was trying out Kedro-Databricks on a simple projec...
# questions
j
was trying out Kedro-Databricks on a simple project and the job got stuck for 15 minutes before I killed it, has it happened to anyone?
h
Someone will reply to you shortly. In the meantime, this might help:
n
^is the job request stuck or is the job created successfully but stuck during execution? Can you see the job on Databricks portal?
j
hmmm actually after 24 minutes (!) it failed with an error that happened quite early in the process
Copy code
MissingConfigException: Given configuration path either does not exist or is not a valid directory: /dbfs/FileStore/spaceflights/conf/base
so there's • an issue with how the config got sent to FileStore • an issue with tasks lingering for a very long time before logs are shown 🤔