Hey everyone! I am getting the following error wi...
# questions
s
Hey everyone! I am getting the following error with kedro and I am not sure why conf/base is under site packages Context: I am trying to run a job in Databricks based off the .whl file packaged by Kedro: Kedro Version: 0.18.3 Error:
ValueError: Given configuration path either does not exist or is not a valid directory: /databricks/driver/conf/base
y
Hi @shawn! Let's see if we can help you. I noted you asked a similar question earlier. Is that solution failing?
Other things I have seen other teams do is: • Move
conf
into
src
• Update
settings.py
with the new location And then
kedro package
will package your
conf
because it's there. It's not the best solution because it means you can't update your configuration. We will be working on a way to do this from the CLI.
Hey Shawn, we've addressed this issue in our latest release of Kedro. Please upgrade your project to 0.18.5 and use the
--conf-source
flag for a
kedro run
, it will allow you to specify a source for project configuration for the run.