charles
04/20/2023, 12:35 PMlocals/parameters.yml
file?
catalog:
parsed_documents: # Just one document for now.
type: json.JSONDataSet
filepath: '<s3://mybucket/${env}/myjson.json>
local/parameters.yml file entry: env: "main"
in kedro ipython trying to load i am getting:
DataSetError: Failed while loading data from data set JSONDataSet(filepath=mybucket/${env}/myjson.json, protocol=s3, save_args={'indent': 2}).
mybucket/${env}/myjson.json
FlorianGD
04/20/2023, 12:37 PMTemplatedConfigLoader
in settings.py
? And have you given a global_path
(from memory, not sure it is the real name, you have commented examples in the file)charles
04/20/2023, 12:38 PMFlorianGD
04/20/2023, 12:40 PMOmegaConfigLoader
, but I do not think it is on by default in 0.18.*
Merel
04/20/2023, 12:56 PMConfigLoader
which doesn’t support any templating. From 0.19.0
we are planning to make the OmegaConfigLoader
the default.charles
04/20/2023, 12:57 PMMerel
04/20/2023, 12:57 PMConfigLoader
doesn’t support templating ${env}
is templating so you’ll need to specifically use the TemplatedConfigLoader
to make that work.charles
04/20/2023, 12:58 PM