charles
04/20/2023, 12:35 PMlocals/parameters.yml file?
catalog:
parsed_documents: # Just one document for now.
type: json.JSONDataSet
filepath: '<s3://mybucket/${env}/myjson.json>
local/parameters.yml file entry: env: "main"
in kedro ipython trying to load i am getting:
DataSetError: Failed while loading data from data set JSONDataSet(filepath=mybucket/${env}/myjson.json, protocol=s3, save_args={'indent': 2}).
mybucket/${env}/myjson.jsonFlorianGD
04/20/2023, 12:37 PMTemplatedConfigLoader in settings.py ? And have you given a global_path (from memory, not sure it is the real name, you have commented examples in the file)charles
04/20/2023, 12:38 PMFlorianGD
04/20/2023, 12:40 PMOmegaConfigLoader , but I do not think it is on by default in 0.18.*Merel
04/20/2023, 12:56 PMConfigLoader which doesn’t support any templating. From 0.19.0 we are planning to make the OmegaConfigLoader the default.charles
04/20/2023, 12:57 PMMerel
04/20/2023, 12:57 PMConfigLoader doesn’t support templating ${env} is templating so you’ll need to specifically use the TemplatedConfigLoader to make that work.charles
04/20/2023, 12:58 PMcharles
04/20/2023, 12:58 PM