Abhishek Bhatia
04/15/2024, 1:06 PMkedro>=0.19
, but struggling with getting my catalog and parameters being discovered by OmegaConfigLoader
The folder structure for parameters
is something like this (same for catalog)
conf/base/
└── parameters/
├── <usecase1>/
│ └── usecase1.yml
└── <usecase2>/
├── <usecase2a>/
│ ├── usecase2a_1.yml
│ └── usecase2a_2.yml
└── <usecase2b>/
└── usecase2b.yml
This used to work with kedro<0.19
and OmegaConfigLoader
, but now I am really struggling with how to set the glob pattern for:
1. Discovering catalog in any folder depth as long as they are under a folder named catalog
2. Discovering parameters in any folder depth as long as they are under a folder named parameters
3. Discovering catalog globals (where to place them?)
4. Discovering parameter globals (where to place them?)
Thanks! 🙂Merel
04/15/2024, 1:17 PMOmegaConfigLoader
between pre and post 0.19.0
, (right @Ankita Katiyar? ). Can you share the error you're seeing?Merel
04/15/2024, 1:20 PMAnkita Katiyar
04/15/2024, 1:22 PMAbhishek Bhatia
04/15/2024, 1:48 PMkedro<0.18
but breaks in kedro>=0.19
Ankita Katiyar
04/15/2024, 1:59 PMCONFIG_LOADER_ARGS
in settings.py
?Ankita Katiyar
04/15/2024, 2:00 PMbase_env
and default_run_env
in CONFIG_LOADER_ARGS
along with the other things you were passing 🤔Abhishek Bhatia
04/15/2024, 2:07 PMAbhishek Bhatia
04/15/2024, 2:20 PMAbhishek Bhatia
04/15/2024, 2:25 PMkedro>=0.19.0
- [x] Add dependency kedro_dataset>=3.0.0
- [x] Move kedro dataset imports to kedro_datasets
- [x] DataSet to Dataset in catalog
- [x] DataSet to Dataset when importing
- [x] Move layer to metadata.layer in catalog
- [x] Update settings.py since now OmegaConfigLoader
is default
- [x] Clean node tags to contain only letters, digits, hyphens, underscores and/or fullstops.