Srikanth Reddy
08/12/2024, 9:52 AMcatalog.yaml
files in the same kedro project? If so, how does kedro behave if there are multiple catalog.yaml
files?Yetunde
08/12/2024, 10:20 AMcatalog.yaml
, and the same pattern applies to any other configuration file like parameters.yaml
• You have a few ways to do this:
◦ Start each file with catalog
e.g. catalog_pipeline_1.yaml
and catalog_pipeline_2.yaml
◦ Or put the files into a folder called catalog
e.g. catalog/pipeline_1.yaml
and catalog/pipeline_2.yaml
Here's where this is detailed in the documentation: https://docs.kedro.org/en/stable/configuration/configuration_basics.html#configuration-file-names
And you can see which configuration files allow you to do this: https://docs.kedro.org/en/stable/configuration/configuration_basics.html#configuration-patternsSrikanth Reddy
08/12/2024, 10:43 AMYury Fedotov
08/12/2024, 5:21 PM01_raw
, 02_intermediate
etc, I create one YAML file per layer and then Kedro config loader merges them automatically.Srikanth Reddy
08/12/2024, 7:24 PM