Hello, Does kedro allow more than one `catalog.ya...
# questions
s
Hello, Does kedro allow more than one
catalog.yaml
files in the same kedro project? If so, how does kedro behave if there are multiple
catalog.yaml
files?
y
Hi @Srikanth Reddy! Thanks for your question. Let me see if I can help you: • Yes, Kedro allows more than one
catalog.yaml
, and the same pattern applies to any other configuration file like
parameters.yaml
• You have a few ways to do this: ◦ Start each file with
catalog
e.g.
catalog_pipeline_1.yaml
and
catalog_pipeline_2.yaml
◦ Or put the files into a folder called
catalog
e.g.
catalog/pipeline_1.yaml
and
catalog/pipeline_2.yaml
Here's where this is detailed in the documentation: https://docs.kedro.org/en/stable/configuration/configuration_basics.html#configuration-file-names And you can see which configuration files allow you to do this: https://docs.kedro.org/en/stable/configuration/configuration_basics.html#configuration-patterns
s
Thanks a lot @Yetunde ! This helps
🥳 1
y
@Srikanth Reddy What I like to do on every Kedro project is to split catalog by layers. As Kedro data folder by default consists of
01_raw
,
02_intermediate
etc, I create one YAML file per layer and then Kedro config loader merges them automatically.
s
Thanks @Yury Fedotov !!