Marc Gris
08/11/2023, 12:45 PMkedro ipython :
Is there a way to specify /override the conf_source ? 🙂
ThxFlavien
08/11/2023, 12:59 PM--env, you can use the environment you wish.Ankita Katiyar
08/11/2023, 1:03 PMCONF_SOURCE in settings.py , I believeFlavien
08/11/2023, 1:04 PMMarc Gris
08/11/2023, 1:05 PMMarc Gris
08/11/2023, 1:12 PMconf and data as follow:
conf
└── client_A
├── base
└── local
└── client_B
├── base
└── local
data
├── client_A
│ └── 01_raw
│ └── 02_intermediate
│ └── ...
└── client_B
│ └── 01_raw
│ └── 02_intermediate
│ └── ...conf
I did so because I liked the idea of not being able to run the pipeline without being explicit about which client it should be done for…
(the structure above makes it so that kedro run without --conf-source will raise an error)
Another reason I did so (if I recall correctly) was to avoid having “duplicate keys” conflicts in the different yaml files across clients…Nok Lam Chan
08/11/2023, 1:37 PMreload_kedro magic, similarly you can do reload_kedro --env=prodNok Lam Chan
08/11/2023, 1:37 PMNok Lam Chan
08/11/2023, 1:39 PMAnkita Katiyar
08/11/2023, 1:42 PMMarc Gris
08/11/2023, 2:31 PMkedro viz
It doesn’t have a conf-source param and kedro viz --env client_A/base does not work.
Am I just being “a pain” or does this sound like a legit expectation 🙂Nok Lam Chan
08/11/2023, 2:38 PMMarc Gris
08/11/2023, 2:46 PMNok Lam Chan
08/11/2023, 2:54 PMMarc Gris
08/11/2023, 3:01 PMMarc Gris
08/11/2023, 3:38 PM