Marc Gris
08/11/2023, 12:45 PMkedro ipython
:
Is there a way to specify /override the conf_source
? 🙂
ThxFlavien
08/11/2023, 12:59 PM--env
, you can use the environment you wish.Ankita Katiyar
08/11/2023, 1:03 PMCONF_SOURCE
in settings.py
, I believeFlavien
08/11/2023, 1:04 PMMarc Gris
08/11/2023, 1:05 PMconf
and data
as follow:
conf
└── client_A
├── base
└── local
└── client_B
├── base
└── local
data
├── client_A
│ └── 01_raw
│ └── 02_intermediate
│ └── ...
└── client_B
│ └── 01_raw
│ └── 02_intermediate
│ └── ...conf
I did so because I liked the idea of not being able to run the pipeline without being explicit about which client it should be done for…
(the structure above makes it so that kedro run
without --conf-source
will raise an error)
Another reason I did so (if I recall correctly) was to avoid having “duplicate keys” conflicts in the different yaml files across clients…Nok Lam Chan
08/11/2023, 1:37 PMreload_kedro
magic, similarly you can do reload_kedro --env=prod
Ankita Katiyar
08/11/2023, 1:42 PMMarc Gris
08/11/2023, 2:31 PMkedro viz
It doesn’t have a conf-source
param and kedro viz --env client_A/base
does not work.
Am I just being “a pain” or does this sound like a legit expectation 🙂Nok Lam Chan
08/11/2023, 2:38 PMMarc Gris
08/11/2023, 2:46 PMNok Lam Chan
08/11/2023, 2:54 PMMarc Gris
08/11/2023, 3:01 PM