Hi everyone I m using Kedro with two main configuration envs Kedro #questions

Hi everyone, I'm using Kedro with two main configu...

R P

03/21/2023, 7:09 PM

Hi everyone, I'm using Kedro with two main configuration envs: "conf/base" and "conf/test", and I'm running

kedro run --env=test

when I need to run a quick pipeline check. However, I have some code in my "settings.py" file that I must not run when I'm using the "conf/test" env, but I'm not managing to get this environment information in the "settings.py" code so I can write a simple if/else condition. What is the best way to do this? Thanks for this awesome open-source tool!

Javier del Villar

03/21/2023, 7:30 PM

hi, what version are you using?

Javier del Villar

03/21/2023, 7:42 PM

In kedro < 0.18 you should use the

TempleatedConfigLoader

hooks.py

in kedro >= 0.18 you need to create a thin layer over the

TempleatedConfigLoader

class to catch that CLI param. https://github.com/kedro-org/kedro/issues/1527#issuecomment-1127697871

datajoely

03/21/2023, 7:54 PM

you could also parameterize the env with the environment variable KEDRO_ENV = test

datajoely

03/21/2023, 7:54 PM

and pick this up in settings.py

R P

03/21/2023, 8:28 PM

Thanks you both for the answers 🙂 And I'm currently using kedro==0.18.6

R P

03/23/2023, 2:33 PM

One more question regarding the suggestion made in that Github issue. If I define that "MyTemplatedConfigLoader" class in the settings.py file, can also access the extra param value I'm passing through the command line also in settings.py?

3 Views

Open in Slack

Previous Next