https://kedro.org/ logo
#questions
Title
# questions
j

Jose Alejandro Montaña Cortes

11/01/2022, 4:11 PM
Hi everyone, i am developing a pipeline of training which has some parameters set by default. I have a question about what are the best practices for running multiple times the same pipeline but with multiple parameters. I am currently using a bash script that runs “kedro run” with the flag “--params”. I am doing this because i want to register each experiment. However it does not fell quite right and i was wondering if it is possible to run multiple times a pipeline varying the parameters via a hook implementation or should i use a modular pipeline and register all the parameters in the yaml file. (i think this solutions is not quite practical ) but i would like to know if there is a “Better” way of doing these kind of things
👍 1
n

Nok Lam Chan

11/02/2022, 7:30 PM
I think it’s better to have the run separately as you need to have 1 run as 1 experiment. This depends on what kind of experiment tracking tools you are using.
If you are using the Python API
KedroSession
, it should be easy to read parameters and go through a loop to execute all the runs. This is almost equivalent to run a bash script.
j

Jose Alejandro Montaña Cortes

11/02/2022, 8:41 PM
Ok thanks for your help 😄
2 Views