Hi all, i'm wondering what's the recommended practice to execute runs under multiple combination of parameters (for hyperparameter tuning / ablation studies)? e.g. i'd like to repeat the runs with combinations of parameters such as the following:

for lr in [0.1,0.2,0.3]:
   for hidden_nodes in [10,20,300]:
     for drop_out in [True,False]:
        ## run with the params

If possible, it would be even better to parallelise such independent runs.

Currently, Kedro doesn't offer that functionality directly. However, a method has been outlined at . While Kedro does have a 'multiple runner' plugin for purposes like that, it's not open-source. The Kedro team plans to incorporate this feature in the future.

Using the

KedroSession

and

session.run

would be quite easy to achieve that. You can then inject the parameters into

KedroSession.create(extra_params=<params>)

.

See also a possibly similar discussion here