https://kedro.org/ logo
#questions
Title
# questions
y

Yong Bang Xiang

08/30/2023, 10:42 AM
Hi all, i'm wondering what's the recommended practice to execute runs under multiple combination of parameters (for hyperparameter tuning / ablation studies)? e.g. i'd like to repeat the runs with combinations of parameters such as the following:
Copy code
for lr in [0.1,0.2,0.3]:
   for hidden_nodes in [10,20,300]:
     for drop_out in [True,False]:
        ## run with the params
If possible, it would be even better to parallelise such independent runs.
d

Dmitry Sorokin

08/30/2023, 11:25 AM
Currently, Kedro doesn't offer that functionality directly. However, a method has been outlined at

https://www.youtube.com/watch?v=7eRBNra6TVo

. While Kedro does have a 'multiple runner' plugin for purposes like that, it's not open-source. The Kedro team plans to incorporate this feature in the future.
👍 1
n

Nok Lam Chan

08/30/2023, 2:35 PM
Using the
KedroSession
and
session.run
would be quite easy to achieve that. You can then inject the parameters into
KedroSession.create(extra_params=<params>)
.
💯 1
q

quantumtrope

08/30/2023, 5:29 PM
See also a possibly similar discussion here
😯 1
2 Views