noam05/21/2023, 2:02 PM
) during a run, the results of the run may be affected. For example, let's say I set
in the terminal. If I change the text in
(for example, if I am setting up the parameters for my next experiment) before the "training" node begins executing, it appears that Kedro will then read hyper_tune: True. In this example, that would mean that Kedro would execute hyperparameter tuning (despite being instructed not to do so at the beginning of the run). Am I missing something? Is the answer as simple as passing all parameters to the pipeline one time as a whole (i.e. using a before_pipeline_runs hook) rather than to each node?
Sajid Alam05/22/2023, 9:41 AM
hook, you can read all the parameters at the beginning of the pipeline run and store them in memory. Then, during the pipeline run, nodes would reference these in-memory parameters, which would be unaffected by changes to the parameter file during the run.