https://kedro.org/ logo
#questions
Title
# questions
m

Maxime Steinmetz

03/27/2023, 1:06 PM
Does Kedro natively support parameters versioning? I’d like to know which parameters were used in a run for reproducibility
d

datajoely

03/27/2023, 1:24 PM
Have you checked out the Experiment Tracking workflow?
m

Maxime Steinmetz

03/27/2023, 1:58 PM
Hi, yes I have. From what I understand parameters versioning is made possible because the git info in Kedro Viz maps to the config specified in the source code when pipeline ran. However, say I override one of the parameters through CLI, is there any way to recover the resulting config? I was expecting "Run Command" in Kedro Viz to be updated accordingly but my testing showed it isn't (is this an issue on my end?).
d

datajoely

03/27/2023, 2:01 PM
The run command is persisted

https://docs.kedro.org/en/stable/_images/experiment-tracking-runs-list.png

m

Maxime Steinmetz

03/27/2023, 2:12 PM
indeed, but do we expect CLI args to appear in here as well? On my end, running
kedro run --params=some_param:2.5
still yields
kedro run
in Kedro Viz
d

datajoely

03/27/2023, 2:16 PM
let me check if that’s expected
so this is apparently a known issue - https://github.com/kedro-org/kedro-viz/issues/1020
the data is available in the session store sqlite db if you want to poke around there, but it’s not done today.
What I would say is that if you want to save your CLI parameters you could write your own hook the same way we do
kedro-telemetry
https://github.com/kedro-org/kedro-plugins/blob/main/kedro-telemetry/kedro_telemetry/plugin.py
m

Maxime Steinmetz

03/27/2023, 4:13 PM
Amazing 👍 thanks a lot I've exposed the extra params by tweaking the kedro viz code I think this should be enough for my use case for now. CLI param overrides can be reproduced by rerunning the pipeline with same git commit, and with the same CLI params
🥳 1
K 1
🎉 1
d

datajoely

03/27/2023, 4:20 PM
Super clever!
t

Tynan

03/28/2023, 8:32 AM
@Maxime Steinmetz that great! would you want to open a PR in the Kedro-Viz repo for that change? i think it would be very useful to other users
m

Maxime Steinmetz

03/28/2023, 9:46 AM
@Tynan I'd be very happy to! I'll get started on this 🙂
d

datajoely

03/28/2023, 9:46 AM
❤️
t

Tynan

03/28/2023, 9:46 AM
thank you!
2 Views