Does Kedro natively support parameters versioning?...
# questionsm
Maxime Steinmetz
03/27/2023, 1:06 PMDoes Kedro natively support parameters versioning? I’d like to know which parameters were used in a run for reproducibility
d
datajoely
03/27/2023, 1:24 PMHave you checked out the Experiment Tracking workflow?
m
Maxime Steinmetz
03/27/2023, 1:58 PMHi, yes I have. From what I understand parameters versioning is made possible because the git info in Kedro Viz maps to the config specified in the source code when pipeline ran.
However, say I override one of the parameters through CLI, is there any way to recover the resulting config? I was expecting "Run Command" in Kedro Viz to be updated accordingly but my testing showed it isn't (is this an issue on my end?).
d
datajoely
03/27/2023, 2:01 PMThe run command is persisted
https://docs.kedro.org/en/stable/_images/experiment-tracking-runs-list.png▾
m
Maxime Steinmetz
03/27/2023, 2:12 PMindeed, but do we expect CLI args to appear in here as well? On my end, running
kedro run --params=some_param:2.5kedro rund
datajoely
03/27/2023, 2:16 PMlet me check if that’s expected
datajoely
03/27/2023, 3:52 PMso this is apparently a known issue - https://github.com/kedro-org/kedro-viz/issues/1020
datajoely
03/27/2023, 3:53 PMthe data is available in the session store sqlite db if you want to poke around there, but it’s not done today.
datajoely
03/27/2023, 3:54 PMWhat I would say is that if you want to save your CLI parameters you could write your own hook the same way we do
kedro-telemetrydatajoely
03/27/2023, 3:54 PMm
Maxime Steinmetz
03/27/2023, 4:13 PMAmazing 👍 thanks a lot
I've exposed the extra params by tweaking the kedro viz code
I think this should be enough for my use case for now. CLI param overrides can be reproduced by rerunning the pipeline with same git commit, and with the same CLI params
🎉 1
K 1
🥳 1
d
datajoely
03/27/2023, 4:20 PMSuper clever!
t
Tynan
03/28/2023, 8:32 AM@Maxime Steinmetz that great! would you want to open a PR in the Kedro-Viz repo for that change? i think it would be very useful to other users
m
Maxime Steinmetz
03/28/2023, 9:46 AM@Tynan I'd be very happy to! I'll get started on this 🙂
d
datajoely
03/28/2023, 9:46 AM❤️
t
Tynan
03/28/2023, 9:46 AMthank you!
5 Views