Hello good afternoon I was adding a catalog item from a data

Question

Hello good afternoon I was adding a catalog item from a database that has timeseries data and I wanted to have a dynamic param so when I run the code It retrieves the data regarding a certain day I ran into this post <https github com kedro org kedro issues 1089> But I am failing to understand what is the reasoning behind I would like to understand what would be the approach in kedro Loading the whole table from sql and then run the transformations in code But that would make quite inefficient when running in production

datajoely · Answer

hey this is possible but it s not encouraged since you lose reproducibility

datajoely · Answer

but you can use templated config to have the data param in `globals yml`

datajoely · Answer

you can then use a hook to inject a CLI argument into that if you really want

Javier Hernandez · Answer

but my initial thought on this is that dynamic parameters is obtained with code with another node Could I use the after node run to set this dynamic parameter in the catalog

datajoely · Answer

so when you get into that territory you are breaking some of Kedro s key design decisions

datajoely · Answer

because we re striving for reproducibility we don t like conditional logic an the nodes shouldn t be aware of IO

datajoely · Answer

it s a tricky one because there are valid reasons users want to do this but it s an area Kedro has been designed to not enable

Javier Hernandez · Answer

so the kedro approach is to have a static catalog entries

datajoely · Answer

it was designed that way initially

datajoely · Answer

now there are ways to do what you re looking for but it involves hooks like you say

Javier Hernandez · Answer

thanks for the answer

Javier Hernandez · Answer

It s now more clear to me