https://kedro.org/ logo
#questions
Title
# questions
u

3loy3loy

03/06/2024, 3:44 PM
Does anyone know why when I do catalog.load on a versioned PickleDataset it is not loading the latest version but the third one of five?
d

Deepyaman Datta

03/06/2024, 3:46 PM
Dumb question—how do you know it's loading the third one?
u

3loy3loy

03/06/2024, 3:46 PM
I pickle loaded them directly in my notebook one by one
I mean most probably I am doing something wrong but I am not sure what it can be
d

Deepyaman Datta

03/06/2024, 3:50 PM
There's no reason this should be happening. That said, I suppose you could try modifying your Kedro installation to spit out the filepath it's loading from, just to confirm. (Not 100% trivial, but if you want to investigate, I can suggest how to do it.)
👍 1
n

Nok Lam Chan

03/06/2024, 7:12 PM
Did you keep the same catalog while having many kedro runs? Does the result change after you run
%reload_kedro
?
I think that's the caching behavior of Kedro, which was created to ensure the same load version is used throughout the same session. But I would confirm
%reload_kedro
works as expected first.
👀 1
u

3loy3loy

03/07/2024, 7:59 AM
It was a bad mix of different datasets having similar structures + I was reading the name of the function used inside the node (in bold pink) instead of the name of the node, my fault. I would recommend highlighting more the name of the node. Thank you for your patience, I like Kedro a lot!
👀 1
thankyou 1
n

Nok Lam Chan

03/07/2024, 10:15 AM
Gotcha, I have similar thoughts after we introduce the %load_node magic, there are some complexity because not all nodes has a custom name and the auto generated one is not human readable. One more thing for us to consider.
3 Views