Join Slack
Powered by
Hi! Can Kedro pass generator objects between the n...
# questions
y
Yury Fedotov
02/26/2025, 3:44 PM
Hi! Can Kedro pass generator objects between the nodes?
h
Hall
02/26/2025, 3:53 PM
Someone will reply to you shortly. In the meantime, this might help:
d
datajoely
02/26/2025, 5:33 PM
I think so
https://docs.kedro.org/en/stable/nodes_and_pipelines/nodes.html#how-to-use-generator-functions-in-a-node
n
Nok Lam Chan
02/27/2025, 1:24 PM
Yes - it's a less explored pattern but this was added a year or two ago. Traditionally lazy loading is only possible with
PartitionedDataset
, which can be done with generator now.
❤️ 1
2
Views
Open in Slack
Previous
Next