Aayush08/24/2023, 3:31 AM
Deepyaman Datta08/24/2023, 5:06 AM
should then be consumed by the next node. There are also more sophisticated ways to do this; e.g. https://github.com/deepyaman/kedro-accelerator (for inspiration, not currently maintained/not compatible out of the box with Kedro 0.18.x AFAIK).
Aayush08/24/2023, 6:29 AM
Lodewic van Twillert08/24/2023, 7:48 AM
does? 🤔 Haven't used it myself, but this seems like the right usecase https://docs.kedro.org/en/stable/kedro.io.CachedDataset.html
Deepyaman Datta08/24/2023, 1:56 PM
is the way to go for this specifically. Thanks @Lodewic van Twillert!!