Rahul Kumar
07/27/2023, 8:57 AMJuan Luis
07/27/2023, 9:08 AMThe main reason we haven't implemented this functionality yet, is because it's very complex.more discussion in https://github.com/kedro-org/kedro/issues/2043, current issue https://github.com/kedro-org/kedro/issues/2115
Deepyaman Datta
07/27/2023, 1:52 PMJuan Luis
07/27/2023, 1:55 PMRahul Kumar
07/27/2023, 3:47 PMNok Lam Chan
07/27/2023, 4:30 PMchoose between versioning of the PartitionedDataSet as a whole, or of the underlying dataset.I believe treating the whole dataset as a whole will be easier for implementation, but might not be the most efficient way to store the data?
Deepyaman Datta
07/27/2023, 4:36 PMversioned: true
be set on the top-level dataset
2. versioning the underlying dataset with that key
I would be down to close this out in a tech design session or something.