Ryan Ng
03/09/2023, 8:37 AMdatajoely
03/09/2023, 10:23 AMVersionedDataSet
or the underlying dataset your using to add the key automatically i.e. InferenceParquetDataset
which automatically adds the extra column you describe above when used in your catalog.
• You could do this on a more macro level using Kedro Hooks
• You could also use Kedro’s native experiment tracking as an alternative workflow, but with minimal code changes.Ryan Ng
03/09/2023, 10:27 AM