If I have a versioned data output and the catalog ...
# questions
t
If I have a versioned data output and the catalog entry is like this:
Copy code
exmaple_df:
  type: pandas.ParquetDataset
  filepath: <s3://s3_bucket/example_file.parquet>
  versioned: True
Is there a kedro catalog entry where I can load in all the versioned data, not just the data save with the most recent date?
👀 1
i
all the data meaning you want every single version? not just a specific version? I don't think so but maybe the partitioned dataset could help? https://docs.kedro.org/en/stable/data/partitioned_and_incremental_datasets.html
👍 1
t
Yeah exactly, we are using versioning to save forecasts made daily. But I would like load all of them to see the changes as the forecast is made day by day. thanks I will have a look at this, I'm currently just loading them in the node using the s3 filepath for the versioned file, but it doesn't feel very kedro-ey
👍 1