hello, I'm trying see if the following functionality exists for versioned datasets:
1. list all available versions of the catalog item
2. limit the number of versions created of this dataset, ie - limit is 10, clean up the oldest 11th version when I save a newer version
im looking at hooks but it doesn't seem easily done?
I'm trying to load the last version of my dataset to compare with the new dataframe, and then clean up old versions based on a limit. seems like a custom dataset implementation is the path forward
03/24/2023, 12:02 PM
in the hook you can get the
and introspect from there
but custom dataset should work too
03/24/2023, 2:26 PM
i ended up implementing hook for after node run. thanks for all the help
03/24/2023, 2:58 PM
If you don't mind, feel free to throw your hook implementation on that issue above; it is something that comes up every now and then, so I'm sure it would be appreciated!