Hi Kedro Team,
I try to extend a partitioned dataset and would like to include multiple suffixes, e.g. "1.csv", "2.csv" but exclude all the rest. However, simply passing a list to filename_suffix in the catalog doesn't work. Is there an elegant way to achieve this?
d
datajoely
03/25/2024, 10:40 AM
I think the fastest way to do this is to build a custom version of our
PartitionedDataSet
, either through subclassing or copying the code into your project
👍 2
datajoely
03/25/2024, 10:41 AM
you may be able to do some omegaconf magic here but I don’t think it’s clean