saeed choobani
10/05/2023, 1:59 PMpolars to our kedro pipeline, but I don't want to make a data catalog load files only with polars (type: polars.CSVDataSet); doing so, everyone else must load it as polars too.
Is there a way in kedro to be able to use both formats in some way or should I create a custom dataset?Jose Nuñez
10/05/2023, 2:11 PMpolars and one for (let's say) pandas but both pointing to the same .csv file.
Then the user can choose which one to use when loading data to a notebook (for instance)Jose Nuñez
10/05/2023, 2:12 PMmarrrcin
10/05/2023, 2:13 PMmarrrcin
10/05/2023, 2:14 PMmy_dataframe@pandas:
type: pandas.CSVDataSet
filepath: data.csv
my_dataframe@polars:
type: POLARS
filepath: data.csvsaeed choobani
10/05/2023, 2:14 PM