saeed choobani
10/05/2023, 1:59 PMpolars
to our kedro
pipeline, but I don't want to make a data catalog load files only with polars (type: polars.CSVDataSet
); doing so, everyone else must load it as polars
too.
Is there a way in kedro
to be able to use both formats in some way or should I create a custom dataset?Jose Nuñez
10/05/2023, 2:11 PMpolars
and one for (let's say) pandas
but both pointing to the same .csv
file.
Then the user can choose which one to use when loading data to a notebook (for instance)marrrcin
10/05/2023, 2:13 PMmy_dataframe@pandas:
type: pandas.CSVDataSet
filepath: data.csv
my_dataframe@polars:
type: POLARS
filepath: data.csv
saeed choobani
10/05/2023, 2:14 PM