Hi all, is there an equivalent to pandas.ParquetDa...
# questions
j
Hi all, is there an equivalent to pandas.ParquetDataset for Polars?
d
Polars supports generic backends so parquet support doesn’t need a different dataset
j
I've tried polars.GenercDatateset but it doesn't work
j
@Jeraime Griffith I use it all the time! what’s the issue you have? could you share the traceback?
j
"/Users/corkhill/opt/miniconda3/envs/mykedro/lib/python3.10/site-packages/kedro/io/core.py", line 156, in from_config raise DatasetError( kedro.io.core.DatasetError: An exception occurred when parsing config for dataset 'positioning': Class 'polars.GenericDataset' not found, is this a typo?
j
I now remember that we renamed it. do
pip install "kedro-datasets>=3.0"
and use
polars.EagerPolarsDataset
instead https://docs.kedro.org/projects/kedro-datasets/en/kedro-datasets-3.0.1/api/kedro_datasets.polars.EagerPolarsDataset.html
🥳 2
j
Thanks a lot. Much appreciated.
🙏🏼 1