Matthias Roels
08/31/2023, 12:03 PMdatajoely
08/31/2023, 12:16 PMmarrrcin
08/31/2023, 12:33 PMpyspark==3.4.1
and SparkDataSet from kedro.extras: https://github.com/kedro-org/kedro/blob/0293dc15812b27330bba31a01c7b332b3165af2a/kedro/extras/datasets/spark/spark_dataset.py
(Kedro 0.18.12), haven’t tested with kedro-datasets
though.datajoely
08/31/2023, 12:37 PMMatthias Roels
08/31/2023, 12:40 PMdatajoely
08/31/2023, 12:42 PMSajid Alam
08/31/2023, 1:23 PMpyproject.toml
and setup.py
midway through the ticket.datajoely
08/31/2023, 1:30 PMMatthias Roels
08/31/2023, 2:11 PMSajid Alam
08/31/2023, 2:12 PMdatajoely
08/31/2023, 2:33 PMMatthias Roels
08/31/2023, 3:31 PMSajid Alam
08/31/2023, 3:33 PM