CHIRAG WADHWA
06/13/2023, 4:34 AMkedro-datasets 1.4.0 does not provide the extra 'pickle.pickledataset'
does kedro-datasets not support pickle datasets ?
context - i'm removing kedro.extras
datasets from our asset codebase and using kedro-datasetsJuan Luis
06/13/2023, 7:29 AMpickle.PickleDataSet
is defined:
https://github.com/kedro-org/kedro-plugins/blob/e8f8e6e3a7798589afa4e5939e944ac2bc7cb87e/kedro-datasets/kedro_datasets/pickle/pickle_dataset.py#L21
@Nok Lam Chan wdyt?Nok Lam Chan
06/13/2023, 10:06 AMJuan Luis
06/13/2023, 10:07 AMkedro
has a pickle.PickleDataSet
extra, but indeed as @CHIRAG WADHWA says, kedro_datasets
doesn't, even though the PickleDataSet
class is present in bothkedro_datasets
for some reason but I couldn't find itNok Lam Chan
06/13/2023, 10:08 AMsetup.py
extras thing.setup.py
and do a quick fix @CHIRAG WADHWACHIRAG WADHWA
06/13/2023, 10:12 AMJuan Luis
06/13/2023, 10:17 AMpip install kedro-datasets "compress-pickle[lz4]~=2.1.0"
Nok Lam Chan
06/13/2023, 5:23 PMpip install kedro-datasets -U