https://kedro.org/ logo
#questions
Title
# questions
c

CHIRAG WADHWA

06/13/2023, 4:34 AM
Hi all, i have recently come across this error
kedro-datasets 1.4.0 does not provide the extra 'pickle.pickledataset'
does kedro-datasets not support pickle datasets ? context - i'm removing
kedro.extras
datasets from our asset codebase and using kedro-datasets
j

Juan Luis

06/13/2023, 7:29 AM
hi @CHIRAG WADHWA! I could be wrong but this might be an oversight on kedro-datasets, because the
pickle.PickleDataSet
is defined: https://github.com/kedro-org/kedro-plugins/blob/e8f8e6e3a7798589afa4e5939e944ac2bc7cb87e/kedro-datasets/kedro_datasets/pickle/pickle_dataset.py#L21 @Nok Lam Chan wdyt?
n

Nok Lam Chan

06/13/2023, 10:06 AM
@Juan Luis Can you elaborate? I am not sure if I am following
It could be just the heat in LondonπŸ₯΅
🌞 2
j

Juan Luis

06/13/2023, 10:07 AM
I see that
kedro
has a
pickle.PickleDataSet
extra, but indeed as @CHIRAG WADHWA says,
kedro_datasets
doesn't, even though the
PickleDataSet
class is present in both
I tried looking to the history of the project to see if it was removed from
kedro_datasets
for some reason but I couldn't find it
n

Nok Lam Chan

06/13/2023, 10:08 AM
Oh right, this is about the
setup.py
extras thing.
Let me have a quick look
πŸ‘πŸΌ 1
I am pretty sure it’s an oversight. I will check the two
setup.py
and do a quick fix @CHIRAG WADHWA
c

CHIRAG WADHWA

06/13/2023, 10:12 AM
Thank you @Nok Lam Chan @Juan Luis. Please keep me posted once it is done πŸ’―
j

Juan Luis

06/13/2023, 10:17 AM
in the meantime @CHIRAG WADHWA you can install the deps manually by doing
pip install kedro-datasets "compress-pickle[lz4]~=2.1.0"
n

Nok Lam Chan

06/13/2023, 5:23 PM
@CHIRAG WADHWA 1.4.1 is out, you can try
pip install kedro-datasets -U
πŸ‘ 1