Hi all, i have recently come across this error `ke...
# questions
c
Hi all, i have recently come across this error
kedro-datasets 1.4.0 does not provide the extra 'pickle.pickledataset'
does kedro-datasets not support pickle datasets ? context - i'm removing
kedro.extras
datasets from our asset codebase and using kedro-datasets
j
hi @CHIRAG WADHWA! I could be wrong but this might be an oversight on kedro-datasets, because the
pickle.PickleDataSet
is defined: https://github.com/kedro-org/kedro-plugins/blob/e8f8e6e3a7798589afa4e5939e944ac2bc7cb87e/kedro-datasets/kedro_datasets/pickle/pickle_dataset.py#L21 @Nok Lam Chan wdyt?
n
@Juan Luis Can you elaborate? I am not sure if I am following
It could be just the heat in LondonπŸ₯΅
🌞 2
j
I see that
kedro
has a
pickle.PickleDataSet
extra, but indeed as @CHIRAG WADHWA says,
kedro_datasets
doesn't, even though the
PickleDataSet
class is present in both
I tried looking to the history of the project to see if it was removed from
kedro_datasets
for some reason but I couldn't find it
n
Oh right, this is about the
setup.py
extras thing.
Let me have a quick look
πŸ‘πŸΌ 1
I am pretty sure it’s an oversight. I will check the two
setup.py
and do a quick fix @CHIRAG WADHWA
c
Thank you @Nok Lam Chan @Juan Luis. Please keep me posted once it is done πŸ’―
j
in the meantime @CHIRAG WADHWA you can install the deps manually by doing
pip install kedro-datasets "compress-pickle[lz4]~=2.1.0"
n
@CHIRAG WADHWA 1.4.1 is out, you can try
pip install kedro-datasets -U
πŸ‘ 1