Hi folks - I am trying to do something very simpl...
# questions
c
Hi folks - I am trying to do something very simple ->. load a json from s3 and I am seeing the following issue:
Copy code
DataSetError: Failed while loading data from data set JSONDataSet().
module 'aiobotocore' has no attribute 'AioSession'
d
which version of Kedro are you running
c
I've tried 0.18.7 0.18.6 0.18.1 0.17.7
d
okay
and can you do a
pip freeze
, I want to see which version of
s3fs
you have
c
yeah i saw that. what's weird is i tried loading it in
kedro ipython
and it loads fine. it's just when i run
kedro run
d
so that suggests you’ve got multiple environments here
c
s3fs
isn't installed
i've tried installing and reinstalling s3f2 0.30 - 0.5.0
d
what platform are you using? Mac/Windows/nix
c
Mac
d
okay in the terminal
c
but will be ubuntu
d
can you type
which python
is that the environment you expect?
c
im in a venv with python3.8.10
d
if you do
which kedro
is it the same place?
c
Copy code
(env) charles_blumenthal@M-C02FG0YFML87 pipeline % which python
/Users/charles_blumenthal/qb-fm-labs-client-poc-techco/env/bin/python
(env) charles_blumenthal@M-C02FG0YFML87 pipeline % which kedro
/Library/Frameworks/Python.framework/Versions/3.8/bin/kedro
(env) charles_blumenthal@M-C02FG0YFML87 pipeline %
Actually not sure if that's right but it seems right to me...
d
yes that’s what I thought
you’ve got multiple kedros installed
and the wrong one is being picked up
c
interesting
i want it to use:
Copy code
/Users/charles_blumenthal/qb-fm-labs-client-poc-techco/env/bin/k
edro
d
yeah
so my suggestion is to try and uninstall the one you don’t want
c
can i set kedro home
d
we’re now not in a Kedro issue, but just a borked Python environment one
once this is resolved things should work
c
halelujah thank you
i
fwiw, if you haven’t been able to sort your environment (usually a bit of a hassle) if you do
python -m kedro ...
it should pick up the correct version of kedro 🙂
103 Views