Hello Kedroids! I'm running into a rather cryptic ...
# questions
b
Hello Kedroids! I'm running into a rather cryptic error: I'm doing a simple
kedro run
on a pipeline that I've already tested on my local M1 mac, but now I'm on a Cloudera Ubuntu VM. The installation goes fine, but then I get the following error:
Copy code
AssertionError: /usr/local/lib/python3.8/distutils/core.py
It appears to come from the following:
Copy code
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /home/cdsw/.local/bin/kedro:5 in <module>                                                        │
│                                                                                                  │
│   2 # -*- coding: utf-8 -*-                                                                      │
│   3 import re                                                                                    │
│   4 import sys                                                                                   │
│ ❱ 5 from kedro.framework.cli import main                                                         │
│   6 if __name__ == '__main__':                                                                   │
│   7 │   sys.argv[0] = re.sub(r'(-script\.pyw|\.exe)?$', '', sys.argv[0])                         │
│   8 │   sys.exit(main())                                                                         │
│                                                                                                  │

...

│ /home/cdsw/.local/lib/python3.8/site-packages/_distutils_hack/__init__.py:64 in                  │
│ ensure_local_distutils                                                                           │
│                                                                                                  │
│    61 │                                                                                          │
│    62 │   # check that submodules load as expected                                               │
│    63 │   core = importlib.import_module('distutils.core')                                       │
│ ❱  64 │   assert '_distutils' in core.__file__, core.__file__                                    │
│    65 │   assert 'setuptools._distutils.log' not in sys.modules                                  │
│    66                                                                                            │
│    67                                                                                            │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
System: • Debian Ubuntu 20.04.6 LTS • Kedro==0.18.12 • Python==3.8.18 Any help would be much appreciated!!
traceback.txt
Full traceback^
d
is it possible to do a different version of python on the cloudera instance
3.9 or 3.10
e
would also do like @datajoely... try to upgrade python version using venv on your local machine and once it wroks ther try is on the VM BTW, have you tried to run a simple pipeline on the VM (to verify that kedro runs on it as all)
b
The solution that worked for us was setting
Copy code
export SETUPTOOLS_USE_DISTUTILS=stdlib
before installation
🥳 1
d
oh that’s horrible! thanks for posting the solution @Ben Levy
b
Haha it truly was