https://kedro.org/ logo
#questions
Title
# questions
v

Vladimir Filimonov

11/02/2022, 1:56 PM
Hey everyone. I’m having troubles running
make test-no-spark
on kedro source code. 6 tests failing and seems like all of them related to parallel task runner. Have anyone had similar issue? My current hypothesis that it all fails due to
ModuleNotFoundError: No module named 'tests.runner'
. But wondering what might’ve caused an issue. Here is list of tests failed:
Copy code
FAILED tests/framework/cli/test_cli.py::TestRunCommand::test_run_successfully_parallel - assert not 1
FAILED tests/framework/session/test_session_extension_hooks.py::TestNodeHooks::test_on_node_error_hook_parallel_runner - assert 0 == 2
FAILED tests/framework/session/test_session_extension_hooks.py::TestNodeHooks::test_before_and_after_node_run_hooks_parallel_runner - assert 0 == 2
FAILED tests/framework/session/test_session_extension_hooks.py::TestDataSetHooks::test_before_and_after_dataset_loaded_hooks_parallel_runner - as...
FAILED tests/framework/session/test_session_extension_hooks.py::TestDataSetHooks::test_before_and_after_dataset_saved_hooks_parallel_runner - ass...
FAILED tests/framework/session/test_session_extension_hooks.py::TestBeforeNodeRunHookWithInputUpdates::test_correct_input_update_parallel - asser...
FAILED tests/framework/session/test_session_extension_hooks.py::TestBeforeNodeRunHookWithInputUpdates::test_broken_input_update_parallel - Failed...
And here is failure of test in
test_cli.py
reporting ModuleNotFound:
Copy code
╭───────────────────── Traceback (most recent call last) ──────────────────────╮
│ <string>:1 in <module>                            │
│                                       │
│ /Users/Vladimir_Filimonov/opt/anaconda3/envs/kedro-environment/lib/python3.8 │
│ /multiprocessing/spawn.py:116 in spawn_main                 │
│                                       │
│  113 │  │  resource_tracker._resource_tracker._fd = tracker_fd      │
│  114 │  │  fd = pipe_handle                        │
│  115 │  │  parent_sentinel = os.dup(pipe_handle)             │
│ ❱ 116 │  exitcode = _main(fd, parent_sentinel)               │
│  117 │  sys.exit(exitcode)                         │
│  118                                    │
│  119                                    │
│                                       │
│ /Users/Vladimir_Filimonov/opt/anaconda3/envs/kedro-environment/lib/python3.8 │
│ /multiprocessing/spawn.py:126 in _main                    │
│                                       │
│  123 │  │  try:                              │
│  124 │  │  │  preparation_data = reduction.pickle.load(from_parent)   │
│  125 │  │  │  prepare(preparation_data)                 │
│ ❱ 126 │  │  │  self = reduction.pickle.load(from_parent)         │
│  127 │  │  finally:                            │
│  128 │  │  │  del process.current_process()._inheriting         │
│  129 │  return self._bootstrap(parent_sentinel)              │
╰──────────────────────────────────────────────────────────────────────────────╯
ModuleNotFoundError: No module named 'tests.runner'
K 1
n

Nok Lam Chan

11/02/2022, 2:23 PM
hi @Vladimir Filimonov, What happen if you execute the failing tests directly?
Copy code
pytest tests/framework/cli/test_cli.py
v

Vladimir Filimonov

11/02/2022, 2:52 PM
Hey @Nok Lam Chan. thanks for looking into that. when ran directly tests in
test_cli.py
pass, only complain about coverage target miss
n

Nok Lam Chan

11/02/2022, 3:03 PM
Do you run from the root directory? I suppose it is otherwise make won’t work anyway.
I just test it locally and it works fine - using MacOS
v

Vladimir Filimonov

11/02/2022, 3:04 PM
sure, I ran both
make test-no-spark
and
pytest tests/framework/cli/test_cli.py
from the root directory of the git repo
I’m on MacOS too. another colleague of mine also on MacOS getting same symptoms
n

Nok Lam Chan

11/02/2022, 3:05 PM
Are you on M1/M2?
I have a intel one, I know someone has issues with M2 but I don’t know exactly what it is.
v

Vladimir Filimonov

11/02/2022, 3:07 PM
Intel, 2019 model
let me try debugging it further
👍 1
n

Nok Lam Chan

11/02/2022, 7:26 PM
Let us know if it doesn’t work, worst case when you submit PR the CI will still do the checking, so it isn’t too bad if it’s just failing a couple of them locally.
7 Views