Sergey S11/14/2023, 12:10 AM
class KedroCocoDataset(AbstractDataset): ...
However in the notebook (started by
coco_dataset: type: kedro-example.datasets.KedroCocoDataset filepath: data/01_raw/014-playment-parts-100-images-variant-a.json
) when running
kedro jupyter lab
I get an error:
Any help is appreciated.
DatasetError: An exception occurred when parsing config for dataset 'coco_dataset': Class 'kedro-example.datasets.KedroCocoDataset' not found or one of its dependencies has not been installed.
marrrcin11/14/2023, 7:50 AM
? Looks like a Python-level issue rather than Kedro issue.
Nok Lam Chan11/14/2023, 8:46 AM
, this is a python convention you cannot have
as a namespace. p.s. Most notable example is probably
, you do
but you do
pip install scikit-learn
this should be handled properly, if not then it’s a bug on our side👀
I quickly test it with the latest release, it is working as expected.
The project name 'kedro-example' has been applied to: - The project title in /Users/Nok_Lam_Chan/GitHub/kedro/kedro-example/README.md - The folder created for your project in /Users/Nok_Lam_Chan/GitHub/kedro/kedro-example - The project's python package in /Users/Nok_Lam_Chan/GitHub/kedro/kedro-example/src/kedro_example
Lukas Innig11/14/2023, 10:23 AM
Nok Lam Chan11/14/2023, 10:41 AM
Sergey S11/14/2023, 12:14 PM
in the code. The issue #2 remains. I followed the project structure of the
directory) and my test pipeline works 🥳 However if I move
to a sub directory called
(see image below) I am getting an error of
The issue seems to be that
ValueError: Pipeline contains no nodes after applying all provided filters
does not find my pipeline if its defined in a sub folder. If I manually import my pipeline (
from the sub-directory and manually assign it (
from kedro_example.pipelines.pipeline import create_pipeline)
) then everything works.
pipelines["__default__"] = create_pipeline()
example, I've added
from .pipeline import create_pipeline
in the pipelines directory but that did not help when using
pipelines = find_pipelines()
Defining my pipeline inside
src/ kedro-proj/ pipelines/ data_processing/ __init__.py # with 'from .pipeline import create_pipeline' pipeline.py nodes.py
directory does not work:
src/ kedro-proj/ pipelines/ __init__.py # with 'from .pipeline import create_pipeline' pipeline.py nodes.py
Nok Lam Chan11/14/2023, 1:32 PM
Sergey S11/14/2023, 7:52 PM
recursively iterates over the whole
folder to find my pipelines. It requiring a default folder structure makes sense as to why it didn't work, thanks!
Nok Lam Chan11/15/2023, 9:49 AM