Flavien07/31/2023, 3:42 PM
— which works great too — and run different independent pipelines defined on the same project, but I did not manage to do so. I modified the
to account for a
option but I think the problem is in packaging the project which does not take into account pipelines created through
if I am not mistaken (but I probably am). Would you point me towards my mistake? Thanks!
kedro pipeline create
after creation. 😅
datajoely08/01/2023, 8:04 AM
Flavien08/01/2023, 9:17 AM
and you create a pipeline from
, the folder
kedro create pipeline
dos not have
as shown here
While creating a new project from
kedro pipeline create abcdef Creating the pipeline 'abcdef': OK Location: '/tmp/iris/src/iris/pipelines/abcdef' Creating '/tmp/iris/src/tests/pipelines/abcdef/__init__.py': OK Creating '/tmp/iris/src/tests/pipelines/abcdef/test_pipeline.py': OK Creating '/tmp/iris/conf/base/parameters': Creating '/tmp/iris/conf/base/parameters/abcdef.yml': OK Pipeline 'abcdef' was successfully created.
, the folder has indeed the necessary file for packaging
└── src ├── abcdef │ ├── __init__.py │ ├── __main__.py │ ├── pipeline_registry.py │ ├── pipelines │ │ └── __init__.py │ └── settings.py ├── requirements.txt ├── setup.py
is also not present in the starter which is a bit confusing if one follows the documentation on packaging. My humble opinion is that, maybe, it would be clearer to follow the usual structure for
which would also allow for running different pipelines from the same package.
is still a fantastic library.
datajoely08/01/2023, 9:18 AM