https://kedro.org/ logo
#questions
Title
# questions
e

Eluard Camota

10/27/2023, 1:48 PM
Hello everyone, I do have a question on pipeline registry, how can I specify the order of the pipeline to execute?
Or better question is how do I connect the disconnected pipelines on pipeline__registry.py
n

Nok Lam Chan

10/27/2023, 2:00 PM
Can you explain what you are trying to do? It may help to understand the context better since these 2 questions are quite different
e

Eluard Camota

10/27/2023, 2:18 PM
I have 3 different pipelines created using
kedro pipeline create
. Those pipelines are disconnected since it doesn't contain the output from the previous nodes. So what, I'm trying to do is to register those 3 different pipelines on the
pipeline_registry.py
and connect each pipeline after another pipeline
n

Nok Lam Chan

10/27/2023, 2:27 PM
I see - so you just want to run all pipelines together right?
You don’t need to do anything special, pipelines can be disconnected. In your
pipeline_registry.py
, you can add
pipelines["all"] = pipelines["a"] + pipelines["b"] + pipelines"[c"]
(or whatever name you preferred)
You can then run
kedro viz
to confirm it - they should be just 3 parallel pipelines
e

Eluard Camota

10/27/2023, 2:35 PM
for example, pipeline["b"] should only run once pipeline["a"] is done running
and pipeline["c"] will run only after pipeline["b"] is finished
n

Nok Lam Chan

10/27/2023, 4:07 PM
what does these pipeline do and why it has to be run after another pipeline without any explicit dependencies?
the execution order is determined by Node dependencies, that is a node has some input and output, Kedro then try to resolve this graph. If you need to guarantee this order, then your last node of pipeline_a should produce something that the first node of pipeline_b would take.
e

Eluard Camota

10/27/2023, 4:23 PM
Thanks for the response