https://kedro.org/ logo
#questions
Title
# questions
m

Marc Gris

07/06/2023, 3:26 PM
Hi again, Does the
ParallelRunner
really only parallelize nodes, or does it actually also parallelize modular / namespace pipelines ? Thx M
d

datajoely

07/06/2023, 3:30 PM
node level
m

Marc Gris

07/06/2023, 3:59 PM
Ok. Just to be sure that I get really get this correctly. Let’s assume 2 namespace pipelines, A & B. Running
kedro run --runner=ParallelRunner
will result in something like: • Run pipeline A’s nodes in parallel • then • Run pipeline B’s nodes in parallel Is that correct ?
d

datajoely

07/06/2023, 4:03 PM
so the parallel runner isn’t namespace aware, it will just run what it can in paralell
if you know that the namespaces are mutually exclusive you could do
kedro run --runner=ParallelRunner --namespace=A && kedro run --runner=ParallelRunner --namespace=B
m

Marc Gris

07/06/2023, 4:07 PM
Ok. Great ! Thx for the clarifications.