Hi again, Does the `ParallelRunner` really only p...
# questions
m
Hi again, Does the
ParallelRunner
really only parallelize nodes, or does it actually also parallelize modular / namespace pipelines ? Thx M
d
node level
m
Ok. Just to be sure that I get really get this correctly. Let’s assume 2 namespace pipelines, A & B. Running
kedro run --runner=ParallelRunner
will result in something like: • Run pipeline A’s nodes in parallel • then • Run pipeline B’s nodes in parallel Is that correct ?
d
so the parallel runner isn’t namespace aware, it will just run what it can in paralell
if you know that the namespaces are mutually exclusive you could do
kedro run --runner=ParallelRunner --namespace=A && kedro run --runner=ParallelRunner --namespace=B
m
Ok. Great ! Thx for the clarifications.