https://kedro.org/ logo
#questions
Title
# questions
e

Elior Cohen

12/27/2022, 7:28 AM
Is there an option to dynamically execute nodes? I imagine a use case where I have node
A
which does some work and then depending on how much data it produced, it can create multiple parallel executions of
B
where each
B_i
executes the same logic on a sub set of the data produced by
A
Then maybe if any data point in
B
has errors they go to
C
but the data points that are good go to
D
w

William Caicedo

12/27/2022, 7:30 PM
As far as I know there is no such option, as the Kedro team doesn’t favour dynamic pipelines.
3 Views