Is there an option to dynamically execute nodes? I...
# questions
e
Is there an option to dynamically execute nodes? I imagine a use case where I have node
A
which does some work and then depending on how much data it produced, it can create multiple parallel executions of
B
where each
B_i
executes the same logic on a sub set of the data produced by
A
Then maybe if any data point in
B
has errors they go to
C
but the data points that are good go to
D
w
As far as I know there is no such option, as the Kedro team doesn’t favour dynamic pipelines.