Hi all! Does anyone know how can i enforce a pipel...
# questionss
Shubham Agrawal
10/31/2023, 1:39 PMHi all! Does anyone know how can i enforce a pipeline to run before other pipeline in Kedro?
I tried specifying a dummy output/input to one of the nodes but kedro still tries to run remaining nodes from the second pipeline.
n
Nok Lam Chan
10/31/2023, 1:52 PMKedro resolves execution order in nodes level - if some nodes from the 2nd pipeline get executed before the 1st pipeline is finish, it means that these node are not dependent on 1st pipeline at all.
Nok Lam Chan
10/31/2023, 1:53 PMYou may need to find out which nodes are the “source” - you probably missed a few of them.
Nok Lam Chan
10/31/2023, 1:54 PMYou should check which nodes in the 2nd pipeline doesn’t take output from previous nodes.
s
Shubham Agrawal
10/31/2023, 1:54 PMcool, thanks will do that
n
Nok Lam Chan
10/31/2023, 2:00 PMYou can probably do this programatically or inspect it with kedro-viz.
pipeline.inputs() will shows you all the node with “free input”
👍 1
4 Views