sujdurai
03/21/2023, 2:39 AMnode
that is used in two pipelines. They use the same input tables, but I expect the node
in the second pipeline to run only after my first pipeline, because, the input files for the node
in the second pipeline will be updated as part of the first pipeline run.
Because I have registered both the pipelines to run as default in the registry
, the node
from the second pipeline runs sooner than I expect - I don’t want that.
# Pipeline A
Input X, Y --> node1 + node2 + node3 --> Output X (i.e Input X after update)
# Pipeline B
Input X(after update from Pipeline A), Y --> node1 + node4 + node5. --> Output Z
Order of execution (node_Pipelinename)
node1_A
node1_B
node3_A
node2_A
node4_B
node5_B
Expected order of execution
node1_A
node3_A
node2_A
node1_B
node4_B
node5_B
marrrcin
03/21/2023, 7:49 AMAntony Milne
03/21/2023, 9:58 AM# Pipeline A
Input X, Y --> node1 + node2 + node3 --> Output X2
# Pipeline B
Input X2, Y --> node1 + node4 + node5. --> Output Z
sujdurai
03/21/2023, 12:52 PM