hi i'm nitin soni tried to create conditional pipe...
# questions
n
hi i'm nitin soni tried to create conditional pipelines how can i do it suggest me something i'm totally new in kedro
j
hi @Nitin Soni! when you say "conditional pipelines", do you mean a pipeline that executes one node or another depending on some condition? what kind of condition did you have in mind? something that depends on the data, a CLI flag specified by the user, something else?
đź‘Ť 1
n
yes
tried to do something like that
a normal condition file check if xyz file is exist then pipeline_a executes else pipeline_b
m
You can work-around this issue but this is not possible natively in Kedro, as Kedro (right now) does not support dynamic pipelines. This topic was discussed many times in this Slack, just search for
dynamic
in #questions Think if you really need the dynamic pipelines or maybe your logic of pipeline creation should get some adjustments, so that it could be implemented statically. Executing something “if a file exists” is totally out of Kedro way of doing things, as you also should not read/write files directly from the nodes, it’s what the Data Catalog is for. Also: https://kedro-org.slack.com/archives/C03RKP2LW64/p1680886173408959?thread_ts=1680883726.370709&cid=C03RKP2LW64
K 1
👍🏼 1
đź‘Ť 1
n
ok