As a particular modular pipeline becomes more complex, I'm thinking of breaking up its

nodes.py

into multiple files in a

nodes/

directory. For example,

<project>.pipelines.<modular_pipeline>.nodes/

would have

logic1.py

,

logic2.py

with the functions that will be used in nodes and their private helper functions. And in

<modular_pipeline>.pipeline.py

I'd import the functions from

nodes/logic1

and

nodes/logic2

My question is, if I am wanting to do the above, should I just be breaking this up into multiple modular pipelines? The modular pipeline's purpose is to produce an input to a simulation, but the simulation's input is becoming more "refined" over time. So it makes sense to me to keep it as one modular pipeline but am curious how others approach this.

So the functions referenced by nodes in the modular pipeline can live anywhere, I feel the

nodes.py

we generate is a suggestion of where to get started…. but not a mandate