Hello Kedro folks, I have a question on dynamic generation of nodes via parameters in my catalog. I have this paramaters.yml file:

params:
 - p1
 - p2

p1: value1
p2: value2

I want to create a pipeline with 2 nodes that each node take as input one of these params. e.g.

nodes = [node(func, f"params:{p}", f"output_{p}" for p in params]
pipeline(nodes)

Is that possible and how?

hello @Panos P, my colleagues from the engineering team can probably give a more qualified answer, but generally speaking, generating pipelines dynamically is not something Kedro supports well

Params are meant to be passed into a node (function). It’s probably a good idea to separate these “pipeline_parameters” into a separate file. Then you can read these “pipeline_parameters” and construct the pipeline as you intended.

I just did what @Nok Lam Chan suggested…