Channels
announcements
introduce-yourself
resources
random
plugins-integrations
user-research
questions
questions-so
job-posting
help-
circleci-status
dependencies-releases
Powered by
#questions
Title
# questions
c
Chandan Malla
09/26/2023, 2:13 PM
Is there a way to run pipelines in a loop?, I am creating a bscktesting pipeline and i want to send input data with loop.
👀 1
n
Nok Lam Chan
09/26/2023, 2:23 PM
You can do this with namespace pipeline -
https://docs.kedro.org/en/stable/tutorial/add_another_pipeline.html
1. A for loop to create pipeline 2. each namespace pipeline will have its own namespace, i.e. the index of the loop or more meaningful names 3. stitch all these pipeline together
c
Chandan Malla
09/26/2023, 2:38 PM
How do I give different input every time?
n
Nok Lam Chan
09/26/2023, 3:51 PM
https://docs.kedro.org/en/stable/nodes_and_pipelines/modular_pipelines.html#:~:text=The%20pipeline()%20wrapper[…]es%20the%20following%20arguments%3A
I’ll try to work out a nicer example later, if you are in a rush then you can refer to this
I hope this answer your question better.
https://noklam.github.io/blog/posts/understand_namespace/2023-09-26-understand-kedro-namespace-pipeline.html
c
Chandan Malla
09/27/2023, 6:27 AM
I have 100 inputs, how do I create namespace entry in catalog for 100 inputs?
n
Nok Lam Chan
09/27/2023, 8:33 AM
Dataset factory or in older version using Templates ConfigLoader Jinja2 feature.
2 Views
Post