Kedro is an open-sourced Python framework for creating maintainable and modular data science code.

Kedro

Is there a way to run pipelines in a loop?, I am creating a bscktesting pipeline and i want to send input data with loop.

You can do this with namespace pipeline - <https://docs.kedro.org/en/stable/tutorial/add_another_pipeline.html>

1. A for loop to create pipeline
2. each namespace pipeline will have its own namespace, i.e. the index of the loop or more meaningful names
3. stitch all these pipeline together

How do I give different input every time?

<https://docs.kedro.org/en/stable/nodes_and_pipelines/modular_pipelines.html#:~:text=The%20pipeline()%20wrapper%20method%20takes%20the%20following%20arguments%3A|https://docs.kedro.org/en/stable/nodes_and_pipelines/modular_pipelines.html#:~:text=The%20pipeline()%20wrapper[…]es%20the%20following%20arguments%3A>

I’ll try to work out a nicer example later, if you are in a rush then you can refer to this

I hope this answer your question better. <https://noklam.github.io/blog/posts/understand_namespace/2023-09-26-understand-kedro-namespace-pipeline.html>

1695796017414.jpg

I have 100 inputs, how do I create namespace entry in catalog for 100 inputs?

Dataset factory or in older version using Templates ConfigLoader Jinja2 feature.