Hello I would like to know how can if I can pass from multip

Question

Hello I would like to know how can if I can pass from multiple nodes living in a different namespace tag exactly the same output so it can be reused then later ```node first namespace fn inputs= some input outputs= shared name so it can reused somewhere else namespace= first node second namespace fn inputs=None outputs= shared name so it can reused somewhere else namespace= second node third common fn inputs= shared name so it can reused somewhere else outputs= final output ``` Thank you

Deepyaman Datta · Answer

I don t think I ve ever seen somebody explicitly set `namespace` on a node I don t think it does any input remapping I assume what you re saying in this case is that you will either run the first and third node or the second and third node but not first and second in the same run In that case it should be possible When using a modular pipeline multiple times you can use a mapping dictionary to say that a catalog entry shouldn t get namespaced For example ```cook breakfast pipeline = pipeline node func=defrost inputs= frozen potatoes outputs= veg name= defrost node node func=sauté inputs= veg outputs= breakfast potatoes cook lunch pipeline = pipeline node func=defrost inputs= frozen carrots outputs= veg name= defrost node node func=blanch inputs= veg outputs= cooked veggies eat veggies = pipeline node func=nom inputs= cooked veggies outputs= leftovers name= consume Run either of the below pipelines not both at once eat breakfast pipeline = pipeline pipe=cook breakfast pipeline outputs= breakfast potatoes cooked veggies namespace= breakfast eat lunch pipeline = pipeline pipe=cook lunch pipeline outputs= cooked veggies Alternatively `outputs= cooked veggies cooked veggies ` namespace= lunch ```

Deepyaman Datta · Answer

You should be able to run that code above with minimal setup E g ```from kedro pipeline import pipeline node Make dummy nodes defrost = lambda x x sauté = lambda x x blanch = lambda x x nom = lambda x x Copy paste above code here Then if you run gt gt gt eat breakfast pipeline inputs breakfast frozen potatoes gt gt gt eat breakfast pipeline outputs cooked veggies gt gt gt eat lunch pipeline inputs lunch frozen carrots gt gt gt eat lunch pipeline outputs cooked veggies ``` I this what you wanted

Andrej Zachar · Answer

Yes that is what I want but now I do not know how to run it kedro run namespace breakfast it says there is no pipeline defined

Andrej Zachar · Answer

do you mind to share a complete pipeline py code that i can run using kedro command thank you

Andrej Zachar · Answer

e g I want that one micropackage would produce a different meal depending on namespace it would be either lunch or breakfast But I do not want to create 2 micropackages i want to have it in one

Andrej Zachar · Answer

is that possible Thank you so much for your answers

Deepyaman Datta · Answer

Off the top of my head I don t think a node could belong to two namespaces so I think that s not possible You could put them in the same micropackage and add tags breakfast and lunch and add both tags to the node that you d want to run in either case and then you could do `kedro run tag breakfast`

Andrej Zachar · Answer

Thank you for your reply Sure i do not need to put them on node

Andrej Zachar · Answer

I will try

Andrej Zachar · Answer

hmm I am not sure if we are talking about the same How can I create a pipeline that would be a combination of eat breakfast pipeline + eat lunch pipeline + clean kitchen where clean kitchen pipeline would expect to get cooked veggies as input and depending on the namespace or tag that was applied to eat lunch pipeline or eat breakfast pipeline it would procude `cooked veggies` If do so then it says ```Output s cooked veggies are returned by more than one nodes Node outputs must be unique ``` Also I am not sure how to declare it so find pipelines it is going to pick it out automatically Thank you again for your help < Deepyaman Datta>

Deepyaman Datta · Answer

gt How can I create a pipeline that would be a combination of gt gt eat breakfast pipeline + eat lunch pipeline + clean kitchen gt gt where clean kitchen pipeline would expect to get cooked veggies as input and depending on the namespace or tag that was applied to eat lunch pipeline or eat breakfast pipeline it would procude `cooked veggies` gt gt If do so then it says gt ```Output s cooked veggies are returned by more than one nodes Node outputs must be unique ``` You can t do this because you re creating an invalid Kedro pipeline as mentioned in that error Even in my example I wrote ` Run either of the below pipelines not both at once`

Andrej Zachar · Answer

And do you plan to support such a sceniario Also it would be cool that have one example project with tags and namespaces so i do not need to bother you here Anyway thanks a lot for a quick and straight comunication Kedro is great

Deepyaman Datta · Answer

gt And do you plan to support such a sceniario Not that I know of allowing two nodes in the same pipeline to write to a single output causes undeterministic behavior It is possible to get this same behavior by defining pipelines separately so that seems to be the way to go gt Also it would be cool that have one example project with tags and namespaces so i do not need to bother you here Can you create an issue on <http github com kedro org kedro issues|github com kedro org kedro issues> to request this That way the broader team can decide if they will add this and how to structure the docs

Andrej Zachar · Answer

Btw can I pass an input param that is optional