Hello I am trying to connect two pipelines let's s...
# questions
a
Hello I am trying to connect two pipelines let's say P1 and P2 they both have namespace n1 and n2 specified where output from P1 is to be consumed as input in P2 , what is the best practice to specify such pipelines so that we can connect these pipelines, do we always need to explicitly mention in inputs of nodes of P2 - inputs = N1.output, or there is any other way we can do this?
a
Hey Ayushi, you can also use the
prefix_datasets_with_namespace
option as shown in the “Note” in this section https://docs.kedro.org/en/1.0.0/build/namespaces/#what-is-a-namespace
a
Hey @Ankita Katiyar thanks for replying, I need to add namespace as a prefix to datasets as in my use case: 1. I want to group my pipelines and also in few scenarios utilise this concept for reusing pipelines 2. I would like to use dataset patterns like {namespace}.{dataset_name} to ensure that no overwrites happen in intermediates across pipelines I wanted to understand if there is a better practice or solution to connect pipelines that have different namespace
a
If you want the datasets to be prefixed then the best way is to specify the input/output/parameters mapping in the arguments of
Pipeline()
👍 1