Hello, I have this error : ValueError: Pipeline input(s) {'mlflow_run_id'} not found in the DataCatalog What I am trying to do is to pass "mlflow_run_id" value from one pipeline (named training) to another pipeline (named deployement) As attached, my kedro viz And this gist contains my two pipelines + nodes (training) (deployment) code source : https://gist.github.com/Noobzik/cdf7a4754067e587010d4819fae671f4 Can you help me point where I did wrong ?

Someone will reply to you shortly. In the meantime, this might help:

Sorry, I am just dumb, I forgot the

mlflow_run_id:
  type: MemoryDataset

Inside the catalog Which it lead me to an another question, how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

glad you solved it @Rakib Sheikh!

how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

maybe

kedro run --to-outputs=stage_model

? (and

--from-inputs=

if you want to specify a starting point) would this work for you?