Hi Team! K In Kedro, while running pipeline from the cmd line, is there a way to do the following: 1. Run pipeline except certain tags (exclude them) 2. Run pipeline with certain tag combinations only 3. Run pipeline except certain tag combinations

Hi @Abhishek Bhatia, I think this documentation page answers most of your questions: https://docs.kedro.org/en/stable/development/commands_reference.html#run-the-project 🙂

Thanks @Merel. From the docs, none of the 3 points seem possible from the cmd line though 🙁

"kedro run --tags=<tag_name1>,<tag_name2> Run only nodes which have any of these tags attached."

It will actually run nodes which have either

tag_name1

OR

tag_name2

. I want the possibility of AND condition as well

You mean you only want to run nodes that contain all tags specified?

Yes, in point 2. Otherwise, I sometimes to need to exclude certain nodes with tags as well (point 1 and 3)

Then perhaps you need to tag your nodes differently. Or maybe namespaces could be a way for you to separate pipelines better: https://docs.kedro.org/en/stable/nodes_and_pipelines/namespaces.html

Yep, heavily using namespaces too where it makes sense. I feel I would really like the freedom to do some AND/OR logic with some syntactic sugar implemented in kedro cmd line. But depends on how many people would like to have this functionality as well! 🙂

I would wonder if there is a way to do this by customizing the cli

See: https://noklam.github.io/blog/posts/kedro-pipeline-slicing-pipeline/2024-03-06-Kedro-Pipeline-Slicing-Pipeline.html#advance-pipeline-slicing