Hi, does anyone know how to skip one pipeline when...
# questions
t
Hi, does anyone know how to skip one pipeline when running
kedro run
? I have a model training pipeline which I want to skip since I have a model already working
d
In
pipeline_registry.py
, you can define whatever set of pipelines you want runnable via
kedro run --pipeline pipeline_name
. You can construct a pipeline object that doesn't have the training pipeline in there.
t
Yeah but that means I have to add all the non training pipelines by hand?
d
You can subtract.
pipelines['no_training'] = pipelines['__default__'] - pipelines['training']
1
n
Yes, you will need to define what is “training” or “non-training” anyway, there is no way Kedro know it automatically.
t
Yes but that subtraction is what I needed
Thanks!
n
You can either separate the pipelines and do the subtraction or addition, or use
tag
d
@Tomás Rojas how could we have made this more obvious to you in the docs?
the algebra you can use with the pipelines feels like something we don’t make enough noise about
n
I think this non_training = full_pipeline - training is quite handy. It’s more obvious you can
add
pipeline since it’s defined in templates (in the older versions), it may be less obvious that you can subtract them.
t
I've never used the
tag
option... I'll take a look
Thanks
Hi @datajoely, I think with an example in the documentation
After one adding example
As a note
Like: hey, you can also subtract
d
💪
t
Oy maybe a new page where you show how you can make custom pipelines with many pipelines inside
And show "how to exclude a pipeline" that is what I googled without success
👍🏼 1
I think that is the best option @datajoely, have a "how to exclude specific pipelines" page
❤️ 2
Maybe the note in the page where you show how to add, you can hint that you can subtract and link to the exclusion page thing
👍 1
d
I thought for sure this is documented, but I can't find it anywhere... Maybe it's just in some internal Kedro training presentations? The intermediate training deck had material on this for sure.
t
Yeah, I haven't read that anywhere either
n
Cc @Jo Stichbury this could be some inspiration for blog/doc material?