https://kedro.org/ logo
#questions
Title
# questions
t

Tomás Rojas

03/24/2023, 1:33 PM
Hi, does anyone know how to skip one pipeline when running
kedro run
? I have a model training pipeline which I want to skip since I have a model already working
d

Deepyaman Datta

03/24/2023, 1:34 PM
In
pipeline_registry.py
, you can define whatever set of pipelines you want runnable via
kedro run --pipeline pipeline_name
. You can construct a pipeline object that doesn't have the training pipeline in there.
t

Tomás Rojas

03/24/2023, 1:39 PM
Yeah but that means I have to add all the non training pipelines by hand?
d

Deepyaman Datta

03/24/2023, 1:40 PM
You can subtract.
pipelines['no_training'] = pipelines['__default__'] - pipelines['training']
1
n

Nok Lam Chan

03/24/2023, 1:40 PM
Yes, you will need to define what is “training” or “non-training” anyway, there is no way Kedro know it automatically.
t

Tomás Rojas

03/24/2023, 1:40 PM
Yes but that subtraction is what I needed
Thanks!
n

Nok Lam Chan

03/24/2023, 1:41 PM
You can either separate the pipelines and do the subtraction or addition, or use
tag
d

datajoely

03/24/2023, 1:43 PM
@Tomás Rojas how could we have made this more obvious to you in the docs?
the algebra you can use with the pipelines feels like something we don’t make enough noise about
n

Nok Lam Chan

03/24/2023, 1:45 PM
I think this non_training = full_pipeline - training is quite handy. It’s more obvious you can
add
pipeline since it’s defined in templates (in the older versions), it may be less obvious that you can subtract them.
t

Tomás Rojas

03/24/2023, 1:52 PM
I've never used the
tag
option... I'll take a look
Thanks
Hi @datajoely, I think with an example in the documentation
After one adding example
As a note
Like: hey, you can also subtract
d

datajoely

03/24/2023, 1:58 PM
💪
t

Tomás Rojas

03/24/2023, 1:58 PM
Oy maybe a new page where you show how you can make custom pipelines with many pipelines inside
And show "how to exclude a pipeline" that is what I googled without success
👍🏼 1
I think that is the best option @datajoely, have a "how to exclude specific pipelines" page
❤️ 2
Maybe the note in the page where you show how to add, you can hint that you can subtract and link to the exclusion page thing
👍 1
d

Deepyaman Datta

03/24/2023, 2:03 PM
I thought for sure this is documented, but I can't find it anywhere... Maybe it's just in some internal Kedro training presentations? The intermediate training deck had material on this for sure.
t

Tomás Rojas

03/24/2023, 2:04 PM
Yeah, I haven't read that anywhere either
n

Nok Lam Chan

03/24/2023, 9:39 PM
Cc @Jo Stichbury this could be some inspiration for blog/doc material?
5 Views