New blog post How to build a custom Kedro runner kedro In th

Question

New blog post How to build a custom Kedro runner kedro In this post our colleague < Nok Lam Chan> explains how to write an efficient custom Kedro pipeline runner that continues executing a set of nodes after encountering non catastrophic failure points Enjoy Source code at

Jose Nuñez · Answer

Great post < Nok Lam Chan> keep on going party parrot kedro QQ Is this SoftFailRunner going to be merged into the main branch eventually or was this just a show case on how to create a new runner

Juan Luis · Answer

< Jose Nuñez> we re discussing just that smile

Nok Lam Chan · Answer

Stay tune We are going to open a ticket shortly please upvote it if you think this is useful and we could plan accordingly Currently we didn t plan to merge it into `main` in the coming weeks as we have some other priorities Short term plan is have it as example and links with doc and a follow up ticket to merge that into `main`

Nok Lam Chan · Answer

It works pretty fine if you are mostly using `kedro run` only there are some caveats if you need to consume the output i e ```result = session run do something about result This isn t available in the current implementation ``` We will need to fix this before we merge it into the collections of runners

Nok Lam Chan · Answer

The issue is here now <https github com kedro org kedro issues 2716 top|Add documentation for the soft fail runner if when it is released in a supported version >