https://kedro.org/ logo
#questions
Title
# questions
a

Aaron Niskin (amniskin)

04/07/2023, 4:48 PM
Hey all. Is there a way to get a single node to execute in, say, aws batch?
d

datajoely

04/07/2023, 4:49 PM
kedro run --node {node_name}
a

Aaron Niskin (amniskin)

04/07/2023, 4:50 PM
Can I run the whole pipeline locally, but have one node run in batch, or is it an all or nothing kinda thing?
there are lots of ways to specify which parts of a project get run
a

Aaron Niskin (amniskin)

04/07/2023, 4:52 PM
Hmm. But I want to run the whole project. I just want to farm out the compute for one node. It doesn’t seem like this would do that, or am I misunderstanding?
d

datajoely

04/07/2023, 4:52 PM
oh as part of the same pipeline run
not really, there is stuff coming down the line for that
👍 1
a

Aaron Niskin (amniskin)

04/07/2023, 4:53 PM
Basically I want to run the whole thing, but have a node specific runner
d

datajoely

04/07/2023, 4:53 PM
you could maybe design a custom runner today
a

Aaron Niskin (amniskin)

04/07/2023, 4:53 PM
Yeah I couldn’t find it in the docs, but I figured I should ask
d

datajoely

04/07/2023, 4:53 PM
yeah it’s a good push
we don’t have a great solution today in truth
a

Aaron Niskin (amniskin)

04/07/2023, 4:54 PM
I’ll keep a lookout for it!
d

datajoely

04/07/2023, 4:54 PM
💪
a

Aaron Niskin (amniskin)

04/07/2023, 4:54 PM
Thanks for the help!
And great work here!
d

datajoely

04/07/2023, 4:54 PM
🙏 thanks! Shout if we can help with other questions
👍 1