I'm about to get into implementing a pipeline that runs a ray rllib job inside a node.
Is there anything I should know ahead of time that people have run into?
I know there's some ray + kedro discussion online, but that seems to be more around ray being the runner not just running inside a node.
n
Nok Lam Chan
02/02/2024, 6:06 PM
As far as I know, it's relatively straight forward to run it with the decorator.
👍 1
Nok Lam Chan
02/02/2024, 6:07 PM
I haven't done that myself but I know it has been done within the firm
i
Ian Whalen
02/02/2024, 6:07 PM
Cool
Just wanted to check in case there was something big to look out for
I'll report back!
👍 1
n
Nok Lam Chan
02/02/2024, 6:08 PM
Nice! If it goes smooth and you want to write something about it, @Jo Stichbury can help with that!
👍 2
Nok Lam Chan
02/02/2024, 6:09 PM
In general decorator based feature works quite well with kedro, same goes with pandera etc