What is the best way to manage consistency with kedro pipelines. Is there a way to set the random seed for a pipeline? Or what would people suggest?

You can set seed, but it also depends how you're running your pipeline. If you're running using

ThreadRunner

or

ParallelRunner

, there's no guarantee that node execution order would be the same. Even with

SequentialRunner

, I wouldn't generally rely on execution order, but it should be guaranteed if the pipeline doesn't change (IIRC). Setting seed in node is more guaranteed "reproducible"

okay thank you