https://kedro.org/ logo
#questions
Title
# questions
j

Jack Lint

02/22/2024, 1:28 AM
What is the best way to manage consistency with kedro pipelines. Is there a way to set the random seed for a pipeline? Or what would people suggest?
d

Deepyaman Datta

02/22/2024, 1:34 AM
You can set seed, but it also depends how you're running your pipeline. If you're running using
ThreadRunner
or
ParallelRunner
, there's no guarantee that node execution order would be the same. Even with
SequentialRunner
, I wouldn't generally rely on execution order, but it should be guaranteed if the pipeline doesn't change (IIRC). Setting seed in node is more guaranteed "reproducible"
👍 1
j

Jack Lint

02/22/2024, 1:39 AM
okay thank you
2 Views