09/12/2023, 10:52 PM
Hi, I am new. Does Kedro reduce inference latency? Thanks.
09/13/2023, 1:29 AM
No. I'm not sure if you got any indication that it would?
09/13/2023, 6:32 AM
If your pipeline structure is designed for multithreading or multiprocessing, then I suppose it could.
09/14/2023, 2:10 AM
Depends on what you mean by inference latency. Does it reduce execution time of
observation? No. Though if you for example have your observations split into multiple files, kedro can help parallelize inference on each of those. But single calls to
are not affected by Kedro.