Hi, I am new. Does Kedro reduce inference latency?...
# questions
s
Hi, I am new. Does Kedro reduce inference latency? Thanks.
d
No. I'm not sure if you got any indication that it would?
c
If your pipeline structure is designed for multithreading or multiprocessing, then I suppose it could.
y
Depends on what you mean by inference latency. Does it reduce execution time of
model.predict()
for a single observation? No. Though if you for example have your observations split into multiple files, kedro can help parallelize inference on each of those. But single calls to
model.predict()
are not affected by Kedro.