https://kedro.org/ logo
#questions
Title
# questions
s

star

09/12/2023, 10:52 PM
Hi, I am new. Does Kedro reduce inference latency? Thanks.
d

Deepyaman Datta

09/13/2023, 1:29 AM
No. I'm not sure if you got any indication that it would?
c

Chandan Malla

09/13/2023, 6:32 AM
If your pipeline structure is designed for multithreading or multiprocessing, then I suppose it could.
y

Yury Fedotov

09/14/2023, 2:10 AM
Depends on what you mean by inference latency. Does it reduce execution time of
model.predict()
for a single observation? No. Though if you for example have your observations split into multiple files, kedro can help parallelize inference on each of those. But single calls to
model.predict()
are not affected by Kedro.