:question:Have you encountered any performance iss...
# user-research
n
Have you encountered any performance issue with Kedro? i.e. config/dataset takes forever to load. We are starting to look into opportunities to improve performance of Kedro but need to get some more clarity what's actually slow. The 1st step for this is create something internally we can run in CI to inform ourselves.
💯 1
Creating some notes here from what I've seen in Slack/Github: • slow s3
glob
https://linen-slack.kedro.org/t/22727466/hi-fellows-we-are-using-the-versioned-pandas-parquetdataset-#e411b958-a918-4874-88b2-2396a9d726c3 • I/O related issue (i.e. CacheDataset/kedro-accelerator) https://linen-slack.kedro.org/t/16947241/using-the-last-version-of-the-0-18-i-found-out-that-when-you#70c641e4-98d6-48fe-8e6a-2a0a4cee65dd • Slow catalog load https://linen-slack.kedro.org/t/15474644/hey-everyone-im-trying-to-add-some-tests-to-my-project-but-i#4796efa8-d9a0-4c40-b73f-36b15f412225 • Slow Config loading https://github.com/kedro-org/kedro/issues/3893 • Lazy catalog loading items • Low performance of pipeline sums Tagging people that I found in old thread related to this topic, would love to hear more about your thought or if things improved already with the newer version of Kedero @Flavien @Matthias Roels @Iñigo Hidalgo @Fazil B. Topal @Marc Gris @Takieddine Kadiri @marrrcin