Hi Team, My team has been using it for 4-5 months ...
# questionsj
Jonghyun Yun
07/19/2024, 9:35 PMHi Team, My team has been using it for 4-5 months after McK left their code in Kedro, my impression it makes us follow good disciplines in doing DS (modular code, logging, catalog, parameters), but takes some time to learn. I just want to ask if I’m missing other great points using Kedro for DS project. The reason is that my team will briefly introduce Kedro to a bigger team as a part of a project review
d
datajoely
07/19/2024, 9:43 PMHi @Jonghyun Yun have you checked out our YouTube content?
https://www.youtube.com/@kedro-python
datajoely
07/19/2024, 9:45 PMFor me the biggest acceleration has always been the following:
• It pushes people out of notebooks when reproducibility is the goal
• It makes moving people between team something that was possible
• It makes inheriting an old project you had nothing to do with accessible
It would be great to learn more of your pain points and we / the community can chime in with their thoughts 🙂
n
Nok Lam Chan
07/19/2024, 10:22 PMI'll add:
• It's a common ground between different type of engineer (Data Engineer/MLE/DS). It allows collaboration without forcing people too much on a specific tool. (Think a DS have to use Airflow cluster/Docker for development)
Nok Lam Chan
07/19/2024, 10:24 PMHi Team, My team has been using it for 4-5 months after McK left their code in Kedro, my impression it makes us follow good disciplines in doing DS (modular code, logging, catalog, parameters), but takes some time to learn.Our experience is, when people try to get rid of Kedro, they end up creating something resemble but less robust. i.e. if you don't have Kedro Pipeline/CLI, you end up writing tons of scripts to stitch things.
👍 2
Nok Lam Chan
07/19/2024, 10:27 PMthe plugin ecosystem is also a big bonus point
• Kedro viz for communication/collaboration
• kedro-pandera for data validation
• kedro-mlflow for experiment tracking if you want to use mlflow
Which mean, you can also develop plugin internally if Kedro starts to scale within your organisation. You need to build the plugin once.
👍 1
j
Jonghyun Yun
07/23/2024, 8:52 AMThank you @datajoely and @Nok Lam Chan. I hope I can make sense these great points to the leadership ;)
🚀 1
3 Views