Anyone have experience with migrating their Kedro ...
# questions
g
Anyone have experience with migrating their Kedro project to systems such as Hatch, PDM, Poetry or Rye? I'm not talking about moving away from Kedro, just combining it with a package management system. ā€¢ https://hatch.pypa.io/latest/ ā€¢ https://pdm-project.org/en/latest/ ā€¢ https://python-poetry.org/ ā€¢ https://rye.astral.sh/ Any lessons or gotchas I should know about?
j
I use PDM for all my Kedro projects now, ask me anything šŸ˜„
ā¤ļø 1
will drop a more detailed comment in your issue https://kedro-org.slack.com/archives/C03RKP2LW64/p1719763940076719
ā¤ļø 1
g
@Juan Luis What's involved in changing over for an existing Kedro project. When you're starting a new project, do you setup PDM first and then create the Kedro project within it? Any changes that you make to the toml or other files/paths to help the integration?
j
luckily, from Kedro 0.19 the project template uses PEP 621-compliant
pyproject.toml
. so, there are 2 ways: ā€¢ from an existing project created with a normal
kedro new
, then either change the
[build-system]
table manually, or run
pdm init
as explained in https://pdm-project.org/en/stable/usage/project/#import-the-project-from-other-package-managers ā€¢ create your own Kedro starter that uses PDM ā—¦ and if you're in a hurry, you can do
pdm init
to create your project from scratch and then use my
kedro init
plugin https://github.com/astrojuanlu/kedro-init
ā¤ļø 1
m
There are no problems with using Kedro with Poetry šŸ‘ŒšŸ»
g
I did not encounter any major issues with setting up Kedro with Rye. https://galenseilis.github.io/posts/kedro-init-rye/
šŸ„³ 1
j
thanks a lot for this writeup @Galen Seilis! šŸ‘šŸ¼
šŸ‘ 1