https://kedro.org/ logo
#questions
Title
# questions
l

Lukas Innig

12/05/2023, 3:58 PM
Question on kedro starters: If I wanted to create a set of templates, with some functionality being common across them (like custom datasets, say - or full pipelines) - what are some approaches to keep this maintainable that work better than just copy-pasting the code between the starters?
d

datajoely

12/05/2023, 4:04 PM
So you can do
kedro pipeline create --template
for package templates
for shared datasets I would think about building your own internal library which can reused across projects
the same applies to pipelines if you really are going to reuse them as libraries not code
d

Deepyaman Datta

12/05/2023, 4:16 PM
No easy, open-source answer (yet). You could build a custom library to assemble your templates from shared components. 🙂
l

Lukas Innig

12/05/2023, 4:37 PM
I'm also toying with the thought of git submodules, that would preserve the raw python code being accessible, which I think might help with the target audience in my case.
Thank you for your thoughts on this
And I wasn't aware of template pipelines, will definitely look into it!
d

datajoely

12/05/2023, 4:39 PM
Yeah the idea of two way editing is an interesting one, we’ve had some teams use symlinks. Since symlinks were rejected in PEP-660 we’ve erred on the proper packaging process
👀 1