Hi <!channel>, we are excited to announce that 📣 Kedro

0.18.14

is available! K > TLDR: In this new release of Kedro we added support to customise the pipeline directory structure and overriding the configuration keys, made substantial improvements to the documentation (including a page on how to use Kedro from Jupyter notebooks), and squashed a number of bugs. We had a record number of community contributions thanks to Hacktoberfest. Preparations for 0.19.0 are underway! Kedro 0.18.14 is the last non-breaking release in the 0.18.x series, which means you can upgrade with:

pip install kedro==0.18.14

or

conda/mamba/micromamba install -c conda-forge kedro=0.18.14

🚀 Major Features and improvements • Allowed using of custom cookiecutter templates for creating pipelines with

--template

flag for

kedro pipeline create

or via

template/pipeline

folder. • Allowed overriding of configuration keys with runtime parameters using the

runtime_params

resolver with

OmegaConfigLoader

. 🪲 Bug fixes and other changes • Updated dataset factories to resolve nested catalog config properly. • Made

settings.py

optional. ✍️ Documentation changes • Added a Jupyter notebook example for spaceflights to illustrate how to incrementally add Kedro features. • Added new documentation about deploying a Kedro project with Amazon EMR Serverless. • Added new documentation about how to publish a Kedro-Viz project to make it shareable. • New TSC members added to the page and the organisation of each member is also now listed. ⚠️ Upcoming deprecations • Remember, all dataset classes will be removed from the core Kedro repository (

kedro.extras.datasets

). Install and import them from the

kedro-datasets

package instead. • All dataset classes ending with

DataSet

are deprecated and will be removed in Kedro

0.19.0

and

kedro-datasets

2.0.0

. Instead, use the updated class names ending with

Dataset

. • The starters

pandas-iris

,

pyspark-iris

,

pyspark

, and

standalone-datacatalog

are deprecated and will be archived in Kedro 0.19.0. •

PartitionedDataset

and

IncrementalDataset

have been moved to

kedro-datasets

and will be removed in Kedro

0.19.0

. Install and import them from the

kedro-datasets

package instead. kedroid hacktoberfest2023 Community contributions This release received the largest number of community contributions ever, thanks in large part to Hacktoberfest. A million thanks to @Laiza Milena Scheid Parizotto , @Miguel Angel Ortiz Marin, @R.X.M, @Iñigo Hidalgo, @Harmony, @Celsuss, and the rest of the contributors who aren't on this Slack for submitting PRs to this release! 🚨 This will (hopefully) be the last release in the 0.18.x line, next one will be 0.19.0. Stay tuned! Read the complete release notes on https://github.com/kedro-org/kedro/blob/main/RELEASE.md#release-01814 We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features. Until next time, The Kedro Team 💛