Hi <!channel>, we are thrilled to announce some ne...
# announcements
m
Hi <!channel>, we are thrilled to announce some new releases. 📣 Kedro
0.18.12
is now available! K and so are kedro-datasets
1.5.1
& kedro-airflow
0.6.0
📣
TLDR: In the new release of Kedro, we introduce the dataset factories feature, activated all built-in resolvers by default for OmegaConfigLoader (except for oc.env), and added a new CLI command to rank dataset factories. We made some important bug fixes and updated the documentation, notably recommending ruff as the linter.
See the 🧵 for details of each release. We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features. Until next time, The Kedro Team 💛
🥳 1
K 22
kedroid 10
❤️ 6
🏭 9
🎉 18
🎉 9
a
K Kedro
0.18.2
is out now!
K Kedro 0.18.12 is a non-breaking release in the 0.18.x series, which means you can upgrade with:
pip install kedro==0.18.12
or
conda/mamba/micromamba install -c conda-forge kedro=0.18.12
🚀 Major Features and improvements • Added dataset factories feature, which uses pattern matching to reduce the number of catalog entries. Check out the feature documentation on how to use it! • Activated all built-in resolvers by default for
OmegaConfigLoader
, except for
oc.env
. • Introduced a new CLI command
kedro catalog rank
that ranks dataset factories in the catalog by their matching priority. 🪲 Bug fixes and other changes • Consolidated dependencies and optional dependencies in
pyproject.toml
. • Made validation of unique node outputs much faster. • Updated
kedro catalog list
to show datasets generated with factories. ✍️ Documentation changes • Recommended ruff as the linter and removed mentions of
pylint
,
isort
,
flake8
. ⚠️ Upcoming deprecations
ConfigLoader
and
TemplatedConfigLoader
will be deprecated in Kedro 0.19.0. Please use
OmegaConfigLoader
instead. 💌 Community contributions A big thank you to @Laiza Milena Scheid Parizotto and @Chris Schopp for their contributions to Kedro!
💛 3
🙌 1
❤️ 3
K kedro-datasets
1.5.1
is out now!
K 🚀 What’s new in
kedro-datasets
?
• Implemented lazy loading of dataset subpackages and classes and improved error messages for missing dataset dependencies. • Added
pandas.DeltaTableDataSet
. • Added automatic inference of file format for
pillow.ImageDataSet
to be passed to
save()
. 💌 Community contributions A big thank you to @daniel-falk, @Kyle Chung and @Afaque Ahmad for their contributions to
kedro-datasets
!
🚀 1
K kedro-airflow
0.6.0
is out now!
K 🚀 What’s new in
kedro-airflow
?
• Added option to configure DAG kwargs using
airflow.yml
• Included help for CLI arguments (see
kedro airflow create --help
) • Added additional CLI argument
--params
to pass configuration to the Jinja2 template. • Migrated all the project metadata to static
pyproject.toml
. 💌 Community contributions A big thank you to @sbrugman for their contributions to
kedro-airflow
!
m
FYI: @Ben Levy @Julian Waton @Tom Taylor-Vigrass @Ian Whalen @Ivan Doroshenko @Matthias Roels @Jose Nuñez @Giuseppe Ughi @marrrcin - thanks all for participating in the dataset factories research! The feature is now released, so let us know what you think 😄
K 12
🏭 5
thankyou 6
🎉 6