Merel
08/01/2023, 4:13 PM0.18.12
is now available! K and so are kedro-datasets 1.5.1
& kedro-airflow 0.6.0
📣
TLDR: In the new release of Kedro, we introduce the dataset factories feature, activated all built-in resolvers by default for OmegaConfigLoader (except for oc.env), and added a new CLI command to rank dataset factories. We made some important bug fixes and updated the documentation, notably recommending ruff as the linter.See the 🧵 for details of each release. We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features. Until next time, The Kedro Team 💛
Ankita Katiyar
08/01/2023, 4:15 PM0.18.2
is out now! K
Kedro 0.18.12 is a non-breaking release in the 0.18.x series, which means you can upgrade with:
pip install kedro==0.18.12
or
conda/mamba/micromamba install -c conda-forge kedro=0.18.12
🚀 Major Features and improvements
• Added dataset factories feature, which uses pattern matching to reduce the number of catalog entries. Check out the feature documentation on how to use it!
• Activated all built-in resolvers by default for OmegaConfigLoader
, except for oc.env
.
• Introduced a new CLI command kedro catalog rank
that ranks dataset factories in the catalog by their matching priority.
🪲 Bug fixes and other changes
• Consolidated dependencies and optional dependencies in pyproject.toml
.
• Made validation of unique node outputs much faster.
• Updated kedro catalog list
to show datasets generated with factories.
✍️ Documentation changes
• Recommended ruff as the linter and removed mentions of pylint
, isort
, flake8
.
⚠️ Upcoming deprecations
• ConfigLoader
and TemplatedConfigLoader
will be deprecated in Kedro 0.19.0. Please use OmegaConfigLoader
instead.
💌 Community contributions
A big thank you to @Laiza Milena Scheid Parizotto and @Chris Schopp for their contributions to Kedro!1.5.1
is out now! K
🚀 What’s new in kedro-datasets
?
• Implemented lazy loading of dataset subpackages and classes and improved error messages for missing dataset dependencies.
• Added pandas.DeltaTableDataSet
.
• Added automatic inference of file format for pillow.ImageDataSet
to be passed to save()
.
💌 Community contributions
A big thank you to @daniel-falk, @Kyle Chung and @Afaque Ahmad for their contributions to kedro-datasets
!0.6.0
is out now! K
🚀 What’s new in kedro-airflow
?
• Added option to configure DAG kwargs using airflow.yml
• Included help for CLI arguments (see kedro airflow create --help
)
• Added additional CLI argument --params
to pass configuration to the Jinja2 template.
• Migrated all the project metadata to static pyproject.toml
.
💌 Community contributions
A big thank you to @sbrugman for their contributions to kedro-airflow
!Merel
08/01/2023, 4:19 PM