Ankita Katiyar
02/21/2023, 3:13 PMTLDR: In this release, we introduce a brand new config loader powered byKedro 0.18.5 is a non-breaking release in the 0.18.x series, which means you can upgrade with:, updates & improvements toomegaconf
command options, the ability to use generator functions as nodes, and more!kedro run
pip install kedro==0.18.5
or
conda install -c conda-forge kedro==0.18.5
🚀 Major Features/Changes
• Several configuration improvements
â—¦ A new config loader, the OmegaConfigLoader
, which uses the powerful omegaconf
library under the hood.
â—¦ A new flag --conf-source
for the kedro run
command that allows you to specify the location of your config files.
â—¦ You can now also use the omegaconf
syntax with kedro run --param
flag.
• Improvements to the kedro run
CLI to make it more consistent
â—¦ The flags --node
, --tag
, and --load-version
are deprecated in favour of --nodes
, --tags
, and --load-versions
(they’ll be removed in Kedro 0.19.0).
â—¦ Filter and run nodes by node namespace using the --namespace
flag with kedro run
.
• Support for using generator functions as nodes, i.e. using yield
instead of return
.
• New node
argument to all four dataset hooks.
• Documentation improvements and additions.
🪲 Bug fixes and other changes
• Corrected the parsing of Azure Data Lake Storage Gen2 URIs used in datasets.
• Fixed the incorrect splitting of auto-generated node names containing commas for kedro run
options --from-nodes
and --to-nodes
.
• Fixed bug where micropkg
manifest section in pyproject.toml
wasn’t being recognised as allowed configuration.
• Added safe extraction of tar files in micropkg pull
caused by CVE-2007-4559
• Added `anyconfig`’s ac_context
parameter to kedro.config.commons
module functions for more flexible ConfigLoader
customisations.
• Fixed bug causing after_dataset_saves
hook to be called only once even when multiple datasets are being saved in a single node and async saving is in use.
• And more …
You can find the full list of changes in the release notes:
https://github.com/kedro-org/kedro/releases/tag/0.18.5
We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features.
📣 Watch this space for announcements for upcoming sessions where we talk more about the brand new OmegaConfigLoader, our upcoming work on Databricks, and new experiment tracking features introduced in Kedro Viz 5.3.0! 📣
Until next time,
The Kedro Team 💜