Ankita Katiyar
02/21/2023, 3:13 PMTLDR: In this release, we introduce a brand new config loader powered byKedro 0.18.5 is a non-breaking release in the 0.18.x series, which means you can upgrade with:, updates & improvements toomegaconfcommand options, the ability to use generator functions as nodes, and more!kedro run
pip install kedro==0.18.5
or
conda install -c conda-forge kedro==0.18.5
🚀 Major Features/Changes
• Several configuration improvements
â—¦ A new config loader, the OmegaConfigLoader, which uses the powerful omegaconf library under the hood.
â—¦ A new flag --conf-source for the kedro run command that allows you to specify the location of your config files.
â—¦ You can now also use the omegaconf syntax with kedro run --param flag.
• Improvements to the kedro run CLI to make it more consistent
◦ The flags --node, --tag, and --load-version are deprecated in favour of --nodes, --tags, and --load-versions (they’ll be removed in Kedro 0.19.0).
â—¦ Filter and run nodes by node namespace using the --namespace flag with kedro run.
• Support for using generator functions as nodes, i.e. using yield instead of return.
• New node argument to all four dataset hooks.
• Documentation improvements and additions.
🪲 Bug fixes and other changes
• Corrected the parsing of Azure Data Lake Storage Gen2 URIs used in datasets.
• Fixed the incorrect splitting of auto-generated node names containing commas for kedro run options --from-nodes and --to-nodes.
• Fixed bug where micropkg manifest section in pyproject.toml wasn’t being recognised as allowed configuration.
• Added safe extraction of tar files in micropkg pull caused by CVE-2007-4559
• Added `anyconfig`’s ac_context parameter to kedro.config.commons module functions for more flexible ConfigLoader customisations.
• Fixed bug causing after_dataset_saves hook to be called only once even when multiple datasets are being saved in a single node and async saving is in use.
• And more …
You can find the full list of changes in the release notes:
https://github.com/kedro-org/kedro/releases/tag/0.18.5
We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features.
📣 Watch this space for announcements for upcoming sessions where we talk more about the brand new OmegaConfigLoader, our upcoming work on Databricks, and new experiment tracking features introduced in Kedro Viz 5.3.0! 📣
Until next time,
The Kedro Team 💜