Juan Luis
08/31/2023, 2:34 PM0.18.13 and kedro-datasets 1.6.0 are available! K
TLDR: In this new release of Kedro we finally introduce official support for Python 3.11, as well as some newKedro 0.18.13 is a non-breaking release in the 0.18.x series, which means you can upgrade with:features, a newOmegaConfigLoadercommand, and a leaner project structure. We also made significant documentation improvements around the Data Catalog and the datasets. Preparations for 0.19.0 are underway!kedro catalog resolve
pip install kedro==0.18.13
or
conda/mamba/micromamba install -c conda-forge kedro=0.18.13
š Major Features and improvements
⢠Added support for Python 3.11.
⢠Added new OmegaConfigLoader features: registering of custom resolvers through CONFIG_LOADER_ARGS and support for global variables.
⢠Added kedro catalog resolve CLI command that resolves dataset factories in the catalog with any explicit entries in the project pipeline.
⢠Implemented a flat conf/ structure for modular pipelines and updated kedro pipeline create and kedro catalog create accordingly.
⢠Made various updates to the Kedro project template and Kedro starters: use of OmegaConfigLoader , transition from setup.py to pyproject.toml, and flat conf/ structure.
šŖ² Bug fixes and other changes
⢠Updated OmegaConfigLoader to ignore config from hidden directories like .ipynb_checkpoints.
āļø Documentation changes
⢠Restructure beginner and advanced pages about the Data Catalog and datasets.
⢠Moved contributor documentation to the GitHub wiki.
⢠Updated example of using generator functions in nodes.
⢠Added migration guide from the ConfigLoader and the TemplatedConfigLoader to the OmegaConfigLoader.
ā ļø Upcoming deprecations
⢠The ConfigLoader and the TemplatedConfigLoader are deprecated and will be removed in the 0.19.0 release.
⢠AbstractDataSet becomes AbstractDataset and AbstractVersionedDataSet becomes AbstractVersionedDataset, old names are deprecated and will be removed in 0.19.0.
⢠Using the layer attribute at the top level is deprecated and it will be removed in Kedro 0.19.0. Please move layer inside the metadata -> kedro-viz attributes.
š Migration Tips for Python 3.11
⢠Users on Windows with Python >=3.8 should note we've pinned pytables to 3.8.0 due to compatibility issues.
š Community contributions
Many thanks to @Laiza Milena Scheid Parizotto and @Jon Cohen for contributing PRs to this release!
šØ This will be among the last releases in the 0.18.x line, very soon we will start working on 0.19.0. Stay tuned!
We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features.
Until next time,
The Kedro Team š