Ankita Katiyar
12/07/2022, 5:39 PMTLDR: In this release, we introduce the option of usingKedro 0.18.4 is a non-breaking release in the 0.18.x series, which means you can upgrade with:as its own package, easier ways to access and update project configurations, new datasets to work with svmlight/libsvm files and video objects and more!kedro-datasets
pip install kedro==0.18.4
or conda install -c conda-forge kedro==0.18.4
🚀 Major Features/Changes
• We have released kedro-datasets
as its own package (Check it out here!) and Kedro now instantiates datasets from kedro_datasets
with a higher priority than kedro.extras.datasets
.
• The config loader now implements UserDict
and the configuration can now be accessed through conf_loader['catalog']
.
• You can configure config file patterns through settings.py
without having to create a custom config loader.
• Support for a functional definition of schema added to dask.ParquetDataSet
to work with <http://dask.to|dask.to>_parquet
API.
• Our documentation has had a revamp, including a new and improved Spaceflights tutorial.
• New datasets added to our collection -
◦ svmlight.SVMLightDataSet
◦ video.VideoDataSet
◦ video.video_dataset.SequenceVideo
◦ video.video_dataset.GeneratorVideo
🪲 Bug fixes and other changes
• Fixed kedro micropkg pull
for packages on PyPI.
• Fixed format
in save_args
for SparkHiveDataSet
, previously it didn’t allow you to save it as delta format.
• Fixed save errors in TensorFlowModelDataset
when used without versioning; previously, it wouldn’t overwrite an existing model.
• The Kedro IPython extension now surfaces errors when it cannot load a Kedro project.
• And more …
You can find the full list of changes in the release notes:
https://github.com/kedro-org/kedro/releases/tag/0.18.4Eugene P
12/07/2022, 8:24 PMpandas.SQLQueryDataSet
. Can this contribution be of any value for Kedro/Your team and if yes what are the contribution guidelines?
thanks!Merel
12/08/2022, 8:39 AM