Juan Luis
10/26/2023, 7:00 AMPartitionedDataSet
and IncrementalDataSet
from the core Kedro repo to kedro-datasets
and renamed to PartitionedDataset
and IncrementalDataset
.
• Added polars.LazyPolarsDataset
, a GenericDataSet
using Polars's lazy API.
• Renamed polars.GenericDataSet
to polars.EagerPolarsDataset
to better reflect the difference between the two dataset classes.
• Added a deprecation warning when using polars.GenericDataSet
or polars.GenericDataset
that these have been renamed to polars.EagerPolarsDataset
• Delayed backend connection for pandas.SQLTableDataset
, pandas.SQLQueryDataset
, and snowflake.SnowparkTableDataset
. In practice, this means that a dataset's connection details aren't used (or validated) until the dataset is accessed. On the plus side, the cost of connection isn't incurred regardless of when or whether the dataset is used.
A kedro-airflow 0.7
• Added support for Python 3.11.
• Added the --all
CLI argument to kedro-airflow
to convert registered all pipelines at once.
• Simplify the output of the kedro airflow create
command.
• Fixed compatibility of kedro-airflow
with older versions of the config loaders (kedro<=0.18.2
).
• Removed support for Python 3.7.
docker kedro-docker 0.4
• Added support for Python 3.11.
• Removed support for Python 3.7.
📡 kedro-telemetry 0.3
• Added support for Python 3.11.
• Removed support for Python 3.7.
many thanks to our community contributors Peter Bludau, Alistair McKelvie, @H. Felix Wittmann, @Matthias Roels, and Simon Brugman 👏🏼
python notice that we dropped Python 3.7 and added support for Python 3.11 across the board. going forward, for kedro-datasets we will follow NEP 29 (hence a 42 month support window - Python 3.8 will be dropped soon!) and for kedro framework and the other official plugins we will drop Python versions that reach their end-of-life status without making a major release.
(And yes, Python 3.12 is coming soon!)
Until next time,
The Kedro Team 💛