:kedro: <!channel> we're happy to announce that ke...
# announcements
j
K <!channel> we're happy to announce that kedro-datasets 1.3.0 is out! 🎉 kedro-datasets is a separate PyPI package where Kedro datasets live. ⚠️
kedro.extras.datasets
is deprecated and will be removed in Kedro 0.19, so these improvements won't be backported. to benefit from them, run
Copy code
pip install "kedro-datasets==1.3.0"
and check out the complete list of datasets in our documentation https://docs.kedro.org/en/stable/kedro_datasets.html 🚀 Major Features/Changes • Added pandas 2.0 support. • Added SQLAlchemy 2.0 support (and dropped support for versions below 1.4). • Added a save method to the APIDataSet • Reduced constructor arguments for
APIDataSet
by replacing most arguments with a single constructor argument
load_args
. This makes it more consistent with other Kedro DataSets and the underlying
requests
API, and automatically enables the full configuration domain: stream, certificates, proxies, and more. • Relaxed Kedro version pin to
>=0.16
• Added
metadata
attribute to all existing datasets. This is ignored by Kedro, but may be consumed by users or external plugins. • Added
ManagedTableDataSet
for managed delta tables on Databricks. 🐛 Bug fixes and other changes • Relaxed
delta-spark
upper bound to allow compatibility with Spark 3.1.x and 3.2.x. • Upgraded required
polars
version to 0.17. • Renamed
TensorFlowModelDataset
to
TensorFlowModelDataSet
to be consistent with all other plugins in kedro-datasets. kedroid Community contributions Thank you to Brian Cechmanek, Joseph McDonnell, and Danny Farah! Until next time, The Kedro Team 💛
🥳 20
🎉 6
K 12
🎉 12
v
awesome news! 🤘 am I missing something or https://docs.kedro.org/en/stable/kedro_datasets.html is not in sync with latest of https://github.com/kedro-org/kedro-plugins/tree/main/kedro-datasets/kedro_datasets? Ex. I can’t see in docs reference to
ManagedTableDataSet
you mentioned, but its for sure in the code
j
it's indeed not in sync @Vladimir Filimonov, good catch - at the moment our docs infra is not ready for updating these after each subproject release, but hopefully it will be soon 🙏🏼
🥳 2
i
Looking forward to trying out the new APIDataSet and the dataset metadata!! Thanks team!
🙌🏼 1
j
I still don't see polars in the list 🥹
j
same reason as above, still not in sync loading working on it!
🥹 1