Juan Luis
05/23/2023, 7:10 AMkedro.extras.datasets
is deprecated and will be removed in Kedro 0.19, so these improvements won't be backported. to benefit from them, run
pip install "kedro-datasets==1.3.0"
and check out the complete list of datasets in our documentation https://docs.kedro.org/en/stable/kedro_datasets.html
🚀 Major Features/Changes
• Added pandas 2.0 support.
• Added SQLAlchemy 2.0 support (and dropped support for versions below 1.4).
• Added a save method to the APIDataSet
• Reduced constructor arguments for APIDataSet
by replacing most arguments with a single constructor argument load_args
. This makes it more consistent with other Kedro DataSets and the underlying requests
API, and automatically enables the full configuration domain: stream, certificates, proxies, and more.
• Relaxed Kedro version pin to >=0.16
• Added metadata
attribute to all existing datasets. This is ignored by Kedro, but may be consumed by users or external plugins.
• Added ManagedTableDataSet
for managed delta tables on Databricks.
🐛 Bug fixes and other changes
• Relaxed delta-spark
upper bound to allow compatibility with Spark 3.1.x and 3.2.x.
• Upgraded required polars
version to 0.17.
• Renamed TensorFlowModelDataset
to TensorFlowModelDataSet
to be consistent with all other plugins in kedro-datasets.
kedroid Community contributions
Thank you to Brian Cechmanek, Joseph McDonnell, and Danny Farah!
Until next time,
The Kedro Team 💛Vladimir Filimonov
05/23/2023, 8:16 AMManagedTableDataSet
you mentioned, but its for sure in the codeJuan Luis
05/23/2023, 8:38 AMIñigo Hidalgo
05/23/2023, 8:43 AMJose Nuñez
05/23/2023, 4:25 PMJuan Luis
05/23/2023, 6:10 PM