Ravi Kumar Pilla
12/19/2024, 2:19 PMdatabase to ibis.TableDataset for load and save operations.
- Added functionality to save pandas DataFrames directly to Snowflake, facilitating seamless .csv ingestion.
- Added Python 3.9, 3.10 and 3.11 support for snowflake.SnowflakeTableDataset.
- Enabled connection sharing between ibis.FileDataset and ibis.TableDataset instances, thereby allowing nodes to save data loaded by one to the other (as long as they share the same connection configuration).
- Added databricks.ExternalTableDataset and safetensors.SafetensorsDataset to experimental datasets.
šŖ² Bug fixes and other changes
- Made pandas.GBQTableDataset lazy and pickleable.
- Made pandas.GBQQueryDataset pickleable.
- Implemented Snowflake's local testing framework for testing purposes.
- Improved the dependency management for Spark-based datasets by refactoring the Spark and Databricks utility functions used across the datasets.
- Deprecated tracking.MetricsDataset and tracking.JSONDataset.
- Moved kedro-catalog JSON schemas from Kedro core to kedro-datasets.
ā ļø Breaking Changes
- Demoted video.VideoDataset from core to experimental dataset.
- Removed file handling capabilities from ibis.TableDataset. Use ibis.FileDataset to load and save files with an Ibis backend instead.
kedro-airflow-0.9.2
š Major features and improvements
⢠Removed support for Python 3.8
kedro-docker-0.6.2
š Major features and improvements
⢠Added support for Python 3.13
⢠Removed support for python 3.8
⢠Switch dependency management to uv.
kedro-telemetry-0.6.2
š Major features and improvements
⢠Removed support for Python 3.8
⢠Added support for Python 3.13
Thanks a lot to our community contributors ⨠-
⢠Felix Scherz
⢠@Minura Punchihewa
⢠@Thomas d'Hooghe
⢠@Mark Druffel
⢠@Chris Schopp
We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features.
Until next time,
The Kedro Team š