Ravi Kumar Pilla
12/19/2024, 2:19 PMdatabase
to ibis.TableDataset
for load and save operations.
- Added functionality to save pandas DataFrames directly to Snowflake, facilitating seamless .csv
ingestion.
- Added Python 3.9, 3.10 and 3.11 support for snowflake.SnowflakeTableDataset
.
- Enabled connection sharing between ibis.FileDataset
and ibis.TableDataset
instances, thereby allowing nodes to save data loaded by one to the other (as long as they share the same connection configuration).
- Added databricks.ExternalTableDataset
and safetensors.SafetensorsDataset
to experimental datasets.
šŖ² Bug fixes and other changes
- Made pandas.GBQTableDataset
lazy and pickleable.
- Made pandas.GBQQueryDataset
pickleable.
- Implemented Snowflake's local testing framework for testing purposes.
- Improved the dependency management for Spark-based datasets by refactoring the Spark and Databricks utility functions used across the datasets.
- Deprecated tracking.MetricsDataset
and tracking.JSONDataset
.
- Moved kedro-catalog
JSON schemas from Kedro core to kedro-datasets
.
ā ļø Breaking Changes
- Demoted video.VideoDataset
from core to experimental dataset.
- Removed file handling capabilities from ibis.TableDataset
. Use ibis.FileDataset
to load and save files with an Ibis backend instead.
kedro-airflow-0.9.2
š Major features and improvements
⢠Removed support for Python 3.8
kedro-docker-0.6.2
š Major features and improvements
⢠Added support for Python 3.13
⢠Removed support for python 3.8
⢠Switch dependency management to uv
.
kedro-telemetry-0.6.2
š Major features and improvements
⢠Removed support for Python 3.8
⢠Added support for Python 3.13
Thanks a lot to our community contributors ⨠-
⢠Felix Scherz
⢠@Minura Punchihewa
⢠@Thomas d'Hooghe
⢠@Mark Druffel
⢠@Chris Schopp
We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features.
Until next time,
The Kedro Team š