https://kedro.org/ logo
#plugins-integrations
Title
# plugins-integrations
w

Walber Moreira

02/08/2023, 9:06 PM
@datajoely im just finishing the test cases on polars.Generic , and Im wondering why I never used pandas.generic lol, thx for the input 🎉🤪
d

datajoely

02/09/2023, 10:32 AM
AMAZING!
This is what we’re talking about by the way https://github.com/kedro-org/kedro-plugins/pull/95/files And you can use the pandas equivalent to see how we did that: https://kedro.readthedocs.io/en/stable/_modules/kedro/extras/datasets/pandas/generic_dataset.html#GenericDataSet The bit that’s important is that we included an exclusion list of
NON_FILE_SYSTEM_TARGETS
so we didn’t support writing in certain directions. With polars we could possibly do this dynamically and simply check what suffixes are available 🙂
6 Views