Channels
announcements
introduce-yourself
resources
random
plugins-integrations
user-research
questions
questions-so
job-posting
help-
circleci-status
dependencies-releases
Powered by
#plugins-integrations
Title
# plugins-integrations
w
Walber Moreira
02/08/2023, 9:06 PM
@datajoely
im just finishing the test cases on polars.Generic , and Im wondering why I never used pandas.generic lol, thx for the input 🎉🤪
d
datajoely
02/09/2023, 10:32 AM
AMAZING!
This is what we’re talking about by the way
https://github.com/kedro-org/kedro-plugins/pull/95/files
And you can use the pandas equivalent to see how we did that:
https://kedro.readthedocs.io/en/stable/_modules/kedro/extras/datasets/pandas/generic_dataset.html#GenericDataSet
The bit that’s important is that we included an exclusion list of
NON_FILE_SYSTEM_TARGETS
so we didn’t support writing in certain directions. With polars we could possibly do this dynamically and simply check what suffixes are available 🙂
6 Views
Post