Hello all kedro enthusiasts, I am looking for implementation of kedro dataset

json.JSONDataSet

supporting gzip compression, so the filepath would be

*.json.gz

I haven’t found such backend in

kedro.datasets

Have anyone already implemented such dataset?

Since we use

fsspec

behind the scenes I think it’s possible that you can provide

compression='gzip'

as an an argument to

fs_args

https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.open If that doesn’t work it should be very simple to subclass the dataset and provide your own implementation

I will check if fs-args solve my problem. Thanks.