Hello everyone. Does anyone know if there is documentation on how to use google storage files instead of amazon s3?

Most of the Kedro datasets should work out of the box, as they’re using fsspec for file operations. As long as you have

gcsfs

dependency installed it should work.

Right, but how do I set up the credentials? Should I use environment variables?

You can either use

credentials.yml

or just set

GOOGLE_APPLICATION_CREDENTIALS

env variable and point to service account json path

I'm not sure how to set up the credentials for google cloud, so I guess I'll just use the env variable. Thanks for the answer.