How can I configure my dataset catalog to read/write files to either my local file system or s3 depending on the env variable ENVIRONMENT which can be

dev

or

prod

?

I think the best way would be kedro config environments: https://docs.kedro.org/en/stable/configuration/configuration_basics.html#configuration-environments You would just do

kedro run --env=$ENVIRONMENT

Then have separate catalog entries in your

dev

and

prod

catalogs But if you want it to be dynamic at run time you could do something like a hook (maybe using this hook). But using

env

seems more right

Thank you!