Question on environments and credentials: We are currently using multiple environments for different runs, all of them however access the same SQL database. What is the preferred way to provide credentials configurations without having multiple

credentials.yml

files - perhaps add to conf/base and

.gitignore

the file?

you can use hooks / env vars

ok thanks

is

conf/base

not working? I think it should work?

both that & hooks work - just wanted to check if there is a preferred way.

yeah, I think

conf/base

and gitignore is fine for development. For deployment you will almost certainly inject this from environment variable or external credentials (key vault etc)

hi @Nikos Kaltsas , I’m curious - what do you mean with using multiple environments for different runs? what’s your use case?

@Juan Luis we have a lot of params that change depending on the pipeline input so we used the envs concept to parametrise through the cli - works well for us.

thanks @Nikos Kaltsas, that's what I expected. we have a long conversation about parameter sweep/experimentation/multi-run and I added your testimony at the end of it https://github.com/kedro-org/kedro/issues/1606