https://kedro.org/ logo
#questions
Title
# questions
n

Nikos Kaltsas

11/06/2023, 3:30 PM
Question on environments and credentials: We are currently using multiple environments for different runs, all of them however access the same SQL database. What is the preferred way to provide credentials configurations without having multiple
credentials.yml
files - perhaps add to conf/base and
.gitignore
the file?
d

datajoely

11/06/2023, 3:30 PM
you can use hooks / env vars
n

Nikos Kaltsas

11/06/2023, 3:31 PM
ok thanks
@Giuseppe Ughi ^
n

Nok Lam Chan

11/06/2023, 4:16 PM
is
conf/base
not working? I think it should work?
n

Nikos Kaltsas

11/06/2023, 4:35 PM
both that & hooks work - just wanted to check if there is a preferred way.
๐Ÿ‘ 1
๐Ÿ‘๐Ÿผ 1
n

Nok Lam Chan

11/06/2023, 4:43 PM
yeah, I think
conf/base
and gitignore is fine for development. For deployment you will almost certainly inject this from environment variable or external credentials (key vault etc)
๐Ÿ‘ 1
j

Juan Luis

11/07/2023, 6:15 AM
hi @Nikos Kaltsas , Iโ€™m curious - what do you mean with using multiple environments for different runs? whatโ€™s your use case?
n

Nikos Kaltsas

11/07/2023, 10:28 AM
@Juan Luis we have a lot of params that change depending on the pipeline input so we used the envs concept to parametrise through the cli - works well for us.
๐Ÿ‘๐Ÿผ 1
j

Juan Luis

11/07/2023, 10:36 AM
thanks @Nikos Kaltsas, that's what I expected. we have a long conversation about parameter sweep/experimentation/multi-run and I added your testimony at the end of it https://github.com/kedro-org/kedro/issues/1606
๐Ÿ‘๐Ÿผ 1
3 Views