Hi everyone i am currently developing a project which uses GCP credentials. The problem i am facing is that i want to deploy a container of this pipeline but the secrets should no be in the container. I want to know if by using kedro-docker package the secrets are not added to the docker container or in case they do what can i do to handle these credentials with the docker deployment 😄 thanks

You can check the .dockerignore file that

kedro docker init

creates, I believe it ignores the credentials file. Then you can pass the credentials as environment variables to the container and modify the

dockerfile

so it calls

kedro run

with the creds as parameters. There might be another way but something like that should work

@Jose Alejandro Montaña Cortes the best approach would be to rely on Application Default Credentials. Could you share some details on how you’re attempting to run this on GCP?

Hi, i am trying to run the pipeline as a job by uploading the docker image. i configure the resources it will use and i just run it. The thing is taht i do not see where can i add the credentials so kedro can understand where it should get them from

i am trying to run the pipeline as a job by uploading

In which GCP service, Vertex AI, AI Pipelines (kubeflow)?

Hi, what we are doing is in cloud functions we create a job to run a docker image and we set up the resources and we just press the button execute. the image is uploaded to the registry.. So about the commands are just the commands that kedro docker create in the Docker file, basically kedro run

If you are using CloudRun the drill should be the same as for other services, If you don’t specify service account to run your cloud run job explicitly, it uses compute engine default service account and that is the job’s identity https://cloud.google.com/compute/docs/access/service-accounts#default_service_account

Ok thanks for your answer