Hi Kedro Team,
I'm currently deploying Kedro in Kubernets and scheduling it via Kubernets Cron Jobs and running it using Kedro run -p <pipeline_name>. I'm facing an issue when there's a wrong inside the pipeline (data not available or else which is fine) it will continuously retry. I want to add an exit code into my Kedro pipeline so if there's an error it will exit immediately. Where to put it, can't find it in the docs.
05/19/2023, 6:51 AM
1. How you’re deploying it to K8s?
2. Kedro does not do automatic retry, it’s k8s that restarts your job/deployment
05/19/2023, 7:16 AM
Hi @marrrcin thanks for replying
1. Via Docker but using Kubernetes cron job, so when it's the scheduled time it will create a container and run "Kedro run -p <pipeline_name>"