[Kedro + GCP’s Cloud Run]
Any directions on orchestrating kedro to run on GCP’s Cloud Run?
Today I have a docker image with a kedro pipeline that runs on Cloud Run end-to-end, but it’s getting big and I wonder if I should run different nodes from that pipeline on different Cloud Runs. Any directions?
10/02/2023, 2:56 PM
Do you run it as Cloud Run Jobs or did you write a HTTP API on top of Kedro for that?
10/02/2023, 3:09 PM
as a cloud run job
I’m reading about Airflow and Composer… seems to be a possible solution