Hi team, I wrote a small plugin to deploy kedro applications on single AWS Sagemaker instances using Sagemaker Processing. I've found quite a bit of plugins that implement deploying Kedro on cluster of cloud machines, however I couldn't find an implementation that would run a containarized Kedro pipeline on a temporary cloud machine of the like of a Sagemaker instance. It's called kedro-cloud as it may grow to supporting other vendors than AWS. Here is the repo: https://github.com/antoinebon/kedro-cloud
01/06/2023, 10:31 AM
This is really cool!
01/09/2023, 8:25 AM
We have recently released this plugin https://github.com/getindata/kedro-sagemaker, which takes slightly more robust approach - we encourage you @Antoine Bon to contribute there! 🙂
Also, you should check out other plugins for: Azure ML, Vertex AI and Kubeflow that we’ve build - they cover all major cloud providers at this point.