Sebastian Cardona Lozano
02/01/2023, 4:43 AMkedro-mlflow
plugin to achieve what we want. Here are the questions: Once you have the mlflow artifact can we still use the kedro-docker plugin to create the image or do we have to create the Docker image from scratch? From the other hand, can we still use the other plugins to export the pipeline to Airflow or Vertex Pipelines?
2. On that basis, we start to question if is it better to use mlflow for tracking and model registry taking advantage of the Kedro plugins, than the Vertex AI APIs. I would like to know your opinion about this or recommendations about how to combine both worlds.
Thanks in advance.
#C03RKP2LW64 #C03RKPCLYGYdatajoely
02/01/2023, 8:35 AMkedro-docker
is maintained by the core team, but is really designed for people who don’t know where to start with docker and give them something to get going
• kedro-mlflow
is a community driven plugin which our users really love, but I’m not sure if any thing changes when containerised
• kedro-vertexai
is another community driven plugin which apparently has great integration with the kedro-mlflow
plugin above
All in all how you package or orchestrate your kedro pipelines isn’t something we’re super opinionated on. In terms of philosophy I like the view presented here