Hi, I wonder if anyone have experience using Kedro with Prefect 2.0? How different is it from Prefect 1?

We evaluated prefect for our orchestration, the nice thing about it is that you can just define flows in code using decorators which simplified configuration. It was only a short evaluation and we decided to move for Argo as it is more similar to our current deployment patterns, but Prefect 2 seemed promising although it would’ve required some work to unify kedro pipelines and prefect flows, as some functionality overlapped. cc @Deepyaman Datta

Thanks @Iñigo Hidalgo! I have add this into https://github.com/kedro-org/kedro/issues/2431, as it’s easier to keep conversation in one main thread.

Great @Nok Lam Chan, is the idea to implement some sort of Prefect runner, or to work on updating the deployment documentation?

yes Prefect 2.0 is fully open source, see https://github.com/kedro-org/kedro/issues/2431#issuecomment-1570454756 , which comes from https://prefect-community.slack.com/archives/CL09KU1K7/p1685531174933939

I think it’s still up and open, depends on which solution is the best. I guess it’s still a good exercise to try to update the current docs with 2.0 and try to come up with a more powerful Runner.