Robertqs
02/24/2023, 9:34 AMmarrrcin
02/24/2023, 9:46 AMEveryone sees the pipeline abstraction in Kedro and gets excited, thinking that we’re similar to orchestrators like Airflow, Luigi, Prefect, Dagster, Flyte, Kubeflow and more. We focus on a different problem, which is the process of authoring pipelines, as opposed to running, scheduling and monitoring them.
The responsibility of “What time will this pipeline run?“, “How do I manage my compute?” and “How will I know if it failed?” is left to the orchestrators. We also have deployment guidelines for using orchestrators as deployment targets and are working in collaboration with the maintainers of some of those tools to make the deployment experience as enjoyable as possible.Source https://kedro.readthedocs.io/en/stable/faq/faq.html#how-does-kedro-compare-to-other-projects
Nok Lam Chan
02/24/2023, 10:10 AMRobertqs
02/24/2023, 6:10 PM