&gt; When I open-sourced <Apache Airflow> back in ...
# resources
j
When I open-sourced Apache Airflow back in 2015, I thought we would see data engineers leveraging these tools to create reusable, high-level constructs. I imagined pipelines that could be shared across companies—like software libraries—where teams could build once and use everywhere. But that hasn’t happened. Even at the Airflow Summit, where we saw huge advancements in orchestration, no one was talking about reusing the actual logic within these pipelines.
https://preset.io/blog/why-data-teams-keep-reinventing-the-wheel/
👍 1