Does QB have something on top of Kedro?
In our company we have data engineers (technical people) who can build pipelines (currently not Kedro), but don't actually run pipelines in production. We have build a small UI on top of the existing pipeline infrastructure that allows non-technical users to upload files, do manual validation and execute one or more pipeline tasks.
Is this something you have seen as well at other companies?
07/11/2023, 1:57 PM
Yes, I can tell you a few of the things we have on top of them because one is getting open-sourced. Could you also show us your UI sometime?
What's built on top of Kedro or integrates with it:
• VizX (will be renamed): A framework for building dashboards; it has this feature that allows users to change parameters and re-run the pipeline. And it will be open-sourced in Q3.
• Reusable pipeline ecosystem across different industries: Products like CustomerOne are largely built with reusable pipelines. We have this across many different industries and this has happened because we use Kedro so much.
Michel van den Berg
07/11/2023, 1:59 PM
The UI is really crappy tbh... we are rebuilding it now, and thinking of using Kedro as the underlying tech