Hello! Does anyone here have experience using Kedro for data engineering, specifically with Iceberg or Delta, using CDF/CDC and streaming workloads, and has had to handle historical backfills caused by late-arriving dimensions?
I understand I may need to declare multiple catalog entries for different load/save patterns against the same physical table. I'm afraid this causes a mismatch between the physical table and its abstraction layer and confuses the lineage. I'm interested in hearing how others have structured this in practice ☺️