04/03/2023, 11:11 AM
Hey, is there any way to use an IncrementalDataSet with a SQL query to incrementally fetch partitions from RDBMS tables, or it works only with object storage partitioned data?
Nok Lam Chan
04/03/2023, 11:19 AM
I don’t think this is supported natively -
may have better idea. It was designed to work with files -
is an example of how it can be used.
04/03/2023, 11:36 AM
no we don’t natively support this - if you look at our DeltaLake docs we talk about how to do the
in Kedro, but it’s not a fantastic fit for our load/save pattern
04/03/2023, 2:43 PM
ok thanks for the information :)