Hello, I have a quick question: What is the use-case for

dataset.confirm()

? Documentation is not clear, also it is not implemented in any dataset except

IncrementalDataSet

.

it’s not part of the AbstractDataSet classes, it’s part of the mechanism of how the IncrementalDataSet checkpoints. https://kedro.readthedocs.io/en/stable/_modules/kedro/io/core.html#AbstractDataSet what are you trying to understand?

OK I see, I thought it could be used to somehow validate data quality.

no for that - your best bet is hooks

Thanks for the quick answer! I'll check out hooks.