Hello everyone! I am exploring ways to implement d...
# questions
o
Hello everyone! I am exploring ways to implement data validation on data pipeline output using Kedro and Databricks. Do you have any suggestions about the modules I can use for this?
d
So if you want to do runtime checks Iā€™m a big fan of pandera
šŸ‘ 1
if you want to do checks at rest Great Expectations is often a good shout
šŸ‘ 1
o
Thanks @datajoely, my use case is more aligned with runtime check. I will check out pandera.