Hi! Someone knows why we have this constraint in the

kedro-datasets

requirements?

delta-spark~=1.2.1

I noticed that it only affects

databricks-managedtabledataset

and not

spark-deltatabledataset

(which requires

"delta-spark>=1.0, <3.0"

)

Sorry, is your question, why is it so tight? If so, I think it can be relaxed, feels like an oversight. If you want to raise a PR to address, I would be happy to approve.

Thanks! I just wanted to know that it is not an issue regarding the delta-spark version in the databricks runtime

I'm all for relaxing dependency constraints. then if the CI fails, we should understand why, and if there's a known issue, put a version cap and a comment indicating it.