I think Kedro

0.19.12

and the changes we did to the databricks starter (https://github.com/kedro-org/kedro-starters/pull/267) might have broken the resource creation for the

kedro-databricks

plugin @Jens Peder Meldgaard. When I do

kedro databricks bundle

the resources folder gets created, but it's empty. (cc: @Sajid Alam)

I can have a look later today. I’m not entirely up to speed with the new changes to Kedro, so will have to do some testing. 😊

Thank you! 🙏 We're happy to help too if needed.

I’ve been trying to slim it down and let Databricks do the heavy lifting where possible. I can have a look at the docs as well

@Merel I think this is an issue with cookiecutter, when we moved files from a flat structure to a modular one we didn't update

cookiecutter.json

with the

tools

variable and confused cookiecutter. I opened a PR to fix this: https://github.com/kedro-org/kedro-starters/pull/273

So I did some experimenting yesterday, and you’re right. My new updates did break the clean deployment from the iris starter. It has to do with which cluster configuration you use as security enabled clusters simply don’t have access to dbfs. I’m trying to find a good middle ground where I still promote best practice but can support easy deployment from the iris starter. A new update will be coming soon! 😊