hello all! from kedro.framework.session import KedroSession from kedro.framework.startup import bootstrap_project I'm trying to run my project in databricks and I'm initiating session: bootstrap_project(project_root) with KedroSession.create(project_path=project_root, env="databricks") as session: session.run() bootstrap_project works and gives me info which point correctly to the folder my project is stored in databricks

ProjectMetadata(
    config_file=PosixPath('/Workspace/Repos/.../.../.../modeling/.../.../scalability/pyproject.toml'),
    package_name='scalability',
    project_name='scalability',
    project_path=PosixPath('/Workspace/Repos/.../.../.../modeling/.../.../scalability'),
    project_version='0.18.4',
    source_dir=PosixPath('/Workspace/Repos/.../.../.../modeling/.../.../scalability/src')
)

but when session.run() is executed it gives me an error: ModuleNotFoundError: No module named 'scalability.pipeline_registry' and I have this file under /Workspace/Repos/.../.../.../modeling/.../.../scalability/src/scalability/pipeline_registry even though source_dir from ProjectMetadata shows the correct path, why it gives me this error? thanks in advance!

would check sys.path to make sure

scalability.pipeline_registry

is available. if not then you just need to add to the PYTHONPATH

thanks for the reply! the problem was that because of the compatability issues, I installed 0.18.4 version and locally it ran fine but on databricks it didn't see scalability.pipeline_registry, when updating to 0.18.7 on databricks the issue was solved