Kedro is an open-sourced Python framework for creating maintainable and modular data science code.

Kedro

Hi everyone!
Has anyone tried to running *kedro with symlink* folder?

I have my parameters in `conf/base/sub_folder/parameters_A.yml` kind of structure. The pipeline give me following error with this structure, however it is able to read the parameters if I have following structure: `conf/base/parameters_A.yml`
Note that folder: `sub_folder` is symlinked.
`ValueError: Pipeline input(s) {'params:length', 'params:width'} not found in the DataCatalog`

I need to check the resulting path resolved on the framework side. It will take some time.

Alright, the problem is that `fsspec.filesystem.glob()` which we use to find the paths recursively doesn’t find simlinks.

Thanks for reporting, I’ll open an issue.

Thanks Elena! My debuggin lead me to <https://discuss.python.org/t/treating-symlinks-consistently-in-pathlib-path-glob/49233|this> which could be helpful

Issue created: <https://github.com/kedro-org/kedro/issues/3972>