https://kedro.org/ logo
Powered by
#questions
Title
# questions
v

Vincent Liagre

07/20/2023, 11:44 AM
Hello team ; I have installed my module (within 
src/my_module
) with 
pip install -e src
; now 
kedro
is looking for data within the 
my_module
folder from root for some reason. Any clue whats going on here and how I can solve this ? Happy to provide more details if required 🙂
d

datajoely

07/20/2023, 11:45 AM
can you provide a stack trace?
v

Vincent Liagre

07/20/2023, 11:49 AM
Copy code
┌─────────────────────────────── Traceback (most recent call last) ────────────────────────────────┐
│ C:\Users\Vincent Liagre\Anaconda3\envs\my_env\lib\site-packages\kedro\io\core.py:210 in   │
│ load                                                                                             │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\kedro_datasets\pandas\excel_dataset.py:223 │
│ in _load                                                                                         │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\util\_decorators.py:211 in wrapper  │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\util\_decorators.py:331 in wrapper  │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\io\excel\_base.py:482 in read_excel │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\io\excel\_base.py:1695 in __init__  │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\io\excel\_openpyxl.py:557 in        │
│ __init__                                                                                         │
│                                                                                                  │
│ C:\Users\Vincent                                                                                 │
│ Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\io\excel\_base.py:535 in __init__   │
│                                                                                                  │
│ C:\Users\Vincent Liagre\Anaconda3\envs\my_env\lib\site-packages\pandas\io\common.py:865   │
│ in get_handle                                                                                    │
└──────────────────────────────────────────────────────────────────────────────────────────────────┘
FileNotFoundError: [Errno 2] No such file or directory: 'C:/Projects/my_env/my_module/<path_to_my_data.xlsx>
d

datajoely

07/20/2023, 11:50 AM
and can you show the catalog entry?
v

Vincent Liagre

07/20/2023, 11:50 AM
I guess for some reason 
kedro
thinks I am within 
my_module
d

datajoely

07/20/2023, 11:50 AM
I’m not sure that should matter, the dataset handles this
v

Vincent Liagre

07/20/2023, 11:51 AM
Copy code
my_dataset:
  type: pandas.ExcelDataSet
  filepath: path_to_my_data
d

datajoely

07/20/2023, 11:51 AM
and that path, does it live locally
or s3 etc
v

Vincent Liagre

07/20/2023, 11:51 AM
locally 🙂
d

datajoely

07/20/2023, 11:51 AM
and do you have any custom hooks or decorators here?
v

Vincent Liagre

07/20/2023, 11:51 AM
and the issue is fixed when I 
pip uninstall my_module
I have just onboarded on the existing project, let me check hooks / decorators
d

datajoely

07/20/2023, 11:52 AM
is the 
my_module
name the same as the main Kedro package
v

Vincent Liagre

07/20/2023, 11:52 AM
yes precisely
d

datajoely

07/20/2023, 11:52 AM
okay
that may be causing some issues if it has exactly the same name
Python is just overwriting the namespace
v

Vincent Liagre

07/20/2023, 11:53 AM
but it is not only "the same", it is the main Kedro package
point is to be able to easily use nodes in notebooks
d

datajoely

07/20/2023, 11:53 AM
why does having the same name make that easier?
v

Vincent Liagre

07/20/2023, 11:55 AM
so you think I should just change the name in the 
setup.py
?
it's not that I intentionally put the same name, its really the main kedro project package so by default its the same name
d

datajoely

07/20/2023, 12:49 PM
yes I think the setup.py name before you install will be the easiest option
my_module_nodes
etc should fix it
v

Vincent Liagre

07/20/2023, 12:54 PM
@datajoely this seems to resolve the issue ; thanks
Now I am wondering : how do other people do ?
d

datajoely

07/20/2023, 1:00 PM
Python has no protection against this, the trick is to keep your import namespace mutually exclusive
v

Vincent Liagre

07/20/2023, 1:12 PM
I just changed the name in the 
setup
function, which I think just changes the name in the 
pip list
but not the names I need to use in imports
d

datajoely

07/20/2023, 1:13 PM
the two are interlinked in funny ways, especially when you’re doing an 
pip install -e
editable install
v

Vincent Liagre

07/20/2023, 1:14 PM
ok lets say at least it works 🪄
Powered by