Hi Team, I’m working in a SageMaker notebook which is in the

/notebook

directory. I’m trying to load some nodes that I created locally but it doesn’t find path. Two questions: • How can load kedro context to this notebook? • How can I load python modules developed as part of the kedro project? Thank you! I looked into this but somehow I can’t make it work: https://docs.kedro.org/en/0.18.11/notebooks_and_ipython/kedro_and_notebooks.html

do you get an error?

yeah, what does

%load_ext kedro.ipython

give?

When I’m trying to load the below:

from gci_pricing.pipelines.feature_engineering.treasury import (
    create_treasury_total_features,
    create_treasury_trx_type_features
)

I’m getting

ModuleNotFoundError: No module named 'gci_pricing'

.

oh okay I misunderstood, this must be a

sys.path

thing. you're trying that inside a notebook right?

For

%load_ext kedro.ipython

, I’m getting

ModuleNotFoundError: No module named 'kedro'

.

so, looks like the kernel of the notebook you launched doesn't have kedro nor your project installed. can you do

import sys
print(sys.prefix, sys.executable)

and see if it matches what you expected?

My pwd is

/home/ec2-user/SageMaker/<my project name>/notebooks/data_engineering

and from the terminal, what's the output of

kedro info

,

which kedro

, and

which python

@Mate Scharnitzky?

image.png

okay so we got it.

kedro

is installed in the

base

environment of Anaconda, which is not the same as

/home/ec2-user/SageMaker/pyspark

found it

you can try

/home/ec2-user/SageMaker/pyspark/bin/python -m pip install kedro

and then in your notebook you should be able to do

%load_ext kedro.ipython

I installed it to the

pyspark

env

🎉

so loading the context now works

excellent!

then if I load the context then I load the modules from the package as well

is there anything we could have added to the documentation you linked that would have helped in this situaiton?

I don’t think so

this isn’t quite the same thing, but maybe helpful

thank you!

https://github.com/kedro-org/kedro/issues/2412 This is related, I put Joel’s link there for reference.