hi all! on friday i started getting the below erro...
# questions
n
hi all! on friday i started getting the below error when trying to run a node or pipeline
Copy code
ValueError: Failed to find the pipeline named 'data_engineering'. It needs to be generated and returned by the 'register_pipelines' function.
i can see that the data_engineering pipeline exists based on the file structure so i'm not sure what caused this error since i've run the pipeline many times before any help on this is appreciated! thanks!
d
Do you have any warnings in your logs, basically saying that
data_engineering
pipeline had some errors? That could be reason it's not included.
šŸ‘šŸ¼ 1
n
i get the error for all 3 of my pipelines, but how would i go about checking the logs? (still new to kedro šŸ™‚ )
d
It should be printed out. What do you get when you do
kedro run
, full log?
n
You should see the terminal outputing log already, try to search for
ERROR
maybe?
šŸ‘ 1
The error that you post is from Python, if you scroll up a little bit there should be more info
n
ā”‚   379 ā”‚   ā”‚   name = pipeline_name or "__default__"                                              ā”‚
ā”‚ 380 ā”‚ ā”‚ ā”‚ ā”‚ 381 ā”‚ ā”‚ try: ā”‚ ā”‚ ā± 382 ā”‚ ā”‚ ā”‚ pipeline = pipelines[name] ā”‚ ā”‚ 383 ā”‚ ā”‚ except KeyError as exc: ā”‚ ā”‚ 384 ā”‚ ā”‚ ā”‚ raise ValueError( ā”‚ ā”‚ 385 ā”‚ ā”‚ ā”‚ ā”‚ f"Failed to find the pipeline named '{name}'. " ā”‚ ā”‚ ā”‚ ā”‚ /opt/anaconda3/envs/core-kedro-snowpark/lib/python3.10/site-packages/kedro/framework/project/__i ā”‚ ā”‚ nit__.py:137 in inner ā”‚ ā”‚ ā”‚ ā”‚ 134 ā”‚ # noqa: protected-access ā”‚ ā”‚ 135 ā”‚ def inner(self, *args, **kwargs): ā”‚ ā”‚ 136 ā”‚ ā”‚ self._load_data() ā”‚ ā”‚ ā± 137 ā”‚ ā”‚ return func(self._content, *args, **kwargs) ā”‚ ā”‚ 138 ā”‚ ā”‚ ā”‚ 139 ā”‚ return inner ā”‚ ā”‚ 140 ā”‚ ā•°ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā•Æ KeyError: 'data_engineering'
and i was mistaken, my other 2 pipelines ran when i used "kedro run", but it just skipped over the data_engineering one. so it looks like this is the only one giving me trouble
d
Can you share logs further up? Almost certainly, there is an error in trying to load the
data_engineering
pipeline--could be a syntax error in the pipeline, maybe a missing library (
snowpark
?), something else.
n
yep you're right, totally missed that. looks like one of the packages i was using updated and within that update one of the imports i use was changed. thanks for the help!!
šŸ™Œ 1