https://kedro.org/ logo
#questions
Title
# questions
p

Panos P

06/23/2023, 4:44 PM
Hello folks, I have a kedro framework with a lot of parameters and and catalog records, when I run kedro run with a different environment I get this log messages:
kedro.config.config - INFO - Config from path "/conf/dev" will override the following existing top-level config keys
This messages appear for about 30 minutes before the kedro pipeline even runs. Do you have any ideas, recommendations of speeding this up?
m

marrrcin

06/26/2023, 7:07 AM
Try changing log level to error
n

Nok Lam Chan

06/26/2023, 5:16 PM
This is very unusual if the validation logic takes 30 mins to run. How big is your parameters & catalog file?
Can you do some profiling to check where is the bottleneck?
3 Views