Hello folks, I have a kedro framework with a lot ...
# questions
p
Hello folks, I have a kedro framework with a lot of parameters and and catalog records, when I run kedro run with a different environment I get this log messages:
kedro.config.config - INFO - Config from path "/conf/dev" will override the following existing top-level config keys
This messages appear for about 30 minutes before the kedro pipeline even runs. Do you have any ideas, recommendations of speeding this up?
m
Try changing log level to error
n
This is very unusual if the validation logic takes 30 mins to run. How big is your parameters & catalog file?
Can you do some profiling to check where is the bottleneck?