https://kedro.org/ logo
#questions
Title
# questions
h

Hugo Evers

02/12/2024, 5:05 PM
I just upgraded to kedro 0.19.2 and there is a bug when i set the
config_loader_args
. When in
settings.py
i set:
Copy code
CONFIG_LOADER_CLASS = OmegaConfigLoader
CONFIG_LOADER_ARGS = {
    "custom_resolvers": {
        "merge": merge_dicts,  
    },
}
Now kedro doesnt load my conf correctly, basically i have a few different configurations folders, (for testing, local, base, and aws_batch), when i set the config_loaders_args it now only loads the parameters and catalog entries from aws_batch, and not base (even though i set env=local). when i comment the config_loader_args out, there is no issue with loading the catalog. So i think this is overriding some of the config loading patterns, but i did not confirm that.
👀 1
K 1
n

Nok Lam Chan

02/12/2024, 5:17 PM
https://docs.kedro.org/en/latest/resources/migration.html#changes-to-the-default-environments
Copy code
CONFIG_LOADER_ARGS = {
      "base_env": "base",
      "default_run_env": "local",
          "config_patterns": {
              "spark": ["spark*", "spark*/**"],
          }
}
You need to add the base_env and default_run_env if you have override
CONFIG_LOADER_ARGS
h

Hugo Evers

02/12/2024, 5:29 PM
thanks! i recall seeing that in the documentation but it refered to a very specific case of some dataset configs, but now that you mention it, it connects the dot. yes that worked!
n

Nok Lam Chan

02/12/2024, 5:34 PM
Ya I think it should be stated more clearly in
RELEASE.md
, thanks for flagging. It should only affect projects that are upgrade from older version to 0.19.
2 Views