Hello folks. Is there any way I can use globals params from env other than base? problem: I have some configurations that are parsed from globals to other params files by reference

my_param: ${my_param_in_globals.yml}

for some reason we can parse params like that just from base globals.yml. and when i try to get from live/globals.yml it’s not taken.

hello Felipe! are you using the default

ConfigLoader

or something else? also, what version of Kedro are you using?

Hello Juan! I’m using

from kedro.config import TemplatedConfigLoader
import os

CONFIG_LOADER_CLASS = TemplatedConfigLoader
CONFIG_LOADER_ARGS = {"globals_pattern": "*globals.yml",
                      "globals_dict": os.environ,
                      }

maybe it's because of the

globals_pattern

🤔 what about

"globals_pattern": "**/globals.yml",

@Felipe Vianna?

Let me try it

I’m not quite sure I understand the setup. What config files do you have? And what’s the part that isn’t working?

I have some values in live/globals.yml that I want to be taken when I do

kedro run --env live

You could use the

before_pipeline_run

hook which has

run_params

and contains

env

I think I need something much simpler than hooks.. I really just need to be able to parse the ENV in the

kedro run --env ENV

A quick hook I made that does the trick:

class PipelineHooks:
    @property
    def _logger(self):
        return logging.getLogger(self.__class__.__name__)

    @hook_impl
    def before_pipeline_run(
            self, run_params: dict[str, Any], pipeline: Pipeline, catalog: DataCatalog
    ) -> None:
        self._logger.warning(f"ENV: {run_params['env']}")

That seems to be what I need =] thank you!

At the moment that doesn’t work out of the box. There’s a work around described on this ticket: https://github.com/kedro-org/kedro/issues/2640

I did that in settings, and ran the command above but got

Failed to format pattern '${run_end_date}': no config value found, no default provided

hi @Felipe Vianna, did you manage to fix your original issue of

globals

not being picked up? happy to have another look at this and try to craft a reproducer

I did a work a workaround by running

KEDRO_ENV=live kedro run ….

and then in the py file I used the config loader passing the env I could get with os.getenv(). that forced the usage of the right globals.

I'm happy that you found a workaround although I must say that definitely feels less more complicated than it should be. I'll keep you posted if I find a better way, even if it's just for users finding a similar problem in the future. thanks @Felipe Vianna!

Thank you juan!