#questions
Title
# questions
z
Zoran
02/06/2023, 5:26 PMHi everyone,
is it possible to change globals parameters (conf/<env>/globals.yml) dynamically at runtime (as params do with --params)?
👍 2
d
datajoely
02/06/2023, 6:05 PMyou can do all sorts of things with hooks if you really want
https://kedro.readthedocs.io/en/stable/hooks/introduction.html
z
Zoran
02/06/2023, 7:06 PMfor example
before_dataset_loadedafter_context_createdglobals_dictd
datajoely
02/07/2023, 9:48 AMso with the
after_context_createdcontext.catalogsettings.py is the very first thing that gets executed so you don’t want to try and change that, just intercept things later on in the lifecycle
this pattern however is intentionally a little cumbersome since we do want to encourage users to prioritise reproducibility and dynamic pipelines hinder that
z
Zoran
02/07/2023, 10:43 AMi forgot to add at beginning what i want to achieve, which is:
catalog.yml:
filepath: data/01_raw/${DATASET_NAME}.yml
depending on which parameters from CLI is run on it DATASET_NAME is changed
d
datajoely
02/07/2023, 10:43 AMyeah that’s possible
z
Zoran
02/07/2023, 10:44 AMI need little help on that how to achieve this
d
datajoely
02/07/2023, 10:46 AMz
Zoran
02/07/2023, 10:48 AMthank you.
I will try it now
@datajoely @Antony Milne
i tried this:
add class to settings.py
Copy code
class MyTemplatedConfigLoader(TemplatedConfigLoader):
def __init__(self, *args, **kwargs):
super().__init__(*args, **kwargs)
self._config_mapping.update(self.runtime_params)
CONFIG_LOADER_CLASS = MyTemplatedConfigLoader Copy code
self._config_mapping.update(self.runtime_params)
TypeError: 'NoneType' object is not iterable
kedro.framework.cli.utils.KedroCliError: 'NoneType' object is not iterable
Run with --verbose to see the full exception
Error: 'NoneType' object is not iterablei forgot to add that i am using kedro 0.18.4 and kedro viz 5.2.1
4 Views