Sergei Benkovich
01/29/2023, 9:12 AMsplit_folder: "split_1"
folders:
raw: "{split_folder}/01_raw"
but it doesnt work and i just get a new folder called, {split_folder}/01_raw
is there anyway to accomplish this?
i’m running several versions one after the other, i want each one in different folder, but don’t want to have to change paths for all the subdirs i defined...Merel
01/30/2023, 12:14 PM$
before your templated value like:
split_folder: "split_1"
folders:
raw: "${split_folder}/01_raw"
Sergei Benkovich
01/31/2023, 7:46 PMMerel
02/01/2023, 8:49 AMfrom kedro.config import TemplatedConfigLoader # new import
CONFIG_LOADER_CLASS = TemplatedConfigLoader
CONFIG_LOADER_ARGS = {"globals_pattern": "*globals.yml"}
?globals
file as well, which isn’t possible. Your globals file should only hold the values and then you can use template placeholders in your parameters and catalog files.base_folder: data
folders:
raw: /01_raw
int: /intermediate
catalog.yml:
example_iris_data:
type: pandas.CSVDataSet
filepath: ${base_folder}/${folders.raw}/iris.csv
Sergei Benkovich
02/01/2023, 9:19 AMMerel
02/01/2023, 9:25 AMSergei Benkovich
02/01/2023, 9:28 AMMerel
02/01/2023, 9:29 AMTemplatedConfigLoader
?Sergei Benkovich
02/01/2023, 9:29 AMMerel
02/01/2023, 9:35 AMSergei Benkovich
02/01/2023, 9:36 AMMerel
02/01/2023, 10:48 AMSergei Benkovich
02/01/2023, 10:57 AMMerel
02/01/2023, 12:20 PM