umesh sri
05/03/2024, 2:55 PMDeepyaman Datta
05/03/2024, 10:08 PMparameters.yml
), or just configure a value for @Parameter
based on the Kedro environment? The latter is easily doable, the latter is more complicated. I'm not the best person to answer questions on the newer config loaders (let me see if I can pull in some help!), but in past Kedro versions you could seemingly extend the config loader to provide such functionality (see https://stackoverflow.com/a/75409579). This is a bit hacky, as you're using protected attributes in the Kedro API; maybe there's a more straightforward way?
For the first case, you could also consider using ibis.TableDataset
instead, and then you can pass a regular Kedro parameter to the node and do the filtering within the node. This has the benefit of being simpler/less hacky, and you could always execute .to_pandas()
within the node if you need it in that format.