Eden Macdonald
08/17/2023, 8:15 PMkedro.io.DataCatalog
and kedro.runner.SequentialRunner
in a script instead of the command line). Several of my nodes have inputs of the format inputs=[params:foo, params:bar...]
and I pass them as a list to Pipeline(nodes)
in order to define my pipeline.
I have no trouble creating a DataCatalog
that contains my input datasets, and passing it along with the pipeline to SequentialRunner
. The problem is I don’t know how to pass the parameter inputs (the inputs with a prefix params:
). I tried adding them to the DataCatalog
as though they were datasets, but it didn’t like me passing things like strings as though they are datasets and I couldn’t find a params kwarg. When I run from the command line there’s no issue because I’m simply loading those inputs from the parameters.yml
file, but in this case I’m trying to run the pipeline in code & would like to define the parameters in the code instead of a config file.
I feel like I may be missing something trivial here, but Googling has proven futile. Thoughts?~