Quick question, what is the correct way of defining an optional input in the Kedro pipeline? is it possible? The function takes some df's inputs as optional but I would also want to have that feature in the pipeline to not edit it everytime one input is not available.
05/19/2023, 4:12 PM
It's possible with custom dataset
Or workarounded with the use of PartitionedDataSet
06/05/2023, 3:32 PM
Great recommendations @marrrcin, Finally the workaround I used was that the node function had the inputs as Optional and then I passed a dict on the input parameters to map each input with their respective catalog and name on the function and worked perfectly.