Hi everyone, I’m trying to pass a dictionary of keyword arguments to a function in a Kedro node, but it doesn’t seem to be working. Instead, I have to use a lambda function to pass the arguments as separate inputs. For example, I would like to have a node that looks like this (knowing that best practice is to move the

sample_size

to a config):

node(
    func=train_test_split,
    inputs={"df": "input", "sample_size": 50},
    ...
),

However, this doesn’t seem to work and I get an error refering to a separator error.. I noticed that in the modular pipeline, a similar syntax is allowed. Is that on purpose? What does work is:

node(
      func=lambda df: train_test_split(df, sample_size=50),
      inputs="input",
      ...
     )

because

sample_size

does not exist. You need to have

sample_size

in your

parameters.yml

and use

params:sample_size

instead.

ah, okay, I got the impression the error was because i was passing a dictionary, but i see i have to move the sample_size to config

inputs={
                    "df": "input",
                    "sample_size": "params:finetuner.sample_size",
                },

everything inside the

pipeline

is a string literal, which will be reference to a

dataset

or

parameter

, you cannot pass value directly there.

AttributeError: ‘int’ object has no attribute ‘split’

We are happy to take a PR to improve the error message if you would like to.

cool, i dont have the bandwidth to do that PR ATM, since im working on an improved AWS batch runner, i would to contribute that in the near future (preferably by making it a plugin in line with kedro-sagemaker)

https://docs.kedro.org/en/stable/nodes_and_pipelines/nodes.html#syntax-for-input-variables Is it what you are looking for?

nice!

I don’t have an idea where should the fix goes into the code, but I have opened an issue here to document the issue. https://github.com/kedro-org/kedro/issues/2733

thanks!

https://github.com/kedro-org/kedro/pull/2734 I have created a draft PR here.