Hi all, I am having an issue with the kedro vertex...
# questions
a
Hi all, I am having an issue with the kedro vertexai plugin. Basically when I run the
Copy code
kedro vertexai compile
command the compiled pipeline does not receive anything close the compute resources I request via the resources section of the yaml config file. Been trying to figure out where im going wrong for a while now but not much luck. Is there anyone here with some ideas?
a
Can you give more context on what were you expecting and what are you trying to do? I don't fully understand. "the compiled pipeline does not receive anything close the compute resources I request via the resources section of the yaml config file" - which config file? Vertexai's plugin config? What do you mean by close compute resources? I'm not very familiar with compile feature, but from what I see in the code, this reads only the following from the config: https://github.com/getindata/kedro-vertexai/blob/7b62cd7a9766baf8bfe21fffa6c628861266efb2/kedro_vertexai/cli.py#L206-L216 Which is image pull policy and image to use.
also move the question to #plugins-integrations if you can
a
Hey Artur, I think i figured it out. Bit of a strange one. I had my nodes named like "train_this_model". And had the corresponding node defined with the same name in the resources section of the vertexi.yaml. On inspection of the compiled vertex pipeline I noticed that the node names had replaced underscores with dashes, so in the pipeline json it looks like "exec-train-this-model" So I replaced the underscores with dashes in my node definitions and in the vertexai config and it seems to work nicely now
👍 1