Linda Sun
05/01/2023, 3:17 PMkedro azureml run --pipeline=xxx -s xxxxx to run the pipeline in azure ml
, and met this error:
azure.core.exceptions.ResourceExistsError: (UserError) The run has been submitted somewhere else, please change the run id and try again. Existing pipline run id: *******
Code: UserError
Message: The run has been submitted somewhere else, please change the run id and try again. Existing pipline run id: *******
I’ve used azure cli to list all jobs that I have in the workspace, and deleted the job with the run id it is complaining about. But still met the same error 😶.
Would love to get some insights from the group: 1). any clue on how to solve the error? 2)Is there any way that I can set job name or run id in kedro project or with the kedro-azureml cmd (In azureml.yml seems users can only set experiment name)?
Thank you!!marrrcin
05/01/2023, 4:08 PMLinda Sun
05/01/2023, 4:13 PMcode_directory: ~
code_directory: "."
and I’m getting same errormarrrcin
05/02/2023, 10:39 PM0.4.0
) it works smoothly. I suspect that there is some issue with your local configuration. Could you provide more details on how your project is configured, where do you invoke the kedro azureml run
etc?
As for second point:
2)Is there any way that I can set job name or run id in kedro project or with the kedro-azureml cmd (In azureml.yml seems users can only set experiment name)?The pipeline name is automatically taken from Kedro’s pipeline name: https://github.com/getindata/kedro-azureml/blob/2e5836b72256d7455d8525c7769a68d4c844ccf7/kedro_azureml/generator.py#L90 Run ID for the Azure job is assigned automatically by the Azure ML SDK (it’s not our code).
Linda Sun
05/05/2023, 1:55 PMkedro azureml run
in local ternimal (VS code). I think the code structure follows standard kedro project. I actually tried the method of uploading code (docker image only contains requirements), as I might modify code and then kedro azureml run the same pipeline again. Sometimes I got the error too, but it is less frequent than using docker flow. Let me know if you need to know more details.
Thank you for the information on the second point!marrrcin
05/05/2023, 1:57 PM