Linda Sun05/01/2023, 3:17 PM
, and met this error:
kedro azureml run --pipeline=xxx -s xxxxx to run the pipeline in azure ml
I’ve used azure cli to list all jobs that I have in the workspace, and deleted the job with the run id it is complaining about. But still met the same error 😶. Would love to get some insights from the group: 1). any clue on how to solve the error? 2)Is there any way that I can set job name or run id in kedro project or with the kedro-azureml cmd (In azureml.yml seems users can only set experiment name)? Thank you!!
azure.core.exceptions.ResourceExistsError: (UserError) The run has been submitted somewhere else, please change the run id and try again. Existing pipline run id: ******* Code: UserError Message: The run has been submitted somewhere else, please change the run id and try again. Existing pipline run id: *******
marrrcin05/01/2023, 4:08 PM
Linda Sun05/01/2023, 4:13 PM
and I’m getting same error
marrrcin05/02/2023, 10:39 PM
) it works smoothly. I suspect that there is some issue with your local configuration. Could you provide more details on how your project is configured, where do you invoke the
etc? As for second point:
kedro azureml run
2)Is there any way that I can set job name or run id in kedro project or with the kedro-azureml cmd (In azureml.yml seems users can only set experiment name)?The pipeline name is automatically taken from Kedro’s pipeline name: https://github.com/getindata/kedro-azureml/blob/2e5836b72256d7455d8525c7769a68d4c844ccf7/kedro_azureml/generator.py#L90 Run ID for the Azure job is assigned automatically by the Azure ML SDK (it’s not our code).
Linda Sun05/05/2023, 1:55 PM
in local ternimal (VS code). I think the code structure follows standard kedro project. I actually tried the method of uploading code (docker image only contains requirements), as I might modify code and then kedro azureml run the same pipeline again. Sometimes I got the error too, but it is less frequent than using docker flow. Let me know if you need to know more details. Thank you for the information on the second point!
kedro azureml run
marrrcin05/05/2023, 1:57 PM