Hello everyone. I am trying to deploy my Kedro pro...
# questionsq
Quint Van Leeuwen
05/08/2024, 9:34 AMHello everyone. I am trying to deploy my Kedro project to Azure ML studio. After running the command 'kedro azureml run' in my Command prompt, I am asked to enter the Azure Storage Account Key for my storage account. I fill in the SAS key that I have generated for the respective storage account (and give it the full permissions).
The pipeline will start running in Azure ML Studio, but an error message will be displayed in the first step of the pipeline:
DatasetError: Failed while saving data to data set
KedroAzureRunnerDataset(dataset_name=data_merged, info=for use only within
Azure ML Pipelines,
path=abfs://azureml/kedro-azureml-temp/XXXXXX
a_merged.bin).
Failed to upload block: Invalid base64-encoded string: number of data characters
(1) cannot be 1 more than a multiple of 4!
Does anyone know how to resolve this?
azure 1
m
marrrcin
05/08/2024, 12:02 PMHave you verified that the key you're providing is valid?
f
Florian d
05/10/2024, 10:07 PMMy recommendation would be to try to get the spaceflight tutorial or better the kedro-azureml tutorial (quick start) running. Once you know that is working you can move to your own project with the same configuration. Second thing you can try if you haven’t already is using the pipeline data passing
q
Quint Van Leeuwen
05/13/2024, 7:22 AMI have tried if the key is valid and have also rotated new keys just to be sure, so that won't be the issue I think.. When using the pipeline-data-passing instead of the -a and -c options, a different error is displayed:
ValidationError: 1 validation error for KedroAzureRunnerConfig
root
Expecting value: line 1 column 1 (char 0) (type=value_error.jsondecode;
msg=Expecting value; doc=; pos=0; lineno=1; colno=1)
Quint Van Leeuwen
05/13/2024, 9:16 AMAnd now, if I run kedro azureml init with -d, -a, -c included, I get the following error after running the kedro azureml run command:
Error Code: ScriptExecution.WriteStreams.Authentication
Native Error: Permission denied while trying to write: Some(Server failed to authenticate the request. Make sure the value of the Authorization header is formed correctly including the signature.).
PermissionDenied(Some(Server failed to authenticate the request. Make sure the value of the Authorization header is formed correctly including the signature.))
Error Message: Authentication failed when trying to access destination. Make sure you have correct permissions set up. Ok(Server failed to authenticate the request. Make sure the value of the Authorization header is formed correctly including the signature.)| session_id=4a097b8c-8d3d-42b9-aba3-7a658e461f65
2 Views