Júlio Resende
10/02/2023, 2:49 PMDatasetError: Failed while loading data from data set PickleDataSet
I registered my model as follows in the catalog.yaml
file:
bulldozers_df_models:
type: pickle.PickleDataSet
filepath: <https://kedrodatastores.blob.core.windows.net/my-container/06_models/bulldozers/df.pkl>
credentials: azure_data_storage
backend: pickle
In the credentials.yaml
file I used the following fields:
azure_data_storage:
DefaultEndpointsProtocol: https
AccountName: kedrodatastores
AccountKey: mykey
EndpointSuffix: <http://core.windows.net|core.windows.net>
Does anyone know what I did wrong?datajoely
10/02/2023, 2:54 PMfrom kedro.datasets.pickle import PickleDataSet
and get this working. The YAML api is just passing arguments to this constructor - so you can debug it nicely that waymarrrcin
10/02/2023, 2:57 PMhttps://
? For Azure Blob Storage you should use abfs://
Erwin
10/02/2023, 2:58 PMfsspec.filesystem
Júlio Resende
10/02/2023, 3:12 PMadlfs
library. Thank you very much!