#catalog #azureblobstorage Hello Kedro Community, I try to connect to a csv file in azure blobstorage with help of this example: https://docs.kedro.org/en/stable/data/data_catalog_yaml_examples.html#load-a-model-saved-as-a-pickle-from-azure-blob-storage I adjusted the catalog and created a credentials.,yml with account_name and account_key. When trying to load the csv to a dataframe in a jupyter notebook I get the following error:

dict() got multiple values for keyword argument 'account_name'

Any body can help out on what I am missing? Thx in advance!

is it possible you’re providing

account_name

via env variables too?

dev_abs:
  account_name: accountname
  account_key: key

Try to update the example to

dev_abs:
  key: accountname
  secret: key

hm, I just followed the setup in the spaceflight tutorial and want to test a connection to azure blobstorage. I was not able to find the solution yet. using key and secret instead of account_name or account_key does not work in this case.

does this example not work? https://docs.kedro.org/en/stable/data/data_catalog_yaml_examples.html#load-a-model-saved-as-a-pickle-from-azure-blob-storage

no, i get the following error:

could you run

pip list -V

and tell us the version of

Kedro

,

Pandas

,

fsspec

and

adlfs

adlfs 2023.10.0 kedro 0.18.14 kedro-datasets 1.7.1 pandas 2.1.1 fsspec 2023.10.0

Okay they look right - can I ask you to do something. Open a notebook in the same Kedro environment. I’m

from kedro.datasets.pandas import CSVDataSet

and try to configure

CSVDataSet

live in python, all we’re doing behind the scenes is passing arguments to this class so if you get the same error plugging in the credentials manually we can isolate the issue

the import already gives an error:

sorry try this?

from kedro.extras.datasets.pandas import CSVDataSet

seems to work

can you do a

df.load()

okay, same error as before.

Okay can you try passing the credentials to the

fs_args

argument?

same dict error

Okay I’m going to escalate this

Can you shared what config did you pass?

from kedro_datasets.pandas import CSVDataset
import pandas as pd

data = pd.DataFrame({"col1": [1, 2], "col2": [4, 5], "col3": [5, 6]})
cred = {"account_name":"123","account_key":"123"}
dataset = CSVDataset(filepath="<abfs://model/test.csv>", credentials=cred)

dataset.save(data)

I try this and I get authentication error not dict error

does it work if you do

.load()

slightly awkward error but still autentication related

thanks for the escalation @datajoely

oh i think i know what the problem is you only need to list container onwards

the filepath listing container onwards seem to have solved the dict error but now I get a weird authentication error too

Can you share some more info? Traceback and (anonymized if necessary, but preserving the structure) how you're authenticating?