Hello. I'm experiencing troubles when trying to s...
# questions
n
Hello. I'm experiencing troubles when trying to save a
TensorFlowModelDataset
to Azure Blob Storage. The error doesn't reproduce when saving to the local fs. A short writeup can be found here https://github.com/kedro-org/kedro-plugins/issues/839. Please help šŸ˜„? This might be related to a previous issue with this dataset and fsspec...
šŸ‘€ 1
m
Thanks for reporting this @Nelson Zambrano, we'll try work on this asap, but any help is appreciated. We don't have an Azure setup ready, so it might take us some time to reproduce and debug.
n
```'azureml/modelling/reprecios/data/06_models/run_2024-09-09' because a file with the same name already exists in the
directory. This is likely because versioning was enabled on a dataset already saved previously. Either remove
'model_prestamos.keras' from the directory or manually convert it into a versioned dataset by placing it in a
versioned directory (e.g. with default versioning format
'azureml/modelling/reprecios/data/06_models/run_2024-09-09/model_prestamos.keras/YYYY-MM-DDThh.mm.ss.sssZ/model_pre
stamos.keras').```
This is straight from the error you post. Did you have a file that has exactly the same name? This could happen when you first use the datasets as a non-version dataset (created a file), then change the config to a versioned dataset, that requires to create a folder name same as the file.
For example, it you have a file call
my_data.csv
, when you have
versioned: True
. It need to create the folder and the file:
my_data.csv/<timestamp>/my_data.csv
the first
my_data_.csv
in this path is a folder, and if you already have a file that clash with it you will get the error above.
n
@Nok Lam Chan The file isn't created or doesn't exist at any point in the ABS.
versioned
was always set to
False
@Merel I've updated the GitHub issue with an example. If I can assist with tests in my Azure environment, I’d be glad to help!