Nelson Zambrano
09/18/2024, 12:05 AMTensorFlowModelDataset
to Azure Blob Storage. The error doesn't reproduce when saving to the local fs.
A short writeup can be found here https://github.com/kedro-org/kedro-plugins/issues/839.
Please help š?
This might be related to a previous issue with this dataset and fsspec...Merel
09/18/2024, 11:40 AMNok Lam Chan
09/18/2024, 12:51 PM```'azureml/modelling/reprecios/data/06_models/run_2024-09-09' because a file with the same name already exists in the
directory. This is likely because versioning was enabled on a dataset already saved previously. Either remove
'model_prestamos.keras' from the directory or manually convert it into a versioned dataset by placing it in a
versioned directory (e.g. with default versioning format
'azureml/modelling/reprecios/data/06_models/run_2024-09-09/model_prestamos.keras/YYYY-MM-DDThh.mm.ss.sssZ/model_pre
stamos.keras').```
This is straight from the error you post. Did you have a file that has exactly the same name? This could happen when you first use the datasets as a non-version dataset (created a file), then change the config to a versioned dataset, that requires to create a folder name same as the file.
Nok Lam Chan
09/18/2024, 12:53 PMmy_data.csv
, when you have versioned: True
. It need to create the folder and the file:
my_data.csv/<timestamp>/my_data.csv
the first my_data_.csv
in this path is a folder, and if you already have a file that clash with it you will get the error above.Nelson Zambrano
09/18/2024, 5:15 PMversioned
was always set to False
@Merel I've updated the GitHub issue with an example. If I can assist with tests in my Azure environment, Iād be glad to help!