https://kedro.org/ logo
#questions
Title
# questions
u

3loy3loy

02/20/2024, 8:30 AM
Hello community! I have an (apparently) random error when versioning elements in the catalog. Some of them throw me an error of type
<http://kedro.io|kedro.io>.core.DatasetError: Cannot save versioned dataset
. There is no an old dataset not versioned inside, and it creates the containing folder, very strange. I have added this issue
Copy code
# the error causing one

X_train_batched_energy_pca_as_target_dataset_preprocessed:
  type: pickle.PickleDataset
  filepath: data/05_model_input/X_train_batched_energy_pca_as_target_dataset_preprocessed.pkl
  versioned: true
  metadata:
    kedro-viz:
      layer: train_data

# one correctly working

X_train_merged_input_data_preprocessed:
  type: pickle.PickleDataset
  filepath: data/05_model_input/X_train_merged_input_data_preprocessed.pkl
  versioned: true
  metadata:
    kedro-viz:
      layer: train_data
n

Nok Lam Chan

02/20/2024, 12:38 PM
hi @3loy3loy, am I understand correctly it's only the name of the folder changes?
Since I notice you are running on Windows, can you do a test and save it with a shorter file name? I vaguely remember I encountered this years ago, and it's due to Windows has a limitation of the length of file name.
u

3loy3loy

02/20/2024, 4:29 PM
Hi @Nok Lam Chan super thank you! Just added the info to the issue to indicate that it seems to be the source of the problem.
K 1
👍🏼 1
n

Nok Lam Chan

02/20/2024, 4:32 PM
Thanks for leaving a response to the issue. As far as I remember, that error come straight from the OS so I don't know if we can catch anything to provide a better warning. I will leave the issue open and see if other team members can look into it.
K 1
4 Views