Cyril Verluise
09/22/2023, 3:10 PMkedro run
throws the following error.
DataSetError: Class 'PartitionedDataset' not found or one of its dependencies has not been installed.
my dataset config is the following
# Raw data
optical_images_raw:
type: PartitionedDataset
path: data/01_raw/optical/
dataset: my_pkg.extras.datasets.image_dataset.ImageDataSet
filename_suffix: .tif
overwrite: True
layer: raw
and yes, my_pkg...ImageDataset
is well installed.
Help?
Anyone has ever faced a similar issue? Google did not help much so far? Any fix idea?
kedro version: 0.18.10datajoely
09/22/2023, 3:10 PMCyril Verluise
09/22/2023, 3:11 PMdatajoely
09/22/2023, 3:12 PMCyril Verluise
09/22/2023, 3:14 PMis there a chance there are any issues with the dependencies of the wrapped dataset?hmm, does not seem to be the case
my trick with these sorts of issues is to open a notebook and try and do this config with the python apiYes, that's what I meant by "I've (successfully) tested the config before" 😓
datajoely
09/22/2023, 3:15 PMCyril Verluise
09/22/2023, 3:22 PMpandas.CSVDataSet
as dataset
optical_images_raw:
type: PartitionedDataset
path: data/01_raw/optical/
dataset: pandas.CSVDataSet
filename_suffix: .csv
overwrite: True
Nok Lam Chan
09/22/2023, 3:22 PMDataSetError: Class ‘PartitionedDataset’ not found or one of its dependencies has not been installed.Uhhh, at this point we should be able to surface the underlying error better. Can you try importing the underlying dataset directly from a terminal?
import my_pkg.extras.datasets.image_dataset.ImageDataSet
Cyril Verluise
09/22/2023, 3:23 PMpandas.CSVDataSet
Nok Lam Chan
09/22/2023, 3:25 PMPartitionedDataSet
instead of PartitionedDataset
?PartitionedDataset
is 0.18.11Cyril Verluise
09/22/2023, 3:28 PMNok Lam Chan
09/22/2023, 3:28 PMCyril Verluise
09/22/2023, 3:35 PMdatajoely
09/22/2023, 3:42 PMCyril Verluise
09/22/2023, 3:46 PM