Lim H.
07/26/2023, 6:51 PMtest:
type: CachedDataset
versioned: true
dataset:
type: pandas.JSONDataSet
filepath: ...
load_args:
lines: True
credentials: ...
doesn’t work but this works
test:
type: pandas.JSONDataSet
filepath: ...
load_args:
lines: True
credentials: ...
I thought this was working at some point? I might be hallucinating though. Just want to double check quickly before I create my own CachedDataSetNok Lam Chan
07/26/2023, 9:04 PMversioned
work with any of these wrapper dataset like PartitionedDataSet
Lim H.
07/26/2023, 9:17 PMNok Lam Chan
07/27/2023, 4:34 PMLim H.
07/27/2023, 4:36 PMdon’t know ifIf that’s the case, we should probably remove that from the doc for CachedDataSet. I haven’t verified that claim thoughwork with any of these wrapper dataset likeversioned
PartitionedDataSet
Nok Lam Chan
07/27/2023, 4:41 PMversioned
flag does work
• versioned
is not supported for PartitionedDataset