Hi everyone is it possible to pass credentials of the underl

Question

Hi everyone is it possible to pass credentials of the underlying dataset when using it with CachedDataSet e g ```test type CachedDataset versioned true dataset type pandas JSONDataSet filepath load args lines True credentials ``` doesn t work but this works ```test type pandas JSONDataSet filepath load args lines True credentials ``` I thought this was working at some point I might be hallucinating though Just want to double check quickly before I create my own CachedDataSet

Lim H. · Answer

Sorry my bad I included versioned true and that tried to glob through the directory which my credentials didn t have access to

Nok Lam Chan · Answer

Actually I don t know if `versioned` work with any of these wrapper dataset like `PartitionedDataSet`

Lim H. · Answer

The official doc includes versioned true there for CachedDataSet

Nok Lam Chan · Answer

Just to clarify it is only a permission issue versioning still works right or is this a doc issue

Lim H. · Answer

My issue was a permission issue I turned off versioning and it works I haven t tested versioning yet My comment about versioning was in the doc was because you mentioned gt don t know if `versioned` work with any of these wrapper dataset like `PartitionedDataSet` If that s the case we should probably remove that from the doc for CachedDataSet I haven t verified that claim though

Nok Lam Chan · Answer

Cool just to report back CacheDataset `versioned` flag does work `versioned` is not supported for `PartitionedDataset`