https://kedro.org/ logo
#questions
Title
# questions
a

Abhishek Bhatia

06/17/2023, 1:15 PM
Hi Team, is there a way to have multiple nested partitions in
PartitionedDataSet
? It seems kedro assumes, the keys to be flat and string so neither a specification of tuple as keys nor nested dictionary specification works.
n

Nok Lam Chan

06/17/2023, 1:15 PM
Can you describe the structure of the data?
This is the default but you are able to customise it
It's using fsspec under the hood and you can change the pattern that it used
a

Abhishek Bhatia

06/17/2023, 1:17 PM
Something like this
but arbitrary nesting is required
How do I achieve this?
Sorry, this was easy 😅 just need to specify
/
in key names i.e.
Copy code
{'iter_1/run_1': df1, 'iter_2/run_2': df2}
K 1
3 Views