Hi Team, is there a way to have multiple nested pa...
# questionsa
Abhishek Bhatia
06/17/2023, 1:15 PMHi Team, is there a way to have multiple nested partitions in
PartitionedDataSetn
Nok Lam Chan
06/17/2023, 1:15 PMCan you describe the structure of the data?
Nok Lam Chan
06/17/2023, 1:16 PMThis is the default but you are able to customise it
Nok Lam Chan
06/17/2023, 1:16 PMIt's using fsspec under the hood and you can change the pattern that it used
a
Abhishek Bhatia
06/17/2023, 1:17 PMSomething like this
Abhishek Bhatia
06/17/2023, 1:17 PMbut arbitrary nesting is required
Abhishek Bhatia
06/17/2023, 1:17 PMHow do I achieve this?
Abhishek Bhatia
06/17/2023, 1:46 PMSorry, this was easy 😅
just need to specify
/ Copy code
{'iter_1/run_1': df1, 'iter_2/run_2': df2}K 1
4 Views