Sid Shetty07/26/2023, 5:24 PM
. Is there any workaround here that avoids me having to add another node to put these partitions together and ideally just read as a pandas.ParquetDataSet? Perhaps passing the schema of the original dataframe or even specifying it explicitly?
Juan Luis07/26/2023, 5:29 PM
to your dataset to control how to
will be used, these will get passed directly
Sid Shetty07/26/2023, 5:41 PM
seems like just what I was looking for!