Vaibhav
01/18/2023, 11:15 AMdatajoely
01/18/2023, 11:17 AMpandas.ParquetDataset
so you should be able to just upgrade the library with that being the only risk of it breakingVaibhav
01/18/2023, 12:56 PMpandas.parquertDataset
in our pipeline, I tried with pyarrow == 8 nothing breaksMerel
01/18/2023, 1:20 PMdatajoely
01/18/2023, 1:21 PMVaibhav
01/18/2023, 1:36 PMdatajoely
01/18/2023, 1:36 PMVaibhav
01/18/2023, 1:44 PMMerel
01/18/2023, 1:45 PMVaibhav
01/18/2023, 1:48 PMdatajoely
01/18/2023, 1:50 PMkedro-datasets
being a standalone package will make this way way easier in the future as we can bump / change / push releases way faster than corep