Is it possible to directly load an `.xlsx` file in...
# questionsm
Merel
07/13/2023, 4:09 PMIs it possible to directly load an
.xlsxSparkDataSetd
datajoely
07/13/2023, 4:14 PMno pandas then transcode
datajoely
07/13/2023, 4:14 PMyou may be able to add some Jar to spark to make it work, but it’s way easier to do this way
datajoely
07/13/2023, 4:15 PMesp when an Excel file has to be < 1M lines
m
Merel
07/13/2023, 4:18 PMOkay cool that’s what I’m doing now 👍
d
Deepyaman Datta
07/13/2023, 11:20 PMyou may be able to add some Jar to spark to make it work, but it’s way easier to do this wayYeah, plus IIRC performance reading with the Spark Excel connector isn't good anyway, so what's the point
2 Views