Is it possible to directly load an ` xlsx` file into a Kedro

Question

Is it possible to directly load an ` xlsx` file into a Kedro `SparkDataSet`

datajoely · Answer

no pandas then transcode

datajoely · Answer

you may be able to add some Jar to spark to make it work but it s way easier to do this way

datajoely · Answer

esp when an Excel file has to be lt 1M lines

Merel · Answer

Okay cool that s what I m doing now +1

Deepyaman Datta · Answer

gt you may be able to add some Jar to spark to make it work but it s way easier to do this way Yeah plus IIRC performance reading with the Spark Excel connector isn t good anyway so what s the point