https://kedro.org/ logo
#questions
Title
# questions
j

Javier del Villar

03/20/2023, 4:01 PM
Hi everybody, is it there something equivalent to
pandas.SQLQueryDataSet
in spark? can I get the same functionality in spark? I can not make queries with
spark.SparkJDBCDataSet
, am I missing something? Thanks in advance!
d

datajoely

03/20/2023, 4:02 PM
Hello - we don’t support that natively, you could easily subclass
spark.SparkJDBCDataSet
if you’d like - but we prefer DataFrame like interfaces in Kedro 🙂
j

Javier del Villar

03/20/2023, 4:04 PM
hehehe I was thinking exactly that, but wanted to ask first! Thanks for the quick response!
d

datajoely

03/21/2023, 9:49 AM
Fundamentally the UD part of CRUD doesn’t make lots of sense in Kedro world so we prefer keeping transformation in DataFrame world
j

Javier del Villar

03/21/2023, 2:02 PM
yeah, i'll think about it, I agree that's not a "kedronic" solution
d

datajoely

03/21/2023, 2:06 PM
kedroid