https://kedro.org/ logo
#questions
Title
# questions
f

FlorianGD

09/29/2023, 1:34 PM
Hello ! Has someone integrated
Kedro
and
duckdb
? My use case would be to read a lot of parquet files on Minio buckets, which seems a good fit for
duckdb
. My fear is that we'd need to create the connection each time we instantiate a dataset, which would risk to make it slow
n

Nok Lam Chan

09/29/2023, 1:55 PM
SQLDataSet should work out of the box,
SQLAlchemy
takes care of it
d

datajoely

09/29/2023, 2:11 PM
f

FlorianGD

09/29/2023, 2:14 PM
Thanks!
i

Iñigo Hidalgo

10/02/2023, 4:40 PM
@datajoely I have to get back onto that, been unchanged since basically before summer 😅
with all the cool new stuff coming up around Ibis I think it would be so useful
🥳 1
2 Views