Antonio Perelló Moragues
09/06/2023, 10:33 AMpandas.SQLQueryDataSet
?datajoely
09/06/2023, 10:37 AMpd.read_sql_query
so part 1 of this tutorial should be everything you need
https://medium.com/codex/connecting-to-aws-athena-databases-using-python-4a9194427638Antonio Perelló Moragues
09/06/2023, 10:45 AMFailed while loading data from data set SQLQueryDataSet(...), 'OptionEngine' has no attribute 'execute'
I'm using:
aws_credentials:
con: awsathena+pandas://{aws_access_key_id}:{aws_secret_access_key}@athena.{region_name}.<http://amazonaws.com/{schema_name}?s3_staging_dir={s3_staging_dir}|amazonaws.com/{schema_name}?s3_staging_dir={s3_staging_dir}>
connect_args:
aws_secret_access_key: ...
aws_access_key_id: ...
region_name: ...
schema_name: ...
s3_staging_dir: ...
and this in the catalog:
test_df:
type: pandas.SQLQueryDataSet
sql: "select * from test.test_table"
credentials: aws_credentials
datajoely
09/06/2023, 10:46 AMselect *
can you try pandas.SQLTableDataSet