Hi all! Has anyone used Kedro to load data from Am...
# questions
s
Hi all! Has anyone used Kedro to load data from Amazon Redshift? I tried using the SQLDataSet, but getting credentials issues since the creds I passed are not SQLAlchemy connection string. Would be helpful to know what worked for anyone.
d
@Deepyaman Datta, do you know if Redshift is planned to be supported by Ibis? Using BigQuery with the Ibis Kedro Dataset provided a superb experience.
d
Let me ask if anybody has a surer answer, but it looks like you could use the Postgres backend, based on some issues I found like https://github.com/ibis-project/ibis/issues/3889 (the actual issue reported there may have gotten resolved in newer Ibis backends, but would need to confirm; in any case, may not affect you).
Using BigQuery with the Ibis Kedro Dataset provided a superb experience.
Also, great to hear! ❤️
Looking through some year-old messages
It's not "officially" supported because redshift is based on a prehistoric version of postgres - 8.0
But we do occasionally get issues filed by people using Redshift with a Postgres backend.
👍 1
s
Thanks Deepyaman! I tried the postgres way using SQLDataSet and it worked