Team Can anyone share the latest document on " How...
# questions
r
Team Can anyone share the latest document on " How to create and run a Kedro based repo on Databricks using AWS env"?
j
indeed @Rahul Jain, the document @Laura Couto shared covers one of the possible workflows, using Databricks Notebooks. there are 2 other supported ones: using
dbx
, and using Databricks Jobs. which one suits your needs best? if you're unsure, you have a flowchart here that might help you decide https://docs.kedro.org/en/stable/deployment/databricks/index.html
r
Thanks @Laura Couto and @Juan Luis. Do you have documentation on " How to set and run kedro using databricks connect"
j
@Rahul Jain
DeltaTableDataset
,
ManagedTableDataset
, and
SparkDataset
support
databricks-connect
. here's a blog post https://kedro.org/blog/how-to-integrate-kedro-and-databricks-connect