https://kedro.org/ logo
#questions
Title
# questions
r

Rahul Jain

11/13/2023, 9:43 PM
Team Can anyone share the latest document on " How to create and run a Kedro based repo on Databricks using AWS env"?
j

Juan Luis

11/14/2023, 7:59 AM
indeed @Rahul Jain, the document @Laura Couto shared covers one of the possible workflows, using Databricks Notebooks. there are 2 other supported ones: using
dbx
, and using Databricks Jobs. which one suits your needs best? if you're unsure, you have a flowchart here that might help you decide https://docs.kedro.org/en/stable/deployment/databricks/index.html
r

Rahul Jain

11/14/2023, 6:38 PM
Thanks @Laura Couto and @Juan Luis. Do you have documentation on " How to set and run kedro using databricks connect"
j

Juan Luis

11/14/2023, 6:53 PM
@Rahul Jain
DeltaTableDataset
,
ManagedTableDataset
, and
SparkDataset
support
databricks-connect
. here's a blog post https://kedro.org/blog/how-to-integrate-kedro-and-databricks-connect
2 Views