how to define a table schema using databricks.Mana...
# questions
l
how to define a table schema using databricks.ManagedTableDataset? someone knows?
j
Hey, Please refer to the official docs for `databricks.ManagedTableDataset`: https://docs.kedro.org/projects/kedro-datasets/en/stable/api/kedro_datasets/databricks.ManagedTableDataset/ And the blog post “How to use Databricks managed Delta tables in a Kedro project”: https://kedro.org/blog/managed-delta-tables-kedro-dataset
l
Ok, but that dosen't shows me how to pass the schema using the catalog.yml
j
Hey, Have you tired this way in your catalog.yml ?
Copy code
customers:
  type: databricks.ManagedTableDataset
  catalog: "main"                    
  database: "gold_layer"              
  table: "customers"                           
  schema:
    type: "struct"                   
    fields:                          
      - name: "customer_id"          
        type: "long"                 
        nullable: false              
        metadata: {}