Hello, i`m having problems using *ManagedTableData...
# questions
l
Hello, i`m having problems using ManagedTableDataset, when i try to upsert using the data-set can someone help??
Copy code
def update_dataset_with_silver_layer(**kwargs):
    """
    Merge the dataset with the silver layer
    Last dict item is always the pipeline name
    The second to last dict item is always the silver managed table
    """
    _, pipeline_name = kwargs.popitem()
    master_dataset_name, master_dataset = kwargs.popitem()
    _, bronze_dataset = kwargs.popitem()
    print(type(master_dataset))
    (
        master_dataset.alias("silver").merge(
            bronze_dataset.alias("bronze"),
            mount_join_keys_string(
                GRAPHS["bronze_to_silver"][pipeline_name][master_dataset_name]["pk"],
            ),
        )
        .whenMatchedUpdateAll()
        .whenNotMatchedInsertAll()
        .execute()
    )
n
What is the problem here?
l
Just found out Nok, Thnx!
👍🏼 1
d
what was the issue?
l
between the keyboard and the chair 😂 i was trying to upsert via code instead of using the catalog in delta tables
🍌 1