Ecram
05/24/2024, 4:22 PMmergeSchema
in ManagedTableDataset
in Kedro to avoid schema errors when appending to an existing table in Databricks? Could you share how to configure it correctly? I share an example:
"{namespace}.db_results":
type: databricks.ManagedTableDataset
table: reporting_prove
database: db_reporting
write_mode: append
dataframe_type: pandas
layer: reporting
options:
mergeSchema: true <- This part return an error because Kedro 0.18.14 unexpected keyword argument 'options'
Thxs!Jitendra Gundaniya
05/27/2024, 9:52 AMmergeSchema
, is not currently supported. To request this feature and ensure it gets the attention of the Kedro maintainers, I suggest opening an issue/feature request on the kedro-plugins