Join Slack
Powered by
How Kedro handling merging 2 streaming datasets on...
# questions
j
Jamal Sealiti
05/30/2025, 10:24 AM
How Kedro handling merging 2 streaming datasets on some merge keys? And deleting?
m
Merel
05/30/2025, 11:01 AM
Hi Jamal, for streaming we have a specific
SparkStreamingDataset
. I personally haven't used it, but there's a blog post that describes how it works:
https://kedro.org/blog/kedro-dataset-for-spark-structured-streaming
👍 1
Open in Slack
Previous
Next