How Kedro handling merging 2 streaming datasets on...
# questions
j
How Kedro handling merging 2 streaming datasets on some merge keys? And deleting?
m
Hi Jamal, for streaming we have a specific
SparkStreamingDataset
. I personally haven't used it, but there's a blog post that describes how it works: https://kedro.org/blog/kedro-dataset-for-spark-structured-streaming
👍 1