Explore Spark 2.0 and structured streaming in Microsoft Azure HDInsight

Sign in to queue

Description

Big data pipelines are notoriously hard to build. Mixing real-time data with batch data makes things even messier. Spark 2.0 offers new take on all-inclusive approach of solving this problem using Structured Streams. In this session we explore new features of Spark 2.0 and evaluate elegance of the new approach to streaming and how it achieves exactly once semantics of event processing.

Embed

Download

Download this episode

The Discussion

Add Your 2 Cents