Leverage R and Spark in Azure HDInsight for scalable machine learning
Play Explore Spark 2.0 and structured streaming in Microsoft Azure HDInsight
Description
Big data pipelines are notoriously hard to build. Mixing real-time data with batch data makes things even messier. Spark 2.0 offers new take on all-inclusive approach of solving this problem using Structured Streams. In this session we explore new features of Spark 2.0 and evaluate elegance of the new approach to streaming and how it achieves exactly once semantics of event processing.
Download
Right click or Alt+Enter to download this episode
- MP3 (58.3 MB)
- Mid Quality MP4 (108.0 MB)
- High Quality MP4
rss
The Discussion
More episodes in this series
Bring Big Data to the masses with U-SQL
Related episodes
Breakpoint debugging of Spark jobs in Azure HDInsight
Building modern data pipelines with Spark on Azure HDInsight
Scalable machine learning with R and Spark
Build interactive data analysis environments using Apache Spark
Big, Fast, and Data-Furious…with Spark
R and Spark as Yin and Yang of Scalable Machine Learning in Azure HDInsight
Upcoming: Secrets of R and Spark at MS Data Science Summit
Building Big Data Applications using Spark and Hadoop
Developing an app for SharePoint autohosted in Windows Azure Web Sites with an…
It's All about the Services: Developing Custom Applications for Microsoft SharePoint…
