What's up with Spark(1/5) - Spark Architecture

Download this episode

Download Video

Description

In this episode of What's up with___?  Andrew Moll meets with Alejandro Guerrero Gonzalez and Joel Zambrano, Engineers on the HDInsight team, and learns all about the interworkings of Apache Spark.  The team relies on your knowledge of traditional Hadoop, giving an overview of the major changes when developing on Spark. The video takes you through what is an RDD, how the Spark master and driver work together, and how we interact with the cluster once it's provisioned.  You'll want to start here if you are just getting your feet wet with Spark! The spark documentation can be found here and HDInsight specific docs are here!

Tags:

Azure, spark

Embed

Format

Available formats for this video:

Actual format may change based on video formats available and browser capability.

    The Discussion

    Comments closed

    Comments have been closed since this content was published more than 30 days ago, but if you'd like to send us feedback you can Contact Us.