Tap into the YARN ecosystem using Azure HDInsight
Play Tap into the YARN ecosystem using Azure HDInsight
The ecosystem of YARN applications has exploded with a diverse range of distributed big data tools and engines. The strength of this ecosystem is one of the primary drivers behind the health of Hadoop/YARN. HDInsight is a fully managed distribution of Apache Hadoop that features a number of YARN applications as first class workloads (Hive, HBase, Spark, Storm, Kafka and Interactive Hive), but many of the popular YARN applications are either difficult or impossible to install. Additionally, once an application is installed, system administrators expect it to be managed and monitored through a common interface rather than a special case. In this session, the Apache Ambari HDInsight framework will be presented with real-world examples of YARN applications that may be deployed directly onto the cluster and managed through the shared Ambari web interface. We’ll show how these applications can be configured, monitored and managed to be resilient to node failures and become truly elastic as the cluster is scaled.