Working with Spark Using HDInsight & Cluster Management

Apache Hadoop    |    Intermediate
  • 12 videos | 55m 12s
  • Includes Assessment
  • Earns a Badge
Rating 3.3 of 4 users Rating 3.3 of 4 users (4)
Discover how to work with Spark and its in-memory capabilities of data management. How to manage and troubleshoot HDInsight clusters using Ambari and the Azure CLI tool is also covered.

WHAT YOU WILL LEARN

  • Specify the essential capabilities of spark and its essential architectural components
    List the data structures along with the rdd and lineage concepts that are used in spark
    Set up spark clusters using powershell and azure resource manager template
    Describe the relationship between spark sql and hive
    Specify the essential concepts of spark sql and dataframe
    Demonstrate the approach of customizing hdinsight clusters using bootstrap
  • Install hadoop applications on azure hdinsight
    Illustrate the usage of ambari as a tool in order to manage clusters
    Manage hadoop clusters in hdinsight using azure cli
    Specify the approach of troubleshooting and tuning hdinsight clusters
    Monitor hadoop clusters in hdinsight to collect metrics for analysis
    Set up spark clusters and manage the clusters using ambari gui

IN THIS COURSE

  • 6m 11s
    After completing this video, you will be able to specify the essential capabilities of Spark and its essential architectural components. FREE ACCESS
  • 5m 47s
    Upon completion of this video, you will be able to list the data structures, along with the RDD and lineage concepts, that are used in Spark. FREE ACCESS
  • Locked
    3.  Create Spark Clusters Using PowerShell
    3m 52s
    During this video, you will learn how to set up Spark clusters using PowerShell and Azure Resource Manager templates. FREE ACCESS
  • Locked
    4.  Spark SQL and Hive
    3m 29s
    After completing this video, you will be able to describe the relationship between Spark SQL and Hive. FREE ACCESS
  • Locked
    5.  Spark SQL Data Sources and DataFrames
    4m 8s
    Upon completion of this video, you will be able to specify the essential concepts of Spark SQL and DataFrames. FREE ACCESS
  • Locked
    6.  Customizing HDInsight Cluster
    4m 42s
    Learn about the approach of customizing HDInsight clusters using a bootstrap. FREE ACCESS
  • Locked
    7.  Application Installation on HDInsight
    3m 13s
    During this video, you will learn how to install Hadoop applications on Azure HDInsight. FREE ACCESS
  • Locked
    8.  Ambari User Management
    6m 26s
    Upon completion of this video, you will be able to illustrate the usage of Ambari as a tool for managing clusters. FREE ACCESS
  • Locked
    9.  HDInsight Management Using Azure CLI
    3m 11s
    Find out how to manage Hadoop clusters in HDInsight using the Azure CLI. FREE ACCESS
  • Locked
    10.  Troubleshooting HDInsight
    3m 20s
    After completing this video, you will be able to specify the approach for troubleshooting and tuning HDInsight clusters. FREE ACCESS
  • Locked
    11.  Monitoring HDInsight Hadoop
    6m 30s
    During this video, you will learn how to monitor Hadoop clusters in HDInsight to collect metrics for analysis. FREE ACCESS
  • Locked
    12.  Exercise: Working with Spark and Ambari
    4m 26s
    In this video, find out how to set up Spark clusters and manage the clusters using the Ambari GUI. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Microsoft Fabric: Spark & the Capacity Metrics App for Lakehouses
Course Processing Data: Introducing Apache Spark
Rating 4.7 of 57 users Rating 4.7 of 57 users (57)
Book Querying Databricks with Spark SQL: Leverage SQL to Query and Analyze Big Data for Insights