Dataproc Architecture

Google Cloud    |    Intermediate
  • 10 videos | 40m 16s
  • Includes Assessment
  • Earns a Badge
Rating 4.6 of 30 users Rating 4.6 of 30 users (30)
Dataproc can be used to perform several operations when integrating platforms, including Pig and Hive. Explore Dataproc architecture while introducing the use of Pig and Hive.

WHAT YOU WILL LEARN

  • Describe how to create a cluster with the dataproc cli
    Recognize implementations using the dataproc rest api
    Describe the various dataproc architecture types in gcp and common use cases
    Define dataproc machine types and their uses
    Configure a custom machine type
  • Describe how and when to execute dataproc jobs
    Recognize connections between apache hadoop hdfs and cloud storage
    Describe the use of pig and hive
    Configure and execute a job using pig and hive with dataproc
    Recall concepts of dataproc jobs, including implementation of pig and hive

IN THIS COURSE

  • 2m 29s
    After completing this video, you will be able to describe how to create a cluster using the Dataproc CLI. FREE ACCESS
  • 4m 11s
    Upon completion of this video, you will be able to recognize implementations of the Dataproc REST API. FREE ACCESS
  • Locked
    3.  Dataproc Architecture
    3m 54s
    After completing this video, you will be able to describe the various Dataproc architecture types in GCP and their common use cases. FREE ACCESS
  • Locked
    4.  Machine Types
    4m 39s
    In this video, you will learn about Dataproc machine types and their uses. FREE ACCESS
  • Locked
    5.  Custom Machine Types
    3m 43s
    Learn how to configure a custom machine type. FREE ACCESS
  • Locked
    6.  Dataproc Job Execution
    3m 16s
    After completing this video, you will be able to describe how and when to execute Dataproc jobs. FREE ACCESS
  • Locked
    7.  HDFS and GCS
    3m 8s
    After completing this video, you will be able to recognize connections between Apache Hadoop HDFS and Cloud Storage. FREE ACCESS
  • Locked
    8.  Introduction to Pig and Hive
    3m 43s
    After completing this video, you will be able to describe the use of Pig and Hive. FREE ACCESS
  • Locked
    9.  Pig and Hive Jobs
    3m 25s
    During this video, you will learn how to configure and execute a job using Pig and Hive on Dataproc. FREE ACCESS
  • Locked
    10.  Exercise: Concepts in Dataproc Implementations
    7m 50s
    After completing this video, you will be able to recall concepts of Dataproc jobs, including implementation of Pig and Hive. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Google Professional Cloud Architect: Google Cloud Database Design
Rating 5.0 of 1 users Rating 5.0 of 1 users (1)
Channel Snowflake
Rating 5.0 of 2 users Rating 5.0 of 2 users (2)
Course DevOps Platforms and Operations: DataOps Principles
Rating 4.7 of 12 users Rating 4.7 of 12 users (12)

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course CAPM(r): Project Performance Domains
Rating 4.2 of 17 users Rating 4.2 of 17 users (17)
Course GCP Network Data Processing Models
Rating 4.6 of 43 users Rating 4.6 of 43 users (43)
Course MySQL: Querying Data
Rating 4.7 of 150 users Rating 4.7 of 150 users (150)