Data Flow for the Hadoop Ecosystem

Apache Hadoop    |    Intermediate
  • 12 videos | 59m 5s
  • Earns a Badge
Rating 4.1 of 11 users Rating 4.1 of 11 users (11)
Data must move into and through Hadoop for it to function. Here we look at Hadoop and the data life cycle management, and use Sqoop and Hive to flow data.

WHAT YOU WILL LEARN

  • Describe the data life cycle management
    Recall the parameters that must be set in the sqoop import statement
    Create a table and load data into mysql.
    Use sqoop to import data into hive
    Recall the parameters that must be set in the sqoop export statement
    Use sqoop to export data from hive
  • Recall the three most common date datatypes and which systems support each
    Use casting to import datetime stamps into hive
    Export datetime stamps from hive into mysql
    Describe dirty data and how it should be preprocessed
    Use hive to create tables outside the warehouse
    Use pig to sample data

IN THIS COURSE

  • 8m 41s
    After completing this video, you will be able to describe the data life cycle. FREE ACCESS
  • 2m 40s
    After completing this video, you will be able to recall the parameters that must be set in the Sqoop import statement. FREE ACCESS
  • Locked
    3.  Loading SQL Data Tables
    1m 26s
    In this video, learn how to create a table and load data into MySQL. FREE ACCESS
  • Locked
    4.  Importing Data into Hive
    6m 35s
    During this video, you will learn how to use Sqoop to import data into Hive. FREE ACCESS
  • Locked
    5.  Sqoop and Hive Exports
    3m 14s
    Upon completion of this video, you will be able to recall the parameters that must be set in the Sqoop export statement. FREE ACCESS
  • Locked
    6.  Exporting Data from Hive
    7m 23s
    Learn how to use Sqoop to import data from Hive. FREE ACCESS
  • Locked
    7.  Working with Date data types
    1m 58s
    Upon completion of this video, you will be able to recall the three most common date data types and which systems support each. FREE ACCESS
  • Locked
    8.  Importing Datetime Stamps
    5m 50s
    Learn how to use casting to import date and time stamps into Hive. FREE ACCESS
  • Locked
    9.  Exporting Datetime Stamps
    4m 41s
    Find out how to export date and time stamps from Hive into MySQL. FREE ACCESS
  • Locked
    10.  Preprocessing Data
    4m 24s
    Upon completion of this video, you will be able to describe dirty data and how to preprocess it. FREE ACCESS
  • Locked
    11.  Cleaning with Functions
    7m 45s
    In this video, you will use Hive to create tables outside of the warehouse. FREE ACCESS
  • Locked
    12.  Cleaning with Regular Expressions
    4m 27s
    In this video, find out how to use pigs to sample data. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Channel Wintellect Apache Hadoop
Book Big Data Using Hadoop and Hive
Book Data Processing and Modeling with Hadoop