Apache Spark SQL

Apache Spark    |    Intermediate
  • 16 videos | 1h 2s
  • Includes Assessment
  • Earns a Badge
Rating 4.7 of 40 users Rating 4.7 of 40 users (40)
Apache Spark SQL is used for structured data processing in Spark. Explore features of Spark SQL such as SparkSessions, DataFrames, and Datasets.

WHAT YOU WILL LEARN

  • Describe apache spark sql
    Create a sparksession
    Create dataframes with spark sql
    Use aggregations with the built-in dataframes functions
    Run sql queries programmatically
    Create a global temporary view
    Create datasets with spark sql
    Use json datasets with spark sql
  • Use load/save functions
    Manually specify a data source
    Run sql directly on files
    Use savemode to handle save operations
    Write parquet files with spark sql
    Use spark sql to save a dataframe as a persistent table
    Use partitioning when saving persistent tables
    Use spark sql to create datasets and dataframes

IN THIS COURSE

  • 2m 56s
    Upon completion of this video, you will be able to describe Apache Spark SQL. FREE ACCESS
  • 3m 37s
    In this video, you will learn how to create a SparkSession. FREE ACCESS
  • Locked
    3.  DataFrames
    4m 44s
    In this video, you will learn how to create DataFrames using Spark SQL. FREE ACCESS
  • Locked
    4.  Aggregations
    4m 9s
    Learn how to use aggregations with the built-in DataFrame functions. FREE ACCESS
  • Locked
    5.  SQL Queries
    5m 10s
    During this video, you will learn how to run SQL queries using a programming language. FREE ACCESS
  • Locked
    6.  Temporary View
    3m 41s
    In this video, you will learn how to create a global temporary view. FREE ACCESS
  • Locked
    7.  Datasets
    2m 58s
    During this video, you will learn how to create datasets using Spark SQL. FREE ACCESS
  • Locked
    8.  JSON Datasets
    4m 50s
    In this video, you will use JSON datasets with Spark SQL. FREE ACCESS
  • Locked
    9.  Load/Save Functions
    4m
    Find out how to use the Load/Save functions. FREE ACCESS
  • Locked
    10.  Specifying a Data Source
    4m 23s
    During this video, you will learn how to manually specify a data source. FREE ACCESS
  • Locked
    11.  Querying with SQL
    3m 41s
    In this video, learn how to run SQL directly on files. FREE ACCESS
  • Locked
    12.  SaveMode
    3m 26s
    In this video, you will learn how to use SaveMode to handle save operations. FREE ACCESS
  • Locked
    13.  Parquet Files
    4m 5s
    To find out how to write parquet files with Spark SQL, consult a tutorial or the Spark SQL documentation. FREE ACCESS
  • Locked
    14.  Persistent Tables
    2m 37s
    During this video, you will learn how to use Spark SQL to save a DataFrame as a table that will not be deleted when the Spark session ends. FREE ACCESS
  • Locked
    15.  Partitioning
    3m 4s
    In this video, learn how to use partitioning when saving tables that will not be deleted. FREE ACCESS
  • Locked
    16.  Exercise: Use Spark SQL
    2m 44s
    In this video, you will learn how to use Spark SQL to create datasets and dataframes. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Processing Data: Getting Started with Apache Kafka
Rating 4.7 of 117 users Rating 4.7 of 117 users (117)
Book Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications, 1st Edition
Course Processing Data: Introducing Apache Spark
Rating 4.7 of 57 users Rating 4.7 of 57 users (57)

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course Spark Monitoring & Tuning
Rating 5.0 of 1 users Rating 5.0 of 1 users (1)
Course Generative AI and Its Impact to Everyday Business
Rating 4.6 of 893 users Rating 4.6 of 893 users (893)
Course Getting Started with Hive
Rating 4.4 of 79 users Rating 4.4 of 79 users (79)