Data Analysis using Spark SQL
Apache Spark
| Intermediate
- 9 videos | 54m 6s
- Includes Assessment
- Earns a Badge
Analyze an Apache Spark DataFrame as though it were a relational database table. During this Aspire course, you will discover the different stages involved in optimizing any query or method call on the contents of a Spark DataFrame. Discover how to create views out of a Spark DataFrame's contents and run queries against them; and how to trim and clean a DataFrame. Next, learn how to perform an analysis of data by running different SQL queries; how to configure a DataFrame with an explicitly defined schema; and define what a window is in the context of Spark. Finally, observe how to create and analyze categories of data in a data set by using Windows.
WHAT YOU WILL LEARN
-
Recall the different stages involved in optimizing any query or method call on the contents of a spark dataframe
Create views out of a spark dataframe's contents and run queries against them
Trim and clean a dataframe before a view is created as a precursor to running sql queries on it
Perform an analysis of data by running different kinds of sql queries, including grouping and aggregations -
Recognize how spark dataframes infer the schema of data loaded into them and configure a dataframe with an explicitly defined schema
Define what a window is in the context of spark dataframes and when they can be used
Create and analyze categories of data in a dataset using windows
Analyze data using spark sql
IN THIS COURSE
-
2m 45s
-
3mUpon completion of this video, you will be able to recall the different stages involved in optimizing any query or method call on the contents of a Spark DataFrame. FREE ACCESS
-
3. Introduction to Spark SQL7m 41sIn this video, you will learn how to create views out of a Spark DataFrame's contents and run queries against them. FREE ACCESS
-
4. Preparing Data for Analysis7m 14sDuring this video, you will learn how to trim and clean a DataFrame before creating a view as a precursor to running SQL queries on it. FREE ACCESS
-
5. Running SQL Queries6m 44sIn this video, you will learn how to perform an analysis of data by running different kinds of SQL queries, including grouping and aggregations. FREE ACCESS
-
6. Inferred and Explicit Schemas7m 56sAfter completing this video, you will be able to recognize how Spark DataFrames infer the schema of data loaded into them and configure a DataFrame with an explicitly defined schema. FREE ACCESS
-
7. Windowing in Spark5m 53sLearn how to define what a window is in the context of Spark DataFrames and when they can be used. FREE ACCESS
-
8. Applying Window Functions8m 3sIn this video, you will create and analyze categories of data in a dataset using Microsoft Windows. FREE ACCESS
-
9. Exercise: Data Analysis Using Spark SQL4m 50sDuring this video, you will learn how to analyze data using SQL with Spark. FREE ACCESS
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.YOU MIGHT ALSO LIKE
Rating 4.6 of 51 users
(51)
