Graph Modeling on Apache Spark: Working with Apache Spark GraphFrames

Apache Spark    |    Intermediate
  • 13 videos | 1h 51m 32s
  • Includes Assessment
  • Earns a Badge
Rating 4.7 of 24 users Rating 4.7 of 24 users (24)
Apache Spark, which is a widely used analytics engine, also helps anyone modeling graphs to perform powerful graph analytics. GraphFrames, a Spark package, aids this process by providing various graph algorithm implementations. Use this course to learn about GraphFrames and the application of graph algorithms on data to extract insights. Explore how GraphFrames complements the Apache Hadoop ecosystem in processing graph data. Getting hands-on, construct and visualize a GraphFrame. Practice querying nodes and relationships in a graph and finding motifs in it. Moving along, work with the breadth-first search and the shortestPaths functions to find paths between graph nodes. And finally, apply the PageRank algorithm to arrive at the most relevant nodes in a network. Upon completion, you'll be able to use GraphFrames to analyze and generate insights from graph data.

WHAT YOU WILL LEARN

  • Discover the key concepts covered in this course
    Outline apache hadoop and its ecosystem, describe graphframes and their capabilities, and recognize where graphframes fit into the apache hadoop ecosystem
    Download and install apache spark and set up your ide with graphframes
    Construct a graphframe starting with the definition of its nodes and edges
    Define functions to present a directed as well as an undirected graph
    Demonstrate the identification of the most and the least-connected nodes in a graph
    Apply filters on the nodes in a graph at the dataframe and the graphframe levels
  • Apply filters on the edges of a graph and apply aggregation operations on them
    Search for patterns of relationships between the nodes in a spark graphframe
    Illustrate how to find chains of connections as well as cycles in a graphframe
    Use the breadth-first search and the shortestpaths functions to find the shortest paths between nodes in a graph
    Apply the pagerank algorithm to identify triangles of connections in a graph and calculate the page rank for a graph of connected web pages
    Summarize the key concepts covered in this course

IN THIS COURSE

  • 2m 23s
  • 11m 51s
  • Locked
    3.  Setting up PySpark and GraphFrames
    7m 26s
  • Locked
    4.  Constructing a GraphFrame
    11m 46s
  • Locked
    5.  Visualizing a GraphFrame
    10m 19s
  • Locked
    6.  Calculating the Degrees of Nodes in a Graph
    6m 17s
  • Locked
    7.  Filtering the Nodes in a GraphFrame
    9m 58s
  • Locked
    8.  Filtering the Edges in a GraphFrame
    7m 54s
  • Locked
    9.  Finding Simple Motifs in GraphFrames
    11m 45s
  • Locked
    10.  Searching for Complex Patterns in Graphs
    10m 24s
  • Locked
    11.  Finding the Shortest Paths between Nodes in a Graph
    12m 5s
  • Locked
    12.  Applying the PageRank Algorithm
    7m 30s
  • Locked
    13.  Course Summary
    1m 54s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Processing Data: Introducing Apache Spark
Rating 4.7 of 57 users Rating 4.7 of 57 users (57)
Course Apache Spark Getting Started
Rating 4.5 of 137 users Rating 4.5 of 137 users (137)
Book Spark in Action, Second Edition

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course Data Nuts & Bolts: Fundamentals of Data
Rating 4.4 of 524 users Rating 4.4 of 524 users (524)
Book PySpark Recipes: A Problem-Solution Approach with PySpark2
Course GNNs: An Introduction to Graph Neural Networks
Rating 4.3 of 6 users Rating 4.3 of 6 users (6)