Using Tasks and Architecting Snowflake Data Pipelines

Snowflake    |    Intermediate
  • 14 videos | 1h 49m 26s
  • Includes Assessment
  • Earns a Badge
Rating 5.0 of 2 users Rating 5.0 of 2 users (2)
Tasks are Snowflake constructs that can execute code on a fixed schedule or when a stream has data to consume. Tasks are similar to cron jobs but are more complex because they can be chained into complex dependency networks called task graphs. In this course, learn about continuous data processing tasks, create and execute scheduled serverless and user-managed scheduled tasks, and implement task graphs and child tasks. Next, use dummy root nodes to bypass Snowflake's root node restrictions, create and use triggered tasks, and construct an architecture that utilizes streams, tasks, stages, and dynamic tables to feed into a dynamic dashboard. Finally, discover how to implement data pipelines with a stage, scheduled task, and table, add dynamic pipelines and triggered tasks to data pipelines, and create dashboards in Snowflake to consume data from different tables. Upon completion of this course, you will be able to use tasks and architect Snowflake data pipelines.

WHAT YOU WILL LEARN

  • Discover the key concepts covered in this course
    Outline scheduled tasks, triggered tasks, and task graphs
    Build and execute a scheduled serverless task
    Create a user-managed scheduled task using a cron expression
    Build a task graph with a child task that depends upon a parent task
    Implement a task graph with one root node and two child nodes that each depend upon the root
    Design and partially implement a task graph with two root nodes and a single child node that depends upon both root nodes
  • Use dummy root nodes to circumvent snowflake's restriction on multiple root nodes in a task graph
    Create and use a triggered task that executes whenever a standard stream has data that can be consumed
    Construct an architecture that utilizes streams, tasks, stages, and dynamic tables to feed into a dynamic dashboard
    Implement an architecture with a stage, scheduled task, and table
    Extend a data pipeline by adding a triggered task to consume stream data and a dynamic table to compute base table analytical queries
    Create a dashboard to consume data from different tables and dynamic tables in snowflake
    Summarize the key concepts covered in this course

IN THIS COURSE

  • 1m 40s
    In this video, we will discover the key concepts covered in this course. FREE ACCESS
  • 8m 20s
    Upon completion of this video, you will be able to outline scheduled tasks, triggered tasks, and task graphs. FREE ACCESS
  • Locked
    3.  Building and Executing a Scheduled Serverless Task
    11m 56s
    In this video, discover how to build and execute a scheduled serverless task. FREE ACCESS
  • Locked
    4.  Creating Cron Expressions for Task Scheduling
    9m 31s
    Find out how to create a user-managed scheduled task using a cron expression. FREE ACCESS
  • Locked
    5.  Building a Task Graph and a Child Task
    12m 22s
    During this video, you will learn how to build a task graph with a child task that depends upon a parent task. FREE ACCESS
  • Locked
    6.  Implementing Task Graphs with Multiple Child Tasks
    10m 50s
    Discover how to implement a task graph with one root node and two child nodes that each depend upon the root. FREE ACCESS
  • Locked
    7.  Designing Task Graphs with Multiple Root Nodes
    9m 49s
    In this video, find out how to design and partially implement a task graph with two root nodes and a single child node that depends upon both root nodes. FREE ACCESS
  • Locked
    8.  Using Dummy Task Nodes for Complex Task Graphs
    6m 16s
    Learn how to use dummy root nodes to circumvent Snowflake's restriction on multiple root nodes in a task graph. FREE ACCESS
  • Locked
    9.  Creating and Using Triggered Tasks
    7m 26s
    After completing this video, you will be able to create and use a triggered task that executes whenever a standard stream has data that can be consumed. FREE ACCESS
  • Locked
    10.  Architecting Snowflake Data Pipelines
    6m 40s
    During this video, you will learn how to construct an architecture that utilizes streams, tasks, stages, and dynamic tables to feed into a dynamic dashboard. FREE ACCESS
  • Locked
    11.  Implementing a Snowflake Data Pipeline
    7m 43s
    Discover how to implement an architecture with a stage, scheduled task, and table. FREE ACCESS
  • Locked
    12.  Adding Dynamic Pipelines and Triggered Tasks to a Data Pipeline
    8m 33s
    In this video, you will learn how to extend a data pipeline by adding a triggered task to consume stream data and a dynamic table to compute base table analytical queries. FREE ACCESS
  • Locked
    13.  Building Dashboards in Snowflake
    6m 27s
    Upon completion of this video, you will be able to create a dashboard to consume data from different tables and dynamic tables in Snowflake. FREE ACCESS
  • Locked
    14.  Course Summary
    1m 52s
    In this video, we will summarize the key concepts covered in this course. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Snowflake Performance: Clustering and Search Optimization
Rating 4.0 of 2 users Rating 4.0 of 2 users (2)
Course Snowflake Performance: Iceberg Tables, External Tables, and Views
Rating 5.0 of 4 users Rating 5.0 of 4 users (4)
Course Advanced Analytics: Performing Analytics Using Snowflake
Rating 4.6 of 48 users Rating 4.6 of 48 users (48)