Using Tasks and Architecting Snowflake Data Pipelines
Snowflake
| Intermediate
- 14 videos | 1h 49m 26s
- Includes Assessment
- Earns a Badge
Tasks are Snowflake constructs that can execute code on a fixed schedule or when a stream has data to consume. Tasks are similar to cron jobs but are more complex because they can be chained into complex dependency networks called task graphs. In this course, learn about continuous data processing tasks, create and execute scheduled serverless and user-managed scheduled tasks, and implement task graphs and child tasks. Next, use dummy root nodes to bypass Snowflake's root node restrictions, create and use triggered tasks, and construct an architecture that utilizes streams, tasks, stages, and dynamic tables to feed into a dynamic dashboard. Finally, discover how to implement data pipelines with a stage, scheduled task, and table, add dynamic pipelines and triggered tasks to data pipelines, and create dashboards in Snowflake to consume data from different tables. Upon completion of this course, you will be able to use tasks and architect Snowflake data pipelines.
WHAT YOU WILL LEARN
-
Discover the key concepts covered in this courseOutline scheduled tasks, triggered tasks, and task graphsBuild and execute a scheduled serverless taskCreate a user-managed scheduled task using a cron expressionBuild a task graph with a child task that depends upon a parent taskImplement a task graph with one root node and two child nodes that each depend upon the rootDesign and partially implement a task graph with two root nodes and a single child node that depends upon both root nodes
-
Use dummy root nodes to circumvent snowflake's restriction on multiple root nodes in a task graphCreate and use a triggered task that executes whenever a standard stream has data that can be consumedConstruct an architecture that utilizes streams, tasks, stages, and dynamic tables to feed into a dynamic dashboardImplement an architecture with a stage, scheduled task, and tableExtend a data pipeline by adding a triggered task to consume stream data and a dynamic table to compute base table analytical queriesCreate a dashboard to consume data from different tables and dynamic tables in snowflakeSummarize the key concepts covered in this course
IN THIS COURSE
-
1m 40sIn this video, we will discover the key concepts covered in this course. FREE ACCESS
-
8m 20sUpon completion of this video, you will be able to outline scheduled tasks, triggered tasks, and task graphs. FREE ACCESS
-
11m 56sIn this video, discover how to build and execute a scheduled serverless task. FREE ACCESS
-
9m 31sFind out how to create a user-managed scheduled task using a cron expression. FREE ACCESS
-
12m 22sDuring this video, you will learn how to build a task graph with a child task that depends upon a parent task. FREE ACCESS
-
10m 50sDiscover how to implement a task graph with one root node and two child nodes that each depend upon the root. FREE ACCESS
-
9m 49sIn this video, find out how to design and partially implement a task graph with two root nodes and a single child node that depends upon both root nodes. FREE ACCESS
-
6m 16sLearn how to use dummy root nodes to circumvent Snowflake's restriction on multiple root nodes in a task graph. FREE ACCESS
-
7m 26sAfter completing this video, you will be able to create and use a triggered task that executes whenever a standard stream has data that can be consumed. FREE ACCESS
-
6m 40sDuring this video, you will learn how to construct an architecture that utilizes streams, tasks, stages, and dynamic tables to feed into a dynamic dashboard. FREE ACCESS
-
7m 43sDiscover how to implement an architecture with a stage, scheduled task, and table. FREE ACCESS
-
8m 33sIn this video, you will learn how to extend a data pipeline by adding a triggered task to consume stream data and a dynamic table to compute base table analytical queries. FREE ACCESS
-
6m 27sUpon completion of this video, you will be able to create a dashboard to consume data from different tables and dynamic tables in Snowflake. FREE ACCESS
-
1m 52sIn this video, we will summarize the key concepts covered in this course. FREE ACCESS
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.