SRE Data Pipelines & Integrity: Pipeline Design
SRE
| Intermediate
- 17 videos | 1h 2m 59s
- Includes Assessment
- Earns a Badge
Site reliability engineers (SREs) encounter numerous and varied pipeline technologies and frameworks in their work. When building a pipeline, SREs need to invest considerable time during the design phase to ensure the results work best for the specific case. In this course, you'll explore the numerous features of a pipeline, such as latency, high availability, development, and operations. You'll also examine the two different pipeline mutations: idempotent and two-phase, as well as the checkpointing technique and various code patterns. You'll then investigate the five core characteristics of the pipeline maturity matrix and outline how they should be used to design the pipeline technology. You'll then identify potential failure modes, outage causes, and different prevention and response techniques. Finally, you'll outline event delivery system design and operations and how to plan for customer integration and support.
WHAT YOU WILL LEARN
-
Discover the key concepts covered in this courseDifferentiate between the various pipeline featuresDifferentiate between idempotent and two-phase mutationsDescribe what the checkpointing technique is used for, in what situations it's used, and the advantages of its useList common code patterns, such as reusing code and the microservice approachDescribe the purpose and characteristics of the maturity matrixList example milestones for the failure tolerance maturity matrix characteristicList examples of the scalability maturity matrix characteristicList examples of the monitoring and debugging maturity matrix characteristic
-
List examples of the implementation maturity matrix characteristicList examples of the testing maturity matrix characteristicDifferentiate between the different potential failure modesList potential causes of an outageRecognize event delivery system design and architecture considerationsOutline how event delivery system operations are used using practical examplesDescribe considerations when planning for customer integration and supportSummarize the key concepts covered in this course
IN THIS COURSE
-
1m 47s
-
6m 34s
-
3m 48s
-
3m 28s
-
3m 10s
-
2m 35s
-
4m 14s
-
3m 6s
-
3m 7s
-
3m 20s
-
5m 23s
-
6m 13s
-
4m 6s
-
3m 35s
-
3m 18sIn this video, you'll learn more about event delivery systems. These groups or aggregate incoming events based on type to glean useful information from event streams. You'll discover what types the system supports are important to delivering useful information. Consider a system that collects events from HVAC units and refrigeration units. Both HVAC units and refrigeration units can have a maximum temperature threshold. FREE ACCESS
-
4m 3sIn this video, you'll learn more about integrating your pipelines with client systems and what user support for your pipelines will entail. Your clients' main objective is going to be to get their own systems up and running. They don't want to spend the majority of their time working with your system. So make sure to keep your pipeline services simple, intuitive, and easy to use. FREE ACCESS
-
1m 12s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.