SRE Data Pipelines & Integrity: Pipeline Design

SRE    |    Intermediate
  • 17 videos | 1h 2m 59s
  • Includes Assessment
  • Earns a Badge
Rating 4.6 of 19 users Rating 4.6 of 19 users (19)
Site reliability engineers (SREs) encounter numerous and varied pipeline technologies and frameworks in their work. When building a pipeline, SREs need to invest considerable time during the design phase to ensure the results work best for the specific case. In this course, you'll explore the numerous features of a pipeline, such as latency, high availability, development, and operations. You'll also examine the two different pipeline mutations: idempotent and two-phase, as well as the checkpointing technique and various code patterns. You'll then investigate the five core characteristics of the pipeline maturity matrix and outline how they should be used to design the pipeline technology. You'll then identify potential failure modes, outage causes, and different prevention and response techniques. Finally, you'll outline event delivery system design and operations and how to plan for customer integration and support.

WHAT YOU WILL LEARN

  • Discover the key concepts covered in this course
    Differentiate between the various pipeline features
    Differentiate between idempotent and two-phase mutations
    Describe what the checkpointing technique is used for, in what situations it's used, and the advantages of its use
    List common code patterns, such as reusing code and the microservice approach
    Describe the purpose and characteristics of the maturity matrix
    List example milestones for the failure tolerance maturity matrix characteristic
    List examples of the scalability maturity matrix characteristic
    List examples of the monitoring and debugging maturity matrix characteristic
  • List examples of the implementation maturity matrix characteristic
    List examples of the testing maturity matrix characteristic
    Differentiate between the different potential failure modes
    List potential causes of an outage
    Recognize event delivery system design and architecture considerations
    Outline how event delivery system operations are used using practical examples
    Describe considerations when planning for customer integration and support
    Summarize the key concepts covered in this course

IN THIS COURSE

  • 1m 47s
  • 6m 34s
  • Locked
    3.  Idempotent and Two-phase mutations
    3m 48s
  • Locked
    4.  The Checkpointing Technique
    3m 28s
  • Locked
    5.  Common Code Patterns
    3m 10s
  • Locked
    6.  The Maturity Matrix
    2m 35s
  • Locked
    7.  The Failure Tolerance Maturity Matrix Characteristic
    4m 14s
  • Locked
    8.  The Scalability Maturity Matrix Characteristic
    3m 6s
  • Locked
    9.  The Monitoring and Debugging Maturity Matrix Elements
    3m 7s
  • Locked
    10.  The Implementation Maturity Matrix Characteristic
    3m 20s
  • Locked
    11.  The Testing Maturity Matrix Characteristic
    5m 23s
  • Locked
    12.  Potential Failure Modes
    6m 13s
  • Locked
    13.  Outage Causes
    4m 6s
  • Locked
    14.  Event Delivery System Design and Architecture
    3m 35s
  • Locked
    15.  Event Delivery System Operations
    3m 18s
    In this video, you'll learn more about event delivery systems. These groups or aggregate incoming events based on type to glean useful information from event streams. You'll discover what types the system supports are important to delivering useful information. Consider a system that collects events from HVAC units and refrigeration units. Both HVAC units and refrigeration units can have a maximum temperature threshold. FREE ACCESS
  • Locked
    16.  Planning For Customer Integration and Support
    4m 3s
    In this video, you'll learn more about integrating your pipelines with client systems and what user support for your pipelines will entail. Your clients' main objective is going to be to get their own systems up and running. They don't want to spend the majority of their time working with your system. So make sure to keep your pipeline services simple, intuitive, and easy to use. FREE ACCESS
  • Locked
    17.  Course Summary
    1m 12s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Software Product Management: Measuring Progress & Productivity
Rating 4.6 of 5 users Rating 4.6 of 5 users (5)
Course Scaled Agile Leader: Scaling Scrum Customization
Rating 4.4 of 48 users Rating 4.4 of 48 users (48)
Course CAPM(r): Project Performance Domains
Rating 4.2 of 17 users Rating 4.2 of 17 users (17)

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course Digital Transformation Insights: Marketing, Sales & Engineering Functions
Rating 4.5 of 202 users Rating 4.5 of 202 users (202)
Course Introduction to Domain-driven Design
Rating 4.1 of 48 users Rating 4.1 of 48 users (48)
Course SRE Products at Scale: Product Launches
Rating 4.8 of 27 users Rating 4.8 of 27 users (27)