Microsoft Fabric: The Medallion Architecture with a Star Schema

Microsoft Fabric 2024    |    Expert
  • 10 videos | 1h 23m 27s
  • Earns a Badge
Rating 4.3 of 3 users Rating 4.3 of 3 users (3)
The medallion architecture, which features bronze, silver, and gold layers, is a data organization approach and an important part of Microsoft Fabric and the DP-600 certification test. In this course, learn how the bronze layer stores raw data, the silver layer holds cleaned and transformed data, and the gold layer is for business-ready reporting and analytics. Begin by implementing the bronze layer. Create code for incremental data processing, perform data cleaning, and use merge and upsert operations with Spark Delta tables to load data into the Silver layer. Next, prepare the gold layer by using fact and dimension tables within a star schema. Transform silver layer data into the gold layer and create a semantic model that defines relationships between tables for use in Power BI reports. Finally, explore partitioning and table maintenance techniques and study the use of features like optimize, v-order, and vacuum. This course is part of a series that prepares learners for Exam DP-600: Implementing Analytics Solutions Using Microsoft Fabric.

WHAT YOU WILL LEARN

  • Discover the key concepts covered in this course
    Define and analyze the gold, silver, and bronze layers of the medallion architecture
    Outline the star schema, which is commonly used in the gold layer of the medallion architecture, and describe the way semantic models capture relationships between fact and dimension tables
    Use the files section of a lakehouse for the bronze layer of the medallion architecture and prepare data for loading into the silver layer
    Use merge and upsert methods of spark delta tables to successfully manage incremental data loading from the bronze layer (file storage) to the silver layer (delta table)
  • Outline the star schema that we will be implementing in the gold layer, with detailed schemas for the fact and dimension tables
    Create fact and dimension delta tables in the gold layer and populate them with data from the silver layer using upsert operations
    Create a semantic model from the star schema and use that semantic model in power bi reports
    Analyze partitioning and the optimize, v-order and vacuum features in table maintenance
    Summarize the key concepts covered in this course

IN THIS COURSE

  • 2m 3s
    In this video, you will discover the key concepts covered in this course. FREE ACCESS
  • 11m 54s
    Upon completion of this video, you will be able to define and analyze the gold, silver, and bronze layers of the medallion architecture. FREE ACCESS
  • Locked
    3.  The Star Schema in Semantic Models
    8m 5s
    Learn how to outline the star schema, which is commonly used in the gold layer of the medallion architecture, and describe the way semantic models capture relationships between fact and dimension tables. FREE ACCESS
  • Locked
    4.  The Bronze Layer in the Medallion Architecture
    10m 32s
    Find out how to use the files section of a lakehouse for the bronze layer of the medallion architecture and prepare data for loading into the silver layer. FREE ACCESS
  • Locked
    5.  Moving from the Bronze Layer to the Silver Layer
    10m 37s
    Discover how to use merge and upsert methods of Spark Delta tables to successfully manage incremental data loading from the bronze layer (file storage) to the silver layer (Delta table). FREE ACCESS
  • Locked
    6.  Outlining the Architecture of the Gold Layer
    8m 52s
    In this video, find out how to outline the star schema that we will be implementing in the gold layer, with detailed schemas for the fact and dimension tables. FREE ACCESS
  • Locked
    7.  Moving from the Silver Layer to the Gold Layer
    10m 12s
    Learn how to create fact and dimension Delta tables in the gold layer and populate them with data from the silver layer using upsert operations. FREE ACCESS
  • Locked
    8.  Gold Layer Semantic Models & Power BI Reports
    11m 22s
    During this video, discover how to create a semantic model from the star schema and use that semantic model in Power BI reports. FREE ACCESS
  • Locked
    9.  Partitioning and Table Maintenance
    7m 52s
    Learn how to analyze partitioning and the optimize, v-order and vacuum features in table maintenance. FREE ACCESS
  • Locked
    10.  Course Summary
    2m 1s
    In this video, we will summarize the key concepts covered in this course. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Book Data Mesh in Action
Book Data Fabric and Data Mesh Approaches with AI: A Guide to AI-based Data Cataloging, Governance, Integration, Orchestration, and Consumption
Course CompTIA Data+: Data Quality & Master Data Management
Rating 4.3 of 14 users Rating 4.3 of 14 users (14)