Azure Storage, Streaming, and Batch Analytics: Guide for Data Engineers
- 7h 1m
- Richard Nuckolls
- Manning Publications
- 2020
The Microsoft Azure cloud is an ideal platform for data-intensive applications. Designed for productivity, Azure provides pre-built services that make collection, storage, and analysis much easier to implement and manage. Azure Storage, Streaming, and Batch Analytics teaches you how to design a reliable, performant, and cost-effective data infrastructure in Azure by progressively building a complete working analytics system.
Summary
The Microsoft Azure cloud is an ideal platform for data-intensive applications. Designed for productivity, Azure provides pre-built services that make collection, storage, and analysis much easier to implement and manage. Azure Storage, Streaming, and Batch Analytics teaches you how to design a reliable, performant, and cost-effective data infrastructure in Azure by progressively building a complete working analytics system.
About the technology
Microsoft Azure provides dozens of services that simplify storing and processing data. These services are secure, reliable, scalable, and cost efficient.
About the book
Azure Storage, Streaming, and Batch Analytics shows you how to build state-of-the-art data solutions with tools from the Microsoft Azure platform. Read along to construct a cloud-native data warehouse, adding features like real-time data processing. Based on the Lambda architecture for big data, the design uses scalable services such as Event Hubs, Stream Analytics, and SQL databases. Along the way, you’ll cover most of the topics needed to earn an Azure data engineering certification.
What's inside
- Configuring Azure services for speed and cost
- Constructing data pipelines with Data Factory
- Choosing the right data storage methods
About the reader
For readers familiar with database management. Examples in C# and PowerShell.
About the Author
Richard Nuckolls is a senior developer building big data analytics and reporting systems in Azure.
In this Book
-
About This Book
-
What is Data Engineering?
-
Building an Analytics System in Azure
-
General Storage with Azure Storage Accounts
-
Azure Data Lake Storage
-
Message Handling with Event Hubs
-
Real-Time Queries with Azure Stream Analytics
-
Batch Queries with Azure Data Lake Analytics
-
U-SQL for Complex Analytics
-
Integrating with Azure Data Lake Analytics
-
Service Integration with Azure Data Factory
-
Managed SQL with Azure SQL Database
-
Integrating Data Factory with SQL Database
-
Where to Go Next