August 2025
Intermediate to advanced
476 pages
12h 52m
English
Content preview from AWS Certified Data Engineer Associate Study Guide
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Chapter 6. Data Operations and Support
In the evolving world of data-driven decision making, the ability to effectively manage, monitor, and optimize data processing pipelines is crucial for organizations seeking to unlock the full potential of their data assets. As data engineers, you play a pivotal role in ensuring the reliability, performance, and cost-effectiveness of these data pipelines, which power the critical analytics and business intelligence initiatives within your organization.
This chapter will explore the key aspects of data operations and support, equipping you with the knowledge and skills required to automate data processing, analyze data, maintain and monitor data pipelines, and ensure data quality. By mastering these techniques, you will become a valuable asset in your organization’s data-driven journey, enabling seamless data operations and supporting the delivery of actionable insights.
This chapter will help you learn how to do the following:
-
Analyze data using a variety of AWS services, including Amazon QuickSight, Amazon Athena, and Amazon Redshift.
-
Monitor data pipelines by deploying comprehensive logging and monitoring solutions, leveraging tools like Amazon CloudWatch, AWS CloudTrail, Amazon Macie, and system tables for specific services.
-
Apply best practices for performance tuning and troubleshooting data processing pipelines.
-
Build robust data pipelines to achieve your recovery point objective (RPO) and recovery time objective (RTO) in case ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.