Skip to Main Content
Data Engineering with AWS
book

Data Engineering with AWS

by Gareth Eagar
December 2021
Beginner to intermediate content levelBeginner to intermediate
482 pages
11h 27m
English
Packt Publishing
Content preview from Data Engineering with AWS

Chapter 7: Transforming Data to Optimize for Analytics

In previous chapters, we covered how to architect a data pipeline and common ways of ingesting data into a data lake. We now turn to the process of transforming raw data in order to optimize the data for analytics and to create value for an organization.

Transforming data to optimize for analytics and to create value for an organization is one of the key tasks for a data engineer, and there are many different types of transformations. Some transformations are common and can be generically applied to a dataset, such as converting raw files to Parquet format and partitioning the dataset. Other transformations use business logic in the transformations and vary based on the contents of the data ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Data Engineering with AWS - Second Edition

Data Engineering with AWS - Second Edition

Gareth Eagar
Data Science on AWS

Data Science on AWS

Chris Fregly, Antje Barth
Data Engineering with Python and AWS Lambda LiveLessons

Data Engineering with Python and AWS Lambda LiveLessons

Noah Gift, Robert Jordan, Kennedy Behrman

Publisher Resources

ISBN: 9781800560413Supplemental Content