October 2025
Intermediate to advanced
284 pages
7h
English
Content preview from Building Data Integration Solutions
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Chapter 9. Introducing the Example Solution
In this chapter, we introduce the example solution, which will be detailed in Chapters 10 and 11. We will discuss the objectives of the example, describe its initial state, and give you a big-picture overview of its architecture. By providing this high-level overview of the example scenario, this chapter aims to provide a tangible starting point for the hands-on portions in Chapters 10 and 11 and preview what’s to come.
Objectives
The goals of the example data integration in Chapters 10 and 11 include the following:
- Demonstrate the ease with which a purpose-built data integration platform can handle the ETL process.
The example will show how a modern data integration platform can simplify the traditional extract, transform, load (ETL) workflow. Rather than requiring extensive custom scripting or manual configuration, the platform streamlines data ingestion, transformation, and delivery across multiple sources and destinations. By highlighting automation, low-code interfaces, and built-in connectivity, the demonstration reveals how integration tasks that once demanded significant effort can now be executed with speed and repeatability.
- Illustrate some of the concepts discussed in Part I, including batch and stream processing.
Concepts such as batch and streaming integration, data silos, and pipeline orchestration are brought to life through the practical implementation. The example includes both static data sources (e.g., CSV files ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.