Skip to Content
Building Data Integration Solutions
book

Building Data Integration Solutions

by Jay Borthen
October 2025
Intermediate to advanced
284 pages
7h
English
O'Reilly Media, Inc.
Content preview from Building Data Integration Solutions

Chapter 10. Implementing a Batch Solution

In this chapter we walk through the steps of implementing the data integration solution introduced in Chapter 9. By the end of this chapter, you will have gained practical experience in building a batch solution that is scalable and reliable.

Setting Up Qlik Replicate

In the following sections, we’ll set up Qlik Replicate in a Windows Server EC2 Instance, and we will copy data located in a PostgreSQL database into an AWS S3 bucket to form the beginning of a small data lake.

Setting Up a Windows Server EC2 Instance for Qlik Replicate

First, we create a Windows Server EC2 Instance with the following specs. These specs align with Qlik’s Basic System recommended hardware configuration but with an additional 8 GB of memory:1

t3.xlarge
4 vCPUs
x86_64 Architecture
16 GiB Memory
EBS Root Device Type
GP3 Volume Type
320 GiB HD
3000 IOPS

AMI: Microsoft Windows Server 2025 Base
AMI ID: ami-07fa5275316057f54

Log in to AWS and navigate to the EC2 dashboard. In the EC2 Instance console, click the “Launch instances” button and select “Launch instances” from the drop-down menu, as shown in Figure 10-1.

AWS EC2 console displaying the "Launch instances" dropdown menu with the option to "Launch instances" highlighted.
Figure 10-1. Launch instances

Name the instance. Here we’ll use the name “Qlik Replicate (Windows Server).” Then, under Application and OS Images (Amazon Machine Image) and the Quick Start tab, select the Windows panel. Under Amazon Machine Image (AMI), ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

The Definitive Guide to Data Integration

The Definitive Guide to Data Integration

Pierre-Yves BONNEFOY, Emeric CHAIZE, Raphaël MANSUY, Mehdi TAZI
Implementing Data Mesh

Implementing Data Mesh

Jean-Georges Perrin, Eric Broda

Publisher Resources

ISBN: 9781098173050Errata Page