Skip to Content
Microsoft® SQL Server® 2008 Integration Services: Problem-Design-Solution
book

Microsoft® SQL Server® 2008 Integration Services: Problem-Design-Solution

by Erik Veerman, Jessica M. Moss, Brian Knight, Jay Hackney
November 2009
Beginner to intermediate
476 pages
13h 20m
English
Wrox
Content preview from Microsoft® SQL Server® 2008 Integration Services: Problem-Design-Solution

10

Implementing Scale-Out ETL Process

Now that you’ve worked through several aspects of building an SSIS solution, let’s turn now to some advanced concepts. In this chapter, you learn how to scale out SSIS, where SSIS packages are working in tandem on multiple machines. This effective way to handle large volumes of data has the added benefit of fault tolerance if one of the servers goes down.

Chapter 11 transitions to review advanced scripting in those situations when you just can’t accomplish what you need to with out-of-the-box components and you need to compose code to help accomplish your goals (both control flow and data flow). The final chapter, Chapter 12, is about troubleshooting performance issues and optimizing packages for efficient use of the data flow, and other advanced topics (such as how to handle partitioned tables). Overall, these last chapters give you the direction you need to deal with both complexity and high volumes of data.

One of the biggest benefits of SSIS is its capability to process and transform data in memory, effectively reducing disk I/O, and taking advantage of better memory availability and 64-bit architecture as well. With BI solutions now becoming more commonplace than just a few years ago, companies are realizing the need to process larger and larger amounts of data, and to try to do so as quickly and efficiently as possible. As a result, ETL architects and SSIS developers must start thinking about ways to scale out ETL processes so that they ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Microsoft® SQL Server® 2012 Integration Services

Microsoft® SQL Server® 2012 Integration Services

Rakesh Parida Wee-Hyong Tok Matt Masson, Xiaoning Ding, and Kaarthik Sivashanmugam
Data Mining with Microsoft® SQL Server® 2008

Data Mining with Microsoft® SQL Server® 2008

Jamie MacLennan, ZhaoHui Tang, Bogdan Crivat

Publisher Resources

ISBN: 9780470525760Publisher Website