Skip to Content
Professional SQL Server® 2008 Integration Services
book

Professional SQL Server® 2008 Integration Services

by Brian Knight, Erik Veerman, Grant Dickinson, Douglas Hinson, Darren Herbold
October 2008
Intermediate to advanced
1005 pages
27h 22m
English
Wrox
Content preview from Professional SQL Server® 2008 Integration Services

Chapter 14. Understanding and Tuning the Data Flow Engine

This chapter dives under the hood of SSIS to consider the architecture of the engine and its components, and then best practices for design and optimization including the following concepts:

  • Control Flow and Data Flow comparison

  • Data Flow Transformation types

  • Data Flow buffer architecture and execution trees

  • Monitoring Data Flow execution

  • Data Flow design practices

  • Tuning the Data Flow engine

  • Performance monitoring

The initial part of this chapter is more abstract and theoretical, but we'll then move into the practical and tangible. In the concluding sections, you will take the knowledge you have developed here and bring it to application, considering a methodology to optimization and looking at a few real-world scenarios.

The SSIS Engine

Before learning about buffers, asynchronous components, and execution trees, consider this analogy — traffic management. Have you ever driven in a big city and wondered how the traffic system works? It's remarkable to consider how the traffic lights are all coordinated in a city. In Manhattan, for example, a taxi drive can take you from midtown to downtown in minutes — in part because the lights are timed in a rolling fashion to maintain efficiency. The heavy fine assessed to anyone who "locks the box" (remains in the intersection after the light turns red) demonstrates how detrimental it is to interfere with the synchronization of such a complex traffic grid.

Contrast the efficiency of Manhattan with ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Professional SQL Server™ 2005 Integration Services

Professional SQL Server™ 2005 Integration Services

Brian Knight, Allan Mitchell, Darren Green, Douglas Hinson, Kathi Kellenberger, Andy Leonard, Erik Veerman, Jason Gerard, Haidong Ji, Mike Murphy
Microsoft® SQL Server™ 2005 Integration Services Step by Step

Microsoft® SQL Server™ 2005 Integration Services Step by Step

Hitachi Consulting Paul Turley Joe Kaspizak, Scott Cameron, Satoshi Iizuka, and Pablo Guzman
Microsoft® SQL Server® 2012 Integration Services

Microsoft® SQL Server® 2012 Integration Services

Rakesh Parida Wee-Hyong Tok Matt Masson, Xiaoning Ding, and Kaarthik Sivashanmugam

Publisher Resources

ISBN: 9780470247952Purchase book