Chapter 15
Understanding and Tuning the Data Flow Engine
WHAT’S IN THIS CHAPTER?
- Understanding the Control Flow and Data Flow
- Data Flow architecture and transformation types
- Data Flow design and tuning
- Troubleshooting Data Flow performance
This chapter focuses on how the Data Flow engine works, because as you seek to expand your knowledge and skills with SSIS, you will need to understand how to best leverage and tune your packages and Data Flows. The chapter begins with a consideration of the architecture of the engine and its components, and then describes best practices for design and optimization, including the following concepts:
- Control Flow and Data Flow comparison
- Data Flow Transformation types
- Data Flow buffer architecture and execution trees
- Monitoring Data Flow execution
- Data Flow design practices
- Tuning the Data Flow engine
- Performance monitoring
The initial part of this chapter is more abstract and theoretical, but we’ll then move into the practical and tangible. In the concluding sections, you will apply the knowledge you have developed here, considering a methodology for optimization and looking at a few real-world scenarios.
Some of you will have worked with a previous edition of SSIS (2008 and 2005); for others, this will be your first time working with the tool. In many ways, each new version of SSIS has made improvements to the Data Flow architecture, adding more scalability and performance and fine-tuning the performance of the Data Flow engine.
For those ...
