Chapter 23
Case Study: A Programmatic Example
WHAT’S IN THIS CHAPTER?
- Understanding the business situation
- Architecting a data quality solution
- Setting up the case study
- Implementing the ETL
Usually, a book like this has to cover so much material that there is not enough space to really dig into some of the typical issues that can arise when you put the book down and begin your first solution. You end up returning to the book to flip through all the one-off examples, but they just don’t seem to provide the insight you need or to apply to your current project or deadline. Looking at a case study enables you to get specific — that is, to get hands-on experience with a real-world business issue and run with it. By working through the example provided in this chapter, you will gain the fundamental knowledge and skills you need to tackle your own project.
You will use the SSIS environment to solve a payment processing problem; you have payment data of varying levels of quality that has to be validated against corporate billing records. This example is a little different from the typical data warehouse-type ETL case study; it’s a little more programmatic. That’s not to say that there is no ETL. You’ll need to import three heterogeneous data formats, but the interesting part is the use of the SSIS Data Flow Transformations that allow for the development of smart validation and matching programming logic. This will all combine into a solid learning opportunity that showcases the real ...
