Your company’s data warehouse project has finally taken off, and you’ve been asked to build a reliable system to extract, clean, integrate, and deliver the data. A preliminary check indicates you have the required elements to accomplish your mission: data from source systems and a handy ETL tool. It looks easy!
The reality is that building a data integration system is an endeavor that requires meeting complex requirements coming from different perspectives. In this chapter, you’ll explore key tasks and subcomponents that should be included in every ETL solution for increased reliability, scalability, manageability, and data quality.
To facilitate the discussion, I’ll break the chapter into five ...