In any effective ETL system, there lies an unseen but valuable system of event and error logging designed to aid in troubleshooting problems, heading off potential issues, and tracking historical trends in data movement and transformation.
In this chapter, we’re going to discuss logging patterns. If you are a lumberjack and are looking for career tips, you can stop reading now—this is a different type of logging.
Essentials of Logging
Let’s be honest—event and error logging probably isn’t at the top of the list when the average ETL professional thinks of his or her favorite things. Consider the types of things we brag ...