In this recipe, we will implement the external user-built ETL audit mechanism. Our ETL audit will include information about the start and stop times of the workflows running within the job, their statuses, names, and information about which job they belong to.
We need to create an ETL audit table in our database where we will store the audit results.
Connect to the
STAGE database using the SQL Server Management Studio and execute the following statement to create the ETL audit table:
create table dbo.etl_audit ( job_run_id integer, workflow_status varchar(50), job_name varchar(255), start_dt datetime, end_dt datetime, process_name varchar(255) );
First, we need to choose ...