Moving Forward with the On Demand Real-time Enterprise

Chapter 4. IBM technologies supporting real-time 185

Figure 4-47 Data Profiling for data transformation

4.3.4 WebSphere QualityStage

WebSphere QualityStage helps your strategic systems deliver accurate,

complete information to business users across the enterprise. Through an

easy-to-use GUI and capabilities that can be customized to your organization’s

business rules, WebSphere QualityStage provides control over international

names and addresses and related data such as phone numbers, birth dates,

email addresses and other descriptive comment fields – and discovers

relationships among them – in enterprise and Internet environments, in batch

and real-time.

It analyzes data at the character level and uncovers anomalies and buried data

prior to transforming it for database loading or transaction processing. Data from

disparate sources is standardized into fixed fields using business driven rules to

assign the correct semantic meaning to input data in order to facilitate matching.

Duplication and data relationships can be detected despite anomalous,

inconsistent, and missing data values. There is a unique statistical matching

engine that assesses the probability that two or more sets of data values refer to

the same business entity - providing the most accurate match results available.

Once a match is confirmed, linking keys are constructed so users can complete a

transaction or load a target system with true entity integrity and view related data

as information. As a result, companies gain access to accurate, consistent,

consolidated views of any individual or business entity and its relationships

across the enterprise.

An example of a typical quality process is depicted in Figure 4-48.

Profiling

Sample

Create

Data

Model

WebSphere

DataStage

Job

Profile

and

Analyze

Normalize

and

Generate

Source

Target

Mappings

RDBMS

COBOL

Legacy Data

Flat Files

Working

Data Set