book

Metadata Management with IBM InfoSphere Information Server

by Jackie Zhu, Tuvia Alon, Gregory Arkus, Randy Duran, Marc Haber, Robert Liebke, Frank Morreale Jr., Itzhak Roth, Alan Sumano

October 2011

Beginner to intermediate

458 pages

10h 10m

English

IBM Redbooks

Read now

Unlock full access

Trademarks
The team who wrote this bookNow you can become a published author, too!Comments welcomeStay connected to IBM Redbooks
1.1 Information governance1.2 Defining metadata1.3 Types of metadata1.3.1 Business metadata1.3.2 Technical metadata1.3.3 Operational metadata1.4 Why metadata is important1.4.1 Risk avoidance1.4.2 Regulatory compliance1.4.3 IT productivity1.5 Requirements for managing metadata1.5.1 The information governance organization1.5.2 Information governance operational teams1.5.3 Standards, policies, and procedures1.6 Business scenarios for metadata management1.6.1 Metadata for compliance1.6.2 Metadata for risk management1.7 Where to start1.8 Conclusion
2.1 Getting started with solution planning2.1.1 Information integration solution2.1.2 Information integration project2.2 Stakeholders2.3 Integrated solution data flow2.4 Typical implementation process flow2.4.1 Defining business requirements2.4.2 Building business centric vocabulary2.4.3 Developing data model2.4.4 Documenting source data2.4.5 Assessing and monitoring data quality2.4.6 Building up the metadata repository2.4.7 Transforming data2.4.8 Developing BI solutions2.4.9 Generating enterprise reports and lineage2.5 Conclusion
3.1 Overview of InfoSphere Information Server3.2 Platform infrastructure3.2.1 Services tier3.2.2 Engine tier3.2.3 Repository tier3.3 Product modules and components3.3.1 InfoSphere Blueprint Director3.3.2 InfoSphere DataStage and InfoSphere QualityStage3.3.3 InfoSphere Information Analyzer3.3.4 InfoSphere Discovery3.3.5 InfoSphere FastTrack3.3.6 InfoSphere Business Glossary3.3.7 InfoSphere Metadata Workbench3.3.8 InfoSphere Information Server Manager, ISTools and InfoSphere Metadata Asset Manager3.3.9 InfoSphere Data Architect3.3.10 Cognos Business Intelligence software3.4 Solution development: Mapping product modules and components to solution processes3.4.1 Defining the business requirements3.4.2 Building business centric vocabulary3.4.3 Developing data model3.4.4 Documenting source data3.4.5 Assessing and monitoring data quality3.4.6 Building up the metadata repository3.4.7 Transforming data3.4.8 Developing BI solutions3.4.9 Generating enterprise reports and lineage3.5 Deployment architecture and topologies3.5.1 Overview of the topologies3.5.2 Unified and shared metadata3.5.3 Metadata portability3.5.4 Alternative deployment3.6 Conclusion
4.1 Scenario background4.2 Current BI and data warehouse solution for Bank A4.3 Project goals for the new solution4.4 Using IBM InfoSphere Information Server for the new solution4.4.1 Changes required4.5 Additional challenges4.5.1 The integration challenge and the governance problem4.5.2 Additional business requirements4.6 A customized plan4.6.1 BI process development4.6.2 Data Quality monitoring and subscription4.6.3 Data lineage and reporting requirements and capabilities4.7 Conclusion
5.1 Introduction to InfoSphere Blueprint Director5.2 InfoSphere Blueprint Director user interface basics5.2.1 User interface5.2.2 Palette5.3 Creating a blueprint by using a template5.3.1 Customizing the template5.3.2 Working with metadata repository5.3.3 Working with a business glossary5.4 Working with milestones5.5 Using methodology5.6 Conclusion

6.1 Introduction to InfoSphere Business Glossary6.2 Business glossary and information governance6.3 Creating the business glossary content6.3.1 Taxonomy6.3.2 The taxonomy development process6.3.3 Controlled vocabulary6.3.4 Term specification process and guidelines6.3.5 Using external glossary sources6.3.6 The vocabulary authoring process6.4 Deploying a business glossary6.4.1 InfoSphere Business Glossary environment6.5 Managing the term authoring process with a workflow6.5.1 Loading and populating the glossary6.5.2 Creating and editing a term6.5.3 Adding term relations and assigning assets6.5.4 Reference by category6.5.5 Custom attributes6.5.6 Labels6.5.7 Stewardship6.5.8 URL links6.5.9 Import glossary6.6 Searching and exploring with InfoSphere Business Glossary6.7 Multiple ways of accessing InfoSphere Business Glossary6.7.1 InfoSphere Business Glossary Anywhere6.7.2 REST API6.7.3 Eclipse plug-in6.8 Conclusion
7.1 Process overview7.2 Introduction to InfoSphere Metadata Asset Manager7.3 Application systems7.3.1 Extended data source types7.3.2 Format7.3.3 Loading the application system7.3.4 Results7.4 Sequential files7.4.1 Loading a data file7.4.2 Results7.5 Staging database7.5.1 Loading the staging database7.5.2 Results7.6 Data extraction7.6.1 Input file format7.6.2 Documenting the data extraction7.6.3 Results7.7 Conclusion
8.1 Introduction to InfoSphere Discovery8.1.1 Planning equals saving8.1.2 A step-by-step discovery guide8.2 Creating a project8.2.1 Pointing to the data requiring analysis8.2.2 Importing the source data8.2.3 Importing the target data8.3 Performing column analysis8.3.1 Monitoring tasks with the activity viewer8.3.2 Reviewing the column analysis results8.3.3 Metadata and statistical results8.3.4 Value, pattern, and length frequencies8.4 Identifying and classifying sensitive data8.4.1 Column classification view8.4.2 Displaying hits for classification columns8.4.3 Column classification algorithms8.5 Assigning InfoSphere Business Glossary terms to physical assets8.5.1 Importing, mapping, and exporting term assignments8.5.2 Mapping business glossary terms to physical assets8.6 Reverse engineering a data model8.6.1 Primary-foreign key candidates8.6.2 Discovering primary-foreign key candidates8.6.3 Displaying the results8.6.4 Data objects8.6.5 Performing transformation discovery8.7 Performing value overlap analysis8.7.1 Running overlap analysis8.7.2 Column Summary8.7.3 Viewing value overlap details8.8 Discovering transformation logic8.8.1 Performing a transformation discovery8.8.2 Reviewing maps8.8.3 Exporting transformation results to InfoSphere FastTrack8.9 Conclusion
9.1 Introduction to IBM InfoSphere Information Analyzer9.1.1 InfoSphere Information Analyzer and information governance9.1.2 InfoSphere Information Analyzer and InfoSphere Information Server9.1.3 Metadata data repository9.2 InfoSphere Information Analyzer data rules9.2.1 Roles in data rules and data quality management9.2.2 Properties of the InfoSphere Information Analyzer data rules9.2.3 Data rules management9.2.4 Rule definition guidelines for data quality9.3 Creating a rule9.3.1 Creating a rule definition9.3.2 Testing a rule9.3.3 Generating data rules9.4 Data rule examples9.4.1 Checking for duplicates9.4.2 Generating a data rule9.4.3 Use case: Creating a data rule to monitor high value customers9.4.4 Creating rules to monitor gold customers9.5 Data rules and performance consideration9.5.1 Types of data rules9.5.2 Using join tables in data quality rules9.5.3 Cartesian products and how to avoid them9.5.4 Applying filtering in data quality rules9.5.5 Filtering versus sampling9.5.6 Virtual tables versus database views9.5.7 Global variables9.6 Rule sets9.7 Metrics9.8 Monitoring data quality9.9 Using HTTP/CLI API9.10 Managing rules9.11 Deploying rules, rule sets, and metrics9.12 Rule stage for InfoSphere DataStage9.13 Conclusion
10.1 Introduction to InfoSphere Metadata Workbench10.2 Data storage systems10.3 Data models10.3.1 Loading the data models10.3.2 Results10.4 Business intelligence reports10.4.1 Loading BI reports10.4.2 Results10.5 Information asset enrichment10.5.1 Business glossary terms10.5.2 Business glossary labels10.5.3 Data stewardship10.5.4 Asset descriptor and alias10.6 Conclusion
11.1 Introduction to InfoSphere FastTrack11.1.1 Functionality and user interface11.1.2 Administration11.2 Basic mapping11.3 Advanced mapping11.4 Mapping lifecycle management (job generation)11.5 Metadata sharing (extension mappings)11.6 InfoSphere DataStage job design11.6.1 Job design details11.7 Shared metadata11.7.1 Shared metadata that must be created11.8 Operational metadata11.8.1 Creating operational metadata11.9 Conclusion
12.1 Lineage administration12.1.1 Business lineage12.1.2 Data lineage12.1.3 Impact analysis12.2 Support for InfoSphere DataStage and InfoSphere QualityStage jobs12.2.1 Design lineage12.2.2 Operational lineage12.3 Support for external processes12.4 Support for InfoSphere FastTrack mapping specifications12.5 Configuring business lineage12.6 Search and display12.6.1 Information catalog12.6.2 Find and search12.7 Querying and reporting12.7.1 Reports12.7.2 Querying12.8 Conclusion
IBM RedbooksOnline resourcesHelp from IBM

Content preview from Metadata Management with IBM InfoSphere Information Server

Implementation

This part provides information about the implementation of a solution. It uses the process described in the previous part and includes a use case.

This part includes the following chapters:

•Chapter 4, “Use-case scenario” on page 77

•Chapter 5, “Implementation planning” on page 89

•Chapter 6, “Building a business-centric vocabulary” on page 131

•Chapter 7, “Source documentation” on page 175

•Chapter 8, “Data relationship discovery” on page 209

•Chapter 9, “Data quality assessment and monitoring” on page 283

•Chapter 10, “Building ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Start your free trial

IBM Spectrum Discover: Metadata Management for Deep Insight of Unstructured Storage

Joseph Dain, Norman Bogard, Isom Crawford Jr., Mathias Defiebre, Larry Coyne

IBM Information Governance Solutions

Chuck Ballard, John Baldwin, Alex Baryudin, Gary Brunell, Christopher Giardina, Marc Haber, Erik A O'neill, Sandeep Shah

IBM WebSphere Information Analyzer and Data Quality Assessment

Nagraj Alur, Reginald Joseph, Harshita Mehta, Jorgen Tang Nielsen, Denis Vasconcelos

IBM DS8900F Architecture and Implementation: Updated for Release 9.2

Bertrand Dufrasne, Sherri Brunson, Jeff Cook, Lisa Martinez, Connie Riggins, Mike Stenson

Publisher Resources

ISBN: 0738435996Purchase book