O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

DAMA-DMBOK: Data Management Body of Knowledge (2nd Edition)

Book Description

The Data Management Body of Knowledge (DAMA-DMBOK2) presents a comprehensive view of the challenges, complexities, and value of effective data management.

Today's organizations recognize that managing data is central to their success. They recognize data has value and they want to leverage that value. As our ability and desire to create and exploit data has increased, so too has the need for reliable data management practices.

The second edition of DAMA International's Guide to the Data Management Body of Knowledge (DAMA-DMBOK2) updates and augments the highly successful DMBOK1. An accessible, authoritative reference book written by leading thinkers in the field and extensively reviewed by DAMA members, DMBOK2 brings together materials that comprehensively describe the challenges of data management and how to meet them by:
  • Defining a set of guiding principles for data management and describing how these principles can be applied within data management functional areas.
  • Providing a functional framework for the implementation of enterprise data management practices; including widely adopted practices, methods and techniques, functions, roles, deliverables and metrics.
  • Establishing a common vocabulary for data management concepts and serving as the basis for best practices for data management professionals.
DAMA-DMBOK2 provides data management and IT professionals, executives, knowledge workers, educators, and researchers with a framework to manage their data and mature their information infrastructure, based on these principles:
  • Data is an asset with unique properties
  • The value of data can be and should be expressed in economic terms
  • Managing data means managing the quality of data
  • It takes metadata to manage data
  • It takes planning to manage data
  • Data management is cross-functional and requires a range of skills and expertise
  • Data management requires an enterprise perspective
  • Data management must account for a range of perspectives
  • Data management is data lifecycle management
  • Different types of data have different lifecycle requirements
  • Managing data includes managing risks associated with data
  • Data management requirements must drive information technology decisions
  • Effective data management requires leadership commitment
Chapters include:
  • Data Management
  • Data Handling Ethics
  • Data Governance
  • Data Architecture
  • Data Modeling and Design
  • Data Storage and Operations
  • Data Security
  • Data Integration and Interoperability
  • Document and Content Management
  • Reference and Master Data
  • Data Warehousing and Business Intelligence
  • Metadata Management
  • Data Quality Management
  • Big Data and Data Science
  • Data Management Maturity Assessment
  • Data Management Organization and Role Expectations
  • Data Management and Organizational Change Management
Standardization of data management disciplines will help data management professionals perform more effectively and consistently. It will also enable organizational leaders to recognize the value and contributions of data management activities.

Table of Contents

  1. Preface
  2. CHAPTER 1 Data Management
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals
    2. 2. Essential Concepts
      1. 2.1 Data
      2. 2.2 Data and Information
      3. 2.3 Data as an Organizational Asset
      4. 2.4 Data Management Principles
      5. 2.5 Data Management Challenges
      6. 2.6 Data Management Strategy
    3. 3. Data Management Frameworks
      1. 3.1 Strategic Alignment Model
      2. 3.2 The Amsterdam Information Model
      3. 3.3 The DAMA-DMBOK Framework
      4. 3.4 DMBOK Pyramid (Aiken)
      5. 3.5 DAMA Data Management Framework Evolved
    4. 4. DAMA and the DMBOK
    5. 5. Works Cited / Recommended
  3. CHAPTER 2 Data Handling Ethics
    1. 1. Introduction
    2. 2. Business Drivers
    3. 3. Essential Concepts
      1. 3.1 Ethical Principles for Data
      2. 3.2 Principles Behind Data Privacy Law
      3. 3.3 Online Data in an Ethical Context
      4. 3.4 Risks of Unethical Data Handling Practices
      5. 3.5 Establishing an Ethical Data Culture
      6. 3.6 Data Ethics and Governance
    4. 4. Works Cited / Recommended
  4. CHAPTER 3 Data Governance
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Define Data Governance for the Organization
      2. 2.2 Perform Readiness Assessment
      3. 2.3 Perform Discovery and Business Alignment
      4. 2.4 Develop Organizational Touch Points
      5. 2.5 Develop Data Governance Strategy
      6. 2.6 Define the DG Operating Framework
      7. 2.7 Develop Goals, Principles, and Policies
      8. 2.8 Underwrite Data Management Projects
      9. 2.9 Engage Change Management
      10. 2.10 Engage in Issue Management
      11. 2.11 Assess Regulatory Compliance Requirements
      12. 2.12 Implement Data Governance
      13. 2.13 Sponsor Data Standards and Procedures
      14. 2.14 Develop a Business Glossary
      15. 2.15 Coordinate with Architecture Groups
      16. 2.16 Sponsor Data Asset Valuation
      17. 2.17 Embed Data Governance
    3. 3. Tools and Techniques
      1. 3.1 Online Presence / Websites
      2. 3.2 Business Glossary
      3. 3.3 Workflow Tools
      4. 3.4 Document Management Tools
      5. 3.5 Data Governance Scorecards
    4. 4. Implementation Guidelines
      1. 4.1 Organization and Culture
      2. 4.2 Adjustment and Communication
    5. 5. Metrics
    6. 6. Works Cited / Recommended
  5. CHAPTER 4 Data Architecture
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Data Architecture Outcomes and Practices
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Establish Data Architecture Practice
      2. 2.2 Integrate with Enterprise Architecture
    3. 3. Tools
      1. 3.1 Data Modeling Tools
      2. 3.2 Asset Management Software
      3. 3.3 Graphical Design Applications
    4. 4. Techniques
      1. 4.1 Lifecycle Projections
      2. 4.2 Diagramming Clarity
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organization and Cultural Change
    6. 6. Data Architecture Governance
      1. 6.1 Metrics
    7. 7. Works Cited / Recommended
  6. CHAPTER 5 Data Modeling and Design
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Plan for Data Modeling
      2. 2.2 Build the Data Model
      3. 2.3 Review the Data Models
      4. 2.4 Maintain the Data Models
    3. 3. Tools
      1. 3.1 Data Modeling Tools
      2. 3.2 Lineage Tools
      3. 3.3 Data Profiling Tools
      4. 3.4 Metadata Repositories
      5. 3.5 Data Model Patterns
      6. 3.6 Industry Data Models
    4. 4. Best Practices
      1. 4.1 Best Practices in Naming Conventions
      2. 4.2 Best Practices in Database Design
    5. 5. Data Model Governance
      1. 5.1 Data Model and Design Quality Management
      2. 5.2 Data Modeling Metrics
    6. 6. Works Cited / Recommended
  7. CHAPTER 6 Data Storage and Operations
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Manage Database Technology
      2. 2.2 Manage Databases
    3. 3. Tools
      1. 3.1 Data Modeling Tools
      2. 3.2 Database Monitoring Tools
      3. 3.3 Database Management Tools
      4. 3.4 Developer Support Tools
    4. 4. Techniques
      1. 4.1 Test in Lower Environments
      2. 4.2 Physical Naming Standards
      3. 4.3 Script Usage for All Changes
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organization and Cultural Change
    6. 6. Data Storage and Operations Governance
      1. 6.1 Metrics
      2. 6.2 Information Asset Tracking
      3. 6.3 Data Audits and Data Validation
    7. 7. Works Cited / Recommended
  8. CHAPTER 7 Data Security
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Identify Data Security Requirements
      2. 2.2 Define Data Security Policy
      3. 2.3 Define Data Security Standards
    3. 3. Tools
      1. 3.1 Anti-Virus Software / Security Software
      2. 3.2 HTTPS
      3. 3.3 Identity Management Technology
      4. 3.4 Intrusion Detection and Prevention Software
      5. 3.5 Firewalls (Prevention)
      6. 3.6 Metadata Tracking
      7. 3.7 Data Masking/Encryption
    4. 4. Techniques
      1. 4.1 CRUD Matrix Usage
      2. 4.2 Immediate Security Patch Deployment
      3. 4.3 Data Security Attributes in Metadata
      4. 4.4 Metrics
      5. 4.5 Security Needs in Project Requirements
      6. 4.6 Efficient Search of Encrypted Data
      7. 4.7 Document Sanitization
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organization and Cultural Change
      3. 5.3 Visibility into User Data Entitlement
      4. 5.4 Data Security in an Outsourced World
      5. 5.5 Data Security in Cloud Environments
    6. 6. Data Security Governance
      1. 6.1 Data Security and Enterprise Architecture
    7. 7. Works Cited / Recommended
  9. CHAPTER 8 Data Integration and Interoperability
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Data Integration Activities
      1. 2.1 Plan and Analyze
      2. 2.2 Design Data Integration Solutions
      3. 2.3 Develop Data Integration Solutions
      4. 2.4 Implement and Monitor
    3. 3. Tools
      1. 3.1 Data Transformation Engine/ETL Tool
      2. 3.2 Data Virtualization Server
      3. 3.3 Enterprise Service Bus
      4. 3.4 Business Rules Engine
      5. 3.5 Data and Process Modeling Tools
      6. 3.6 Data Profiling Tool
      7. 3.7 Metadata Repository
    4. 4. Techniques
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organization and Cultural Change
    6. 6. DII Governance
      1. 6.1 Data Sharing Agreements
      2. 6.2 DII and Data Lineage
      3. 6.3 Data Integration Metrics
    7. 7. Works Cited / Recommended
  10. CHAPTER 9 Document and Content Management
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Plan for Lifecycle Management
      2. 2.2 Manage the Lifecycle
      3. 2.3 Publish and Deliver Content
    3. 3. Tools
      1. 3.1 Enterprise Content Management Systems
      2. 3.2 Collaboration Tools
      3. 3.3 Controlled Vocabulary and Metadata Tools
      4. 3.4 Standard Markup and Exchange Formats
      5. 3.5 E-discovery Technology
    4. 4. Techniques
      1. 4.1 Litigation Response Playbook
      2. 4.2 Litigation Response Data Map
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organization and Cultural Change
    6. 6. Documents and Content Governance
      1. 6.1 Information Governance Frameworks
      2. 6.2 Proliferation of Information
      3. 6.3 Govern for Quality Content
      4. 6.4 Metrics
    7. 7. Works Cited / Recommended
  11. CHAPTER 10 Reference and Master Data
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 MDM Activities
      2. 2.2 Reference Data Activities
    3. 3. Tools and Techniques
    4. 4. Implementation Guidelines
      1. 4.1 Adhere to Master Data Architecture
      2. 4.2 Monitor Data Movement
      3. 4.3 Manage Reference Data Change
      4. 4.4 Data Sharing Agreements
    5. 5. Organization and Cultural Change
    6. 6. Reference and Master Data Governance
      1. 6.1 Metrics
    7. 7. Works Cited / Recommended
  12. CHAPTER 11 Data Warehousing and Business Intelligence
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Understand Requirements
      2. 2.2 Define and Maintain the DW/BI Architecture
      3. 2.3 Develop the Data Warehouse and Data Marts
      4. 2.4 Populate the Data Warehouse
      5. 2.5 Implement the Business Intelligence Portfolio
      6. 2.6 Maintain Data Products
    3. 3. Tools
      1. 3.1 Metadata Repository
      2. 3.2 Data Integration Tools
      3. 3.3 Business Intelligence Tools Types
    4. 4. Techniques
      1. 4.1 Prototypes to Drive Requirements
      2. 4.2 Self-Service BI
      3. 4.3 Audit Data that can be Queried
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Release Roadmap
      3. 5.3 Configuration Management
      4. 5.4 Organization and Cultural Change
    6. 6. DW/BI Governance
      1. 6.1 Enabling Business Acceptance
      2. 6.2 Customer / User Satisfaction
      3. 6.3 Service Level Agreements
      4. 6.4 Reporting Strategy
      5. 6.5 Metrics
    7. 7. Works Cited / Recommended
  13. CHAPTER 12 Metadata Management
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Define Metadata Strategy
      2. 2.2 Understand Metadata Requirements
      3. 2.3 Define Metadata Architecture
      4. 2.4 Create and Maintain Metadata
      5. 2.5 Query, Report, and Analyze Metadata
    3. 3. Tools
      1. 3.1 Metadata Repository Management Tools
    4. 4. Techniques
      1. 4.1 Data Lineage and Impact Analysis
      2. 4.2 Metadata for Big Data Ingest
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organizational and Cultural Change
    6. 6. Metadata Governance
      1. 6.1 Process Controls
      2. 6.2 Documentation of Metadata Solutions
      3. 6.3 Metadata Standards and Guidelines
      4. 6.4 Metrics
    7. 7. Works Cited / Recommended
  14. CHAPTER 13 Data Quality
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Define High Quality Data
      2. 2.2 Define a Data Quality Strategy
      3. 2.3 Identify Critical Data and Business Rules
      4. 2.4 Perform an Initial Data Quality Assessment
      5. 2.5 Identify and Prioritize Potential Improvements
      6. 2.6 Define Goals for Data Quality Improvement
      7. 2.7 Develop and Deploy Data Quality Operations
    3. 3. Tools
      1. 3.1 Data Profiling Tools
      2. 3.2 Data Querying Tools
      3. 3.3 Modeling and ETL Tools
      4. 3.4 Data Quality Rule Templates
      5. 3.5 Metadata Repositories
    4. 4. Techniques
      1. 4.1 Preventive Actions
      2. 4.2 Corrective Actions
      3. 4.3 Quality Check and Audit Code Modules
      4. 4.4 Effective Data Quality Metrics
      5. 4.5 Statistical Process Control
      6. 4.6 Root Cause Analysis
    5. 5. Implementation Guidelines
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organization and Cultural Change
    6. 6. Data Quality and Data Governance
      1. 6.1 Data Quality Policy
      2. 6.2 Metrics
    7. 7. Works Cited / Recommended
  15. CHAPTER 14 Big Data and Data Science
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Define Big Data Strategy and Business Needs
      2. 2.2 Choose Data Sources
      3. 2.3 Acquire and Ingest Data Sources
      4. 2.4 Develop Data Hypotheses and Methods
      5. 2.5 Integrate / Align Data for Analysis
      6. 2.6 Explore Data Using Models
      7. 2.7 Deploy and Monitor
    3. 3. Tools
      1. 3.1 MPP Shared-nothing Technologies and Architecture
      2. 3.2 Distributed File-based Databases
      3. 3.3 In-database Algorithms
      4. 3.4 Big Data Cloud Solutions
      5. 3.5 Statistical Computing and Graphical Languages
      6. 3.6 Data Visualization Tools
    4. 4. Techniques
      1. 4.1 Analytic Modeling
      2. 4.2 Big Data Modeling
    5. 5. Implementation Guidelines
      1. 5.1 Strategy Alignment
      2. 5.2 Readiness Assessment / Risk Assessment
      3. 5.3 Organization and Cultural Change
    6. 6. Big Data and Data Science Governance
      1. 6.1 Visualization Channels Management
      2. 6.2 Data Science and Visualization Standards
      3. 6.3 Data Security
      4. 6.4 Metadata
      5. 6.5 Data Quality
      6. 6.6 Metrics
    7. 7. Works Cited / Recommended
  16. CHAPTER 15 Data Management Maturity Assessment
    1. 1. Introduction
      1. 1.1 Business Drivers
      2. 1.2 Goals and Principles
      3. 1.3 Essential Concepts
    2. 2. Activities
      1. 2.1 Plan Assessment Activities
      2. 2.2 Perform Maturity Assessment
      3. 2.3 Interpret Results
      4. 2.4 Create a Targeted Program for Improvements
      5. 2.5 Re-assess Maturity
    3. 3. Tools
    4. 4. Techniques
      1. 4.1 Selecting a DMM Framework
      2. 4.2 DAMA-DMBOK Framework Use
    5. 5. Guidelines for a DMMA
      1. 5.1 Readiness Assessment / Risk Assessment
      2. 5.2 Organizational and Cultural Change
    6. 6. Maturity Management Governance
      1. 6.1 DMMA Process Oversight
      2. 6.2 Metrics
    7. 7. Works Cited / Recommended
  17. CHAPTER 16 Data Management Organization and Role Expectations
    1. 1. Introduction
    2. 2. Understand Existing Organization and Cultural Norms
    3. 3. Data Management Organizational Constructs
      1. 3.1 Decentralized Operating Model
      2. 3.2 Network Operating Model
      3. 3.3 Centralized Operating Model
      4. 3.4 Hybrid Operating Model
      5. 3.5 Federated Operating Model
      6. 3.6 Identifying the Best Model for an Organization
      7. 3.7 DMO Alternatives and Design Considerations
    4. 4. Critical Success Factors
      1. 4.1 Executive Sponsorship
      2. 4.2 Clear Vision
      3. 4.3 Proactive Change Management
      4. 4.4 Leadership Alignment
      5. 4.5 Communication
      6. 4.6 Stakeholder Engagement
      7. 4.7 Orientation and Training
      8. 4.8 Adoption Measurement
      9. 4.9 Adherence to Guiding Principles
      10. 4.10 Evolution Not Revolution
    5. 5. Build the Data Management Organization
      1. 5.1 Identify Current Data Management Participants
      2. 5.2 Identify Committee Participants
      3. 5.3 Identify and Analyze Stakeholders
      4. 5.4 Involve the Stakeholders
    6. 6. Interactions Between the DMO and Other Data-oriented Bodies
      1. 6.1 The Chief Data Officer
      2. 6.2 Data Governance
      3. 6.3 Data Quality
      4. 6.4 Enterprise Architecture
      5. 6.5 Managing a Global Organization
    7. 7. Data Management Roles
      1. 7.1 Organizational Roles
      2. 7.2 Individual Roles
    8. 8. Works Cited / Recommended
  18. CHAPTER 17 Data Management and Organizational Change Management
    1. 1. Introduction
    2. 2. Laws of Change
    3. 3. Not Managing a Change: Managing a Transition
    4. 4. Kotter’s Eight Errors of Change Management
      1. 4.1 Error #1: Allowing Too Much Complacency
      2. 4.2 Error #2: Failing to Create a Sufficiently Powerful Guiding Coalition
      3. 4.3 Error #3: Underestimating the Power of Vision
      4. 4.4 Error #4: Under Communicating the Vision by a Factor of 10, 100, or 1000
      5. 4.5 Error #5: Permitting Obstacles to Block the Vision
      6. 4.6 Error #6: Failing to Create Short-Term Wins
      7. 4.7 Error #7: Declaring Victory Too Soon
      8. 4.8 Error # 8: Neglecting to Anchor Changes Firmly in the Corporate Culture
    5. 5. Kotter’s Eight Stage Process for Major Change
      1. 5.1 Establishing a Sense of Urgency
      2. 5.2 The Guiding Coalition
      3. 5.3 Developing a Vision and Strategy
      4. 5.4 Communicating the Change Vision
    6. 6. The Formula for Change
    7. 7. Diffusion of Innovations and Sustaining Change
      1. 7.1 The Challenges to be Overcome as Innovations Spread
      2. 7.2 Key Elements in the Diffusion of Innovation
      3. 7.3 The Five Stages of Adoption
      4. 7.4 Factors Affecting Acceptance or Rejection of an Innovation or Change
    8. 8. Sustaining Change
      1. 8.1 Sense of Urgency / Dissatisfaction
      2. 8.2 Framing the Vision
      3. 8.3 The Guiding Coalition
      4. 8.4 Relative Advantage and Observability
    9. 9. Communicating Data Management Value
      1. 9.1 Communications Principles
      2. 9.2 Audience Evaluation and Preparation
      3. 9.3 The Human Element
      4. 9.4 Communication Plan
      5. 9.5 Keep Communicating
    10. 10. Works Cited / Recommended
  19. Acknowledgements
  20. Index