Oracle Data Integration: Tools for Harnessing Data

Oracle Data Integration: Tools for Harnessing Data

by Michelle Malcher, Bobby Curtis, Chris Lawless
Released November 2015
Publisher(s): McGraw Hill Computing
ISBN: 9780071841665

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Deliver continuous access to timely and accurate BI across your enterprise using the detailed information in this Oracle Press guide. Through clear explanations and practical examples, a team of Oracle experts shows how to assimilate data from disparate sources into a single, unified view. Find out how to transform data in real time, handle replication and migration, and deploy Oracle Data Integrator and Oracle GoldenGate. Oracle Data Integration: Tools for Harnessing Data offers complete coverage of the latest “big data” hardware and software solutions.

 

·       Efficiently move data both inside and outside an Oracle environment

·       Map sources to database fields using Data Merge and ETL

·       Export schema through transportable tablespaces and Oracle Data Pump

·       Capture and apply changes across heterogeneous systems with Oracle GoldenGate

·       Seamlessly exchange information between databases using Oracle Data Integrator

·       Correct errors and maximize quality through data cleansing and validation

·       Plan and execute successful Oracle Database migrations and replications

·       Handle high-volume transactions with Oracle Big Data Appliance, Oracle NoSQL, and third-party utilities

 

Table of contents

  1. Cover
  2. Title Page
  3. Copyright Page
  4. Dedication
  5. Contents at a Glance
  6. Contents
  7. Acknowledgments
  8. Introduction
  9. 1 Data Integrations Overview
    1. What Is a Data Integration?
    2. History of Data Integration
    3. Integrations Today
    4. Decision Flow Chart
    5. Tools for Harnessing Data
    6. Summary
  10. 2 Moving Data Around the Oracle Environment
    1. Structured Query Language
      1. SELECT
      2. Data Manipulation Language
      3. Data Definition Language
      4. Data Control Language
      5. SQL Summary
    2. PL/SQL
      1. Functions
      2. Procedures
      3. Packages
      4. Triggers
    3. The COPY Command
    4. SPOOL
    5. SQL*Loader
      1. Control File
      2. Dealing with the Bad File
      3. Invoking SQL*Loader
    6. External Tables
    7. Summary
  11. 3 Moving/Using Data
    1. Database Links
    2. Gateways
    3. Materialized Views
    4. Export/Import
      1. Invoking Export from the Command Line
      2. Invoking Export Interactively from the Command Line
      3. Invoking Export via Parameter Files
    5. Data Pump
    6. Transportable Tablespaces
    7. Pluggable Databases and Transport Databases
    8. Logminer
    9. Advanced Replication
    10. Oracle Streams
    11. Oracle GoldenGate
    12. XStream API
      1. XStream Out
      2. XStream In
    13. Summary
  12. 4 Oracle Replication (GoldenGate)
    1. Oracle GoldenGate Use-Cases
      1. Unidirectional Use-Case
      2. Consolidation Use-Case
      3. Data Distribution Use-Case
      4. Near-Zero-Downtime Migration
    2. Oracle GoldenGate Architecture
      1. Capture (Extract) Process
      2. Data Pump (Extract) Process
      3. Apply (Replicat) Process
      4. Trail File
    3. Transforming Data on the Fly with Oracle GoldenGate
      1. Configure DEFGEN
      2. Running DEFGEN
    4. Using Oracle GoldenGate to Create Flat Files
      1. Types of Flat Files
      2. Generating Flat Files
      3. Generating an ASCII-Formatted File
    5. Using Oracle GoldenGate to Create Native Database Loader Files
      1. Extracting for Database Utility Usage
    6. Oracle GoldenGate User Exit Functions
    7. Testing Data with Oracle GoldenGate
      1. Changing Data Using @IF
    8. Summary
  13. 5 Oracle Data Integrator
    1. Architecture
      1. Repositories
      2. Users
      3. Run-Time Agents
      4. Oracle Data Integrator Console
    2. Installation
      1. Deploying the Binaries
      2. Preparing the Repository
      3. Verifying the Repository
      4. Configuring the ODI Agent
    3. Starting Oracle Data Integrator
      1. Setting Connections
      2. Initial Connection and Wallet Configuration
    4. Configuring a Topology
      1. Physical Architecture
      2. Logical Architecture
    5. Designing Models
      1. Target Side
    6. Mappings
      1. Creating a Project
    7. Running the Mappings
      1. Simulation
      2. Step-by-Step Execution
    8. Validating That the Data Has Been Integrated
    9. Summary
  14. 6 Common Challenges
    1. Examining the Issues
      1. Design for Integrations
      2. Change
      3. Business Purpose
      4. Standardization
      5. Data Problems
      6. Synchronizing Data and Copies: Multiple Systems
      7. Latency
      8. Tool Issues
      9. Managing Mapping Tables: Metadata
      10. Testing
      11. Performance
    2. Summary
  15. 7 Data Cleansing
    1. What Is Data Cleansing?
    2. Master Data Management
      1. Process
      2. Standards
      3. Governing Data Sources
    3. Tools for Cleansing
    4. Developing Other Tools
    5. Summary
  16. 8 Big Data
    1. Oracle Big Data Appliance
      1. Cloudera
      2. Oracle NoSQL
      3. Oracle R Distribution
      4. Oracle XQuery for Hadoop
      5. Oracle Loader for Hadoop
      6. Oracle SQL Connector for Hadoop
      7. Oracle Big Data SQL
    2. Hadoop
      1. Hadoop Distributed File System
      2. MapReduce
    3. NoSQL
    4. HBase
    5. Big Data Connectors
      1. Oracle Data Integrator and Big Data
      2. Oracle GoldenGate and Big Data
    6. Summary
  17. Index

Product information

  • Title: Oracle Data Integration: Tools for Harnessing Data
  • Author(s): Michelle Malcher, Bobby Curtis, Chris Lawless
  • Release date: November 2015
  • Publisher(s): McGraw Hill Computing
  • ISBN: 9780071841665