O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Oracle Information Integration, Migration, and Consolidation

Book Description

The definitive book and eBook guide to Oracle Information Integration and Migration in a heterogeneous world

  • Learn about integration practices that many IT professionals are not familiar with
  • Evaluate and implement numerous tools like Oracle SOA Suite and Oracle GoldenGate
  • Get to grips with the past, present, and future of Oracle Integration practices
  • Ultimately meet your own business requirements with Oracle Information and application integration products

In Detail

The book covers data migration, data consolidation, and data integration, the three scenarios that are typically part of the information integration life cycle. Organizations typically find themselves migrating data to Oracle and either later, or at the same time, consolidating multiple database instances into a single global instance for a department, or even an entire company. The business savings and technical benefits of data consolidation cannot be overlooked, and this book will help you to use Oracle's technology to achieve these goals.

In this book, you will gain hands-on advice about data consolidation, integration, and migration using tools and best practices. Along the way you will leverage products like Oracle Data Integrator, Oracle GoldenGate, and SQL Developer, as well as Data Hubs and 11gR2 Database.

The book covers everything from the early background of information integration and the impact of SOA, to products like Oracle GoldenGate and Oracle Data Integrator. By the end you'll have a clear idea of where information and application integration is headed and how to plan your own projects.

Use Oracle technologies and best practices to manage, maintain, migrate, and mobilize data

Table of Contents

  1. Oracle Information Integration, Migration, and Consolidation
    1. Table of Contents
    2. Oracle Information Integration, Migration, and Consolidation
    3. Credits
    4. About The Author
    5. About the Contributing Authors
    6. About the Reviewers
    7. www.PacktPub.com
      1. Support files, eBooks, discount offers and more
        1. Why Subscribe?
        2. Free Access for Packt account holders
        3. Instant Updates on New Packt Books
    8. Preface
      1. What this book covers
      2. Who this book is written for
      3. Conventions
      4. Reader feedback
      5. Customer support
        1. Errata
        2. Piracy
        3. Questions
    9. 1. Getting Started with Information Integration
      1. Why consider information integration?
      2. Business challenges in data integration and migration
      3. Technical challenges of information integration
      4. General approaches to information integration and migration
        1. Data integration
        2. Data migration
          1. Architectures: federated versus shared
          2. Data sharing integration
          3. Considerations when choosing an integration approach
      5. Integration and SOA, bringing it together
        1. Architected for the Internet
        2. Scalability
        3. Availability
        4. Greater software options
        5. On-demand reporting
        6. Security
        7. Overcoming barriers to change
        8. Custom integration applications and utilities
        9. Custom workflow
      6. The real world: studies in integration
        1. Banking case
        2. Education case
        3. High technology case
      7. Summary
    10. 2. Oracle Tools and Products
      1. Database migration products and tools
        1. SQL Loader
        2. Oracle external tables
        3. Oracle Warehouse Builder
        4. SQL Developer Migration Workbench
        5. Oracle Data Integrator
        6. Oracle Enterprise Manager tuning and diagnostic packs
      2. Physical federation products
        1. Oracle Data Integrator
        2. Oracle GoldenGate
        3. Oracle CDC adapters
        4. Oracle Master Data Management
        5. Oracle Data Quality and Profiling
      3. Virtual federation products
        1. Oracle Gateways and Heterogeneous Services
        2. Oracle Business Intelligence Suite
        3. Oracle SOA adapters
        4. Oracle Web Center and Portal
        5. Oracle Business Activity Monitoring
      4. Data services
        1. Oracle Data Integration Suite
      5. Data consolidation
        1. Oracle Exadata
      6. Data grid
        1. Oracle Coherence
        2. Oracle TimesTen
        3. Oracle Exalogic
      7. Information Lifecycle Management
        1. Oracle Information Lifecycle Management
      8. Oracle-to-Oracle
        1. Oracle Streams
        2. Oracle Data Pump
        3. Oracle XStream
      9. Application integration
        1. Oracle SOA Suite
        2. Oracle Advanced Queuing
        3. Oracle Application Information Architecture
      10. Products matrix summary
      11. Products not covered
      12. Summary
    11. 3. Application and Data Integration Case Study
      1. What is the POV?
        1. Solving a business problem
        2. Estimated level of effort
      2. Software and hardware requirements
        1. Software
        2. Hardware and network
      3. Original architecture — nightly batch process
        1. Batch cycle diagram — technical architecture
      4. Functional specifications
        1. Functional design diagram
      5. Technical specifications
        1. Technical specifications diagram
      6. Assumptions, out of scope, and success criteria
        1. Assumptions
        2. Out of scope
        3. Success criteria
      7. Technical implementation details
        1. Reading from the Oracle Database
        2. Writing to flat files
        3. Executing the z/OS COBOL module
        4. Reading from VSAM files
        5. Writing to IBM MQSeries
        6. BPEL process
        7. Security
      8. Actual level of effort and outcome
      9. Challenges and lessons learned
      10. Cultural change in technology organizations
      11. Next steps
      12. Summary
    12. 4. Oracle Database Migrations
      1. Database migration scenarios
        1. Migrating an Oracle database from one platform to another
        2. Migrating relational databases to Oracle
      2. Using Oracle SQL Developer Version 3.0 for migrations to Oracle
        1. Prerequisites for using SQL Developer
        2. Creating a migration repository
          1. JDBC Drivers setup
          2. Creating a connection for a privileged database user in Oracle using SQL Developer
          3. Creating a directory for a migration project
      3. Migration process using SQL Developer
        1. Migration steps in SQL Developer
      4. Selection of the database connection for the repository
        1. Project creation
        2. Gathering source database metadata
          1. Online capture
          2. Offline mode
        3. Convert the captured database model to an Oracle model
        4. Target Oracle schema generation
        5. Data migration
      5. Enabling a factory approach to database migrations using SQL Developer
      6. Data migration using Oracle SQL*Loader/External tables
        1. Using Oracle SQL*Loader
          1. Using Oracle External Table
        2. Using Oracle Data Integrator (ODI) for data migration
        3. Production rollout using Oracle GoldenGate
      7. Impact of database migrations on applications
      8. Summary
    13. 5. Database Migration Challenges and Solutions
      1. Database schema migration challenges
        1. Database object naming/definition issues
          1. Use of special characters in object names
          2. Use of reserved words in object names and their definitions
          3. Use of case-sensitive object names
          4. Length of object names
        2. Data type conversion issues
          1. Numeric data
          2. Identity columns
          3. Date/timestamp data
        3. User-defined data types
          1. Database feature mapping
          2. Clustered indexes
            1. Database schema layout
            2. Empty strings and NULL value handling
            3. Data case-sensitivity
            4. EBCDIC/ASCII conversions
            5. Globalization
      2. Database migration case studies
        1. Case Study #1: DB2/400 migration to Oracle using Oracle DRDA Gateway for DB2
        2. Case Study #2: Sybase migration to Oracle
        3. Case Study #3: Mainframe data migration/archiving from various databases such as DB2, IDMS, and VSAM
      3. Summary
    14. 6. Data Consolidation and Management
      1. What is enterprise data?
        1. Transactional data
        2. Analytical data
        3. Master data
        4. Enterprise data hub
      2. Oracle Master Data Management
        1. Oracle Customer Hub
        2. Oracle Product Hub
        3. Oracle Supplier Hub
          1. Oracle Supplier Hub capabilities
        4. Oracle Site Hub
      3. Oracle RAC
      4. Data grids using Oracle caching
        1. Database-centric — TimesTen
        2. Application-centric — Coherence
      5. Oracle as a service
        1. Reasons to consider Consolidation
      6. Information Lifecycle Management
        1. Active data archiving
        2. Passive data archiving
      7. Oracle Exadata
      8. Data management at IHOP, a case study
      9. Summary
    15. 7. Database-centric Data Integration
      1. Oracle GoldenGate
        1. Configuring GoldenGate for IBM DB2 to Oracle data replication
          1. Prerequisites
      2. Configuration overview
        1. On the Oracle database server (target)
      3. Oracle Database Gateways
        1. Oracle heterogeneous connectivity solution architecture
          1. Heterogeneous Services
          2. Database Gateways (Heterogeneous Services agent)
        2. Overview of Database Gateway installation and configuration
      4. Oracle Data Integrator
        1. ODI repositories
        2. ODI Studio
        3. ODI runtime agent
        4. ODI console
      5. Data management case study
        1. Company overview
        2. Company challenges
        3. Overstock.com's value proposition
        4. Integration framework
      6. Summary
    16. 8. Application and Process Integration
      1. History of application integration
        1. Point-to-Point API-based integration
        2. EDI
        3. Message and integration brokers
        4. XML over HTTP or FTP
      2. History of Oracle integration products
        1. Oracle InterConnect
        2. Oracle ProcessConnect
        3. Oracle Enterprise Service Bus
        4. Oracle Workflow - process integration
      3. Oracle commercial off-the-shelf (COTS) application integration history
      4. Oracle application and process integration software stack
        1. Oracle Business Process Analysis
      5. Oracle Business Process Management
        1. SOA Adapters
        2. Oracle Business Rules
        3. Oracle BPEL
        4. Oracle Service Bus
        5. Oracle Complex Events Processing (CEP)
        6. Oracle Business-to-Business (B2B)
        7. Oracle Service Component Architecture (SCA)
        8. Oracle Web Services Registry
        9. Oracle Web Services Manager
        10. Metadata Services (MDS)
        11. AIA — Going beyond the Oracle SOA Suite
        12. AIA — fundamentals
          1. Enterprise Business Objects
          2. Enterprise Business Messages
          3. Enterprise Business Service
          4. Enterprise Business Flow
          5. Application Business Connector Service
          6. Tools — development environment
          7. Oracle AIA Foundation and Process Integration Packs
        13. Oracle JDeveloper
        14. Eclipse
      6. Oracle SOA Suite integration best practices
      7. Oracle success stories
        1. Success one — Saleforce.com and Oracle E-Business Suite
          1. Solution
          2. Benefits
        2. Success two — cross-industry Oracle eAM print solution
          1. Solution
          2. Benefits
      8. Summary
    17. 9. Information Lifecycle Management for Transactional Applications
      1. Data growth challenges
      2. How enterprises try to solve data growth issues
        1. Hardware refresh
        2. SQL/DB tuning
        3. Delete historical data
      3. What is Information Lifecycle Management?
      4. What benefits can ILM offer?
        1. Active Application Archiving
        2. Application Retirement
      5. Start with Application Portfolio Management
      6. Application Retirement solution from Solix Technologies and Oracle partner
      7. Summary
    18. A. Appendix
      1. Cloud integration
      2. Implications of web services for all Integration
      3. Data, process, and application integration convergence
      4. Job scheduling, ETL/ELT and BPEL product convergence
      5. Middle tier integration appliances
      6. Security
      7. Mobile data and collective intelligence
      8. Summary
    19. Index