Oracle Data Integrator 11g Cookbook

Oracle Data Integrator 11g Cookbook

by Christophe Dupupet, Denis Gray, Peter C. Boyd-Bowman, Julien Testut
Released May 2013
Publisher(s): Packt Publishing
ISBN: 9781849681742

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This book is all you need to take your understanding of Oracle Data Integrator to the next level. From initial deployment right through to esoteric techniques, the task-based approach will enhance your expertise effortlessly.

  • Clear, step-by-step recipes to walk you through some of the most advanced features of Oracle Data Integrator
  • Covers everything from administration, to development, to deployment, including advanced coding techniques using the Oracle Data Integrator SDK
  • Numerous code samples, screenshots, diagrams, and best practice recommendations

In Detail

Oracle Data Integrator (ODI) is Oracle's strategic data integration platform for high-speed data transformation and movement between different systems. From high-volume batches, to SOA-enabled data services, to trickle operations, ODI is a cutting-edge platform that offers heterogeneous connectivity, enterprise-level deployment, and strong administrative, diagnostic, and management capabilities.

"Oracle Data Integrator 11g Cookbook" will take you on a journey past your first steps with ODI to a new level of proficiency, lifting the cover on many of the internals of the product to help you better leverage the most advanced features.

The first part of this book will focus on the administrative tasks required for a successful deployment, moving on to showing you how to best leverage Knowledge Modules with explanations of their internals and focus on specific examples. Next we will look into some advanced coding techniques for interfaces, packages, models, and a focus on XML. Finally the book will lift the cover on web services as well as the ODI SDK, along with additional advanced techniques that may be unknown to many users.

Throughout "Oracle Data Integrator 11g Cookbook", the authors convey real-world advice and best practices learned from their extensive hands-on experience.

Table of contents

  1. Oracle Data Integrator 11g Cookbook
    1. Table of Contents
    2. Oracle Data Integrator 11g Cookbook
    3. Credits
    4. Foreword
    5. About the Authors
    6. About the Reviewers
    7. www.PacktPub.com
      1. Support files, eBooks, discount offers and more
        1. Why Subscribe?
        2. Free Access for Packt account holders
        3. Instant Updates on New Packt Books
    8. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Downloading the example code
        2. Errata
        3. Piracy
        4. Questions
    9. 1. Installation, Deployment, and Configuration
      1. Introduction
        1. Understanding the ODI Installation
      2. Deploying and configuring a standalone agent manually
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      3. Deploying a JEE ODI Agent
        1. How to do it...
        2. How it works...
        3. There's more...
      4. Configuring a standalone agent with OPMN
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Deploying JDBC drivers with a JEE ODI Agent
        1. Getting ready
        2. How to do it…
        3. There's more...
    10. 2. Defining the Oracle Data Integrator Security
      1. Introduction
      2. Setting up LDAP security for Oracle Data Integrator
        1. How to do it...
        2. How it works...
      3. Setting external authentication with Oracle Data Integrator
        1. How to do it...
        2. How it works...
        3. There's more...
      4. Creating users using generic profiles
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See also
      5. Creating users using non-generic profiles
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      6. Creating new custom profiles in the Security navigator
        1. Getting ready
        2. How to do it...
        3. How it works...
    11. 3. Advanced Topology
      1. Introduction
      2. Creating a new technology
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      3. Modifying actions to get more from your diagrams
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Modifying and expanding datatypes
        1. Getting ready
        2. How to do it...
        3. How it works...
      5. Changing the case sensitivity for code generation
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There is more...
      6. Best practice – using the Staging Area User to access your target schema
        1. Getting ready
        2. How to do it...
        3. How it works...
    12. 4. Using Variables
      1. Introduction
      2. Passing start-up parameters to a scenario using variables
        1. Getting ready
        2. How to do it...
        3. How it works...
      3. Using table names that run in all contexts using getObjectName
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Using variables to filter data based on a timestamp
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Using variables in KM options (and reusing the variables in an interface, package, and so on)
        1. How to do it...
        2. How it works...
        3. There's more...
      6. Using variables in topology
        1. How to do it...
        2. How it works...
      7. Using variables to control loops inside packages
        1. Getting ready...
        2. How to do it...
        3. How it works...
        4. There's more...
    13. 5. Knowledge Module Internals
      1. Introduction
      2. Using the substitution passes
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      3. Using Java variables in KMs
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Using Java for condition code generation
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Invoking Java from the KMs
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      6. Using substitution methods in Java
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      7. Combining substitution methods in a KM
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
    14. 6. Inside Knowledge Modules – SCD and CDC
      1. Introduction
      2. Implementing Slowly Changing Dimensions (SCD) using ODI
        1. Getting ready
        2. How to do it...
        3. How it works...
      3. Modifying a Slowly Changing Dimension KM to allow undefined behaviors
        1. Getting ready
        2. How to do it...
        3. How it works...
      4. Using Changed Data Capture (CDC) - simple
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Using Changed Data Capture (CDC) - consistent set
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      6. Using one single interface to load changes that occur in any dimensions
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more…
    15. 7. Advanced Coding Techniques
      1. Introduction
      2. Using diagrams to develop and maintain models
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      3. Generating DDL from data models
        1. Getting ready
        2. How to do it...
        3. How it works...
      4. Generating interfaces from data models or diagrams
        1. Getting ready
        2. How to do it...
        3. How it works...
      5. Creating a temporary interface (subquery)
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      6. Loading data from an SQL query
        1. Getting ready
        2. How to do it...
        3. How it works...
      7. Performing a pivot
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      8. Loading data using partition exchange
        1. Getting ready
        2. How to do it...
        3. How it works...
    16. 8. Package Loops and File Processing
      1. Introduction
      2. Defining packages and loops for near real-time execution using a hybrid loop
        1. Getting ready
        2. How to do it...
        3. How it works...
      3. Using a file from a parameter variable
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Detecting files with a variable name
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Processing all files in a directory
        1. Getting ready
        2. How to do it...
        3. How it works...
      6. Processing a large number of files in parallel
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
    17. 9. XML and Web Services
      1. Introduction
      2. Defining a connection to XML within ODI
        1. How to do it...
        2. How it works...
        3. There's more...
      3. Processing complex files with ODI
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Processing XML data within an RDBMS not in memory
        1. How to do it...
        2. How it works...
        3. There's more...
      5. Invoking web services from ODI
        1. How to do it...
        2. How it works...
        3. There's more...
      6. Invoking asynchronous ODI web services with callbacks
        1. How to do it...
        2. How it works...
      7. Configuring container-based authentication with ODI web services
        1. How to do it...
        2. How it works...
    18. 10. Advanced Coding Techniques Using the ODI SDK
      1. Introduction
      2. Creating the Master and Work repositories using the SDK
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      3. Creating a project using the SDK
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Automating the import of artifacts using the SDK
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Creating models and datastores using the SDK
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There is more…
      6. Creating an interface using the SDK
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
        5. See Also
      7. Invoking and monitoring a scenario using the SDK
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
    19. 11. More on ODI
      1. Introduction
      2. Invoking an external program that requires a password
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      3. Tuning a standalone ODI agent
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      4. Loading a file containing a LOB
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      5. Using ODI versioning
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      6. Performing a Smart Export/Smart Import
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      7. Accessing an Excel spreadsheet
        1. Getting ready…
        2. How to do it...
        3. How it works...
        4. There's more...
      8. Impacting the data flow by changing the staging area location
        1. Getting ready
        2. How to do it...
        3. How it works...
        4. There's more...
      9. Automating Smart Export/Smart Import with the ODI SDK
        1. How to do it...
        2. How it works...
        3. There's more...
    20. Index

Product information

  • Title: Oracle Data Integrator 11g Cookbook
  • Author(s): Christophe Dupupet, Denis Gray, Peter C. Boyd-Bowman, Julien Testut
  • Release date: May 2013
  • Publisher(s): Packt Publishing
  • ISBN: 9781849681742