book

Oracle Streams 11g Data Replication

Name: Oracle Streams 11g Data Replication
Author: Kirtikumar Deshpande
ISBN: 9780071759120

by Kirtikumar Deshpande

December 2010

Beginner to intermediate

576 pages

13h 6m

English

McGraw Hill Computing

Read now

Unlock full access

Cover Page
Oracle Streams 11g Data Replication
Copyright Page
Dedication
Contents
Acknowledgments
Introduction
Part I Introduction to Oracle Streams
1 What Is Oracle Streams
Information Flow in Oracle StreamsArchitectural Overview of Oracle StreamsCaptureStaging and PropagationConsumptionQueuesStreams TagRules and Rule SetsInstantiationLogMiner Data DictionaryStreams Data DictionaryNOLOGGING and UNRECOVERABLE OperationsSupplemental LoggingLogical Change RecordsTable Data ComparisonSummary
2 Using Oracle Streams
Data ReplicationUnidirectional (One-Way) ReplicationBidirectional ReplicationN-Way (Peer-to-Peer) ReplicationHub-and-Spoke ReplicationReplication with Non-Oracle DatabasesData Warehouse LoadingData AuditingData ProtectionMessage QueuingMinimizing Downtime During Database UpgradesMinimizing Downtime During Maintenance TasksSummary

Part II Oracle Streams Concepts and Architecture
3 Streams Rules and Rule Sets
RulesEvaluation ContextRule ConditionAction ContextRule SetsPositive Rule SetNegative Rule SetCreating Rules and Rule SetsSystem-Created Rules and Rule SetsUser-Created Rules and Rule SetsRule Condition for Discarding Unsupported LCRsProcedures to Manage Rules and Rule SetsSummary
4 Capture Process
Capture Process TypesLocal Capture ProcessDownstream Capture ProcessCapture Process Checkpoints and System Change NumbersRequired Checkpoint SCNMaximum Checkpoint SCNFirst SCNStart SCNCaptured SCNLast Enqueued SCNApplied SCNSource Reset Logs SCNCheckpoint Retention TimeCreating the Capture ProcessCreate the Local Capture ProcessCreate the Downstream Capture ProcessCreate the Synchronous Capture ProcessThe Capture UserCapture Process ComponentsCapture Process ParametersChanging Capture Process ParametersWhat Changes Are Not Captured?Changes Not Captured by the Capture ProcessChanges Not Captured by the Synchronous Capture ProcessHow to Check for Unsupported ObjectsNOLOGGING OperationsSupplemental LoggingWhat Needs Supplemental LoggingTypes of Supplemental LoggingSystem-Created Supplemental Log GroupsSummary
5 Staging and Propagation Process
Queue ModelsQueue TypesTyped Queue of ANYDATA TypeBuffered QueuePersistent QueueSecure QueueTransactional QueueNontransactional QueueCommit-Time QueueHow Streams Clients Use Queues1Creating a Streams QueueQueues and Real Application ClustersPropagationQueue-to-Database Link PropagationQueue-to-Queue PropagationDirected NetworksCreating the Propagation ProcessPropagation Rule Set and RulesPropagation Job and ScheduleCombined Capture and ApplySummary
6 Apply Process
Overview of the Apply ProcessApply Process StatesApply Process ComponentsReader ServerCoordinator ProcessServer ProcessApply UserCreating the Apply ProcessAutomatic Apply Process CreationManual Apply Process CreationApply Process ParametersHandling TriggersHandling Column DiscrepanciesData Type MismatchFewer Columns at DestinationMore Columns at DestinationColumn Name MismatchNo Primary Key or Unique KeyHandling Transaction DependenciesObject DependencyValue DependencyMessage Processing by the Apply ProcessDML HandlerDDL HandleError HandlerPrecommit HandlerWhat Changes Are Not Applied?Summary
7 Logical Change Records
Row LCRsDDL LCRsExtra Attributes in LCRsAccessing LCR ContentsAccessing Row LCR ContentsAccessing DDL LCR ContentsModifying LCR ContentModifying Row LCR ContentsModifying DDL LCR ContentsLCRs and LOB Data TypesSummary
Part III Oracle Streams Configuration
8 Configuring Oracle Streams for Data Replication
Streams Configuration MethodsPrerequisite TasksPrepare the DatabasesCreate Network Connectivity Between DatabasesCreate the Streams Administrator AccounCreate Database LinksCreate Directory ObjectsStreams Configuration Using MAINTAIN ProceduresStreams Replication at the Database LevelStreams Replication at the Schema LevelStreams Replication at the Table LevelStreams Replication at the Tablespace LevelConfiguring the Downstream Capture Process Using MAINTAIN ProceduresMonitoring the Progress of MAINTAIN ProceduresRecovering from an Error in MAINTAIN ProceduresAdvantages of MAINTAIN ProceduresLimitations of MAINTAIN ProceduresStreams Configuration Using Custom ScriptsUnidirectional Replication with the Local Capture ProcessUnidirectional Replication with the Downstream Capture ProcessBidirectional ReplicationReplication from a Single Source to Multiple DestinationsReplication Using Queue ForwardingReplication Using Apply ForwardingReplication Using the Synchronous Capture ProcessHub-and-Spoke ReplicationN-Way Replication (Multimaster)Summary
9 Data Transformations
Types of Rule-Based TransformationsDeclarative Rule-Based TransformationsCustom Rule-Based TransformationsWhere to Use Rule-Based TransformationsFinding the Rule NameConfiguring Declarative Rule-Based TransformationsAdd Column ProcedureDelete Column ProcedureKeep Columns ProcedureRename Column ProcedureRename Schema ProcedureRename Table ProcedureRule-Based Transformations and DDL ReplicationConfiguring Custom Rule-Based TransformationsCustom Rule-Based Transformation for DDL LCRsCustom Rule-Based Transformation for Row LCRsRemoving Rule-Based TransformationsRemoving Declarative Rule-Based TransformationsRemoving Custom Rule-Based TransformationsTable Subset Rule TransformationsTransformation Execution OrderSummary
10 Handling Data Conflicts
Type of ConflictsDelete ConflictsUpdate ConflictsUniqueness ConflictsForeign Key ConflictsHow to Avoid ConflictsAvoiding Uniqueness ConflictsAvoiding Delete ConflictsAvoiding Update ConflictsResolving ConflictsUsing the Prebuilt Update Conflict HandlerUsing Column ListsUsing Resolution ColumnSetting Up the Prebuilt Update Conflict HandlerListing Defined Update Conflict HandlersModifying Update Conflict HandlerRemoving Update Conflict HandlersStopping Conflict Detection for Non-Key ColumnsCustom Conflict HandlersSummary
Part IV Oracle Streams Management
11 Managing and Monitoring Streams Replication
Managing Streams ProcessesManaging the Capture ProcessManaging the Synchronous Capture ProcessManaging the Propagation ProcessManaging the Apply ProcessMonitoring Streams ProcessesMonitoring the Capture ProcessMonitoring the Propagation Process and QueuesMonitoring the Apply ProcessMonitoring TransactionsMonitoring the Alert Log FileSplit and Merge: Managing and MonitoringAutomatic Split and MergeManual Split and MergeStreams Performance AdvisorSummary
12 Maintenance and Troubleshooting
Expanding the Streams EnvironmentAdding Objects to the Exiting Streams EnvironmentAdding a Database to the Existing Streams EnvironmentRemoving Streams ConfigurationRemoving Entire Streams ConfigurationRemoving Specific Streams ConfigurationTroubleshooting Streams ProcessesCapture Process TroubleshootingPropagation Process TroubleshootingApply Process TroubleshootingStreams Message TrackingStreams Health Check ReportData Comparison and ConvergenceCreating the ComparisonRunning the ComparisonListing the ComparisonConverging from the Local Table to the RemoteTableRechecking the ComparisonPurging the ComparisonDropping the ComparisonSummary
13 Streams Performance Considerations
Streams Queue SpillingApply SpillingHandling Large TransactionsStreams TagProcedural ReplicationHandling Long-Running TransactionsLog Mining ActivityCapture Process ConsiderationsParallelismCheckpoint InformationPropagation Process ConsiderationsApply Process ConsiderationsTuning Apply Process ParametersHandling LOB Data TypesApply Rule SetDetecting ConflictsBug FixesSummary
14 Oracle Enterprise Manager Grid Control for Streams Replication
Streams Configuration WizardsCreating Schema-Level ReplicationStep 1: Object SelectionStep 2: Destination OptionsStep 3: Replication OptionsStep 4: Schedule JobStep 5: ReviewMonitoring and Managing the Streams Replication EnvironmentMonitoring the Capture ProcessMonitoring the Propagation ProcessMonitoring the Apply ProcessDisplaying Transaction Details: LogMiner SessionDisplaying Overview of Streams ComponentsDisplaying Streams Paths and Performance Analysis DataManaging Streams ProcessesManaging Apply ErrorsStreams Metrics and AlertsSummary
Part V Appendixes
A Oracle Streams Best Practices
Oracle PatchesARCHIVELOG Mode and Archived Log FilesTablespace for StreamsStreams Administrator User AccountStreams Administrator PrivilegesDatabase Initialization ParametersDatabase LinksNetwork TuningOperating System ParametersNetwork Device Queue SizeOracle Net ParametersHeartbeat TableDDL ReplicationEstablish Performance Goals
B Oracle Streams Replication in a RAC Environment
Archived LogsStreams QueuesQueue-to-Queue PropagationChecking Queue Table and Streams Process LocationsCreating Standby Redo Log Groups for Downstream Capture
C Streams Health Check Report
How to Run the Streams Health Check ScriptWhen to Run the Streams Health Check ScriptHow to Use the Health Check ReportConfigurationAnalysisStatisticsOther Information
D Data Dictionary Views for Streams Replication
Views for Configuration and Administrative TasksViews for Capture ProcessViews for Apply ProcessViews for Propagation ProcessViews for Rules and Rule SetsViews for InstantiationViews for Supplemental LoggingViews for HandlersViews for Conflict HandlersViews for TransformationsViews for LogMinerViews for Archived Log/Redo Log FilesView for TransactionsViews for Queues and Queue Table
E References
Index

Content preview from Oracle Streams 11g Data Replication

CHAPTER 9Data Transformations

One of the strongest features of Oracle Streams replication is data transformation. The contents in the Logical Change Record (LCR) can be modified as it flows through the replication process. The transformation of the data is done in the LCRs. Oracle calls such modifications rule-based transformations because they are performed after the rule evaluates to TRUE.

Such transformations are required when the source and destination objects are not identical but data must be replicated. For example, the destination table name may not be the same, the schema name may not be the same, some of the columns in source tables may not exist or may not have the same data type at the destination, and so forth. In such cases, the ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9780071496643

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills