Oracle GoldenGate 12c Implementer's Guide

Oracle GoldenGate 12c Implementer's Guide

by John P Jeffries
Released July 2015
Publisher(s): Packt Publishing
ISBN: 9781785280474

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Leverage the power of real-time data access for designing, building, and tuning your GoldenGate Enterprise

In Detail

GoldenGate exchanges data among systems in a timely manner and meets the demand for real-time access to information regardless of volume. The new release, 12c, includes an optimized database, intelligent and integrated delivery capabilities, expanded heterogeneity, and tighter security. Perform zero downtime data migration to on-premise or public cloud with GoldenGate's feature-rich portfolio.

Start with the installation and learn the design concepts and enhanced configuration of GoldenGate 12c. Exploit new 12c features to successfully implement GoldenGate on your enterprise. Dive deep into configuring GoldenGate for high availability, DDL support, and reverse processing. Build fast, secure, robust, scalable technical solutions by tuning data delivery and networks. Finally, enrich your data replication knowledge by learning the troubleshooting tips.

What You Will Learn

  • Extend GoldenGate's out-of-the-box functionality to employ its rich features and meet your business objectives
  • Deliver best-in-class data integration solutions by integrating GoldenGate with other Oracle products
  • Deploy data integration solutions effectively to lower your total cost of ownership and increase you ROI
  • Extend GoldenGate functionality through APIs and reduce your IT operational expenditure
  • Leverage the designs to build efficient, cost effective data integration solutions
  • Enhance system management and monitoring in your GoldenGate environment
  • Generate real-time statistics to gauge data throughput and performance
  • Evaluate data integration concepts through Oracle's new Integration Cloud Service offering

Table of contents

  1. Oracle GoldenGate 12c Implementer's Guide
    1. Table of Contents
    2. Oracle GoldenGate 12c Implementer's Guide
    3. Credits
    4. About the Author
    5. About the Reviewers
    6. www.PacktPub.com
      1. Support files, eBooks, discount offers, and more
        1. Why subscribe?
        2. Free access for Packt account holders
        3. Instant updates on new Packt books
    7. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Downloading the example code
        2. Errata
        3. Piracy
        4. Questions
    8. 1. Getting Started
      1. What is GoldenGate?
      2. Oracle GoldenGate evolution
      3. Oracle GoldenGate solutions
      4. Oracle GoldenGate technology overview
        1. Extract – the capture process
        2. Trail files
        3. Data pump
        4. Server collector
        5. Replicat – the apply process
        6. The Manager process
        7. GGSCI
        8. Process data flow
      5. Oracle GoldenGate architecture
        1. Classic configurations
          1. One-to-one architecture
          2. One-to-many architecture
          3. Many-to-one architecture
          4. Cascading
          5. Bidirectional – active-active
          6. Bidirectional – active-passive
        2. New configurations
          1. Oracle Data Integrator
          2. Oracle Big Data
      6. 12c new features
        1. Integrated capture
        2. Integrated Replicat
        3. Downstream capture
        4. Installation
          1. Upgrading to 12c
        5. Multitenant database replication
        6. Coordinated Delivery
        7. Enhanced event-based processing
        8. Enhanced security
        9. Conflict Detection and Resolution
        10. Dynamic Rollback
        11. Streams to GoldenGate migration
        12. Improved management and monitoring
          1. Oracle Management Pack
          2. Oracle GoldenGate Veridata
      7. Supported platforms and databases
      8. Oracle GoldenGate topology
        1. Process topology
          1. The rules
          2. Position
          3. Statistics
      9. Design considerations
        1. Choosing a solution
        2. Network
        3. Database schema
      10. What to replicate?
        1. Object mapping and data selection
        2. Initial load
        3. CSN coordination
        4. Trail file format
      11. Summary
    9. 2. Installing and Preparing GoldenGate
      1. Prerequisites
        1. The GoldenGate certification matrix
        2. Downloading the software
        3. Software requirements
        4. Hardware requirements
          1. Memory
          2. CPU
          3. Network
          4. Disk
      2. The Oracle virtual machine
      3. The software installation
        1. Installing GoldenGate using the OUI
          1. Unpacking the media
          2. Enabling the X server
          3. Running the installer
        2. Performing a silent installation
        3. The subdirectories
          1. br
          2. dircrd
          3. dirchk
          4. dirdat
          5. dirdef
          6. dirpcs
          7. dirprm
          8. dirrpt
          9. dirsql
          10. dirtmp
          11. dirwlt
      4. Preparing the environment
        1. Preparing the 12c container database for data replication
          1. Enabling archive log mode
          2. Enabling supplemental logging
          3. Creating GoldenGate admin user
          4. Enabling the Flashback Query
          5. Enabling transaction data capture
        2. Preparing the 11g database for replication
          1. Enabling the archive log mode
          2. Creating the GoldenGate admin user
          3. Enabling the transaction data capture
        3. Preparing the operating system
      5. Creating the initial configuration
        1. Configuring the Manager process
        2. The capture process
          1. Creating the capture process
          2. Registering the capture process in a 12c container database
          3. Registering the capture process in a 11g database
          4. The data pump process
          5. Starting the capture process
        3. The apply process
          1. Creating the GoldenGate admin user on the target database
          2. Registering the Replicat process in the target database
          3. Creating and starting the apply process
        4. The configuration summary
      6. Patching the GoldenGate home
      7. GoldenGate deinstallation from Linux/Unix
      8. Summary
    10. 3. Design Considerations
      1. Replication methods
        1. Active-active replication
        2. Active-passive replication
        3. Cascading
        4. Downstream capture
        5. Extract Load and Transform (E-LT)
      2. Networking
        1. Surviving network outages
          1. Redundant networks
            1. NIC teaming
      3. Non-functional requirements
        1. Performance
        2. Availability
        3. Security
        4. Backup and recovery
        5. Support
      4. Hardware considerations
        1. Computing architectures
          1. Grid computing
          2. Single server
          3. Clusters
          4. Cloud computing
        2. Machines
          1. The x86-64 Linux server
          2. The database machine
          3. Scaling up and out
      5. Changed data management
        1. Integrated capture and delivery
        2. Classic mode
        3. Coordinated mode
        4. DDL replication
      6. Changed data recovery
        1. Point-in-time recovery (PITR)
          1. Oracle Recovery Manager (RMAN)
          2. Flashback
          3. SAN Snapshot
      7. Summary
    11. 4. Configuring Oracle GoldenGate
      1. GoldenGate parameters
      2. The GoldenGate instantiation
        1. Choosing an instantiation method
          1. File to Replicat
            1. Extract parameters
            2. Replicat parameters
          2. File to Database Utility
            1. Extract parameters
            2. Replicat parameters
          3. Direct Load
            1. Extract parameters
            2. Replicat parameters
          4. Direct Bulk Load
            1. Extract parameters
            2. Replicat parameters
      3. Performing the initial load
        1. The example architecture
        2. Direct Load instantiation
          1. Configuring initial data capture
      4. Configuring change data capture
        1. The configuration summary
        2. Creating the configuration for multitenant databases
        3. Creating the configuration for nonCDB databases
      5. Configuring change delivery
      6. Testing change data capture and delivery
      7. Stopping GoldenGate processes
      8. More about trail files
        1. The trail
        2. Trail file purging
      9. Configuring Oracle Manager process
      10. Configuring the downstream mining database
        1. Preparing the source database
        2. Preparing the target database
        3. The GoldenGate configuration
      11. Summary
    12. 5. Configuration Options
      1. Using BATCHSQL
        1. The SQL cache
        2. Exceptions
        3. When to use BATCHSQL
      2. Data compression
        1. Compressing the data stream
          1. The COMPRESS option
        2. The Oracle table compression
      3. Security features
        1. The wallet method
        2. The ENCKEYS method
        3. The data encryption
          1. The message encryption
          2. The trail file encryption
        4. The password encryption
          1. The default method
          2. The named method
          3. The Credential Store
      4. Event-based processing
        1. The Event Marker System
          1. Triggering Event Actions
          2. Using Event Actions to improve batch performance
      5. Bidirectional configuration options
        1. The loop detection
        2. Conflict Detection and Resolution in bidirectional environment
          1. CDR reporting
        3. Exception handling
        4. Oracle sequences
        5. Oracle triggers
      6. The DDL support
        1. The DDL replication
        2. The DDL configuration
          1. Filtering
          2. Mapping options
          3. The DDLOPTIONS parameter
        3. Using DUMPDDL
        4. Using LogMiner
      7. Heterogeneous environments
        1. Microsoft SQL Server
        2. IBM DB2
        3. The DEFGEN utility
      8. Oracle Streams to GoldenGate Migration
      9. Summary
    13. 6. Configuring GoldenGate for HA
      1. GoldenGate on RAC
        1. Shared Storage
          1. ACFS
          2. DBFS
          3. OCFS
        2. Configuring GoldenGate on RAC
        3. Configuring Grid Infrastructure for GoldenGate
          1. Oracle Grid Infrastructure Agents (XAG)
            1. Installing the XAG Grid Infrastructure Agents
          2. The Virtual IP
          3. Creating an ACFS-shared filesystem
          4. Installing the GoldenGate software
          5. Creating the GoldenGate application VIP
        4. Resilience
      2. GoldenGate on Exadata
        1. Supported compression methods
        2. Considerations
          1. Creating the Extract process
          2. Creating the Replicat process
      3. Failover
        1. The automatic failover
        2. The manual failover
          1. The GoldenGate application failover
        3. The active-active configuration
        4. Summary
    14. 7. Advanced Configuration
      1. Mapping your data
        1. Column mapping
          1. Using the COLMAP option
          2. The COLMATCH option
          3. Using the DEFGEN utility
      2. Data selection and filtering
        1. The WHERE clause
        2. The FILTER clause
        3. Loop detection
          1. Active-active
          2. Cascade
      3. Data transformation
        1. Truncation and extraction
        2. Concatenation
        3. Substitution
        4. Case changing
        5. Conversion functions
        6. Arithmetic expressions
        7. Date functions
      4. DDL support
      5. The SQLEXEC parameter
        1. Data lookups
          1. Executing stored procedures
          2. Executing SQL
        2. Executing DML
          1. Handling errors
        3. Scheduling jobs
      6. Using and defining macros
      7. User tokens
        1. Using user tokens to populate a heartbeat table
      8. User exits
        1. Calling C routines
        2. Sample user exits
          1. Source files explained
      9. Using logic in the data replication
      10. Replicating data between different GoldenGate versions
      11. Licensing
      12. Oracle Data Integrator 12c
        1. ETL versus E-LT
          1. Pros
          2. Cons
        2. Knowledge Modules
      13. Summary
    15. 8. Managing Oracle GoldenGate
      1. The Oracle Management Pack for GoldenGate
        1. Oracle GoldenGate Monitor 12c
      2. Command-level security
        1. The CMDSEC file
      3. Managing the trail file
      4. Managing the process startup
      5. Managing TCP/IP errors
      6. Reporting and statistics
        1. Monitoring errors
        2. Monitoring latency
        3. Creating an OEM 12c Metric Extension to monitor GoldenGate processes
          1. Creating the monitoring script
          2. Creating the Metric Extension
          3. Deploying the Metric Extension
        4. Historical reporting
        5. Measuring throughput
          1. The data throughput
          2. The operation throughput
      7. Summary
    16. 9. Performance Tuning
      1. Before tuning GoldenGate
        1. The online redo logs
        2. Large objects – LOBs
        3. Base lining
        4. DBFS enhancements
      2. Tuning data delivery
        1. Balancing load across parallel process groups
        2. Considerations when using parallel process groups
        3. Splitting large tables into row ranges across process groups
          1. The RANGE function
            1. Adding Replicats with the @RANGE function
        4. Tuning parameters to improve the Replicat throughput
          1. BATCHSQL
          2. COMMIT_SERIALIZATION
          3. EAGER_SIZE
          4. PARALLELISM
      3. Viewing integrated parameters
      4. Controlling the memory consumption
      5. Tracing processes to find wait events
      6. Diagnosing a slow Extract
      7. Static data dictionary views
      8. Tuning the network
        1. Linux TCP tuning
      9. Hardware upgrades
        1. Solid-state disks
      10. Summary
    17. 10. Troubleshooting GoldenGate
      1. Troubleshooting tips
        1. Troubleshooting process startup failures
          1. The CHECKPARAMS parameter
          2. Adjusting the replication starting point
          3. Altering Extract processes in RAC environments
            1. Classic capture
            2. Integrated capture
          4. Confirming the integrated capture process status
          5. Checking data throughput
          6. Checking process checkpoints
        2. Recovering from a corrupt trail file
      2. GoldenGate health check
      3. The GoldenGate dynamic performance views
      4. Investigating network issues
        1. TCP/IP
        2. SQL*Net
        3. Bequeath connections
      5. Investigating Oracle errors
      6. Exception handling
        1. Creating an exceptions handler
        2. Viewing exceptions
      7. Handling Oracle Sequences
      8. Using LOGDUMP
        1. Opening files
        2. Viewing the header record
        3. Viewing the transaction record
        4. Miscellaneous commands
        5. Filtering records
      9. Upgrading GoldenGate
      10. Dynamic Rollback
        1. Creating process groups and trails for reverse processing
      11. Summary
    18. 11. The Future of GoldenGate
      1. Cloud computing
        1. The Oracle Integration Cloud Service
        2. On-premises to cloud migrations
      2. GoldenGate and Big Data
      3. Deprecation of the nonCDB architecture
      4. Oracle GoldenGate 12c Release 2
      5. Summary
    19. A. GGSCI Commands
    20. B. GoldenGate Installed Components
    21. C. Acronyms
    22. Index

Product information

  • Title: Oracle GoldenGate 12c Implementer's Guide
  • Author(s): John P Jeffries
  • Release date: July 2015
  • Publisher(s): Packt Publishing
  • ISBN: 9781785280474