Professional Documents
Culture Documents
1) E21504-01
September 2011
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 11g Release 1 Patch Set 1 (11.1.1.1) E21503-01 Copyright 1995, 2011 Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this software or related documentation is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle USA, Inc., 500 Oracle Parkway, Redwood City, CA 94065. This software is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications which may create a risk of personal injury. If you use this software in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure the safe use of this software. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software in dangerous applications. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. This software and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.
Contents
Contents
...............
Chapter 1 System requirements and preinstallation instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Overview of Oracle GoldenGate for DB2 on z/OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Supported Platforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Operating system requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 System services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 Memory requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Disk requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Storage for Oracle GoldenGate trails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 Other operating system requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 Database requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5 Database configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Database user for Oracle GoldenGate processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Supported DB2 on z/OS data types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 Non-supported DB2 on z/OS data types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Supported objects and operations for DB2 on z/OS. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Non-supported objects and operations for DB2 on z/OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Supported and non-supported object names and case. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 Object names and owners . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Case sensitivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Supported characters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Non-supported characters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Chapter 2 Installing Oracle GoldenGate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 Installation overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 Choosing an installation system for a DB2 target. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 Downloading Oracle GoldenGate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 Setting library paths for dynamic builds on UNIX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 Installing Oracle GoldenGate in USS on z/OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Installing Oracle GoldenGate on Linux and UNIX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Installing Oracle GoldenGate on Windows and Windows Cluster . . . . . . . . . . . . . . . . . . . . . . 16 Installing Oracle GoldenGate into a Windows Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Installing the Oracle GoldenGate files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Specifying a custom Manager name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Installing Manager as a Windows service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide iii
Contents
Adding Oracle GoldenGate as a Windows cluster resource . . . . . . . . . . . . . . . . . . . . . . . . 19 Configuring Manager and other processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Chapter 3 Preparing the system for Oracle GoldenGate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Preparing tables for processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Disabling triggers and cascade constraints . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Assigning row identifiers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Handling ROWID columns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 Configuring character sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Configuring database connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Setting initialization parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Specifying the path to the initialization file . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Ensuring ODBC connection compatibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Specifying the number of connection threads. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Accessing load modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Specifying job names and owners . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Assigning WLM velocity goals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Monitoring processes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Viewing Oracle GoldenGate messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Identifying processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Interpreting statistics for update operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 Chapter 4 Preparing the DB2 for z/OS transaction logs for Oracle GoldenGate . . . . . . . . . . . . . . . . . 28 Specifying a bootstrap data set . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Making transaction data available . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Enabling change capture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Enabling access to log records . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Sizing and retaining the logs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Using archive logs on tape . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Controlling log flushes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Chapter 5 Uninstalling Oracle GoldenGate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Uninstalling Oracle GoldenGate from UNIX (includes USS) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Removing Oracle GoldenGate from Windows Cluster. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Uninstalling Oracle GoldenGate from Windows (non-cluster) . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Appendix 1 Oracle GoldenGate installed components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Oracle GoldenGate Programs and Utilities. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Oracle GoldenGate subdirectories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Other Oracle GoldenGate files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 Oracle GoldenGate checkpoint table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide iv
CHAPTER 1
Supported Platforms
To find out which Oracle GoldenGate builds are available for a specific combination of database version and operating system, log onto http://support.oracle.com and select the Certifications tab. For assistance, click Tips for Finding Certifications. An e-mail and password are required to enter this site.
Activate Unix System Services (USS) in full function mode rather than in minimum mode. You can use the z/OS UNIX Configuration Wizard for this purpose. Refer to the IBM UNIX System Services Planning manual for more information. The UNIX customization includes the following:
Make the Language Environment run-time library (RTL) available to Oracle GoldenGate and other C programs by including it in the link list or Link Pack Area (LPA), or by adding it to the STEPLIB environment variable. RTL consists of data sets
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 1
SCEERUN and SCEERUN2. If you are using STEPLIB, define the SCEERUN data sets to LLA to make loading the run-time modules faster. See the UNIX System Services Planning documentation for more information.
To support the Oracle GoldenGate edit and report commands under the TSO/E OMVS command, concatenate the following target libraries to the appropriate ISPF data definition names (ddnames):
Data set SYS1.SBPXPENU to ddname ISPPLIB Data set SYS1.SBPXMENU to ddname ISPMLIB Data set SYS1.SBPXTENU to ddname ISPTLIB Data set SYS1.SBPXEXEC to ddname SYSEXEC or SYSPROC
Install Recoverable Resource Manager Services (RRS) for the best performance. Depending on the attachment type, the user by which Oracle GoldenGate runs might need one of the following permissions on the DSNR resource class:
If using RRSAF, assign RACF ACCESS(READ) to the RRSAF resource. IBM recommends using RRSAF because it has several advantages over CAF, including support for two-phase commit, thread reuse, and control over accounting intervals. If using CAF (the default), assign RACF ACCESS(READ) to the BATCH environment. If using CAF, it is possible for Oracle GoldenGate to hold locks on the system catalog until it receives a transaction commit.
Memory requirements
Allocate approximately 50-100 MB of virtual memory for each Oracle GoldenGate Extract process, depending upon the amount of uncommitted data per unit of work. Oracle GoldenGate stores transaction data on the source system until either a commit or rollback indicator is received. Alternately, you can use spill files to hold most of the data. You may need to monitor the usage of your z/OS page data sets that have extensive USS usage. The default size of the initial Extract memory heap might be too high for some z/OS systems, especially those running applications that primarily generate small transactions. To adjust the size, use the TRANSMEMORY parameter in the Extract parameter file. The GGSCI program uses the International Components for Unicode (ICU) libraries and thus requires a virtual memory allocation of 48 MB. When using TSO to access USS, give the TSO user enough memory allocation to start the Oracle GoldenGate GGSCI process. If you get the error message CEE3536S Not enough storage was available for the WSA, increase the TSO user memory or ask your TSO administrator to do it.
Disk requirements
Assign a Hierarchical File System (HFS) volume with the following free disk space:
50-150 MB, depending on the database and platform. This includes space for the compressed download file and space for the uncompressed files. You can delete the download file after the installation is complete.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 2
40 MB for the working directories and binaries for each instance of Oracle GoldenGate that you are installing on the system. For example, to install two builds of Oracle GoldenGate into two separate directories, allocate 80 MB of space. To install Oracle GoldenGate into a cluster environment, install the Oracle GoldenGate binaries and files on a shared file system that is available to all cluster nodes.
Automatically mount the new file at IPL with an update to the BPXPRM UNIX PARMLIB member. Make certain that the MOUNT FILESYSTEM parameter for HFS in the BPXPRM PARMLIB member is not set to NOSETUID. To mount the files:
MOUNT FILESYSTEM([hfs dsn]') TYPE(HFS) MODE(RDWR) MOUNTPOINT('[/u/ggs]')
An additional 1 GB of disk space on any system that hosts Oracle GoldenGate trails, which are files that contain the working data. You may need more or less than this amount, because the space that is consumed by the trails depends on the volume of data that will be processed. Start with 1 GB and adjust as needed. See also the following guidelines.
1.
Estimate the longest time that the network could be unavailable. Plan to store enough data to withstand the longest possible outage, because otherwise you will need to resynchronize the source and target data if the outage outlasts disk capacity.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 3
2. 3.
Estimate how much transaction log volume your business applications generate in one hour. Use the following formula to calculate the required disk space.
[log volume in one hour] x [number of hours downtime] x .4 = trail disk space
This equation uses a multiplier of 40 percent because only about 40 percent of the data in a transaction log is needed by Oracle GoldenGate.
NOTE This formula is a conservative estimate, and you should run tests once you have configured Oracle GoldenGate to determine exactly how much space you need.
Network
Configure the system to use TCP/IP services, including DNS. Configure the network with the host names or IP addresses of all systems that will be hosting Oracle GoldenGate processes and to which Oracle GoldenGate will be connecting. Host names are easier to use. Oracle GoldenGate requires some unreserved and unrestricted TCP/IP ports, the number of which depends on the number and types of processes in your configuration. See the Oracle GoldenGate Windows and UNIX Administrators Guide for details on how to configure the Manager process to handle the required ports. Keep a record of the ports that you assigned to Oracle GoldenGate. You will specify them with parameters when configuring the Manager process. Configure your firewalls to accept connections through the Oracle GoldenGate ports.
To use Oracle GoldenGate user exits, install the C/C++ Compiler, which creates the programs in the required shared object or DLL. For best results, have the following tools on the system:
Gzip to decompress the Oracle GoldenGate installation files. Otherwise, you must unzip the installation on a PC by using a Windows-based product, and then FTP it to the z/OS machine. RACF command processor. Time Sharing Option Extensions (TSO/E) command processor, including authorized TSO/E commands.
For best results, apply HIPER maintenance on a regular basis, staying within one year of the current maintenance release, as recommended by IBM. The HIPER process identifies defects that could affect data availability or integrity. IBM provides Program Temporary Fixes (PTF) to correct defects found in DB2 and z/OS.
The following are the required operating system privileges for Oracle GoldenGate:
Table 1 Operating system privileges Manager Extract Replicat
User privilege
Resource Access Control Facility (RACF) account (or equivalent) with OMVS segment1
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 4
Table 1
User privilege CONNECT to the local DB2 subsystem2 ACCESS(READ) to the bootstrap data set (BSDS) ACCESS(READ) to resource BPX.FILEATTR.APF in CLASS(FACILITY)4 chmod +rw on the subdirectories in the Oracle GoldenGate
X X3 X X X
directory
1 2 3 4
The user who starts the Manager process is typically the user by which other Oracle GoldenGate processes run. Requires access to either the CAF or the RRSAF protected access profile in the DSNR RACF resource class, depending upon the MVSATTACHTYPE value in the ODBC initialization file. Non-data sharing only. Required for the user that installs the Extract program.
Database requirements
Database configuration
Install a DB2 ODBC driver. The Oracle GoldenGate Extract and Replicat processes use ODBC (Open Database Connectivity) to connect to the DB2 subsystem. For information about ODBC, see the DB2 for z/OS ODBC Guide and Reference documentation. Install and configure the DB2 ODBC dynamic load library. Grant Oracle GoldenGate EXECUTE privilege on the plan that is specified in the ODBC initialization file (the default is DSNACLI). You might need to insert the name of the local DB2 subsystem into the SYSIBM.LOCATIONS table, which contains the remote DB2 server locations. Use a statement similar to the following (the example uses the name DB2A).
INSERT INTO SYSIBM.LOCATIONS (LOCATION, PORT) VALUES ('DB2A', '446');
By default, the user who starts the Manager process becomes the default DB2 primary authorization ID for all of the Oracle GoldenGate processes that any users start in that Oracle GoldenGate instance.You can assign a different user to any process by means of JCL or UNIX variables. To monitor Oracle GoldenGate processing accurately, do not permit other applications or processes to operate as the Oracle GoldenGate user. Assign the DB2 privileges listed in Table 2 to the user by which Extract and Replicat will be running (default is the user who starts Manager). These are in addition to any permissions that DB2 ODBC requires. All Extract privileges apply to initial-load and log-based Extract processes, except where noted.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 5
Table 2
X X
X X
SELECT on source tables required only if tables contain LOB columns, or for an initial-load Extract, if used. Required if using ADD CHECKPOINTTABLE in GGSCI to use the database checkpoint feature. SQLEXEC enables stored procedures and queries to be executed by an Oracle GoldenGate process.
ASCII or EBCDIC data format. Oracle GoldenGate will convert between ASCII and EBCDIC data automatically. Unicode is never converted. Most DB2 data types except those listed in Non-supported DB2 on z/OS data types.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 6
Limitations of support
Oracle GoldenGate does not perform character set conversion for columns that could contain multi-byte data. This includes GRAPHIC, VARGRAPHIC and DBCLOB data types, as well as CHAR, VARCHAR, and CLOB for tables defined with ENCODING_SCHEME of 'M' (multiple CCSID set or multiple encoding schemes) or 'U' (Unicode). Such data is only supported if the source and target systems are the same CCSID. The column conversion functions of Oracle GoldenGate only support tables with EBCDIC encoding. The support of range and precision for floating-point numbers depends on the host machine. In general, the precision is accurate to 16 significant digits, but you should review the database documentation to determine the expected approximations. Oracle GoldenGate rounds or truncates values that exceed the supported precision. When the size of a large object exceeds 4K, Oracle GoldenGate stores the data in segments within the Oracle GoldenGate trail. The first 4K is stored in the base segment, and the rest is stored in a series of 2K segments. Oracle GoldenGate does not support the filtering, column mapping, or manipulation of large objects of this size. Full Oracle GoldenGate functionality can be used for objects that are 4K or smaller.
DECFLOAT XML
Extraction and replication of DML operations on DB2 for z/OS tables that contain rows of up to 512KB in length. This size exceeds the maximum row size of DB2. Oracle GoldenGate supports the maximum number of columns per table that is supported by the database. Oracle GoldenGate supports the maximum column size that is supported by the database. Extraction and replication of data that is stored using DB2 data compression (CREATE TABLESPACE COMPRESS YES).
TRUNCATE TABLE is supported, but because this command issues row deletes to perform
the truncate, they are shown in Oracle GoldenGate statistics as such, and not as a truncate operation. To replicate a TRUNCATE, Replicat uses a DELETE without a WHERE clause.
TRUNCATES are always captured from a DB2 for z/OS source, but can be ignored by Replicat if the IGNORETRUNCATES parameter is used in the Replicat parameter file.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 7
Data manipulation, including compression, that is performed within user-supplied DB2 exit routines, such as:
Date and time routines Edit routines (CREATE TABLE EDITPROC) Validation routines (CREATE TABLE VALIDPROC)
Case sensitivity
The following are general guidelines for the case-sensitivity of object names as it relates to Oracle GoldenGate. These guidelines may or may not apply to your databases, depending on whether the database or the underlying operating system supports case-sensitivity. Keep in mind that case-sensitivity (or lack thereof) may apply to the source database but not the target, or to the target but not the source.
If the system or database is case-sensitive, Oracle GoldenGate supports the case sensitivity of database names, owner and schema names, object names, column names, and user names. If the system or database is case-insensitive (or is configured for case-insensitivity), Oracle GoldenGate converts all names to upper case.
In Oracle GoldenGate parameter files, specify case-sensitive names exactly as they appear in the database. In TABLE and MAP parameters, enclose case-sensitive names in double quotes if the other database (the source or target of the case-sensitive objects) is not casesensitive. If replicating from a case-insensitive source to a case-sensitive target, enter the source names in upper case in the Replicat MAP statements, to reflect the fact that Extract writes them to the trail as uppercase. For example:
MAP SALES.CUSTOMER, TARGET "Sales.Account";
Supported characters
Oracle GoldenGate supports alphanumeric characters in the names of objects, key columns, and non-key columns. Oracle GoldenGate also supports the following characters in columns that are not being used by Oracle GoldenGate as a key.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 8
Table 3
Supported non-alphanumeric characters in object names and non-key column names1 Description
Character
~ <> / \ ! @ # $ % ^ () _ + = | [] {}
1
Tilde Greater-than and less-than symbols Forward slash Backward slash Exclamation point At symbol Pound symbol Dollar symbol Percent symbol Caret symbol Open and close parentheses Underscore Dash Plus sign Equal symbol Pipe Begin and end brackets Begin and end curly brackets (braces)
The type of key that is being used by Oracle GoldenGate depends on the definition of a given table and whether there are any overrides by means of a KEYCOLS clause. Oracle GoldenGate will use a primary key, if available, or a unique key/index (selection is dependent on the database). In the absence of those definitions, all columns of the table are used, but a KEYCOLS clause overrides all existing key types. For columns that are being used by Oracle GoldenGate as a key, the characters in the names must be valid for inclusion in a WHERE clause. This list is all-inclusive; a given database platform may or may not support all listed characters.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 9
Non-supported characters
Oracle GoldenGate does not support the following characters in object or column names.
Table 4 Non-supported characters in object and column names1 Description
Character
& * ? : ; , .
Ampersand Asterisk Question mark Colon Semi-colon Comma Single quotes Double quotes Accent mark (Diacritical mark) Period Space
This list is all-inclusive; a given database platform may or may not support all listed characters.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 10
CHAPTER 2
Installation overview
To install Oracle GoldenGate, the following steps are required:
Choosing an installation system for a DB2 target Downloading Oracle GoldenGate Setting library paths for dynamic builds Installing the Oracle GoldenGate software Configuring Manager and other processes
NOTE Before proceeding, make certain that you have reviewed the System Requirements in this guide.
Install Oracle GoldenGate directly on the DB2 target system. Go to Installing Oracle GoldenGate in USS on z/OS on page 11. Install Oracle GoldenGate DB2Remote on an intermediary Linux, UNIX, or Windows system for remote delivery to a DB2 target system. In this configuration, Replicat connects to the target DB2 database by using the ODBC API that is supplied in DB2 Connect (requires DB2 LUW). See the following instructions.
NOTE All of the Oracle GoldenGate functionality that is supported for DB2 for z/OS is supported in this configuration. In addition, ASCII character data is converted to EBCDIC automatically by DB2 Connect.
1.
For the intermediary system, select any Linux, UNIX, or Windows platform that Oracle GoldenGate supports for the DB2 for LUW database. This will be the system on which Oracle GoldenGate is installed. Install and run DB2 for LUW on the selected intermediary system so that the Replicat process can use the supplied DB2 Connect driver. 8
2.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide
3.
Catalog the DB2 target node in the DB2 for LUW database on the intermediary system by using the following DB2 command:
catalog tcpip node <db2-node-name> remote <DNS-name> server <DB2-port-number>
4.
Add the target DB2 database to the DB2 for LUW catalog on the intermediary system by using the following DB2 command:
catalog db <database-name> as <database-alias> at node <db-node-name> NOTE Refer to the IBM DB2 LUW documentation for more information about these commands.
5.
Download and install the appropriate Oracle GoldenGate build for the selected intermediary platform. Make certain to select the build that is labeled for DB2Remote. Follow Downloading Oracle GoldenGate on page 9, and then follow the appropriate installation instructions:
Installing Oracle GoldenGate on Linux and UNIX on page 11 Installing Oracle GoldenGate on Windows and Windows Cluster on page 12
6.
Specify the DB2 target database name with the Replicat parameter TARGETDB when you configure the Oracle GoldenGate processes.
3.
Enter your identification information. Accept the Trial License Agreement (even if you have a permanent license). Accept the Export Restrictions. Click Continue.
4.
Select the Oracle Fusion Middleware Product Pack. Select the platform on which you will be installing the software. Click Go.
5.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 9
Select the Media Pack that you want to download. Note: To install Oracle GoldenGate to connect to a DB2 target using DB2 Connect from a Windows or UNIX system, select the build that is labeled as DB2Remote; or to download Oracle GoldenGate to run on the DB2 target system, select the appropriate build for the database and platform. (See Choosing an installation system for a DB2 target on page 8.) Click Continue.
6.
Click Download for each component that you want. Follow the automatic download process to transfer the mediapack.zip file to your system.
NOTE Before installing the software, review the release notes for any new features, new requirements, or bug fixes that affect your current configuration. Review the readme file for known issues.
2.
(Optional) Add the Oracle GoldenGate installation directory to the PATH environment variable. (Required) Add the Oracle GoldenGate installation directory to the sharedlibraries environment variable.
For example, given an Oracle GoldenGate installation directory of /users/ogg, the second command in the following example requires these variables to be set:
Command $ users/ogg > ./ggsci $ users > ./ogg/ggsci To set the variables in Korn shell PATH=<installation directory>:$PATH export PATH <shared libraries variable>=<absolute path of installation directory>:$<shared libraries variable> export <shared libraries variable> Requires GG libraries in environment variable?
No Yes
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 10
To set the variables in Bourne shell export PATH=<installation directory>:$PATH export <shared libraries variable>=<absolute path of installation directory>:$<shared libraries variable> To set the variables in C shell setenv PATH <installation directory>:$PATH setenv <shared libraries variable> <absolute path of installation directory>:$<shared libraries variable> Where: <shared libraries variable> is one of the following: UNIX/Linux library path variables per platform Platform1 IBM AIX IBM z/OS HP-UX Sun Solaris HP Tru64 (OSF/1) LINUX
1 2
SHLIB_PATH LD_LIBRARY_PATH2
A specific platform may or may not be supported by Oracle GoldenGate for your database. In 64-bit environments with 32-bit Oracle databases, Oracle GoldenGate requires the LD_LIBRARY_PATH to include the 32-bit Oracle libraries.
Example
export LD_LIBRARY_PATH=/ggs/10.0:$LD_LIBRARY_PATH NOTE To view the libraries that are required by an Oracle GoldenGate process, use the ldd <process> shell command before starting the process. This command also shows an error message for any that are missing.
Call the API in Supervisor State with Storage Key 0. Allocate a return area in Extended Common Storage Area (ECSA) memory subpool 241 (not fetch protected, pageable) with Storage Key 7. The size of the return area will be a minimum of the largest DB2 log record that is returned, plus the additional area that is defined in DB2 macro DSNDQW04.
1.
IFI is IBMs Instrumentation Facility Interface. IFCID is IBMs Instrumentation Facility Counter ID.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 11
2. 3.
Extract the Oracle GoldenGate mediapack.zip file to the system and directory where you want Oracle GoldenGate to be installed. In the Unix shell, verify that the DLL files have the write mode set.
ls -l *.dll -rwxrwx--a-s1 BSTPIER IPGROUP 6127616 Apr 25 14:56 lib.dll
4.
5.
In the UNIX shell, check for the "a" authorization for Extract and the DLL files by issuing the following command.
ls -E extract *.dll
In the output, look for the "a" attribute, indicating the authorization in Authorized Program Facility (APF) as shown in the following example.
-rwxrwx--a-s1 BSTPIER IPGROUP 6127616 Apr 25 14:56 extract
6.
If the "a" attribute is not set for both Extract and its DLL files (it may be built into one but not the other, depending on the build configuration), issue the following commands to add the authorization for Extract and the DLL files.
extattr +a extract extattr +a *.dll
7. 8.
Run the command shell and change directories to the new Oracle GoldenGate directory. Set the LIBPATH environment variable to include the path to the Oracle GoldenGate installation directory.
export LIBPATH=".:$(LIBPATH)"
The . indicates the current directory. This change must be performed before starting any Oracle GoldenGate processes and can be made in one of the following ways:
system-wide for a specific user at login time manually each time that Oracle GoldenGate is executed
9.
10. In GGSCI, issue the following command to create the Oracle GoldenGate working directories.
CREATE SUBDIRS
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 12
5.
In GGSCI, issue the following command to create the Oracle GoldenGate working directories.
CREATE SUBDIRS
6.
3.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 13
4.
In GGSCI, issue the following command to create the Oracle GoldenGate working directories.
CREATE SUBDIRS
5.
You want to use a name for Manager other than the default of GGSMGR. There will be multiple Manager processes running as Windows services on this system, such as one for the Oracle GoldenGate replication software and one for Oracle GoldenGate Veridata. Each Manager on a system must have a unique name. Before proceeding further, note the names of any local Manager services.
1. 2.
From the directory that contains the Manager program, run GGSCI. Issue the following command.
EDIT PARAMS ./GLOBALS NOTE The ./ portion of this command must be used, because the GLOBALS file must reside at the root of the Oracle GoldenGate installation file.
3.
In the file, add the following line, where <name> is a one-word name for the Manager service.
MGRSERVNAME <name>
4.
Save the file. The file is saved automatically with the name GLOBALS, without a file extension. Do not move this file. It is used during installation of the Windows service and during data processing.
1. 2. 3.
(Recommended) Log on as the system administrator. Click Start > Run, and type cmd in the Run dialog box. From the directory that contains the Manager program that you are installing as a service, run the install program with the following syntax:
install <option> [...]
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 14
Table 3 Option
ADDEVENTS
Adds Oracle GoldenGate events to the Windows Event Manager. By default, Oracle GoldenGate errors are generic. To produce more specific error content, copy the following files from the Oracle GoldenGate installation directory to the SYSTEM32 directory.
category.dll ggsmsg.dll
ADDSERVICE
Adds Manager as a service with the name that is specified with the MGRSERVNAME parameter in the GLOBALS file, if one exists, or by the default of GGSMGR. ADDSERVICE configures the service to run as the Local System account, the standard for most Windows applications because the service can be run independently of user logins and password changes. To run Manager as a specific account, use the USER and PASSWORD options.1 The service is installed to start at system boot time (see AUTOSTART). To start it after installation, either reboot the system or start the service manually from the Services applet of the Control Panel.
AUTOSTART
Sets the service that is created with ADDSERVICE to start at system boot time. This is the default unless MANUALSTART is used. Sets the service that is created with ADDSERVICE to start manually through GGSCI, a script, or the Services applet of the Control Panel. The default is AUTOSTART. Specifies a domain user account that executes Manager. For <name>, include the domain name, a backward slash, and the user name, for example HEADQT\GGSMGR. By default, the Manager service is installed to use the Local System account.
MANUALSTART
USER <name>
PASSWORD <password>
1
Specifies the password for the user that is specified with USER.
A user account can be changed by selecting the Properties action from the Services applet of the Windows Control Panel.
4.
(Windows Server 2008) If Windows User Account Control (UAC) is enabled, you are prompted to allow or deny the program access to the computer. Select Allow to enable the install program to run. This installs the Manager service with a local system account running with administrator privileges. No further UAC prompts will be encountered when running Manager if installed as a service.
NOTE If Manager is not installed as a service, Oracle GoldenGate users will receive a UAC prompt to confirm the elevation of privileges for Manager when it is started from the GGSCI command prompt. Running other Oracle GoldenGate programs also triggers a prompt.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 15
3. 4. 5. 6.
The database resource The disk resource that contains the Oracle GoldenGate directory The disk resource that contains the database transaction log files The disk resource that contains the database transaction log backup files
7. 8. 9.
Click Apply, then OK. In the Generic Service Parameters dialog box, type either the default Manager service name of GGSMGR or the custom name, if one is specified with MGRSERVNAME in the GLOBALS file. Click Next.
10. Click Finish to exit the wizard. 11. In the Cluster Administrator tree, right-click the Manager resource and then select Properties. 12. Click the Advanced tab, and then deselect Affect the Group. This is a recommendation, but you can configure it as needed for your environment. 13. Click Apply. 14. Bring the cluster resource online to verify that it was installed correctly. 15. Take the resource offline again. 16. Move the group to the next node in the cluster. When the group moves successfully to the second node, the Manager resource should still be offline. 17. Log onto the second node. 18. Install Oracle GoldenGate Manager as a service on this node by running the install program as you did on the previous node. If you created a custom name for Manager in the GLOBALS file, that name will be used. 19. Bring the resource online to verify that it is running correctly on this node. 20. Repeat from step 16 for each additional node in the cluster.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 16
Configure the Manager process with a TCP/IP port and other optional parameters that control dynamic port assignments, trail file maintenance, automatic startup, and other properties. Configure Extract and Replicat processes to support reporting, high availability, disaster recovery, and other topologies. Configure security to control user access, file security, and data encryption. Configure integration, manipulation, and conversion features that enable you to customize Oracle GoldenGate and support the delivery of data across heterogeneous environments. Configure utilities and other tools that support Oracle GoldenGate.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 17
CHAPTER 3
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 21
NOTE
If there are other, non-usable keys on a table or if there are no keys at all on the table, Oracle GoldenGate logs an appropriate message to the report file. Constructing a key from all of the columns impedes the performance of Oracle GoldenGate on the source system. On the target, this key causes Replicat to use a larger, less efficient WHERE clause.
Using KEYCOLS to specify a custom key If a table does not have one of the preceding types of row identifiers, or if you prefer those identifiers not to be used, you can define a substitute key if the table has columns that always contain unique values. You define this substitute key by including a KEYCOLS clause within the Extract TABLE parameter and the Replicat MAP parameter. The specified key will override any existing primary or unique key that Oracle GoldenGate finds. For more information, see the Oracle GoldenGate Windows and UNIX Reference Guide.
You can do one of the following to prepare tables with ROWID columns to be processed by Oracle GoldenGate:
Ensure that any ROWID columns in target tables are defined as GENERATED BY DEFAULT. If it is not possible to change the table definition, you can work around it with the following procedure.
1.
For the source table, create an Extract TABLE statement, and use a COLSEXCEPT clause in that statement that excludes the ROWID column. For example:
TABLE tab1, COLSEXCEPT (rowidcol);
The COLSEXCEPT clause excludes the ROWID column from being captured and replicated to the target table. 2. For the target table, ensure that Replicat does not attempt to use the ROWID column as the key. This can be done in one of the following ways:
Specify a primary key in the target table definition. If a key cannot be created, create a Replicat MAP parameter for the table, and use a KEYCOLS clause in that statement that contains any unique columns except for the ROWID column. Replicat will use those columns as a key. For example:
For more information about KEYCOLS, see Assigning row identifiers on page 21.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 22
The character set of the target database must be a superset of the character set of the source database. If your client applications use different character sets, the database character set must be a superset of the character sets of the client applications. In this configuration, every character is represented when converting from a client character set to the database character set.
MVSDEFAULTSSID: set to the DB2 subsystem. LOCATION: set to the DB2 location name as stored in the DB2 Boot Strap Dataset. MVSATTACHTYPE: set to RRSAF (Recoverable Resource Manager Services Attachment Facility) or CAF (Call Attachment Facility). IBM recommends using RRSAF. MULTICONTEXT: set to 1 if using RRSAF. PLANNAME: set to the DB2 plan. The default plan name is DSNACLI. NOTE When using the CAF attachment type, you must use the Oracle GoldenGate DBOPTIONS parameter with the NOCATALOGCONNECT option in the parameter file of any Extract or Replicat process that connects to DB2. This parameter disables the usual attempt by Oracle GoldenGate to obtain a second thread for the DB2 catalog. Otherwise, you will receive error messages, such as ODBC operation failed: Couldn't connect to <data source> for catalog queries.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 23
The first (or open) bracket must use the hexadecimal characters X'AD' (0xAD). The second (or close) bracket must use the hexadecimal characters X'BD' (0xBD).
Use the hex command in OEDIT and change the hex code for each character appropriately. Use the iconv utility convert the ODBC initialization file. For example, to convert from CCSID IBM-037 to IBM-1047, use the following command:
iconv -f IBM-037 -t IBM-1047 ODBC.ini > ODBC-1047.ini mv ODBC-1047.ini ODBC.ini
Change your terminal emulator or terminal configuration to use CCSID IBM-1047 when you create or alter the file.
MAX USERS (macro DSN6SYSP CTHREAD) MAX TSO CONNECT (macro DSN6SYSP IDFORE) MAX BATCH CONNECT (macro DSN6SYSP IDBACK)
Extract Replicat The GGSCI command DBLOGIN (logs into the database)
DEFGEN (generates data definitions for column mapping)
One extra DB2 thread for Extract for IFI calls. One extra DB2 thread for each SQLEXEC parameter statement that will be issued by each Extract and Replicat process. For more information about SQLEXEC, see the Oracle GoldenGate Windows and UNIX Reference Guide.
If using CAF, there can be only one thread per Oracle GoldenGate process.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 24
the z/OS system search order. the USS profile of the Oracle GoldenGate user. Use a UNIX command similar to the following, where DSN810 is the user-assigned data set prefix from the DB2 installation.
export STEPLIB='DSN810.SDSNEXIT:DSN810.SDSNLOAD'
The preceding command will cause USS to allocate the equivalent of a STEPLIB DD statement whenever it executes a shell command or Oracle GoldenGate process. If using APF, all libraries in the STEPLIB concatenation must be APF-authorized.
Assign the Extract process that reads the transaction logs a medium velocity goal, one that is below the velocity of the main DB2 address spaces, but above the velocity of most online transactions, TSO/E sessions, and z/OS batch work. The higher the velocity goal, the more processor power that Extract will receive, and the less lag that it will experience. You can assign an initial-load Extract process a velocity goal, or you can treat it as a typical DB2 batch job. For more information about the initial-load processes, see the Oracle GoldenGate Windows and UNIX Administrators Guide. You might need to assign the Replicat process a higher velocity goal. Although Replicat is a typical DB2 batch application, it might require more processing power to prevent backlogs and latency. You probably will run Oracle GoldenGate utilities, such as DEFGEN and LOGDUMP, only occasionally, so you can let them perform like the other UNIX terminal-oriented work. If using SQLEXEC stored procedures, make certain that they do not become a bottleneck for Oracle GoldenGate. Their priority should be close to that of the calling Extract or Replicat process. WLM executes them with that priority, but the z/OS system executes them under the priority of a stored procedure as defined by the DB2 and z/OS system programmers.
If you run Oracle GoldenGate under the TSO/E OMVS command, the Oracle GoldenGate processes are subject to the system and WLM limits of the TSO/E user account, rather than those of the UNIX kernel. Very long TSO/E response times (up to 20 seconds), often with little service consumption, can be recorded for an OMVS user because of the way that OMVS polls for terminal input. This can affect those WLM goals that are based on response time.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 25
You can use multiple WLM service classes for the Oracle GoldenGate processes. The following is an example of how to maintain relative priorities for Oracle GoldenGate and other work, from highest priority to the lowest: 1. 2. 3. 4. 5. 6. 7. 8. 9. z/OS system processes, including the UNIX kernel and IRLM. DB2 for z/OS address spaces for the primary Extract group. Primary Extract group configured for online or batch change synchronization, and any DB2 stored procedures that it calls. z/OS transaction managers, such as CICS and IMS. Collector (Server) for local Extract data pump, if used. Local Extract data pump (reading from trail), if used. Collector for remote trails (files received from a remote site). Such files include the QSAM file created with the Extract RMTBATCH parameter on a NonStop system. Online Replicat groups and any DB2 stored procedures that they call. Manager process (required only for startup of Oracle GoldenGate processes and trail cleanup).
10. GGSCI and other user UNIX and TSO/E terminal work. 11. Initial-load Extract and any DB2 stored procedures that it calls. 12. Initial-load Replicat and any DB2 stored procedures that it calls. 13. Other z/OS batch work.
Monitoring processes
The following provides information about monitoring Oracle GoldenGate with z/OS system facilities.
Identifying processes
The system management facility (SMF) typically creates a separate accounting record for each UNIX process, including Oracle GoldenGate processes. However, if a user invokes the UNIX shell by using the OMVS command with the default SHAREAS option, or if a user sets
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 26
the environment variable _BPX_SHAREAS to YES, it could cause two or more processes to run in the same address space. SMF provides process identification only for the first process, but resource consumption is accumulated for all processes that are running. For Oracle GoldenGate, this means that the work probably will be recorded under the Manager process, which is named mgr. If the DB2 accounting trace is also active to the SMF destination, DB2 will create an SMF accounting record for each of the following Oracle GoldenGate processes:
Extract Replicat Manager, if performing maintenance on Oracle GoldenGate tables. Examples of Oracle GoldenGate tables are the marker table and the Replicat checkpoint table. GGSCI sessions that issue the Oracle GoldenGate DBLOGIN command to log into the database.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 27
Preparing the DB2 for z/OS transaction logs for Oracle GoldenGate
Specifying a bootstrap data set
CHAPTER 4
Preparing the DB2 for z/OS transaction logs for Oracle GoldenGate
...............
Specifying a bootstrap data set
The Extract process uses the BSDS to find its initial position in the transaction log within a non-data-sharing environment. You specify the BSDS when you create your Extract groups. It must be the BSDS for the DB2 subsystem to which the Extract process will be connecting. Oracle GoldenGate does not perform any validations of the BSDS specification.
1. 2.
From the Oracle GoldenGate directory, run GGSCI. Log on to DB2 from GGSCI as a user that has ALTER TABLE privileges.
DBLOGIN SOURCEDB <ODBC data source name>, USERID <user>[, PASSWORD <password>]
3.
Issue the following command. where <table> is the fully qualified name of the table. You can use a wildcard to specify multiple table names but not owner names.
ADD TRANDATA <table>
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 28
Preparing the DB2 for z/OS transaction logs for Oracle GoldenGate
Making transaction data available
1. 2.
Log on to DB2 as a DB2 user who has the TRACE privilege or at least SYSOPR authority. Issue the following command:
start trace(monitor) class(1) scope(group)
Set MONITOR TRACE to 'YES' on the DSNTIPN installation tracing panel. Set 'DSN6SYSP MON=YES' in the DSNTIJUZ installation job, as described in the DB2 UDB Installation Guide.
NOTE The primary authorization ID, or one of the secondary authorization IDs, of the ODBC plan executor also must have the MONITOR2 privilege.
Your applications generate large amounts of DB2 data. Your applications have infrequent commits. You expect to stop Extract for long periods of time. Your network is unreliable or slow.
Retain enough log data so that Extract can start again from its checkpoints after you stop it or after an unplanned outage. Extract must have access to the log that contains the start of the oldest uncommitted unit of work, and all logs thereafter. If data that Extract needs during processing was not retained, either in online or archived logs, one of the following corrective actions might be required:
alter Extract to capture from a later point in time for which log data is available (and accept possible data loss on the target). resynchronize the source and target tables, and then start the Oracle GoldenGate environment over again.
Use the DSN6LOGP MAXARCH system parameter in the DSNTIJUZ installation job.
NOTE The IBM documentation makes recommendations for improving the performance of log reads. In particular, you can use large log output buffers, large active logs, and make archives to disk.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 29
Preparing the DB2 for z/OS transaction logs for Oracle GoldenGate
Making transaction data available
manner between online DASD storage and tape, but Extract will have to wait until the transfer is finished. Delays in Extract processing increase the latency between source and target data.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 30
CHAPTER 4
1. 2.
Run the command shell. (Suggested) Log on as the system administrator or as a user with permission to issue Oracle GoldenGate commands and delete files and directories from the operating system. Change directories to the Oracle GoldenGate installation directory. Run GGSCI. Stop all Oracle GoldenGate processes. Stop the Manager process.
3. 4. 5. 6.
On a source system:
7.
Log into the database with the DBLOGIN command, and then run the DELETE TRANDATA command to alter the tables to DATA CAPTURE NONE.
8.
Log into the database with the DBLOGIN command, and then remove the Replicat checkpoint table by running the DELETE CHECKPOINTTABLE command.
On all systems:
9.
10. Remove the Oracle GoldenGate files by removing the installation directory.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 15
being used for remote delivery to DB2 on an IBM z/OS system. 1. Working from the node in the cluster that owns the cluster group that contains the Manager resource, run GGSCI and then stop any Extract and Replicat processes that are still running. Use the Cluster Administrator tool to take the Manager resource offline. Right click the resource and select Delete to remove it. Click Start > Run, and type cmd in the Run dialog box to open the command console. Change directories to the Oracle GoldenGate installation directory. Run the install program using the following syntax.
install deleteevents deleteservice
2. 3. 4. 5. 6.
This command stops Oracle GoldenGate events from being reported to the Windows Event Manager and removes the Manager service. 7. 8. 9. Delete the CATEGORY.DLL and GGSMSG.DLL files from the Windows SYSTEM32 folder. Move the cluster group to the next node in the cluster, and repeat from step 4. Follow the instructions in Uninstalling Oracle GoldenGate from Windows (noncluster).
1.
(Suggested) Log on as the system administrator or as a user with permission to issue Oracle GoldenGate commands and to delete files and directories from the operating system. From the Oracle GoldenGate installation folder, run GGSCI. Stop all Oracle GoldenGate processes. Stop the Manager program or service.
NOTE Skip step 5 through step 8 if you already performed them when removing Oracle GoldenGate from a Windows cluster.
2. 3. 4.
5. 6. 7.
Click Start > Run, and type cmd in the Run dialog box to open the command console. Change directories to the Oracle GoldenGate installation directory. Run the install program using the following syntax.
install deleteevents deleteservice
This command stops Oracle GoldenGate events from being reported to the Windows Event Manager and removes the Manager service. 8. Delete the CATEGORY.DLL and GGSMSG.DLL files from the Windows SYSTEM32 folder.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 16
9.
Log into the database with the DBLOGIN command, and then remove the Replicat checkpoint table by running the DELETE CHECKPOINTTABLE command.
On all systems:
10. Make certain all processes are stopped (including GGSCI) and then remove the Oracle GoldenGate files by removing the installation directory.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 17
APPENDIX 1
Table 3
Program cobgen
Programs and utilities Description Generates source definitions based on COBOL layouts. Used for Oracle GoldenGate for Datawise on Stratus. Converts checkpoint files to a newer version. Generates target DDL table creation statements based on COBOL layouts. Used for Oracle GoldenGate for Datawise on Stratus. Generates target database table definitions based on source database DDL. Used primarily on the NonStop platform. Generates data definitions and is referenced by Oracle GoldenGate processes when source and target tables have dissimilar definitions. Sends event messages created by Collector and Replicat on Windows or UNIX systems to EMS on NonStop systems. Performs capture from database tables or transaction logs or receives transaction data from a vendor access module. Oracle GoldenGate installation script for the SQL/MX database. User interface to Oracle GoldenGate for issuing commands and managing parameter files.
convchk ddlcob
ddlgen
defgen
emsclnt
extract
ggmxinstall ggsci
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 16
Table 3
Program
Programs and utilities (continued) Description Start the Oracle GoldenGate Manager process from a batch job or the operator console on a z/OS system. Installed to support DB2 z/OS databases.
Installs Oracle GoldenGate as a Windows service and provides other Windowsbased service options. Generates data-encryption keys. A utility for viewing and saving information stored in extract trails or files. (Manager) Control process for resource management, control and monitoring of Oracle GoldenGate processes, reporting, and routing of requests through the GGSCI interface. Applies data to target database tables. A utility that reverses the order of transactional operations, so that Replicat can be used to back out changes from target tables, restoring them to a previous state. The Collector process, an Extract TCP/IP server collector that writes data to remote trails. Started by Extract to read the TMF audit trails generated by TMF-enabled applications. Installed to support the NonStop SQL/MX database.
replicat reverse
server
vamserv
Table 4
Directory br cfg
Subdirectories Description Contains the checkpoint files for the bounded recover feature. Contains the property and xml files that are used to configure Oracle GoldenGate Monitor.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 17
Table 4
Directory dirchk
Subdirectories (continued) Description Contains the checkpoint files created by Extract and Replicat processes, which store current read and write positions to support data accuracy and fault tolerance. Written in internal Oracle GoldenGate format. File name format is <group name><sequence number>.<ext> where <sequence number> is a sequential number appended to aged files and <ext> is either cpe for Extract checkpoint files or cpr for Replicat checkpoint files. Do not edit these files. Examples:
ext1.cpe rep1.cpr
dirdat
The default location for Oracle GoldenGate trail files and extract files that are created by Extract processes to store extracted data for further processing by the Replicat process or another application or utility. Written in internal Oracle GoldenGate format. File name format is a user-defined two-character prefix followed by either a sixdigit sequence number (trail files) or the user-defined name of the associated Extract process group (extract files). Do not edit these files. Examples:
rt000001 finance
dirdef
The default location for data definitions files created by the DEFGEN utility to contain source or target data definitions used in a heterogeneous synchronization environment. Written in external ASCII. File name format is a user-defined name specified in the DEFGEN parameter file. These files may be edited to add definitions for newly created tables. If you are unsure of how to edit a definitions file, contact Oracle GoldenGate technical support. Example:
defs.dat
dirjar dirout
Contains the Java executable files that support Oracle GoldenGate Monitor. This directory is not used any more.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 18
Table 4
Directory dirpcs
Subdirectories (continued) Description Default location for status files. File name format is <group>.<extension> where <group> is the name of the group and <extension> is either pce (Extract), pcr (Replicat), or pcm (Manager). These files are only created while a process is running. The file shows the program name, the process name, the port number, and the process ID. Do not edit these files. Examples:
mgr.pcm ext.pce
dirprm
The default location for Oracle GoldenGate parameter files created by Oracle GoldenGate users to store run-time parameters for Oracle GoldenGate process groups or utilities. Written in external ASCII format. File name format is <group name/user-defined name>.prm or mgr.prm. These files may be edited to change Oracle GoldenGate parameter values after stopping the process. They can be edited directly from a text editor or by using the EDIT PARAMS command in GGSCI. Examples:
defgen.prm finance.prm
dirrec dirrpt
Not used by Oracle GoldenGate. The default location for process report files created by Extract, Replicat, and Manager processes to report statistical information relating to a processing run. Written in external ASCII format. File name format is <group name><sequence number>.rpt where <sequence number> is a sequential number appended to aged files. Do not edit these files. Examples:
fin2.rpt mgr4.rpt
dirsql
Used by the TRIGGEN utility to store SQL scripts before TRIGGEN was deprecated. Currently used to store training scripts and any user-created SQL scripts that support Oracle GoldenGate. The default location for storing large transactions when the size exceeds the allocated memory size. Do not edit these files. Contains the Oracle Wallet that supports Oracle GoldenGate Monitor. This directory is not installed until the utility that creates the wallet is run. Contains sample files to help with the creation of user exits.
dirtmp
dirwlt
UserExitExamples
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 19
Table 5
Other files Description Template for use with Replicat when creating a run file for the Microsoft BCP/DTS bulk-load utility. Blowfish encryption software license agreement. Contains the Windows dynamic link library for the Oracle GoldenGate Monitor C sub-agent. Windows dynamic link library used by the INSTALL program. Script that creates a checkpoint table in the local database. A different script is installed for each database type. Template for use with Replicat when creating a control file for the IBM LOADUTIL bulk-load utility. Template used by the DDLGEN utility to convert source DDL to Microsoft Access DDL. Script that removes the DDL trace file. (Oracle installations) Template used by the DDLGEN utility to convert source DDL to DB2 DDL (Linux, UNIX, Windows). Template used by the DDLGEN utility to convert source DDL to DB2 DDL (z/OS systems). Script that saves DDL from the marker table to a file. Script that disables the Oracle GoldenGate DDL trigger. (Oracle installations) Script that enables the Oracle GoldenGate DDL trigger. (Oracle installations) Script that supports filtering of DDL by Oracle GoldenGate. This script runs programmatically; do not run it manually. Template used by the DDLGEN utility to convert source DDL to Informix DDL.
Component bcpfmt.tpl
bcrypt.txt cagent.dll
category.dll chkpt_<db>_create.sql
db2cntl.tpl
ddl_access.tpl
ddl_cleartrace.sql ddl_db2.tpl
ddl_db2_os390.tpl
ddl_ddl2file.sql ddl_disable.sql
ddl_enable.sql
ddl_filter.sql
ddl_informix.tpl
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 20
Table 5
Other files (continued) Description Template used by the DDLGEN utility to convert source DDL to SQL Server DDL. Template used by the DDLGEN utility to convert source DDL to MySQL DDL. Empty script file for use by Oracle GoldenGate support staff. Template used by the DDLGEN utility to convert source DDL to NonStop SQL DDL. Scripts that run programmatically as part of Oracle GoldenGate DDL support; do not run these scripts.
Component ddl_mss.tpl
ddl_mysql.tpl
ddl_nopurgeRecyclebin.sql ddl_nssql.tpl
Template used by the DDLGEN utility to convert source DDL to Oracle DDL. Script that pins DDL tracing, the DDL package, and the DDL trigger for performance improvements. (Oracle installations) Script that purges the Oracle recyclebin in support of the DDL replication feature. Script that removes the DDL extraction trigger and package. (Oracle installations) Supports the installation of the Oracle DDL objects. This script runs programmatically; do not run it manually. Script that installs the Oracle GoldenGate DDL extraction and replication objects. (Oracle installations) Template used by the DDLGEN utility to convert Tandem Enscribe DDL to NonStop SQL/MX DDL. Script that verifies whether or not each object created by the Oracle GoldenGate DDL support feature exists and is functioning properly. (Oracle installations) Scripts that control whether the Oracle DDL trigger collects metadata. This script runs programmatically; do not run it manually. Template used by the DDLGEN utility to convert source DDL to Sybase DDL.
ddl_pin.sql
ddl_purgeRecyclebin.sql
ddl_remove.sql
ddl_sqlmx.tpl
ddl_status.sql
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 21
Table 5
Other files (continued) Description Template used by the DDLGEN utility to convert source DDL to NonStop SQL DDL. Scripts that control whether DDL tracing is on or off. Script that sets the level of tracing for the DDL support feature. (Oracle installations) Debug text files that may be present if tracing was turned on. Scripts that create and populate demonstration tables for use with tutorials and basic testing.
Component ddl_tandem.tpl
debug files demo_<db>_create.sql demo_more_<db>_create.sql demo_<db>_insert.sql demo_more_<db>_insert.sql demo_<db>_lob_create.sql demo_<db>_misc.sql .dmp files
Dump files created by Oracle GoldenGate processes for tracing purposes. User-created file that stores encryption keys. Written in external ASCII format. User exit example. License agreement for FreeBSD. Data file that contains error, informational, and warning messages that are returned by the Oracle GoldenGate processes. The version of this file is checked upon process startup and must be identical to that of the process in order for the process to operate. File that logs processing events, messages, errors, and warnings generated by Oracle GoldenGate. Windows dynamic link library used by the INSTALL program. User-created file that stores parameters applying to the Oracle GoldenGate instance as a whole. Help file for the GGSCI command interface. Windows shared libraries for International Components for Unicode.
ENCKEYS
ggserr.log
ggsmsg.dll GLOBALS
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 22
Table 5
Other files (continued) Description Windows batch file for the Java Agent for Oracle GoldenGate Monitor. Log files for the Oracle GoldenGate Monitor Agent. UNIX shell script for the Java Agent for Oracle GoldenGate Monitor Lesser General Public License statement. Applies to free libraries from the Free Software Foundation. Windows dynamic link library containing the XML library for the Oracle GoldenGate XML procedures. License agreement for libxml2.dll. File created by Replicat if markers were passed from a NonStop source system. Script that removes the DDL marker table. (Oracle installations) Script that installs the Oracle GoldenGate DDL marker table. (Oracle installations) Script that confirms successful installation of the DDL marker table. (Oracle installations) Third-party software license file. Script that contains configurable parameters for DDL support. (Oracle installations) License agreement for pthread-VC.dll. POSIX threads library for Microsoft Windows. Supports the replication of Oracle encrypted data. Script files that support the Oracle GoldenGate Monitor Agent. Script that creates the database role necessary for Oracle GoldenGate DDL support. (Oracle installations) Template for use with Replicat when creating a control file for the Oracle SQL*Loader bulk-load utility.
Component jagent.bat
libxml2.dll
libxml2.txt marker.hist
marker_remove.sql marker_setup.sql
marker_status.sql
notices.txt params.sql
sqlldr.tpl
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 23
Table 5
Other files (continued) Description z/OS paramlib members to start and stop the Manager process. z/OS Unix System Services scripts to start the Manager process from GGSCI. z/OS system input command for the Manager process.
File containing user-defined instructions for responding to TCP/IP errors. Include file for user exit API. Apache XML parser library. License agreement for zlib compression library.
The name of a Replicat group using this table for checkpoints. There can be multiple Replicat groups using the same table. A unique identifier that, together with GROUPNAME, uniquely identifies a checkpoint regardless of how many Replicat groups are writing to the same table. The sequence number of the checkpoint file. The relative byte address of the checkpoint in the file. The timestamp of the checkpoint position in the checkpoint file. The date and time when the checkpoint table was created.
CREATE_TS
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 24
Table 6
Column
LAST_UPDATE_TS CURRENT_DIR
The date and time when the checkpoint table was last updated. The current Oracle GoldenGate home directory or folder.
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 25
Index
Symbols
Index
...............
Symbols
$LD_LIBRARY_PATH variable 14 $PATH variable 13, 14 cluster, installing on 3 columns number and size supported 7 supported data types 6, 7 components, Oracle GoldenGate 34 compression, data 7 connection threads, number of 24 connection, database 23, 24 constraints, integrity 21 CREATE SUBDIRS command 15, 16
A
ADDEVENTS Windows service option 18 ADDSERVICE Windows service option 18 API privileges for Oracle GoldenGate 14 archive logs on tape 29 retaining 29 ASCII, converting to EBCDIC 6 attachment type 2 AUTOSTART Windows service option 18
D
DATA CAPTURE CHANGES 28 data types, supported 6, 7 database character sets 23 connections 23 logs, preparing 28 requirements 5 versions supported 1 DB2 Connect connection option 11 DBOPTIONS parameter 23 DDL operations 7 DECFLOAT data type 7 deleteevents 32 deletes, cascaded 21 deleteservice 32 disk requirements 2 DSN6LOGP MAXARCH system parameter 29 DSN6SYSP MON 29 DSNACLI plan name 23 DSNAOINI environment variable 23 DSNHDECP load module, access to 24 DSNTIJUZ installation job 29 DSNTIPE 24
B
bootstrap data set, specifying 28 BPX_JOBNAME environment variable 25 BPX_USERID environment variable 25
C
C Compiler 4 CAF attachment type 2 cascade deletes, disabling 21 cascade updates, disabling 21 case, supported 8 category.dll 18 change capture, enabling 28 character sets, configuring 23 characters ASCII, EBCDIC conversion 6 supported in object names 8 cluster installing on 16, 19 removing from 31
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 44
Index
E
E
EBCDIC, converting to from ASCII 6 environment variables, setting 13 exit routines 8
L
large objects, limitations on 7 LE Runtime Libraries 1 LIBPATH variable 14 Linux, installing on 16 load modules, accessing 24 LOCATION parameter 23 logs, configuring for Oracle GoldenGate 21
F
files, installed by Oracle GoldenGate 34 firewall, configuring 4 flushes of logs, controlling 30
M G
ggmessage.dat file 40 GGSMGR default Manager name 17 ggsmsg.dll 18 GLOBALS file 17 Gzip 4 Manager as Windows service 17 multiple on same system 17 name, customizing 17 MANUALSTART Windows service option 18 MAX BATCH CONNECT parameter 24 MAX TSO CONNECT parameter 24 MAX USERS parameter 24 Memory requirements for Oracle GoldenGate 2 messages, Oracle GoldenGate 26 MGRSERVNAME parameter 17 MONITOR TRACE 29 Monitor Trace Class 1, enabling 28 monitoring, guidelines for 26 MULTICONTEXT parameter 23 MVSATTACHTYPE parameter 23 MVSDEFAULTSSID parameter 23
H
HIPER maintenance 4
I
IFI IFCID 306 14 initialization file, path to 23 initialization parameters, setting 23 installing on Linux and UNIX 16 Windows 16 intermediary installation system 11
N
name non-supported characters in 10 supported characters in 8 names, supported 8 network configuration 4 NOCATALOGCONNECT option, DBOPTIONS 23 NOFLUSH option, TRANLOGOPTIONS 30
J
job name and owner, Oracle GoldenGate 25
K
key assigning 21 name, supported characters 8 storage in ECSA 14 KEYCOLS option, TABLE or MAP 22
O
OMVS command, running Oracle GoldenGate under 25 Open Database Connectivity (ODBC) requirements 1, 5
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 45
Index
P
Open MVS, DB2 1 operating systems supported 1 Oracle GoldenGate installed programs and files 34 installing 11 uninstalling 31 Oracle, versions supported 1
spaces address and velocity goals 25 in folder names 16 in object and column names 10 SQL Server requirements 5 SQLEXEC, and velocity goals 25 STEPLIB environment variable 1 subdirectories, creating 15, 16 SYSIBM.LOCATIONS table 5 syslogd, and Oracle GoldenGate messages 26 system requirements 1
P
PASSWORD Windows service option 18 permissions operating system 4 PLANNAME parameter 23 platforms, supported 1 ports, required by Oracle GoldenGate 4 pre-installation instructions 1 privileged API, using 14 privileges database 6 operating system 4 processes, monitoring 26 Program Temporary Fixes 4
T
tables creating with DATA CAPTURE CHANGES 29 preparing for processing 21 supported kinds 7 SYSIBM, select on 6 tape, archive logs on 29 TCP/IP, configuring 4 Thread Management Panel 24 threads, connection 24 Time Sharing Option Extensions 4 TRANLOGOPTIONS parameter 30 transaction logs active, access to 28 API privileges 14 archived on tape 29 enabling change capture 28 flushes, controlling 30 initial position in 28 sizing and retaining 29 transaction logs, configuring for Oracle GoldenGate 21 triggers, disabling on target 21 TRUNCATE TABLE 7
R
RACF command processor 4 Recoverable Resource Manager Services 2 remote connection 11 removing Oracle GoldenGate 31 ROWID columns, correct definition for 22 rows, number and size supported 7 RRSAF attachment type 2
S
SCEERUN library 2 SDSNLOAD library, access to 24 SHLIB_PATH variable 14
U
uninstalling Oracle GoldenGate 31 Unix System Services 1 UNIX, installing on 16 USER Windows service option 18
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 46
Index
V
user-defined types 7
W
Windows, installing on 16 WLM velocity goals, setting 25 Workload Manager velocity goals 25
V
VAMSERV program 35 velocity goals, setting 25 versions of Oracle supported 1 virtual memory requirements 2
X
XML data type 7
..............................................................................
Oracle GoldenGate DB2 z/OS Installation and Setup Guide 47