Real-Time Data Replication to Hadoop using GoldenGate 12c Adaptors
gavinsoorma.com.au · Web viewGoldenGate 12c Advanced Workshop Lab Exercise 4 21 21 GoldenGate 12c...
Transcript of gavinsoorma.com.au · Web viewGoldenGate 12c Advanced Workshop Lab Exercise 4 21 21 GoldenGate 12c...
GoldenGate 12c Advanced Workshop
Hands-on Lab Exercise 4
Install and Configure Oracle GoldenGate Monitor 12.2
Download Fusion Middleware 12.2.1.2.0 from Oracle Software Delivery Cloud
Download Oracle GoldenGate Monitor and Veridata 12.1.3.0.0
Check the current Java version
[oracle@host01 admin]$ java -version
java version "1.7.0_51"
OpenJDK Runtime Environment (rhel-2.4.5.5.0.1.el7-x86_64 u51-b31)
OpenJDK 64-Bit Server VM (build 24.51-b03, mixed mode)
Note: The requirement for Oracle GoldenGate Monitor is Java SE, JDK 8u40 and greater
Download and Install Java JDK 8
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
[oracle@host01 sf_software]$ ls jdk-8*
jdk-8u131-linux-x64.tar.gz
[oracle@host01 sf_software]$ cp jdk-8u131-linux-x64.tar.gz /home/oracle
[oracle@host01 ~]$ gunzip jdk-8u131-linux-x64.tar.gz
[oracle@host01 ~]$ tar -xvf jdk-8u131-linux-x64.tar
Add the JAVA_HOME variable to the .bash_profile
[oracle@host01 ~]$ vi .bash_profile
export JAVA_HOME=/home/oracle/jdk1.8.0_131
PATH=$JAVA_HOME/bin:$PATH:$HOME/.local/bin:$HOME/bin
[oracle@host01 ~]$ . ./.bash_profile
[oracle@host01 ~]$ java -version
java version "1.8.0_131"
Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode)
Install Fusion Middleware Infrastructure 12.2.1.2.0
[oracle@linux01 fmw_12.2.1.2.0_infrastructure]$ pwd
/media/sf_software/fmw_12.2.1.2.0_infrastructure
[oracle@linux01 fmw_12.2.1.2.0_infrastructure]$ java -Djava.io.tmpdir=/u01/app/oracle -jar fmw_12.2.1.2.0_infrastructure.jar
Launcher log file is /u03/app/oracle/OraInstall2017-05-22_02-59-36PM/launcher2017-05-22_02-59-36PM.log.
Extracting the installer . . . . . . . . . . . . . . . . . . . . . Done
Checking if CPU speed is above 300 MHz. Actual 2494.222 MHz Passed
Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed
Checking swap space: must be greater than 512 MB. Actual 2047 MB Passed
Checking if this platform requires a 64-bit JVM. Actual 64 Passed (64-bit not required)
Checking temp space: must be greater than 300 MB. Actual 10324 MB Passed
Preparing to launch the Oracle Universal Installer from /u03/app/oracle/OraInstall2017-05-22_02-59-36PM
Log: /u03/app/oracle/OraInstall2017-05-22_02-59-36PM/install2017-05-22_02-59-36PM.log
Install GoldenGate Monitor Server 12.2
[oracle@rac01 sf_software]$ cd fmw_12.2.1.2.0_ogg
[oracle@rac01 fmw_12.2.1.2.0_ogg]$ ls
fmw_12.2.1.2.0_ogg.jar fmw_12212_readme.htm
[oracle@linux01 fmw_12.2.1.2.0_ogg]$ java -Djava.io.tmpdir=/u01/app/oracle -jar fmw_12.2.1.2.0_ogg.jar
Launcher log file is /u03/app/oracle/OraInstall2017-05-22_04-03-41PM/launcher2017-05-22_04-03-41PM.log.
Extracting the installer . . . . . . . . . . Done
Checking if CPU speed is above 300 MHz. Actual 2494.222 MHz Passed
Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed
Checking swap space: must be greater than 512 MB. Actual 2047 MB Passed
Checking if this platform requires a 64-bit JVM. Actual 64 Passed (64-bit not required)
Checking temp space: must be greater than 300 MB. Actual 9495 MB Passed
Preparing to launch the Oracle Universal Installer from /u03/app/oracle/OraInstall2017-05-22_04-03-41PM
Log: /u03/app/oracle/OraInstall2017-05-22_04-03-41PM/install2017-05-22_04-03-41PM.log
Click on View
Create required schemas using Repository Creation Utility (RCU)
[oracle@rac01 fmw_12.2.1.2.0_ogg]$ cd /u01/app/oracle/middleware/oracle_common/bin
[oracle@rac01 bin]$ ./rcu
Create the WebLogic Domains
[oracle@rac01 bin]$ cd /u01/app/oracle/middleware/oracle_common/common/bin
[oracle@rac01 bin]$ ./config.sh
Select Oracle GoldenGate Monitor Server template
Select the option Production
Click on Get RCU Configuration
Enter the password for the OS user oracle
Select options Administration Server and Topology
Note the Managed Server Name and the port
Click Next
Click Next
Click Next
Click Next
Click Next
Click Create
Edit the monitor.properties file
[oracle@rac01 bin]$ cd /u01/app/oracle/middleware/user_projects/domains/base_domain/config/monitorserver/cfg
[oracle@rac01 cfg]$ vi monitor.properties
# underscore in JMX server's hostname is not valid e.g. XXX_YZW is invalid JMX server's host name
monitor.jmx.server.host=host01
#Port that is bound by the JMX server
monitor.jmx.server.port=5502
#JMX server's user
monitor.jmx.server.user=oracle
Execute the updateOGGMonitorConfig.sh script to configure security
[oracle@rac01 cfg]$ cd /u01/app/oracle/middleware/oggmon/monitor_server/bin
[oracle@rac01 bin]$ ./updateOGGMonitorConfig.sh
This script utility is used to update configuration information for monitor server. All feilds are mandatory. Press Ctrl+C to exit.
Enter absolute path for oggmon domain:
/u01/app/oracle/middleware/user_projects/domains/base_domain
You have entered the domain path as : /u01/app/oracle/middleware/user_projects/domains/base_domain
Enter JMX HOST NAME/IP:host01
Enter JMX Server Port:5502
Enter JMX Server Username:oracle
Enter the database type for Monitor Installation.
For Oracle Database, Press 1. For SQL Server, Press 2:1
Jul 11, 2017 8:33:45 AM oracle.security.jps.JpsStartup start
INFO: Jps initializing.
Jul 11, 2017 8:33:50 AM org.hibernate.validator.internal.util.Version
INFO: HV000001: Hibernate Validator 5.1.3.Final
Jul 11, 2017 8:34:04 AM oracle.security.jps.JpsStartup start
INFO: Jps started.
Jul 11, 2017 8:34:06 AM oracle.security.audit.Auditor init
WARNING: IAU:IAU-6012: Unable to determine the audit log directory. No log directory specified.
Jul 11, 2017 8:34:06 AM oracle.security.jps.util.JpsUtil disableAudit
INFO: JpsUtil: isAuditDisabled set to true
Jul 11, 2017 8:34:06 AM oracle.security.jps.internal.audit.AuditServiceImpl validateLogPossible
WARNING: No audit log directory is set. Cannot perform audit operations for component JPS.
Created Secure Key properties file.
Added Secure Key into Monitor Server Oracle Wallet.
Install the Oracle GoldenGate Monitor Agent
[oracle@host01 bin]$ cd /media/sf_software/fmw_12.2.1.2.0_ogg/
[oracle@host01 fmw_12.2.1.2.0_ogg]$ ls -l
total 435577
-rwxrwx---. 1 root vboxsf 446021430 May 22 16:01 fmw_12.2.1.2.0_ogg.jar
-rwxrwx---. 1 root vboxsf 8986 May 22 16:01 fmw_12212_readme.htm
[oracle@rac01 fmw_12.2.1.2.0_ogg]$ java -jar fmw_12.2.1.2.0_ogg.jar
Launcher log file is /tmp/OraInstall2017-07-11_09-22-38AM/launcher2017-07-11_09-22-38AM.log.
Extracting the installer . . . . . . . . . . . Done
Checking if CPU speed is above 300 MHz. Actual 2494.234 MHz Passed
Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed
Checking swap space: must be greater than 512 MB. Actual 3071 MB Passed
Checking if this platform requires a 64-bit JVM. Actual 64 Passed (64-bit not required)
Checking temp space: must be greater than 300 MB. Actual 1336 MB Passed
Preparing to launch the Oracle Universal Installer from /tmp/OraInstall2017-07-11_09-22-38AM
Log: /tmp/OraInstall2017-07-11_09-22-38AM/install2017-07-11_09-22-38AM.log
Enter the FMW Oracle Home location and click on the View button
Select option Oracle GoldenGate Monitor Agent
Start the WebLogic Admin Server
[oracle@host01 fmw_12.2.1.2.0_ogg]$ cd /u01/app/oracle/middleware/user_projects/domains/base_domain/
[oracle@host01 base_domain]$ cd servers/
[oracle@host01 servers]$ cd AdminServer/
[oracle@host01 AdminServer]$ mkdir security
[oracle@host01 AdminServer]$ cd security
[oracle@host01 security]$ vi boot.properties
username=weblogic
password=w3bl0g1c
[oracle@host01 bin]$ pwd
/u01/app/oracle/middleware/user_projects/domains/base_domain/bin
[oracle@host01 base_domain]$ nohup ./startWebLogic.sh &
[oracle@host01 base_domain]$ tail -f nohup.out
….
…..
Start the WebLogic Managed Server
[oracle@host01 MONITORSERVER_server1]$ pwd
/u01/app/oracle/middleware/user_projects/domains/base_domain/servers/MONITORSERVER_server1
[oracle@host01 MONITORSERVER_server1]$ mkdir security
[oracle@host01 MONITORSERVER_server1]$ cd security
[oracle@host01 security]$ vi boot.properties
username=weblogic
password=w3bl0g1c
[oracle@host01 security]$ cd /u01/app/oracle/middleware/user_projects/domains/base_domain/bin
[oracle@linux01 middleware]$ nohup ./startManagedWebLogic.sh MONITORSERVER_server1 http://host01:7001 &
[oracle@linux01 middleware]$ tail -f nohup.out
Create the OGGMON WebLogic User
Launch WebLogic Console
http://host01:7001/console/login/LoginForm.jsp
Click on Security Realms menu
Click on myrealm
Click on Users and Groups tab and then the New button
Click on oggmon
Click on Groups
Click on Save
Click on Log Out
Configure the GoldenGate Monitor Agent
[oracle@linux01 ogg_agent]$ mkdir /u01/app/oracle/ogg_agent_inst
[oracle@linux01 ogg_agent]$ cd /u01/app/oracle/middleware/oggmon/ogg_agent
[oracle@rac01 ogg_agent]$ ./createMonitorAgentInstance.sh
Please enter absolute path of Oracle GoldenGate home directory : /u01/app/oracle/ogg
Please enter absolute path of OGG Agent instance : /u01/app/oracle/ogg_agent_inst
Please enter unique name to replace timestamp in startMonitorAgent script (startMonitorAgentInstance_20170711095808.sh) : oggmon_hol
Successfully created OGG Agent instance.
[oracle@rac01 ogg_agent]$ cp /u01/app/oracle/middleware/user_projects/domains/base_domain/config/monitorserver/cfg/oggmon.properties /u01/app/oracle/ogg_agent_inst/cfg/
[oracle@rac01 ogg_agent]$ cd /u01/app/oracle/ogg_agent_inst/cfg/
[oracle@rac01 cfg]$ vi Config.properties
jagent.host=host01
####################################################################
## jagent.jmx.port: jAgent's JMX port number ###
####################################################################
jagent.jmx.port=5555
####################################################################
monitor.host=host01
####################################################################
## monitor.jmx.port: Monitor Server JMX port number ###
####################################################################
monitor.jmx.port=5502
####################################################################
monitor.jmx.username=oracle
####################################################################
## jagent.username: jAgent username ###
## It can be any name. This jAgent username will be passed to ###
## Monitor Server during jAgent registration. ###
####################################################################
jagent.username=oracle
agent.type.enabled=OGGMON
Update JAGENT password in the Wallet
[oracle@host01 ~]$ cd /u01/app/oracle/ogg_agent_inst/bin
[oracle@linux01 bin]$ ./pw_agent_util.sh -create
Please create a password for Java Agent:
Please confirm password for Java Agent:
Please enter Monitor Server JMX password:
Please confirm Monitor Server JMX password:
May 24, 2017 10:19:35 PM oracle.security.jps.JpsStartup start
INFO: Jps initializing.
May 24, 2017 10:19:36 PM oracle.security.jps.JpsStartup start
INFO: Jps started.
Wallet is created successfully.
Configure and start GoldenGate JAGENT
[oracle@rac01 bin]$ cd /u01/app/oracle/ogg
[oracle@rac01 ogg]$ ./ggsci
GGSCI (rac01.localdomain) 1> edit params ./GLOBALS
ENABLEMONITORING
GGSCI (host01.localdomain) 2> exit
[oracle@rac01 ogg]$ ./ggsci
GGSCI (rac01.localdomain) 17> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
JAGENT STOPPED
EXTRACT RUNNING EXT1 00:18:00 00:00:00
EXTRACT RUNNING PUMP1 00:00:00 00:00:03
GGSCI (rac01.localdomain) 18> start jagent
Sending START request to MANAGER ...
GGCMD JAGENT starting
GGSCI (rac01.localdomain) 19> info jagent
JAgent is running.
GGSCI (rac01.localdomain) 40> stop mgr!
Sending STOP request to MANAGER ...
Request processed.
Manager stopped.
GGSCI (host01.localdomain) 5> stop jagent !
Sending STOP request to GGCMD JAGENT ...
Request processed.
JAgent stopped.
GGSCI (host01.localdomain) 6> stop er *
Sending STOP request to EXTRACT EXT1 ...
Request processed.
Sending STOP request to EXTRACT PUMP1 ...
Request processed.
Sending STOP request to REPLICAT REP1 ...
Request processed.
GGSCI (rac01.localdomain) 44> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER STOPPED
JAGENT STOPPED
EXTRACT STOPPED EXT1 00:00:13 00:00:15
EXTRACT STOPPED PUMP1 00:00:00 00:00:14
GGSCI (rac01.localdomain) 45> delete datastore
Are you sure you want to delete the datastore? y
2017-07-11T03:09:47Z INFO OGG-06492 Datastore deleted
GGSCI (rac01.localdomain) 46> create datastore
Profile 'Trace' added.
2017-07-11T03:09:52Z INFO OGG-06489 Datastore created
GGSCI (rac01.localdomain) 47> start mgr
Manager started.
GGSCI (rac01.localdomain) 48> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
JAGENT STOPPED
EXTRACT STARTING EXT1 00:00:13 00:00:37
EXTRACT RUNNING PUMP1 00:00:00 00:00:36
GGSCI (rac01.localdomain) 49> start jagent
Sending START request to MANAGER ...
GGCMD JAGENT starting
GGSCI (rac01.localdomain) 50> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
JAGENT RUNNING
EXTRACT RUNNING EXT1 00:00:56 00:00:06
EXTRACT RUNNING PUMP1 00:00:00 00:00:10
Launch Oracle GoldenGate Monitor
http://host01:7003/monitor/faces/loginPage.jspx
21