© 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add...

31
© 2005 Solution Beacon, LLC. All Rights Reserved. Release 11 Release 11 i i Workshops Workshops Release 11 Release 11 i i … Please Add RAC … Please Add RAC Session Leader Kevin Dahl, Solution Beacon Release 11i Workshops San Ramon, CA Worthington, MA Los Angeles, CA St. Louis, MO Orlando, FL www.solutionbeacon.com TRAIL to TEXAS sm

description

© 2005 Solution Beacon, LLC. All Rights Reserved. 3 Introduction Install 11iInstall 9iUpgrade 8i to 9i Configure RAC Install SUN Cluster 3.0 OVERVIEW

Transcript of © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add...

Page 1: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

© 2005 Solution Beacon, LLC. All Rights Reserved.

Release 11Release 11ii Workshops Workshops

Release 11Release 11ii … Please Add RAC… Please Add RACSession LeaderKevin Dahl, Solution Beacon

Release 11i WorkshopsSan Ramon, CA • Worthington, MA •

Los Angeles, CA • St. Louis, MO • Orlando, FLwww.solutionbeacon.com

TRAIL to TEXAS sm

Page 2: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

2© 2005 Solution Beacon, LLC. All Rights Reserved.

Introduction The ChallengeThe Challenge

– Customer wanted to run Release Customer wanted to run Release 1111ii and could only afford to be and could only afford to be down 5 minutesdown 5 minutes

The 50,000 Foot Solution The 50,000 Foot Solution – Implement SUN Cluster 3.0 on 2 Implement SUN Cluster 3.0 on 2

nodesnodes– Implement 11Implement 11ii with 9i RAC with 9i RAC– Utilize 2 apps serversUtilize 2 apps servers

Page 3: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

3© 2005 Solution Beacon, LLC. All Rights Reserved.

Introduction

Install 11i Install 9i Upgrade 8i to 9i

Configure RAC

Install SUN

Cluster 3.0

OVERVIEW

Page 4: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

4© 2005 Solution Beacon, LLC. All Rights Reserved.

Choosing the Oracle Software 1111ii and RAC and RAC

– Customer decided Release 11Customer decided Release 11ii would would best meet their software needsbest meet their software needs

– Explained that Oracle9Explained that Oracle9ii Real Real Application Clusters (RAC) was an Application Clusters (RAC) was an architecture that allowed multiple architecture that allowed multiple instances to access a shared instances to access a shared database of datafilesdatabase of datafiles

– Customer was shown that Oracle9Customer was shown that Oracle9ii RAC would meet their 5 minutes RAC would meet their 5 minutes down time requirementdown time requirement

Page 5: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

5© 2005 Solution Beacon, LLC. All Rights Reserved.

Choosing the Hardware What was chosen?What was chosen?

– SUN V880s. 2 clustered nodes for SUN V880s. 2 clustered nodes for backend, and 2 non-clustered nodes for backend, and 2 non-clustered nodes for middle tiermiddle tier

– A T3 storage array is in the same storage A T3 storage array is in the same storage enclosure as the SunFire V880. That enclosure as the SunFire V880. That means there are two T3 storage arrays means there are two T3 storage arrays connected via an optical hub. The arrays connected via an optical hub. The arrays provide both storage that is local to a provide both storage that is local to a given database server and storage that is given database server and storage that is shared between the two database servers shared between the two database servers

Page 6: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

6© 2005 Solution Beacon, LLC. All Rights Reserved.

Implementation – Hardware

Router

app1application server

Oracle9i

RAID-5, RAW Database Files onT-3 Shared Disk Array

(Real Application Cluster)

sundb2

Router

WAN

Desktop Web-Client Desktop Web-Client

LAN

The type of LAN shown just below thistext will be used at all client locations:

Los Angeles Louisville El Paso Taipai Korea Germany Mexico Canada

El Paso, TXData Center

FDDI EthernetBackbone 100 Mbps

TCP/IP

sundb1

app2application server

Page 7: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

7© 2005 Solution Beacon, LLC. All Rights Reserved.

Implementation – SUN Cluster 3.0

Install SUN Cluster 3.0 (SUN did this)Install SUN Cluster 3.0 (SUN did this)– A cluster is a collection of loosely A cluster is a collection of loosely

coupled computing nodes that provides coupled computing nodes that provides a single client view of network services a single client view of network services or applications, including databases, or applications, including databases, web services, and file servicesweb services, and file services

– Each cluster node is a standalone Each cluster node is a standalone server that runs its own processes. server that runs its own processes. These processes can communicate with These processes can communicate with one another to form a virtual single one another to form a virtual single systemsystem

Page 8: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

8© 2005 Solution Beacon, LLC. All Rights Reserved.

11i RACLeaving the Overview – The Detail

Page 9: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

9© 2005 Solution Beacon, LLC. All Rights Reserved.

Implementation – Release 11i Install Release 11Install Release 11ii via Rapidwiz via Rapidwiz

– 2-tier2-tier– post install stepspost install steps– backed up databasebacked up database

Page 10: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

10 © 2005 Solution Beacon, LLC. All Rights Reserved.

Get 11i Ready for 9i

Applied Interoperability PatchApplied Interoperability Patch– This patch is necessary for This patch is necessary for

Oracle9Oracle9ii to be used in place of to be used in place of Oracle8Oracle8ii when using Release 11 when using Release 11ii

– The patch number is 1833692The patch number is 1833692

Page 11: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

11 © 2005 Solution Beacon, LLC. All Rights Reserved.

Install Oracle9i (9.0.1) runInstallerrunInstaller

– chose enterprise installation typechose enterprise installation type– did NOT install a databasedid NOT install a database

Modify init.ora and iflecbo.oraModify init.ora and iflecbo.ora– copied init and ifilecbo and copied init and ifilecbo and

modified as follows:modified as follows: remove obsolete parmsremove obsolete parms set aq_tm_processes = 0set aq_tm_processes = 0 set job_queue_processes = 0set job_queue_processes = 0

Page 12: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

12 © 2005 Solution Beacon, LLC. All Rights Reserved.

Install Oracle9i (9.0.1)... Modify init.ora and iflecbo.ora... Modify init.ora and iflecbo.ora...

Set the parameter _SYSTEM_TRIG_ENABLED to Set the parameter _SYSTEM_TRIG_ENABLED to FALSE FALSE

change ifile entry in the init.ora to point to new change ifile entry in the init.ora to point to new locationlocation

db_block_buffers= (at least 2000) db_block_buffers= (at least 2000) shared_pool_size= (at least 150MB) shared_pool_size= (at least 150MB) java_pool_size= (at least 20MB) java_pool_size= (at least 20MB) cluster_database=falsecluster_database=false event="10619 trace name context forever, level 1"event="10619 trace name context forever, level 1" event=”10932 trace name context level 32768“event=”10932 trace name context level 32768“ event=”10933 trace name context level 512“event=”10933 trace name context level 512“ event=”10943 trace name context level 16384“event=”10943 trace name context level 16384“

Page 13: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

13 © 2005 Solution Beacon, LLC. All Rights Reserved.

Upgrade Oracle9i 9.0.1 db to 9.0.1.3 (1/03 upgraded to 9.0.1 db to 9.0.1.3 (1/03 upgraded to

9.0.1.4)9.0.1.4) note these are the Oracle9note these are the Oracle9ii binaries just binaries just

installed -- not the Release11installed -- not the Release11ii db db installed (it’s Oracle8installed (it’s Oracle8ii))

done via patch 2271678done via patch 2271678 DO NOTDO NOT PERFORM any sql scripts, PERFORM any sql scripts,

database update steps or POST INSTALL database update steps or POST INSTALL STEPS NOW -- DO THOSE AFTER THE STEPS NOW -- DO THOSE AFTER THE 8.1.7.3 DATABASE IS UPGRADED8.1.7.3 DATABASE IS UPGRADED

Page 14: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

14 © 2005 Solution Beacon, LLC. All Rights Reserved.

Upgrade Apps 8i to 9i 8.1.7.3 db to 9.0.1.3 8.1.7.3 db to 9.0.1.3

include 9.0.1.3 home in ORACLE_HOME, include 9.0.1.3 home in ORACLE_HOME, PATH, LD_LIBRARY_PATH PATH, LD_LIBRARY_PATH

start db restrict using modified init.orastart db restrict using modified init.ora run upgrade script u0801070.sql (runs run upgrade script u0801070.sql (runs

several hours)several hours) run $ORACLE_HOME/rdbms/admin/utlip.sql run $ORACLE_HOME/rdbms/admin/utlip.sql

because db was moving from 32 to 64 bitbecause db was moving from 32 to 64 bit shutdown Oracle9shutdown Oracle9ii db db

Page 15: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

15 © 2005 Solution Beacon, LLC. All Rights Reserved.

Upgrade Apps 8i to 9i 8.1.7.3 db to 9.0.1.3... 8.1.7.3 db to 9.0.1.3...

Re-adjusted init.ora fileRe-adjusted init.ora file Changed _system_trig_enabled = TUREChanged _system_trig_enabled = TURE O7_DICTIONARY_ACCESSIBILITY=TRUEO7_DICTIONARY_ACCESSIBILITY=TRUE Optimizer_features_enable = 9.0.1Optimizer_features_enable = 9.0.1 restarted dbrestarted db

ran relevant scripts per Oracle9ran relevant scripts per Oracle9ii migration migration manualmanual Jserver, XDK for java, Session Jserver, XDK for java, Session

Namespace, CORBA and OSE, jsp, Namespace, CORBA and OSE, jsp, oracle spatial, intermedia, oracle textoracle spatial, intermedia, oracle text

ran post install steps per patch 2271678ran post install steps per patch 2271678

Page 16: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

16 © 2005 Solution Beacon, LLC. All Rights Reserved.

Upgrade Apps 8i to 9i

8.1.7.3 db to 9.0.1.3... 8.1.7.3 db to 9.0.1.3... Copy/Modify the listener.ora Copy/Modify the listener.ora

and tnsnames.ora to reflect and tnsnames.ora to reflect Oracle9Oracle9ii locations locations

reset the following in init.orareset the following in init.ora•set aq_tm_processes set aq_tm_processes parameter = 1parameter = 1

•set job_queue_processes = 2set job_queue_processes = 2

Page 17: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

17 © 2005 Solution Beacon, LLC. All Rights Reserved.

More 11i Adjustments for 9i Remove from applora.txtRemove from applora.txt

_complex_view_merging_complex_view_merging_optimizer_mode_force_optimizer_mode_force_optimizer_undo_changes_optimizer_undo_changes_or_expand_nvl_predicate_or_expand_nvl_predicate_ordered_nested_loop_ordered_nested_loop_push_join_predicate_push_join_predicate_push_join_union_view_push_join_union_view_sort_elimination_cost_ratio_sort_elimination_cost_ratio_use_column_stats_for_function_use_column_stats_for_functionalways_anti_joinalways_anti_joinalways_semi_joinalways_semi_joinoptimizer_percent_paralleloptimizer_percent_parallel

Page 18: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

18 © 2005 Solution Beacon, LLC. All Rights Reserved.

More 11i Adjustments for 9i ... Perform object maintenancePerform object maintenance

– Compile all apps objectsCompile all apps objects– Recreate grants and synonyms Recreate grants and synonyms

(adadmin)(adadmin) Increase MAXINSTANCES parameterIncrease MAXINSTANCES parameter

– to change this parameter, the database to change this parameter, the database control file needs to be recreated, control file needs to be recreated, MAXINSTANCES parameter modified MAXINSTANCES parameter modified and the create control file sql executedand the create control file sql executed

shutdown/backup DBshutdown/backup DB

Page 19: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

19 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC Raw files are required Raw files are required

– shutdown dbshutdown db– cooked files must become rawcooked files must become raw– shared disk volumes must be configured shared disk volumes must be configured

for for database files database files redologsredologs control filescontrol files

existing cooked files copied to raw existing cooked files copied to raw locationslocations

the above was done with a combination the above was done with a combination veritas and dd commandsveritas and dd commands

Page 20: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

20 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... Modify init.ora…node 1Modify init.ora…node 1

– modified init.ora for RACmodified init.ora for RAC•maxinstances=2 (customer had 2 maxinstances=2 (customer had 2

nodes)nodes)•cluster_database=truecluster_database=true•instance_name=mcprod1instance_name=mcprod1•instance_number=1instance_number=1•thread=1thread=1•local_listener = local_listener =

"(address=(port=1522)"(address=(port=1522)(protocol=tcp)(host=sundb1))"(protocol=tcp)(host=sundb1))"

Page 21: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

21 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... Change db file locations…node 1Change db file locations…node 1

– create a sql script that will alter create a sql script that will alter the location of the database files the location of the database files to reflect the new raw locationsto reflect the new raw locations

– startup the database mountstartup the database mount– run the alter sql created aboverun the alter sql created above

Page 22: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

22 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... Modify init.ora…node 2Modify init.ora…node 2

– ensure instance is shutdownensure instance is shutdown– modified init.ora for RACmodified init.ora for RAC

•maxinstances=2 (customer had 2 maxinstances=2 (customer had 2 nodes)nodes)

•cluster_database=truecluster_database=true•instance_name=mcprod2instance_name=mcprod2•instance_number=2instance_number=2•thread=2thread=2•local_listener = local_listener =

"(address=(port=1522)(protocol=tcp)"(address=(port=1522)(protocol=tcp)(host=sundb2))"(host=sundb2))"

Page 23: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

23 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... Configure listener.ora on node 1Configure listener.ora on node 1

mcprod1 =mcprod1 = (DESCRIPTION =(DESCRIPTION = (LOAD_BALANCE = OFF)(LOAD_BALANCE = OFF) (ADDRESS = (PROTOCOL = TCP)(HOST = sundb1)(ADDRESS = (PROTOCOL = TCP)(HOST = sundb1)

(PORT = 1522))(PORT = 1522)) ))SID_LIST_mcprod1 =SID_LIST_mcprod1 = (SID_LIST =(SID_LIST = (SID_DESC =(SID_DESC = (ORACLE_HOME = /u20/oracle/mc11idb)(ORACLE_HOME = /u20/oracle/mc11idb) (SID_NAME = mcprod1)))(SID_NAME = mcprod1)))

Page 24: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

24 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... Configure listener.ora on node 2Configure listener.ora on node 2

mcprod2 =mcprod2 = (DESCRIPTION =(DESCRIPTION = (LOAD_BALANCE = OFF)(LOAD_BALANCE = OFF) (ADDRESS = (PROTOCOL = TCP)(HOST = (ADDRESS = (PROTOCOL = TCP)(HOST =

sundb2)(PORT = 1522))sundb2)(PORT = 1522)) ))SID_LIST_mcprod2 =SID_LIST_mcprod2 = (SID_LIST =(SID_LIST = (SID_DESC =(SID_DESC = (ORACLE_HOME = /u20/oracle/mc11idb)(ORACLE_HOME = /u20/oracle/mc11idb) (SID_NAME = mcprod2)))(SID_NAME = mcprod2)))

Page 25: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

25 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... tnsnames.oratnsnames.ora

mcprod2=mcprod2=(description=(description= (address=(protocol=tcp)(host=sundb2)(address=(protocol=tcp)(host=sundb2)

(port=1522))(port=1522)) (connect_data=(service_name=mcprod)))(connect_data=(service_name=mcprod)))mcprod1=mcprod1= (description=(description= (address=(protocol=tcp)(host=sundb1)(address=(protocol=tcp)(host=sundb1)

(port=1522))(port=1522)) (connect_data=(service_name=mcprod)))(connect_data=(service_name=mcprod)))

Page 26: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

26 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... Tnsnames.ora…Tnsnames.ora…

mcprod=mcprod= (description=(load_balance=off)(failover=on)(description=(load_balance=off)(failover=on) (address_list= (address=(protocol=tcp)(address_list= (address=(protocol=tcp)

(host=sundb1)(port=1522))(host=sundb1)(port=1522)) (address=(protocol=tcp)(host=sundb2)(address=(protocol=tcp)(host=sundb2)

(port=1522)) )(port=1522)) ) (connect_data=(service_name=mcprod) (connect_data=(service_name=mcprod)

(failover_mode=(type=select)(failover_mode=(type=select)(method=basic)(method=basic)

(backup=mcprod2))))(backup=mcprod2))))

Page 27: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

27 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC...

Start Instances and APPSStart Instances and APPS– started instance 1: startup parallelstarted instance 1: startup parallel– added redo thread for instance 2added redo thread for instance 2– started instance 2: startup parallelstarted instance 2: startup parallel– started relevant apps processes on db started relevant apps processes on db

tiertier– started relevant apps processes on started relevant apps processes on

app tierapp tier

Page 28: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

28 © 2005 Solution Beacon, LLC. All Rights Reserved.

Add RAC... A virtual middle tierA virtual middle tier

– Round robin dns was implemented Round robin dns was implemented because this customer had 2 apps boxes; because this customer had 2 apps boxes; Round robin dns requires adjustments to Round robin dns requires adjustments to dns entries resulting in the ability to dns entries resulting in the ability to access either apps server with the same access either apps server with the same name; Later, this was replaced with Big IPname; Later, this was replaced with Big IP

Parallel Concurrent ProcessingParallel Concurrent Processing– Concurrent processing was parallelized Concurrent processing was parallelized

according the instructions in the system according the instructions in the system administration guide for Release 11administration guide for Release 11ii and and MetaLink note 185489.1; In addition, a MetaLink note 185489.1; In addition, a transaction manager should be setup via transaction manager should be setup via MetaLink note 240818.1MetaLink note 240818.1

Page 29: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

29 © 2005 Solution Beacon, LLC. All Rights Reserved.

Conclusion The process is complexThe process is complex

– Release 11Release 11ii increases the complexity increases the complexity of implementing RACof implementing RAC

– RAC increases the complexity of RAC increases the complexity of managing Release 11managing Release 11ii (use oem and (use oem and veritas volume mgr)veritas volume mgr)

– Attention gettersAttention getters•Parallel concurrent processingParallel concurrent processing•Middle tier load balancingMiddle tier load balancing•Management of raw filesManagement of raw files

Page 30: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

30 © 2005 Solution Beacon, LLC. All Rights Reserved.

References Sources used for this presentationSources used for this presentation

metalink note 162091 – Interoperablility Notes: metalink note 162091 – Interoperablility Notes: Oracle Applications Release 11Oracle Applications Release 11ii with Oracle9 with Oracle9ii Release 9.0.1Release 9.0.1

metalink note 183649.1 – Database upgrade metalink note 183649.1 – Database upgrade from 32 to 64 bit (This note was written for from 32 to 64 bit (This note was written for Oracle8Oracle8ii - ensure you ignore items that no - ensure you ignore items that no longer apply to Oracle9longer apply to Oracle9ii

Oracle White paper by Ahmed Alomari of Oracle Oracle White paper by Ahmed Alomari of Oracle Corporation: Migrating Your E-Business Suite Corporation: Migrating Your E-Business Suite Single Instance to Real Application Clusters Single Instance to Real Application Clusters (RAC)(RAC)

Oracle9Oracle9ii Database Migration Manual, Part Database Migration Manual, Part Number A90191-02 (Manual upgrade section)Number A90191-02 (Manual upgrade section)

several tarsseveral tars

Page 31: © 2005 Solution Beacon, LLC. All Rights Reserved. Release 11i Workshops Release 11i Please Add RAC…

31 © 2005 Solution Beacon, LLC. All Rights Reserved.

Kevin DahlKevin [email protected] www.solutionbeacon.com

Hope you enjoyed this Release 11i session! Hope you enjoyed this Release 11i session!

Remember:Remember:

KISSKISS

Keep It Simple and Keep It Simple and SupportableSupportablesmsm

Q&A