Cluster Oracle 11g

download Cluster Oracle 11g

of 197

Transcript of Cluster Oracle 11g

  • 7/28/2019 Cluster Oracle 11g

    1/197

    So you want to play with Oracle 11gs RAC?

    Heres how.Installing Oracle 11g RAC on virtual servers using VMware.

    This post describes the installation of Oracle 11g RAC on virtual servers.Hardware

    The following hardware was used for the installation:Operating

    system

    Processor Memory HDDs

    Windows XP

    SP2 (32 bit)

    Intel P4 3Ghz 3Gb 1 x 160Gb 7200rpm & 1x

    250Gb 7200rpm. Both on

    Ultra ATA Controllers

    Youll need at least 3Gb of RAM for this installation as the virtual machines will be configured with 1Gb of

    RAM each, leaving 1Gb for the host operating system. The virtual machines further requires a total of 40Gb

    of storage.

    Software

    Oracle 11g (11.1.0.6) Database & Clusterware Software

    Oracle Enterprise Linux 4 (Update 5)

    VMware Server 1.0.3

    General

    For obvious reason this installation should never be used for Production or Development purposes. This type

    of environment is however extremely helpful if you want to learn and understand Oracle RAC and you do not

    have access to traditional hardware resources.

    Virtual Machines

    http://www.oracle.com/technology/software/products/database/oracle11g/111060_linuxsoft.htmlhttp://edelivery.oracle.com/linuxhttp://www.vmware.com/download/server/http://www.vmware.com/download/server/http://edelivery.oracle.com/linuxhttp://www.oracle.com/technology/software/products/database/oracle11g/111060_linuxsoft.html
  • 7/28/2019 Cluster Oracle 11g

    2/197

    I used VMware Server (1.0.3) to facilitate my virtual machines. If you have not done so already download the

    software here. Youll need to register to get an activation code, but it is a free product.

    Configure your first virtual machine:

    1. Install VMware Server and launch.

    2. Select local host and OK to close the pop-up window.3. Select New Virtual Machine from the VMware Server Console to create the hardware specification for

    your first virtual machine.

    http://www.vmware.com/download/server/http://www.vmware.com/download/server/http://www.vmware.com/download/server/
  • 7/28/2019 Cluster Oracle 11g

    3/197

    4. This will launch the New Virtual Machine Wizard. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    4/197

    5. Select Custom to allow you to customize the virtual machine. Next to continue.

    6. Ive settled for Oracle Enterprise Linux 4.5 (which is a rebranded version of Red Hat Enterprise Linux ),therefore select Linux as the Guest Operating System and Red Hat Enterprise Linux 4 as the Version.

  • 7/28/2019 Cluster Oracle 11g

    5/197

    Oracle Enterprise Linux 5 is not yet supported on VMware Server. Next to continue.

    7. Name your virtual machine and select a location to store the files.Ive named the virtual machines: EL4_11gRAC1 and EL4_11gRAC2. We will be creating 2 virtual

    machines with shared storage. You need to create separate directories for your virtual machines. Also

    create a separate directory for your shared storage. Ive created them as follows:Virtual Machine 1 E:\Virtual Machines\RAC\rac11g\rac1

    Virtual Machine 2 E:\Virtual Machines\RAC\rac11g\rac2

    Shared Storage E:\Virtual Machines\RAC\rac11g\share

  • 7/28/2019 Cluster Oracle 11g

    6/197

    8.9. Set Access Rights. Deselect Make this virtual machine private. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    7/197

    10.Keep the default Startup/Shutdown Options (Run this virtual machines as the user that powers on thevirtual machine). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    8/197

    11.Keep the Processor Configuration default (One). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    9/197

    12.Allocate 1Gb of memory for your virtual machine. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    10/197

    13.Keep the default network type (bridged networking). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    11/197

    14.Keep the default I/O Adapter Type (LSI Logic). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    12/197

    15.Keep the default setting to create a new virtual disk. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    13/197

    16.Keep the default disk type (SCSI). Next to continue.

    17.Specify a disk capacity of 20Gb for your local disk. We need enough space for the Linux installation,Oracle Clusterware software, Oracle Database software and a staging area. Make sure to deselect

    Allocate all disk space now and select Split disk into 2Gb files.

  • 7/28/2019 Cluster Oracle 11g

    14/197

    Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    15/197

    18.Specify a filename for your virtual disk (localdisk.vmdk) and create it in the directory for your firstvirtual machine (E:\Virtual Machines\RAC\rac11g\rac1). Next to continue.

    19.Edit your virtual machine settings to add the shared disks and an additional network card. Select Editvirtual machine settings from the Commands section on the VMware Server Console. Next to

  • 7/28/2019 Cluster Oracle 11g

    16/197

    continue.

  • 7/28/2019 Cluster Oracle 11g

    17/197

    20.This willbring up a settings window. Select Add to add new hardware. This will launch the Add NewHardware wizard.

  • 7/28/2019 Cluster Oracle 11g

    18/197

    21.Select Ethernet Adapter to add an additional network card. We will use this to configure the privateinterconnect. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    19/197

    22.This time around select Host-only as the network type. Next to continue.

    23.Launch the New Hardware Wizard again to add the following SCSI disks:Purpose Size Virtual device node

    Database files 3Gb SCSI 1:0

    Database files 3Gb SCSI 1:1

    Database files 3Gb SCSI 1:2

    Oracle ClusterRegistry

    300Mb SCSI 1:3

    Voting Disk 300Mb SCSI 1:4

  • 7/28/2019 Cluster Oracle 11g

    20/197

    24.Select Hard Disk to add a new harddisk. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    21/197

    25. Select Create a new virtual disk. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    22/197

    26.Select SCSI as the disk type. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    23/197

    27.Allocate disk space as per the table in step 22. This time around keep the default options (Allocate all

    disk space now selected and Split disk into 2Gb files deselected). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    24/197

    28.Give the new disk a descriptive name (datadisk1.vmdk) and save it to the shared disk folder (E:\VirtualMachines\RAC\rac11g\share ). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    25/197

    29.Once the new disk has been created, select it and click on the Advanced button to edit. Next tocontinue.

  • 7/28/2019 Cluster Oracle 11g

    26/197

    30.Change the Virtual device node as per the table in step 22 and change the Mode to Independent andPersistent. Next to continue.

    31.Repeat steps 23 to 29 until all the disks in the table in step 22 have been configured.32.

    Once all the disks have been added edit the virtual machine configuration file (E:\Virtual

    Machines\RAC\rac11g\rac1\Red Hat Enterprise Linux 4.vmx), but first close the Virtual Machine

    Settings screen to save the changes to the configuration file.Add the parameters in bold blue below to

    the configuration file in order to enable disk sharing:config.version = 8

    virtualHW.version = 4

    scsi0.present = TRUE

  • 7/28/2019 Cluster Oracle 11g

    27/197

    scsi0.virtualDev = lsilogic

    memsize = 768

    scsi0:0.present = TRUE

    scsi0:0.fileName = rac1_localdisk.vmdk

    ide1:0.present = TRUE

    ide1:0.fileName = autodetect

    ide1:0.deviceType = cdrom-raw

    floppy0.present = FALSE

    Ethernet0.present = TRUE

    displayName = EL4_11gRAC1

    guestOS = rhel4

    priority.grabbed = normal

    priority.ungrabbed = normal

    disk.locking = FALSEdiskLib.dataCacheMaxSize = 0diskLib.dataCacheMaxReadAheadSize = 0diskLib.dataCacheMinReadAheadSize = 0diskLib.dataCachePageSize = 0scsi1.sharedBus = virtual

    scsi1.present = TRUE

    scsi1:0.present = TRUE

    scsi1:0.fileName = E:\Virtual Machines\rac\rac11g\share\datadisk1.vmdk

    scsi1:0.mode = independent-persistent

    scsi1:0.deviceType = disk

    scsi1:1.present = TRUE

  • 7/28/2019 Cluster Oracle 11g

    28/197

    scsi1:1.fileName = E:\Virtual Machines\rac\rac11g\share\datadisk2.vmdk

    scsi1:1.mode = independent-persistent

    scsi1:1.deviceType = disk

    scsi1:2.present = TRUE

    scsi1:2.fileName = E:\Virtual Machines\rac\rac11g\share\datadisk3.vmdk

    scsi1:2.mode = independent-persistent

    scsi1:2.deviceType = disk

    scsi1:3.present = TRUE

    scsi1:3.fileName = E:\Virtual Machines\rac\rac11g\share\ocrdisk.vmdk

    scsi1:3.mode = independent-persistent

    scsi1:3.deviceType = disk

    scsi1:4.present = TRUE

    scsi1:4.fileName = E:\Virtual Machines\rac\rac11g\share\votingdisk.vmdk

    scsi1:4.mode = independent-persistent

    scsi1:4.deviceType = disk

    scsi1.virtualDev = lsilogic

    ide1:0.autodetect = TRUE

    Ethernet1.present = TRUE

    You have now successfully configured your first virtual machine. Well clone this at a later stage to provide

    for the second virtual machine.

    Install Oracle Enterprise Linux

    You are now ready to install Linux on the virtual machine. If you have not done so already, download the

    Oracle Enterprise Linux 4 (Update 5) files fromhere and unzip. Once unzipped you should have the following

    cd image files:

    http://edelivery.oracle.com/linuxhttp://edelivery.oracle.com/linux
  • 7/28/2019 Cluster Oracle 11g

    29/197

    Enterprise-R4-U5-i386-disc1.iso

    Enterprise-R4-U5-i386-disc2.iso

    Enterprise-R4-U5-i386-disc3.iso

    Enterprise-R4-U5-i386-disc4.isoInstall Linux:

    1. To start the installation select Edit virtual machine settings from the main VMware Server Console.Select the CD-ROM drive. Under Connection select Use ISO image and browse to and select the ISO

    image for the Linux installation disk 1 (Enterprise-R4-U5-i386-disc1.iso).OK to continue.

  • 7/28/2019 Cluster Oracle 11g

    30/197

    2. Select Start this virtual machine to start it up.

    3. The virtual machine will now boot from the CD-ROM and start the Linux installer. Press Enter to selectto install in graphical mode. Select Skip on the following screen to skip media testing.

  • 7/28/2019 Cluster Oracle 11g

    31/197

    4. The graphical installer will now launch. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    32/197

    5. Make your language selection. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    33/197

    6. Select your keyboard configuration. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    34/197

    7. Select Manually partition with Disk Druid. Next to continue.

    8. Select Yes for all warning messages that indicate the partition table was unreadable.

  • 7/28/2019 Cluster Oracle 11g

    35/197

    9. Partition local diskPartition the local disk (/dev/sda) as follows:Mount point Size

    /swap 2048Mb/tmp 1024Mb

    / 4096Mb

    /u01 13312Mb

    10.To partition the local disk select the free space on /dev/sda and select Edit to add partitions. Add allpartitions as in the table above to /dev/sda. Do not configure the other disks at this stage. Select Next

    to continue once done.

  • 7/28/2019 Cluster Oracle 11g

    36/197

    11.Keep the default boot loader configuration. Next to continue.

    12.Network configurationConfigure the network as follows:Hostname Network

    deviceetwork

    ypeIP address

    rac1.startoracle.com eth0 ublic 192.168.1.50

    eth1 rivate 10.10.10.50

    13.Please note: Configure the public IP address for your virtual machines so that they are on the samenetwork (192.168.1.1 in my case) as your host machine. You can also change the domain name

    (startoracle.com in my case) to your own. Remember to make these changes throughout the rest of the

    installation.

  • 7/28/2019 Cluster Oracle 11g

    37/197

    14.Tick both network devices to be Active on boot:

    Select each device and select Edit to edit advanced settings:

    Deselect Configure using DHCP

    Enter the IP address as per the table above.

    Enter the Netmask: 255.255.255.0

    Repeat for interface eth1:

  • 7/28/2019 Cluster Oracle 11g

    38/197

    Set the hostname: rac1.startoracle.com

    Set the Gateway: 192.168.1.1Set the Primary DNS: 192.168.1.1

  • 7/28/2019 Cluster Oracle 11g

    39/197

    Next to continue when done.

  • 7/28/2019 Cluster Oracle 11g

    40/197

    15.Disable the firewall and SELinux. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    41/197

    16.Select additional language support. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    42/197

    17.Select your time zone. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    43/197

    18.Set your root password. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    44/197

    19.Select Customize software packages to be installed. Next to continue.

    20.Package Group SelectionKeep all the default selected package groups and add the following groups:

    Legacy Software Development

    Graphical Internet (to add Firefox)

    Development Tools

    System Tools. Also select Details for this group and add the 3 oracleasm packages and the sysstat

    package.

  • 7/28/2019 Cluster Oracle 11g

    45/197

    Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    46/197

    21.Select Next to start the installation.

    During the installation youll be prompted to insert the

    installation cds. When this happens simply right-click on the CD-ROM icon in the bottom right corner

    and select the appropriate ISO image file. Select Ok to continue the installation.

  • 7/28/2019 Cluster Oracle 11g

    47/197

    22.Reboot once installation is done.

  • 7/28/2019 Cluster Oracle 11g

    48/197

    23.After the reboot, finalize the setup. Next to skip the Welcome screen.

  • 7/28/2019 Cluster Oracle 11g

    49/197

    24.Accept the license agreement. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    50/197

    25. Check the date and time and set if incorrect. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    51/197

    26.Check and set display. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    52/197

    27.Setup a system user (not the oracle user). You can skip this. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    53/197

    28.Additional CDs. No action required. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    54/197

    29.Select Next to complete the installation.

    30.Ensure that you are using the SMP kernelTo ensure you are using this kernel open a terminal window as the root user and enter the followingcommand: uname -rIf the following output is displayed then the correct kernel is used:

    If any other kernel is used edit the /boot/grub/grub.conf file and set the default option to boot the SMP

  • 7/28/2019 Cluster Oracle 11g

    55/197

    kernel. The first option is 0 and is usually set as the default boot option, the second option is 1 etc. Each

    kernel boot option starts with the title line.

    31.At this point power down the virtual machine, edit the virtual machine settings to reset the CD-ROM toUse physical drive and Auto detect. Restart the virtual machine.

    32.Install VMware tools in the virtual machine. This is necessary so that the time between the host andvirtual machines stay synchronized. If the time between the RAC nodes are out of sync installation to

    the remote node will fail.To install VMware tools, log in as root in the virtual machine and select InstallVMware Tools from the VM menu in the VMware Server Console.

  • 7/28/2019 Cluster Oracle 11g

    56/197

    Confirm installation. Install to continue.

    This will mount an image on the cd drive with the installation package.

    Open the cd folder and double-click the VMwareTools package to install.

    http://startoracle.files.wordpress.com/2007/09/030.jpghttp://startoracle.files.wordpress.com/2007/09/030.jpghttp://startoracle.files.wordpress.com/2007/09/030.jpg
  • 7/28/2019 Cluster Oracle 11g

    57/197

    Open a terminal window and execute: /usr/bin/vmware-config-tools.pl to configure VMware

    Tools. Select the screen resolution during configuration.Configure VMware Tools to start every time you

    login. On the Applications menu go to Preferences, More Preferences and launch Sessions.Add: /usr/bin/vmware-toolbox to Startup Programs.

    Log out and back in as root.Make sure to tick the Time synchronization between the virtual machine

    and the host operating system box. This will add the following line to the Virtual Machine configurationfile:tools.syncTime = TRUE

  • 7/28/2019 Cluster Oracle 11g

    58/197

    Minimize the VMware Tools Properties window.

    33.Edit /boot/grub/grub.conf and add the following options to the kernel /boot/ line of your default(SMP) kernel:

  • 7/28/2019 Cluster Oracle 11g

    59/197

    clock=pit nosmp noapic nolapic

    34.Install the following packages from the indicated cds:libaio-devel-0.3.105-2 (CD 3)

    elfutils-libelf-devel-0.97.1-4 (CD 4)

    unixODBC-devel-2.2.11-1 (CD 4)

    35. Create disk partitions for shared disksPrepare the following disks that will host the shared database files, the Oracle Cluster Registry and the

    Clusterware voting disk:Purpose Size Virtual device

    nodeDisk

    Database files 3Gb SCSI 1:0 /dev/sdb

    Database files 3Gb SCSI 1:1 /dev/sdc

  • 7/28/2019 Cluster Oracle 11g

    60/197

    Database files 3Gb SCSI 1:2 /dev/sdd

    Oracle Cluster Registry 300Mb SCSI 1:3 /dev/sde

    Voting Disk 300Mb SCSI 1:4 /dev/sdf

    36.Use the following command to list all disks & partitions:fdisk lThiswill list all disks (including /dev/sda which weve already configured).

    37.Repeat the following steps for all disks in the table above:Open a terminal window as the root user and enter the following command (replacing with thecorrect disk name): fdisk

    38.[root@rac1 ~]# fdisk /dev/sdbCommand (m for help): n

    Command action

    e extended

    p primary partition (1-4)

    p

    Partition number (1-4): 1

    First cylinder (1-391, default 1):

    Using default value 1

    Last cylinder or +size or +sizeM or +sizeK (1-391, default 391):

    Using default value 391

    Command (m for help): w

    The partition table has been altered!

    Calling ioctl() to re-read partition table.

    Syncing disks.

  • 7/28/2019 Cluster Oracle 11g

    61/197

    The key sequence after entering the fdisk command is:

    n [return] p [return] 1 [return] [return] [return] w [return]

    39.Prepare raw disksBind the OCR and Voting Disk partitions to raw devices. To do this edit the file:/etc/sysconfig/rawdevices and add the following lines:/dev/raw/raw1 /dev/sde1

    /dev/raw/raw2 /dev/sdf1

    Restart the raw devices service for the new settings to take effect:

    [root@rac1 ~]# service rawdevices restart

    Assigning devices:

    /dev/raw/raw1 > /dev/sde1/dev/raw/raw1: bound to major 8, minor 65

    /dev/raw/raw2 > /dev/sdf1

    /dev/raw/raw2: bound to major 8, minor 81When you restart an Oracle Enterprise Linux 4

    system, ownership and permissions for raw devices will revert to the root owner. To prevent this from

    happening edit the raw devices section of the /etc/udev/permissions.d/50-udev.permissions file to look

  • 7/28/2019 Cluster Oracle 11g

    62/197

    like the following:

    40.Create users and groupsIn Oracle 11g Oracle recommends a new system group (osasm) if you want to separate the ASM

    administration function from your DBAs. Likewise they recommend creating a separate group (crs) for

    Clusterware administration. I will however create a single software owner (oracle) for all Oracle

    software.To create the necessary groups and users execute the following from the command line as the

    root user:# groupadd -g 501 oinstall

    # groupadd -g 502 dba# useradd -g oinstall -G dba -s /bin/ksh oracle

    # passwd oracle

    41.Configuring kernel parameters and shell limitsAppend the following to the /etc/sysctl.conf file as the root user:kernel.sem = 250 32000 100 128

    kernel.shmmax = 536870912

    net.ipv4.ip_local_port_range = 1024 65000

    net.core.rmem_default = 4194304net.core.rmem_max = 4194304

    net.core.wmem_default = 262144

    net.core.wmem_max = 262144

    You can issue the following command for these settings to take immediate effect: /sbin/sysctl p

  • 7/28/2019 Cluster Oracle 11g

    63/197

    42.Add the following entries to the /etc/hosts file as the root user:Public 192.168.1.50 rac1.startoracle.com rac1

    192.168.1.60 rac2.startoracle.com rac2

    VIP 192.168.1.51 rac1-vip.startoracle.com rac1-vip

    192.168.1.61 rac2-vip.startoracle.com rac2-vip

    Inter-connect 10.10.10.50 rac1-priv.startoracle.com rac1-priv

    10.10.10.60 rac2-priv.startoracle.com rac2-priv

    43.The /etc/hosts file should now contain the following entries:

    Restart the network services to pick up the new settings with the following command: # service network

    restart

    44.As root create the following oracle directories and change the ownership to oracle:# mkdir -p /u01/app/oracle/product/11.1.0/crs

  • 7/28/2019 Cluster Oracle 11g

    64/197

    # mkdir /u01/app/oracle/product/11.1.0/db_1

    # mkdir /u01/Stage11g

    # chown -R oracle:oinstall /u01/app

    # chown oracle:oinstall /u01/Stage11g45. Set shell limits for the Oracle user

    As the root user add the following lines to the /etc/security/limits.conf file:oracle soft nproc 2047

    oracle hard nproc 16384

    oracle soft nofile 1024

    oracle hard nofile 65536Add the following as the second last lines in the /etc/pam.d/login file if

    it does not exist:

    session required pam_limits.soAppend the following to the /etc/profile file:if [ $USER = oracle ]; then

    if [ $SHELL = /bin/ksh ]; then

    ulimit -p 16384

    ulimit -n 65536

    else

    ulimit -u 16384 -n 65536

    fiumask 022

    fi

    46.Install the ASMLib packageDownload the ASM Lib package from the Oracle Technology Network. Download the package named

    http://www.oracle.com/technology/software/tech/linux/asmlib/rhel4.htmlhttp://www.oracle.com/technology/software/tech/linux/asmlib/rhel4.html
  • 7/28/2019 Cluster Oracle 11g

    65/197

    oracleasmlib-2.0.2-1.i386.rpm under the section Intel IA32 (x86) Architecture and install it as theroot user with the following command: # rpm -i oracleasmlib-2.0.2-1.i386.rpm

    47. Clone the virtual machineAt this point shutdown the virtual machine and copy all the files from the virtual machines directory tothe directory for the second virtual machine. Once this is complete add the second virtual machine as

    follows:

    Select the Home tab in the VMware Server Console.

    Select Open Existing Virtual Machine and browse to the cloned virtual machine directory and select the

    file Red Hat Enterprise Linux 4.vmx. The cloned virtual machine will now show up in the VMware

    Server Console.

    Rename the new virtual machine:

    To rename the virtual machine select Edit virtual machine settings and select the Options tab. Change

    the virtual machine name (EL4_11gRAC2) and click OK to continue.

  • 7/28/2019 Cluster Oracle 11g

    66/197

    Start the new virtual machine (while leaving the old one powered off) and log in as root. Whenprompted if you want to create a new UUID for the virtual machine select Create and OK to continue.

    Upon startup you will be asked to remove the 2 old network cards and add new network cards.

    Select Remove Configuration to remove the network cards. Youll need to do this twice.

  • 7/28/2019 Cluster Oracle 11g

    67/197

    Select Configure to configure the first network card.

    Enter the IP configuration for the second virtual machines first network card (Private) as per the table

    in step 36. OK to continue.

  • 7/28/2019 Cluster Oracle 11g

    68/197

    Select Configure again to configure the second network card and enter the IP configuration for the

    second virtual machines second network card (Public) as per the table in step 36. OK to continue.

    Login as the root user and update the network settings.

    From the Applications menu select SystemSettings and Network to edit network settings.

    For each network device do the following:

  • 7/28/2019 Cluster Oracle 11g

    69/197

    Select the device and Select Edit.

    Make sure the IP address is correct for each device eth0 (the bridged network connection) should be

    on the public network and eth1 (the host-only network connection) should be on the private network. If

    the settings are incorrect update the IP address, subnet mask and default gateway.

  • 7/28/2019 Cluster Oracle 11g

    70/197

    Select the Hardware Device tab and click Probe to get the new MAC address for the device. Select OK

    to continue.

  • 7/28/2019 Cluster Oracle 11g

    71/197

    Select the DNS tab and update the Hostname to rac2.startoracle.com. From the file menu select Save

    and Quit.

  • 7/28/2019 Cluster Oracle 11g

    72/197

    Restart the virtual machine for the changes to take effect and start the first virtual machine. Both virtual

    machines should now be up and running.Note: To test the network setup, ping the nodes from each

    other using the public and private ip addresses (the virtual ip address is not pingable at this stage).

    48.Enabling SSH User EquivalencyThe OUI (Oracle Universal Installer) uses the ssh and scp commands during installation to run remotecommands and copy files to other nodes in the cluster, therefore you need to setup user equivalency for

    the Oracle user on all nodes.Perform the following in order to setup user equivalency:As the oracle user

    on node rac1:$ mkdir ~/.ssh

    $ chmod 700 ~/.ssh

  • 7/28/2019 Cluster Oracle 11g

    73/197

    $ /usr/bin/ssh-keygen -t rsa

    Note: Whenever prompted for a passphrase leave it empty and press return.

    As the oracle user on node rac2:

    $ mkdir ~/.ssh$ chmod 700 ~/.ssh

    $ /usr/bin/ssh-keygen -t rsa

    As the oracle user on node rac1:$ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

    $ ssh rac2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

    $ scp ~/.ssh/authorized_keys rac2:/home/oracle/.ssh/

    Perform the following as the oracle user on node rac1 and then node rac2:ssh rac1 date

    ssh rac2 date

    ssh rac1.startoracle.com date

    ssh rac2.startoracle.com date

    ssh rac1-priv date

    ssh rac2-priv date

    ssh rac1-priv.startoracle.com date

    ssh rac2-priv.startoracle.com date

    49.Setup the ASM disksConfigure the Oracle ASM driverAs the root user on both nodes run the following:# service oracleasm configure

    Ouput:[root@rac1 etc]# service oracleasm configure

  • 7/28/2019 Cluster Oracle 11g

    74/197

    Configuring the Oracle ASM library driver.

    This will configure the on-boot properties of the Oracle ASM library

    driver. The following questions will determine whether the driver is

    loaded on boot and what permissions it will have. The current valueswill be shown in brackets ([]). Hitting without typing an

    answer will keep that current value. Ctrl-C will abort.

    Default user to own the driver interface []: oracle

    Default group to own the driver interface []: dba

    Start Oracle ASM library driver on boot (y/n) [n]: y

    Fix permissions of Oracle ASM disks on boot (y/n) [y]: y

    Writing Oracle ASM library driver configuration: [ OK ]

    Loading module oracleasm: [ OK ]Mounting ASMlib driver filesystem: [ OK ]

    Scanning system for ASM disks: [ OK ]

    Stamp the ASM disks

    As the root user on node rac1 (or rac2, but not both) run the following:# service oracleasm createdisk DATA1 /dev/sdb1

    # service oracleasm createdisk DATA2 /dev/sdc1

    # service oracleasm createdisk RECO1 /dev/sdd1

    Output:[root@rac1 etc]# service oracleasm createdisk DATA1 /dev/sdb1

    Marking disk /dev/sdb1 as an ASM disk: [ OK ]

    [root@rac1 etc]# service oracleasm createdisk DATA2 /dev/sdc1

    Marking disk /dev/sdc1 as an ASM disk: [ OK ]

    [root@rac1 etc]# service oracleasm createdisk RECO1 /dev/sdd1

  • 7/28/2019 Cluster Oracle 11g

    75/197

    Marking disk /dev/sdd1 as an ASM disk: [ OK ]

    Verify the newly configured ASM disks

    As the root user on both nodes run the following:# service oracleasm scandisks

    # service oracleasm listdisks

    Output:[root@rac1 etc]# service oracleasm scandisks

    Scanning system for ASM disks: [ OK ]

    [root@rac1 etc]# service oracleasm listdisks

    DATA1DATA2

    RECO1

    You are now ready to install Oracle Clusterware.

    Install Oracle Clusterware

    1. Copy the Oracle Clusterware and Database Software zip files downloadedearlier to the staging area(/u01/Stage11g) on node rac1. Use pscp to copy the downloaded files from your Windows host machine

    to the virtual machine:

    http://www.oracle.com/technology/software/products/database/oracle11g/111060_linuxsoft.htmlhttp://www.chiark.greenend.org.uk/~sgtatham/putty/download.htmlhttp://www.chiark.greenend.org.uk/~sgtatham/putty/download.htmlhttp://www.oracle.com/technology/software/products/database/oracle11g/111060_linuxsoft.html
  • 7/28/2019 Cluster Oracle 11g

    76/197

    Alternatively download the zip files from your virtual machine. If your network is setup correctly you

    should be able to connect to the internet from within your virtual machine.

    2. Unzip the Oracle 11g software in your staging area (/u01/Stage11g) as the oracle user:$ unzip /u01/Stage11g/linux_11gR1_clusterware.zip$ unzip /u01/Stage11g/linux_11gR1_database.zip

    3. Install the cvuqdisks packageIt can be found in the /u01/Stage11g/clusterware/rpm directory. Install on both nodes as the root user:# rpm -i cvuqdisk-1.0.11.rpm

    4. Run the Cluster Verification Utility (CVU or Cluvfy) as the oracle user to verify all pre-installation tasksfor Oracle Clusterware are completed.

    Go to your Clusterware staging directory (/u01/Stage11g/clusterware) and run the following command

    as the oracle user on node rac1: $ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2TheClufvy output will be similar to the following:

    $ pwd

    /u01/Stage11g/clusterware

    $ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2

    Performing pre-checks for cluster services setup

  • 7/28/2019 Cluster Oracle 11g

    77/197

    Checking node reachability

    Node reachability check passed from node rac1.

    Checking user equivalence

    User equivalence check passed for user oracle.

    Checking administrative privileges

    User existence check passed for oracle.

    Group existence check passed for oinstall.

    Membership check for user oracle in group oinstall [as Primary] passed.

    Administrative privileges check passed.

    Checking node connectivity

    Node connectivity check passed for subnet 192.168.1.0 with node(s) rac2,rac1.

    Node connectivity check passed for subnet 10.10.10.0 with node(s) rac2,rac1.

    Interfaces found on subnet 10.10.10.0 that are likely candidates for VIP:

    rac2 eth1:10.10.10.60

    rac1 eth1:10.10.10.50

    Interfaces found on subnet 192.168.1.0 that are likely candidates for a private interconnect:rac2 eth0:192.168.1.60

    rac1 eth0:192.168.1.50

    Node connectivity check passed.

    Checking system requirements for crs

    Total memory check failed.

    Check failed on nodes:

    rac2,rac1

    Free disk space check passed.

    Swap space check passed.

    System architecture check passed.

  • 7/28/2019 Cluster Oracle 11g

    78/197

    Kernel version check passed.

    Package existence check passed for make-3.80.

    Package existence check passed for binutils-2.15.92.0.2.

    Package existence check passed for gcc-3.4.5.

    Package existence check passed for libaio-0.3.105.

    Package existence check passed for libaio-devel-0.3.105.

    Package existence check passed for libstdc++-3.4.5.

    Package existence check passed for elfutils-libelf-devel-0.97.

    Package existence check passed for sysstat-5.0.5.

    Package existence check passed for libgcc-3.4.5.

    Package existence check passed for libstdc++-devel-3.4.5.

    Package existence check passed for unixODBC-2.2.11.

    Package existence check passed for unixODBC-devel-2.2.11.

    Package existence check passed for glibc-2.3.4-2.19.

    Group existence check passed for dba.

    Group existence check passed for oinstall.

    User existence check passed for nobody.

    System requirement failed for crs

    Pre-check for cluster services setup was unsuccessful on all the nodes.The Clufvy pre-check will fail, because the Total memory check failed, even though we have the

    recommended 1Gb RAM allocated to each instance. Make sure all other checks passed.

    5. Launch the OUI for Oracle ClusterwarePrior to installing open a terminal window as the root user on node rac1 and type the following:

    # xhost +Open a terminal window as the oracle user on node rac1 and go to the clusterware staging

  • 7/28/2019 Cluster Oracle 11g

    79/197

    directory (/u01/Stage11g/clusterware) and start the installer with the following command:

    $ ./runInstaller

    This will launch the OUI (Oracle Universal Installer) for Oracle Clusterware 11g.

    6.Welcome. Select Next to continue.

    7. Specify Inventory directory and credentialsChange the inventory directory from the default of /u01/app/oraInventroy to

    /u01/app/oracle/oraInventory. Keep the default (oinstall) Operating System group name. Next to

  • 7/28/2019 Cluster Oracle 11g

    80/197

    continue.

  • 7/28/2019 Cluster Oracle 11g

    81/197

    8. Specify Home DetailsChange the path to /u01/app/oracle/product/11.1.0/crs. Next to continue.

    9. Product-Specific Prerequisite ChecksThe OUI will now verify that the environment meets all the requirements. All pre-requisite steps should

  • 7/28/2019 Cluster Oracle 11g

    82/197

    complete successfully. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    83/197

  • 7/28/2019 Cluster Oracle 11g

    84/197

    11.Select Add and add the details for node rac2. Enter all details. OK to continue.

  • 7/28/2019 Cluster Oracle 11g

    85/197

    12.After youve added node rac2 the Cluster configuration should look as below. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    86/197

    13.Specify Network Interface UsageSelect the eth0 interface name and Edit to correct the Interface Type.

  • 7/28/2019 Cluster Oracle 11g

    87/197

    14.Change the eth0 Interface Type to Public. Ok to continue.

  • 7/28/2019 Cluster Oracle 11g

    88/197

    15.Verify that eth0 (192.168.1.0) is now your public network and eth1 (10.10.10.0) is your private network.Next to continue.

    16.Specify Oracle Cluster Registry (OCR) LocationSelect External Redundancy and specify the first raw device (/dev/raw/raw1) setup earlier as the OCR

  • 7/28/2019 Cluster Oracle 11g

    89/197

    location. Next to continue.

    17.Specify Voting Disk LocationSelect External Redundancy and specify the second raw device (/dev/raw/raw2) setup earlier as the

  • 7/28/2019 Cluster Oracle 11g

    90/197

    Voting Disk location. Next to continue.

    18.SummaryReview the summary and select Install to start the installation.

  • 7/28/2019 Cluster Oracle 11g

    91/197

    Install

  • 7/28/2019 Cluster Oracle 11g

    92/197

    19.Monitor the progress of the installation.

    20.Configuration ScriptsOnce the installation is complete you will be prompted to run 2 configuration scripts as the root user.

    Open a terminal window and execute these scripts as the root user on each node. Select Ok to continue

    after these scripts have completed successfully on both nodes. Do not run the scripts simultaneously on

    both nodes.

  • 7/28/2019 Cluster Oracle 11g

    93/197

    The output for the configuration scripts will look similar to below:

    [root@rac1 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh

    Changing permissions of /u01/app/oracle/oraInventory to 770.

    Changing groupname of /u01/app/oracle/oraInventory to oinstall.

    The execution of the script is complete

    [root@rac1 ~]# /u01/app/oracle/product/11.1.0/crs/root.sh

    WARNING: directory /u01/app/oracle/product/11.1.0 is not owned by root

    WARNING: directory /u01/app/oracle/product is not owned by root

    WARNING: directory /u01/app/oracle is not owned by root

    WARNING: directory /u01/app is not owned by root

    Checking to see if Oracle CRS stack is already configured

  • 7/28/2019 Cluster Oracle 11g

    94/197

    /etc/oracle does not exist. Creating it now.

    Setting the permissions on OCR backup directory

    Setting up Network socket directories

    Oracle Cluster Registry configuration upgraded successfully

    The directory /u01/app/oracle/product/11.1.0 is not owned by root. Changing owner to root

    The directory /u01/app/oracle/product is not owned by root. Changing owner to root

    The directory /u01/app/oracle is not owned by root. Changing owner to root

    The directory /u01/app is not owned by root. Changing owner to root

    Successfully accumulated necessary OCR keys.

    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.

    node :

    node 1: rac1 rac1-priv rac1

    node 2: rac2 rac2-priv rac2

    Creating OCR keys for user root, privgrp root..

    Operation successful.

    Now formatting voting device: /dev/raw/raw2

    Format of 1 voting devices complete.

    Startup will be queued to init within 30 seconds.

    Adding daemons to inittab

    Expecting the CRS daemons to be up within 600 seconds.

    Cluster Synchronization Services is active on these nodes.

    rac1

    Cluster Synchronization Services is inactive on these nodes.

    rac2

    Local node checking complete. Run root.sh on remaining nodes to start CRS daemons.

  • 7/28/2019 Cluster Oracle 11g

    95/197

    21.Configuration AssistantsThe configuration assistants will now kick into gear. They all need to complete successfully in order for

    the installation to be successful.

    22.End of InstallationOnce the configuration assistants complete below screen will display. Exit to complete the installation

  • 7/28/2019 Cluster Oracle 11g

    96/197

    and exit the OUI.

    23.Checking the status of ClusterwareTo check the status of your installation issue the following commands as the root user:

    # /u01/app/oracle/product/11.1.0/crs/bin/crsctl check crs

    Cluster Synchronization Services appears healthy

    Cluster Ready Services appears healthy

    Event Manager appears healthyTo get more detailed information issue the following command as the rootuser: #/u01/app/oracle/product/11.1.0/crs/bin/crs_stat -t

    Name Type R/RA F/FT Target State Host

    - - -

    ora.rac1.gsd application 0/5 0/0 ONLINE ONLINE rac1

  • 7/28/2019 Cluster Oracle 11g

    97/197

    ora.rac1.ons application 0/3 0/0 ONLINE ONLINE rac1

    ora.rac1.vip application 0/0 0/0 ONLINE ONLINE rac1

    ora.rac2.gsd application 0/5 0/0 ONLINE ONLINE rac2

    ora.rac2.ons application 0/3 0/0 ONLINE ONLINE rac2

    ora.rac2.vip application 0/0 0/0 ONLINE ONLINE rac2

    Install Oracle Database and ASM Software

    1. As root change ownership of the oracle directories to the oracle user on both nodes:# chown oracle:oinstall /u01/app/oracle

    # chown oracle:oinstall /u01/app/oracle/product

    # chown oracle:oinstall /u01/app/oracle/product/11.1.0

    2. To start the OUI change to the database directory in your staging area (/u01/Stage11g/database) andlaunch the OUI as the oracle user with the following command: $ ./runInstaller

  • 7/28/2019 Cluster Oracle 11g

    98/197

    3.WelcomeNext to skip the Welcome screen.

  • 7/28/2019 Cluster Oracle 11g

    99/197

    4. Select Installation TypeKeep the default installation type (Enterprise Edition). Next to continue.

    5. Install LocationKeep the default Oracle Base location (/u01/app/oracle) and default Oracle Home location

  • 7/28/2019 Cluster Oracle 11g

    100/197

    (/u01/app/oracle/product/11.1.0/db_1). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    101/197

    6. Specify Hardware Cluster Installation ModeKeep the default Cluster Installation selection and select both nodes. Next to continue.

    7. Product-Specific Prerequisite ChecksThe OUI will now verify that the environment meets all the requirements. All pre-requisite steps should

  • 7/28/2019 Cluster Oracle 11g

    102/197

    complete successfully. Select Next to continue.

    8. Select Configuration OptionSelect Install Software Only. We will use the DBCA (Database Configuration Assistant) at a later stage

  • 7/28/2019 Cluster Oracle 11g

    103/197

    to configure ASM and create a database. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    104/197

    9. Privileged Operating System GroupsKeep the default options (dba, oinstall and oinstall). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    105/197

    10.SummaryReview the summary and select Install to start the installation.

  • 7/28/2019 Cluster Oracle 11g

    106/197

  • 7/28/2019 Cluster Oracle 11g

    107/197

    been run successfully on both nodes.

  • 7/28/2019 Cluster Oracle 11g

    108/197

    13.End of InstallationOnce the installation is complete select Exit to complete the installation and exit the OUI.

    Create Oracle ASM instances

    1. Launch the DBCA (Database Configuration Assistant) to configure ASM and create a RACdatabase.Open a terminal window as the oracle user. From the

    /u01/app/oracle/product/11.1.0/db_1/bin directory launch the dbca with the following command: $./dbca

  • 7/28/2019 Cluster Oracle 11g

    109/197

    2.WelcomeKeep the default selection (Oracle RAC database). Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    110/197

    3. OperationsSelect ConfigureASM. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    111/197

    4. Node SelectionSelect all the nodes and Next to continue.

    5. Create ASM InstanceSelect a SYS pasword for the ASM instance. Keep the default type of parameter file (IFILE) to create.

  • 7/28/2019 Cluster Oracle 11g

    112/197

    Next to continue.

    6. Select Ok to confirm creation of the ASM instances.

  • 7/28/2019 Cluster Oracle 11g

    113/197

    7. Select Yes to let the DBCA create default listeners.

    8.ASM Disk GroupsSelect Create New to create new ASM disk groups.

    Enter DATA as the first disk group name.

  • 7/28/2019 Cluster Oracle 11g

    114/197

  • 7/28/2019 Cluster Oracle 11g

    115/197

    9. The DATA disk group should now be mounted. This will be the location for all our database files. SelectCreate new again to add another disk group.

  • 7/28/2019 Cluster Oracle 11g

    116/197

    10.Enter RECO as the disk group name. This time select External for redundancy and select theremaining disk (RECO1). OK to continue.

  • 7/28/2019 Cluster Oracle 11g

    117/197

    i

  • 7/28/2019 Cluster Oracle 11g

    118/197

    1. OperationsSelect Create a Database. Next to continue.

    N d S l i

  • 7/28/2019 Cluster Oracle 11g

    119/197

    2. Node SelectionSelect all the nodes and Next to continue.

    D t b T l t

  • 7/28/2019 Cluster Oracle 11g

    120/197

    3. Database TemplatesKeep the default setting (General Purpose or Transaction Processing). Next to continue.

    D t b Id tifi ti

  • 7/28/2019 Cluster Oracle 11g

    121/197

    4. Database IdentificationEnter rac (without the quotes) as the global database name. Next to continue.

    5. Management OptionsKeep the default settings (Configure Enterprise Manager and Configure Database Control for local

    management selected, but Enable Alert Notifications and Enable Daily Disk Backup to Recovery Area

    d l t d) N t t ti

  • 7/28/2019 Cluster Oracle 11g

    122/197

    deselected). Next to continue.

    6. Database CredentialsSelect Use the same Administrative Password for All Accounts and enter a password. Next to

    continue

  • 7/28/2019 Cluster Oracle 11g

    123/197

    continue.

  • 7/28/2019 Cluster Oracle 11g

    124/197

    8 ASM Disk Groups

  • 7/28/2019 Cluster Oracle 11g

    125/197

    8.ASM Disk GroupsSelect both disk groups (DATA and RECO). Next to continue.

    9. Database File LocationsKeep the default (Use Oracle-Managed Files). Make sure +DATA is entered as the Database Area.

    Next to continue

  • 7/28/2019 Cluster Oracle 11g

    126/197

    Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    127/197

    +RECO/ (without the quotes) OK and then Next to continue

  • 7/28/2019 Cluster Oracle 11g

    128/197

    +RECO/ (without the quotes). OK and then Next to continue.

    12.Database Content

  • 7/28/2019 Cluster Oracle 11g

    129/197

    12.Database ContentSelect Sample Schemas if you want to install them. I did not. Next to continue.

    13.Initialization ParametersReduce the Memory Size to250Mb and select Use Automatic Memory Management Leave all other

    settings as is. Next to continue.

  • 7/28/2019 Cluster Oracle 11g

    130/197

    settings as is. Next to continue.

    14.Security Settings

  • 7/28/2019 Cluster Oracle 11g

    131/197

    14.Security SettingsKeep the default, enhanced 11g security settings. Next to continue.

    15.Automatic Maintenance Tasks

  • 7/28/2019 Cluster Oracle 11g

    132/197

    5

    Make sure Enable automatic maintenance tasks is seleced. Next to continue.

    16.Database Storage

  • 7/28/2019 Cluster Oracle 11g

    133/197

    g

    Review the storage options for all files. Next to continue.

    17.Creation OptionsSelect Generate database creation scripts if you want to review these at a late r stage. Finish to review

    the installation.

  • 7/28/2019 Cluster Oracle 11g

    134/197

    18.Summary

  • 7/28/2019 Cluster Oracle 11g

    135/197

    Select Ok to close the review page and Finish to start the installation.

    19.The DBCA will first generate the database creation scripts if you selected this. A message will be

  • 7/28/2019 Cluster Oracle 11g

    136/197

    displayed once this is done. Acknowledging the message will start the database creation.

    20.Once database creation is done a summary screen will be displayed. Exit to exit the OUI.

  • 7/28/2019 Cluster Oracle 11g

    137/197

    21.As the oracle user edit the /etc/oratab file on both nodes.Replace the database name with the instancename for the rac database i.e. replace the rac keyword with rac1 or rac2 depending on the node.

    Furthermore add details for your clusterware home to this file. This will enable you to set the

    Clusterware home using the oraenv script. Once edited the /etc/oratab file should contain the following:On node RAC1:

    +ASM1:/u01/app/oracle/products/11.1.0/db_1:N

    rac1:/u01/app/oracle/products/11.1.0/db_1:N

    crs:/u01/app/oracle/products/11.1.0/crs:N

    On node RAC2

  • 7/28/2019 Cluster Oracle 11g

    138/197

    +ASM2:/u01/app/oracle/products/11.1.0/db_1:N

    rac2:/u01/app/oracle/products/11.1.0/db_1:N

    crs:/u01/app/oracle/products/11.1.0/crs:N

    22.Setup the environment for the Oracle userAs the oracle user create the file /home/oracle/.profile on all nodes and add the following lines:

    umask 022

    set -o vi

    export PS1=[${USER}@`hostname -s`]$

    export ORACLE_BASE=/u01/app/oracle

    export ORACLE_SID=`hostname -s`

    export ORAENV_ASK=NO

    . oraenv

    unset ORAENV_ASKCongratulations! You have successfully installed and created an Oracle 11g RAC

    database.

    Oracle 11g RAC on virtual servers. Done.

    Bibliography / Resources

    Oracle Clusterware Installation Guide, 11g Release 1 (11.1) for Linux, Part Number B28263-02

    Oracle RAC Installation Guide, 11g Release 1 (11.1) for Linux and UNIX, Part Number B28264-02

    VMware Communities

    OTN Forums

    http://download.oracle.com/docs/cd/B28359_01/install.111/b28263/toc.htmhttp://download.oracle.com/docs/cd/B28359_01/install.111/b28264/toc.htmhttp://communities.vmware.com/index.jspahttp://forums.oracle.com/http://forums.oracle.com/http://forums.oracle.com/http://communities.vmware.com/index.jspahttp://download.oracle.com/docs/cd/B28359_01/install.111/b28264/toc.htmhttp://download.oracle.com/docs/cd/B28359_01/install.111/b28263/toc.htmhttp://wordpress.com/signup/?ref=housead_ehttp://wordpress.com/signup/?ref=housead_ehttp://wordpress.com/signup/?ref=housead_e
  • 7/28/2019 Cluster Oracle 11g

    139/197

    Like

    Be the first to like this.

    119 Comments

    Filed under11g,oracle,RAC,Real Application Clusters,virtual machine,VMware

    119 Responses toSo you want to play withOracle 11gs RAC? Heres how.

    1. H.Tongu YlmazOctober 1, 2007 at 11:53 am

    Great article! Thank you for sharing and for your efforts

    Best regards.

    2. Pingback:Oracle 11g RAC on Oracle Enterprise Linux 4(Update 5) and VMware Server 1.0.3 H.Tongu

    l l

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/?like=1&_wpnonce=006e1a85c5http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/?like=1&_wpnonce=006e1a85c5http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#commentshttp://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#commentshttp://startoracle.com/category/11g/http://startoracle.com/category/11g/http://startoracle.com/category/11g/http://startoracle.com/category/oracle/http://startoracle.com/category/oracle/http://startoracle.com/category/oracle/http://startoracle.com/category/rac/http://startoracle.com/category/rac/http://startoracle.com/category/rac/http://startoracle.com/category/real-application-clusters/http://startoracle.com/category/real-application-clusters/http://startoracle.com/category/real-application-clusters/http://startoracle.com/category/virtual-machine/http://startoracle.com/category/virtual-machine/http://startoracle.com/category/virtual-machine/http://startoracle.com/category/vmware/http://startoracle.com/category/vmware/http://startoracle.com/category/vmware/http://tonguc.wordpress.com/http://tonguc.wordpress.com/http://tonguc.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-10http://wordpress.com/signup/?ref=housead_ehttp://wordpress.com/signup/?ref=housead_ehttp://wordpress.com/signup/?ref=housead_ehttp://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-10http://tonguc.wordpress.com/http://startoracle.com/category/vmware/http://startoracle.com/category/virtual-machine/http://startoracle.com/category/real-application-clusters/http://startoracle.com/category/rac/http://startoracle.com/category/oracle/http://startoracle.com/category/11g/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#commentshttp://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/?like=1&_wpnonce=006e1a85c5http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/
  • 7/28/2019 Cluster Oracle 11g

    140/197

    YILMAZ Oracle Blog

    3. bakumaOctober 1, 2007 at 2:48 pm

    Excelent article, thank you.

    4. mdinhOctober 1, 2007 at 4:54 pm

    Thanks for sharing.

    5. Pingback:blogspot.sk Blog Archive Oracle 11g RAC na Oracle Enterprise Linux 4(Update 5) a VMwareServer 1.0.3

    6. Pingback: Oracle 11g RAC na Oracle Enterprise Linux 4(Update 5) a VMware Server 1.0.3 by OracleLog 7. Pingback:Setting up Oracle Database 11g Real Application Clusters with VMware. A Really Good Reference.

    Kevin Clossons Oracle Blog: Platform, Storage & Clustering Topics Related to Oracle Databases

    8. TOctober 23, 2007 at 5:48 pm

    Do you have the instructions for installing Oracle 10g RAC using vmware with RHEL 4\Fedora 7? Please

    advise.

    9. Pingback:about NetApp Blog Archive Oracle 11g RAC VMware Server.

    http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://www.oraclelog.com/http://www.oraclelog.com/http://www.oraclelog.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-12http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-13http://www.blogspot.sk/2007/10/02/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.blogspot.sk/2007/10/02/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.blogspot.sk/2007/10/02/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.blogspot.sk/2007/10/02/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.oraclelog.com/2007/10/02/oracle/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.oraclelog.com/2007/10/02/oracle/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.oraclelog.com/2007/10/02/oracle/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-35http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-35http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://kevinclosson.wordpress.com/2007/10/03/setting-up-oracle-database-11g-real-application-clusters-with-vmware-a-really-good-reference/http://www.oraclelog.com/2007/10/02/oracle/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.blogspot.sk/2007/10/02/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://www.blogspot.sk/2007/10/02/oracle-11g-rac-na-oracle-enterprise-linux-4update-5-a-vmware-server-103/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-13http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-12http://www.oraclelog.com/http://tonguc.wordpress.com/2007/10/01/oracle-11g-rac-on-oracle-enterprise-linux-4update-5-and-vmware-server-103/http://blog.aboutnetapp.ru/archives/57http://blog.aboutnetapp.ru/archives/57http://blog.aboutnetapp.ru/archives/57http://blog.aboutnetapp.ru/archives/57http://blog.aboutnetapp.ru/archives/57http://blog.aboutnetapp.ru/archives/57http://startoracle.wordpress.com/http://blog.aboutnetapp.ru/archives/57
  • 7/28/2019 Cluster Oracle 11g

    141/197

    10. Frederik VisserOctober 27, 2007 at 7:22 pm

    Hi T

    The 10g installation is exactly the same, except you need to configure the hangcheck timer on Linux as an

    additional task. In 11g the Process Monitor Daemon (oprocd) monitors the system state of cluster nodes so

    you no longer need the hangcheck timer.

    Kind Regards

    Frikkie Visser

    11.Pingback:IT : it4business.ru Oracle 11g RAC VMware Server.12. Mani

    January 8, 2008 at 4:26 am

    Magnificent article. Really really helps a DBA in many way. Thanks for your time and effort and most

    importantly, thanks for sharing it.

    regards,

    Mani

    13.Pingback:OEL onVMWare Manis Oracle Scratchpad

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-47http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://it4business.ru/notes/739/http://manib.wordress.com/http://manib.wordress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-341http://manib.wordpress.com/2008/01/08/oel-on-vmware/http://manib.wordpress.com/2008/01/08/oel-on-vmware/http://manib.wordpress.com/2008/01/08/oel-on-vmware/http://manib.wordpress.com/2008/01/08/oel-on-vmware/http://manib.wordpress.com/2008/01/08/oel-on-vmware/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-341http://manib.wordress.com/http://it4business.ru/notes/739/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-47http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    142/197

    14. Pekka KoppanenJanuary 9, 2008 at 12:53 pm

    Hi,Great article..

    I always install seperate homes for the asm and db because if you upgrade in the future

    15. MiladinJanuary 22, 2008 at 6:23 pm

    Good work.For someone who is not familiar with this install picutres are very usefull.

    Only thing is missing here is to install ASM in a separate Oracle home.It is for High Availability and

    maintenace.

    Thats mean after installing Oracle Database Software do one more install

    ORACLE_HOME=:/u01/app/oracle/products/11.1.0/asm directory.

    Choose option Configure ASM.

    Thanks.

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-343http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-349http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-349http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-343http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    143/197

    16. Frederik VisserJanuary 27, 2008 at 12:24 pm

    Hi Miladin & Pekka Koppanen

    Thanks for your valuable feedback. You are indeed right. Seperating the ASM and Oracle Homes in a

    production environment is recommended. I wanted to save disk space hence the reason for using only one

    home!

    Kind Regards

    Frikkie Visser

    17. AnandFebruary 12, 2008 at 2:17 pm

    First of all thank you for creating these instructions. They are very helpful.

    I have managed to create the two VM-s and they are able to communicate among themselves. But I am not

    able to see the outside world (internet) from within the VM-s. Can you tell me what I might be missing? I

    tried both the bridged and NAT. The former does not allow the host computer to connect to the VM but thelatter does. But with the NAT, I cannot connect to the host or the internet from within the VM-s.

    Thanks.

    Anand

    i i h

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-350http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-355http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-355http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-350http://startoracle.wordpress.com/http://dba-tip-trick.blogspot.com/http://dba-tip-trick.blogspot.com/http://dba-tip-trick.blogspot.com/
  • 7/28/2019 Cluster Oracle 11g

    144/197

    18. Niramit SoonthawongMarch 7, 2008 at 9:23 pm

    thanks for your clear step by step demonstration, i am running vmvare + linux + oracle 11g and thing oftrying oracle RAC out.

    19. AnupMarch 17, 2008 at 8:15 pm

    Great job!!!

    I installed 10g rac on Enterprise linux and vmware. I used 1 local node and 1 virtual node. Before I read this

    artical, I was stuck with disk sharing. Here you gave nice tricks for doing it.

    Thanks,

    Anup

    20. TomMarch 17, 2008 at 8:54 pm

    One question How many ethernet card did you use? I have one ethernet card and for interconnect when I

    tried to configure private ip, I coundnt ping with that.

    http://dba-tip-trick.blogspot.com/http://dba-tip-trick.blogspot.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-356http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-357http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-358http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-358http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-357http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-356http://dba-tip-trick.blogspot.com/
  • 7/28/2019 Cluster Oracle 11g

    145/197

    May 7, 2008 at 4:06 am

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-369http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-369
  • 7/28/2019 Cluster Oracle 11g

    146/197

    Hi,

    I have windows vista,i installed vmware workstation and the RAC

    but when i am rebooting the system it says the cluster configuration is not supported after reboot all thecluster infomation are removed and RAC configuration also removed.VIP also not ping

    I also try with vmware server but its not compatible with windows vista can you please advice what is the

    vmware software i should use to install rac on windows vista

    FLY I installed succecfully on windows-XP

    Thanks in advace

    Karl marx

    23. enriqueojedalaraMay 26, 2008 at 6:25 pm

    Excellent tutorial!!

    24.

    JoeMay 28, 2008 at 5:11 am

    It really run!

    Thanks

    M h R j

    http://quique.itakate.net/http://quique.itakate.net/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-370http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-371http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-371http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-370http://quique.itakate.net/
  • 7/28/2019 Cluster Oracle 11g

    147/197

    25. Murugesh RajaMay 28, 2008 at 6:05 am

    Excelent article. Thanks for sharing.

    26. AnonymousJune 12, 2008 at 5:10 am

    Verify the newly configured ASM disks

    As the root user on both nodes run the following:

    # service oracleasm sandisks# service oracleasm listdisks

    SHOULD BE:

    Verify the newly configured ASM disks

    As the root user on both nodes run the following:

    # service oracleasm scandisks

  • 7/28/2019 Cluster Oracle 11g

    148/197

    give the ifconfig -a output

  • 7/28/2019 Cluster Oracle 11g

    149/197

    31. Frederik VisserJuly 29, 2008 at 7:38 pm

    Hi Anonymous

    Thanks for pointing out the typo Ive now updated the post.

    Cheers

    Frikkie

    32. Frederik VisserJuly 29, 2008 at 7:41 pm

    Hi OraDba

    Sorry you feel this post does not provide you with enough value. The post was however intended to serve as a

    how-to guide for installing 11g RAC on VMWare virtual machines. It doesnt claim to be anything else!

    Cheers

    Frikkie

    33 Frederik Visser

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-381http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-382http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-382http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-381http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    150/197

    33. Frederik VisserJuly 29, 2008 at 7:46 pm

    Hi Dallas

    You dont need OCFS/OCFS2. I used the following:

    1.) Raw devices for the voting disk & OCR

    2.) Local file systems for the Oracle & Clusterware Homes

    3.) ASM for the database files.

    You can place the following on OCFS: Oracle software, Oracle database files, Voting disks, OCR & spfiles if

    you want to.

    Cheers

    Frikkie

    34. Frederik VisserJuly 29, 2008 at 7:48 pm

    Hi Jarek

    This is done under the section Install Oracle Enterprise Linux.

    Cheers

    Frikkie

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-383http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-384http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-384http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-383http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    151/197

    Frikkie

    35. Pingback: Oracle 11g RAC VMware Server. | about NetApp36. taizica

    September 21, 2008 at 8:37 am

    Great how-to guide. Nice to update for RHEL5U2 which does not support the raw device any more. The

    information here about raw devices needs to be updated.

    I followed the instructions on the following website, which seems working:

    http://oraclepitstop.wordpress.com/2008/02/15/raw-devices-on-rhel-5-or-oel-5/

    Frederik VisserDecember 8, 2008 at 9:51 pm

    Hi Taizica

    You are right thanks for pointing that out. This installation was however done on OEL 4. Ill publish an

    updated installation guide in the near future.

    Cheers

    F

    37.Pingback:Oracle 11gs RAC Playground setup howto

    38 Anonymous

    http://blog.aboutnetapp.ru/archives/146http://blog.aboutnetapp.ru/archives/146http://blog.aboutnetapp.ru/archives/146http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-430http://oraclepitstop.wordpress.com/2008/02/15/raw-devices-on-rhel-5-or-oel-5/http://oraclepitstop.wordpress.com/2008/02/15/raw-devices-on-rhel-5-or-oel-5/http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-440http://blog.rbmh.net/?p=131http://blog.rbmh.net/?p=131http://blog.rbmh.net/?p=131http://blog.rbmh.net/?p=131http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-440http://startoracle.wordpress.com/http://oraclepitstop.wordpress.com/2008/02/15/raw-devices-on-rhel-5-or-oel-5/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-430http://blog.aboutnetapp.ru/archives/146
  • 7/28/2019 Cluster Oracle 11g

    152/197

    38. AnonymousOctober 12, 2008 at 6:59 am

    Its great

    39. AnonymousNovember 29, 2008 at 5:32 am

    I am planning to use OCFS2 for the 2 ocr disks, 3 voting disks, database binaries, asm , clusterware binaries,

    and database files. Could u please let me know what shud i do about this.

    40. John HetheringtonDecember 5, 2008 at 11:10 am

    Im sorry if Ive missed something, but when I get to step 23 of the clusterware setup, I get the status of the

    VIPs as offline. And when I ping them I get unreachable. They are mentioned in my /etc/hostss file but

    nowhere else. Have I missed a step?

    41. John HetheringtonDecember 5, 2008 at 11:48 am

    Never mind. I start them using srvctl. Great Article though.

    Frederik Visser

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-435http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-437http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-438http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-439http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-439http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-438http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-437http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-435http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    153/197

    Frederik VisserDecember 8, 2008 at 9:56 pm

    Hi John

    Thanks very much! Watch out for an updated version of this post using a slightly different method. Glad you

    got that VIP problem sorted out!

    Let me know if you have any further questions.

    Cheers

    F

    42. NatarajanDecember 17, 2008 at 10:06 pm

    Not able to connect to internet from the vmware and even when linux boots up it fails to detect the eth0 and

    eth1

    Frederik VisserFebruary 9, 2009 at 8:53 pm

    Hi Natarajan

    Youll need to provide me with more details in order to troubleshoot this. Send me an email at: dbafred at

    gmail dot com.

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-441http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-457http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-490http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-490http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-457http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-441http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    154/197

    g

    Cheers

    Frederik

    43. Shyam SundarDecember 29, 2008 at 9:45 pm

    Very Nice document and really useful. Thank you so much.

    Help:

    Is it possible to install the same RAC in Windows vista home premium 64bit OS with 4 gb of RAM instead ofWindows XP 32 bit. What are the changes required to perform this in Windows vista.

    Thanks

    Shyam

    Frederik VisserFebruary 9, 2009 at 8:56 pm

    Hi Shyam

    This should be possible although Ive never done it not a big fan of Vista. If I had to take a guess Id say you

    should be able to do this just fine with my post.

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-476http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-491http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-491http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-476
  • 7/28/2019 Cluster Oracle 11g

    155/197

    j y p

    Let me know how you get on.

    CheersFrederik

    44. Ravi PrakashDecember 30, 2008 at 3:22 pm

    Great!!! I have one doubt regarding ASM and RDBMS, Oracle 11g recommends seperate HOME for ASM and

    RDBMS, will this work the same

    Ravi

    Frederik VisserFebruary 9, 2009 at 8:48 pm

    Hi Ravi

    This is perfectly fine, although it does complicate matters when it comes to upgrades & patching. Itstherefore recommended to have separate homes for ASM and the database in production environments.

    Cheers

    Frederik

    http://www.ravidba-oracle.blogspot.com/http://www.ravidba-oracle.blogspot.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-477http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-489http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-489http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-477http://www.ravidba-oracle.blogspot.com/
  • 7/28/2019 Cluster Oracle 11g

    156/197

    Thanx very much for this article. I start building up the environment but,

    unfortunatly the Cluvfy precheck failed during installation of the Oracle Clusterware.

  • 7/28/2019 Cluster Oracle 11g

    157/197

    y y p g

    It is complaining about missing gcc-3.4.5 and libgcc-3.4.5

    Where can I find them ?

    Regards

    Robert

    Frederik VisserFebruary 9, 2009 at 8:59 pm

    Hi Robert

    You can find this on the Linux installation CDs. If you are having trouble finding it let me know and Ill email

    it to you.

    Kind Regards

    Frederik

    47. Baber SafdarFebruary 3, 2009 at 1:07 pm

    Hi

    I am trying to do step 31 to install following packages. I have downloaded linux as ISO files on my PC. Could

    someone advise how I would go about installing these packages on my Linux vmware instances? Do I need to

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-492http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-488http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-488http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-492http://startoracle.wordpress.com/
  • 7/28/2019 Cluster Oracle 11g

    158/197

    download Linux as source??

    31, Install the following packages from the indicated cds:libaio-devel-0.3.105-2 (CD 3)

    elfutils-libelf-devel-0.97.1-4 (CD 4)

    unixODBC-devel-2.2.11-1 (CD 4)

    thanks

    Baber

    Frederik VisserFebruary 9, 2009 at 9:02 pm

    Hi Baber

    You mount the ISO files, which is cd image files, with VMWare no other software is needed. See step 1

    under Install Oracle Enterprise Linux of my post.

    Cheers

    Frederik

    48. Anonymous

    February 13, 2009 at 2:56 pm

    Hi,

    http://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-493http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-493http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-496http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-496
  • 7/28/2019 Cluster Oracle 11g

    159/197

    Hi,

    I created a vmx file and try to boot from the iso image but it always tries a network boot. Can someone tell me

    why this is happening.I can never boot from the iso image. any help appreciated

    Tabrez

    49. PaulFebruary 18, 2009 at 9:19 am

    Hi. I installed my clusterware on both nodes. i use Suse 10 Linux Enterprise Server on both nodes, and

    vmware server 1.0.8. When I install database software as it is in this artice , during copying files to node 2 in

    about 62% of installation my both machines power off. Can anybody help me? Please write on email :

    [email protected]

    Frederik VisserMarch 11, 2009 at 9:02 am

    Hi Paul

    It is difficult to troubleshoot an issue without access to the log files. Please verify that youve completed all

    the SUSE pre-installation requirements.

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-497mailto:[email protected]:[email protected]://startoracle.wordpress.com/http://startoracle.wordpress.com/http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-511http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-511http://startoracle.wordpress.com/mailto:[email protected]://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-497
  • 7/28/2019 Cluster Oracle 11g

    160/197

  • 7/28/2019 Cluster Oracle 11g

    161/197

  • 7/28/2019 Cluster Oracle 11g

    162/197

    Thank you very much for your detailed post. It helped me learn a lot!

    I ran into the issue. I successfully completed all the steps described here. Everything appeared up an

    i h fi i f ll i ll i h d b h i l d i h b i i d

  • 7/28/2019 Cluster Oracle 11g

    163/197

    running. The very first time after all installations I shutdown both virtual nodes without bringing down

    instances by usind Action/Log Off/Shutdown. Now I am not able to start any nodes. It reaches the point

    where it says:Starting init.crs:

    and hangs there indefinitely. Is there any way this can be resolved or I will need to redo all the set up from

    scratch?

    Please help.

    Thanks!!!

    58. AnonymousMarch 4, 2009 at 8:39 pm

    Frederik,

    This is a really nice article for Installing RAC.

    However I got stuck at one point and cannot move any forward.

    I followed the instructions above for installing linux and I find the unixODBC rpm missing. I could not find it

    in the CDs either. I donwloaded it from the internet but its complaining about lot of other pre-requisites.

    Please let me know if you had to do anything else to get those packages. For this reason, I am not able to gopast the runClufy stage. Thanks.

    Babu

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-506http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-506
  • 7/28/2019 Cluster Oracle 11g

    164/197

  • 7/28/2019 Cluster Oracle 11g

    165/197

  • 7/28/2019 Cluster Oracle 11g

    166/197

    Thanks for the clear instructions, this is the best I ever found over the internet for RAC set up.

    Thank you

  • 7/28/2019 Cluster Oracle 11g

    167/197

    Thank you,

    Dhanu.

    67. DhanuApril 16, 2009 at 9:36 pm

    Hi Frederik,

    Is it possible to share shared disk of OCR,voting and ASM from rac3 if I create another server rac3 on the

    same host? If possible, could you please share your ideas.

    Thank you,Dhanu.

    68. MandeepApril 20, 2009 at 12:11 am

    Excellent Artiicle. Much appreciate your efforts for sharing this, Also it would be nice to have same Arcticle

    but with vmware version 2 (or 2.1)

    69. Afsar

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-519http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-520http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-520http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-519
  • 7/28/2019 Cluster Oracle 11g

    168/197

    Thanks

  • 7/28/2019 Cluster Oracle 11g

    169/197

    71. Denny HanMay 25, 2009 at 8:46 pm

    Hi,

    could you please tell me more detail steps about how to install the package, dont know how to do it. thanks

    31, Install the following packages from the indicated cds:

    libaio-devel-0.3.105-2 (CD 3)

    elfutils-libelf-devel-0.97.1-4 (CD 4)

    unixODBC-devel-2.2.11-1 (CD 4)

    72. JayWMay 26, 2009 at 5:44 am

    I think your site So you want to play with Oracle 11gs RAC? Heres how. is greatbut have encountered a

    problem in step 42, while preparing to install Oracle Clusterware. I see If your network is setu p correctly

    you should be able to connect to the internet from within your virtual machine but although I can ping rac1

    and rac2 from each other I cannot get out to the internet from inside either virtual machine. I am admittedlya noob when it comes to linux and am not overly familiar with network configurations either; I have gathered

    what data I can and present it below:

    My host environment for VMware machines:

    http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-525http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-526http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-526http://startoracle.com/2007/09/30/so-you-want-to-play-with-oracle-11gs-rac-heres-how/#comment-525
  • 7/28/2019 Cluster Oracle 11g

    170/197

  • 7/28/2019 Cluster Oracle 11g

    171/197

    Ethernet adapter VMware Network Adapter VMnet1:

    Connection-specific DNS Suffix . :

  • 7/28/2019 Cluster Oracle 11g

    172/197

    p

    Description . . . . . . . . . . . : VMware Virtual Ethernet Adapter for VMnet1

    Physical Address. . . . . . . . . : 00-50-56-C0-00-01

    DHCP Enabled. . . . . . . . . . . : Yes

    Autoconfiguration Enabled . . . . : Yes

    Link-local IPv6 Address . . . . . : fe80::d819:7596:3806:2a5%15(Preferred)

    IPv4 Address. . . . . . . . . . . : 192.168.79.1(Preferred)

    Subnet Mask . . . . . . . . . . . : 255.255.255.0

    Lease Obtained. . . . . . . . . . : Monday, May 25, 2009 11:35:36 PM

    Lease Expires . . . . . . . . . . : Tuesday, May 26, 2009 12:50:36 AM

    Default Gateway . . . . . . . . . :

    DHCP Server . . . . . . . . . . . : 192.168.79.254

    DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1

    fec0:0:0:ffff::2%1

    fec0:0:0:ffff::3%1

    NetBIOS over Tcpip. . . . . . . . : Enabled

    Ethernet adapter VMware Network Adapter VMnet8:

    Connection-specific DNS Suffix . :Description . . . . . . . . . . . : VMware Virtual Ethernet Adapter for VMnet8

    Physical Address. . . . . . . . . : 00-50-56-C0-00-08

    DHCP Enabled. . . . . . . . . . . : No

    Autoconfiguration Enabled . . . . : Yes

    Link-local IPv6 Address . . . . . : fe80::e52b:d897:1424:f9bf%17(Preferred)

    IPv4 Address. . . . . . . . . . . : 192.168.188.1(Preferred)

    Subnet Mask : 255 255 255 0

  • 7/28/2019 Cluster Oracle 11g

    173/197

    Subnet Mask . . . . . . . . . . . : 255.255.255.0

    Default Gateway . . . . . . . . . :

    DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1fec0:0:0:ffff::2%1

    fec0:0:0:ffff::3%1

    NetBIOS over Tcpip. . . . . . . . : Enabled

    Tunnel adapter Local Area Connection* 6:

    Media State . . . . . . . . . . . : Media disconnected

    Connection-specific DNS Suffix . :

    Description . . . . . . . . . . . : isatap.{B5702F29-88E8-42FB-8A6C-CF0B3E1659A5}Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0

    DHCP Enabled. . . . . . . . . . . : No

    Autoconfiguration Enabled . . . . : Yes

    Tunnel adapter Local Area Connection* 7:

    Media State . . . . . . . . . . . : Media disconnected

    Connection-specific DNS Suffix . :Description . . . . . . . . . . . : isatap.{233A5367-81C5-4BFA-B1BA-41D8D79E3D84}

    Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0

    DHCP Enabled. . . . . . . . . . . : No

    Autoconfiguration Enabled . . . . : Yes

  • 7/28/2019 Cluster Oracle 11g

    174/197

  • 7/28/2019 Cluster Oracle 11g

    175/197

  • 7/28/2019 Cluster Oracle 11g

    176/197

    #

    127.0.0.1 localhost localhost.localdomain localhost

  • 7/28/2019 Cluster Oracle 11g

    177/197

    # Public

    192.168.1.50 rac1.localhost rac1

    192.168.1.60 rac2.localhost rac2

    # VIP

    192.168.1.51 rac1-vip.localhost rac1-vip

    192.168.1.61 rac2-vip.localhost rac2-vip

    # Interconnect / Private

    10.10.10.50 rac1-priv.localhost rac1-priv

    10.10.10.60 rac2-priv.localhost rac2-priv

    #EOF

    This is rac2 ifconfig:

    [root@rac2 ~]# ifconfig -a

    eth0 Link encap:Ethernet HWaddr 00:0C:29:2B:D1:B5

    inet addr:192.168.1.60 Bcast:192.168.1.255 Mask:255.255.255.0

    inet6 addr: fe80::20c:29ff:fe2b:d1b5/64 Scope:Link

    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

    RX packets:21 errors:0 dropped:0 overruns:0 frame:0

    TX packets:11 errors:0 dropped:0 overruns:0 carrier:0

    collisions:0 txqueuelen:1000

    RX bytes:6732 (6.5 KiB) TX bytes:630 (630.0 b)

    Interrupt:185 Base address:01480

  • 7/28/2019 Cluster Oracle 11g

    178/197

    p 5 4

    eth1 Link encap:Ethernet HWaddr 00:0C:29:2B:D1:BF

    inet addr:10.10.10.60 Bcast:10.10.10.255 Mask:255.255.255.0

    inet6 addr: fe80::20c:29ff:fe2b:d1bf/64 Scope:Link

    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

    RX packets:0 errors:0 dropped:0 overruns:0 frame:0

    TX packets:11 errors:0 dropped:0 overruns:0 carrier:0

    collisions:0 txqueuelen:1000