Installing gR RAC on RBEL .

bit
Pre-requisites :

BeIore you install the Grid,Clusterware and the Database, you must complete several pre-installation
tasks.
1) Public IP`s Needs a NIC card on the server
) Virtual IP`s Binded with Public IP
3) Private IP`s -- Needs a NIC card on the server
4) SCAN IP Does not need a NIC card however needs to resolved by DNS i.e it should have a
Iully qualiIied domain name in the hosts Iile as well as the DOMAIN.
5) Min GB RAM on each server
6) Kernel Parameters
7) Lun`s created on the storage and mounted on the server which will be seen as a raw device on the
server
For e.g : /dev/sdb, /dev/sdc etc
8) SoItware Ior Oracle 11g Grid and Database (64 bit)
9) Access to root to create users and run post installation steps
10)0 GB Iree on local hard disk Ior grid and database soItware installation

tarting tbe Configuration and Installation :

1) l's requlred for conflguraLlon
rooL[erpuaLdbs01 # caL /eLc/hosLs
17.0.0.1 localhost.localdomain localhost
######PUBLIC IP FOR RAC#####################
10.10.160.1 erpuatdbs01.mbcgroup.local erpuatdbs01
10.10.160. erpuatdbs0.mbcgroup.local erpuatdbs0
##### VIP Ior RAC ########################
10.10.160.11 erpuatdbs01-vip.mbcgroup.local erpuatdbs01-vip
10.10.160.1 erpuatdbs0-vip.mbcgroup.local erpuatdbs0-vip
##########Private Interconnect Ior RAC#############
10.10.0.0 erpuatdbs01-priv.mbcgroup.local erpuatdbs01-priv
10.10.0.1 erpuatdbs0-priv.mbcgroup.local erpuatdbs0-priv
##########SCAN VIP#############################
10.10.160.3 erpuatdbs.mcbgroup.local erpuatdbs

2)use "free m" Lo check Lhe slze of memory ln Llnux
3) Lun's mounLed on Lhe server
##########ll uSlnC 8AWuLvlCLS ul8LC1L? Wl1P ASM##############
|rooterpuatdbs01 ~|# Idisk l
Disk /dev/sdb: 1073 MB, 107374184 bytes For OCR and Voting Disk
34 heads, 61 sectors/track, 1011 cylinders
Units cylinders oI 074 * 51 1061888 bytes
Device Boot Start End Blocks Id System For OCR and Voting Disk -- Redundant
Disk /dev/sdc: 1073 MB, 107374184 bytes
34 heads, 61 sectors/track, 1011 cylinders
Units cylinders oI 074 * 51 1061888 bytes

Device Boot Start End Blocks Id System For Database Files
Disk /dev/sdd: 14.7 GB, 14748364800 bytes
55 heads, 63 sectors/track, 6108 cylinders
Units cylinders oI 16065 * 51 8580 bytes

Device Boot Start End Blocks Id System For Archive Logs
Disk /dev/sde: 14.7 GB, 14748364800 bytes
55 heads, 63 sectors/track, 6108 cylinders
Units cylinders oI 16065 * 51 8580 bytes

##########################################################################
4) SofLware for Crld and uaLabase lnsLallaLlon
a) llnuxx64_11g82_grldzlp
b) llnuxx64_11g82_daLabase_1of2zlp
c) llnuxx64_11g82_daLabase_2of2zlp
3) Local hard dlsk
|rooterpuatdbs01 soItware|# dI h
Filesystem Size Used Avail Use Mounted on
/dev/sda 19G 3.0G 15G 17 /
/dev/sda7 78G 9.5G 64G 13 /soItware For Oracle SoItwares
/dev/sda6 15G 165M 14G /u01 For GRID ORACLE HOME ( CRS AND ASM)
/dev/sda5 15G 165M 14G /u0 For ORACLE DATABASE HOME
/dev/sda1 190M 13M 168M 7 /boot
tmpIs 3.0G 0 3.0G 0 /dev/shm


##############ll uSlnC ASM ulSkS lC8 ASM###############
lnsLalllng ASM Llbrarles
#uname r
2618194el3
rooL[erpuaLdbs02 rpm# rpm uvh oracleasm*rpm
warnlng oracleasm2618164el32031el3x86_64rpm Peader v3 uSA slgnaLure nCkL? key lu
e3e0139
reparlng ########################################### 100
1oracleasmsupporL ########################################### 33
2oracleasm2618194el########################################### 67
3oracleasmllb ########################################### 100
rooL[erpuaLdbs02 rpm#
rooL[erpuaLdbs01 # rpm qa oracleas*
oracleasmllb2041el3
oracleasm2618194el32031el3
oracleasmsupporL2131el3
lormaL Lhe raw devlce Lo have aLleasL 1 parLlLlon
rooL[erpuaLdbs01 # fdlsk /dev/sdb
1he number of cyllnders for Lhls dlsk ls seL Lo 26108
1here ls noLhlng wrong wlLh LhaL buL Lhls ls larger Lhan 1024
and could ln cerLaln seLups cause problems wlLh
1) sofLware LhaL runs aL booL Llme (eg old verslons of LlLC)
2) booLlng and parLlLlonlng sofLware from oLher Css
(eg uCS lulSk CS/2 lulSk)
Command (m for help) n
Command acLlon
e exLended
p prlmary parLlLlon (14)
p
arLlLlon number (14) 1
llrsL cyllnder (126108 defaulL 1)
uslng defaulL value 1
LasL cyllnder or +slze or +slzeM or +slzek (126108 defaulL 26108)
uslng defaulL value 26108
Command (m for help) w
1he parLlLlon Lable has been alLered!
Calllng locLl() Lo reread parLlLlon Lable
Synclng dlsks

8LLA1 1PL SAML lC8 ALL 1PL 8AW uLvlCLS
rooL[erpuaLdbs01 # fdlsk l
ulsk /dev/sda 1468 C8 146814976000 byLes
233 heads 63 secLors/Lrack 17849 cyllnders
unlLs cyllnders of 16063 * 312 8223280 byLes
uevlce 8ooL SLarL Lnd 8locks ld SysLem
/dev/sda1 * 1 23 200781 83 Llnux
/dev/sda2 26 2373 20482873 83 Llnux
/dev/sda3 2376 3619 8383930 82 Llnux swap / Solarls
/dev/sda4 3620 17849 114302473 3 LxLended
/dev/sda3 3620 3331 13338108+ 83 Llnux
/dev/sda6 3332 7443 13338108+ 83 Llnux
/dev/sda7 7444 17849 83386163+ 83 Llnux
ulsk /dev/sdb 1073 M8 1073741824 byLes
34 heads 61 secLors/Lrack 1011 cyllnders
unlLs cyllnders of 2074 * 312 1061888 byLes

uevlce 8ooL SLarL Lnd 8locks ld SysLem
/dev/sdb1 1 1011 1048376+ 83 Llnux

ulsk /dev/sdc 1073 M8 1073741824 byLes
34 heads 61 secLors/Lrack 1011 cyllnders
unlLs cyllnders of 2074 * 312 1061888 byLes

uevlce 8ooL SLarL Lnd 8locks ld SysLem
/dev/sdc1 1 1011 1048376+ 83 Llnux

ulsk /dev/sdd 2147 C8 214748364800 byLes
233 heads 63 secLors/Lrack 26108 cyllnders
unlLs cyllnders of 16063 * 312 8223280 byLes

uevlce 8ooL SLarL Lnd 8locks ld SysLem
/dev/sdd1 1 26108 209712478+ 83 Llnux
ulsk /dev/sde 2147 C8 214748364800 byLes
233 heads 63 secLors/Lrack 26108 cyllnders
unlLs cyllnders of 16063 * 312 8223280 byLes

uevlce 8ooL SLarL Lnd 8locks ld SysLem
/dev/sde1 1 26108 209712478+ 83 Llnux

Conf|gure CkACLL ASM
rooL[erpuaLdbs01 # oracleasm conflgure l
Conflgurlng Lhe Cracle ASM llbrary drlver
1hls wlll conflgure Lhe onbooL properLles of Lhe Cracle ASM llbrary
drlver 1he followlng quesLlons wlll deLermlne wheLher Lhe drlver ls
loaded on booL and whaL permlsslons lL wlll have 1he currenL values
wlll be shown ln brackeLs () PlLLlng Ln1L8 wlLhouL Lyplng an
answer wlll keep LhaL currenL value CLrlC wlll aborL
uefaulL user Lo own Lhe drlver lnLerface oracrs
uefaulL group Lo own Lhe drlver lnLerface olnsLall
SLarL Cracle ASM llbrary drlver on booL (y/n) y
Scan for Cracle ASM dlsks on booL (y/n) y
WrlLlng Cracle ASM llbrary drlver conflguraLlon done
rooL[erpuaLdbs01 #


rooL[erpuaLdbs01 oracleasm# /usr/sbln/oracleasm lnlL
MounLlng ASMllb drlver fllesysLem /dev/oracleasm
rooL[erpuaLdbs01 eLc# /usr/sbln/oracleasm creaLedlsk C8S /dev/sdb1
WrlLlng dlsk header done
lnsLanLlaLlng dlsk done
rooL[erpuaLdbs01 eLc# /usr/sbln/oracleasm creaLedlsk uA1A /dev/sdd1
WrlLlng dlsk header done
lnsLanLlaLlng dlsk done
rooL[erpuaLdbs01 eLc# /usr/sbln/oracleasm creaLedlsk A8C /dev/sde1
WrlLlng dlsk header done
lnsLanLlaLlng dlsk done
rooL[erpuaLdbs01 eLc#

rooL[erpuaLdbs01 eLc# /usr/sbln/oracleasm scandlsks
8eloadlng dlsk parLlLlons done
Cleanlng any sLale ASM dlsks
Scannlng sysLem for ASM dlsks
rooL[erpuaLdbs01 eLc# /usr/sbln/oracleasm llsLdlsks
A8C
C8S
uA1A

6) CreaLe users for crs and daLabase lnsLallaLlon
#groupadd dba
#groupadd oinstall
#useradd orauat g oinstall G dba
#useradd oracrs g oinstall G dba
7) Kernel Parameters on all nodes
kernel.msgmax 65536

# Controls the deIault maxmimum size oI a mesage queue
kernel.shmmni 4096
kernel.sem 50 3000 100 18
kernel.shmmax 68719476736

# Controls the maximum number oI shared memory segments, in pages
kernel.shmall 49496796
Is.Iile-max 6815744
Is.aio-max-nr 1048576
net.ipv4.iplocalportrange 9000 65500
net.core.rmemdeIault 6144
net.core.rmemmax 4194304
net.core.wmemdeIault 6144
net.core.wmemmax 1048576
Add below 4 lines in /etc/security/limits.conI
* soIt nproc 047
* hard nproc 16384
* soIt noIile 104
* hard noIile 65536


SLarLlng Lhe Crld lnsLallaLlon
1) unzlp Lhe grld sofLware as rooL user and glve oracrs and orauaL user Lo run Lhe lnsLallaLlon
2) LxporL ulSLA? and sLarL Lhe lnsLaller
lor eg lrom your local machlne you should have
a) uLLy
b) xmlng sofLware
c) uouble Cllck on xmlng and lL wlll seL Lhe local deskLop dlsplay and wlll run ln Lhe background
Cpen puLLy and Lnable x11 forwardlng


3) uslng oracrs user execuLe Lhe runlnsLaller
oracrs[erpuaLdbs01 grld$ /runlnsLaller




Cllck on SSP ConnecLlvlLy




LnLer Lhe S?SASM assword and cllck nexL
Clve permlsslon Lo Lhe 8AW uLvlCLS on Lhe server
rooL[erpuaLdbs01 dev# chown oracrsolnsLall /dev/sdb
rooL[erpuaLdbs01 dev# chown oracrsolnsLall /dev/sdc



LdlL n1u" and S1A81 Lhe servlce Cn ALL nCuLS
rooL[erpuaLdbs01 dev# cd /eLc/sysconflg/
rooL[erpuaLdbs01 sysconflg# caL nLpd
# urop rooL Lo ld nLpnLp by defaulL
C1lCnSx u nLpnLp p /var/run/nLpdpld
# SeL Lo yes Lo sync hw clock afLer successful nLpdaLe
S?nC_PWCLCCkno
# AddlLlonal opLlons for nLpdaLe
n1uA1L_C1lCnS
rooL[erpuaLdbs01 sysconflg# servlce nLpd sLarL
nLpd Synchronlzlng wlLh Llme server Ck
SLarLlng nLpd Ck
rooL[erpuaLdbs01 sysconflg#



LxecuLe oralnsL8ooLsh and rooLsh from all Lhe nodes
node 1 oralnsL8ooLsh
rooL[erpuaLdbs01 oralnvenLory# /oralnsL8ooLsh
Changlng permlsslons of /u01/app/oralnvenLory
Addlng readwrlLe permlsslons for group
8emovlng readwrlLeexecuLe permlsslons for world
Changlng groupname of /u01/app/oralnvenLory Lo olnsLall
1he execuLlon of Lhe scrlpL ls compleLe
rooL[erpuaLdbs01 oralnvenLory#

node 2 oralnsL8ooLsh
rooL[erpuaLdbs02 oralnvenLory# /oralnsL8ooLsh
Changlng permlsslons of /u01/app/oralnvenLory
Addlng readwrlLe permlsslons for group
8emovlng readwrlLeexecuLe permlsslons for world
Changlng groupname of /u01/app/oralnvenLory Lo olnsLall
1he execuLlon of Lhe scrlpL ls compleLe
rooL[erpuaLdbs02 oralnvenLory#
node 1 rooLsh node 2 rooLsh
Node1.txt Node2.txt



rooL[erpuaLdbs01 bln# /crs_sLaL L
name 1ype 1argeL SLaLe PosL

oraL8lsnr oraerLype CnLlnL CnLlnL erpuaLdbs01
oran1lsnr oraerLype CnLlnL CnLlnL erpuaLdbs01
oraCC8dg oraupLype CnLlnL CnLlnL erpuaLdbs01
oraasm oraasmLype CnLlnL CnLlnL erpuaLdbs01
oraeons oraeonsLype CnLlnL CnLlnL erpuaLdbs01
oraSM1asm appllcaLlon CnLlnL CnLlnL erpuaLdbs01
ra01lsnr appllcaLlon CnLlnL CnLlnL erpuaLdbs01
oras01gsd appllcaLlon CllLlnL CllLlnL
oras01ons appllcaLlon CnLlnL CnLlnL erpuaLdbs01
oras01vlp oraL1Lype CnLlnL CnLlnL erpuaLdbs01
oraSM2asm appllcaLlon CnLlnL CnLlnL erpuaLdbs02
ora02lsnr appllcaLlon CnLlnL CnLlnL erpuaLdbs02
oras02gsd appllcaLlon CllLlnL CllLlnL
oras02ons appllcaLlon CnLlnL CnLlnL erpuaLdbs02
oras02vlp oraL1Lype CnLlnL CnLlnL erpuaLdbs02
oragsd oragsdLype CllLlnL CllLlnL
oraneLwork orarkLype CnLlnL CnLlnL erpuaLdbs01
oraoc4[ oraoc4[Lype CllLlnL CllLlnL
oraons oraonsLype CnLlnL CnLlnL erpuaLdbs01
oraryacfs orafsLype CnLlnL CnLlnL erpuaLdbs01
orascan1vlp oralpLype CnLlnL CnLlnL erpuaLdbs01

8un ASMCA Lo add creaLe new ulSk C8CuS for uA1A and l8A
Logln as orauaL user and run asmca
C8ACLL_PCML/u01/app/1120/grld
exporL C8ACLL_PCML
C8ACLL_Slu+ASM1
exporL C8ACLL_Slu
A1P$A1P$C8ACLL_PCML/bln$PCML/bln
exporL A1P
cd $C8ACLL_PCML/bln
/asmca


Cllck on creaLe




Slmllarly creaLe for l8A by selecLlng Lhe remalnlng dlsks

LxlL Lhe appllcaLlon


CreaLe a uaLabase SofLware
1) Logln as orauaL user and sLarL Lhe lnsLallaLlon









node 1
rooL[erpuaLdbs01 dbhome_1# /rooLsh
8unnlng Cracle 11g rooLsh scrlpL
1he followlng envlronmenL varlables are seL as
C8ACLL_CWnL8 orauaL
C8ACLL_PCML /u02/app/oracle/producL/1120/dbhome_1
LnLer Lhe full paLhname of Lhe local bln dlrecLory /usr/local/bln
1he flle dbhome already exlsLs ln /usr/local/bln CverwrlLe lL? (y/n)
n y
Copylng dbhome Lo /usr/local/bln
1he flle oraenv already exlsLs ln /usr/local/bln CverwrlLe lL? (y/n)
n y
Copylng oraenv Lo /usr/local/bln
1he flle coraenv already exlsLs ln /usr/local/bln CverwrlLe lL? (y/n)
n y
Copylng coraenv Lo /usr/local/bln
LnLrles wlll be added Lo Lhe /eLc/oraLab flle as needed by
uaLabase ConflguraLlon AsslsLanL when a daLabase ls creaLed
llnlshed runnlng generlc parL of rooLsh scrlpL
now producLspeclflc rooL acLlons wlll be performed
llnlshed producLspeclflc rooL acLlons
node 2
rooL[erpuaLdbs02 dbhome_1# /rooLsh
8unnlng Cracle 11g rooLsh scrlpL
1he followlng envlronmenL varlables are seL as
C8ACLL_CWnL8 orauaL
C8ACLL_PCML /u02/app/oracle/producL/1120/dbhome_1
LnLer Lhe full paLhname of Lhe local bln dlrecLory /usr/local/bln
1he flle dbhome already exlsLs ln /usr/local/bln CverwrlLe lL? (y/n)
n y
Copylng dbhome Lo /usr/local/bln
1he flle oraenv already exlsLs ln /usr/local/bln CverwrlLe lL? (y/n)
n y
Copylng oraenv Lo /usr/local/bln
1he flle coraenv already exlsLs ln /usr/local/bln CverwrlLe lL? (y/n)
n y
Copylng coraenv Lo /usr/local/bln
LnLrles wlll be added Lo Lhe /eLc/oraLab flle as needed by
uaLabase ConflguraLlon AsslsLanL when a daLabase ls creaLed
llnlshed runnlng generlc parL of rooLsh scrlpL
now producLspeclflc rooL acLlons wlll be performed
llnlshed producLspeclflc rooL acLlons
rooL[erpuaLdbs02 dbhome_1#