1/27

ASMLIB Installation On MultiPath

Mapper Devices (Step by Step)
1) Install the ASMLIB RPMs (Linux only) as described in the following document (on all
the RAC nodes or on one node if you are using a Standalone configuration):
=)> How To Setup ASM on Linux Using ASMLIB Disks, Raw Devices, Block
Devices or UDEV Devices? [ID 580153.1]
For additional information please check the following ASMLIB sites and documents:
http://www.oracle.com/technetwork/topics/linux/index-101839.html
=)> Tips on Installing and Using the Software

=)> Collecting The Required Information For Support To Troubleshot ASM/ASMLIB

Issues. [ID 869526.1]

1.1) For this example we are using the next OS Linux kernel release (it must be the
same on all the RAC nodes):

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

2/27
1.2) So the required RPMs need to be downloaded from the following site:
http://www.oracle.com/technetwork/server-storage/linux/asmlib/ol6-1709075.html
=)> Oracle Linux 6

Oracle ASMLib (2.0) Downloads for Oracle Linux 6

=)> Intel EM64T (x86_64) Architecture
==)> Library and Tools
a) oracleasmlib-2.0.4-1.el6.x86_64.rpm

b) oracleasm-support-2.1.5-1.el6.x86_64 # (Installed by default on OL (Oracle Linux)

OS configurations)
Example:

==)> Drivers for 2.6.32-300.32.3.el6uek.x86_64 kernel:

c) On UEK kernel OL (Oracle Linux) OS configurations, the Kernel driver/package RPM

is implicitly included in the UEK OS kernel by default as follows:

1.3) The required ASMLIB RPMs need to be installed (on all the RAC nodes) as
described in the following documents:
http://www.oracle.com/technetwork/server-storage/linux/install-082632.html
Or

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

3/27
=)> How To Setup ASM on Linux Using ASMLIB Disks, Raw Devices, Block
Devices or UDEV Devices? [ID 580153.1]

1.4) Validate that all the required ASMLIB (oracleasm) RPMs were installed (on all the
RAC nodes):
Node #1:

Node #2:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

4/27
Node #3:

2) List the available candidate disk for ASM/ASMLIB, for this example we will use 5
shared multipath (mapper) disks (5 GB in size each):

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

5/27
Node #1:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

6/27
Node 2:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

7/27

Node 3:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

8/27

3) Check if a primary partition exists per disk:

# ls -l /dev/mapper/mpath[d,c,b,f,e]*

4) If the partitions do not exist, then create one partition per disk, so you need to be
connected from node only (e.g. Node #1), since the disks are shared among all the
nodes:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

9/27

Node #1 (only):

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

10/27

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

11/27

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

12/27

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

13/27

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

14/27

5) The new multipath partitions are listed as follows:

6) Now partprobe OS command needs to be executed on all the other RAC nodes to
make the new partitions available and visible on each node as follows:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

15/27
Node #2:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

16/27
Node #3:

7) Setup the Oracle ASMLIB API (Linux only) as follows (the following steps need to be
executed on all the nodes):
Note: Having we are doing an ASM Role Separation, the candidate ASMLIB disks or
raw devices or block devices or LUNs or NAS devices, etc, which will be used for ASM
disks, need to be owned by the Grid Infrastructure OS user (grid) and by the OSASM
group (asmadmin). This applies for both Linux & Unix.
Non-role separation configurations will use oracle:dba as the user:group for all the
candidate/member disks.
But using ASM Role Separation, the ownership for the ASM disks will be
grid:asmadmin. Note that the Grid Infrastructure software owner must be same owner
for all the ASM disks as well.
The suggested name for the OS user is grid and the suggested name for the OS group
is asmadmin (as follow):

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

17/27

Node #1:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

18/27
Node #2:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

19/27

Node #3:

8) Because this is a multipath (mapper) configuration (multipath disks), the ASMLIB API
needs to be configured following the steps described in the next note (in all the RAC
nodes):
=)> How To Setup ASM & ASMLIB On Native Linux Multipath Mapper disks? [ID
602952.1]

As follows:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

20/27
8.1) You will need to update the /etc/sysconfig/oracleasm file with the next value(s)
in the ORACLEASM_SCANORDER &
ORACLEASM_SCANEXCLUDE
parameters:

Node #1:

Node #2:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

21/27

Node #3:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

22/27

8.2) Then reboot all the RAC nodes to implement the ASMLIB changes:
# reboot
8.3) After the reboot, please verify that the ASMLIB API is loaded on each node:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

23/27

Node #1:

Node #2:

Node #3:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

24/27

9) Create the ASMLIB disks on the 5 mapper multipath disk partitions (created in the
previous steps):
9.1) Connect as root user to Node #1 only and execute the following commands:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

25/27

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

26/27
9.2) On the other RAC nodes, the next commands need to be executed to discover the
new ASMLIB disks:

Node #2:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal

27/27

Node #3:

ASMLIB Installation On MultiPath Mapper Devices (Step by Step)

Author: Esteban D Bernal