Professional Documents
Culture Documents
Modified 12-NOV-2008 Type HOWTO Status PUBLISHE
D
In this Document
Goal
Solution
1. Partition the shared disk
2. Set Partitions to be used as RAW Devices
3. Create symbolic links to the raw partitions and set ownership to oracle:dba:
4. To add the voting disk mirror, run 'crsctl add css votedisk' command as root:
5. Query the status of all voting disks:
Conclusion
References
Applies to:
Goal
Voting disk mirroring can be implemented on shared raw partitions and on a supported
shared filesystem - either Oracle Cluster File System (OCFS) or Network FileSystem
(NFS). In this article we will show how to implement voting disk mirroring on raw
partitions.
At the time of installation the clusterware in this setup was configured with one voting
disk (/ora10g/app/oracle/oradata/V10/VotingDisk1) on a shared raw partition:
# cd /ora10g/app/oracle/oradata/V10/
# ls -l
total0
lrwxrwxrwx 1 oracle dba 14 Jul 25 14:58 OracleClusterRegistry ->/dev/raw/raw28
lrwxrwxrwx 1 oracle dba 14 Jul 29 11:38 VotingDisk1 -> /dev/raw/raw29
Solution
To achieve this we need to partition the shared disk, make the partitions available to the
OS as raw devices, optionally create symbolic links to these raw devices and add them
as mirrored voting disks.
1. Partition the shared disk
In this setup the shared disk is seen as /dev/sdb from both nodes in the two node RAC
setup:
# fdisk -l /dev/sdb
Partitions /dev/sdb2 and /dev/sdb15 will be used for voting disk mirroring. To set them
up as raw devices, with permissions 600 and ownership assigned to oracle:dba,run the
following as root:
# ln -s /dev/raw/raw30 /ora10g/app/oracle/oradata/V10/VotingDisk2
# /bin/chown oracle:dba /ora10g/app/oracle/oradata/V10/VotingDisk2
# ln -s /dev/raw/raw31 /ora10g/app/oracle/oradata/V10/VotingDisk3
# /bin/chown oracle:dba /ora10g/app/oracle/oradata/V10/VotingDisk3
4. To add the voting disk mirror, run 'crsctl add css votedisk' command as
root:
This fails with "Cluster is not in a ready state for online disk addition" error. The problem
is due to an Oracle bug where this operation does not work (as it should) with
clusterware up and running.
To work around the problem perform the add operation with the -force option while the
clusterware is down:
Stopping resources.
Successfully stopped CRS resources
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
# crsctl add css votedisk /ora10g/app/oracle/oradata/V10/VotingDisk2 -
force
4.3. Restart the clusterware on all nodes for these changes to take effect:
# crsctl query css votedisk
0. 0 /ora10g/app/oracle/oradata/V10/VotingDisk2
1. 0 /ora10g/app/oracle/oradata/V10/VotingDisk1
2. 0 /ora10g/app/oracle/oradata/V10/VotingDisk3
located 3 votedisk(s).
# ls -al
...
lrwxrwxrwx 1 oracle dba 14 Jul 25 14:58 OracleClusterRegistry-
>/dev/raw/raw28
lrwxrwxrwx 1 oracle dba 14 Jul 29 11:38 VotingDisk1 ->/dev/raw/raw29
lrwxrwxrwx 1 oracle dba 14 Jul 29 11:38 VotingDisk2 ->/dev/raw/raw30
lrwxrwxrwx 1 oracle dba 14 Jul 29 11:38 VotingDisk3 ->/dev/raw/raw31
Conclusion
Design of the CSS voting disk mirroring allows for large number of voting disk mirrors.
In practice, to get the benefit of this feature without an impact on performance, three to
five voting disk mirrors should be implemented.
Keep in mind that the number of voting disks available in a RAC cluster should be an
odd number.
References
Related
Products
Oracle Database Products > Oracle Database > Oracle Database > Oracle Server -
Enterprise Edition
Keywords
CLUSTERWARE; RAW
Back to top