ES-331 Sun Enterprise Cluster Administration Veritas Volume Manager

Sun Educational Services
Sun Enterprise Cluster

Administration – Veritas Volume
Manager
ES-331
Sun Enterprise Cluster Administration – Veritas Volume Manager October 1999

Copyright © 1999 Sun Microsystems, Inc., 901 San Antonio Road, Palo Alto, California 94303, U.S.A. All rights reserved.
This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this
product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any.
Third-party software, including font technology, is copyrighted and licensed from Sun suppliers.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S. and other
countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun Logo, Sun Enterprise, Sun StorEdge Volume Manager, Solstice DiskSuite, Solaris Operating Environment, Sun StorEdge A5000,
Solstice SyMon, NFS, JumpStart, Sun VTS, OpenBoot, and AnswerBook are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other
countries.
All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products
bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc.
The OPEN LOOK and Sun Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sun acknowledges the pioneering efforts
of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry. Sun holds a non-exclusive license from Xerox
to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN LOOK GUIs and otherwise comply with Sun’s written
license agreements.
U.S. Government approval required when exporting the product.
RESTRICTED RIGHTS: Use, duplication, or disclosure by the U.S. Govt is subject to restrictions of FAR 52.227-14(g) (2)(6/87) and FAR 52.227-19(6/87), or DFAR
252.227-7015 (b)(6/95) and DFAR 227.7202-3(a).
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS, AND WARRANTIES, INCLUDING ANY
IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE
EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Sun Enterprise Cluster Administration – Veritas Volume Manager

Copyright 1999 Sun Microsystems, Inc. All Rights Reserved. Enterprise Services October 1999 Revision A
Course Contents
About This Course .......................................................................................................Preface-1

Course Goal .................................................................................................................................. Preface-2
Course Overview ......................................................................................................................... Preface-3
Course Map ................................................................................................................................... Preface-4
Module-by-Module Overview ................................................................................................... Preface-5
Course Objectives ......................................................................................................................... Preface-7
Skills Gained by Module ........................................................................................................... Preface-10
Guidelines for Module Pacing ................................................................................................. Preface-11
Topics Not Covered ................................................................................................................... Preface-13
How Prepared Are You? ........................................................................................................... Preface-14
Introductions .............................................................................................................................. Preface-15
How to Use Course Materials .................................................................................................. Preface-16
How to Use the Icons ................................................................................................................. Preface-17
Typographical Conventions and Symbols ............................................................................. Preface-19
Sun Cluster Overview ............................................................................................................1-1

Overview .................................................................................................................................................. 1-2
Sun Cluster 2.2 New Features ............................................................................................................... 1-3
Cluster Hardware Components ............................................................................................................ 1-4
High Availability Features .................................................................................................................... 1-5
High Availability Strategies .................................................................................................................. 1-6
Cluster Configurations ........................................................................................................................... 1-7
Sun Cluster Application Support ......................................................................................................... 1-8
Logical Hosts ........................................................................................................................................... 1-9
Fault Monitoring ................................................................................................................................... 1-10
Failure Recovery Summary ................................................................................................................. 1-11
Sun Enterprise Cluster Administration – Veritas Volume Manager iii

Copyright 1999 Sun Microsystems, Inc. All Rights Reserved. Enterprise Services October 1999, Revision A
Check Your Progress ............................................................................................................................ 1-13

Think Beyond ........................................................................................................................................ 1-15
Terminal Concentrator ..........................................................................................................2-1

Module Overview ................................................................................................................................... 2-2
Cluster Administration Interface .......................................................................................................... 2-3
Terminal Concentrator Overview ........................................................................................................ 2-5
Terminal Concentrator Setup ................................................................................................................ 2-7
Terminal Concentrator Troubleshooting ........................................................................................... 2-10
Exercise ................................................................................................................................................... 2-11
Think Beyond ........................................................................................................................................ 2-14
Administrative Workstation ................................................................................................3-1

Overview .................................................................................................................................................. 3-2
Cluster Software Summary ................................................................................................................... 3-3
Sun Enterprise Cluster Software Summary ........................................................................................ 3-4
Software Installation Program .............................................................................................................. 3-5
Sun Cluster Installation Program Startup ........................................................................................... 3-6
Administration Workstation Environment ......................................................................................... 3-9
Cluster Administration Tools Configuration .................................................................................... 3-11
Cluster Control Panel ........................................................................................................................... 3-13
Cluster Administration Tools .............................................................................................................. 3-15
Exercise ................................................................................................................................................... 3-17
Think Beyond ........................................................................................................................................ 3-19
Preinstallation Configuration ..............................................................................................4-1

Module Overview ................................................................................................................................... 4-2
Cluster Topologies .................................................................................................................................. 4-3
Sun Enterprise Cluster Administration – Veritas Volume Manager iv

Cluster Quorum Devices ........................................................................................................................ 4-9

Cluster Interconnect System Overview ............................................................................................. 4-14
Cluster Interconnect System Configuration ...................................................................................... 4-16
Public Network Management ............................................................................................................. 4-23
Shared CCD Volume ............................................................................................................................ 4-26
Cluster Configuration Information .................................................................................................... 4-28
Storage Array Firmware Upgrades .................................................................................................... 4-33
Exercise ................................................................................................................................................... 4-34
Think Beyond ........................................................................................................................................ 4-36
Cluster Host Software Installation .....................................................................................5-1

Module Overview ................................................................................................................................... 5-2
Sun Cluster Server Software Overview ............................................................................................... 5-3
Sun Cluster Installation Overview ....................................................................................................... 5-5
Sun Cluster Volume Managers ............................................................................................................. 5-6
Sun Cluster Host System Configuration ............................................................................................. 5-8
Sun Cluster Private Network Configuration ...................................................................................... 5-9
Sun Cluster Public Network Configuration ...................................................................................... 5-11
Sun Cluster Logical Host Configuration ........................................................................................... 5-13
Data Protection Configuration ............................................................................................................ 5-15
Application Configuration .................................................................................................................. 5-20
Post-Installation Configuration ........................................................................................................... 5-22
Exercise ................................................................................................................................................... 5-26
Think Beyond ........................................................................................................................................ 5-28
System Operation ...................................................................................................................6-1

Module Overview ................................................................................................................................... 6-2
Cluster Administration Tools ................................................................................................................ 6-3
Sun Enterprise Cluster Administration – Veritas Volume Manager v

Basic Cluster Control (scadmin) ........................................................................................................... 6-5

Cluster Control Panel ............................................................................................................................. 6-6
The hastat Command ........................................................................................................................... 6-8
Sun Cluster Manager Overview ......................................................................................................... 6-15
Sun Cluster Manager Displays ........................................................................................................... 6-17
Sun Cluster SNMP Agent .................................................................................................................... 6-23
Exercise ................................................................................................................................................... 6-25
Think Beyond ........................................................................................................................................ 6-27
Volume Management Using

CVM and SSVM ......................................................................................................................7-1
Module Overview ................................................................................................................................... 7-2
CVM and SSVM Disk Space Management .......................................................................................... 7-3
CVM and SSVM Initialization ............................................................................................................... 7-5
CVM and SSVM Encapsulation ............................................................................................................ 7-6
CVM and SSVM Disk Grouping ........................................................................................................... 7-8
Volume Manager Status ....................................................................................................................... 7-11
Optimizing Recovery Times ................................................................................................................ 7-13
CVM and SSVM Post-Installation ...................................................................................................... 7-14
Think Beyond ........................................................................................................................................ 7-17
Cluster Configuration Database ..........................................................................................8-1

Module Overview ................................................................................................................................... 8-2
Cluster Configuration Information ...................................................................................................... 8-3
Cluster Database Consistency ............................................................................................................... 8-4
Shared CCD Volume .............................................................................................................................. 8-6
CCD Administration .............................................................................................................................. 8-9
Exercise ................................................................................................................................................... 8-10
Sun Enterprise Cluster Administration – Veritas Volume Manager vi


Think Beyond ........................................................................................................................................ 8-12
Public Network Management ...............................................................................................9-1

Module Overview ................................................................................................................................... 9-2
PNM Overview ....................................................................................................................................... 9-3
The Network Monitoring Process ........................................................................................................ 9-5
How PNM Works ................................................................................................................................... 9-6
PNM Monitoring Routines .................................................................................................................... 9-7
The pnmset Command ........................................................................................................................... 9-8
Other PNM Commands ....................................................................................................................... 9-10
Exercise ................................................................................................................................................... 9-11
Think Beyond ........................................................................................................................................ 9-13
Logical Hosts ........................................................................................................................10-1

Module Overview ................................................................................................................................. 10-2
Logical Hosts ......................................................................................................................................... 10-3
Configuring a Logical Host ................................................................................................................. 10-5
Logical Host Variations ........................................................................................................................ 10-6
Administrative File System Overview ............................................................................................... 10-7
Creating the Administrative File System .......................................................................................... 10-8
Logical Host File Systems .................................................................................................................... 10-9
Logical Host Control .......................................................................................................................... 10-10
Exercise ................................................................................................................................................. 10-11
Check Your Progress .......................................................................................................................... 10-12
Think Beyond ...................................................................................................................................... 10-13
The HA-NFS Data Service ...................................................................................................11-1

Module Overview ................................................................................................................................. 11-2
Sun Enterprise Cluster Administration – Veritas Volume Manager vii

Objectives ............................................................................................................................................... 11-3

HA-NFS Overview ................................................................................................................................ 11-4
HA-NFS Data Service ........................................................................................................................... 11-5
Start NFS Methods ................................................................................................................................ 11-6
Stop NFS Methods ................................................................................................................................ 11-7
HA-NFS Fault Monitoring ................................................................................................................... 11-8
Fault Probes ........................................................................................................................................... 11-9
Local Fault Probes ............................................................................................................................... 11-10
Remote Fault Probes ........................................................................................................................... 11-11
Giveaway and Takeaway Process .................................................................................................... 11-12
Processes Related to NFS Fault Monitoring .................................................................................... 11-14
HA-NFS Support Files ........................................................................................................................ 11-15
Using the hareg Command ............................................................................................................... 11-16
File Locking Recovery ........................................................................................................................ 11-17
Exercise ................................................................................................................................................. 11-18
Think Beyond ...................................................................................................................................... 11-20
System Recovery ...................................................................................................................12-1

Module Overview ................................................................................................................................. 12-2
Sun Cluster Reconfiguration Control ................................................................................................. 12-3
Sun Cluster Failfast Driver .................................................................................................................. 12-5
Sun Cluster Reconfiguration Sequence .............................................................................................. 12-7
Cluster Interconnect Failures ............................................................................................................ 12-11
Two-Node Partitioned Cluster Failure ............................................................................................ 12-12
Logical Host Reconfiguration ........................................................................................................... 12-13
Exercise ................................................................................................................................................. 12-15
Think Beyond ...................................................................................................................................... 12-17
Sun Enterprise Cluster Administration – Veritas Volume Manager viii

Sun Cluster
High Availability Data Service API .................................................................................13-1
Module Overview ................................................................................................................................. 13-2
Overview ................................................................................................................................................ 13-3
Data Service Requirements .................................................................................................................. 13-4
Reconfiguration Overview .................................................................................................................. 13-5
Data Service Methods ........................................................................................................................... 13-6
Giveaway and Takeaway ..................................................................................................................... 13-7
START and STOP Method Examples ................................................................................................. 13-8
Data Service Dependencies ............................................................................................................... 13-10
The haget Command ......................................................................................................................... 13-11
The hactl Command ......................................................................................................................... 13-12
The halockrun Command ................................................................................................................ 13-13
The hatimerun Command ................................................................................................................ 13-14
Exercise ................................................................................................................................................. 13-15
Think Beyond ...................................................................................................................................... 13-17
Highly Available DBMS ......................................................................................................14-1

Module Overview ................................................................................................................................. 14-2
Sun Cluster HA-DBMS Overview ...................................................................................................... 14-3
Typical HA-DBMS Configuration ...................................................................................................... 14-4
Configuring and Starting HA-DBMS ................................................................................................. 14-5
Stopping and Unconfiguring
HA-DBMS ........................................................................................................................................... 14-6
The HA-DBMS Start Methods ............................................................................................................. 14-7
The HA-DBMS Stop and Abort Methods .......................................................................................... 14-8
HA-DBMS Fault Monitoring ............................................................................................................... 14-9
Configuring HA-DBMS for High Availability ............................................................................... 14-10
Configuration Overview .................................................................................................................... 14-11
Sun Enterprise Cluster Administration – Veritas Volume Manager ix

Oracle Installation Preparation ......................................................................................................... 14-12

Sybase Installation Preparation ........................................................................................................ 14-13
Informix Installation Preparation ..................................................................................................... 14-14
Preparing the Logical Host ................................................................................................................ 14-15
HA-DBMS Control .............................................................................................................................. 14-16
HA-DBMS Client Overview .............................................................................................................. 14-17
HA-DBMS Recovery ........................................................................................................................... 14-18
HA-DBMS Configuration Files ......................................................................................................... 14-19
Exercise ................................................................................................................................................. 14-20
Think Beyond ...................................................................................................................................... 14-22
Sun Enterprise Cluster Administration – Veritas Volume Manager x

Preface
About This Course

Course Goal
This course provides you with knowledge and skills to install
and administer a Sun Enterprise™ Cluster system running
Sun Cluster 2.2 software.
Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 2 of 18

Course Overview
• Sun Enterprise Cluster hardware configuration
• Sun Cluster software installation
• Sun Cluster software configuration
• Sun Enterprise Cluster operation
• System failure recovery

Course Map
Introduction
Sun Cluster
Overview
Installation
Terminal Administration Preinstallation Cluster Host

Concentrator Workstation Configuration Software
Installation Installation
Operation
System Volume Cluster

Operation Management Configuration
CVM and SSVM Database
Logical Host Configuration
Public Network Logical Hosts The HA-NFS

Management Data Service
Recovery
System
Recovery
High Availability
Sun Cluster Highly

HA-API Available
DBMS

Copyright 1999 Sun Microsystems, Inc. All Rights Reserved. Enterprise Services, October 1999, Revision A
Module-by-Module Overview
• Module 1 – "Sun Cluster Overview"
• Module 2 – "Terminal Concentrator"
• Module 3 – "Administration Workstation Installation"
• Module 4 – "Preinstallation Configuration"
• Module 5 – "Cluster Host Software Installation"
• Module 6 – "System Operation"
• Module 7 – "Volume Management Using CVM and
SSVM"

Module-by-Module Overview
• Module 8 - "Cluster Configuration Database"
• Module 9 - "Public Network Management"
• Module 10 - "Logical Hosts"
• Module 11 - "The HA-NFS Data Service"
• Module 12 - "System Recovery"
• Module 13 - "Sun Cluster High Availability Data Service
API"
• Module 14 - "Highly Available DBMS"

Course Objectives
• Describe major Sun Cluster components and functions
• Verify system cabling
• Configure the Terminal Concentrator for proper

operation
• Install, remove, and update Sun Cluster software
• Troubleshoot software installation and configuration

errors

Course Objectives
• Configure environmental variables for correct Sun
Cluster operation
• Use the Sun Cluster administration tools
• Initialize one of the supported volume managers
• Describe the differences between the supported volume

managers
• Prepare the Public Network Management failover

environment

Course Objectives
• Create and configure logical hosts
• Install and configure highly available data services
• Describe the Sun Cluster failure recovery mechanisms
• Identify and recover from selected Sun Cluster failures

Skills Gained by Module

Meaning of:
• Black boxes
• Gray boxes
Module
Skills Gained 1 2 3 4
Skill or Objective 1

Guidelines for Module Pacing

Module Day 1 Day 2 Day 3 Day 4 Day 5
About This Course A.M.
Product Introduction A.M.
Terminal Concentrator A.M./P.M.
Administration Workstation Installation P.M.
Pre-Installation Configuration A.M.
Cluster Host Software Installation A.M./P.M.
System Operation P.M.
Volume Management, CVM/SSVM A.M.
Cluster Configuration Database P.M.
Public Network Management P.M.
Logical Hosts A.M.
HA-NFS Data Service A.MP.M.
System Recovery PM
Sun Enterprise Cluster HA-API A.M.
HA-DBMS A.M./P.M.

Topics Not Covered

• Database management
• Network administration
• Solaris™ Operating Environment administration
• Performance and tuning
• Disk storage management

How Prepared Are You?

• Can you explain virtual volume management
terminology, such as mirroring, striping, concatenation,
volumes, and mirror synchronization?
• Can you perform basic Solaris system administration
tasks, such as using tar and ufsdump commands,
creating user accounts, formatting disk drives, using vi,
installing the operating system, installing patches, and
adding packages?
• Do you have prior experience with Sun hardware and
the OpenBoot™ PROM technology?
• Are you familiar with general computer hardware,
electro-static precautions, and safe handling practices?

Introductions
• Name
• Company affiliation
• Title, function, and job responsibility
• Clustered systems experience
• Reasons for enrolling in this course
• Expectations for this course

How to Use Course Materials

• Course Map
• Relevance
• Overhead image
• Lecture
• Exercise
• Check Your Progress
• Think Beyond

How to Use the Icons
Additional resources
Discussion
Exercise objective

Caution
!
Warning

Typographical Conventions and

Symbols
• Courier is used for the names of command, files, and
directories, as well as on-screen computer output.
• Courier bold is used for characters and numbers that

you type.
• Courier italic is used for variables and command-

line placeholders that are replaced with a real name or
value.
• Palatino italics is used for book titles, new words or

terms, or words that are emphasized.

Module 1
Sun Cluster Overview

Overview
• Objectives
• Relevance
Sun Enterprise Cluster Administration – Veritas Volume Manager Module 1, slide 2 of 15

Sun Cluster 2.2 New Features

The Sun Cluster 2.2 software release has the following new
features:
• Sun Cluster 2.2 is now fully internationalized and Y2K
compliant
• Support for Solstice DiskSuite has been added
• Solaris 7 Operating Environment is now supported
• The installation procedures have been changed
• Licensing is much simpler
• There is a new cluster management tool Sun Cluster
Manager

Cluster Hardware Components

Administration Workstation
Public network
Terminal Concentrator
Cluster host Cluster host

A A
Private network
Mass storage Mass storage

High Availability Features

Several software and hardware features contribute to the
cluster availability. They include:
• High availability hardware design
• Sun Cluster software
• Software RAID technology
• Hardware RAID technology
• Year 2000 compliance

High Availability Strategies

User
Public network
Node 0 Node 1
hme0 hme1 hme0 hme1
Application Application
Private networks
Volume Volume
manager manager
Primary Mirror
data data

Cluster Configurations
Highly Available Data Service Parallel Database
Node 0 Node 1 Node 0 Node 1

Database Database
Application A Application B instance 1 instance 0
Volume Volume
Volume Volume
manager manager
manager manager
Application A Application B
data data Database data

Mass storage

Sun Cluster Application Support

The Sun Cluster software framework provides support for the
following application categories:
• Highly available databases
• Highly available data services
• Parallel databases

Logical Hosts
Node 0 Node 1
ifconfig
Network Access
start
Application
Primary: Node 0
Backup: Node 1 Lhost_1
import
Disk group information
ccd.database ccd.database
Disk
group

Fault Monitoring
Public network Node 0 Node 1
PNM PNM
Node 0 Node 1
CMM CMM
Data Service check
SMA SMA
check Heartbeats
Local Remote Network Private networks Network

fault driver driver
fault
monitor monitor
Failfast Failfast
Data Service Fault Monitoring
Cluster Fault Monitoring

Failure Recovery Summary

• Individual disk drive failure
• Fibre Channel or array controller failure
• Cluster interconnect failure
• Node failure
• Critical process or daemon failure
• Cluster configuration database file inconsistency

Failure Recovery Summary

Node 0 Node 1
RDBMS failfast failfast RDBMS

driver (ff) driver (ff)
Disk Disk
management Consistency management
CDB CDB
Consistency
CCD CCD
Heartbeat
Fiber-optic CMM CMM Fiber-optic
channels channels
Heartbeat
SMA SMA
Network Network
Private networks
driver driver
Storage array Storage array

Check Your Progress

• List the hardware elements that comprise a basic Sun
Enterprise Cluster system
• List the hardware and software components that
contribute to the availability of a Sun Enterprise Cluster
system
• List the types of redundancy that contribute to the
availability of a Sun Enterprise Cluster system.
• Identify the configuration differences between a high
availability cluster and a parallel database cluster

Check Your Progress

• Explain the purpose of logical host definitions in the
Sun Enterprise Cluster environment
• Describe the purpose of the cluster configuration
databases
• Explain the purpose of each of the Sun Enterprise
Cluster fault monitoring mechanisms.

Think Beyond
What are some of the most common problems encountered
during cluster installation?
How does a cluster installation proceed? What do you need to
do first?
Do you need to be a database expert to administer a Sun
Enterprise Cluster system?

Module 2

Module Overview
• Objectives
• Relevance

Cluster Administration Interface

• Administration workstation
• Cluster administration tools
• Terminal Concentrator
• Cluster host serial port connections

Cluster Administration Interface

Administration workstation
Administration
Tools
Network
Network
Setup interface
Serial ports
port
1 2 3 4 5 6 7 8
Serial port A
Node 0 Node 1
Setup device

Terminal Concentrator Overview

• Resident PROM-based operating system
• Special setup port
• Setup programs

Terminal Concentrator Overview

Memory
Self-load at power-on
PROM
Network Operating system
interface
OPER_52_ENET.SYS
Serial ports
Setup
port 1 2 3 4 5 6 7 8
Serial port A
Node 0 Node 1
Setup device

Terminal Concentrator Setup

• Connecting to Port 1
• Enabling setup mode
• Setting IP address
• Setting load sequence
• Specifying operating system image
• Setting serial port variables

1 2 3 4 5 6 7 8
STATUS
POWER UNIT NET ATTN LOAD ACTIVE 1 2 3 4 5 6 7 8
Power indicator Test button


admin-ws# telnet terminal_concentrator_name
Trying terminal concentrator IP address
Connected to sec-tc.
Escape character is '^]'.
Rotaries Defined:
cli -
Enter Annex port name or number: cli
Annex Command Line Interpreter * Copyright 1991 Xylogics, Inc.
annex: su
Password: type the password
annex# admin
Annex administration MICRO-XL-UX R7.0.1, 8 ports
admin: show port=1 type mode imask_7bits
Port 1:
type: hardwired mode: cli imask_7bits: Y
admin:set port=1 type hardwired mode cli imask_7bits Y
admin:set port=2-8 type dial_in mode slave imask_7bits Y
admin: quit
annex# boot
bootfile: <CR>
warning: <CR>

Troubleshooting
• Use the telnet command to manually connect to a
node
• Use the telnet command to abort a node
• Use the terminal concentrator help command
• Use the who and reset commands to free a port
• Use the erase command to reset the password

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Describe the Sun Enterprise Cluster administrative
interface
• Explain the TC hardware configuration
• Verify the correct TC cabling
• Configure the TC IP address
• Configure the TC to self-load
• Verify the TC port settings

Check Your Progress

• Verify that the TC is functional
• Use the terminal concentrator help, who, and hangup

commands
• Describe the purpose of the telnet send brk

command

Think Beyond
Is there a significant danger if the TC port variables are not set
correctly?
Is the Terminal Concentrator a single point of failure? What
would happen if it failed?

Module 3
Administrative Workstation

Overview
• Objectives
• Relevance

Cluster Software Summary
Sun_Cluster_2_2 Sun StorEdge

Volume Manager
Sol_7 Sol_2.6
Cluster
Volume Manager
Product Tools Tools Product

Software Software
scinstall Solstice DiskSuite

(installation script) Volume Manager

Sun Enterprise Cluster
Software Summary
Administration
workstation
Solaris 2.6/7
Sun Cluster
client software
Network
Private disk Private disk
Solaris 2.6/7 Solaris 2.6/7

Sun Cluster Sun Cluster
server software server software
Volume Volume
management management
Node 0 Node 1
system system
hardware hardware
Disk storage array Disk storage array

Software Installation Program

• The scinstall command installs the Sun Cluster
software
• Script runs interactively and prompts user

Sun Cluster Installation Program

Startup
• Event sequence during Sun Cluster package
administration tool startup phase:
• SUNWscins package automatically started
• Sun Cluster software status assessed
• Package administration category selected
• Sun Cluster package source identified
• Package installation mode selected


Startup
Choose one:
1) UpgradeUpgrade to Sun Cluster 2.2 Server packages
2) ServerInstall the Sun Cluster packages needed on a server
3) ClientInstall the admin tools needed on an admin workstation
4) Server and ClientInstall both Client and Server packages
5) CloseExit this Menu

6) QuitQuit the Program
Enter the number of the package set [6]: 3


Startup
Installing Client packages
Installing the following packages: SUNWscch SUNWccon SUNWccp SUNWcsnmp SUNWscsdb
>>>> Warning <<<<

The installation process will run several scripts as root. In addition, it may install
setUID programs. If you choose automatic mode, the installation of the chosen packages
will proceed without any user interaction.If you wish to manually control the install
process you must choose the manual installation option.
Choices:
manual Interactively install each package
automatic Install the selected packages with no user interaction.
In addition, the following commands are supported:

list Show a list of the packages to be installed
help Show this command summary
close Return to previous menu
quit Quit the program
Install mode [manual automatic] [automatic]: automatic

Administration Workstation
Environment
• Environmental changes after client software
installation:
• New search and man page paths
• Host name resolution changes
• Remote login control
• Remote display enabling
• rsh and rcp access control

Administration
Workstation Environment
User JD wants to rlogin, rcp, or rsh to host X host A
host X
No Is user JD in Yes
/etc/passwd?
Yes Is user JD
a superuser?
No
Is host A in Yes
/etc/hosts.equiv?
No
Access allowed
Is host A in
$HOME/.rhosts? Yes
No Yes
rlogin Password Password
Command? prompt correct?
rcp rsh No
Login prompt
Access denied

Cluster Administration Tools

Configuration
• Configuration information required for cluster
administration tools:
• Cluster name
• Each physical node name and IP address
• Terminal concentrator name and IP address
• TC port number used for cluster attachment

Cluster Administration
Tools Configuration
Administration
tools
Network
Terminal concentrator
Network Serial ports
interface 1 2 3 4 5 6 7 8
Serial port A

Cluster Control Panel

• Cluster Control Panel
• Cluster Console
• Cluster Help Tool
• Cluster Manager


Node 0 window Node 1 window
Node 2 window Common window Node 3 window

Tools

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Summarize the Sun Cluster administrative workstation
functions
• Use the scinstall script features

• Install the client software on the administration
workstation
• Set up the administration workstation environment
• Configure the Sun Cluster administration tools

Think Beyond
What is the advantage of the /etc/clusters and
/etc/serialports files?
Why is the Cluster SNMP agent installed on the
administrative workstation?
What is the impact on the cluster if the administrative
workstation is not available? What would you do for backup?

Module 4
Preinstallation Configuration

Module Overview
• Objectives
• Relevance

Cluster Topologies
• Scalable
• Ring
• N+1
• Clustered pairs
• Shared-nothing

Cluster Topologies
CIS switch
or hub
A B A B A B A B
Array Array Array Array

Cluster Topologies
Node 0
Node 3 CIS switch

Node 1
or hub
Node 2

Cluster Topologies
CIS switch
or hub
A B A B A B
Array Array Array

Cluster Topologies
CIS switch
or hub
A B A B A B A B
Array Array Array Array

Cluster Topologies
CIS switch
or hub
a0 a1 b0 b1
A5000 storage
array

Cluster Quorum Devices

• Basic Quorum Device Usage
• Number of Quorum Devices Required


Node 0 Node 1
Cluster
Database interconnect Database
Database
Quorum Quorum
= c3t0d0 =Quorum
c2t0d0
= c2t0d0
Reserve Reserve
A B
Q
Disk storage array


Node 0 Node 1
Cluster
Database interconnect Database
Database
Quorum Quorum
= WWN =Quorum
WWN
= c2t0d0
Reserve Reserve
Controller
A Q B
Disk storage array

Node 0 Node 1 Node 2
A B A B A B
Resource Resource Resource
1 2 3


Lock Ethernet
Abort
TC
2 3 4 5 6 Node 3
interconnect
failure
H
U
B
Direct attached storage

Cluster Interconnect System Overview

• Interconnect Types
• Interconnect Configurations

Cluster Interconnect System Overview
Node 0 Node 1
System board hme0 hme0 System board

Cluster Interconnect System

Configuration
• Primary and backup interface identification
• Primary and backup interface connection
• Point-to-point connections
• SCI high-speed connections
• SCI card identification
• SCI card scrubber jumpers


Configuration
First Node Third Node
hme 0, scid 0 hme 0, scid 0
204.152.65.1 204.152.65.3
204.152.65.33 204.152.65.35

204.152.65.17 204.152.65.19
Second Node Fourth Node

204.152.65.2 204.152.65.4
204.152.65.34 204.152.65.36

204.152.65.18 204.152.65.20


Configuration
Node 0 Node 1
primary
hme0 hme0
System board or or System board
scid0 scid0
backup
hme1 hme1
System board or or System board
scid1 scid1


Configuration
Node 0 Node 1
Switch 0
System board scid0 scid0 System board
0 1
System board scid1 23 scid1 System board
Node 2 Switch 1 Node 3
System board scid0 0 1 scid0 System board
23
System board scid1 scid1 System board


Configuration
Scrubber jumper
On
Off


Configuration
Scrubber on
Node 0 Scrubber off
Node 1
Scrubber on
Scrubber off


Configuration
Node 0 Node 1
Hub 0
Node 2 Node 3
Hub 1

Public Network Management

• Adapter failover
• IP address failover
• Continuous fault monitoring
• Backup group configuration


Network
Node 0
hme0 hme1 hme0 hme1

Primary Backup Primary Backup
nafo12 group nafo7 group
Node 1 Monitor
primary
pnmd ifconfig
backup
ccd
/etc/pnmconfig
NAFO group
IP address NAFO group
configuration


# /opt/SUNWpnm/bin/pnmset
In the following you will be prompted to do configuration for network adapter failover
do you want to continue...[y/n]: y
How many PNM backup groups on the host: 2
Enter backup group number: 0

Please enter all network adapters under nafo0
qe1 qe0
Enter backup group number: 1

hme0

Shared CCD Volume

• Guarantee majority opinion about CCD consistency
• Volume creation

Shared CCD Volume
Node 0 Node 1
I/O interfaces I/O interfaces
ccd primary ccd mirror

Cluster Configuration Information

General cluster configuration information can be gathered
using several commands including:
• The prtdiag command
• The finddevices command
• The luxadm command


# /usr/platform/sun4u/sbin/prtdiag
System Configuration: Sun Microsystems sun4u 8-slot Sun Enterprise 4000/5000
System clock frequency: 84 MHz
Memory size: 512Mb
========================= CPUs =========================
Run Ecache CPU CPU

Brd CPU Module MHz MB Impl. Mask
--- --- ------- ----- ------ ------ ----
0 0 0 168 0.5 US-I 2.2
0 1 1 168 0.5 US-I 2.2
2 4 0 168 0.5 US-I 2.2
2 5 1 168 0.5 US-I 2.2
========================= Memory =========================
Intrlv. Intrlv.
Brd Bank MB Status Condition Speed Factor With
--- ----- ---- ------- ---------- ----- ------- -------
0 0 256 Active OK 60ns 2-way A
2 0 256 Active OK 60ns 2-way A


========================= IO Cards =========================
Bus Freq
Brd Type MHz Slot Name Model
--- ---- ---- ---- --------------------- --------------
1 SBus 25 0 DOLPHIN,sci
1 SBus 25 1 qec/be (network) SUNW,270-2450
1 SBus 25 2 QLGC,isp/sd (block) QLGC,ISP1000U
1 SBus 25 3 SUNW,hme
1 SBus 25 3 SUNW,fas/sd (block)
1 SBus 25 13 SUNW,soc/SUNW,pln 501-2069
Detached Boards
===============
Slot State Type Info
---- -------- ----- -----------------------------
7 disabled disk Disk 0: Target: 14 Disk 1: Target: 15

TPE Fast/Wide
10/100 SCSI
FCOM FCOM
SBus SBus SBus

card card card
SOC slot 2 slot 0 FEPS
slot 1
slot 13 (d) slot 3
SBus 0 SBus 1


# /opt/SUNWcluster/bin/finddevices
c2:00000078BF60
c3:00000078B12D
c4:00000078BF9E
# luxadm probe
Found
SENA Name:d Node WWN:5080020000011df0
Logical Path:/dev/es/ses0
SENA Name:a Node WWN:50800200000291d8

Storage Array Firmware Upgrades

When considering storage array firmware upgrades, you
must be aware of the following points:
• Firmware patches change both software and firmware
• You should not make large firmware revision changes
• Several other patches might be necessary
• The patch README notes might contain critical

information
• You should consider getting qualified assistance

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Configure any supported cluster topology
• List the appropriate applications for each topology
• Configure the cluster interconnect system
• Explain the need for simple quorum device
• Estimate the number of quorum devices needed for
each cluster topology
• Describe the purpose of the public network monitor
feature
• Describe the purpose of the mirrored ccd volume
• Explain the purpose of the TC node locking port
Think Beyond
What additional preparation might be necessary before
installing the Sun Cluster host software?

Module 5
Cluster Host Software Installation

Module Overview
• Objectives
• Relevance

Sun Cluster Server Software Overview
Sun_Cluster_2_2
Sol_7 Sol_2.6
Product Tools Tools Product

Software Software
scinstall
(Installation script)

Sun Cluster Server
Software Overview
Administration
workstation
Solaris 2.6/7
Sun Cluster
client software
Network
Private disk Private disk
Solaris 2.6/7 Solaris 2.6/7

Sun Cluster Sun Cluster
server software server software
Volume Volume
management management
Node 0 Node 1
system system
hardware hardware
Disk storage array Disk storage array

Sun Cluster Installation Overview

• Configuration during Sun Cluster server software
installation:
• Target volume manager
• Cluster host system names and configuration
• Private and public networks
• Logical hosts
• Data protection configuration
• Data services desired

Sun Cluster Volume Managers

• Cluster Volume Manager
• Sun StorEdge Volume Manager
• Solstice DiskSuite™

Sun Cluster Volume Managers

Volume Manager Selection
Please choose the Volume Manager that will be used

on this node:
1) Cluster Volume Manager (CVM)

2) Sun Storage Volume Manager (SSVM)
3) Solstice DiskSuite (SDS)
Choose the Volume Manager: 3
Installing Solstice DiskSuite support packages.

Installing “SUNWdid” ... done
Installing “SUNWmdm” ... done
---------WARNING---------
Solstice DiskSuite (SDS) will need to be installed before the cluster can be
started.
<<Press return to continue>>

Sun Cluster Host System

Configuration
• Cluster name
• Nodes:
• Each name
• Potential number
• Active number

Sun Cluster Private Network

Configuration
• Scalable Coherent Interface
• Ethernet (100BaseT)

Sun Cluster Private Network

Configuration
What is the hostname of node 0 [node0]? phys-hahost1
What is phys-hahost1's first private network interface [hme0]? hme0
What is phys-hahost1's second private network interface [hme1]? hme1
You will now be prompted for Ethernet addresses of

the host. There is only one Ethernet address for each host regardless of the
number of interfaces a host has. You can get this information in one of several
ways:
1. use the 'banner' command at the ok prompt,

2. use the 'ifconfig -a' command (need to be root),
3. use ping, arp and grep commands. ('ping exxon; arp -a | grep exxon')
Ethernet addresses are given as six hexadecimal bytes separated by colons.

ie, 01:23:45:67:89:ab
What is phys-hahost1's ethernet address? 01:23:45:67:89:ab
What is the hostname of node 1 [node1]?

Sun Cluster Public Network

Configuration
• Controller and name of each primary network
• Controller and name of each secondary network

Sun Cluster Public
Network Configuration
What is the primary public network controller for
“phys-hahost1”? hme2
What is the primary public network controller for
“phys-hahost2”? hme2
Does the cluster serve any secondary public subnets
(yes/no) [no]? y
Please enter a unique name for each of these additional

subnets:
Subnet name (^D to finish): sc-cluster-net1

Subnet name (^D to finish): sc-cluster-net2
Subnet name (^D to finish): ^D
The list of secondary public subnets is:

sc-cluster-net1
sc-cluster-net2
Is this list correct (yes/no) [yes]?
For subnet “sc-cluster-pub1” ...

What network controller is used for "phys-hahost1"? qe0
For subnet "sc-cluster-pub2" ...

Initialize NAFO on "phys-hahost1" with one ctlr per group

(yes/no) [yes]? y

Sun Cluster Logical Host

Configuration
• For each logical host:
• Name
• Master system
• Backup system
• Network access name
• Associated disk group

Sun Cluster Logical Host
Configuration
Will this cluster support any HA data services
(yes/no) [yes]? yes
Okay to set up the logical hosts for those HA services now
(yes/no) [yes]? yes
Enter the list of logical hosts you want to add:
Logical host (^D to finish): hahost1

Logical host (^D to finish): ^D
The list of logical hosts is: hahost1
Is this list correct (yes/no) [yes]? y
What is the name of the default master for “hahost1”? phys-

hahost1
Enter a list of other nodes capable of mastering “hahost1”:

Node name: phys-hahost2
Node name (^D to finish): ^D
The list that you entered is:

phys-hahost1
phys-hahost2
Is this list correct (yes/no) [yes]? y

Enable automatic failback for “hahost1” (yes/no) [no]? y
What is the net name for “hahost1” on subnet “sc-cluster-
net1”? hahost1-pub1
What is the net name for “hahost1” on subnet “sc-cluster-
net2”? hahost1-pub2
Disk group name for logical host “hahost1” [hahost1]?
Is it okay to add logical host “hahost1” now (yes/no)

Data Protection Configuration

• Failure fencing
• Node locking
• Quorum device
• Partitioned cluster control

telenet tc_concentrator 5006

Ethernet
TC
1 2 3 4 5 6
Direct attached storage


Getting device information for reachable nodes in the cluster.
This may take a few seconds to a few minutes...done
Select quorum device for the following nodes:
0 (phys-hahost1)
and
1 (phys-hahost2)
1) SSA:000000779A16
2) SSA:000000741430
3) DISK:c0t1d0s2:01799413
Quorum device: 1
...
SSA with WWN 000000779A16 has been chosen as the quorum device.
Finished Quorum Selection

A B A B A B
Resource Resource Resource
1 2 3


In case the cluster partitions into subsets, which subset should stay up?
ask) the system will always ask the operator.
select) automatic selection of which subset should stay up.
Please enter your choice (ask|select) [ask]: select

You have a choice of two policies:
lowest -- The subset containing the node with the lowest node ID value automatically
becomes the new cluster. All other subsets must be manually aborted.
highest -- The subset containing the node with the highest node ID value automatically
becomes the new cluster. All other subsets must be manually aborted.
Select the selection policy for handling partitions (lowest|highest) [lowest]: highest

Application Configuration
• Highly available data services
• Highly available databases
• Parallel databases

Application Configuration
==== Select Data Services Menu ====================
Please select which of the following data services are to be installed onto this cluster.
Select singly, or in a space separated list.
Note: HA-NFS and Informix Parallel Server (XPS) are installed automatically with the
Server Framework.
You may de-select a data service by selecting it a second time.
Select DONE when finished selecting the configuration.
1) Sun Cluster HA for Oracle

2) Sun Cluster HA for Informix
3) Sun Cluster HA for Sybase
4) Sun Cluster HA for Netscape
5) Sun Cluster HA for Netscape LDAP
6) Sun Cluster HA for Lotus
7) Sun Cluster HA for Tivoli
8) Sun Cluster HA for SAP
9) Sun Cluster HA for DNS
10) Sun Cluster for Oracle Parallel Server
INSTALL 11) No Data Services

12) DONE
Choose a data service: 3

Post-Installation Configuration
• Verify installation
• Configure new software directory paths
• Complete SCI interconnect installation
• Install Sun Cluster patches

# scconf sc-cluster -p
/etc/opt/SUNWcluster/conf/sc-cluster.cdb
Checking node status...
Current Configuration for Cluster sc-cluster:
Hosts in cluster: phys-node0 phys-node1 phys-node2
Private Network Interfaces for

phys-node0:be0 be1
phys-node1:be0 be1
phys-node2:be0 be1
Quorum Device Information
Logical Host Timeout Values :

Step10 : 720
Step11 : 720
Logical Host : 180
Cluster TC/SSP Information

phys-node0 TC/SSP, port : 129.150.218.35, 2
sc-cluster Locking TC/SSP, port : 129.150.218.35, 6

Cluster is configured as = SC
HOST 0 = sec-0
HOST 1 = sec-1
HOST 2 = _%sec-2
HOST 3 = _%sec-3
Number of Switches in cluster = 0

Number of Direct Links in cluster = 2
Number of Rings in cluster = 0
host 0 :: adp 0 is connected to = link 0 :: endpt 0


Network IP address for Link 0 = 204.152.65

Network IP address for Link 1 = 204.152.65
Netmask = f0

Cluster is configured as = SC
HOST 0 = sec-0
HOST 1 = sec-1
HOST 2 = sec-2
Number of Switches in cluster = 2

Number of Direct Links in cluster = 0
Number of Rings in cluster = 0
host 0 :: adp 0 is connected to = switch 0 :: port 0

Network IP address for Switch 0 = 204.152.65

Network IP address for Switch 1 = 204.152.65
Netmask = f0

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Install the Sun Cluster host system software
• Correctly interpret configuration questions during Sun

Cluster node software installation on the cluster host
systems
• Perform post-installation configuration

Think Beyond
As you add additional nodes to the cluster, what might you
need to do on the existing nodes? Can you do this while the
nodes are running?
What kinds of configuration changes need to be made
simultaneously on all nodes? How can you tell? What would
happen if you did not make them simultaneously?
What would happen if you did not specify any quorum
devices or use failure fencing?

Module 6
System Operation

Module Overview
• Objectives
• Relevance


• Basic Cluster Control (scadmin)
• Cluster Control Panel
• hastat Command
• Sun Cluster Manager

Tools
Custer Control
Panel
Network
Network
interface
Serial ports
Node 0
Sun Cluster Manager

# scadmin
# hastat

Basic Cluster Control (scadmin)

• Initially starts cluster
• Activates additional cluster nodes
• Removes nodes from clustered operation


• Three cluster console tool variations
• Cluster help tool


The hastat Command

The hastat command provides a complete cluster status
listing that includes:
• General cluster status
• Logical host configuration information
• Private network status
• Public network status
• Data service status
• Cluster error messages

The hastat Command
# hastat
Getting Information from all the nodes ......
HIGH AVAILABILITY CONFIGURATION AND STATUS

-------------------------------------------
LIST OF NODES CONFIGURED IN <sc-cluster> CLUSTER

sc-node0 sc-node1 sc-node2
CURRENT MEMBERS OF THE CLUSTER

sc-node0 is a cluster member
CONFIGURATION STATE OF THE CLUSTER

Configuration State on sc-node0: Stable
UPTIME OF NODES IN THE CLUSTER
uptime of sc-node0:
12:47am up 1:38, 1 user,
load average: 0.14, 0.12, 0.10
uptime of sc-node1:
12:47am up 1:37, 1 user,
load average: 0.16, 0.12, 0.10
uptime of sc-node2:
12:50am up 1:38, 1 user,
load average: 0.16, 0.12, 0.10

The hastat Command

LOGICAL HOSTS MASTERED BY THE CLUSTER MEMBERS
Logical Hosts Mastered on sc-node0:

sc-dbms
Loghost Hosts for which sc-node0 is Backup Node:

sc-nfs

sc-nfs

sc-inetpro

sc-inetpro

sc-dbms
LOGICAL HOSTS IN MAINTENANCE STATE
None

The hastat Command

STATUS OF PRIVATE NETS IN THE CLUSTER
Status of Interconnects on sc-node0:

interconnect0: selected
interconnect1: up
Status of private nets on sc-node0:
To sc-node0 - UP
To sc-node1 - UP
To sc-node2 - UP

interconnect1: up
To sc-node0 - UP
To sc-node1 - UP
To sc-node2 - UP

interconnect1: up
To sc-node0 - UP
To sc-node1 - UP
To sc-node2 - UP

The hastat Command

STATUS OF PUBLIC NETS IN THE CLUSTER
Status of Public Network On sc-node0:
bkggrp r_adp status fo_time live_adp

nafo113 hme1 OK NEVER hme1



The hastat Command

STATUS OF SERVICES RUNNING ON LOGICAL HOSTS IN THE CLUSTER
Status Of Data Services Running On sc-node0

Data Service HA-SYBASE:
No Status Method for Data Service dns
Data Service HA-NFS:

On Logical Host sc-dbms: Ok


On Logical Host sc-nfs: Ok


On Logical Host sc-inetpro: Ok

The hastat Command

RECENT ERROR MESSAGES FROM THE CLUSTER
Recent Error Messages on sc-node0
Feb 2 00:24:20 sc-node0 unix: sbusmem51 at sbus3: SBus3 slot 0x3 offset 0x0
Feb 2 00:24:20 sc-node0 unix: sbusmem51 is /sbus@7,0/sbusmem@3,0
Feb 2 00:36:31 sc-node0 ID[SUNWcluster.ha.hareg.2004]: Service dns is registered
Feb 2 00:24:22 sc-node1 unix: sbusmem45 at sbus2: SBus2 slot 0xd offset 0x0
Feb 2 00:24:22 sc-node1 unix: sbusmem45 is /sbus@6,0/sbusmem@d,0
Feb 2 00:24:22 sc-node1 unix: sbusmem48 at sbus3: SBus3 slot 0x0 offset 0x0
Feb 2 00:27:05 sc-node2 unix: sbusmem13 at sbus0: SBus0 slot 0xd offset 0x0
Feb 2 00:27:05 sc-node2 unix: sbusmem13 is /sbus@1f,0/sbusmem@d,0
Feb 2 00:27:05 sc-node2 unix: sbusmem14 at sbus0: SBus0 slot 0xe offset 0x0

Sun Cluster Manager Overview

• Overall cluster status
• Software and hardware failure
• System log file viewer
• Hardware component displays

SunClusterManager
Overview

Sun Cluster Manager Displays

The Sun Cluster Manager tool has several interactive
windows that provide:
• Detailed cluster configuration information
• A log of significant cluster events
• A system error log filter
• A comprehensive Help tool

Sun Cluster Manager
Displays




Sun Cluster Manager
Displays

Sun Cluster SNMP Agent

• Management Information Base (MIB)
• SNMP Traps

Sun Cluster SNMP Agent
Trap No. Trap Name

0 sc:stopped
1 sc:aborted
4 sc:excluded
11 vm:down
21 db:up
31 vm_on_node:slave
100 SOCKET_ERROR:node_out_of_system_resources
106 UNREACHABLE_ERROR:node’s_mond_unreachable:
network_problems??
110 SHUTDOWN_ERROR:node’s_mond_shutdown
200 Fatal:super_monitor_daemon(smond)_exited!!

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Use the cluster administration tools
• Use the Sun Cluster Manager GUI
• Use the hastat status command
• List the SNMP features

Think Beyond
What would it be like to administer a cluster with 16 nodes
and 200 storage arrays?
What would it be like to administer a cluster with each cluster
member located in a different city?
How does SNMP in general interact with the cluster
environment?

Module 7
Volume Management Using

CVM and SSVM

Module Overview
• Objectives
• Relevance

CVM and SSVM Disk Space

Management
• Space management at the block level
• Eliminates the UNIX® partition limit
• Equate disk regions with virtual volume structures

CVM and SSVM Disk Space

Management
Volume 01
Blocks 1000 – 3000
Blocks 3001 – 5500

Slice 4
Blocks 5501 – 10000

Volume 02
Blocks 10001 – 12000
Physical disk drive

Volume 03

CVM and SSVM Initialization
Private region
Configuration and
management information
Public region
Data Storage

CVM and SSVM Encapsulation

• Encapsulation preserves existing data
• The system boot disk can be encapsulated
• There is a preferred configuration
• Some free space is required
• Only standard partitions should be present
• Can be returned to a sliced configuration
• Boot disk mirrors are structured differently
• Mirrors cannot be returned to a sliced configuration

CVM and SSVM Encapsulation

SCSI rootdg
c0 disk group
SCSI
c1
SOC
c2
rootvol rootmirror
newdg
disk group
Storage Array

CVM and SSVM Disk Grouping

• CVM and SSVM create disk groups
• CVM disk groups are shared between systems
• The disk group is owned by the cluster
• All attached systems have simultaneous access
• Access must be arbitrated
• SSVM disk groups are owned by only one system
• Access from only one system at a time
• Ownership can be transferred between systems

Node 0 access A B Node 1 access
Disk group
The disk group

is owned by the
cluster.
Storage array
Volume Volume Volume

Node 0 access A B Node 1 access
Disk group
The disk group

is owned by
Node 0
Storage array
Volume Volume Volume

Volume Manager Status

• Command line status is quicker
• Information can be more detailed
• Can be used in script files and cron jobs
• Detailed volume status using vxprint
• vxprint can also create a configuration file
• Disk status using vxdisk list
• Can provide critical physical path information

Volume Manager Status

# vxprint
Disk group: sdg0
TY NAME ASSOC KSTATE LENGTH PLOFFS STATE

dg sdg0 sdg0 - - - -
dm disk0 c4t0d0s2 - 8368512 - -

dm disk7 c5t0d0s2 - 8368512 - -
v vol0 fsgen ENABLED 524288 - ACTIVE

pl vol0-01 vol0 DISABLED 525141 - IOFAIL
sd disk0-01 vol0-01 ENABLED 525141 0 -
pl vol0-02 vol0 ENABLED 525141 - ACTIVE
sd disk7-01 vol0-02 ENABLED 525141 0 -
pl vol0-03 vol0 DISABLED LOGONLY - IOFAIL
sd disk0-02 vol0-03 ENABLED 5 LOG -
# vxdisk list
DEVICE TYPE DISK GROUP STATUS

c0t0d0s2 sliced - - error
c0t1d0s2 sliced disk02 rootdg online
- - disk01 rootdg failed was:c0t0d0s2

Optimizing Recovery Times

Mirror synchronization time and file system recovery times
can be greatly reduced using the following techniques:
• Dirty region logging (DRL)
• Greatly reduces mirror synchronization time
• Veritas VxFS file system software
• Eliminates full file system checks by fsck

CVM and SSVM Post-Installation

• Initialize the rootdg disk group
• Three ways to satisfy this requirement
• Match the vxio major numbers between nodes
• The number must be the same on all nodes
• The number must not be duplicated on a single node
• Disable the DMP feature
• Enabled by default
• Should be completely removed

CVM and SSVM Post-Installation

Storage Array
Host system
Drive
Drive
Drive
SOC Controller
card C1
SOC Controller
Drive
Drive
Drive
card C2
DMP
driver
fiber-optic
interface

Check Your Progress

• For the CVM and SSVM volume managers:
• Explain the disk space management techniques
• Describe the initialization process
• Describe grouping disk drives together
• List the basic status commands
• Describe the basic software installation process
• List the major post-installation issues
• Install and configure either CVM or SSVM

Think Beyond
Where does Volume Manager recovery fit into the high
availability environment?
What planning issues are required for the Volume Manager in
the high availability environment?
Is the use of the Volume Manager required for high
availability functionality?

Module 8
Cluster Configuration Database

Module Overview
• Objectives
• Relevance


• CDB database:
• Simple variable=value format

• Static content
• General cluster information
• CCD database:
• Database format
• Dynamic content
• Logical host configuration and status

Cluster Database Consistency

• Data propagation
• Database consistency checking
• Database majority

Cluster Database Consistency
SCI switch
CCD CCD CCD
Freeze Freeze
ccdd ccdd ccdd
Propagate Propagate
(Master)
Update
request

Shared CCD Volume

• Two-node cluster only
• CCD on shared disk storage
• Enables CCD updates with only one node active
• Requires two dedicated shared disk drives

Shared CCD Volume
Node 0 Node 1
I/O interfaces I/O interfaces
CCD primary CCD mirror

Shared CCD Volume
# confccdssa clustername
The disk group sc_dg does not exist.
Will continue with the sc_dg setup.
Please, select the disks you want to use from the following
list:
1) SSA:00000078C8A0
2) SSA:000000722F83
Device 1: 1
1) t0d0
2) t0d1
3) t0d2
Disk: 3
Disk c0t0d2s2 with serial id 00142458

in SSA 00000078C8A0 has been selected as device 1.
Select devices from list.
1) SSA:00000078C8A0
2) SSA:000000722F83
Device 2: 2
1) t0d2
Disk:
1) t0d2
Disk: 1
Disk c2t0d2s2 with serial id 01186928

in SSA 000000722F83 has been selected as device 2.
newfs: construct a new file system /dev/vx/rdsk/sc_dg/ccdvol:

(y/n)? y

CCD Administration
The ccdadm command is used for CCD maintenance and is
used to:
• Verify global CCD consistency
• Checkpoint the CCD
• Restore a CCD from a backup copy
• Disable the CCD quorum feature
• Identify CCD errors

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Describe the Cluster Database and its operation
• Describe the Cluster Configuration Database and its

operation
• List the advantages of a shared CCD volume
• Manage the contents of the cluster configuration files

Think Beyond
When would you disable the CCD update quorum
requirement?
What would it take to have information defined for all nodes,
even if the nodes are offline?

Module 9

Module Overview
• Objectives
• Relevance

PNM Overview
• Adapter failover
• IP address failover
• Continuous fault monitoring
• Backup group configuration
• Interface support

PNM Overview
Network
Node 0
hme0 hme1 hme0 hme1

Primary Backup Primary Backup
nafo12 group nafo7 group
Node 1 Monitor
primary
pnmd ifconfig
backup
ccd
/etc/pnmconfig
NAFO group
IP address NAFO group
configuration

The Network Monitoring Process

• What is wrong?
• Local adapter
• Remote adapter
• Network
• Take or request appropriate recovery action

How PNM Works

• PNM daemon is based on RPC model
• Configuration information is stored in the CCD
• PNM daemon accesses remote status over both public
and private networks
• Adapters supported with different Ethernet or FDDI
MAC addresses on the same subnet

PNM Monitoring Routines

• TEST – Observes and solicits network activity
• DETERMINE_NET_FAILURE – Asks other cluster
nodes for status information
• FAILOVER – Creates a failover to the next adapter in
the group

The pnmset Command

• Configures network adapter backup groups
• Checks adapter status
• Picks primary adapter
• Activates only one adapter per group
• Saves the configuration
• Makes PNM daemon use new configuration
• Creates hostname.xxx file for only one adapter per
group

The pnmset Command

# pnmset
In the following, you will be prompted to do configuration for network adapter failover
do you want to continue ... [y/n]: y
How many NAFO backup groups on the host [1]: 1
Enter backup group number [0]: 113

hme0 hme1 hme2
The following test will evaluate the correctness

of the customer NAFO configuration...
name duplication test passed
Check nafo113... < 20 seconds
hme1 is active
remote address = 192.9.10.222
nafo113 test passed

Other PNM Commands

• pnmstat – Queries backup group status
• pnmptor – Queries which adapter is active
• pnmrtop – Determines which backup group contains the
adapter

Exercise
• Objectives
• Tasks
• Discussion
• Solutions

Check Your Progress

• Explain the need for Public Network Management
(PNM)
• Describe how PNM works

• Configure a NAFO group
• Disable the Solaris operating system Interface Groups
feature

Think Beyond
Are there other system components that would benefit from
the approach taken to network adapters by PNM?
What are the advantages and disadvantages of automatic
adapter failover? Manual adapter failover?
How will IP striping affect this model? Can you realize the
dual goals of higher throughput and high availability through
PNM/NAFO for the network connections?

Module 10
Logical Hosts

Module Overview
• Objectives
• Relevance
Logical Hosts
• Collection of network definitions and disk storage
• Highly available data services require a logical host
• Routines for logical host failover
Logical Host
Client workstation
# ping ds_host
# mount dshost:/Vol-02
Network
Node 0 Node 1
Data service
Logical hostname: recovery routines
dshost
129.50.20.3 Detect Node 0 failure
Import dg3 disk group
NAFO Group fsck and mount Vol-02
Ifconfig dshost IP address
Other recovery routines
Vol-02
volume
Disk group: dg3
lhost2
Primary: Node 0
Backup: Node 1 information
Logical host name: ccd.database

lhost2
ccd.database
Configuring a Logical Host

A logical host requires three main components:
• A NAFO backup group
• Created using the pnmset command
• A logical host definition in the CCD
• Created using the scconf -L command
• An administrative file system
• Created using the scconf -F command
Logical Host Variations

• Basic logical host
• Cascading failover
• Disabling automatic takeover
• Multiple disk groups and hostnames
Administrative File System Overview

• Required for each logical host
• Created by the scconf command
• Configured on special mirrored volume in logical host

disk group
• Requires no management or modification
• Stores cluster configuration and logical host data

service information
Creating the Administrative File

System
• Created with the scconf -F command option
• The command must be run on all cluster hosts
• Created on one of the logical host disk groups
• One for each logical host
• A special vfstab.logicalhost file is created
• Mount point for administrative file system
Logical Host File Systems

• Primary component of logical hosts
• User applications and data
• New file systems added manually
• Information placed in vfstab.lhost file
• Mount information used for logical host failover
Logical Host Control

• Forced logical host migration
• Use either haswitch or scadmin switch commands
• Initiate from current logical host master
• Logical host maintenance mode
• Use scadmin switch -m comand
• Typically for performing backups
Exercise
• Objectives
• Tasks
• Discussion
• Solutions
Check Your Progress

• Configure logical hosts
• Create the administrative file system for a logical host
• Switch logical hosts between physical nodes
Think Beyond
If the concept of a logical host did not exist, what would that
imply for failover?
What complexities does having multiple backup hosts for a
single logical host add to the high availability environment?
Module 11
The HA-NFS Data Service

Module Overview
• Objectives
• Relevance
Objectives
• Describe the function of HA-NFS support files
• List the primary functions of HA-NFS start and stop
methods
• List the primary functions of HA-NFS fault monitoring
probes
• Configure HA-NFS in a Sun Cluster environment
• Add and remove HA-NFS file systems
• Switch a HA-NFS logical host between systems
HA-NFS Overview
• Completely transparent to NFS™ clients
• No client impact
• Supports NFS V.2 and V.3
• Co-exists with all other Sun Cluster data services
• Supports PC clients with lock recovery protocol
• PrestoServe, local access, Secure NFS, and Kerberos

not supported
HA-NFS Data Service
User applications
NFS
Start methods
Stop methods
HA-NFS NFS-oriented
fault monitoring
HA Framework
Start NFS Methods

• Starts automatically during reconfiguration
• Starts or restarts NFS-related daemons
• Forces NFS daemons to go through a lock recovery
protocol
• Exports shared file systems
• Use only HA-NFS
Stop NFS Methods

• Runs during logical host reconfiguration
• Kills appropriate NFS-related daemons
• Unshares the file systems
HA-NFS Fault Monitoring

• Assesses health of HA-NFS data service
• Uses the public net to test the services
• Tests all HA-NFS shared file systems
Fault Probes
Public net
Service
(such as HTTP)
Remoteeprobe
Private net
Localprobe
Master node Backup node

for logical host for logical host
Local Fault Probes

• Ensure NFS daemons are running on physical host
• Perform read, write, and locking operations
• Log failure messages and initiate giveaways
Remote Fault Probes

• Ensures the health of current logical host master
• Mounts and tests all HA-NFS file systems
• Tests read, write, and locking operations on each file
system
• Can initiate logical host takeaway
Giveaway and Takeaway Process

• Local fault monitor initiates logical host giveaway
• Remote fault monitor initiates logical host takeaway
• Sanity check done before proceeding
Giveaway and Takeaway Process

Public network
phys-hostA phys-hostB
check
Data service
check Local
fault Remote
monitor fault
monitor
giveaway
takeaway
Processes Related to NFS Fault

Monitoring
• Logical host fault monitoring processes:
• nfs_probe_loghost
• nfs_mon
• nfs_probe_local_start
HA-NFS Support Files

To administer a HA-NFS logical host you must:
• Configure file system mount information
• Edit logical host-specific vfstab files
• Configure NFS share information

• Edit logical host-specific dfstab files
Using the hareg Command

Use the hareg command to:
• Register a standard data service
• Register a custom data service
• Unregister a data service
• Start and stop data services
File Locking Recovery

• HA framework exploits existing NFS locking recovery
• Server initiates recovery process
• Client supplies lock recovery information
Exercise
• Objectives
• Tasks
• Discussion
• Solutions
Check Your Progress

• Describe the function of HA-NFS support files
• List the primary functions of HA-NFS start and stop
methods
• List the primary functions of HA-NFS fault monitoring
probes
• Configure HA-NFS in a Sun Cluster environment
• Add and remove HA-NFS file systems
• Switch a HA-NFS logical host between systems
Think Beyond
Are there restrictions on the file systems HA-NFS can
support?
What types of NFS operations (if any) might be more difficult
in the HA-NFS environment?
Module 12
System Recovery

Module Overview
• Objectives
• Relevance
Sun Cluster Reconfiguration Control

The following software components monitor for cluster
failures and can trigger a cluster reconfiguration:
• Cluster membership monitor
• Switch management agent
• Public network management
• Failfast (FF) driver
• Data service fault monitors
• Disk management software
• Database management software
Sun Cluster
Reconfiguration Control
Node 0 Node 1
SMA SMA
DBMS DBMS
CMM CMM
Heartbeats
Network Private networks Network

driver driver
Updates
ccdd ccdd
Disk Disk
management PNM PNM management
FF FF
Fiber-optic Fiber-optic
channels Fault Fault channels
monitor monitor
Storage array Storage array
Sun Cluster Failfast Driver

• Memory resident driver (/dev/ff)
• Monitors critical daemons and operations
• Can force a UNIX panic if necessary
• Causes a cluster-wide reconfiguration
Sun Cluster Failfast Driver
Node 0
Critical daemon
Critical operation
Kernel driver: ff OK
Failfast timeout
All other nodes
UNIX panic CMM Loss of heartbeat

detected
reconf_ener
Reboot
Cluster
configuration
dependent
steps
Sun Cluster Reconfiguration Sequence

• Controlled by a master script
• Can be initiated by operator commands
• Can be initiated by cluster monitoring software
• Both major and minor reconfigurations occur
• There are also independent reconfiguration processes
Sun Cluster
Reconfiguration Sequence
Operator commands Status change detected
# scadmin startcluster Failed private network

# scadmin startnode Other node failed
# scadmin stopnode Other node joining cluster
reconf_ener
Varied reconfiguration steps

depending on the cluster
configuration and application
Disk Management
Monitor and
Virtual volumes
disable structures
Resync volumes
UNIX
File system recovery
Reboot after panic
Sun Cluster Reconfiguration Steps

• Reconfiguration is globally coordinated
• Each step must complete on all host systems
• General reconfiguration has the highest priority
• Database recovery is performed second
• Data service recovery is performed last
Sun Cluster
Reconfiguration Steps
CIS
reconf_ener reconf_ener reconf_ener
Step 1 Step 1 Step 1

| | |
| | |
| | |
| | |
Step n Step n Step n
Cluster Interconnect Failures

• The smad daemon detects CIS failures
• All nodes switch to their backup CIS interfaces
• The CIS failure is transparent to applications
• SCI interconnects require special repair steps
Two-Node Partitioned Cluster Failure

• Caused by a complete CIS failure
• Both nodes are isolated
• CVM and SSVM use basic quorum device
• SDS behavior is different
Logical Host Reconfiguration

• Local and remote fault monitors
• Both check the current logical host master
• Either can trigger a logical host reconfiguration
• Local fault monitor initiates a giveaway
• Remote fault monitor initiates a takeaway
• Sanity check must complete before reconfiguration
Logical Host Reconfiguration

Public network
check
Data service
check Local
fault Remote
monitor fault
monitor
giveaway
takeaway
Exercise
• Objectives
• Tasks
• Discussion
• Solutions
Check Your Progress

• List the functions of Sun Cluster control software
• List the events that can trigger a cluster reconfiguration
• Explain the failfast concept
• Describe the general priorities during a cluster

reconfiguration
• Describe the recovery process for selected cluster

failures
• Recover from selected cluster failures
Think Beyond
What are the issues for split-brain failures with more than two
modes?
Is it safe to have two “subclusters” running in a nominal four-
node cluster?
What procedures should be documented for operations
personnel?
Module 13
Sun Cluster
High Availability Data Service API

Module Overview
• Objectives
• Relevance
Overview
User applications
Client-server
data service
C library
Sun Cluster Command–line
utilities
High Availability API
High Availability
framework
Data Service Requirements

• Client-server data service
• Crash tolerant
• No dependencies on physical hostname of server
• Handles multi-homed hosts
• Handles additional IP addresses for logical hosts
Reconfiguration Overview
Logical Host Coming Down Logical Host Coming Up
FM_STOP Method FM_START Method
STOP_NET Method FM_INIT
Configure logical START_NET Method

network addresses DOWN
Configure logical
STOP Method network addresses UP
Stop/unmount volumes START Method
Deport disk groups/disk sets Start/mount volumes
Give up logical host Import disk groups/disk sets
Take over logical host
Data Service Methods

• START
• STOP
• ABORT
• NET
• Fault Monitoring
Giveaway and Takeaway
Public network
check
Data service
check Local
fault Remote
monitor fault
monitor
giveaway
takeaway
START and STOP Method Examples

Example 1
mars venus
phys-mars phys-venus
my_stop(“mars”, “venus”, 30) my_stop(“venus”, “mars”, 30)
my_start(“mars”, “venus”, 30) my_start(“venus”, “mars”, 30)
START and STOP Method Examples

Example 2
venus
mars
phys-mars phys-venus
my_stop(“”, “mars,venus”, 30) my_stop(“venus,mars”, “”, 30)
my_start(“”, “mars,venus”, 30) my_start(“venus,mars”, “”, 30)
Data Service Dependencies

Data service A depends on Data service B
START method ordering: STOP method ordering:
B: START A: STOP_NET
A: START B: STOP_NET
Configure logical network Configure logical network

addresses up addresses down
B: START_NET A: STOP
A: START_NET B: STOP
The haget Command

• Extracts Sun Cluster HA configuration information
• Called by data service methods
• Some haget command options need more information
• A logical hostname or a physical hostname

• A data service name
The hactl Command

• Provides control operations for fault monitors
• Request the movement of one or more logical hosts
• Request a cluster reconfiguration
• Performs sanity checks before proceeding
• Exits if sanity check fails
The halockrun Command

• Implements a mutex-type mechanism
• Serializes command execution
The hatimerun Command

• Sets a timeout for command execution
• Terminates command if not complete within time limit
• Runs in its own process group
Exercise
• Objectives
• Tasks
• Discussion
• Solutions
Check Your Progress

• Describe the available data service methods
• Describe when each method is called

• Describe how to retrieve cluster status information
• Describe how to retrieve cluster configuration
information
• Describe how the fault methods work and how to
request failovers
Think Beyond
Are there other methods that might be needed for some data
services? What would they be?
Are there ways to make a non-HA compliant data service
work with HA?
How would you debug HA API problems when you were
developing your data service?
Module 14
Highly Available DBMS

Module Overview
• Objectives
• Relevance
Sun Cluster HA-DBMS Overview

• Supports Oracle, Sybase, and Informix
• No changes to the database engine
• DBMS engine on local or multihost disks
• No change to database administration on clients
• Includes database fault monitors
Typical HA-DBMS Configuration

Node a Node b
i1 i2 Private net i3
i1 – instance 1 (logical host X)

i2 – instance 2 (logical host Y)
i3 – instance 3 (logical host Z)
Configuring and Starting HA-DBMS

To prepare a HA-DBMS instance:
1. Configure the logical host using the scconf
command.
2. Register the HA-DBMS service.
3. Start the HA-DBMS service using the hareg
command.
4. Register the HA-DBMS instances.
DBMS fault monitoring starts automatically when the HA-
DBMS data service is started.
Stopping and Unconfiguring

HA-DBMS
1. Stop the HA-DBMS service using hareg command.
2. Disconnect the service from the logical host using the
scconf command.
3. Unregister the DBMS data service using the hareg
command.
4. Unconfigure the logical host, if appropriate, using the
scconf command.
5. Remove the DBMS file systems from the
vfstab.lhname file.
The HA-DBMS Start Methods

• Run automatically after hareg -y or the logical host
starts
• Perform crash recovery if needed
• Always lets the HA framework start the database
• Start fault methods after this process completes
The HA-DBMS Stop and Abort

Methods
• HA-DBMS Stop methods
• Run automatically, cleanly shuts down the database
• Allowed a 6 minute timeout to complete
• Logical host disk groups are deported
• HA-DBMS Abort methods
• Run if there is time during a node failure
• Immediate termination of database activity
HA-DBMS Fault Monitoring

• Local fault probes scan database alert files
• Consult the data service action file for alert message

• Performs the action defined for the error
• Remote fault probes act as a DBMS client
• Perform database queries

• Perform SQL table operations
Configuring HA-DBMS for High

Availability
• Database volumes must be in switchable disk groups
• Archives might be an exception
• Database volume must be mirrored
Configuration Overview
• Never start the database manually
• Only the cluster framework should start the DBMS
• Database manager accounts on all nodes
• Be careful about default DBMS software locations
• Some installations will place on local private disks
Oracle Installation Preparation

• Start the cluster and HA-Oracle logical host
• Create dba accounts on primary and backup hosts
• Configure $ORACLE directories
• Install the Oracle software
• Change /etc/system on primary and backup hosts
Sybase Installation Preparation

• Start the cluster and HA-Sybase logical host
• Configure $SYBASE directories
• Install the Sybase software
• The ctlib.loc file must be loaded
• For use by the fault monitor software
Informix Installation Preparation

• Start the cluster and HA-Informix logical host
• Configure $INFORMIX directories
• Install the Informix software
Preparing the Logical Host

• Set database ownership of appropriate volume
• Set ownership with vxedit for CVM and SSVM
• Set ownership with chown/chgrp with SDS
• Grant fault monitors password access
• The process is different for each database

• Register the HA-DBMS data service
• Insert DBMS entry into the CCD
• Use haoracle/hasybase/hainformix insert
HA-DBMS Control
• Fault monitoring configuration information
• Stored in CCD
• Use haoracle/hasybase/hainformix insert
• Command variations for each HA-DBMS
• Fault monitoring control commands
• Use haoracle/hasybase/hainformix start/stop
• Does not start or stop the database
HA-DBMS Client Overview

• No special DBMS configuration
• Client must access only through logical hostname
• Never through the physical hostname
• Clients must be prepared for unscheduled disconnect
• As in a node crash
HA-DBMS Recovery
• Clients and applications must be prepared
• Transaction monitors can help with disruption
• Database instance recovery
• Volume manager recovery is part of it
• Might need to adjust restart delay time
• Set with haoracle/hasybase/hainformix insert

• Use haoracle/hasybase/hainformix update
HA-DBMS Configuration Files

• CCD insert information
• Oracle
• oratab, haoracle_config_V1
• Sybase
• sybtab, hasybase_config_V1
• Informix
• inftab, hainformix_config_V1
Exercise
• Objectives
• Tasks
• Discussion
• Solutions
Check Your Progress

• List the configuration issues for a highly available
DBMS instance
• Describe the general installation and configuration

process for an HA-DBMS data service
Think Beyond
Are there services associated with HA-DBMS that should be
highly available?
Are there advantages to using multiple disk groups with the
HA-DBMS?
Do you need application-specific fault probes for an HA-
DBMS environment? Why or why not?
Why is the quorum mechanism so important with HA-
DBMS?
Copyright © 1999 Sun Microsystems, Inc., 901 San Antonio Road, Palo Alto, California 94303, U.S.A. All rights reserved.
This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this
product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any.
Third-party software, including font technology, is copyrighted and licensed from Sun suppliers.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S. and other
countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun Logo, Sun Enterprise, Sun StorEdge Volume Manager, Solstice DiskSuite, Solaris Operating Environment, Sun StorEdge A5000,
Solstice SyMon, NFS, JumpStart, Sun VTS, OpenBoot, and AnswerBook are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other
countries.
All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products
bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc.
The OPEN LOOK and Sun Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sun acknowledges the pioneering efforts
of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry. Sun holds a non-exclusive license from Xerox
to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN LOOK GUIs and otherwise comply with Sun’s written
license agreements.
U.S. Government approval required when exporting the product.
RESTRICTED RIGHTS: Use, duplication, or disclosure by the U.S. Govt is subject to restrictions of FAR 52.227-14(g) (2)(6/87) and FAR 52.227-19(6/87), or DFAR
252.227-7015 (b)(6/95) and DFAR 227.7202-3(a).
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS, AND WARRANTIES, INCLUDING ANY
IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE
EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.

ES-331 Sun Enterprise Cluster Administration Veritas Volume Manager

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

ES-331 Sun Enterprise Cluster Administration Veritas Volume Manager

Uploaded by

Copyright:

Available Formats

Sun Educational Services

Sun Enterprise Cluster

Sun Enterprise Cluster Administration – Veritas Volume Manager October 1999

Sun Enterprise Cluster Administration – Veritas Volume Manager

About This Course .......................................................................................................Preface-1

Sun Cluster Overview ............................................................................................................1-1

Sun Enterprise Cluster Administration – Veritas Volume Manager iii

Check Your Progress ............................................................................................................................ 1-13

Terminal Concentrator ..........................................................................................................2-1

Administrative Workstation ................................................................................................3-1

Preinstallation Configuration ..............................................................................................4-1

Sun Enterprise Cluster Administration – Veritas Volume Manager iv

Cluster Quorum Devices ........................................................................................................................ 4-9

Cluster Host Software Installation .....................................................................................5-1

System Operation ...................................................................................................................6-1

Sun Enterprise Cluster Administration – Veritas Volume Manager v

Basic Cluster Control (scadmin) ........................................................................................................... 6-5

Volume Management Using

Cluster Configuration Database ..........................................................................................8-1

Sun Enterprise Cluster Administration – Veritas Volume Manager vi

Check Your Progress ............................................................................................................................ 8-11

Public Network Management ...............................................................................................9-1

Logical Hosts ........................................................................................................................10-1

The HA-NFS Data Service ...................................................................................................11-1

Sun Enterprise Cluster Administration – Veritas Volume Manager vii

Objectives ............................................................................................................................................... 11-3

System Recovery ...................................................................................................................12-1

Sun Enterprise Cluster Administration – Veritas Volume Manager viii

Highly Available DBMS ......................................................................................................14-1

Sun Enterprise Cluster Administration – Veritas Volume Manager ix

Oracle Installation Preparation ......................................................................................................... 14-12

Sun Enterprise Cluster Administration – Veritas Volume Manager x

About This Course

Sun Enterprise Cluster Administration – Veritas Volume Manager October 1999

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 2 of 18

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 3 of 18

Terminal Administration Preinstallation Cluster Host

System Volume Cluster

Logical Host Configuration

Public Network Logical Hosts The HA-NFS

Sun Cluster Highly

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 4 of 18

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 5 of 18

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 6 of 18

• Verify system cabling

• Configure the Terminal Concentrator for proper

• Install, remove, and update Sun Cluster software

• Troubleshoot software installation and configuration

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 7 of 18

• Use the Sun Cluster administration tools

• Initialize one of the supported volume managers

• Describe the differences between the supported volume

• Prepare the Public Network Management failover

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 8 of 18

• Install and configure highly available data services

• Describe the Sun Cluster failure recovery mechanisms

• Identify and recover from selected Sun Cluster failures

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 9 of 18

Skills Gained by Module

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 10 of 18

Guidelines for Module Pacing

Sun Enterprise Cluster Administration – Veritas Volume Manager Preface, slide 11 of 18

Topics Not Covered