You are on page 1of 43

Linux and Storage News

SOS05

Alexander Warmuth

© 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

European Storage Competence Centre


The ESCC provides end to end support for IBM storage solutions
Pre-sales support including:
–Technical Q&A
–Solution Design
–Proof of Concepts
–Customer briefings and workshops
Implementation and post-sales support including:
–Implementation Services
–Product Field Engineering
–Customer Care

Intranet Site : w3.escc.mainz.de.ibm.com

2 w3.escc.mainz.de.ibm.com Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Objectives

 Introduce the latest storage related Linux technologies


 Explain how they work
 What is ready for use?
 What is supported?

3 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Agenda

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news
 Closing

4 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DS4000 and Linux Native Multipathing

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news
 Closing

5 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Device Mapper Multipathing


Block
Devices
 Built on top of existing block devices
Device Mapper
 Device scan with read
Block
Devices – Capacity
SCSI – Partitions
HBA
0
Hardware
HBA
1 – File systems
– Meta data
SAN

A B

Storage Server

6 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Device Mapper Multipathing Magic


Block
Devices

Device Mapper

Block
multipath
Devices
multipathd

SCSI

HBA HBA
Hardware
0 1

SAN

/dev/disk/by-id/...
A B
/by-path/...
Storage Server /by-uuid/...

7 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DS4000 modes of operation

 AVT on
– full LUN access on both controllers
– LUN automatically transferred to accessing controller
– Not for cluster solutions with shared access to volumes
 AVT off, RDAC Mode
– SCSI Inquiry, Test Unit Ready, Mode Sense / Select,
Reserve / Release, Read Capacity possible
– No Read / Write access through alternate controller

8 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Device Scan - Owning Controller


Block
Devices
kernel: Vendor: IBM Model: 1814 FAStT Rev: 0916
kernel: Type:
Device Mapper Direct-Access ANSI SCSI revision: 05
kernel: SCSI device sdf: 104857600 512-byte hdwr sectors (53687 MB)
kernel: Block
sdf: Write Protect is off
Devices
kernel: sdf: Mode Sense: 77 00 10 08
kernel: SCSI
SCSI device sdf: drive cache: write back w/ FUA
kernel: SCSI device sdf: 104857600 512-byte hdwr sectors (53687 MB)
HBA HBA
Hardware
kernel: sdf: Write Protect is off
0 1
kernel: sdf: Mode Sense: 77 00 10 08
kernel: SCSI device sdf: drive cache: write back w/ FUA
SAN
kernel: sdf: unknown partition table
kernel: sd 4:0:0:1: Attached scsi disk sdf
A
kernel: B
sd 4:0:0:1: Attached scsi generic sg13 type 0
kernel: device-mapper:
Storage Server multipath rdac: using RDAC command with timeout 15000

9 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

RDAC Mode – Alternate Controller


kernel: Vendor:
kernel: Vendor: IBM
IBM Model:
Model: 1814
1814 FAStT Rev:
FAStT Rev: 0916
0916
kernel: Type:
kernel: Type: Direct-Access
Direct-Access ANSI
ANSI SCSI
SCSI revision:
revision: 0505
Block
Devices
kernel:
kernel: SCSI
SCSI device
device sde:
sde: 104857600
104857600 512-byte
512-byte hdwr
hdwr sectors
sectors (53687
(53687 MB)
MB)
kernel:
kernel: sde:
sde: Write
Write Protect
Protect isis
offoff
Device Mapper
kernel: sde: Mode Sense:
kernel: sde: Mode Sense: 7777
0000
10100808
kernel:
kernel: SCSI
SCSI device
device sde:
sde: drive
drive cache:
cache: write
write back
back w/w/ FUA
FUA
Block
kernel: SCSI
Devices
kernel: SCSI device
device sde:
sde: 104857600
104857600 512-byte
512-byte hdwr
hdwr sectors
sectors (53687
(53687 MB)
MB)
kernel:
kernel: sde:
sde: Write
Write Protect
Protect isis
offoff
kernel: SCSI
kernel: sde:
sde: Mode
Mode Sense:
Sense: 7777
0000
10100808
kernel:
kernel: SCSI
SCSI device
device sde:
sde: drive
drive cache:
cache: write
write back
back w/w/
FUAFUA
HBA HBA
Hardware
0
kernel:
kernel: 1
sde:end_request:
sde:end_request: I/O
I/O error,
error, dev
dev sde,
sde, sector
sector 0 0
kernel:
kernel: Buffer
Buffer I/O
I/O error
error onon device
device sde,
sde, logical
logical block
block 0 0
kernel:
kernel:SAN end_request:
end_request: I/O
I/O error,
error, devdev sde,
sde, sector
sector 0 0
kernel:
kernel: Buffer
Buffer I/O
I/O error
error onon device
device sde,
sde, logical
logical block
block 0 0
kernel:
kernel: end_request:
end_request: I/O
I/O error,
error, devdev sde,
sde, sector
sector 0 0
A
kernel: Buffer B I/O error on device sde, logical block 0
kernel: Buffer I/O error on device sde, logical block 0
Storageunable
kernel:
kernel: Server
unable toto read
read partition
partition table
table
kernel:
kernel: sdsd 3:0:0:1:
3:0:0:1: Attached
Attached scsi
scsi disk
disk sdesde
kernel:
kernel: sdsd 3:0:0:1:
3:0:0:1: Attached
Attached scsi
scsi generic
generic sg12
sg12 type
type 0 0
10 Aug 15, 2008 © 2008 IBM Corporation
New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

AVT Mode – Alternate Controller


Block
Devices
 Automatic volume transfer
Device Mapper
– Access possible
Block
Devices – No error messages
SCSI  Not suitable for cluster environments
HBA HBA
Hardware
0 1

SAN

A B

Storage Server

11 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Block
Devices
RDAC Multipathing Driver
mppVhba
 RDAC upper layer
Block
Devices – Inhibits mapping of block devices

SCSI
– No device scan
mppUpper  RDAC virtual HBA
HBA
0
Hardware
HBA
1
– New block devices
– Regular integration
SAN
– Device Mapper on top possible
A B

Storage Server

12 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DM-MP Development
Block
Devices
 Hardware Handler in SCSI layer
Device Mapper
 Inhibit device scan
Block
Devices
 Multipathing based on UUID
SCSI
RDAC RDAC  No read access neccessary
HBA HBA
Hardware
0 1

SAN

A B

Storage Server

13 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DS4000 DM-MP Configuration


Block  Hardware table
Devices
device {
Device Mapper vendor "IBM"
product "1814"
Block path_grouping_policy "group_by_prio"
Devices
path_checker "rdac"
SCSI hardware_handler "1 rdac"
HBA HBA
prio "rdac
Hardware
0 1 }

SAN
 Change defaults
A B defaults {
Storage Server
failback immediate
no_path_retry "queue"
}

14 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Controlling DM-MP
x3650-lab-10:~ # multipathd -k
multipathd> help
multipath-tools v0.4.8 (08/02, 2007)
CLI commands reference:
list|show paths
list|show maps|multipaths
add path $path
list|show maps|multipaths status
remove|del path $path
list|show maps|multipaths stats $map
add map|multipath
list|show maps|multipaths topology
remove|del map|multipath $map
list|show topology
switch|switchgroup map|multipath $map group $group
list|show map|multipath $map topology
reconfigure
list|show config
suspend map|multipath $map
list|show blacklist
resume map|multipath $map
list|show devices
reinstate path $path
fail path $path
multipathd>

15 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DS4000 Examples multipathd> show multipaths


name sysfs uuid
Block multipathd> show maps status
Devices mpatha dm-0 3600a0b800011f9b200005e2947d762c0
name failback queueing paths dm-st
multipathd> show mapsmpathbstats dm-1 3600a0b800011fa780000340847e8a1f3
Device path_faults
Mapper
mpatha immediate on 2 active
name switch_grp
multipathd> show paths map_loads total_q_time q_timeouts
mpathb immediate on 2 active
mpatha 1hcil
multipathd> dev 3dev_t pri dm_st
0 0
chk_st 0
next_check
Block show maps topology
mpathbDevices
04:0:0:0 sdd 08:48 3 2 0dm-0 XXXX......
[active][ready] 0 8/20 FAStT
mpatha (3600a0b800011f9b200005e2947d762c0) IBM,1814
[size=50G 3:0:0:0 sdc 8:32
][features=1 0 [active][ghost] X.........
queue_if_no_path][hwhandler=1 rdac 3/20
]
SCSI
4:0:0:1
\_ round-robin sdf 8:80 3 [active][ready] XXXXXXXX.. 16/20
0 [prio=3][active]
HBA HBA
Hardware
\_ 04:0:0:0 3:0:0:1 sde 8:64
sdd1 8:48 0 [active][ghost] XXXXXXXXX. 19/20
[active][ready]
\_ round-robin 0 [prio=0][enabled]
SAN
\_ 3:0:0:0 sdc 8:32 [active][ghost]
mpathb (3600a0b800011fa780000340847e8a1f3) dm-1 IBM,1814 FAStT
[size=50G ][features=0 ][hwhandler=1 rdac ]
A B
\_ round-robin 0 [prio=3][enabled]
Storage Server
\_ 4:0:0:1 sdf 8:80 [active][ready]
\_ round-robin 0 [prio=0][enabled]
\_ 3:0:0:1 sde 8:64 [active][ghost]
16 Aug 15, 2008 © 2008 IBM Corporation
New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DM-MP und SCSI Reservation

 No SCSI Reservation support


 Resource fencing in clusters
– Reservation on block devices
– Cluster file systems
– No shared access, data replication

17 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

DM-MP and DS4000 Summary

 Supported by Linux vendors


– SLES 10 SP1
– RH-EL 5 U1
 Not supported by IBM
 RDAC functionality implemented
– Fail over / fail back functionality equivalent
– No SCSI reservation support
 Error messages during startup and reconfiguration

18 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

SAN Boot from Multipath Devices

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news
 Closing

19 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

SAN Boot Single Path


 No difference to local SCSI boot
 No redundancy

Block
Devices

Initial RAM
SCSI
Disk
HBA HBA
Hardware
0 1

SAN

A B

Storage Server

20 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

SAN Boot Multipath


Block  Root on multipath
Devices
– DM-MP in Initial RAM Disk
Device Mapper
implemented
Block
Devices
– SLES: install on single path, turn on
Initial RAM Disk DM-MP afterwards
SCSI
– RH-EL: turn on DM-MP for
HBA
0
Hardware
HBA
1
installation

SAN
 Boot from multipath
– Some boot loaders not yet DM-MP
A B aware
Storage Server – BIOS problems still exist

21 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

SAN Boot,Vendor:
kernel: DM-MP IBM andModel:
DS4000
1814 FAStT Rev: 0916
kernel:
Block
Type: Direct-Access  Device scans lead to SCSI
ANSI errors
SCSI revision: 05
Devices
kernel: SCSI device sde: 104857600 512-byte hdwr sectors (53687 MB)
– Long
kernel: sde: Write Protect is off installation time
Device Mapper
kernel: sde: Mode Sense: 77 00 10 08
– Long boot time
kernel: SCSI device sde: drive cache: write back w/ FUA
Block
kernel: – Boot
SCSI device sde: 104857600
Devices loader
512-byte configuration
hdwr sectors (53687problems
MB)
kernel: sde: Write Protect is off
SCSI
kernel: sde: Mode Sense: 77 00 10 08  Easier with AVT on
kernel: SCSI device sde: drive cache: write back w/ FUA
HBA HBA
Hardware
0
kernel: 1
sde:end_request: I/O error, dev sde, sector 0
kernel: Buffer I/O error on device sde, logical block 0
kernel:
SANend_request: I/O error, dev sde, sector 0
kernel: Buffer I/O error on device sde, logical block 0
kernel: end_request: I/O error, dev sde, sector 0
A
kernel: BufferB I/O error on device sde, logical block 0
Storage Server
kernel: unable to read partition table
kernel: sd 3:0:0:1: Attached scsi disk sde
kernel: sd 3:0:0:1: Attached scsi generic sg12 type 0

22 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

SAN Boot and DM-MP Summary

 Root on dm-multipath is easy


 Boot from dm-multipath: boot loader concerns
 Boot from SAN and DS4000
– Problematic with DM-MP
– Easy with RDAC
 All other IBM storage systems ok

23 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

N-Port ID Virtualization

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news
 Closing

24 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

What is NPIV?

 HBA “multiplication”
– Virtual adapters presented to the operating system
– Virtual N-ports presented to Fabric
• Dedicated WWPN
• Appears just as physical port
 HBA and switch must be NPIV capable
 Used in virtualized systems
– VMWare
– Linux on System z and VM
– XEN integration in implementation

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

XEN Attachment Choices

?
ar
 Physical volume

ye
File
DomU3
 Logical Volume
Dom0 DomU2

st
 Image file
la LVol DomU1
er

XEN Hypervisor
b
em
em
R

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

XEN: Storage Management Today


Dom0 DomU1 DomU2
 Zoning and LUN Mapping to
Hardware
 Virtual drivers for disk
assignment to images

XEN Hypervisor
N-Port

N-Port
Switch

N-Port

N-Port

Storage Server

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Virtual Storage in XEN - Disadvantages


Dom0 DomU1 DomU2
 Management
 Security
 Performance Impact
 Image migration
XEN Hypervisor
N-Port

N-Port
Switch

N-Port

N-Port

Storage Server

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

XEN and Virtual N-Ports


Dom0 DomU1 DomU2
 Provided by HBA
– managed by Dom0
– Dedicated WWPN
– Appears just as physical port

XEN Hypervisor
 Assigned to VM
N-Port V-Port V-Port
 Volume Mapping to V-Port
N-Port V-Port V-Port
Switch

N-Port

N-Port

Storage Server

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Virtual Machine Migration


Dom0 DomU1 DomU2 Dom0 DomU1'

XEN Hypervisor XEN Hypervisor


N-Port V-Port V-Port N-Port V-Port

N-Port V-Port V-Port N-Port V-Port


Switch

N-Port

N-Port

Storage Server

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Setup and Configure NPIV


WWPN WWNN
 Create virtual HBA
# cd /sys/class/scsi_host/host2
# echo "2100001b32013aff:2000001b32013aff" > vport_create

 Similar commands to remove and configure V-Ports


 V-Port management integrated into virtualization

31 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Virtual Ports in the SAN

32 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

NPIV Enabled SAN Example

33 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Virtual Ports Seen by Storage System

34 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Other Linux and Storage News

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news
 Closing

35 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

HBA Information

 Find WWPN and WWNN


# cat /sys/class/fc_host/host3/port_name
0x10000000c954ceba
# cat /sys/class/fc_host/host3/node_name
0x20000000c954ceba

 HBA Driver Info


# modinfo lpfc
filename: /lib/modules/2.6.16.60-0.9-smp/.../lpfc/lpfc.ko
version: 0:8.2.0.21
author: Emulex Corporation - tech.support@emulex.com
description: Emulex LightPulse Fibre Channel SCSI driver 8.2.0.21
license: GPL

36 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Dynamic Volume Resizing

?
ar
 Linux can't use additional capacity on-the-fly

ye
– Minimum interruption: unmount file system
– Reboot usually not necessary

st
la
 LVM: proven method to add capacity online

er
– Add new disk
Linux host

b
– Expand volume group HBA 0 HBA 1

– Expand logical volume


em
em
– Resize file system LUN 0 LUN 1
R

+ Cap

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Agenda

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news
 Closing

38 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Summary

 DS4000 and Linux native multipathing


 SAN Boot from multipath devices
 N-Port ID virtualization
 Other Linux and storage news

39 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Sources of Information

 Linux and IBM Storage Community


– Thomas Gerisch, GERISCH@de.ibm.com
– Wiki: https://w3.webahead.ibm.com/w3ki/display/linuxstorage/Home
 Enterprise Linux Services, Germany
– Michael Weisbach,michael.weisbach@de.ibm.com
– Wiki: https://els.chemnitz.de.ibm.com/wiki/index.php/Main_Page
 Multipath Usage Guide
http://sources.redhat.com/lvm2/wiki/MultipathUsageGuide

 Multipath storage with Xen and DS4800


http://www.ibm.com/developerworks/linux/library/l-multipath-xen/index.html

40 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Questions & Discussion

More Questions?

Contact: warmuth@de.ibm.com

Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Trademarks and Disclaimers


The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. For a complete
list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml: ADD TRADEMARKS FROM DOCUMENT THAT APPLY

The following are trademarks or registered trademarks of other companies:


Java and all Java based trademarks and logos are trademarks of Sun Microsystems, Inc., in the United States and other countries or both
Microsoft, Windows,Windows NT and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other
countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium
are trademarks or registered trademarks
of Intel Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries or both.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.
NOTES:
Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are
dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in
this document may have been made on development-level systems. There is no guarantee these measurements will be the same on
generally-available systems. Users of this document should verify the applicable data for their specific environment.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
Information is provided “AS IS” without warranty of any kind.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have
used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending
on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other
countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the
product or services available in your area.

42 Aug 15, 2008 © 2008 IBM Corporation


New Enterprise Forum: Information Infrastructure - IBM System Storage and Storage Networking Technical Symposium

Trademarks and Disclaimers (continued)


NOTES:
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and
objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not
tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the
capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices are suggested US list prices and are subject to change without notice. Starting price may not include a hard drive, operating system
or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.
Any proposed use of claims in this presentation outside of the United States must be reviewed by local IBM country counsel
prior to such use.

The information could include technical inaccuracies or typographical errors. Changes are periodically made to the
information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in
the product(s) and/or the program(s) described in this publication at any time without notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve
as an endorsement of those Web sites. The
materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.

IBM makes no representation or warranty regarding third-party products or services including those designated as ServerProven,
ClusterProven or BladeCenter Interoperability Program products. Support for these third-party (non-IBM) products is provided by non-IBM
Manufacturers.
IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not
give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive,
Armonk, NY 10504-1785 USA.

43 Aug 15, 2008 © 2008 IBM Corporation

You might also like