SNIA-SA 100 Introduction to Network Storage

Chapter 8 Emerging Technologies

Version 1.1
1

COPYRIGHTED 2004

Coverage

1. Storage Virtualization 2. IP Storage 3. Other Emerging Technologies 4. Review Questions

COPYRIGHTED 2004

Section 1
1. 2. 3. 4. Storage Virtualization IP Storage Other Emerging Technologies Review Questions

COPYRIGHTED 2004

Section 1: Storage Virtualization

1.1 Definition 1.2 Illustration 1.3 Need for Storage Virtualization 1.4 Benefit of Storage Virtualization

COPYRIGHTED 2004

Storage Virtualisation
Definition (SNIA): The act of abstracting, hiding, or isolating the internal function of a storage (sub) system or service from applications, computer servers or general network resources for the purpose of enabling application and network independent management of storage or date.

COPYRIGHTED 2004

Illustration
Storage Pool Tape

Vendor C Disks Vendor B Storage Server

COPYRIGHTED 2004

Client will see storage as virtual storage pools

6

Vendor A

Need for Storage Virtualization

Addresses increasing complexity of managing storage Reduce associated costs Ensures high availability and improved performance. Enables the ability to choose multi-vendor storage independent of the functionality Virtualized storage not limited by the capacity, speed or reliability limitations of the physical device. Provides ability to change and upgrade hardware without disrupting data.

COPYRIGHTED 2004

Storage Virtualization-Benefits
Efficient Management of Data Storage Resources Dynamic management of storage resources as virtual storage pools with little regard to its physical implementation. Centralized management and data sharing with heterogeneous servers. Easy Upgrades Enables non-disruptive capacity expansion, which is critical when storage is growing. Simplified Configuration Allocating volumes, migrating from or replacing obsolete storage subsystems subsystems without server shutdowns or interrupting data access can be done on the fly.
8

COPYRIGHTED 2004

Section 2

1. 2.

Storage Virtualization IP Storage

3. Other Emerging Technologies

4. Review Questions

COPYRIGHTED 2004

Section 2: IP Storage

2.1 What is IP Storage 2.2 IP Storage Technologies

2.2.1 FCIP
2.2.2 iFCP 2.2.3 iSCSI

10

COPYRIGHTED 2004

IP Storage
What is IP Storage? A group of technologies that allows block-level storage data to be transmitted over an IP-based network. Why IP Storage? Leverage on existing IP infrastructure Quality of Service of IP network. Security features- IPSec already available. Use existing switching and routing elements. Existing pool of skills in IP Technology Overcome the distance limitation in FC SAN(10 km) Interconnect FC devices to dispersed SAN islands
COPYRIGHTED 2004

11

IP Storage Technologies
Fibre Channel over IP (FCIP) Internet Fiber Channel Protocol (iFCP) Internet SCSI (iSCSI) Internet Storage Name Server (iSNS)

12

COPYRIGHTED 2004

FCIP
What is FCIP? Definition (SNIA)

TCP/IP based tunneling protocol for connecting geographically

distributed Fibre Channel SANs transparently to both FC and IP.

FCIP gateway encapsulates FC frames into IP.

IP Header IP Payload CRC

IP Datagram

SOF

FC Header

SCSI Data

CRC EOF

Fibre Channel Frame

Only edge devices need to be added. Goal is to interconnect geographically dispersed SANs
through reliable high speed links.
COPYRIGHTED 2004
13

FCIP
Why FCIP? Interconnect geographically dispersed SAN islands through existing IP network.

Overcome distance limitation of Fibre Channel (10km) Cost-effective way to enable solutions such as remote
mirroring, replication, tape vaulting etc in existing FC infrastructure.

14

COPYRIGHTED 2004

How it Works
FC frame is encapsulated into FCIP packet,then into TCP packet and sent over FCIP tunnel to the destination device. At the destination the FC frame is un encapsulated in the reverse order.

Edge Router

Optical IP
Edge Router

SAN Island 1

FCIP tunnel
FC Frame FC Frame FC Frame

Edge Router FCIP Gateway FC Frame

FC Frame FC Frame

TCP headers FCIP headers

SAN Island 3
15

SAN Island 2

COPYRIGHTED 2004

FCIP Applications
FCIP enables SAN interconnectivity over long distances Remote backup and restore Data Replication At higher link speeds, synchronous applications can be implemented. Eg. Synchronous mirroring or replication. Outsource Storage Hosting Customer data can be hosted at a service provider data center and Servers at customer sites can efficiently access the hosted storage over the network
16

COPYRIGHTED 2004

iFCP
What is iFCP? A gateway-to-gateway protocol for implementing a Fibre Channel fabric with TCP/IP switching and routing elements. Maps Fibre Channel transport services over TCP/IP, allowing networked, connections among FC devices. Why iFCP? IP network providing switching and routing functions for FC. Providing features of FC over IP network.
COPYRIGHTED 2004

17

iFCP Frame
Ethernet Header

IP

TCP iFCP FCP

SCSI Data

CRC

The FC frame is encapsulated within the iFCP header followed by the TCP and IP Headers

18

COPYRIGHTED 2004

iFCP
Implementation
Application Layer Operating System Standard SCSI Command set Fibre Channel Protocol

TCP
IP Ethernet At the highest layer, Fibre Channel Protocol (FCP) provides a serial SCSI interface to the operating system
19

Lower Layer FC

COPYRIGHTED 2004

iFCP How it works

There can be different types of communication in an iFCP network Device to Device communication SAN to SAN when there are existing FC fabrics Device to SAN communication Server

Tape Library

Device to Device
iFCP Gateway IP Network

FC Loop

iFCP Gateway

20

COPYRIGHTED 2004

iFCP
Benefits of iFCP Leverage on the existing IP network/infrastructure to deliver FC frames. Enables routing of storage data over wide areas. Facilitates interoperability with most of the storage devices in the market today.

21

COPYRIGHTED 2004

iSCSI
What is iSCSI?

Make IP as a transport for SCSI commands. Allows SCSI block- I/O commands to be sent over existing IP
network.

IP Header

TCP header

iSCSI Header

SCSI commands and data

Information regarding guaranteed delivery Contain routing information

Information to extract SCSI commands and data

Required iSCSI-enabled device (e.g. HBA or software layer). Allow remote disk copying, tape backup and restore.
22

COPYRIGHTED 2004

iSCSI How it works

Server with iSCSI controller Storage Device 2
iSCSI

IP network 3
iSCSI

IP Packet 1

IP Packet

23

COPYRIGHTED 2004

iSCSI Protocol Model

Initiator SCSI iSCSI TCP IP Link IP Network
24

Target SCSI iSCSI TCP IP Link

COPYRIGHTED 2004

iSCSI
Pros Ethernet network already in place. Support longer distance network Uses SCSI (Block) I/O protocol Lower Cost Cons Performance overhead in using TCP/IP

25

COPYRIGHTED 2004

Who will get benefits?

iSCSI SANs are most suitable for organizations with a need for streaming data and/ or large amounts of data to store and transmit over the network. Internet Service Providers (ISPs) Storage Service Providers (SSPs) Organization that need remote data replication and disaster recovery Geographically distributed organizations that require access to the same data on a real-time basis Business and Institutions with limited IT resources, infrastructure and budget

26

COPYRIGHTED 2004

Deployment Examples (1)

Reference: iSCSI: The Future of Network Storage, Intel

27

COPYRIGHTED 2004

Deployment Examples (2)

Reference: iSCSI: The Future of Network Storage, Intel

28

COPYRIGHTED 2004

Deployment Examples (3)

Reference: iSCSI: The Future of Network Storage, Intel

29

COPYRIGHTED 2004

iSNS
What is iSNS Device Discovery in Fibre Channel Discovery in IP Storage Networks iSNS Discovery Process iSNS and Entity Status Enquiry iSNS Objects iSNS Security

30

COPYRIGHTED 2004

iSNS
What is iSNS Used for device discovery Uses both FC and Internet discovery mechanisms. End-nodes must register their presence in the network Initiative that has been developed for facilitating device
discovery in a large scale IP storage network is iSNS.

Enables discovery of iFCP and iSCSI devices using common

protocols .

31

COPYRIGHTED 2004

iSNS
Device Discovery in Fibre Channel nodes log on the fabric to obtain 24bit network address registers to the SNS within the fabric switch SNS maintains a small database that contains the WWN,
fabric address, COS parameters and other attributes.

SNS streamlines the discovery process but does not dictate

assignment of initiators to targets.

32

COPYRIGHTED 2004

iSNS
Discovery in IP Storage Networks iSNS provides support for iFCP and iSCSI include the discovery of gateways also discovery of storage nodes in an IP SAN Address discovery related issues such as zoning
and change notification

Minimize discovery processing requirements for IP

storage end devices.

Reduce administrative and management

overheads.

33

COPYRIGHTED 2004

iSNS
Discovery in IP Storage Networks
FC Storage FC Server FC Server iSCSI Storage

FC Storage iSCSI Server

iSNS
iFCP Gateway

iFCP Gateway

FC Server

iSCSI Server

FC Server

iSCSI Storage

FC Storage FC Storage

34

COPYRIGHTED 2004

iSNS
iSNS Discovery Process Device registration Attributes and address information Server builds a database of iSNS clients

35

COPYRIGHTED 2004

iSNS
iSNS Discovery Process
Rgstr Entity (iFCP) WWPN=PNA PortID=010126 FC4Types=FCP Portal IP Address = 10.1.1.1 WWNN = NNA SCNbitmap=AllEvents

iSNS

Device C
Device A Device B
36

COPYRIGHTED 2004

iSNS
iSNS SCN and Entity Status Query

State Change Notification

iSNS

DD1 Device A

Device B DD2

Device C

37

COPYRIGHTED 2004

iSNS
iSNS Objects iFCP iSNS network entity
IP Network
Portal -IP Addr 1 -TCP Port 1 Portal -IP Addr 2 -TCP Port 2

FC Loop / Fabric
Storage Port -WWPN1 -PortID1 -FWWN1 -FC COS Storage Node -WWNN1 -Symbolic Name -FC Node IP Add -Type - Target Storage Port -WWPN2 -PortID2 -FWWN2 -FC COS Storage Node -WWNN2 -Symbolic Name -FC Node IP Add -Type - Target

38

COPYRIGHTED 2004

iSNS
iSNS Objects iSCSI iSNS network entity
IP Network
Portal -IP Addr 1 -TCP Port 1 Portal -IP Addr 2 -TCP Port 2

Storage Node -WWUI -Alias Server1 - Type - Initiator

Storage Node -WWUI -Alias Disk1 - Type - Target

Network Entity -Entuty ID strg1.foo.com -Type : iSCSI

Network Entity -Entuty ID strg1.bar.com -Type : iSCSI

39

COPYRIGHTED 2004

iSNS
iSNS Security
Key Repository iSNS Public Key Management Platform Public Key

Public Key

Device A

Device B

Device C

40

COPYRIGHTED 2004

Section 3

1. Storage Virtualization 2. IP Storage 3. Other Emerging Technologies 4. Review Questions

41

COPYRIGHTED 2004

Section 3: Other Emerging Technologies

4.1 Policy Based Management 4.2 Object- Based Storage

42

COPYRIGHTED 2004

Policy Based Management

Policy as defined by SNIA is the measurable, enforceable,and realizable specification of method, action, and/ or desired state that meets service requirements in a storage based information infrastructure Policies define the relationship between SLOs (Service Level Objectives) and a particular application

Policies also define the actions necessary to meet and enforce those SLOs through the execution of storage management processes.

43

COPYRIGHTED 2004

Object Based Storage

Storage devices that are treated as objects rather that blocks or files. Object-based storage technologies shield the application or operating system from the low-level details of managing file storage. The intelligence is added to the storage device in order to offload low-level storage management tasks traditionally handled by the operating system, such as mapping files to actual storage blocks on the disk drive and managing file attributes and other associated metadata. Enables cross-platform capable SANs Platform-specific management routines can be offloaded to the devices. The storage device can serve data directly to the host.
44

COPYRIGHTED 2004

Object-Based Storage
Objects can be regarded as the convergence of files and blocks. Files provide applications with a higher-level storage abstraction that enable secure data sharing across different operating system-platforms But often at the cost of limited performance due to fileserver contention Blocks offer fast, scalable access to the shared data But without a file server to authorize the I/O and maintain the metadata, this direct access comes at the cost of limited security and data sharing

45

COPYRIGHTED 2004

Contribution of Object-based Storage

Objects are primitive, logical units of storage that can be directly accessed on a storage device no server needed It is metadata that provides the information needed to directly access objects, along with other information about data including its attributes, security keys, and permissions

46

COPYRIGHTED 2004

OSD Object Abstraction

Source: T10 document;SCSI object based storage Device commands COPYRIGHTED 2004

47

OSD Object Abstraction

In the block-based storage model, the file systems located in the servers are responsible for the management of both files and available disk blocks on the disk storage devices In the OSD model, the file system is divided into two separate parts that communicate through OSD interface. The file manager only needs to manage objects while the management of the individual blocks is moved to the storage devices.

48

COPYRIGHTED 2004

Block Based vs. Object Based Disk

Source: Object based storage using OSD to solve Data, Intel Developer forum by Cameron and Satran.J 49

COPYRIGHTED 2004

An Example of OSD Storage Architecture

50

COPYRIGHTED 2004

Section 4
1. 2. 3. 4. Storage Virtualization IP Storage Other Emerging Technologies Review Questions

51

COPYRIGHTED 2004

Review Questions
How does SAN leverage on the existing LAN? What is FC/IP and how is it different from iFCP? How does iSCSI work? Explain the Infiniband Architecture and its benefits.

52

COPYRIGHTED 2004

References
IBM Enterprise Solutions Handbook IP Storage Forum White Paper http://www.snia.org Delivering Storage Solutions over IP Networks, SNIA IP Storage Forum Presentation Clearing the Confusion: A Primer On Internet Protocol Storage Networks, SNIA IP Storage Tutorial http://www.dothill.com

http://www.dell.com/R&D
http://www.techtarget.com http://www.seneschal.net.com http://www.sysopt.earthweb.com/articles/infiniband http://business.vsnl.com/spacemagnum http://www.snwonline.com http://www.intel.com/labs/storage COPYRIGHTED 2004
53