Federated Tiered

Storage Deep
Dive

Copyright 2012 EMC Corporation. All rights

Download this slide

http://ouo.io/hhqO7c

Agenda
FTS Overview

Benefits
Positioning
New Terminology
Architecture

Design Considerations
Modes of Operation
Feature Support
Director and Zoning considerations

Miscellaneous

Copyright 2012 EMC Corporation. All rights

What is Federated Tiered Storage

(FTS)?

New, and free, feature in Enginuity 5876 in VMAX 20K and

VMAX 40K arrays
Provides an alternative FAST tier
Offers Virtual Provisioning benefits to external arrays
Allows data mobility and migration between heterogeneous
storage arrays
Extends the value of existing, aging disk arrays
Simplifies management of multi-vendor storage arrays
Allows management using Solutions Enabler and Unisphere
for VMAX
Copyright 2012 EMC Corporation. All rights

When to Position FTS or VPLEX?

Copyright 2012 EMC Corporation. All rights

Terminology: Internal Disks and eDisks

Internal
disk 1

Hyper 1
Hyper 2

Hyper 1

Internal
disk 2

Volume
(RAID 0)

Volume
(RAID 1)

Hyper 2
Hyper

External
Array
RAID 5
LUN

Hyper 1

eDisk

Unprotected
Volume

Hyper 2
Hyper

Unprotected
Volume

VMAX 20K or VMAX 40K

Copyright 2012 EMC Corporation. All rights

Terminology: Disk eXternal (DX)

Emulation

7E0, 7E1

8E0, 8E1

VMAX 40K Engine

DX Director Pair

Adapts the traditional DA

DAs connect to internal
operations
Symmetrix

DXs connect
disksto

external
LUNs
Added
and
removed in
Ensures that the LUN ownership is balanced across peer
pairs

directors
Configured on the same slice across directors within an engine
(i.e. 7E and 8E)

Copyright 2012 EMC Corporation. All rights

FTS Big Picture

2 - Configure Physical and Logical
connectivity (DX ports to Array
ports)
LUN(s)
3 - Present LUN(s) to DX
ports

Host

External Array

6 -Present Volume(s) to
Host

DX
Ports

FA
Ports

FF

FF

FD

FD

AA

AA

AX

AX

Volume(s)

VMAX 20K or VMAX 40K

5 - Create Symmetrix Volume(s)

Copyright 2012 EMC Corporation. All rights

4 - Create
eDisk(s)

1 - Configure DX
pair(s)

FTS I/O Operations

VMA
X
Cac
he

Writ
e
Ack

Volu
me

eDi
sk

LU
N

VMAX 20K or
VMAX 40K

Copyright 2012 EMC Corporation. All rights

FTS Data Protection

External
Array with
RAID
protection

Ho
st

DX
Ports

FA
Ports

T10
DIF

FTS
CRC

Global Memory
VMAX 20K or VMAX 40K

Copyright 2012 EMC Corporation. All rights

Geometry Limited Encapsulation

Geometry Limited Encapsulated eDisk (Thick and Thin)
Encapsulated volume where its Symmetrix Cylinder size is larger than the
reported user defined geometry size
Symmetrix size (sum of all prime cylinders of its associated logical
volumes) is different than its read capacity (SCSI capacity reported in
blocks) - then your LUN is geometry limited.

Copyright 2012 EMC Corporation. All rights

11

FTS Architecture

Copyright 2012 EMC Corporation. All rights

12

Two Modes of
Operation
Externally
Provisioned

Repurpose external storage

Used in a FAST Tier with FAST VP
Integrate with enterprise features
Deletes data on LUN when adding as
eDisk

Copyright 2012 EMC Corporation. All rights

Encapsulated

Externally Provisioned eDisks

LUN
LUN

FA Ports

Standard
Vol(s)
Standard Provisioned

DX
Ports
External
Disk Group

eDisk

eD
isk

Thin Pool

Thin
Virtual Provisioned

Copyright 2012 EMC Corporation. All rights

Data
Vol

Data
Vol
Data
Vol

External
Disk Group

eDisk

eD
isk

Externally Provisioned eDisks with

FAST VP
LUN
LUN

FA Ports

DX Ports

Thin Pool

Data
Vol
Virtual Provisioned

Data
Vol
Data
Vol

FAST Policy

Tier 1 = EFD Tier

Tier 2 = SATA Tier
Tier 3 = FTS Tier

Copyright 2012 EMC Corporation. All rights

FTS Pool

External
Disk Group

eDisk

eD
isk

FTS Tier
MUST be the lowest
FAST VP
Tier

Encapsulated eDisks: Standard Provisioned Volumes

50
GB

500
GB

500
GB
Meta
Vol

Stand
ard
Volu
me

240
GB
240
GB
20
GB

Copyright 2012 EMC Corporation. All rights

eDi
sk
eDi
sk

Encapsulated eDisks: Virtual Provisioned Volumes

LU
N

FA Ports

Thin
Virtual Provisioned

Copyright 2012 EMC Corporation. All rights

DX
Ports

Thin Pool

External
Disk Group

Data
Vol

eDisk

FTS Feature S upport: TimeFinder

TF/Snap

TF/VP Snap

TF/Clone

Externally Provisioned
Encapsulated Non-Geometry
Limited
Encapsulated Geometry Limited
*= Partial support

Copyright 2012 EMC Corporation. All rights

*
*

FTS Feature Support: SRDF

Type of eDisk
SRDF/

Externally
Provisioned and
Encapsulated
Encapsulated
Geometry Limited

ype of
eDisk
Externally Provisioned and
Encapsulated
Encapsulated Geometry Limited
Copyright 2012 EMC Corporation. All rights

SRDF/S and

Only used as R1
volumes Only supported for
migrations Meta volumes
Number of Meta
members o and R2 must
equal

Cylinder size
must be the s
each meta member

SRDF/S
SRDF/AR TAR
T
(SAR)

n both R1
ame for

FTS Feature S upport: ORS, RP, and FLM

Open
Replicator
(ORS)

Recover
Point
(RP)

Externally Provisioned
Encapsulated NonGeometry Limited
Encapsulated Geometry
Limited
* = Partial support

Copyright 2012 EMC Corporation. All rights

Federated
Live
Migration
(FLM)

FTS Feature S upport:

Others
Limits
Data pools

Cannot have both FTS and non-FTS data volumes

Zero-space Reclamation

Supported only on volumes created from Externally

Provisioned eDisks
Volumes on Encapsulated eDisks cannot be used with
zero- space reclamation

FAST (Full Volume

Movements)

FAST is not supported with FTS

FAST VP is supported with Externally Provisioned thin volumes

Copyright 2012 EMC Corporation. All rights

 Copyright 2012 EMC Corporation. All rights reserved.

21

FTS Key Limits

Planning & Design Considerations
Back-end Connectivity
Maximum # of eDisks per DX
director pair
Maximum # of eDisks per system
Maximum # of LUNs/eDisks per DX
port
Maximum eDisk Capacity or LUN
size
Maximum number of external disk
groups
FAST VP Support
FAST Tiers per Policy
Disk Encryption

Copyright 2012 EMC Corporation. All rights

FC 8Gb/s or less; 4 paths to eDisks required

16,000
128,000
8,000
60 TB
14,000
Only supported with Externally Provisioned
storage
Only one FTS tier per FAST policy supported
Data at Rest Encryption is not supported

Key
Takeaways
Always check the support matrix for supported External
arrays

To position FTS appropriately recall there are two modes

(encapsulation and externally provisioned).
Each
mode provides different capabilities with different
constraints.
Be aware and careful of potential geometry limited
constraints with encapsulation.
The VMAX only has visibility to basic status information of
the FTS connected external array.
The external array
still needs to be managed, provisioned, tuned and
monitored separately.
Always first understand the business requirements to
determine if FTS is most appropriate recommendation.
Copyright 2012 EMC Corporation. All rights

24

References
Course Title: Symmetrix Federated Tiered Storage Design
and Deployment
Course Title: Symmetrix Federated Tiered Storage Monitoring
and Troubleshooting
Design and Implementation Best Practices for EMC
Symmetrix Federated Tiered Storage (FTS) Technical
Notes P/N 300-014-165
Simple Support Matrix for Federated Tiered Storage
EduTube

Copyright 2012 EMC Corporation. All rights

25

 Copyright 2012 EMC Corporation. All rights reserved.

26

Miscellaneous

Copyright 2012 EMC Corporation. All rights

28

Zoning for a Single Fabric

Zone each DX port to each external storage port for
maximum redundancy

Copyright 2012 EMC Corporation. All rights

29

Dual Fabric Zoning and

Mapping
The DX ports from a director must be split between
the two fabrics

Map all external LUNs to all available ports

Copyright 2012 EMC Corporation. All rights

30

FTS FAQ
1.
If we propose using the external array for
should
we VP
encourage
additional
space, Raid-6 to avoid potential DL if
external array drive fails but takes down our VP as
The
same best practices that we employ for our arrays
well?
and those
provided by the 3rd Party vendors to avoid DL events,
should be
applied to the external array. From the VMAX
management interfaces
(SymCLI
2.
Will
FTS work with
RecoverPoint
(VMAX virtual
or Unisphere
for VMAX)
an unprotected
Yes,
splitter)
FTS
islike
supported
SRDF? with RecoverPoint CRR and CDP.
RAID
group
New
5876,
gets with
created
for each eDisk that gets added to the
the
RecoverPoint
system.
The RAIDsplitter resides natively within the
VMAX
group system.
is unprotected because eDisks rely on the
Some
restrictions
apply if the volumes at target are to
protection
provided
land
onexternal
externalarray.
by the
luns that are geometry limited. Please reference
FTS training materials.
Copyright 2012 EMC Corporation. All rights

FTS FAQ
3.
What is the effect of the loss of the external array.
vault
in any
circumstance? Extending VP with a lower
Will the
VMAX
availability array will lower the overall availability of the
The
I/O would have to fail because the Symm Devices would
solution.
go Not Ready if
their underlying storage were not available. Devices should
be protected in the some manner no different than we
protect our S ymmetrix volumes. A
failure in the FTS pool is not any different from a double
drive failure taking an EFD or FC pool down (less likely in
SATA because hopefully everyone is using RAID 6). All
devices
that
in that
pool
will suffer on
data
4.
Doeshad
FTSdata
support
thin
provisioning
unavailability
andispossible
data
If external
an external
arrays?
lun
presented
to loss.
FTS, the lun will be fully
All
edisk to
are
expanded
itsconsidered Raid 0 (unprotected) from the VMAX
perspective
with the FTS lun initialization process. Thin
maximum size
the
protection is considered to be the responsibility
LUNRAID
management
of
to the
the external
front endarray.
hosts will be handled by the VMAX. FTS does
not have the
capability to communicate with the management functions of
the remote

Copyright 2012 EMC Corporation. All rights

FTS FAQ
5.What is the maximum external capacity supported as
Maximum
compared
capacity
to HDS?is determined by VMAX 20K and
VMAX
6.My40K
understanding
cache.
is that Encapsulation does not perform
checksum. Only
Provisioning has checksum capability. Is that true, or do both
have the checksum capability?
Both Externally Provisioned and Encapsulated volumes have
checksums. Checksums
will take place once the lun is under VMAX 20/40K control and
any I/O activity is
generated
to theany
lun.documentation
CRC information
is saved
the Symmetrix
7.Do we have
or slides
outinthere
that discuss
with
edisks
when utilized with VP, additional hops between the
cache.
This
CRC
the I/O
flows
arrays, I/Oismisses,
information
then checked upon subsequent reads to confirm
etcthe
- basically
that
externalwhat
LUN are the areas of performance concern when
The
I/O flow
is the
as it would be with any other I/O to an
using
edisks
in same
has
not been
altered
outside of Symmetrix control.
internal
The change is that read misses or backend write
certaindisk.
use cases?
operations, instead of going through a DA to access the back end
physical drives, the I/O would go through a DX port,
through the SAN to the external array, and then back.

Copyright 2012 EMC Corporation. All rights

FTS FAQ
8.
Does FTS enable mainframe access
No.
to FTS
VNX does
etc? not support CKD volumes at
this
9. time.
Will this work on
VG2/VG8
data? in
Not
at this point
time.
10. I saw in a presentation that FTS are
mean
that we
can have 100TB eDisks
free - does
that
without additional
FTS
itself
is free. Enginuity and Management
cost
for customer?
S W titles will NOT incur charges associated
with the external FTS
capacity. The only titles where FTS capacity
tier charges
apply include:
VMAX 20K SRDF/S, SRDF/A,SRDF/Star,
TF/Clone,
TF/Snap, Advanced FAST S uite, Advanced

Copyright 2012 EMC Corporation. All rights

FTS Initial Array Integration

Arrays that can enable the FTS
feature
Symmetrix
VMAX
20K
or 40K with
Arrays
qualified
for
Externally
Enginuity 5876
Provisioned
Encapsulated
and
Symmetrix DMX
CLARiiON CX
VNX

Third party Arrays qualified for

Encapsulation only
HDS USPV/ XP9990v
HDS VS P/
P9500

Copyright 2012 EMC Corporation. All rights