You are on page 1of 27

EMC Celerra File Server

Product Description Guide


EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

EMC Celerra File Server Product Description Guide


Table of Contents
2 Table of Figures
2 Tables
3 Chapter 1. Network Attached Storage from EMC
3 Introducing EMC Celerra File Server
3 What is Network Attached Storage?
4 Overview of Celerra File Server
4 Meeting the Information Sharing Challenge with The EMC Effect
5 Celerra File Server and The EMC Effect
7 Chapter 2. EMC Celerra File Server: Product Overview and Benefits
7 General-purpose Servers and Their Limitations
8 The Celerra File Server Solution: EMC Network Attached Storage
8 Data Movers: Channels between Data and the Network
9 Control Station: Data Mover Management Administration Interfaces
9 Cluster Processing and Data Movers
11 System Administration and Ease of Use
11 Celerra File Server Benefits
11 Availability
13 Configurable Failover Levels
14 Non-volatile Power Systems
15 Scalability
16 Performance
17 Chapter 3. Hardware and Software Elements of Celerra File Server
17 Synergistic Systems
17 Reduced-footprint Option
18 Software
18 Hardware
19 Comparison of Protocols
19 Network Management and Security
19 Control Station Software
20 User Configuration Options
20 Server Management
20 Command Line Interface
21 Celerra File Server Manager
22 Backup and Restore
22 Automated Network Backup and Restore
24 Automated Local Backup and Restore
25 Using TimeFinder/FS for Backup and Restore
26 Using SRDF for Disaster Recovery
28 Celerra File Server Configuration
28 NFS-only Environment Configurations
29 CIFS-only Environment Configurations
29 Combined NFS/CIFS Environments
30 Celerra File Server File Security Architecture
30 Authentication

1
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

30 File Locking Chapter 1


31 Opportunistic Locks (oplocks)
31 Access Checking Policy
Network Attached Storage from EMC
32 Chapter 4. Enterprise Functionality
32 Hardware and Software Specifications
Introducing EMC EMC solutions offer choice and flexibility for today’s integrated IT requirements and scalability for
34 Chapter 5. EMC Enterprise Storage Network Celerra File Server information system growth. The EMC® Celerra™ File Server combines EMC’s industry-leading
34 Celerra File Server (NAS) and Fibre Channel Solutions storage technology with a unique software and hardware approach to deliver unprecedented levels
35 Infrastructure Consolidation of high availability, scalability, and performance to meet the sharing and access needs of network
37 Chapter 6. EMC Services and Support file systems.
37 EMC Professional Services
37 Overview of Professional Services Capabilities The Celerra File Server leverages EMC’s I/O design heritage and provides dedicated, special-
37 Best Practices for Best Results purpose file server software, highly optimized for moving data. This dedicated file server for
37 Implementation Options enterprise data networks eliminates I/O performance bottlenecks associated with general-purpose
file servers and relieves traditional network servers of file service tasks, allowing them to handle
38 Customer Service
other server applications, such as database, CAD/CAM, mail, etc. Celerra File Server solves
39 EMC Customer Service
availability and scalability problems for environments that share information over IP networks.
40 Glossary of Terms

What is Network Network Attached Storage (NAS) consolidates distributed data into a large, centralized data pool
Table of Figures
Attached Storage? accessible to, and shared by, heterogeneous clients and application severs across the network. To
3 Figure 1. Network Attached Storage (NAS) Topology
improve performance and provide uninterrupted access, network attached storage uses a
7 Figure 2. Distributed Storage System
dedicated, specialized operating system for network file access. The operating system supports
9 Figure 3. Celerra File Server Hardware
standard file access and network protocols. Figure 1 shows the topology of the network attached
10 Figure 4. Celerra DART Operating System Software
storage environment.
13 Figure 5. Relationship Between Primary and Standby Data Movers
17 Figure 6. Celerra Cabinet NFS or CIFS
Client
18 Figure 7. WebNFS, NFS, and CIFS Software
19 Figure 8. Celerra File Server Architecture NFS or CIFS
Client
21 Figure 9. Browser-based Celerra Manager
23 Figure 10. Automated Network Backup and Restore
General
24 Figure 11. Automated Local Backup and Restore Purpose
25 Figure 12. TimeFinder/FS: Copying Files and File Systems into BCVs Server
(redeployed) LAN/WAN
27 Figure 13. Celerra Disaster Recovery Using SRDF Network
Exchange NFS or CIFS
28 Figure 14. Typical NFS User Configuration Internet Client
29 Figure 15. Typical CIFS User Configuration Applications
Network Attached Server
29 Figure 16. Typical Mixed NFS/CIFS User Configuration
34 Figure 17. Consolidation with Celerra
35 Figure 18. ESN: Consolidation with Celerra and Connectrix
36 Figure 19. Extending the Reach of Connectrix
36 Figure 20. Leveraging Celerra and Symmetrix

Tables
Figure 1. Network Attached Storage (NAS) Topology
4 Table 1. Network and Direct Attached Storage
5 Table 2. Celerra-based Network File Sharing Applications Network attached storage provides an efficient, cost-effective solution for business environments
20 Table 3. Comparison of Protocols that depend on accessing and sharing large amounts of file system data. Data consolidation reduces
22 Table 4. Celerra Manager Components and Options administrative requirements and management costs. Centralized network file server and storage
environments — including hardware and software — ensure reliable access and high availability of
26 Table 5. Backup and Restore Options Using TimeFinder/FS
data. NAS environments typically provide a combination of robust server performance, redun-
30 Table 6. File Locking Comparison
dancy, speedy reboots, and non-disruptive failover protection. Table 1 compares network attached
35 Table 7. Complementary Aspects of Celerra and Connectrix storage to direct attached storage.

2 3
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Table 2 shows typical industries and applications that benefit from the Celerra File Server’s capabilities.
Network Attached Storage (NAS) Direct Attached Storage (DAS)

Network file access with centralized Access to data only through the host Industry Applications
management of file systems
Internet business/electronic • Web pages
commerce • Electronic mail
Clients can share file systems and view Each host manages its own file systems
• Software development, testing, and simulations
concurrent shared data without sharing data with other hosts

Windows NT consolidation of • Office automation


Dedicated file server plus storage provides Storage provides high availability of data to
client storage • Customer service
high availability of data to the network the host
• Decision support

Table 1. Network and Direct Attached Storage.


Telecommunications • Software development and testing
• Internet support
NAS addresses particular business needs, such as when organizations tend to experience rapid
• Customer service
growth leading to scalability problems. Or when uncontrolled collaborative work environments
limit availability, increase system management costs, and reduce backup and recovery capabilities.
Finance and banking • Decision support systems
NAS provides centralized network file access and sharing to resolve these problems. NAS
• Trading
represents a critical component of data storage consolidation and enterprise computing.
• Software development
• Forecasting modeling and simulations
Overview of The Celerra File Server, a specialized network attached storage system, offers industry-leading
Celerra File Server availability and performance; non-disruptive capacity scaling; and flexible network connections. Software development • Code management
Celerra protects the storage investment and improves backup/restore and disaster recovery • R&D simulations and modeling
facilities. Organizations can redeploy resources through consolidation and realize a lower
total cost of ownership, thereby solidifying the IT infrastructure and protecting the Manufacturing • CAD/CAM
computing investment. • CAE
• ECAD
• Software development
Meeting the Information EMC combines its industry-leading Symmetrix® Enterprise Storage technology with a unique
Sharing Challenge software and hardware approach that delivers unprecedented levels of availability, scalability,
Table 2. Celerra-based Network File Sharing Applications
with The EMC Effect management, and performance to network file storage. In developing the Celerra File Server — a
dedicated network file server that runs software optimized for moving data — EMC leveraged its
In addition, organizations with dominant Windows NT and UNIX platforms can use Celerra File
I/O system design heritage and created a breakthrough solution that addressed long-standing
Server to add value and benefit while shifting to enterprise resource planning (ERP) for network
performance bottlenecks associated with file servers based on general-purpose operating systems.
and/or server consolidation.

The EMC Celerra File Server operates over local networks (including 10/100BaseT, ATM, FDDI,
and Gigabit Ethernet) and wide area networks (including the Internet). Multi-protocol NFS and Celerra File Server The EMC Effect™ associated with Celerra File Server brings significant financial, operational, and
CIFS file access capabilities allow a single Celerra system to simultaneously support mixed UNIX® and The EMC Effect business impacts to the enterprise.
and Windows NT environments, with concurrent access to shared data.
®
• The financial impact of consolidating network servers lowers operating and maintenance costs.
One centralized network attached storage system needs fewer people controlling it instead of the
Consolidating data from numerous and scattered UNIX and NT servers onto a reliable Celerra many individuals required to manage dozens of distributed file servers. Ongoing operating and
platform produces significant advantages: Less overhead. Simplified management. High maintenance costs for multiple systems typically exceeds the original cost of distributed file servers.
availability. Ability to upgrade servers when necessary while avoiding data migrations. Celerra’s Plus, EMC’s extensible architecture takes advantage of evolving industry-standard hardware
support of both NFS and CIFS protocols gives both UNIX and NT clients the ability to share the technology, further protecting the investment. EMC’s extensive hardware and software warranties
same files using appropriate locking mechanisms. lower the total cost of ownership and include 24x7 protection.

The Celerra File Server:

– Handles peak workloads of thousands of Network File System (NFS) and Common Internet
File System (CIFS) clients concurrently.

– Allows system administrators to increase capacity and performance as requirements grow.

– Scales non-disruptively to multiple terabytes of disk capacity within the same footprint.

4 5
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

– Reduces the need for local, compartmentalized storage by offering a consolidated network file Chapter 2
server that extends storage capacity while lowering cost.
EMC Celerra File Server:
– Enables increased network data storage requirements without changing the underlying IT
infrastructure.
Product Overview and Benefits
– Allows departments to leverage current capital investments in host computers.

– Adds efficiency to standard data access tasks. EMC Celerra File Server includes Symmetrix storage in a network attached device that delivers
network storage with optimal availability, broad scalability, and high performance to meet enter-
prise file sharing needs.
• The operational impact of Celerra File Server improves data availability, increases overall
productivity, and promotes cost avoidance. Enhanced connectivity and file sharing eliminate data
duplication and time-consuming resynchronization efforts. Because Celerra supports multiple General-purpose Servers Traditionally, file servers operated as general-purpose systems running multi-user applications
heterogeneous clients simultaneously, customers can share files between platforms to optimize use and Their Limitations alongside file services. Usually deployed in distributed storage environments, general-purpose
of data. And, reallocating storage demand between network user groups allows managers to servers lacked the capability to efficiently access, transfer, and manage large quantities of file
address the variable application needs of both Windows and UNIX environments. The Celerra File system data. Users in data-critical environments in particular experienced the limitations of
Server encourages a long, useful life for storage assets, minimizes planned and unplanned general-purpose servers, with server overloading inhibiting high, predictable data throughput.
downtime, and allows redeployment of general-purpose servers (e.g., database engines,
application servers, print servers). Figure 2 illustrates the topology of a distributed storage environment.

The Celerra File Server:

– Combines with a Symmetrix system to manage storage, consolidate departmental servers,


simplify data access, and improve security.

– Promotes secondary uses for data, thereby enhancing productivity and business continuity.

– Allows administrators to concentrate on critical tasks without the need to fine tune the server’s
performance.

– Improves file system performance and increases throughput from application servers.

• The business impact of Celerra File Server “closes the information gap,” giving end users the data
they need when and where they need it, regardless of distance. Celerra allows managers to react
quickly to market changes and enables the enterprise to deliver improved customer service. With
Celerra as the cornerstone of enterprise-wide file sharing, organizations can reduce R&D
development cycles, gain market share, generate additional revenue, and reach the market before
the competition.

The Celerra File Server: Figure 2. Distributed Storage System


– Delivers high levels of availability and scalability.
The advent of the Internet, along with the data explosion of the 1980s and 1990s, intensified
– Offers performance and high-speed reaction to market changes.
requirements to expand capacity and resulted in complex, expensive, and difficult-to-manage
– Optimizes network file sharing capabilities between UNIX and NT platforms. distributed storage environments. Market research shows that users can spend up to eight times
the cost of server and storage hardware to manage increasingly complex storage environments.
– Allows client storage consolidation of large-scale UNIX and NT environments onto a single
storage platform.

– Enables more work in less time, more customers served, more applications run, and more
business opportunities exploited.

6 7
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

The Celerra File Server EMC’s Celerra File Server enables sharing of files over networks and provides transparent access to Control Station: The Celerra Control Station manages configuration and management of the Data Movers with
Solution: EMC Network the same files by UNIX (NFS) and Windows NT (CIFS) clients. Celerra offers superior capacity up Data Mover Management familiar system administration interfaces. Administrators can access the Control Station directly
Attached Storage to 28TB (raw), industry-leading availability and performance, and: Administration Interfaces from the Celerra console, via Telnet, or via a GUI and a Web browser. The Control Station also
supports a MIB II interface for integration with commonly used management packages such as
• Uncompromised protection of enterprise data.
Tivoli®, and HP® OpenView®.
• Continuous data availability with fast failover and reboots.

• High and predictable data throughput that can handle I/O-intensive network applications and
reduce server overloading.

• Investment protection that accommodates frequent advances in technology and changes in


application requirements.

• Low total cost of ownership over the useful life of computer systems.

Data Movers: The Celerra File Server cabinet contains a cluster of up to 14 independent Data Movers that
Data Movers
Channels between operate as autonomous dedicated file servers, establishing highly efficient channels between the
Data and the Network data and the network. Data Movers enable concurrent access to file systems by heterogeneous
network clients using multiple network technologies (including Ethernet, Gigabit Ethernet, FDDI,
and ATM). Celerra supports industry-standard Network File System (NFS), Common Internet File
Systems (CIFS), FTP, and WebNFS protocols.
Control Stations

Power Supplies

Figure 3. Celerra File Server Hardware

The hardware architecture of Celerra File Server (Figure 3) includes four backplanes, each with the
capacity of four hardware slots. The lower left slot is reserved for the Control Station. A second
(e.g., redundant) Control Station can use the lower right slot to support non-disruptive Control
Station failover. (Data Mover failover does not require redundant Control Stations.) The remaining
14 hardware slots are for Data Movers, each composed of an Intel®-based motherboard, PCI bus,
network cards, SCSI cards, and/or fibre connections. The minimum configuration provides two Data
Movers. Data Movers can be added to increase capacity and performance as environments grow.

Cluster Processing A group of independent systems working together as a single system (e.g., cluster) appears to
and Data Movers system managers as a single high-performance, highly available server. Cluster configurations
ensure availability and scalability in business-critical computing applications.

Clustering assumes many forms in delivering scalability and high performance. Adding another
server, for example, provides additional processing power to handle more complex, or a greater
number of, requests from clients. Clustered servers assume the workload of a failed server without
impacting client or network performance.

8 9
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

The fine granularity and the autonomous nature of the servers in the Celerra cluster — the Data System Administration The Control Station performs Celerra’s system configuration and administrative functions and
Movers — provide superior fault isolation and containment. Their unique design isolates and and Ease of Use offers three types of management interface:
limits the impact of failures to individual Data Movers, allows for seamless Data Mover failover
• Local management using a UNIX-like command line interface.
and replacement, and permits near-linear scaling of performance by achieving parallelism across
Data Movers. Data Movers mount and export file systems and respond to client requests for data • Remote management using a Web-based graphical user interface (GUI).
access. In addition, the diskless Data Movers and Control Stations maintain a database of all infor- • Over the network by using either SNMP MIB II management or Telnet.
mation pertaining to their configurations, the file systems mounted by them, and file locks on the
highly reliable and available Symmetrix storage systems.
For additional information, see the Network Management and Server Management sections in
Chapter 3.
Celerra DART The Data Movers run Data Access in Real Time (DART), an optimized, embedded operating
Operating System Software system designed exclusively for high-performance network file access with multi-protocol support.
Celerra File As a high-capacity network attached storage system, Celerra File Server delivers availability,
This realtime, multi-threaded operating system ensures highly optimized network file access, as
Server Benefits scalability, and high-performance file services.
illustrated in Figure 4.

Availability The high-availability architecture of Celerra delivers simple, robust failover with minimal
performance impact. A Data Mover failure prompts a cluster software response and the transfer of
tasks from the failed server to one of the standby servers in the cluster.
NFS CIFS
Traffic (SMB) Traffic
Note: See the Failover section in this chapter for a description of the failover process.
Network
Layer The Celerra File Server ensures high data availability and virtually non-stop file access by combining
NFS CIFS Celerra File Server technology with EMC’s powerful Symmetrix Enterprise Storage system.

Multiprotocol
Support Redundant power supplies, redundant fans, environmental control, single-system management
File System umbrella (e.g., setup, configuration, installation, and administration from a single, optionally
Storage Layer
redundant point of control), and reduced footprint packaging give Celerra’s Data Movers
SCSI Fibre extensive reliability and availability. Specifically, Celerra creates high-availability through
redundancy, failover, information protection with TimeFinder/FS for mirroring, remote
Symmetrix diagnostics and maintenance, and disaster recovery.
Enterprise
Storage
System
Celerra’s flexible failover configurations include a full set of critical components:

Figure 4. Celerra DART Operating System Software • Redundant data paths within the Symmetrix

• Redundant connection paths between the Symmetrix and the Data Movers (Fibre Channel and
DART separates control and data paths, enables high throughput rates, maintains responsiveness
SCSI)
to user requests and enhances data availability. Its intelligent scheduling algorithms maintain
sustained throughput under increasing loads and avoid throughput degradation, even under • Standby Data Movers (customer configurable)
overload conditions. • Redundant Control Stations (optional)

• At least two internal network paths on each Data Mover and Control Station
DART’s transaction-based file system, UxFS, maintains a log of all the file system metadata
changes. In the event of a failure and reboot, only the log needs recovery through a short, constant- • Load-sharing power supplies (n + 1)
duration operation, independent of the number of file systems and the amount of storage involved,
• On-board battery backup
eliminating the need to use fscheck in the majority of cases.
• Dual AC power lines
Note: Celerra’s metadata logging typically handles reboot recovery in minutes. General-purpose
computers without metadata logging can require hours for rebooting and file system checking.

Write gathering, a DART optimization feature, contributes to Celerra’s superior write perfor-
mance. Additional write performance improvements include the non-volatile Symmetrix system,
which uses batteries to protect cache from power loss and prevent corruption. As required by NFS,
Symmetrix provides synchronous data writes (and asynchronous destaging) to disk before
acknowledging writes to clients.

10 11
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Redundancy Celerra File Server ensures continuous data availability by creating multiple data access paths
throughout the system, from the disk drives to the network. In addition, the Celerra cabinet
MAC and IP addresses
provides redundancy of all critical components, ensuring high availability of data on the network.
File
System
File
System
{ are stored on Symmetrix }
Dual data paths throughout the file server eliminate single points of failure, protect data, and
promote data availability. Celerra offers:
Data Mover Data Mover
• Redundant Network Interface Cards (NICs) per Data Mover that provide multiple access paths to "Primary" "Standby"
the network and maintain high availability in the event of a network card failure.

• Dual connections between the Data Movers and the Control Station that handle internal commu-
nications.
LAN/WAN
Network
• The Celerra Fibre Channel driver uses the dual-port Emulex adapter to support 256 devices per
controller port. EMC has tested and qualified this driver with Connectrix and Brocade switches.

• Dual SCSI connections between Symmetrix and each Data Mover that support load-balancing.

• Ethernet Trunking helps Celerra maintain high availability because other ports assume the load if
one port fails. Ethernet Trunking combines up to four Ethernet ports into a single logical device.
Trunking-capable switches handle statistical load balancing by connecting different clients to Client Client Client

different ports. Ethernet Trunking provides higher aggregate throughput for a single IP address and
Figure 5. Relationship Between Primary and Standby Data Movers
avoids any increase in single-client throughput (subject to limitations on the overall aggregate
throughput per Data Mover).
To achieve this level of availability, two redundant internal networks connect the Control Station
and all the Data Movers in the Celerra cabinet. The Control Station continuously monitors the
In addition, health and status of the Data Movers. When the Control Station detects a failure, it powers down
the failed Data Mover and notifies the spare. The diskless Data Movers can see all Symmetrix
• Standby Data Movers ensure virtually uninterrupted access to data through automatic and quick
disks, allowing the spare Data Mover to assume control of the failed Data Mover’s files and
failover support in the event of a Data Mover failure.
configuration information.
• Independent Data Mover/Control Station Architecture makes Data Mover operations independent
of the Control Station (except during configuration or failover). Control Station failure impacts The standby Data Mover assumes the IP and MAC addresses, the interface host names, and all
only installation and management features in single Control Station configurations and does not information about the configuration and file systems of the failed Data Mover. Client service
impact users’ continued access to data. continues. The standby Data Mover transparently resumes NFS services to clients, with no
• Online file system duplication allows creation of multiple file system copies for other business uses. requirement to unmount and remount the file system (Figure 5).

• Advanced Volume Management offers hyper volumes, meta volumes, slicing, and striping.
Note:
• Dual internal Ethernet provides control and management with redundant load-sharing power sup-
• Once configured, failover operates automatically and requires no intervention.
plies, battery backup, environmental controls, Auto-Call remote maintenance parameter
monitoring, and redundant critical components. • Failover appears transparent to NFS clients but not to CIFS clients*.

• Warranty includes one year for hardware, 90-day warranty for software with 7-day-a-week, • The standby Data Mover is already booted; there is no need to wait for boot time.
24-hour coverage. • Failover does not degrade system throughput.
• Backup and proactive maintenance with full system battery backup and support for multiple
backup options, including the EMC Data Manager (EDM™) for network-based backup, and the A single standby Data Mover can act as standby for any number of primary Data Movers when it
industry-standard Network Data Management Protocol (NDMP) for local backup. connects to the same network as the primary Data Movers. Primary Data Movers located on
different networks, however, require configuration of multiple standbys.
Failover The Data Mover failover capability (configurable from manual to completely automatic) allows a
hot spare Data Mover to transparently take over from a failing Data Mover. This cost-effective In addition, Celerra offers scalable availability with high inherent redundancy, disaster recovery-
failover capability enhances data availability while maintaining performance and ease based solutions, and non-volatile power system solutions.
of management. Failover typically occurs in 20 seconds to four minutes, depending on
implementation factors. Configurable System configuration can include manual, automatic, or scripted failover, depending on the level of
Failover Levels availability required.

*You may need to restart some Windows applications or clients.

12 13
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Non-volatile A variety of non-volatile power systems ensures the uninterrupted operation of the Celerra File Server. Enhanced Data Availability The following features contribute to the enhanced data availability of the Celerra File Server and
Power Systems the Symmetrix:
N+1 Load Sharing Power Supplies. Sufficient capacity remains after a power supply failure so that
• Self-Diagnostic and Self-Reporting Capabilities: This includes EMC Call-Home and Call-In
the remaining power supplies can maintain full operation until the failed component receives a
support. EMC Call-Home support operates 24x7x365 and automatically alerts an EMC support
non-disruptive repair.
engineer that the system requires remote diagnostics. The Call-In feature allows the customer to
arrange non-intrusive repair.
Two Fully Redundant AC Power Lines. In the event that one AC input fails, the system
automatically utilizes the other input. Synchronization of the two AC inputs can originate from • Non-Disruptive Component Repair: Hot-swappable components reduce repair time and increase
entirely different sources (e.g., the utility provider grid and an onsite backup power generator). data availability. Field replaceable Symmetrix components include channel directors, disk
directors, head and disk assemblies, and cache memory cards. Celerra File Server components
Onboard Battery Backup creates non-volatile power systems for the cabinets. In event of power include individual Data Movers, the Control Station, power supplies, battery backup systems, fan
loss, battery backup systems supply adequate power to the Celerra File Server to facilitate an subsystems, and all Fibre Channel, SCSI, and power cables.
orderly shutdown.
Scalability Celerra File Server allows non-disruptive upgrades within the same system footprint. This seamless and
Control Station Guard enables the Celerra File Server to provide seamless operation even during economical growth accommodates changing network storage, performance, and connectivity needs
rebooting, upgrading, or unavailability of the Control Station. Used only to configure and manage with no loss of service to clients. The clustering capabilities of Celerra File Server allow customers to
the Celerra environment, the Control Station remains completely independent of file system add incremental servers and meet overall processing power requirements without changing the
operations and services provided by the Data Movers. Clients can continue data transfer between underlying IT storage infrastructure. Once installed, the Celerra File Server software provides the
the network and the Symmetrix even after a Control Station failure. capability to dynamically grow file systems without offloading/reloading or copying data.

Note: A Control Station failure may temporarily delay new software installation or modification of Celerra scalability eliminates the need for multiple low-end systems or implementation of “forklift
the Celerra File Server configuration. Control Station unavailability also disables Data Mover upgrades” to achieve high-level system functionality. Alternatively, users of single-system servers
failover. These operations can resume as soon as the Control Station becomes available. A must choose an expensive expansion solution that requires a commitment to high-end servers for
secondary Control Station can issue any Celerra File Server commands via the command line or the additional CPUs, drives, and memory.
Celerra File Server Manager after a failure of the primary Control Station. A failure also initiates
the Call-Home utility that notifies EMC Customer Service of the event. Under normal Celerra favorably impacts the total cost of ownership (TCO) by accommodating up to 14 Data
circumstances, after repairing or replacing the primary Control Station, the secondary Control Movers without the expense of purchasing additional cabinetry. Management remains centralized
Station continues to monitor and control Celerra functions until the next reboot, either directly or for further cost savings. And, Celerra remains capable of redeploying resources to meet changing
as a result of a power down and restart cycle. business and operational needs.

TimeFinder/FS TimeFinder/FS, an implementation of EMC’s leading information protection software Celerra’s architecture gives system administrators the capability to add Data Movers online and
TimeFinder , creates a point-in-time copy or a dynamic mirror of a file system. Integrated into the
™ scale the expanded system to achieve near-linear performance increases. Adding high-speed cache,
Celerra Control Station, the TimeFinder/FS option allows users to create file system copies (with channel paths, Data Movers, network connections, and disks permits seamless growth of enterprise
only a brief suspension of access to the original file system). These copies permit independent file systems while ensuring balanced high-performance to meet increased client storage demands.
non-disruptive file backups, “live copy” test beds for new applications, and mirror copies of files
for redundancy and business continuity, as well as: See Chapter 5, EMC Enterprise Storage Network, for information about direct connect hosts and
Celerra network connection to the same Symmetrix.
• Backup and restore of older versions of a specific file, directory, or complete file system.

• Mirroring and continuous updates of an active file system.

Note: File system copies require that the configuration of the Symmetrix system attached to the
Celerra File Server include business continuance volumes (BCVs). A BCV, which attaches to a
standard volume on which a file system resides, provides the foundation for the file system copy.
File systems can share BCVs, although the BCV remains dedicated to a volume.

14 15
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Connectivity Celerra supports numerous and heterogeneous network interfaces: 10/100BaseT, ATM, FDDI, Chapter 3
and Gigabit Ethernet. With each Data Mover containing two Network Interface Cards (NICs), a
fully configured system can provide one or a combination of the following options:
Hardware and Software Elements of Celerra File Server
• Up to 112 10/100BaseT connections

• Up to 28 FDDI connections

• Up to 14 ATM connections

• Up to 14 Gigabit Ethernet connections

Integration of Network Celerra File Server supports today’s industry standards including file access protocols, network
Interconnect Devices interfaces and protocols, and physical file system types (CIFS and NFS). It offers connectivity to
devices on the network through hubs, routers, or switches. Celerra provides transparent
communication to any system on the network, no matter which hub or switch connects the system
to the network.

Performance Celerra File Server is optimized for high-performance file sharing and takes advantage of the
Symmetrix system to achieve peak performance*. Robust amounts of cache (up to 16GB) enable Figure 6. Celerra Cabinet
Symmetrix to exceed the throughput and response time performance of conventional disk storage.
Symmetrix transfers data at electronic memory speeds, avoiding the dramatically slower speeds of Synergistic Systems The Celerra File Server and the Symmetrix Enterprise Storage system together deliver high-
physical disk devices. availability, scalability, performance, and capacity required for mission-critical applications. One
cabinet contains the Celerra File Server (with Data Movers, Control Stations, redundant
components, etc., Figure 6). The other cabinet contains EMC’s high-performance Symmetrix
Enterprise Storage system, designed for efficient online storage and retrieval.

Celerra provides network attached file server capabilities tuned and optimized for
high-performance file sharing and centralized data storage.

Reduced-footprint Option Customers may select an option that combines the Symmetrix system and Celerra File Server in a
single cabinet. This single-enclosure Celerra File Server contains up to four Data Movers and two
Control Stations, with a capacity of up to 1.6TB raw of network attached storage. This option
allows system administrators to reduce the Celerra’s footprint and minimize the space required
while maintaining the same level of availability and functionality.

*www.specbench.org contains information about Celerra’s industry-leading performance levels.

16 17
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Software The Data Movers and the Control Station attach to the Symmetrix using Fibre Channel and Ultra
INTERNET FWD SCSI.

Comparison of Protocols CIFS complements existing file access protocols (e.g., FTP and NFS) for networks with Microsoft
WebNFS
Windows users. Table 3 compares the three protocols.
CIFS NFS
FTP NFS CIFS
UXFS
Performs operations on Provides random access to Maintains connection state
entire files, providing bulk files and directories but on both server and client.
(not routine) data access. offers no synchronization
between client and server.
Similar in functionality to
CIFS, but NFS is stateless.
Storage
Table 3. Comparison of Protocols

Figure 7. WebNFS, NFS, and CIFS Software Network Management Both the Data Movers and the Control Stations support SNMP MIB II. This allows Celerra File
and Security Server network management from any SNMP-compliant application. Celerra also supports

Celerra core software components provide high-performance file services, high data availability, SNMP events and traps.

and easy-to-use management tools. The Celerra File Server, a multi-protocol network file server,
supports a variety of network connections and protocols (Figure 7). Celerra File Server supports Celerra File Server supports Domain Name System (DNS) and Network Information System

network protocols as peers in the DART operating system, avoiding the performance and scaling (NIS), with each Data Mover and the Control Station acting as a DNS and/or NIS client. This

problems often associated with emulations. These protocols include: support makes the Data Movers self-sufficient and able to perform name translation without
involving the Control Station.
• Common Internet File System (CIFS), an extension of Microsoft’s Server Message Block (SMB)
file-sharing protocol, allows users to share file systems over the Internet or any intranet. CIFS can Celerra File Server allows CIFS environments to interoperate with Windows NT; each Data Mover
share data because of enhancements to the native file-sharing protocol in Microsoft® Windows 95® can become part of a Windows NT domain and can support multiple domains. Celerra supports
and Windows NT operating systems. Microsoft’s Distributed File System (Dfs).
• Network File System (NFS), which provides distributed file services for transparent file sharing in
network environments. Native UNIX clients and network clients with NFS capabilities use the The Network Time Protocol (NTP) on the individual Data Movers provides accurate time
NFS protocol. synchronization and support. Figure 8 illustrates the Celerra File Server Architecture.

• Web Network File System (WebNFS), which allows users to access NFS-exported file systems
NETWORK PROTOCOLS
using Web browsers, Java applets, and the Internet. Data Mover Data Mover ETHERNET, ATM, FDDI, GB ETHERNET

Data Mover Data Mover


Memory

• File Transfer Protocol (FTP), implemented as an application-level program (based on the Data Mover Data Mover

Disk Disk Channel Channel Data Mover Data Mover NFS/CIFS DATA PROTOCOLS
OSI model), functions over Telnet and TCP protocols. FTP provides a high-level protocol for Adapter Director Director Adaptor
Data Mover Data Mover

transferring files from one machine to another. Disk


Adapter
Disk
Director
Channel
Director
Channel
Adaptor Data Mover Data Mover

Data Mover Data Mover


Control
Control Control LAN/WAN
Stations
Station Station
Management Network
The Celerra File Server supports the industry-standard Network File System (NFS v2 and v3) Disk Disk Channel Channel
Protocol
Adapter Bat. Bat.
Director Director Adaptor Chg
protocols over TCP/IP and UDP/IP. It supports the CIFS protocol and the FTP protocol over Chg

Disk Disk Channel Channel


Adapter Director Director Adaptor
TCP/IP. FTP also provides utilities that allow file transfer among heterogeneous systems. Battery

Symmetrix Celerra

Hardware Celerra core hardware components consist of Control Stations, Data Movers, power supplies, Figure 8. Celerra File Server Architecture
modem connection, communications boards, and battery backup units.

Control Station Software The Celerra File Server Control Station software provides the control system of the Celerra as well
Each Data Mover acts as a fully autonomous file server and operates independently from the as the management interface to all components. The Control Station runs an industry-standard
Control Station (except during configuration and failover). In the unlikely event of a Control operating system, used to install the Control Station software. Control Station software
Station failure, Celerra File Server maintains uninterrupted Data Mover connections to the also installs, manages, and configures the Data Movers, monitors the environmental conditions
external network and to the clients requesting data. and performance of all components, and implements Data Mover failover and the Call-Home
support feature.

18 19
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

The Control Station loads DART server software onto each Data Mover. DART server software Command Line Interface The command line interface allows users to enter approximately 45 Celerra File Server commands
manages high-speed transfer of file system data between the Symmetrix and the network clients. from a command prompt. A Celerra File Server prefix identifies each of these easy-to-use
After loading DART, Data Mover operations remain independent from those of the Control commands. The syntax of these commands resembles familiar UNIX commands. In addition, user
Station; a Control Station failure does not interrupt them. scripts can easily customize and enhance server administration run on the Control Station.

User Configuration Options Celerra commands and options allow users to configure file systems for access by NFS users, CIFS
CIFS Auditing CIFS Auditing maintains an audit log of server events (e.g., tree connect/disconnect, failed/
users, and both NFS and CIFS users. The Celerra File Server supports any clients with NFS or
succeeded file opens, share management events). With the same functionality as Windows NT
CIFS, including:
systems, CIFS Auditing allows system managers to view events from the Event Viewer of any
• Windows 95, Windows 98 Windows NT server.
Celerra File The Celerra Manager runs in a Web browser that supports Java applets and is accessible across
• Windows NT
Server Manager multiple user platforms (Figure 9). Users select a desired function and Celerra Manager builds the
• UNIX variants (SunOS, Solaris, HP-UX, etc.) proper command line.
• Windows clients with third-party NFS applications (PC-NFS, Maestro, Hummingbird)

Server Management Celerra File Server uses the Control Station running an industry-standard operating system to
perform system configuration and administrative functions. Users can access the password-
protected Control Station locally, using the monitor and keyboard in the front of the Celerra
cabinet, or remotely, using Telnet or a Web-based browser. Both interfaces allow users to perform
administrative tasks.

Celerra also provides an SNMP Management Information Base (MIB) II interface for integration
with popular management tools, such as CA Unicenter, Tivoli, and HP OpenView.

Figure 9. Browser-based Celerra Manager

The Celerra Manager provides a set of management commands for each major file server
component. Server components appear as buttons across the top frame of the main menu. Clicking
a button activates a new frame that contains the component management options. The Celerra

20 21
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Manager can manage all functions for every file server component.
Table 4 lists the options associated with Celerra Manager components.

Component Control Station Option Work Station

System Component • Telenet capabilities for direct access to the Control Stations
Manages the Control and the capability to display the Control Station log and
Station and Celerra’s version
graphical interface. • GUI options manage graphical interface users and specify the
graphical interface password

Network Host • Manage the network view of the Data Mover


Component • Perform network administration
Provides an • Manage interfaces
understanding and • Configure NIC cards and IP addresses
diagnosis of network • Manage routing
problems by displaying • Configure DNS, NIS, and SNMP operations
network statistics and
pinging other systems.

Volume Component • Create, size, and manage volume


Offers the capability to • Create and associate file systems
configure volumes and • Quota support allows allocation and constraint of disk
create file systems. usage by specified users

Data Mover • Create mount points


Component • Export file system paths
Uses commands that • Display free space
manage file server
operations. Figure 10. Automated Network Backup and Restore

File System • Check • Delete


The Celerra File Server supports automated network backup and restore (Figure 10) with many
Component • Extend • Archive
enterprise products such as EMC Data Manager (EDM). EDM provides backup and restore from
Manages file systems. • Rename • Restore
a Data Mover to a central tape library connected to a remote backup server. Backup data travels
• Display
across the network.
Data Mover and File • Mount and unmount file systems
System Component • Check free space in the Data Mover and file system This sophisticated backup solution uses high-end backup equipment and tape libraries, typically to
backup and restore large configurations, populated with many small- to medium-capacity
Platform • Commands that halt and reboot the Data Mover platform
distributed systems.
Component • Display platform memory, adapters, name, and date
Manages the platform • Define standby Data Movers
Note: The automated network backup and restore procedure requires sufficient network
view of the Data Mover. • Display platform version
bandwidth to enable the backup operation.
• Display log files and statistics

During the automated network backup operation, the remote backup server acts as a network
Table 4. Celerra Manager Components and Options
client and mounts the Data Mover file systems. The backup server copies files to its local tape
library from the Data Mover, treating the files as locally attached to the backup server.
Backup and Restore The Celerra File Server offers several backup and restore solutions, both network-based and direct-
attached. Configuring the Celerra File Server to use TimeFinder/FS creates another backup and
Automated network backup and restore offers an optimum solution for distributed networks with
restore option with Business Continuance Volumes (BCVs).
sufficient available bandwidth and includes sophisticated capabilities, such as:

• Unattended backup and restore capability


Automated Network The automated network backup and restore option sends files across the network to a tape drive
Backup and Restore attached to a remote backup server. This sophisticated network backup tool allows customers • Tape library support
to protect large configurations that typically contain many small- to medium-capacity
• Management via graphical user interface
distributed systems.
• Sophisticated data cataloging

22 23
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

The Celerra File Server’s highly optimized file system implementation, combined with high- Automated local backup and restore provides features similar to automated network backup, such as:
performance backup and restore products, eliminates most concerns about sufficient available
• Incremental and full backup
bandwidth. Dedicated subnets for backups, which further separate backup and restore from user
traffic, minimize backbone congestion. • Unattended backup capability

• Tape library support


Automated Local Backup Automated local backup and restore backs up files to a local tape, attached directly to a Data • Sophisticated data cataloging
and Restore Mover. This advanced backup and restore tool allows customers with larger configurations to
• Error log support
bypass the network when backing up and restoring data.
• Management via graphical user interface
The Celerra File Server provides local backup and restore using third-party, NDMP-compliant
backup and restore products. Celerra File Server eliminates the need to transfer backup and restore
Using TimeFinder/FS for
data across the network by copying files to a tape library, attached directly to a Data Mover via Celerra and TimeFinder/FS
Backup and Restore
SCSI connections (Figure 11). Use of an NDMPv2 backup package provides automated local
backup for mixed UNIX and NT environments, preserving file and security attributes.
FS2 FS3
Clients copy copy
(CIFS/NFS)
Work Station Client Client access to BCV data
BCVs
FS1
copy
(CIFS/NFS) (CIFS/NFS)
Client Client

FS2 FS3

Client access to current data

FS1

Data Symmetrix
Movers

Figure 12. TimeFinder/FS: Copying Files and File Systems into BCVs

TimeFinder/FS, the Celerra implementation of EMC’s TimeFinder technology, creates a point-


in-time copy of a file system with only a brief suspension of access to the original file system.
System administrators can mount and export this independently addressable file system copy or
use it as a dynamic mirror of a file system. TimeFinder/FS allows continued normal operations on
the original file system, while the copy serves as a basis for the backup operation. Figure 12 shows
the TimeFinder/FS backup and restore process. Table 5 compares various backup and restore
options using TimeFinder/FS.

Figure 11. Automated Local Backup and Restore

An automated local backup and restore operation involves configuring the NDMP backup and
restore product to run on a remote network client. From the remote client, it manages the local
backup and restore of the Celerra File Server. The network only transmits control information
between the Data Movers and the backup device. The remote backup and restore server network
client can also perform simultaneous backup and restore of other enterprise servers, either locally
or over the network.

24 25
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Automated Backup and Restore over NFS


1. Create the file system 2. Mount and export 3. Mount the exported copy as a Bidirectional

copy. the copy on a file system.


Data Mover.

4. Initiate the backup on an NFS


host with a backup utility
installed and a tape drive
Active
attached.

5. The host backs up the file system copy over NFS onto the tape drive. Celerra 1 Symmetrix 1
Passive
Symmetrix 2 Celerra 2
The original file system remains accessible via the other Data Movers in the Celerra.
R1
Restore the original file system from backup, when necessary, using the backup utility’s
R2
restore process.

Automated Backup and Restore Using NDMP


Figure 13. Celerra Disaster Recovery using SRDF
1. Create the file system 2. Mount and export 3. Use an NDMP-compliant backup
copy. the copy as a file tool on a network server.
system on a Data 4. Designate the Data Mover as an The Celerra disaster recovery solution maintains continuously available file systems, even with an
Mover attached to NDMP server. unavailable or non-functioning Celerra File Server. Symmetrix technology connects a local and
a tape drive via a 5. Initiate the backup of the file remote Celerra over a distance of up to 40 miles (66 km). After establishing the connection and
SCSI connection. system copy, via the Data properly configuring the Celerra, users gain continued access to file systems in the event that the
Mover, to tape. local Celerra and/or the Symmetrix becomes unavailable.

6. The host backs up the file system copy onto the tape drive.
By providing a remote mirror copy of file system data in more than one location, Celerra’s disaster
The original file system remains accessible via the other Data Movers in the Celerra.
recovery functionality offers:
Only one Data Mover needs a SCSI connection to a tape drive. Restore the original file
system from backup, when necessary, using the backup utility’s restore process. • Disaster tolerance/recovery

• Data center migration


Table 5. Backup and Restore Options Using TimeFinder/FS
• Data migration capability

Using SRDF for The Symmetrix Remote Data Facility (SRDF™) maintains a mirror image of a logical volume on a • Data center decision solutions
Disaster Recovery remote Symmetrix system to ensure business continuance and disaster recovery. The SRDF option
allows Celerra File Server to recover using Celerra sites at the primary and secondary locations. Note: Implementation of Celerra disaster recovery software requires modification of the standard
Celerra configuration. Each logical volume defined in the Celerra volume database is comprised of
Geographically separated Celerras can provide rapid disaster recovery for each other as well as two physical volumes: one located on the primary Symmetrix (R1) and the other on the backup
service to their own network connections. Each site’s system reserves part of the local Celerra and Symmetrix (R2). The R2 volume provides a mirror of the data on R1. An EMC Customer Service
part of the local Symmetrix as standby resources that can be utilized for disaster recovery. Figure 13 Engineer configures the attached Symmetrix volumes during the Celerra system setup phase.
represents a typical SRDF disaster recovery configuration.
Additional disaster recovery software and communications hardware allows the Symmetrix
systems to communicate with each other.

26 27
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Celerra File Server Proper configuration of the Celerra File Server requires an understanding of the type of users CIFS-only Environment
Configuration planning to use the system in order to configure file system protocols and access. The three Configurations
Windows 95
configuration options include: Native
UNIX Client Running NFS
Client Software

• NFS users only


File Celerra File Server
System

• CIFS users only


IP Address
• Both NFS and CIFS users Data
Mover

Administrators can map an NFS and a CIFS user to the same user name and group ID, providing a /.etc/passwd
Windows NT
Running NFS

seamless access to shared file system data. NFS and CIFS provide different methods and command Client Software

options of authentication, file locking, and access checking.

Native Windows 95
NFS-only Environment UNIX Client Running NFS
Client Software

Configurations
File Celerra File Server
System

Data IP Address
Mover

Windows NT
/.etc/passwd Running NFS
Client Software

Figure 15. Typical CIFS User Configuration

Data Movers configured for CIFS services provide file access features similar to those of a
Windows NT server and are typically associated with a specific NT domain (Figure 15).

Figure 14. Typical NFS User Configuration Primary Domain


Combined NFS/CIFS Controller Default
WINS Server
Environments
Configuring a file system for NFS users and associating it with a Data Mover allows the Data File O N
Celerra File Server
System OG
Mover to operate as an NFS Server. In a typical NFS server environment (Figure 14), the file system TL
NE

is mounted on the Data Mover for export to, and mounting on, clients. Exported file systems
Data NetBIOS
remain available across the network for mounting by remote users. Mover
with
CIFS Domain I
Configuration

Windows NT
/.etc/passwd Client Native UNIX
with NT Client
user entries

hip
tions
Rela st
Tru
Domain II

Additional
WINS Server UNIX
Primary Domain
Client
Controller

Figure 16. Typical Mixed NFS/CIFS User Configuration

28 29
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Users can configure a file system for access by both CIFS and NFS users (Figure 16). Typically, this System managers can configure file locks on a per-file-system basis and select from the following
type of configuration allows users on UNIX and Windows machines to access files that reside in three options:
directory locations on a single file system. To configure a file system for both CIFS and NFS users,
• nolock option enforces no locking between NFS and CIFS users. NFS users can open and write to
configure the file system for NFS users, then configure it for CIFS users.
a file, even one locked by CIFS users.

• wlock option enforces write locking between NFS and CIFS users. NFS users can open a file with
Celerra File Server File NFS and CIFS provide different methods of authentication, file locking, and access checking. To
read-only access if a CIFS user already opened the file.
Security Architecture accommodate these differences, the Celerra File Server includes command options that allow
system mangers to select authentication, file locking, and access checking methods best suited for • rwlock option enforces all CIFS file locking modes on NFS users.
the organization’s configuration.
Opportunistic Locks Opportunistic locks (oplocks) enable CIFS clients to reduce network traffic by reducing the
Authentication Celerra File Server provides three authentication options for file systems configured for both NFS (oplocks) frequency of messages to the server regarding changes to, and status of, a file. The Celerra File
and CIFS users: Server supports exclusive and batch oplocks.

• UNIX Authentication • Exclusive oplocks notify a client that the client is the sole entity opening a file. The server receives
updates about change or status only when the client closes the file.
• NT Authentication
• Batch oplocks allow a server to keep a file open even after the local accessing entity on the client
• Share Level Authentication
closes the file. Batch oplocks reduce the number of open/close requests on the network.

UNIX Authentication Configurations that require user-level authentication for access primarily by NFS users use UNIX
Oplocks are configured per file system and turned on by default. Leave oplocks ON, except when:
authentication. This option authenticates CIFS users by checking the /.etc/passwd file, or NIS
(if enabled). • Using a database application that recommends turning off oplocks.

• Handling critical data with the need to avoid even slight data loss.
NT Authentication Configurations that require user-level authentication for access primarily by CIFS users use NT
authentication. This option verifies CIFS users on the Domain Controller of the NT domain. With Access Checking Policy Celerra File Server provides four configurable file access checking policies to accommodate the
NT authentication, the system administrator uses automated tools provided by EMC to add an differences between the NFS and CIFS security models. Specify a native, NT, UNIX, or secure
entry for each CIFS user accessing the Data Mover in the /.etc/passwd and /.etc/group files on the policy when mounting the CIFS file system:
Data Mover. This entry contains the user name, UID, GID, and enables the Data Mover to assign
Native Celerra File Server employs a native access checking strategy, which gives access to CIFS and NFS
the correct access rights to NFS users subsequently requesting the file.
users. Celerra checks NFS users against file access and group permission, and CIFS users against
Share Level Authentication Configurations with few security requirements use share level authentication. This option allows Security Descriptors.
access to a file system without any password. Optionally, with passwords enabled, any CIFS or
NT Celerra File Server employs a native access checking strategy, which checks both CIFS and NFS
NFS user presenting a valid password receives access to the data.
users. In addition, Celerra checks NFS users against the NT Security Descriptors assigned to the
object.
File Locking CIFS and NFS employ different restrictions for file locking, as described in Table 6.

CIFS NFS UNIX Celerra File Server checks both CIFS and NFS users against a native access checking strategy. In
Restriction More restrictive than NFS. Less restrictive than CIFS. addition, Celerra checks CIFS users against NFS file access and group permissions.
Level

Access No other users can access a Co-operative access. Other users can access Secure Celerra File Server checks both CIFS and NFS users against NFS file access and group permissions
Level locked file. a locked file (other users cannot use the and also against the Security Descriptors assigned to the object.
lock procedure, however).

Table 6. File Locking Comparison

30 31
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Chapter 4 Symmetrix • Concurrent disk mirroring


Enterprise Functionality • Redundant power, battery, bus structures, and I/O subsystems
• Online hot spare disk assemblies
• Automatic cache and disk data scrubbing routines
The Celerra File Server incorporates robust functionality and leading-edge features that provide high • Auto-Call remote maintenance parameter monitoring
value to enterprise-wide computing environments. Celerra supports current industry standards, Power and • Power Consumption (kVA) 1.34
including file access protocols, network interfaces and protocols, and physical file system types. Cooling Data • Heat Dissipation (BTU/hr) 4,563
EMC’s extensible architecture simplifies the process of incorporating additional protocols as user Values represent maximum figures for Celerra File Server cabinets only.
requirements develop with a modular architecture that allows rapid, easy upgrades. Values for multi-enclosure configurations vary.

Regulatory and • UL-950


Hardware and Data Movers • CIFS over TCP/IP Agency • IEC 950/EN 60950
Software Specifications • CISPR 22 Class A/EN 55022
• NFSv2 and NFSv3 concurrently over TCP/IP and UDP/IP
• CSA C22.2 No. 950
• WebNFS
• FCC Subpart B
• FTP • IEC 801-2/EN 55024-2

• 10BaseT/100BaseT, ATM-OC3, FDDI, Gigabit Ethernet

• UxFS File System

• UNIX archive utilities

• Redundant Ultra FWD SCSI interface

• Fibre Channel connectivity

• Autonomous Data Mover architecture

• n+1 Data Mover Failover

Control Station • 10/100BaseT, FDDI

• SNMP MIB II manageability

• Dual redundant Control Station option

• Telnet manageability

• Remote management with an HTTP server management GUI

Celerra Cabinet • Battery backup

• n+1 load-sharing power supplies

• Hot-swappable subassemblies

• Redundant internal Ethernet for environmental status


monitoring and control

• Auto-Call remote maintenance parameter monitoring

32 33
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Managers with responsibility for enterprise infrastructure decisions can quickly appreciate how the
Chapter 5
combination of Celerra File Server and Fibre Channel solutions work to increase competitiveness,
EMC Enterprise Storage Network efficiency, and productivity. While Connectrix connects more servers over greater distances, Celerra
File Server links clients, allowing file sharing between clients (Figure 17). Celerra makes it possible
to consolidate client storage, allowing NT and UNIX clients to transparently share files, and permit
An EMC Enterprise Storage Network™ (ESN) extends the value of enterprise storage solutions to redeployment of file servers as application and/or database servers (where they can fully realize their
more of the organization, giving customers unlimited access to, and unlimited use of, their most CPU capabilities).
strategic information whenever they want it.

Adding to (or supplementing) an ESN infrastructure with Celerra allows the enterprise to extend
ESN enables IT managers to consolidate data faster and over greater distances than ever before. the value of Enterprise Storage throughout more of the organization. Consolidating servers and
Total cost of ownership is reduced as a direct result of centralized management, extending storage sharing information allows the organization to maximize the value of the data while offloading
over greater distances and improving performance. other requirements from the LAN/WAN network.

With ESN, businesses can respond to change and remain more competitive. ESN allows companies
to take greater control of their information assets as business and information demands shift
Infrastructure Consolidation Infrastructure consolidation can occur at both the Celerra and Connectrix levels (Figure 18).

and grow. • Celerra consolidates client storage and file service, allowing redeployment of existing file servers.

• Connectrix consolidates server storage.


ESN extends connectivity by increasing the number of servers connected and extending distances.
ESN creates an information infrastructure, joining data center and distributed environments. The
NT Consoldation with SAN
ESN connectivity choices include FC-SW switched fabric, FC-AL point-to-point, FC-AL through
server
264

hubs, SCSI, and ESCON. ESN includes IP via Celerra. Consolidation of


server
264

server
264

server
264
Connectrix
server storage
server
264

ESN goes beyond defining a specific configuration. ESN is a set of capabilities — available
server
264

server
264

server
264

Greater distances for


exclusively from EMC — that allows customers to evolve their information infrastructures direct connections server
264

server
264

with their enterprises. Each enterprise can achieve ESN capabilities in a way that meets the
server
264

server
264

No sharing of data
organization’s needs. One customer may combine enterprise storage with Professional Services, server
264

server
264

server
264

Connectrix™ and Celerra hardware, and software. Another may achieve ESN capabilities using
server

No file locking
264

Enterprise Storage software and a single Symmetrix.


Each server
stores its own
data on
Celerra File Server (NAS)
Symmetrix
and Fibre Channel Solutions NT Consolidation with NAS - Celerra
Celerra and
Figure 18. ESN: Consolidation with Celerra and Connectrix
Consolidation of
Symmetrix
client storage
Table 7 compares the characteristics and application environments of Celerra File Server
Transparent sharing and Connectrix.
of files by NT and
UNIX clients Network
Celerra File Server (NAS) SAN
Redeployment of Characteristics Characteristics
Celerra File Server (NAS) SAN
server
264

server
264

NT file servers - as • Shared access to files and file systems • Access to disk blocks
server
264

Characteristics Characteristics
server
264

application servers
• LAN/WAN
• Shared access to files and file systems based
• Access to disk blocks • Channel (direct) attached
• LAN/WAN based • Uses standard
• Channelnetwork
(direct)protocols
attached • Uses device-level protocols

Figure 17. Consolidation with Celerra • Uses standard network protocols • Consolidates client storage
• Uses device-level protocols • Consolidates and connects more servers
• Consolidates client storage • Data sharing between UNIX and NT • No data sharing between servers (each
• Consolidates and connects more servers
• Data sharing between UNIX and NT server stores its own data on Symmetrix)
• No data sharing between servers (each
Application
server Environments Application Environments
stores its own data on Symmetrix)
Application Environments •Internet/E-commerce
Application Environments •Database
•Internet/E-commerce •SW Development
•Database •Online Transaction Processing (OLTP)
•SW Development •Manufacturing/Design •Data Warhouse
•Online Transaction Processing (OLTP)
•Manufacturing/Design •Data Warehouse

Table 7. Complementary Aspects of Celerra and Connectrix

34 35
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Chapter 6
EMC Services and Support
Communications
Network
Database and
Applications EMC meets customer needs through its extensive service and support organizations.
Servers

• Professional Services consultants leverage EMC product knowledge and project management skills
to facilitate the customer’s software implementation.
Enterprise Storage
Network • Customer service personnel operate worldwide teams that provide high-level technical expertise.
Fibre
Switch
• EMC Customer Support offers direct support for EMC hardware and software products.

Celerra Symmetrix
Network Enterprise Storage
Attached
Storage
and value-added EMC Professional Services EMC Professional Services consultants understand how Celerra File Server shares files over
software
networks and how it provides access to UNIX and Windows NT clients. This understanding,
combined with knowledge and experience of infrastructure, data consolidation, and enterprise
storage, allows Professional Services consultants to facilitate the customer’s Celerra
Figure 19. Extending the Reach of ESN implementation.

Celerra also acts as a gateway from the fibre storage network of ESN (Figure 19) by extending the
Overview of Professional Professional Services offers both strategic consulting services and practical implementation services
“reach” of the Enterprise Storage Network to include IP networks (e.g., workstations, clients, and
Services Capabilities for Celerra in UNIX/NFS and Windows NT/CIFS environments. Professional Services helps
servers that reside on the traditional LAN and WAN).
customers:

• Assess network file server requirements.


Celerra and Symmetrix Leveraging Existing Symmetrix with Celerra
• Analyze existing environments as they affect Celerra File Server.
SUN IBM
• Install EMC’s network storage products.
HP9000
server
264

Installation and configuration of one Celerra File Server to a base level of operability (e.g., two to
14 Data Movers functioning and available on the client network) involves several Professional
Services tasks, including project management and pre-site survey, physical planning, verification of
the Symmetrix configuration, installation of the Celerra File Server and related software, testing of
the Control Station, system tests, and customer training.

Network Best Practices EMC Storage Logic™ — a framework of EMC-specific and storage industry best practices —
for Best Results allows EMC consultants to deliver time-tested and predictable software implementation services.
This methodology addresses all phases of an enterprise solution, reduces risk, and ensures a
Symmetrix Celerra consistent and effective process with repeatable and predictable results.
Heterogeneous
Clients
Implementation Options EMC Professional Services consultants handle all aspects of assessment, planning, design, and
Figure 20. Leveraging Celerra and Symmetrix implementation at basic and extended offering levels. Standard implementation includes standard
installation assistance and extended custom implementation services (with project management,
Figure 20 demonstrates how adding a Celerra File Server to an existing Symmetrix system can testing, and migration assistance). Extended implementation includes full integration of EMC
create a Symmetrix file server. Such a configuration allows heterogeneous clients and servers to products in the customer’s unique environment and the capability to solve critical
exchange data over the network and optimize the Symmetrix storage capabilities. The system business problems.
administrator and installer must apply the same precautions when adding a Celerra File Server as
when they add a new server to the Symmetrix. They must:

• Ensure that sufficient free disk space exists on the Symmetrix.

• Determine if the Symmetrix requires increased cache.

• Verify sufficient open connections on the Symmetrix (SCSI or Fibre Channel).

• Tune the system after installing Celerra to avoid compromising existing database performance.

36 37
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Standard Implementation EMC Professional Services offers basic installation assistance preparatory to extending and inte- Installation Support EMC specialists configure every Celerra File Server according to the customer’s specifications and
grating Celerra File Server throughout an environment. This service includes: requirements. During installation, customer support engineers and installation specialists:

• Basic installation and configuration of EMC Celerra File Server to achieve file sharing between a • Configure the Symmetrix volumes to provide the needed capacity.
network clients and a Symmetrix Enterprise Storage System.
• Create the number of file systems requested.
• A demonstration of Celerra File Server capabilities, combined with a review of the installed sys-
• Map file systems to Data Movers, according to the requirements of the enterprise.
tem’s functions and operations.
• Export file systems to the network and mount file systems on individual machines, if required.

By ensuring proper installation and operation, the standard service creates a foundation that • Set access rights, as required.
enables continued, confident use of the Celerra File Server solution. • Assist in the configuration of NIS, DNS, WINS and failover.

Extended Implementation Extended implementation offers additional assistance, including detailed testing of EMC Celerra EMC Customer Service Service represents a key component of EMC’s total quality philosophy. EMC’s Customer Service
File Server in a high-availability environment. Consultants simulate failover conditions and organization delivers customer satisfaction — and maintains the highest customer satisfaction
observe actual I/O re-allocation patterns. This combination of EMC Professional Services product ratings in the industry.
knowledge and project management skills maximizes customer confidence in the EMC solution.
Customer service at EMC starts with highly qualified and dedicated EMC engineers, well trained
In summary, EMC Professional Services eliminates the need for customers to divert in-house on EMC equipment. Each customer is assigned a primary and secondary customer engineer.
resources from core business activities, brings expertise and resources to maximize business EMC’s world-wide customer account database contains all information about the customer’s
impact, and helps customers experience the benefits of The EMC Effect. account, which customer engineers can readily access.

Customer Service EMC’s world-class customer engineering personnel provide the technical expertise for seamless Unlike traditional service operations, EMC employs remote service technology that enables
transition to the Celerra File Server. EMC’s onsite customer engineers work closely with IT continuous monitoring and diagnosis on all installed EMC equipment. The Call-Home feature
managers to understand the unique needs of the customer’s business environment. Customer available on the Celerra File Server provides self-monitoring algorithms that detect a potential
engineers collect site information and provide total solutions based upon a thorough failure within a component. Implementing Call-Home means that the Celerra File Server
understanding of the organization’s business needs, storage requirements, storage topology, and automatically notifies the EMC Customer Support Center before a failure actually occurs.
network requirements. Qualified product support engineers immediately handle all calls. With the customer’s permission,
the product support engineer can dial in, conduct further diagnostics, and determine remedial
• Business Needs: EMC technical personnel evaluate business needs and work cooperatively with
actions. Repair is accomplished through the dial-up connections or by dispatching a local
the customer to improve productivity by enhancing data availability, scalability, server
customer engineer, apprised of the problem and ready with the necessary components.
performance, and ease of management.

• Storage Requirements: Customer engineers assess the amount of file system storage required to do
Worldwide Organization, EMC customer service dedicates more than 3,000 technical, field, and support personnel to its
business today and help plan strategies to meet future storage needs.
Local Support worldwide organization. More than 1,900 experts, including over 700 customer engineers, support
• Storage Topology: Customer engineers analyze the size and number of current general-purpose or customers in North and Latin America. International Customer Service is staffed by more than 1,100
dedicated servers and consider data distributed methods and management across the enterprise. professionals spanning 33 countries.
They assess groups of users within the enterprise to develop an understanding of how users need
to access storage data.
EMC Customer Support The EMC Customer Support Center, headquartered in the United States, directly supports
• Network Requirements: Customer engineers analyze current network topology and help assess EMC hardware and software products. Use the following numbers to contact EMC and obtain
the number of users accessing data. They then determine the storage architecture and user technical support:
protections required. These assessments and strategies lead to enterprise-specific network
U.S.: (800) 782-4362 (SVC-4EMC)
protocols and requirements (FTP, NFS, WebNFS, CIFS, TCP/IP, FDDI, Ethernet, ATM, SNMP
and NTP). Canada: (800) 543-4782 (543-4SVC)

Worldwide: 1 + (508) 497-7901 (or contact the nearest EMC office)

38 39
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Data Access in Real Time (DART) — A software component of the Celerra File Server, included on
Glossary of Terms
each Data Mover, that provides a realtime, multi-threaded operating system, optimized for
network file access.
Address Resolution Protocol (ARP) — Allows systems to query the network to identify a machine
with a specific Internet address.
Data Mover — A Celerra cabinet component, running software that retrieves files from a
storage device and exports the file to a network client. Each Celerra File Server can contain up to
Allocation Request — A request for a volume sent by an application. An accompanying volume
14 Data Movers.
template specifies the volume characteristics.

Distributed Storage System — A storage system based on general-purpose servers. Storage data is
ARP — See Address Resolution Protocol.
distributed on general-purpose machines across the enterprise and accessed using the operating
system of the general-purpose machine.
Asynchronous Transfer Mode (ATM) — A broadband technology for transmitting voice, video,
and data over LANs or WANs.
Domain Name Service (DNS) — The standard Internet naming protocol, which maps host names
to IP addresses.
Authentication — A process for verifying that a user trying to access a file or directory is who they
claim to be.
EMC Data Manager (EDM) — An EMC product that provides network backup and restore with
automated management of media. Contains EDM Backup software and optional HSM software.
Automated Local Backup and Restore — This backup strategy uses an NDMP-compliant tool,
and backs up files to a local tape, attached directly to a Data Mover. Backup data does not travel
Ethernet (10/100BaseT) — Ethernet running on unshielded twisted pair (UDP) cable. It allows
across the network.
adjustment of network speeds from 10Mb/s to 100 Mb/s.

Automated Network Backup and Restore — A backup strategy that uses a backup product, like
FDDI — See Fiber Distributed Data Interface.
EDM, and backs up files to a tape drive attached to a remote UNIX backup server. Backup data
travels across the network.
Fibre Channel — The general name of an integrated set of standards being developed by ANSI
which defines new protocols for flexible information transfer. Logically, a point-to-point serial data
Celerra File Server — EMC’s high-end network file server. Provides high availability, capacity, and
channel, structured for high performance.
scalability for network accessible file storage.

Fiber Distributed Data Interface (FDDI) — A high-speed LAN or WAN interconnection


Celerra File Server Manager — The graphical user interface (GUI) used to manage the Celerra
technology. Provides a 100Mbps transmission of dual, counter-rotating optical fiber rings (primary
Network File Server.
and secondary) between single (SAS) and dual (DAS) access stations.

Channel — A path that allows for the rapid transfer of data between a device and storage.
File System — A file system, composed of the files and directories on each individual disk partition,
uses an overall system directory tree to merge file systems into a single hierarchy.
Channel Directors — The component in the Symmetrix system that interfaces between the host
channels and data storage. The channel director transfers data between the channel and cache.
File Transfer Protocol (FTP) — A high-level protocol for transferring files from one machine to
another. Implemented as an application-level program (based on the OSI Model), FTP uses Telnet
CIFS — See Common Internet File System.
and TCP protocols.

Common Internet File System (CIFS) — CIFS is a file system that uses the Server Message Block
Gigabit Ethernet — IEEE standard for 1000Mbps Ethernet; compatible with existing 10/100
(SMB) protocol to provide secure file access and transfer to a multitude of hosts such as LANs,
Ethernet standards. The IEEE, with the help of the Gigabit Ethernet Alliance, defined the standard
intranets, and the Internet.
for full duplex over fiber optic cable and short-haul copper in early 1998.

CIFS separates naming conventions tied into SMB and allows use of any chosen standard, (e.g.,
Gigabyte — 2 to the 30th power (1,073,741,824) bytes. One gigabyte is equal to 1,024 megabytes.
Domain Name Service or DNS). CIFS complements existing file access protocols such as HTTP,
Abbreviated as G or GB.
FTP, and NFS.

HTML — HTML, which along with HTTP, provides the main standards that control how the
Control Station — A hardware and software component of the Celerra File Server that provides
World Wide Web works; specifies how to format and display Web pages.
the controlling subsystem to the Data Movers, as well as the software interface to all
server components. The Control Station is used to install, configure, and monitor Celerra File
HTTP — See Hyper Text Transport Protocol.
Server components.

40 41
EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE EMC CELERRA FILE SERVER PRODUCT DESCRIPTION GUIDE

Hyper Text Transport Protocol (HTTP) — HTTP, the underlying protocol used by the World Wide Ping — A TCP/IP procedure that uses the Internet Control Message Protocol (ICMP) echo to
Web, defines message formatting and transmittal, as well as responses to various commands that Web confirm the status of a network device (e.g., active/inactive). SNMP-based Network Management
servers and browsers need to take. Called a stateless protocol, HTTP allows independent execution systems often use the ping procedure to give alarm signals.
of each command, without any knowledge of previous commands. HTTP 1.1 supports “persistent
connections;” a browser can receive multiple files through the same Web server connection. RARP — See Address Resolution Protocol (ARP).

ICMP — See Internet Control Message Protocol. Reverse ARP — See Address Resolution Protocol (ARP).

Internet Control Message Protocol (ICMP) — A communications protocol that reports errors in Simple Local Backup — A backup strategy that uses the server_archive command and backs up
datagram processing between networked nodes. Part of the Internet (IP) suite of protocols. files to a local tape attached directly to a Data Mover.

Management Information Base (MIB) — The database controlled by SNMP. The MIB holds Simple Network Management Protocol (SNMP) — An application protocol developed in the mid
information about all resources managed by a network management system. 1980s for the purpose of managing network communications in the Internet Protocol suite. SNMP
controls the MIB database. It is most commonly employed using TCP/IP protocols.
Media Access Control (MAC) Address — The media-specific access control protocol within
IEEE802 specifications. Small Computer System Interface (SCSI) — A device-independent protocol that provides
peer-to-peer interface communication from host-to-host, host-to-peripheral device, or peripheral
Meta Volume — A concatenation of volumes composed of disk, slice, or stripe volumes. device-to-peripheral device. This interface standard bus (8 bits wide) defines physical and electrical
connections for SCSI devices, including disk, tape, and CD-ROM devices.
MIB — See Management Information Base.
Symmetrix — EMC’s high-performance Enterprise Storage system, a hardware and software
Mount — In combination with NFS, mount attaches to a subdirectory of a remote system over a storage system designed for high-capacity, highly efficient online storage.
dummy directory on the local machine. This protocol allows clients to mount or unmount file
systems for access through NFS. Mount is accessible over UDP or TCP. TCP/IP — Transmission Control Protocol/Internet Protocol. Protocols used in network
communications routing and data transfer. The accepted standard for UNIX-based operating
NDMP — See Network Data Management Protocol. systems and the Internet.

Network Data Management Protocol (NDMP) — A network protocol designed for the backup Telnet — As the Internet standard protocol for remote terminal connection, Telnet allows a user at
and retrieval of data. one site to interact with a remote device or system that expects terminal-mode traffic.

Network File Server — A self-contained, intelligent storage system that operates independently of Terabyte — 2 to the 40th power (1,099,511,627,776) bytes, or approximately 1 trillion bytes.
the server’s operating system. Network file servers provide files storage as a shared resource and
contain the standard network protocols required to communicate directly with the network. Transport Control Protocol (TCP) — A transport control protocol offering reliable connection-
orientated transport service in the Internet suite of protocols. Used with the IP connectionless
Network File System (NFS) — A distributed file system that provides transparent access to remote network protocol in TCP/IP configurations to transport information across networks.
disks. NFS allows all systems on the network to share a single copy of the directory (the alternative
involves duplicating common directories on every system). Web NFS enables this same User Datagram Protocol (UDP) — A connectionless transport protocol service in the Internet suite
functionality to occur over the Internet. of protocols. Used by the standard Internet name (DNS) and file services (NFS), and more efficient
than TCP, UDP can be used effectively where the application takes care of reliability issues.
Network Information Services (NIS) — This Yellow Page service of Sun® Microsystems maps host
names to IP addresses and vice versa. It also can map usernames, user ids, groups, ARP tables, UxFS — A high-performance Celerra File Server file type based on traditional Berkeley UFS,
services, mail aliases, etc. enhanced with 64-bit support, metadata logging for high availability, and several performance
enhancements.
NTFS (NT File System) — This file system for the Windows NT operating system improves
reliability, such as transaction logs to help recover from disk failures. It allows control access to WebNFS — See NFS.
files, allowing users to set permissions for directories and/or individual files. Other operating
systems (e.g., DOS) cannot access NTFS files. NTFS supports spanning volumes for large Windows Internet Naming Service (WINS) — A name resolution system that determines the IP
applications, allowing distribution of files and directories across several physical disks. address associated with a particular network computer. This service provides mapping between the
machine name and the Internet address, allowing Microsoft networking to function over TCP/IP
Peripheral Connect Interface (PCI) Bus — A local bus specifically designed for use with the Intel networks.
Pentium® processor.
WINS — See Windows Internet Naming Service.

42 43
NOTES NOTES

44 45
NOTES NOTES

46 47
NOTES

48
EMC Celerra File Server
best-of-breed solutions
mission-critical applications
unlimited capabilities
unprecedented control

where information lives www.EMC.com

EMC Corporation
Hopkinton
Massachusetts
01748-9103
1-508-435-1000

In North America
1-800-424-3622, ext. 362

EMC2, EMC, and Symmetrix are registered


trademarks and EMC Enterprise Storage,
Celerra, EDM, SRDF, and where information
lives are trademarks of EMC Corporation.
Other trademarks are the property of their
respective owners.
© 2000 EMC Corporation. All rights reserved.
Printed in the USA. 6/00
Produced by EMC Global Communications.
L795.3
Product Description Guide

You might also like