PS Series Hardware Architecture

4-1

PS Series Hardware Architecture

4-2

 PS Series arrays provides automatic data provisioning . There is no need for administrators to manually create RAID sets or map data onto disks or individual controllers. Arrays in a group contribute space to a shared pool of storage from which you create volumes. Each volume has a specific size and access controls. To increase a volume just specify a new size. The storage management group handles storage allocation and capacity balancing across the disks and arrays. When a new array is added to the group and to a pool then all volumes within that pool will initially immediately distribute across the current member and also the new member disregard of RAID type or spindle speed

PS Series Hardware Architecture

4-3

 PS Series arrays provide dynamic load balancing. As the workload changes, volume data and network I/O are load balanced within and across the arrays in a group with no impact on applications and no user intervention. More spindles equals better performance All active disks per array are always utilized. Data is spread across all disks within the RAID sets.

PS Series Hardware Architecture

4-4

 PS Series Storage array family

PS Series Hardware Architecture

4-5

PS Series Hardware Architecture

4-6

a. When a group contains a mix of PS4000 arrays and other array models, the higher limits prevail. b. A group can contain a maximum of two (2) PS4000 arrays. c. Practical maximum volume size is operating system-specific. A PS Series group can create and present volumes up to 15 TB. d. In a group of mixed array models, only two (2) can be PS4000 arrays.

PS6000 and PS6500 Storage Arrays The PS6000 and PS6500 array models have four Ethernet ports, increasing the number of available network connections. As with the PS5000 and PS5500, one network port can be used for group management traffic if you configure a dedicated management network. However, you still have three ports for iSCSI I/O. PS5500 and PS6500 array models can belong to the same pool, but must be in a separate pool from all other array models in the group. If you are adding a member to a group, you cannot set the RAID policy and use the storage on the member until you create a new pool for the member in the following cases: You are adding a PS5500 or PS6500 to a group containing other model arrays You are adding a different model to a group containing only PS5500 and PS6500 arrays PS4000 Storage Arrays The PS4000 offers a more affordable branch office or medium-sized business storage configuration. The PS4000 contains either two Type 8 or two Type 9 control modules, which include two 1Gb network connections for iSCSI and management traffic, and an optionally enabled 10/100Mb dedicated port for managing the array if you have a management network configured. The PS4000 array offers scaling to two PS4000 arrays in a group, with additional scaling by adding other array models to the group. A group consisting only of PS4000 arrays has different maximum group configuration limits for some attributes. See Table 2,

PS Series Hardware Architecture

4-7

PS 6000 and PS 4000 is a 16 drive, 3U SAS/SATA hardware platform. A PS Series group can easily grow or shrink to accommodate workload requirements. So, administrators purchase only the hardware they need when they need it. Each PS Series array includes: No-single-point-of-failure hardware: Redundant, hot-swappable hardware components disks, control modules, fans, and power supplies. Component failover and disk sparing occur automatically without user intervention or disrupting data availability. RAID technology is used to provide data protection in each array. High-performance control modules. Each control module has four Gigabit Ethernet interfaces. You can configure multiple network interfaces. Dual control modules, data is mirrored across battery backed write-back caches. If one control module fails, the other control module takes over automatically and with no disruption to users. Support for standard Ethernet networks. Optional connectivity through a serial port. Enables you to connect the array to a console or computer running a terminal emulator. Ensures that you can access a group if network connectivity is lost. Interoperability PS Series arrays are ideal for multi-platform, heterogeneous environments eliminating the need for a different storage system for each operating system or application. Because a PS Series group provides block-level storage, hosts need only a standards-compliant iSCSI initiator. Easy setup and management A simple setup utility lets you quickly configure an array on the network and create a PS Series group.

PS Series Hardware Architecture

4-8

 Two control modules Control Module 0 is on the right Control Module 1 is on the left Separate Power for each Power Supply/cooling fan sub-system Two Power Supply/Cooling fan sub-systems Power Supply/Cooling fan sub-system 0 is on the right Power Supply/Cooling fan sub-system 1 is on the left Operation Panel Monitors PS Series array components and is located to the right of Control Module 0.

Power Supply/Cooling fan sub-system

PS Series Hardware Architecture

4-9

 The operations panel is used to supply LED status of the PS Series array and is located to the right of control module 0. The Warning and Error Condition LEDs alert you to errors and conditions that require attention. The LEDs display the status of: Rotation and detection for a fan tray failure or issue, Power supply, Temperature, and Control module communication

In the PS6000 Hardware Maintenance Guide, Table 1-2 describes the LEDs on the PS Series Array operations panel. Refer to this table for detailed information regarding LED indications on the Operations Panel The panel is not redundant, but an array can continue to operate if it fails. See the PS Series array service provider for information about servicing the panel.

PS Series Hardware Architecture

4-10

 Power Supply/Cooling is performed in two redundant power supply/cooling modules Two modules for redundancy Integrated fan and power supplies

Power Supply/Cooling module locations

Power Supply/Cooling module 0 located on the right Power Supply/Cooling module 1 located on the left Power Supply/Cooling module LEDs

PS Series Hardware Architecture

4-11

 Step one Unpacking the PS Series Array Open the outer shipping box Remove the box containing the chassis and place on a secure, stable surface Open the chassis box and remove the foam caps Remove the rails for the shelf assembly kit Remove the accessories Attach the electrostatic wrist guard to wrist Remove the chassis and place on a secure, stable surface Step two - Preparing the rack for installation of the PS Series Storage Array Refer to the PS 6000 and PS 4000 Rack Mount Instructions Install the rack mounting hardware The rack mount kit has hardware for square hole racks Additional hardware is included for round hole racks or tapped hole racks Step three - Install the chassis into the rack Lifting the chassis into the rack requires two people Step four - Connect the PS Series Storage Array to the SAN Connect Ethernet 0, Ethernet 1, Ethernet 2, and Ethernet 3 (if present) Connect the console port

PS Series Hardware Architecture

4-12

PS 6500 is a 48 drive, 4U SAS/SATA hardware platform. A PS Series group can easily grow or shrink to accommodate workload requirements. So, administrators purchase only the hardware they need when they need it. Each PS Series array includes: No-single-point-of-failure hardware: Redundant, hot-swappable hardware components disks, control modules, fans, and power supplies. Component failover and disk sparing occur automatically without user intervention or disrupting data availability. RAID technology is used to provide data protection in each array. High-performance control modules. Each control module has four Gigabit Ethernet interfaces. You can configure multiple network interfaces. Dual control modules, data is mirrored across battery backed write-back caches. If one control module fails, the other control module takes over automatically and with no disruption to users. Support for standard Ethernet networks. Optional connectivity through a serial port. Enables you to connect the array to a console or computer running a terminal emulator. Ensures that you can access a group if network connectivity is lost. Interoperability PS Series arrays are ideal for multi-platform, heterogeneous environments eliminating the need for a different storage system for each operating system or application. Because a PS Series group provides block-level storage, hosts need only a standards-compliant iSCSI initiator. Easy setup and management A simple setup utility lets you quickly configure an array on the network and create a PS Series group.

PS Series Hardware Architecture

4-13

The PS 6500 platform is a 4U SATA or SAS hardware platform with five field replaceable units and up to 48 disk drives. The drives are installed from the top by pulling the chassis out from the rack on rails, this should be done with care. PS6500 can be added to existing PS storage groups allowing for easily growing or shrinking to accommodate workload requirements. Each PS 6500 Series array includes: No-single-point-of-failure hardware: Redundant, hot-swappable hardware componentsdisks, control modules, Channel Cards, EIP card and power supplies cooling systems. Component failover and disk sparing occur automatically without user intervention or disrupting data availability. RAID technology is used to provide data protection in each array. Two High-performance control modules. Two Channel Cards One Enclosure Interface Processor The Disks may be configured with RAID 5, RAID 6, RAID 10, or RAID 50 Interoperability PS Series arrays are ideal for multi-platform, heterogeneous environments eliminating the need for a different storage system for each operating system or application. Because a PS Series group provides block-level storage, hosts need only a standards-compliant iSCSI initiator. Easy setup and management A simple setup utility lets you quickly configure an array on the network and create a PS Series group. Configuration can be performed using either a Serial console port or a GUI wizard Enclosure switches

Are located behind the disk drive slots, Do not change the default switch settings, which are: 4 On, 9 On, 10 Off, 11 On. The other switches are not used. A switch is on when it is in the position closest to the rear of the chassis. A switch is off when it is in the position closest to the front of the chassis.

PS Series Hardware Architecture

4-14

 The PS6500 Series key components: Control Module (CM) There are two CMs: one is active and the other a standby in a redundant configuration Each CM has four 1 Gigabit Ethernet interfaces, only the active controller ports are active Responsible for monitoring the fans, drives, power, and temperature Disks 48 SATA disks 48x 500GB 48 x 1TB Cooling and Power Supplies Three cooling and power supplies to provide redundancy

PS Series Hardware Architecture

4-15

 The front of the PS 6500 is covered by a Dell Bezel. The bezel can be removed by inserting the bezel key to unlock the bezel. You then push the bezel release latch to release the bezel from the chassis. This then reveals a number of LEDs, power switch and the Cam screws used to mount the bezel. PS6500 front panel LED and LCD, detail information relating to them can be found in the Hardware Maintenance document that is available off the Dell EqualLogic Support site. The front panel is comprised of: Power button used to power on or off the array. Proper shutdown involves first connecting to the desired array using the serial console port or telnet using one of the three physical ports IP address for the array you wish to shutdown. Next login and issue the shutdown CLI command. Once you get the message back saying it is safe to power off the array then you use the power button to power off the array Six hardware status LEDs that are used to determine the general status of the array Array Power Power Supply and Cooling modules Control Modules Disk Drives Channel Cards EIP Card LCD display, under normal operation the LCD displays the member name with in the group. If a failure occurs the LCD displays an icon and in some cases the numerical identifier for the affected component appear in the top portion of the LCD panel. If a drive failure has occurred, an icon showing the location of the failed drive will also appear. In addition, a description of the failure will appear in the lower portion of the LCD panel. The disk drive LEDs are used to identify what disk are installed and active. They are grouped in groups of four LEDs starting with Disk 0 on the far left when facing the array

PS Series Hardware Architecture

4-16

 This is a 48 disk drive platform. The disk are inserted from the top once the chassis has been carefully pulled out of the rack. It should be noted that you should not remove the top cover unless you are servicing the array. If the cover is left off for an extended length of time it will disturb the air flow within the chassis. Disk drive numbering, disk are numbered from 0-47. The disk drives are separated into two 24 sections with the channel card between the disk drive sections The left hand sections has disk drives 0-23, with disk 0 being in the front row far left column as shown below. Disk 3 is located in the same column, far left, and is the top drive The right hand sections has disk drives 24-47, with disk 24 being in the front row next to the channel cards as shown below. Disk 47 is located in the far right column at the top 3 7 11 15 19 23 27 31 35 39 43 47

10

14

18

22

26

30

34

38

42

46

13

17

21

25

29

33

37

41

45

12

16

20

24

28

32

36

40

44

PS Series Hardware Architecture

Front

4-17

 From the rear of the chassis you can access the two controllers and the three power supply cooling modules The two control modules are identified as:

Control Module 0 is on the left

Control Module 1 is on the right Each power supply has it own power cord, supplying power for each Power Supply/cooling module separately. Each of these should be connect to a separate power circuit to insure high availability The three Power Supply/Cooling fan modules are identified as: Power Supply/Cooling fan sub-system 0 is on the left Power Supply/Cooling fan sub-system 1 is in the middle Power Supply/Cooling fan sub-system 2 is on the Right

The three Power Supply/Cooling fan modules :

PS Series Hardware Architecture

4-18

 Power Supply/Cooling is performed by three redundant power supply/cooling modules with integrated fan and power supplies If a power supply fails do not remove the failed power supply until you have the replacement, this is for air flow purposes If you remove a power supply and the PS6500 is shutdown, the system WILL NOT power up until the removed power supply has been inserted or replaced The system will operate on two power supplies with one failed Power Supply/Cooling module locations Power Supply/Cooling fan sub-system 0 is on the left Power Supply/Cooling fan sub-system 1 is in the middle Power Supply/Cooling fan sub-system 2 is on the Right

Power Supply/Cooling module LEDs are used to indicate the status of the power supply

PS Series Hardware Architecture

4-19

 Provides switched based connectivity to the disk drives There are two hot swappable Channel cards that provide redundancy, only one is required for normal operations

Channel card 0 is the Channel card on the right when facing the array
Channel Card 1 is the Channel card on the left when facing the array Failure of the Channel card can also be identified by using the Front Panel LEDs and the LCD display There are a set of LEDs on the Channel card that are used to identify the status of the card LED Location Front LED Color Off Yellow Middle LED Off Slow Flash Fast Flash Rear LED Off Slow Flash Fast Flash Description Normal Operation or no power Reset or Hot Swap error No Power Normal Operation Initialization Error No Power Normal Operation Initialization Error

PS Series Hardware Architecture

4-20

 Provides monitoring of the devices on the backplane and the control module and displays the data on the LCD panel on the front of the array There is only one EIP, but the array will continue to operate normally if the EIP card fails. There are a set of two LEDs on the top of the EIP card that are used to identify the status of the card: LED Location Invalid ID Fault Color Off Off Yellow Description Not Used No Power or Normal Operation Failure

PS Series Hardware Architecture

4-21

 Step one Unpacking the PS Series Array Open the outer shipping box Remove the box containing the chassis and place on a secure, stable surface Open the chassis box and remove the foam caps Remove the rails for the shelf assembly kit Remove the accessories Attach the electrostatic wrist guard to wrist Remove the chassis and place on a secure, stable surface Remove the power supplies, at a minimum to reduce the weight, optional you can remove all of the disk drives Step two - Preparing the rack for installation of the PS Series Storage Array Install the rack mounting hardware Two types of rack hardware Center rack mount 4 Post rack mount Step three - Installing components into the PS Series Storage Array Chassis Install the disk-drives and any blanks if required Install the power supplies Install the fan trays Install the controller modules Step four - Connect the PS Series Storage Array to the SAN Connect Eth0, Eth1, Eth2 and Eth3 Connect the console port

PS Series Hardware Architecture

4-22

 PS Series Storage array family

PS Series Hardware Architecture

4-23

 The Controller module for the PS6000 and PS 6500 is identified as the Type 7 controller. This controller has 2 GB Cache per controller Each control module has four 1 Gigabit Ethernet interfaces. It is recommended that you configure and connect all network interfaces. Dual control modules, data is mirrored across battery- backed, write-back caches. If one control module fails, the other control module automatically takes over with no disruption to users. Monitors the PS6000 storage array components Temperature Cooling Fan speeds Disk slot power control Disk presence logic Built around multiple processors to handle the three main processes that are going on within the array: Network interface processing Firmware/ OS functions Monitoring functions Redundancy features enable no single point of failure Cache coherency between controllers, 4 Active Gigabit Ethernet network connections, Active/ Passive relationship between control modules There is control module redundancy, but no Ethernet port redundancy. If a port fails this does not result in a controller failover

PS Series Hardware Architecture

4-24

 Serial Port Serial port 0 used to access the CLI with a terminal

Gigabit Ethernet port

Ports - Eth0, Eth1, Eth2, Eth3 Number from right to left when viewed from the rear of the chassis Control Module LEDs:

ACT LED

Off: No power, secondary control module is not synchronized with active control module, or error condition Green: Active control module (serving network I/o) Orange: Secondary control module. Cache is synchronized with active control module.

ERR LED

Off: Normal operation or no power Red: Array is starting up or error condition Green: Power

PWR LED

PS Series Hardware Architecture

4-25

 The Controller modules for the PS4000 are identified as the Type 8 or 9 controller. The Type 8 has 2 GB Cache per controller , and the Type 9, when available , will have 2 GB Cache per controller

Each control module includes:

Two Gigabit iSCSI Ethernet ports for iSCSI or management traffic One 10Mb/100Mb management port (for use only if you configure a management network) One serial connector (for use if there is no network access to the array) A firmware card running the PS Series firmware. In a Type 8, it is a compact flash card. In a Type 9, it is a micro SD card. Dual control modules, data is mirrored across battery- backed, write-back caches. If one control module fails, the other control module automatically takes over with no disruption to users. Monitors the PS4000 storage array components Temperature Cooling Fan speeds Disk slot power control Disk presence logic Built around multiple processors to handle the three main processes that are going on within the array: Network interface processing Firmware/ OS functions Monitoring functions

PS Series Hardware Architecture

4-26

 Serial Port Serial port 0 used to access the CLI with a terminal

Network port s
Two Gigabit iSCSI Ethernet ports for iSCSI or management traffic, eth0 and Eth1 One 10Mb/100Mb management port (for use only if you configure a management network), Number from right to left when viewed from the rear of the chassis Control Module LEDs: ACT LED Off: No power, secondary control module is not synchronized with active control module, or error condition Green: Active control module (serving network I/o) Orange: Secondary control module. Cache is synchronized with active control module. ERR LED Off: Normal operation or no power Red: Array is starting up or error condition Green: Power

PWR LED

PS Series Hardware Architecture

4-27

 Control Module Monitors the PS5000 storage array components Temperature Cooling Fan speeds Disk slot power control Disk presence logic Built around multiple processors: Network interface processing Firmware/ OS functions Monitoring functions Redundancy features enable no single point of failure

Cache coherency between controllers,

3 Active Gigabit Ethernet network connections, Active/ Passive relationship between CMs Module redundancy but no vertical Ethernet port redundancy

PS Series Hardware Architecture

4-28

 A PS Series array must have at least one network connection but can have up to four active network connections. Each control module has four network interface ports. These are labeled: Ethernet 0, Ethernet 1, Ethernet 2, and Ethernet 3. A dual control module array has four pairs of ports. Both ports in a pair share the same IP address but only one port is used at one time for I/O. General rules for connecting network cables are as follows: Connect network interfaces in the following order: eth0, eth1, eth2, and eth3. To ensure connectivity to the network interface regardless of which control module is active, connect cables to all ports. If possible, connect network interfaces to different switches. Network connections in a dual control module installation: Each Control Module has four connections:

Control Module 0 Ethernet 0 to Switch 1

Control Module 0 Ethernet 1 to Switch 1 Control Module 0 Ethernet 2 to Switch 2 Control Module 0 Ethernet 3 to Switch 2

Control Module 1 Ethernet 0 to Switch 2

Control Module 1 Ethernet 1 to Switch 2 Control Module 1 Ethernet 2 to Switch 1 Control Module 1 Ethernet 3 to Switch 1

Recommendations for network connections for a single control module Connect all ports to the single switch At a minimum, connect Ethernet 0 on both control modules to an Ethernet switch. This will protect against a control module failover. It will not, however, protect against a failure of the Ethernet port (for example, if the cable is disconnected or the switch port fails).

PS Series Hardware Architecture

4-29

 Attach one end of the serial cable to the 9-pin connector on the Active Control Module Attach the other end of the serial cable to a console or computer running a terminal emulator

Default terminal settings are 9600 baud, one stop bit, no parity, 8 data bits and no hardware flow control

PS Series Hardware Architecture

4-30

 PS Series Storage array family

PS Series Hardware Architecture

4-31

 An FRU is any part or component of the PS Series array that can be replaced in the field in the event of a failure of the component. Field replaceable components on the PS Series array are:

Control modules
Control module micro-SD card Power supplies Disk-drives, complete assembly Chassis that contain the mid-plane

PS Series Hardware Architecture

4-32

 After removing a failed control module, follow these steps to install a new control module Remove the control module from its electrostatic bag and place the module on the electrostatic bag.

Open each release latch by squeezing the ends together.

Rotate each latch outward to disengage the controller module from the chassis. Slide the module from the slot. Remove the micro SD card from the old control module and insert it into the new module. Slide the control module into the slot as far as possible. If necessary, hold onto the control module face plate. Rotate each latch inward to engage the controller module to the chassis. Screw in the two screws that attach the controller module to the chassis.

Prior to handling a Control Module , Attach an electrostatic wrist strap

PS Series Hardware Architecture

4-33

 If you are replacing a failed control module, remove the micro SD card from the failed control module d install it in the replacement control module. This will make sure that the new control module is running the correct firmware. 1. Firmly push the card into its housing to release the spring mechanism. The micro SD card will be partially ejected from the housing. 2. Gently pull the card straight out of the housing. 3. Place the micro SD card on a flat surface where it will be protected from electrostatic charge.

Prior to handling a Control Module , Attach an electrostatic wrist strap

PS Series Hardware Architecture

4-34

PS Series Hardware Architecture

4-35

 Identify the failed power supply using the LEDs located on the Power Supply/Cooling module. Remove the power supply as instructed in the diagram.

Slide new power supply into the chassis.

Re-attach the power supply into the chassis slot using the two screws on the power supply. Reconnect the power cable and turn on the power supply. Check that the new power supply LEDs are both on and that the power supply fan status is good in the GUI.

Prior to handling a power supply , attach an electrostatic wrist strap

PS Series Hardware Architecture

4-36

 In order to replace a failed disk, you must first remove the bezel: 1. Insert the bezel key and turn it clockwise to unlock the bezel. 2. Push the bezel release latch up to disengage the bezel from the chassis

3. Hold the bezel and pull it away from the chassis.

PS Series Hardware Architecture

4-37

 Identify the failed disk. It should be the disk with the red LED on. Attach an electrostatic protection device to your wrist as well as a grounded device.

Remove the failed disk.

Press to the left, release handle switch on the disk-drive handle Use the handle to pull out the failed disk-drive Wait approximately 30 seconds to be allow the disk to stop spinning and the heads to land. Install the replacement disk. Use the handle to push in the new disk-drive Press in on the release handle on the disk-drive handle and flip it in to lock the handle in place Check the status of the newly-installed disk. Be sure the disk LED is green.

Check the GUI Alarms panel to be sure there are no indications of a disk failure.
Check that there are no disk failures on the console or in the event log

Prior to handling a disk , attach an electrostatic wrist strap

PS Series Hardware Architecture

4-38

 PS 6500 Series Storage array

PS Series Hardware Architecture

4-39

 An FRU is any part or component of the PS Series array that can be replaced in the field in the event of a failure of the component. Field replaceable components on the PS Series array are:

Control modules
Fan trays Power supplies Disk-drives, complete assembly Chassis that contain the mid-plane Weight of the PS6500 Without hard drives, power supplies, or controllers: 25.50kgs (56.2lbs.) With controller and power supplies but no drives: 35.0kgs (77lbs.) Fully loaded: 80.0kgs (177lbs.)

PS Series Hardware Architecture

4-40

 To remove the failed controller , Label and remove the network cables and remove the serial cable Press the plastic tabs on the controller handle to release the handle

Swing the handles outward to disengage the controller and slide the module from the slot.
Flip the controller upside down on a electrostatic bag and remove the micro SD card To install a new control module Remove the control module from its electrostatic bag and place the module on the electrostatic bag. Open each release latch by squeezing the ends together. Remove the micro SD card from the old control module and insert it into the new module. Slide the control module into the slot as far as possible. If necessary, hold onto the control module face plate. Rotate each latch inward to engage the controller module to the chassis.

Prior to handling a Control Module , Attach an electrostatic wrist strap

PS Series Hardware Architecture

4-41

 If you are replacing a failed control module, remove the micro SD card from the failed control module d install it in the replacement control module. This will make sure that the new control module is running the correct firmware. 1. Firmly push the card into its housing to release the spring mechanism. The micro SD card will be partially ejected from the housing. 2. Gently pull the card straight out of the housing. 3. Place the micro SD card on a flat surface where it will be protected from electrostatic charge.

Prior to handling a Control Module , Attach an electrostatic wrist strap

PS Series Hardware Architecture

4-42

PS Series Hardware Architecture

4-43

 Identify the failed power supply using the LEDs located on the Power Supply/Cooling module and also the LCD panel on the front of the array To remove the power supply

Disconnect any power cables from the module.

Squeeze together the module latches to release the handle and rotate the handle downwards. This action will disengage the module from the chassis. Carefully slide the module from the slot. Store the module where it will be protected from electrostatic discharge. Do not stack modules To install the new power supply module Slide new power supply into the chassis. Squeeze together the module latches to release the handle and rotate the handle downwards. Push the module completely into the slot, simultaneously rotating the handle upwards to close it and seat the module, Reconnect the power cable and turn on the power supply. Check that the new power supply LEDs are both on and that the power supply fan status is good in the GUI. Note: All power supplies must be inserted into the chassis in order for the system to power up

Prior to handling a power supply , attach an electrostatic wrist strap

PS Series Hardware Architecture

4-44

 Locate the failed disk drive by carefully sliding the array out on its rack system and then removing the bezel. To determine which drive has failed Use the LCD panel on the front

The associated event

The failed disk drive can be identified by the failed disk LED located on the disk drive. Any failed drive will have a yellow LED turned on Locate the failed drive, it should be the disk with the yellow LED on. Attach an electrostatic protection device to your wrist as well as a grounded device. Remove the failed disk. Slide the latch in the direction of the arrow on the disk drive Pull up on the handle, this disengages the disk drive from the slot Use the handle to pull out the failed disk-drive Wait approximately 30 seconds to be allow the disk to stop spinning and the heads to land.

Use the handle to push in the new disk-drive

Press the release handle down to engage the disk-drive and flip it in to lock the handle in place Check the status of the newly-installed disk. Be sure the disk LED located on the front of the array is green and also the LCD panel on the front of the array indicated the drive is okay Check the GUI Alarms panel to be sure there are no indications of a disk failure. Check that there are no disk failures on the console or in the event log

PS Series Hardware Architecture

4-45

 Carefully slide the array our on it rack system and then remove the bezel to determine which Channel card has failed, you should also use the associated event log to aid in identifying the failed Channel card. You can also identify the failed Channel card using the Hardware status LEDs located on the front of the array and also the LCD panel on the front of the array To remove the Channel Card Once the array is pulled out from the rack, locate the failed card, the card with the middle and rear green LEDs that are flashing indicated an initialization failure Attach an electrostatic protection device to your wrist as well as a grounded device. Locate the channel card you want to remove and open the two channel card latches by rotating each latch upwards. This action will disengage the channel card from the chassis. Hold the channel card by the plastic handle and carefully pull up, sliding the channel card from the slot. Store the channel card where it is protected from electrostatic discharge. To replace the channel card Hold the replacement channel card by the plastic handle and orient the card with the channel card LEDs facing the front of the chassis. Carefully slide the channel card partially into the slot, using the metal groove on the rear of the slot as a guideline. Do not force the card into the slot. Open the two channel card latches and slide the channel card completely into the slot Rotate the latches downwards to close the latches and secure the card in the slot. Make sure the channel card is completely seated. The card should not protrude from the top of the chassis. Close the chassis and reinstall the bezel

PS Series Hardware Architecture

4-46

 Carefully slide the array out on its rack system and then remove the bezel to identify the failed EIP card. You should also use the associated event log to aid in identifying the failed EIP card. You can also identify the failed EIP card using the LEDs located on the front of the array and also the LCD panel on the front of the array To remove the EIP card Use a phillips screwdriver to release the thumbscrew on the card. Hold the EIP card mounting bracket and carefully pull up and slide the card from the chassis Note: Store the EIP card where it is protected from electrostatic discharge. To replace the EIP card Hold the replacement EIP card by the mounting bracket and orient the card in the direction with the thumbscrew facing the front of the array. Carefully slide the replacement EIP card into the slot, using the metal groove on the rear of the slot as a guideline. Do not force the card into the slot. Make sure the card is completely seated. The card should not protrude from the top of the chassis. Use a phillips screwdriver to tighten the EIP card thumbscrew. Note: The array will emit an audible signal when the EIP card boots. Close the chassis and reinstall the bezel

PS Series Hardware Architecture

4-47

PS Series Hardware Architecture

4-48

 The PS Series array is comprised of 4 key components: Control Module (CM) There are two one active and the other standby

Each CM has three Gigabit Ethernet interfaces

Mid-plane 14 Serial ATA connectors for connectivity to disk drives 2 connectors for connectivity to 2 control modules 2 connectors for connectivity to fan trays (EMM) Fan trays There are two fan trays for redundancy On the fan tray is the Environmental Management Module (EMM) that is responsible for monitoring the fans, drives, power, and temperature Power supplies

There are two for redundancy

PS Series Hardware Architecture

4-49

 14 Disk Drives Array LEDs

Array LEDs Color PWR Off Green WARN Off Red Description No power. Power. No power or normal condition. One or more of the following has occurred: RAIDset is degraded but still functioning. RAIDset (volume) has lost blocks. Temperature of a component is near upper limit. Fan tray fan RPMs exceed upper or lower limit. Power supply fan has failed. Power supply is not installed or has no power. Only one functioning control module. Lock on secondary control module is open. Active control module is syncing with secondary. No communication between control modules. No replication progress for 1 hour or more. A non-critical hardware component has failed. No power or normal condition. One or more of the following has occurred: RAIDset is not functioning. Lost block table is full. Array temperature exceeds upper limit. Control module cache has lost data. One or both fan trays are not installed. Both fans on a fan tray have failed. Cache battery has less than 72 hours of charge. NVRAM coin cell battery has failed. Cache contains data that does not belong to any of the installed disks. More than one valid RAIDset exists in the array. Control modules are different models. A critical hardware component has failed.

ALRM

Off Red

PS Series Hardware Architecture

4-50

 The PS Series provides the following: Two control modules CM0 is on top

CM1 is on the bottom

Two redundant fan trays Fan tray 0 is on the right Fan tray 1 is on the left Two redundant power supplies It is recommended that each power supply is plugged into a separate circuit for increased availability. Two versions of power supplies You cannot mix two power supplies The two can be identified by looking at the fan outlets on the power supply Honey comb Concentric circles

PS Series Hardware Architecture

4-51

Control Module handle and lock system Left-hand handle Slide lock mechanism to the left to remove connectivity to the controller module Handles are used to remove and extract the controller module

Gigabit Ethernet port Ports - Eth0, Eth1 and Eth2 Eth0 and Eth1 are redundant. This means that the active controller can access either port in the pair Eth2 is non-redundant and needs a cable in both ports for redundancy Gigabit Ethernet ports are either copper or fiber Copper is Cat5E or Cat6 only Fiber LC Type SFP must be purchased separately

Serial Ports - CM Type 1 Serial port 0 console port and connection requirement 9600 baud, one stop bit, no parity, 8 data bits, and no hardware flow control Serial Port 1 not used

Two different Controller Modules now available Type 1 is the original Controller Module and can be identified by the two serial port connectors on the far right on the face plate Type 2 is the new Controller Module and can be identified by the single RJ-45 serial port on the far right of the face plate You cannot inter-mix the two controllers. Both CM0 and CM1 must be the same type within the same PS Series Storage array. You can mix Controller module types within a group. You can have two type 1s in one PS Series Storage Array and 2 two type 2s in a second PS Series Storage Array within the same group or as replication partners

PS Series Hardware Architecture

4-52

 Mid-plane is responsible for: Disk slot power control SATA mux for redundant control modules

Disk presence logic

Control Module Built around the Broadcom processor which contains: 2 high performance processors 3 10/100/1000 Gigabit Ethernet MACs Redundancy features enable no single point of failure Redundancy FPGA enables arbitration between controllers to determine which one becomes active. PCI and 2 SATA links between control modules in target mode used as highspeed connection for cache coherency

Ethernet port redundancy

PS Series Hardware Architecture

4-53

 EMM is located on the fan tray and is responsible for monitoring Fans for rotation and detection of a fan failure Disk-drive power

Temperature, where there are 6 total temperature check locations

2 on the mid-plane, both are active to monitor the chassis temperature 2 on each controller, One temperature monitors the chipset and the other monitors the CPU. The CPU is the higher temperature Control module presence

PS Series Hardware Architecture

4-54

 Control Module LEDs

PS Series Hardware Architecture

4-55

 Step one Unpack the PS Series Array Open the outer shipping box Remove the box containing the chassis and place on a secure, stable surface Open the chassis box and remove the foam caps Remove the rails for the shelf assembly kit Remove the accessories Attach the electrostatic wrist guard to wrist Remove the chassis and place on a secure, stable surface Step two - Prepare the rack for installing the PS Series Storage Array Install the rack mounting self hardware Two types of rack mount hardware Center rack mount 4 Post rack mount Step three - Install components into the PS Series Storage Array Chassis Install the disk-drives and any blanks if required Install the power supplies Install the fan trays Install the controller modules Step four - Connect the PS Series Storage Array to the SAN Connect Eth0, Eth1 and Eth2 Connect the Console port

PS Series Hardware Architecture

4-56

 The serial connection must have the following parameters set: 9600 baud One stop bit

No parity
8 data bits No hardware flow control For the Type 1 control module, always connect to serial port 0 on the active controller. For the Type 2 control module, connect to the RJ-45 connector of the active controller. If 100% serial port connectivity is required, connect a serial cable to the serial port of the standby controller module. In the event that the primary, active controller should fail then the secondary will be accessible.

PS Series Hardware Architecture

4-57

 A PS Series storage array must have at least one active network connection but can have up to three network connections. Each control module has three network interface ports. These are labeled: eth0, eth1, and eth2. A dual control module array has three pairs of ports. Both ports in a pair share the same IP address but only one port is used for I/O. General rules for connecting network cables are as follows: Connect network interfaces in the following order: eth0, eth1, and eth2. If possible, connect network interfaces to different switches. The eth0 and eth1 port pairs are redundant. If you connect a cable to one port in a redundant pair, both control modules can use the cable connection regardless of the active control module. To ensure connectivity to the eth2 network interface regardless of which control module is active, connect cables to both ports in the pair. Network connections in a dual control module installation where CM0 is active CM0 has three network connections: CM0s Eth0 to switch 1 CM1s Eth1 to switch 2 CM0s Eth2 to switch 2 If CM0 Fails, CM1 takes over and has 2 network connections CM1s Eth1 to switch 2 CM1s Eth2 to switch 1 Network connections for a single control module Connect all ports to the single switch

PS Series Hardware Architecture

4-58

 An FRU is any part or component of the PS Series array that can be replaced in the field in the event of a failure of the component. Field replaceable components on the PS Series array are:

Control Modules
Fan trays Power Supplies Disk Drives, complete assembly Chassis that contains the mid-plane

PS Series Hardware Architecture

4-59

 After removing a failed control module, follow these steps to install a new control module Remove the control module from its electrostatic bag and place the module on the electrostatic bag.

Grasping the face plate, connect the battery.

Slide the control modules slide switch to the right so that it covers the LED text and pull out the handles. Remove the flash card from the old control module and insert it into the new module. Slide the control module into the slot as far as possible. If necessary, hold onto the control modules face plate. Grasp both handles on the control module and push in the handles to securely engage the control module with the chassis. Slide the control modules locking mechanism to the left so that the LED text is unobstructed. Screw in the two screws that attach the control module to the chassis.

PS Series Hardware Architecture

4-60

 Identify the failing fan. It should have either a solid red LED, black LED or blinking red/green LED. Remove the fan tray as illustrated in the diagram by loosening the retaining screws.

Slide the old fan out of the tray

Slide a new fan tray into the chassis slot. Reattach the fan tray to the chassis using the two screws. After installing the new fan tray, verify it is operational by observing the LED. It should turn green within 1 minute.

PS Series Hardware Architecture

4-61

 Identify the failed power supply. It should be the power supply with the LEDs that are off. Note: A power supply fan failure can only be determined through the GUI. Remove the power supply as instructed in the diagram.

Slide the new power supply into the chassis.

Re-attach the power supply into the chassis slot using the two screws on the power supply. Reconnect the power cable and turn on the power supply. Check that the new power supply LEDs are both on and that the power supply fan status is good in the GUI. Two types of power supplies The power supplies MUST be the same type within the PS Series array The type of power supply can be identified by looking at the fan outlet on either side of the power connection

PS Series Hardware Architecture

4-62

 Identify the failed disk. It should be the disk with the red LED on. Attach an electrostatic protection device to your wrist as well as a grounded device.

Remove the failed disk.

Press down on the locking switch on the disk drive handle. Use the handle to pull out the failed disk drive. Wait about 10-20 seconds to be sure that any cached information related to the failed drive is flushed. Install the replacement disk. Use the handle to push in the new disk drive. Press down on the locking switch on the disk drive handle and flip it forward to lock the handle in place. Check the status of the newly-installed disk.

Be sure the disk LED is green.

Check the GUI Alarms panel to be sure there are no indications of a disk failure. Check for no disk failures on the console or in the event log.

PS Series Hardware Architecture

4-63

PS Series Hardware Architecture

4-64