Drive Replacement Guide

Isilon
NL400

Replace a drive
994-0018-01
REV M
May 2017

l Replacing a drive.................................................................................................... 2
l Drive types............................................................................................................. 2
l Confirm SSD compatibility......................................................................................2
l Gather logs............................................................................................................. 3
l Install a drive support package................................................................................3
l Download a Field Replacement Unit (FRU) package............................................... 4
l Smartfail the drive.................................................................................................. 4
l Install the drive replacement...................................................................................5
l Install the FRU package and run scripts.................................................................. 8
l Update drive firmware........................................................................................... 11
l Verify a drive firmware update............................................................................... 11
l Gather logs............................................................................................................12
l Returning a failed part to Isilon..............................................................................13
l Update the install database................................................................................... 13
l Where to go for support........................................................................................ 13
Drive Replacement Guide

Replacing a drive
You can replace a failed drive in the field.

CAUTION

Perform this procedure on only one node at a time. Performing maintenance on

multiple nodes in parallel may lower the protection level of the cluster, put data
at risk, and lead to the interruption of client workflows.

Working with clusters in SmartLock compliance mode

Clusters running in SmartLock compliance mode require a sudo prefix to run root
commands.
If a cluster is running in SmartLock compliance mode, root access is disabled on the
cluster. Because of this, you can run some commands only through the sudo program.
Prefixing a command with sudo enables you to run commands that require root
access. For example, if you do not have root access, the following command fails:

isi drivefirmware status

However, if you are on the sudoers list, the following command succeeds:

sudo isi drivefirmware status

Compliance mode commands that require changes beyond the sudo prefix are noted
in the procedure steps.
For more information on the sudo program and compliance mode commands, see the
OneFS CLI Administration Guide.

Drive types
This procedure applies to all drive types.
You can follow this procedure with self-encrypting drives (SEDs), hard disk drives
(HDDs), or solid state drives (SSDs).

Confirm SSD compatibility

If you are installing a new solid state drive (SSD) into a cluster, you must confirm that
the drive you have onsite is compatible with the cluster.
See the Isilon Supportability and Compatibility Guide to determine whether the drive
you have is compatible with the cluster.

2 NL400 Drive Replacement Guide

 Replace a drive

Gather logs
Before you begin any maintenance on a cluster, gather cluster logs.
You must collect cluster logs before all maintenance procedures. Cluster logs provide
snapshots of the cluster, which you can review to make sure that maintenance is
successful.
Procedure
1. Open a secure shell (SSH) connection to any node in the cluster and log in.
2. Gather cluster logs by running the following command:
isi_gather_info

Install a drive support package

Before you install a new drive, download and install the drive support package. The
drive support package updates drive configuration information on the node, and
contains the latest firmware versions for Isilon qualified drives.
The drive support package is only supported by clusters running OneFS 7.1.1 or later. If
your cluster is running an earlier version of OneFS, you can skip this step.
Procedure
1. Go to the EMC Support page that lists all the available versions of the drive
support package.
2. Click the latest version of the drive support package and download the file.

Note

See the Considerations for installing the latest drive support package section in
order to select the appropriate variant of the package. If you are unable to
download the package, contact EMC Isilon Technical Support for assistance.

3. Open a secure shell (SSH) connection to any node in the cluster and log in.
4. Create or check for the availability of the directory structure /ifs/data/
Isilon_Support/dsp.
5. Copy the downloaded file to the dsp directory through SCP, FTP, SMB, NFS,
or any other supported data-access protocols.
6. Unpack the drive support package by running the following command:
tar -zxvf Drive_Support_<version>.tgz

7. Install the package by running the following command:

isi_dsp_install Drive_Support_<version>.tar

Note

You must run the isi_dsp_install command to install the dirve support
package. Do not use the isi pkg command.

Gather logs 3
Drive Replacement Guide

Download a Field Replacement Unit (FRU) package

Before you replace a component in a configure-to-order (CTO) node, obtain a Field
Replacement Unit (FRU) package from the EMC FTP site. The FRU package updates
the CTO and as-built information on the node, then forwards the updated information
to Isilon Technical Support.
Procedure
1. Download the latest FRU package from ftp://ftp.emc.com/outgoing/
Fru_Package/.
2. Note the name of the FRU package. You will use the name for other commands.
Package names follow this convention:
IsiFru_Package_ <date-time-stamp> .tgz
For example: IsiFru_Package_201507072125.tgz

3. Place the FRU package on the cluster through a network drop, or by asking
someone at the cluster site to place the package for you. If neither of these
options is available to you, contact Isilon Technical Support for assistance.

Smartfail the drive

Before removing a drive from a node, you should make sure the drive has been
smartfailed.
Procedure
1. Open a secure shell (SSH) connection to the node that contains the drive you
want to remove. Type the command:
ssh <cluster-name>-<node-number>

2. Confirm the node number and bay number of the drive you want to remove.
Depending on your version of OneFS, type one of the following commands:
OneFS 8.0 or later
isi devices drive list

Earlier than OneFS 8.0

isi devices

Note

Note the node number and bay number of the drive you want to remove. If the
drive you need to remove has already been smartfailed automatically, you can
skip the next step. A smartfailed drive will display a status of REPLACE or, if the
node was restarted after the smartfail, a status of EMPTY. A smartfailed SED
drive might display a status of ERASE. This status also indicates the node is
ready to be replaced.

3. Using the node number and bay number of the drive, smartfail the drive by
typing one of the following commands:

4 NL400 Drive Replacement Guide

 Replace a drive

OneFS 8.0 or later

isi devices drive smartfail <bay-number> --node-lnn <node-
number>
Earlier than OneFS 8.0
isi devices -a smartfail -d <node-number>:bay<bay-number>

If the drive does not respond to the smartfail command, do not remove it from
the node. Contact Isilon Technical Support.

4. Confirm that the drive was smartfailed by repeating step two.

CAUTION

Do not replace the drive until you have confirmed that the smartfail
process is complete.

Install the drive replacement

Remove the failed drive and install the replacement drive.

Access the drives

You can access drives by removing the panels that cover the drive bays.
Procedure
1. To access drives at the front of the node, remove the front panel.
There is a release button on each side of the front panel. To remove the panel,
press in the panel release buttons while pulling the panel away from the node.

1. Front panel

Install the drive replacement 5

Drive Replacement Guide

2. To access drives at the back of the node, remove the rear EMI shield.
There is a vertical handle at each end of the shield. To remove the shield, press
the handles toward the center of the shield while pulling away from the node.

1. Rear EMI shield

Remove the failed drive

Drives are secured in the node. You must release the locking handle before removing a
drive.
Procedure
1. To remove a drive, pull the locking handle on the drive toward you.
The drive will release from the node.

6 NL400 Drive Replacement Guide

 Replace a drive

1. Locking handle 2. Drive bay

Install the new drive

You install a drive in a node by inserting it into an empty drive bay.
Procedure
1. With the locking handle on the drive open, insert the drive into the empty drive
bay by sliding the drive along the bay rails until it stops.
Do not force the drive into the drive bay. Forcing the drive into the drive bay
could damage both the drive and the drive bay.
2. Hold the drive in place and gently push the locking handle down against the end
of the drive to secure, or seat, the drive in the node.
Drives that are not fully seated will not be recognized when the node is started,
and a red light will appear above the drive. To avoid this problem, run your
finger across all the installed drives to ensure that they are all seated evenly.
3. Connect the drive to the node using the node number and bay number where
you just inserted the drive. Depending on your version of OneFS, run one of the
following commands:
OneFS 8.1 or later
OneFS will automatically add the drive. If ARR (Automatic Replacement
Recognition) has been disabled, add the drive with the OneFS 8.0
command.

Install the new drive 7

Drive Replacement Guide

OneFS 8.0
isi devices drive add <bay-number> --node-lnn <node-number>

Earlier than OneFS 8.0

isi devices -a add -d <node-number>:<bay-number>

The add command connects the drive to the node.

If the add command fails, make sure that the drive is formatted by running one
of the following commands:
OneFS 8.0 or later
isi devices format <bay-number> --node-lnn <node-number>

Earlier than OneFS 8.0

isi devices -a format -d <node-number>:<bay-number>

The format command introduces the drive to the cluster.

If the drive does not respond to either of these commands, do not remove the
drive from the node. Contact Isilon Technical Support.

4. After the new drive has been installed, replace the front panel on the node by
aligning the panel with the front of the node and pressing the panel until it clicks
onto the node.
If you replaced a drive in the rear of the node, replace the EMI shield.

Install the FRU package and run scripts

Update the configure-to-order (CTO) and as-built information on the node by
installing a FRU package.

Note

If your cluster is running in SmartLock compliance mode with OneFS 7.0.2.10 or later,
7.0.1.4 or later, or 7.1.1.0 or later you will need to enter the provided compliance mode
commands to run the FRU scripts. If your cluster is running in compliance mode but is
not running one of these versions, you will need to upgrade your OneFS version to
support the compliance mode commands. Contact Isilon Technical Support.

Install the FRU package on the node

Unpack and install the FRU package on the node.
Procedure
1. Place the FRU package on the node.
2. Unpack the FRU package by running the following command:
tar -zxvf IsiFru_Package_<date-time-stamp>.tgz

3. Type cd to change to the directory containing the FRU tar.

4. Install the package. Depending on your version of OneFS, run one of the
following commands:

8 NL400 Drive Replacement Guide

 Replace a drive

OneFS 8.0 or later

isi upgrade patches install IsiFru_Package_<date-time-
stamp>_.tar
Earlier than OneFS 8.0
isi pkg install IsiFru_Package_<date-time-stamp>.tar

As the package installs, the following message appears:

Preparing to install the package...

Checking the package for installation...
Installing the package
Committing the installation...
Package is committed.

Run the update script

After the FRU package is installed on the node, run the update script.
Procedure
1. Move to the FRU package location by running the following command:
cd /var/crash/cto/fruPackages/IsiFru_Package_<date-time-stamp>

2. Perform the update script by running the following command:

./isi_fru_update_cluster

The system displays confirmation of the following items:

l CTO capability
l Current node hardware configuration

Run the ABR script

Run the As Built Record (ABR) script to report the updated hardware to Isilon
Technical Support.
Procedure
1. Verify installation of the updated hardware by running the following command:
./isi_cto_update --abr

The update is verified and a series of status messages confirm the node
configuration, and if an FTP connection is available, an updated ABR is sent to
Isilon Technical Support.
2. If an external connection is not available, manually collect and deliver to Isilon
Technical Support the updated ABR.
3. If the cluster is running in SmartLock compliance mode, verify installation of the
updated hardware by running the following command:
sudo /usr/bin/isi_hwtools/isi_cto_update --abr --filepath .

Note

You must include the period at the end of the command.

Run the update script 9

Drive Replacement Guide

Sending an ABR to Isilon with no connectivity

If no external connectivity is available, the As Built Record on a Configure to Order
(CTO) node cannot be automatically delivered to Isilon Technical Support.
If external connectivity is available, the ABR is automatically generated and delivered
to Isilon Technical Support. If there is no external connectivity available, you must
generate and copy the ABR from the node, and then send the ABR to Isilon Technical
Support through an alternate connection.

Generate an ABR
You can manually send an As Built Record (ABR) by copying an XML file from the
node and emailing the file to Isilon Technical Support. You need network access to the
node, or you can request that the customer provide the file to you.
Procedure
1. Generate an ABR by running the following command:
isi_make_abr

The command generates a temporary file named asbuilt_ <serial-

number>_<date-time-stamp> .xml.
2. Identify the full name of the ABR file by running the following command:
isi_inventory_tool --display --itemType asbuilt | grep
asbuiltFileName=
The system output contains information about the ABR file.

3. Place the ABR file where you can copy it by running the following command:
isi_inventory_tool --display --itemType asbuilt > /ifs/
asbuilt_ <serial-number>_<date-time-stamp> .xml

4. Copy the generated asbuilt_ <serial-number>_<date-time-stamp> .xml file.

5. If an FTP connection is not available, contact Isilon Technical Support for an
alternate delivery method.

Remove the FRU package from the node

After all scripts are run, remove the FRU package from the node.
Procedure
1. Change out of the FRU package directory by running the following command:
cd /

2. Delete the FRU package from the node. Depending on your version of OneFS,
run one of the following commands:
OneFS 8.0 or later
isi upgrade patches uninstall IsiFru_Package_ <date-time-
stamp>
Earlier than OneFS 8.0
isi pkg delete IsiFru_Package_ <date-time-stamp>

10 NL400 Drive Replacement Guide

 Replace a drive

Update drive firmware

After you install a new drive in a node, update drive firmware.
This procedure explains how to update drive firmware on clusters running OneFS 7.1.1
or later. If your cluster is running an earlier version of OneFS, you must download and
install the latest drive firmware package. For more information, see the latest drive
firmware package release notes available on https://support.emc.com/.

Note

Do not restart or power off nodes while drive firmware is being updated on the cluster.

Procedure
1. Open a secure shell (SSH) connection to any node in the cluster and log in.
2. Depending on your version of OneFS, run one of the following commands to
update the drive firmware for your cluster:
OneFS 8.0 or later
To update the drive firmware for your entire cluster, run the following
command:
isi devices drive firmware update start all --node-lnn
all
To update the drive firmware for a specific node only, run the following
command:
isi devices drive firmware update start all --node-lnn
<node-number>
OneFS 7.1.1 - OneFS 8.0
For OneFS versions between 7.1.1 - 8.0 you will need to run the following
command on each node that requires drive firmware:
isi devices -a fwupdate

CAUTION

You must wait for one node to finish updating before you initiate an update
on the next node. To confirm that a node has finished updating, run the
following command:
isi devices -d <node-number>
A drive that is still updating will display a status of FWUPDATE.

Updating the drive firmware of a single drive takes approximately 15 seconds,

depending on the drive model. OneFS updates drives sequentially.

Verify a drive firmware update

After you update the drive firmware in a node, confirm that the firmware is updated
properly and that the affected drives are operating correctly.
Procedure
1. Ensure that no drive firmware updates are currently in progress by running one
of the following commands:

Update drive firmware 11

Drive Replacement Guide

OneFS 8.0 or later

isi devices drive firmware update list

Earlier than OneFS 8.0

isi devices

If a drive is currently being updated, [FW_UPDATE] appears in the status

column.
2. Verify that all drives have been updated by running the following command:
OneFS 8.0 or later

isi devices drive firmware list

Earlier than OneFS 8.0

isi drivefirmware status

If all drives have been updated, the Desired FW column is empty.

3. Verify that all affected drives are operating in a healthy state by running the
following command:
OneFS 8.0 or later

isi devices drive list --node-lnn all

Earlier than OneFS 8.0

isi devices

If a drive is operating in a healthy state, [HEALTHY] appears in the status

column.

Gather logs
After you complete maintenance on a cluster, gather cluster logs.
You must collect cluster logs after all maintenance. Cluster logs provide snapshots of
the cluster that you can review to make sure that maintenance is successful.
Procedure
1. Gather cluster logs by typing the command:

12 NL400 Drive Replacement Guide

 Replace a drive

isi_gather_info

Returning a failed part to Isilon

Return the failed part to Isilon Technical Support.
Procedure
1. Contact Isilon Technical Support to notify them that you are returning a failed
part.
2. Package the failed part in the packaging materials provided with the
replacement part.
3. Attach the return label that was included with the replacement part.
4. For the RMA number, write the support case number provided by Isilon
Technical Support.
5. Ship the failed part to the address specified on the return label.

Update the install database

After all work is complete, update the install database.
Procedure
1. Browse to the EMC Product Registration and Install base Maintenance
service portal, at: http://emc.force.com/createPSCcase.
2. Select the Product Registration and Install Base Maintenance
option.
3. To open the form, select the IB Status Change option.
4. Complete the form with the applicable information.
5. To submit the form, click Submit.

Where to go for support

Contact EMC Isilon Technical Support for any questions about EMC Isilon products.

Online Support Live Chat

Create a Service Request

Telephone United States: 1-800-SVC-4EMC (800-782-4362)

Support Canada: 800-543-4782
Worldwide: +1-508-497-7901
For local phone numbers for a specific country, see EMC
Customer Support Centers.

Help with Online For questions specific to EMC Online Support registration or
Support access, email support@emc.com.

Isilon Info Hubs For the list of Isilon info hubs, see the Isilon Info Hubs page on the
EMC Isilon Community Network. Isilon info hubs organize Isilon
documentation, videos, blogs, and user-contributed content into

Returning a failed part to Isilon 13

Drive Replacement Guide

topic areas, making it easy to find content about subjects that

interest you.

Support for IsilonSD Edge

If you are running a free version of IsilonSD Edge, community support is available
through the EMC Isilon Community Network. However, if you have purchased one or
more licenses of IsilonSD Edge, you can contact EMC Isilon Technical Support for
assistance, provided you have a valid support contract for the product.

14 NL400 Drive Replacement Guide

 Replace a drive

Copyright 2017 EMC Corporation All rights reserved.

Published May 2017

Dell believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.

THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS-IS. DELL MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH
RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR
FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION
REQUIRES AN APPLICABLE SOFTWARE LICENSE.

Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners.
Published in the USA.

Where to go for support 15