3PAR Confidential 3PAR InServ ® 2.3.1 T-Class Storage Server Maintenance Manual 3PAR, Inc. 4209 Technology Drive Fremont, CA 94538 U.S.A. Part No. 325-200090 Rev C August 2010
Dec 31, 2015
3PAR Confidential
3PAR InServ® 2.3.1 T-Class Storage Server Maintenance Manual
3PAR, Inc.4209 Technology DriveFremont, CA 94538 U.S.A.
Part No. 325-200090 Rev CAugust 2010
Revision NoticeThis is the third release of this manual. A complete revision history is provided at the end of this manual.
ChangesWhile reasonable efforts have been made in the preparation of this document to assure its accuracy, 3PAR Inc. assumes no liability resulting from errors or omissions or from the use of the information contained herein.3PAR Inc. reserves the right to change the product design and documentation without reservation and without notification.
Updates to the Documentation at 3PAR CentralAny updates to this document, or other 3PAR technical documents, can be found by logging into 3PAR Central's Document Control System from 3PAR's Support page, at: http://support.3PAR.com.
3PAR Technical Support and ServicesContact your local service provider for technical support and services, at: http://www.3PAR.com/services.html.
Sales and Ordering InformationFor sales and ordering information contact:3PAR, Inc. 4209 Technology DriveFremont, CA 94538Telephone: 510–413–5999Fax: 510–413–5699E-mail: [email protected]
Reader Comments and SuggestionsPlease E-mail your comments and suggestions about this document to [email protected].
Copyright
Printed MaterialCopyright © 2009-2010, 3PAR Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior written consent of 3PAR Inc., 4209 Technology Drive, Fremont, CA 94538. The users may print one copy for personal use. Production of multiple copies or copies for sale is strictly prohibited.
Trademarks3PAR, InServ, InForm, InSpire and Serving Information are registered trademarks of 3PAR Inc.Microsoft, Windows, Windows 2000, and Windows NT are either registered trademarks or trademarks of Microsoft Corporation. NEMA is a registered trademark of National Electrical Manufacturers Association.SecureCRT is a registered trademark of VanDyke Software, Inc.UL is a registered trademark of Underwriters Laboratories Inc.All other trademarks and registered trademarks are owned by their respective owners.
Federal Communications Commission Radio Frequency Interference StatementWARNING: Changes or modifications to this unit not expressly approved by the party responsible for compliance could void the user’s authority to operate the equipment.
This device complies with Part 15 of FCC Rules. Operation is subjected to the following two conditions (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation.
This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense.
3PAR Confidential
Canadian Compliance StatementThis ClassA digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations.Cet appareil numérique de la classe A respecte toutes les exigences du Règlement sur le matérial brouilleur du Canada.
Japanese Compliance Statement
This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio disturbance may arise. When such trouble occurs, the user may be required to take corrective actions.
European Compliance Statement:This product complies with CENELEC EN55022 Class A and EN55024:1998/A1:2001 specifications for Information Technology Equipment (ITE).
WARNING: This is a Class A product. In a domestic environment, this product may causeradio interference in which case the user may be required to take adequate measures.
3PAR Confidential
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Table of Contents
1 Introduction
1.1 Related Documentation 1.2
1.2 Organization 1.3
1.3 Typographical Conventions 1.5
1.4 Advisories 1.6
1.5 Using this Guide 1.6
2 Precautions
2.1 General Precautions 2.2
2.2 Disk and Drive Magazine Precautions 2.3
2.3 Controller Node Precaution 2.4
2.4 Clock Battery Precaution 2.4
2.5 Drive Chassis and Node Power Supply Precaution 2.5
2.6 Battery Backup Unit Precautions 2.5
2.7 Power Distribution Unit Precautions 2.6
2.8 AC Cord Precaution 2.6
3 Connecting the Maintenance PC
3.1 Connecting to a Controller Node 3.2
3PAR ConfidentialvTable of Contents
vi
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3.2 Connecting to the Service Processor 3.9
3.2.1 Using a Serial Connection 3.9
3.2.2 Using an Ethernet Connection 3.17
3.2.2.1 Logging into the SP Onsite Customer Care Interface (SPOCC) 3.22
3.2.3 Using a Secure Shell Protocol 3.24
3.2.3.1 Using PuTTy 3.24
3.2.3.2 Using Secure CRT 3.27
3.3 Serial Cable Pinouts 3.30
3.3.1 Crossover Adapter Assembly 3.30
3.3.2 Straight-Through Adapter 3.31
4 Understanding LED Status
4.1 Using the Component LEDs 4.2
4.1.1 Removing the Bezels and Unlocking the Door 4.2
4.1.2 Drive Cage LEDs 4.3
4.1.2.1 DC4 Drive Cage FC-AL Module LEDs 4.4
4.1.2.2 Drive Magazine LEDs 4.7
4.1.3 Controller Node LEDs 4.9
4.1.4 QLogic iSCSI Port LEDs 4.12
4.1.5 3PAR Fibre Channel Port LEDs 4.13
4.1.6 Power Supply LEDs 4.14
4.1.7 Battery Backup Unit LEDs 4.16
4.1.8 Power Distribution Unit Lamps 4.17
4.2 Service Processor LEDs 4.18
4.2.1 Wintec Service Processor 4.18
4.2.2 Supermicro Service Processor 4.19
4.2.3 Supermicro II Service Processor 4.21
5 Powering Down the Storage Server
5.1 General Precautions 5.1
5.2 Power-Down Procedure 5.2
Table of Contents
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Drive Chassis Maintenance Procedures
6 Replacing a Disk on a Drive Magazine
6.1 General Precautions 6.1
6.2 Planning 6.2
6.2.1 Logging Mode 6.2
6.3 Drive Replacement Procedure 6.3
7 Replacing a Drive Magazine
7.1 General Precautions 7.1
7.2 Planning 7.2
7.2.1 Logging Mode 7.2
7.3 Drive Magazine Replacement Procedure 7.3
8 Replacing an SFP Module on an FC-AL
8.1 General Precautions 8.2
8.2 SFP Module Replacement Procedure 8.2
9 Replacing a Drive Cage FC-AL Module
9.1 General Precautions 9.1
9.2 FC-AL Replacement Procedure 9.2
10 Replacing a Drive Cage Midplane Assembly
10.1 General Precautions 10.1
10.2 Planning 10.2
10.3 Migrating Data Off the Drive Cage 10.2
10.4 Midplane Assembly Replacement Procedure 10.6
10.5 Migrating Data Back to the Drive Cage 10.11
11 Replacing a Controller Node
11.1 General Precautions 11.1
11.2 Controller Node Replacement Procedure 11.2
viiTable of Contents
3PAR Confidential
viii
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Controller Node Maintenance Procedures
12 Replacing an SFP on a PCI Adapter
12.1 General Precautions 12.1
12.2 SFP Module Replacement Procedure 12.2
13 Replacing a PCI Adapter
13.1 General Precautions 13.1
13.2 PCI Adapter Replacement Procedure 13.2
14 Replacing Control Cache
14.1 General Precautions 14.1
14.2 Control Cache Replacement Procedure 14.2
15 Replacing Data Cache
15.1 General Precautions 15.1
15.2 Data Cache Replacement Procedure 15.2
16 Replacing a Data Cache Riser Card
16.1 General Precautions 16.1
16.2 Data Cache Riser Card Replacement Procedure 16.2
17 Replacing a Disk in a Node
17.1 General Precautions 17.1
17.2 Node Disk Replacement Procedure 17.2
17.2.1 Performing Node Rescue 17.4
18 Replacing a Clock Battery
18.1 General Precautions 18.1
18.2 Clock Battery Replacement Procedure 18.1
19 Replacing a Controller Node Chassis
19.1 General Precautions 19.1
19.2 Removing a Controller Node Chassis 19.2
Table of Contents
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
19.3 Unpacking a Controller Node Chassis 19.7
19.4 Installing a Replacement Controller Node Chassis 19.9
20 Replacing a Controller Node Power Supply
20.1 General Precautions 20.1
20.2 Controller Node Power Supply Replacement Procedure 20.2
Power System Maintenance Procedures
21 Replacing a Drive Chassis Power Supply
21.1 General Precautions 21.2
21.2 Drive Chassis Power Supply Replacement Procedure 21.2
22 Replacing a Battery Backup Unit
22.1 General Precautions 22.1
22.2 Battery Backup Unit Replacement Procedure 22.2
23 Replacing a Power Distribution Unit
23.1 General Precautions 23.1
23.2 Replacing PDUs in Cabinets that only have Rear PDUs 23.2
23.3 Replacing PDUs in Cabinets that have Front and Rear PDUs 23.8
24 Replacing an AC Cord
24.1 General Precautions 24.1
24.2 AC Cord Replacement Procedure 24.2
Service Processor Maintenance Procedures
25 Service Processor Replacement and Upgrade
25.1 General Precautions 25.1
25.2 Replacing a Service Processor 25.2
25.2.1 Replacing a Service Processor 25.2
ixTable of Contents
3PAR Confidential
x
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Appendices
A Tools
A.1 Tools Required for Performing Maintenance A.1
B Guided Maintenance
B.1 Overview B.1
B.2 Accessing Guided Maintenance B.3
C Removing and Replacing a Controller Node
C.1 General Precautions C.1
C.2 Removing a Controller Node C.2
C.3 Replacing a Serviced Controller Node C.5
D Node Rescue
D.1 Performing an Auto-Node Rescue D.2
D.2 Performing Manual Node Rescue D.7
E Locking Fascia
E.1 Locking Fascia E.2
E.1.1 Converting a Cabinet from Standard to Locking Fascias E.2
E.1.2 Removing the Locking Fascia E.3
E.1.3 Replacing the Locking Fascia E.4
E.2 Locking Fascia II E.6
E.2.1 Converting a Standard Cabinet to a Locking Fascia II E.6
E.2.2 Removing the Locking Fascia E.8
E.2.3 Replacing the Locking Fascia E.10
F Illustrated Parts Catalog
F.1 Storage Server Frame Components F.2
F.2 Drive Chassis Components F.6
F.3 Internal Node Components F.10
F.4 Miscellaneous Components F.14
Table of Contents
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
G Agency Compliance Statements
G.1 Safety Precautions G.2
G.2 Safety Agency Compliance Notices G.2
G.2.1 System Placement and Security G.2
G.2.2 Battery Replacement and Disposal G.5
G.2.3 Controller Nodes G.8
G.2.4 Drive Chassis G.13
G.3 3PAR Power Cables G.16
G.4 Japan Green Law Statement of Compliance G.16
IX Index
RH Revision History
xiTable of Contents
3PAR Confidential
xii
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Table of Contents
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
1Introduction
In this chapter
1.1 Related Documentation 1.2
1.2 Organization 1.3
1.3 Typographical Conventions 1.5
1.4 Advisories 1.6
1.5 Using this Guide 1.6
1.1Introduction
3PAR Confidential
1.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
1.1 Related DocumentationThe following documents provide additional information related to 3PAR InServ Storage
Servers:
Table 1-1. Related Documents
For information about… Read the…
Upgrading the InServ Storage Server 3PAR InServ T-Class Storage Server
Upgrades Guide
Using the InForm Command Line Interface (CLI) to
configure and manage the InServ Storage Server
3PAR InForm OS CLI Administrator’s
Manual
Understanding the InServ Storage Server and its
features
3PAR InForm OS Concepts Guide
Using the InForm Management Console (IMC) user
interface to configure and administer InServ
Storage Servers
3PAR InForm Management Console
Online Help
CLI commands and their usage 3PAR InForm OS Command Line Interface
Reference
Identifying InServ Storage Server components and
fixing problems
3PAR InForm OS Messages and Operator’s
Guide: Service Edition
Using 3PAR Remote Copy 3PAR Inform OS Remote Copy User’s
Guide
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
1.2 OrganizationThe procedures in this guide are divided into four sections and seven appendices.
■ Chapter 1, Introduction (this chapter), provides an overview of this manual, including
information on audience, document conventions, and related documentation.
■ Chapter 2, Precautions, provides general safety instructions, which should be followed
before attempting any procedure in this guide.
■ Chapter 3, Connecting the Maintenance PC, describes the procedure for connecting and
configuring the Maintenance PC to perform maintenance procedures on the storage server.
■ Chapter 4, Understanding LED Status, describes the storage server’s component LEDs.
■ Chapter 5, Powering Down the Storage Server, provides instructions on safely powering
down the storage server in order to perform maintenance on the server’s components.
Drive Chassis Maintenance Procedures
■ Chapter 6, Replacing a Disk on a Drive Magazine, describes how to safely replace a disk
drive on a drive magazine.
■ Chapter 7, Replacing a Drive Magazine, provides instructions on replacing a drive
magazine.
■ Chapter 8, Replacing an SFP Module on an FC-AL, provides instructions on replacing a small
form-factor pluggable transceiver (SFP) on an FC-AL.
■ Chapter 9, Replacing a Drive Cage FC-AL Module, details the procedure for replacing an FC-
AL module.
■ Chapter 10, Replacing a Drive Cage Midplane Assembly, provides instructions on replacing
a failed drive cage midplane assembly.
Controller Node Maintenance Procedures
■ Chapter 11, Replacing a Controller Node, describes how to replace a failed controller node.
■ Chapter 12, Replacing an SFP on a PCI Adapter, provides instructions on replacing a small
form-factor pluggable transceiver (SFP) on a PCI adapter.
■ Chapter 13, Replacing a PCI Adapter, provides instructions on replacing a controller node’s
fibre channel adapter.
1.33PAR Confidential
1.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
■ Chapter 14, Replacing Control Cache, provides instructions on replacing control cache
DIMMs in a controller node.
■ Chapter 15, Replacing Data Cache, describes how to replace data cache DIMMs.
■ Chapter 16, Replacing a Data Cache Riser Card, describes the procedure for replacing the
data cache riser card in a controller node.
■ Chapter 17, Replacing a Disk in a Node, describes the procedure for safely replacing an disk
in a controller node.
■ Chapter 18, Replacing a Clock Battery, describes how to replace the clock battery in a
controller node.
■ Chapter 19, Replacing a Controller Node Chassis, provides instructions on safely replacing a
controller node chassis.
Power System Maintenance Procedures
■ Chapter 21, Replacing a Drive Chassis Power Supply, describes the procedure for safely
replacing a drive chassis power supply.
■ Chapter 20, Replacing a Controller Node Power Supply, describes the procedure for safely
replacing a controller node power supply.
■ Chapter 22, Replacing a Battery Backup Unit, provides instructions on replacing the storage
server’s battery backup units.
■ Chapter 23, Replacing a Power Distribution Unit, describes how to safely replace a power
distribution unit.
■ Chapter 24, Replacing an AC Cord, describes how to safely replace a failed AC cord.
Service Processor Maintenance Procedures
■ Chapter 25, Service Processor Replacement and Upgrade, describes the procedure for
removing and replacing a service processor.
Appendices
■ Appendix A, Tools, lists the tools required for performing maintenance procedures.
■ Appendix B, Guided Maintenance, describes how to use guided maintenance scripts.
■ Appendix C, Removing and Replacing a Controller Node, describes how to safely handle,
remove, and replace a controller node when servicing the node’s internal components.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
■ Appendix D, Node Rescue, describes the procedure to restore a controller node InForm OS.
■ Appendix E, Locking Fascia, describes this optional feature and how to secure the InServ
Storage Server.
■ Appendix F, Illustrated Parts Catalog, lists all field replaceable parts for InServ Storage
Servers.
■ Appendix G, Agency Compliance Statements, contains safety precautions and agency
compliance notices for InServ Storage Servers and storage server components.
This guide also contains an index and a revision history for your reference.
1.3 Typographical ConventionsThe following typographical conventions are used in this guide:
Table 1-2. Typographical Conventions
Typeface Meaning Example
ABCDabcd Used for dialog box
elements such as titles and
button labels.
Enter your system name in the
Value box and click OK.
ABCDabcd Used for file names, paths,
and screen output, and for
text you are to enter.
3PAR(TM) InForm(R) OS
<version> <sernum>-<nodeID>
ttyS0
When prompted, type yes and
press ENTER.
ABCDabcd Used to contrast your input
from screen output.
root@<sernum>-<nodeID># rootb
ABCDabcd
ABCDabcd
Used for variables in file
names, paths, and screen
output, and variables in
user input.
[root@(systemID-nodeID)root]
To continue Enter your
system name ==> systemname
1.53PAR Confidential
1.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
1.4 AdvisoriesBefore performing any of the procedures described in this guide, read Appendix G, Agency
Compliance Statements, to obtain important safety information.
To avoid injury to people or damage to data and equipment, be sure to observe the cautions
and warnings in this guide. Always be careful when handling any electrical equipment.
The following types of alert messages are used to emphasize important information:
1.5 Using this GuideThe maintenance procedures described in this guide should only be used in instances where
online guided maintenance is not available for the hardware that requires servicing. See
Appendix B, Guided Maintenance, for a list of Field Replaceable Units (FRUs) with available
guided maintenance.
NOTE: Notes are reminders or suggestions that supplement the procedures
included in this guide.
CAUTION: Cautions alert you to actions that can cause damage to equipment,
software, or data.
WARNING: Warnings alert you to actions that can cause injury to people or
irreversible damage to data or the operating system.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
2Precautions
In this chapter
2.1 General Precautions 2.2
2.2 Disk and Drive Magazine Precautions 2.3
2.3 Controller Node Precaution 2.4
2.4 Clock Battery Precaution 2.4
2.5 Drive Chassis and Node Power Supply Precaution 2.5
2.6 Battery Backup Unit Precautions 2.5
2.7 Power Distribution Unit Precautions 2.6
2.8 AC Cord Precaution 2.6
2.1Precautions
3PAR Confidential
2.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
2.1 General PrecautionsFollow these general precautions when servicing the InServ Storage Server to avoid injury, data
loss, and damage to the server:
CAUTION: Field Replaceable Units (FRUs) should be within 10° C (18° F) of the
temperature of the computer room before power is applied to them in an InServ
system. This is especially true for disk drives. The maximum rate of change
(gradient) in temperature for the FRU should be 10° C (18° F) per hour. See
Table 2-1 for additional environmental specifications.
Table 2-1. Environmental Specifications for InServ Storage Servers
Specification Value
Altitude
Operating
Non-operating
0–10,000 ft (3,048 m)
0–40,000 ft (12,192 m)
Ambient temperature
Operating
Non-operating
50–104° F (10–40° C)
0–3,000 ft (914.4 m)
50–95° F (10–35° C)
3,000–10,000 ft (914–3,048 m)
–40–203° F (–40–95° C)
0–40,000 ft (0–12,192 m)
Temperature gradient
Operating
Non-operating
18° F/hr. (10° C/hr.)
18° F/hr. (10° C/hr.)
Relative humidity 20–80 percent noncondensing,
maximum gradient 10 percent per hour
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
■ Prepare an Electrostatic Discharge-safe (ESD) work surface by placing an antistatic mat on
the floor, or table, near the InServ Storage Server. Attach the ground lead of the mat to an
unpainted surface of the rack.
■ Always use a wrist grounding strap. A wrist grounding strap is provided with the InServ
Storage Server. Attach the grounding strap clip directly to an unpainted surface of the rack.
■ Avoid contact between electronic components and clothing, which can carry an
electrostatic charge.
■ If applicable, ensure all cables are properly labeled and easily identifiable prior to removing
a component.
2.2 Disk and Drive Magazine PrecautionsYou should always observe caution when handling drive magazines. When carrying a drive
magazine, always support it with both hands. With the solid back panel of the magazine
facing you and with one hand on the handle, support the bottom of the magazine with your
other hand.
CAUTION: Using improper tools can result in damage to the storage server. See
the tools list in Appendix A, Tools.
CAUTION: If you require more than 30 minutes to replace a disk on a drive
magazine, install a drive magazine filler panel over the empty drive magazine slot
to prevent overheating while you are working. See the 3PAR InServ T-Class
Storage Server Installation, Deinstallation, and Upgrade Guide for filler panel
installation procedures.
CAUTION: To avoid damage to hardware and the loss of data, never remove a
drive magazine from the InServ Storage Server without confirming that the hot-
plug LED on the drive magazine is lit.
2.33PAR Confidential
2.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
2.3 Controller Node PrecautionUse both hands to carry controller nodes. With one hand on the node handle, support the
bottom of the controller node with your other hand.
2.4 Clock Battery PrecautionWhen replacing a controller node clock battery, observe the following precaution:
CAUTION: To avoid potential damage to equipment and loss of data, handle disks
and drive magazines carefully.
CAUTION: To avoid potential damage to equipment and loss of data, handle
controller nodes carefully.
WARNING: The lithium coin battery may explode if it is incorrectly installed in the
controller node. Replace the coin battery only with an equivalent type
recommended by 3PAR.
WARNING: Dispose of used batteries according to the manufacturer’s
instructions.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
2.5 Drive Chassis and Node Power Supply PrecautionWhen handling a power supply, observe the following precaution:
2.6 Battery Backup Unit PrecautionsWhen handling a Battery Backup Unit (BBU), observe the following precautions:
The BBU requires 10 hours to become fully charged. The battery charge increases by 10 percent
each hour. When both backup batteries of a node are fully discharged, the cache size on all
nodes is set to 0 and all requests from the host are in write through mode. As batteries
recharge and the available battery charge increases, cache size is increased in 10 percent
increments and write-caching is enabled.
CAUTION: To prevent overheating, this procedure requires a maximum service
time of 10 minutes.
WARNING: Do not attempt to disassemble the BBU. If a battery string inside the
unit fails, you must replace the entire battery backup unit.
WARNING: Battery backup units are heavy. Use care when replacing them.
CAUTION: Verify the storage server cabinet is completely immobilized before
removing battery backup units. For storage servers with 3PAR cabinets, confirm
that the leveling feet at the bottom of the cabinet rest firmly on the ground
before removing a BBU.
2.53PAR Confidential
2.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
2.7 Power Distribution Unit PrecautionsWhen handling a Power Distribution Unit (PDU), observe the following precautions:
2.8 AC Cord PrecautionWhen handling an AC cord, observe the following precaution:
WARNING: Do not operate a storage server if any of the main power cords show
evidence of damage or wear. Immediately replace all PDUs that have a damaged
or worn power cord.
WARNING: To avoid possible injury, damage to storage server equipment, and
potential loss of data, do not use the surplus power outlets in the storage server
PDUs. Never use outlets in the PDUs to power components that do not belong to
the storage server or to power storage server components that reside in other
cabinets.
WARNING: To avoid serious injury, never touch a damaged power cord before
switching off the PDU and power supply connected to the damaged cord.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3Connecting the Maintenance PC
In this chapter
3.1 Connecting to a Controller Node 3.2
3.2 Connecting to the Service Processor 3.9
3.2.1 Using a Serial Connection 3.9
3.2.2 Using an Ethernet Connection 3.17
3.2.2.1 Logging into the SP Onsite Customer Care Interface (SPOCC) 3.22
3.2.3 Using a Secure Shell Protocol 3.24
3.2.3.1 Using PuTTy 3.24
3.2.3.2 Using Secure CRT 3.27
3.3 Serial Cable Pinouts 3.30
3.3.1 Crossover Adapter Assembly 3.30
3.3.2 Straight-Through Adapter 3.31
Many of the maintenance procedures described in this manual require the use of a separate
maintenance PC to issue CLI commands to perform and verify maintenance procedures. This
chapter describes procedures for connecting and configuring the maintenance PC.
3.1Connecting the Maintenance PC
3PAR Confidential
3.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3.1 Connecting to a Controller NodeThe maintenance PC connects directly to a controller node through a serial cable using
terminal emulation software such as HyperTerminal.
To connect the maintenance PC to a node:
1 Remove the bezel that covers the controller node chassis.
2 Insert a standard Category 5 cable into the maintenance port of one of the controller nodes
as shown in Figure 3-1.
Figure 3-1. Location of the Maintenance Port
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
Maintenance Port (C0)
0589_L_R2
NOTE: A cable with adapter (P/N 180-0055) should be connected to the SP.
Disconnect the Ethernet cable from the RJ-45 to DB-9 adapter attached to the SP
(P/N 180-0059).
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3 Attach a DB9 female to RJ45 serial adapter assembly (P/N 180–0055) to the free end of the
Ethernet cable and then insert the adapter into the DB9 serial port (COM 1) of the
maintenance PC, see Figure 3-2.
Figure 3-2. Connecting the Ethernet Cable
4 Power on the maintenance PC.
5 On the taskbar, choose Start > Programs > Accessories > Communications >
HyperTerminal.
0659_L_R1
Crossover Adapter (P/N 180-0055)
C0 Serial Port
Maintenance PC(Laptop)
EthernetCable
Node
3.33PAR Confidential
3.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
6 In the Connection Description dialog box, enter a session name in the Name box for
which you are configuring the maintenance PC, and then click OK (Figure 3-3).
Figure 3-3. Entering a Session Name
0167_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
7 In the Connect To dialog box, select serial port COM1 from the Connect using list, and
then click OK (Figure 3-4).
Figure 3-4. Selecting Serial Port COM1
0168_S_R1
3.53PAR Confidential
3.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 In the COM1 Properties dialog box, select 57600 from the Bits per second list and
select Xon/Xoff from the Flow control list, then click OK (Figure 3-5).
Figure 3-5. Configuring Serial Port COM1
HyperTerminal establishes a serial connection with the controller node to which the
maintenance PC is physically connected.
0169_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
9 Press ENTER to display the login prompt in the terminal window. A display similar to the one
shown in Figure 3-6 appears.
Figure 3-6. HyperTerminal Login Prompt
0286_S_R1
3.73PAR Confidential
3.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
10 In the HyperTerminal main window, click File and then click Properties.
The New Session Properties dialog box appears (Figure 3-7).
Figure 3-7. New Session Properties Dialog Box
0171_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11 Click the Settings tab. From the Emulation list, select either ANSI or VT100 to set the
session emulation type, then click OK.
12 Enter your login ID and password to begin maintenance procedures.
3.2 Connecting to the Service ProcessorThe maintenance PC can connect to the service processor either through a serial connection or
through the Local Area Network (LAN).
After you are connected, you can use a terminal emulation program to communicate with the
service processor.
3.2.1 Using a Serial Connection
To connect the maintenance PC to the service processor using HyperTerminal through a serial
connection:
1 Unlock the rear door of the storage server cabinet. Open the door by unlatching the three
latches located at the top, center, and bottom of the door.
2 Locate the service processor. Attach the DB9 female serial adapter (P/N 180–0055), that is at
the free end of the blue Ethernet cable, to the Serial port on your maintenance PC.
A standard Category 5 Ethernet cable with the appropriate RJ–45 to DB9 adapters at each
end should already be connected to the service processor's DB9 Serial port.
NOTE: If you do not have a login ID and password, contact your 3PAR Authorized
Service Provider.
NOTE: Connecting to the service processor through the LAN (Ethernet) requires
establishing a Secure Shell Session (SSH). If you do not have SSH, connect to the
serial port of the service processor.
3.93PAR Confidential
3.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 If necessary, insert a standard Category 5 Ethernet cable into the service processor serial
port with the DB9 female to RJ45 adapter (P/N 180–0059). See Figure 3-8 or Figure 3-9 or
Figure 3-10 for the location of the serial port on the service processor.
Figure 3-8. Wintec Service Processor Serial Port with Adapter
Figure 3-9. Supermicro Service Processor Serial Port and Adapter
Figure 3-10. Supermicro II Service Processor Serial Port and Adapter
NOTE: See Serial Cable Pinouts on page 3.30 for serial cable pinout diagram.
Serial Port with DB9 Female toRJ45 Adapter (P/N 180-0059-01)
0165_L_R2
Serial Port with DB9 Female toRJ45 Adapter (P/N 180-0059-01)
0636_L_R1
Serial Port with DB9 Female toRJ45 Adapter (P/N 180-0059-01)
0805_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
A standard Category 5 Ethernet cable may already be connected to the DB9 female to RJ45
adapter (Figure 3-11).
Figure 3-11. Attaching the Blue Ethernet Cable
4 Power on the maintenance PC.
5 On the taskbar, choose Start > Programs > Accessories > Communications >
HyperTerminal.
0341_L_R1
180-0055
180-0059
ServiceProcessor
Maintenance PC(Laptop)
BlueEthernetCable
3.113PAR Confidential
3.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
6 In the Connection Description dialog box, enter a session name in the Name box for
the maintenance PC you are configuring, then click OK (Figure 3-12).
Figure 3-12. Entering a Session Name
0167_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
7 In the Connect To dialog box, select serial port COM1 from the Connect using list,
then click OK (Figure 3-13).
Figure 3-13. Selecting Serial Port COM1
0168_S_R1
3.133PAR Confidential
3.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 In the COM1 Properties dialog box, select 38400 from the Bits per second list and
select Xon/Xoff from the Flow control list, then click OK (Figure 3-14).
Figure 3-14. Configuring Serial Port COM 1
HyperTerminal establishes a serial connection with the service processor to which the
maintenance PC is physically connected.
0169_S_R2
38400
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
9 Press ENTER to display the login prompt in the terminal window. A display similar to the one
shown in Figure 3-15 appears.
Figure 3-15. HyperTerminal Login Prompt
0660_S_R1
3.153PAR Confidential
3.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
10 In the HyperTerminal main window, click File and then click Properties.
The New Session Properties dialog box opens (Figure 3-16).
Figure 3-16. New Session Properties Dialog Box
0171_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11 Click the Settings tab. From the Emulation list, select either ANSI or VT100 to set the
session emulation type, then click OK.
12 Enter your login ID and password to begin the maintenance procedures.
3.2.2 Using an Ethernet Connection
To connect the maintenance PC to the service processor through the private Local Area
Network using an Ethernet cable, you must first configure the LAN settings on the
maintenance PC.
To configure the LAN settings on the maintenance PC:
1 Unlock and open the rear door of the storage server cabinet.
◆ If necessary, insert a red crossover Category 5 Ethernet cable (RJ45 to RJ45) into the
proper Ethernet port of the SP (ETH1), see Figure 3-17 or Figure 3-18 or Figure 3-19.
Figure 3-17. Wintec Service Processor Ethernet Ports
Figure 3-18. Supermicro Service Processor Ethernet Ports
NOTE: If you do not have a login ID and password, contact your 3PAR Authorized
Service Provider.
0166_L_R2
Eth-1 (Int)Eth-0 (Ext)
Eth-1 (Int)Eth-0 (Ext)
0638_L_R1
3.173PAR Confidential
3.18
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Figure 3-19. Supermicro II Service Processor Ethernet Ports
2 Connect the free end of the crossover Ethernet cable to the Ethernet port in the
maintenance PC.
3 Power on the maintenance PC.
Eth-1 (Int)Eth-0 (Ext)
0806_L_R1
NOTE: The Supermicro and Wintec Service Processor Ethernet port (ETH0)
corresponds with the front NIC Port LED 1 and Ethernet port (ETH1) corresponds
with the front NIC Port LED 2.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 Right-click the My Network Places desktop icon to bring up the shortcut menu.
5 Click Properties.
The Network and Dial-up Connections window appears (Figure 3-20).
Figure 3-20. Network and Dial-Up Connections Window
0172_S_R1
3.193PAR Confidential
3.20
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
6 Right-click the Local Area Connection icon to bring up the Local Area Connections
Properties menu.
7 Click Properties.
The Local Area Connection Properties dialog box appears (Figure 3-21).
Figure 3-21. Local Area Connection Properties Dialog Box
0173_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
8 Double-click Internet Protocol (TCP/IP).
The Internet Protocol (TCP/IP) Properties dialog box appears (Figure 3-22).
Figure 3-22. Internet Protocol (TCP/IP) Properties Box
0174_S_R1
3.213PAR Confidential
3.22
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
9 In the Internet Protocol (TCP/IP) Properties dialog box, click the Use the
following IP address button and then type the following IP addresses:
10 Click OK.
11 Click OK in the Advanced TCP/IP Settings dialog box to finish configuring the LAN
connection.
3.2.2.1 Logging into the SP Onsite Customer Care Interface (SPOCC)
After the Ethernet connection is configured for the service processor, log in to the Service
Processor Onsite Customer Care (SPOCC) interface from the maintenance PC using a supported
Web browser. SPOCC and SPMAINT are two of the service processor user interfaces. These
interfaces enable you to perform various administrative and diagnostic tasks in support of
both the InServ Storage Server and the service processor.
To log in to SPOCC using a Web browser:
1 Type the IP address of the service processor in the Web browser and press ENTER.
Table 3-1. IP Addresses
IP address 10.255.155.49
Subnet mask 255.255.255.248
Default gateway None.
NOTE: If you are using the crossover cable to the service processor’s ETH1 (Int)
port, use IP address 10.255.155.54.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
The Service Processor Login screen appears (Figure 3-23).
Figure 3-23. Service Processor Login Screen
2 Click the Login button.
The Enter Network Password dialog box appears.
3 Type your user name and password and click OK.
0177_S_R1
NOTE: If you do not have a user name and password, contact your 3PAR
Authorized Service Provider.
3.233PAR Confidential
3.24
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3.2.3 Using a Secure Shell Protocol
After the Ethernet connection is configured for the service processor, also initiate a Secure
Shell Session (SSH) using PuTTy or SecureCRT. The following sections describe the various
methods for obtaining an SSH connection to the service processor.
3.2.3.1 Using PuTTy
Follow these steps to initiate a secure shell session between the maintenance PC and the
service processor using PuTTY:
1 Go to the permanent location where you extracted putty.zip and double-click the
putty.exe file (Figure 3-24).
Figure 3-24. Launching the PuTTY Application
0183_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
2 In the PuTTY Configuration dialog box that appears, type the service processor IP
address in the Host Name (or IP address) box, click the SSH protocol button, then click
Open (Figure 3-25).
Figure 3-25. PuTTY Configuration Dialog Box
0184_S_R1
3.253PAR Confidential
3.26
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 If you are connecting to the service processor for the first time, the PuTTY Security
Alert dialog box appears. Click Yes (Figure 3-26).
Figure 3-26. PuTTY Security Alert Dialog Box
The PuTTY main window appears (Figure 3-27).
Figure 3-27. PuTTY Main Window Login Screen
0185_S_R1
0186_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 Type your user ID and press ENTER, then type your password and press ENTER.
3.2.3.2 Using Secure CRT
To initiate a secure shell session between the maintenance PC and the service processor, use
SecureCRT:
1 On the taskbar, choose Start > Programs > SecureCRT > SecureCRT.
2 In the SecureCRT window, click the Quick Connect icon (Figure 3-28).
Figure 3-28. SecureCRT Window
NOTE: If you do not have a user ID and password, contact your 3PAR Authorized
Service Provider.
0187_S_R1
3.273PAR Confidential
3.28
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 In the Quick Connect dialog box that appears, select ssh2 from the Protocol list, type
the IP address of the service processor in the Hostname box, type your user ID in the
Username box, then click Connect (Figure 3-29).
Figure 3-29. Quick Connect Dialog Box
NOTE: If you are using the service processor’s private network (crossover cable to
ETH1) then use IP address 10.225.155.54.
0188_S_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 In the Enter Password dialog box, type your password and click OK.
A window similar to the following appears (Figure 3-30).
Figure 3-30. Secure CRT Session
NOTE: If you do not have a user ID and password, contact your 3PAR Authorized
Service Provider.
0190_S_R2
3.293PAR Confidential
3.30
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3.3 Serial Cable PinoutsThe following tables and diagrams illustrate the serial cable pinouts for the crossover DB9
female serial to RJ45 adapter assembly (P/N 180–0055) and the straight-through DB9 to RJ45
serial adapter (P/N 180–0059).
3.3.1 Crossover Adapter Assembly
The following table lists cable pinouts for the crossover DB9 female serial to RJ45 adapter
assembly (P/N 180–0055). This connector inserts into the COM port on the maintenance PC.
Figure 3-31 illustrates the pin locations and connections for the crossover DB9 female serial to
RJ45 adapter assembly (P/N 180–0055).
Figure 3-31. Crossover DB9 Female Serial to RJ45 Serial Connector Pinouts
Table 3-2. Crossover DB9 Female Serial to RJ45 Serial Connector Pinouts
Color DB9 (Female) Pin RJ45 Pin
Black 2 3
Orange 3 2
Green 5 5
1
2
3
4
5
6
7
8
9
2
4
6
8
0162_L_R2
DB9 Pin 2 (Black)
RJ45DB9
RJ45 Pin 2 (Orange)
RJ45 Pin 3 (Black)
RJ45 Pin 5 (Green)DB9 Pin 3 (Orange)
DB9 Pin 5 (Green)
1
3
5
7
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3.3.2 Straight-Through Adapter
The following table lists connector pinouts for the straight-through DB9 to RJ45 adapter
(P/N 180–0059). This connector inserts into the COM port on the service processor.
Figure 3-32 illustrates the pin locations and connections for the straight-through DB9 to RJ45
adapter (P/N 180–0059).
Figure 3-32. Straight-Through DB9 to RJ45 Serial Connector Pinouts
Table 3-3. Straight-Through DB9 to RJ45 Adapter Serial Cable Pinouts
Color DB9 (Female) Pin RJ45 Pin
Orange 2 2
Black 3 3
Green 5 5
1
2
3
4
5
6
7
8
9
2
4
6
8
0163_L_R2
RJ45 Pin 2 (Orange)
RJ45 Pin 3 (Black)
RJ45 Pin 5 (Green)
DB9 Pin 5 (Green)
1
3
5
7
DB9 Pin 3 (Black)
DB9 Pin 2 (Orange)
RJ45DB9
3.313PAR Confidential
3.32
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4Understanding LED Status
In this chapter
4.1 Using the Component LEDs 4.2
4.1.1 Removing the Bezels and Unlocking the Door 4.2
4.1.2 Drive Cage LEDs 4.3
4.1.3 Controller Node LEDs 4.9
4.1.4 QLogic iSCSI Port LEDs 4.12
4.1.5 3PAR Fibre Channel Port LEDs 4.13
4.1.6 Power Supply LEDs 4.14
4.1.7 Battery Backup Unit LEDs 4.16
4.1.8 Power Distribution Unit Lamps 4.17
4.2 Service Processor LEDs 4.18
4.2.1 Wintec Service Processor 4.18
4.2.2 Supermicro Service Processor 4.19
4.2.3 Supermicro II Service Processor 4.21
4.1Understanding LED Status
3PAR Confidential
4.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4.1 Using the Component LEDsInServ Storage Server components have LEDs to indicate whether or not the hardware is
functioning properly and to help identify errors. These LEDs serve as tools for diagnosing basic
hardware problems.
You can quickly identify hardware problems by simply examining the LEDs on all the
components. Use the tables and diagrams in the following sections to determine if the
hardware is functioning properly.
If you detect any problems during inspection of the LEDs, contact your 3PAR Authorized
Service Provider.
4.1.1 Removing the Bezels and Unlocking the Door
An optional locking fascia kit may be installed on the storage server. If your storage server is
equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional
information on removal and replacement.
■ To view the node, drive chassis or service processor LEDs, remove the bezels.
■ To view the power supply, battery or power distribution unit LEDs, open the rear door by
unlatching the three latches of the door (T800 Storage Servers contain PDUs in the front
and rear of the cabinet).
WARNING: Hazardous energy is located behind the rear access door of the
storage server cabinet. Use caution when working with the door open.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.1.2 Drive Cage LEDs
The DC4 drive chassis holds one DC4 drive cage housing with two drive cage FC-AL modules
and a maximum of ten drive magazines. See Figure 4-1.
Figure 4-1. DC4 Drive Cage
0588_L_R2
Drive Magazines
B0
A0
Por
tsA
1B
1P
orts
0 1 2 3 4 5 6 7 8 9
4.33PAR Confidential
4.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4.1.2.1 DC4 Drive Cage FC-AL Module LEDs
The DC4 drive cage FC-AL modules have the following LEDs (Figure 4-2):
Figure 4-2. Connections and LEDs on the DC4 Drive Cage FC-AL Modules
0655_L_R1
(Typical)
FC-AL Status LED
Port B RX LED
Port A RX LED
Hot-Plug LED
Port B TX LED
Port A TX LED
Port B
Port A
Split Mode LED 4 Gb/s
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Consult Table 4-1 to verify proper functioning of the DC4 drive cage FC-AL modules.
Table 4-1. Drive Cage DC4 FC-AL Module LED Displays
LED Appearance Meaning
RX Steady green light Indicates the presence of a small
form-factor pluggable optical
transceiver (SFP) and a valid
signal from the node.
No light Indicates no connection to the
node or no SFP is installed.
TX Steady green light Indicates the presence of an SFP
and the LED is on and
transmitting.
No light Indicates no SFP is present or the
SFP transmitter failed.
FC-AL status Steady green light Indicates the drive cage is
functioning properly, but is not
communicating with other
nodes.
Flashing green light (1 blink
per second)
Indicates the cage is connected
and communicating with the
system manager of a node in the
cluster.
Steady amber light Normal, initial indication for two
seconds upon power up.
Otherwise, indicates FC-AL
module error or other cage error.
If both FC-AL modules have a
steady light, the temperature of
a disk drive has exceeded 55°C, or
a power supply has failed.
4.53PAR Confidential
4.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Flashing amber light (1
blink per second)
The drive cage has some type of
error, such as a failed or missing
power supply, but is
communicating with a node.
Rapid toggle between
amber and green light
Indicates a cage firmware
upgrade initiated by the
upgradecage CLI command is in
progress. A firmware upgrade
normally takes less than two
minutes to complete.
Hot-plug Steady amber light Indicates the FC-AL module is
prepared for replacement (hot
plug).
No light Indicates the FC-AL module is not
prepared for hot plug.
Split Mode Steady green light Indicates the drive cage is split
into two logical portions.
No light Indicates the drive cage is not
split.
4 GB/s Steady green light Indicates the transfer rate is
operating at 4 Gb/s.
No light Indicates the transfer rate is
operating at 2 Gb/s.
Table 4-1. Drive Cage DC4 FC-AL Module LED Displays (continued)
LED Appearance Meaning
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.1.2.2 Drive Magazine LEDs
Drive magazines contain the following LEDs (Figure 4-3):
Figure 4-3. DC4 Drive Magazine Status LEDs
DC4 0587_L_R1
Disk Status LEDs
Hot-Plug LED
Drive MagazineStatus LED
!0123
4.73PAR Confidential
4.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Consult Table 4-2 to verify proper functioning of disks and drive magazines.
Table 4-2. Drive Magazine LED Displays
LED Appearance Meaning
Drive Magazine
Status
Steady green light Indicates the drive magazine is
functioning properly.
Steady amber light Indicates a drive magazine error,
or one or more drives are
bypassed on at least one path.
Disk status Quick flashing, or 20 percent
on, 80 percent off green light
Indicates the disk is not spun up
but has power.
Steady green light Indicates the disk is spun up and
waiting for a command.
Flashing green light Indicates the disk is executing
commands.
No light Indicates no disk is present.
Steady amber light Indicates a disk error, or the disk
is bypassed on both paths
(loops).
Hot-plug Steady amber light Indicates the drive magazine is
prepared for replacement (hot-
plug).
Flashing amber light Indicates there is a connection
failure between the drive
magazine and the drive chassis.
No light Indicates the magazine is not
prepared for hot-plug.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.1.3 Controller Node LEDs
Depending upon the configuration, storage servers contain two, four, six, or eight controller
nodes, all located in the storage server chassis.
Controller nodes contain the following LEDs (Figure 4-4):
Figure 4-4. Controller Node LEDs
Consult Table 4-3 to verify proper functioning of controller nodes.
NOTE: After powering on, allow approximately two minutes for the disks on the
DC4 drive magazine to spin up before checking the drive magazine LEDs.
0571_L_R2
Node Hot-plug LED
Node Status LED
Ethernet10/100/1000 MbpsLED
Ethernet Activity LED
DiskHot-plug LED
4.93PAR Confidential
4.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Table 4-3. Controller Node LED Displays
LED Appearance Meaning
Disk Hot-plug Steady amber light Indicates the node disk is prepared
for hot-plug.
No light Indicates the node disk is not
prepared for hot-plug.
Node Hot-plug Steady amber light In combination with the Status
LED blinking green three times per
second, indicates the controller
node is prepared for removal.
In combination with the Status
LED being solid, indicates a fatal
node failure.
No light Indicates the node is not prepared
for removal.
Node status Flashing green light (1
blink per second)
Indicates the node is fully
functional and part of the cluster.
Flashing amber light
(1 blink per second)
Indicates the node has a failed or
missing power supply, fan, battery
backup unit, or TOD battery but
the node is still operational.
Steady green light Indicates the node is in the process
of joining the cluster.
Rapidly flashing green (3
blinks per second), in
conjunction with the hot-
plug LED being solid
amber.
Indicates the node is safe to
remove.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Steady amber light Indicates an error within the node.
Solid amber and hot-plug
LED amber
Indicates a fatal node failure.
Ethernet activity Steady green light Indicates an Ethernet link.
Flashing green light Indicates no Ethernet activity.
No light Indicates no Ethernet connection.
Ethernet 10/100/1000 Mbps Steady amber light 1000 Mb/sec mode.
Steady green light 100 Mb/sec mode.
No light 10 Mb/sec mode (or disconnected).
Table 4-3. Controller Node LED Displays (continued)
LED Appearance Meaning
4.113PAR Confidential
4.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4.1.4 QLogic iSCSI Port LEDs
The QLogic iSCSI adapter contains two ports. There is one LED for each port as shown in
Figure 4-5.
Figure 4-5. iSCSI Adapter Ports and LEDs
Table 4-4. iSCSI Adapter Port LED Meanings
LED Appearance Meaning
Steady Green Indicates a link is established.
Flashing Green Indicates receiving or transmitting activity.
No Light Indicates no connection or active link.
0514_L_R2
LEDs (2x)
Port 2
Port 1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.1.5 3PAR Fibre Channel Port LEDs
The 3PAR Fibre Channel adapter contained in the controller node also contains Fibre Channel
port LEDs (Figure 4-6).
Figure 4-6. 3PAR 4-Port Fibre Channel LEDs
Consult Table 4-5 to verify the proper function of the 3PAR Fibre Channel adapter LED.
Table 4-5. 3PAR Fibre Channel Port Status LED Indications (3PAR 4-Port Adapter)
LED Appearance Meaning
No Light Wake-up Failure (dead device).
Steady Green Light Normal -- Link up at 2-4 Gbps.
Flashing Green Light Link down or not connected.
0256_L_R2
Port 4
Port 1
LED (4x)
4.133PAR Confidential
4.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4.1.6 Power Supply LEDs
Power supply units are located at the rear of all drive cages and controller nodes.
■ Power supplies have the following LEDs (Figure 4-7):
Figure 4-7. Power Supply LEDs
0632_L_R1
Controller Node Power Supply
AC LED
Power SupplyStatus LED
AC LED
Power SupplyStatus LED
Drive Chassis Power Supply
NOTE: The appearance of the power supplies can vary slightly according to
manufacturer and location (drive chassis or controller node).
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Consult Table 4-6 to verify proper operation of the power supplies.
Table 4-6. Power Supply LED Displays
LED Appearance Meaning
Power Supply Status Steady green light Indicates the power is on.
Steady amber light Indicates a power supply error.
No light Indicates a broken connection to
the AC power source.
AC Steady green light Indicates the AC is entering from
an external source.
No light Indicates no AC is entering from
an external source (for example,
when power is off or when using
battery power).
4.153PAR Confidential
4.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4.1.7 Battery Backup Unit LEDs
Depending on the configuration, storage servers with 3PAR cabinets include one or more
battery trays that hold up to four Battery Backup Units (BBUs) apiece. BBUs supply power to
write the cache memory to the drive inside the node in the event of a power failure.
BBUs contain two batteries, labeled BATTERY A and BATTERY B. The BBUs also include the
following LEDs (Figure 4-8):
Figure 4-8. Battery Backup Unit LEDs
Consult Table 4-7 to verify the proper functioning of the BBUs.
Table 4-7. Battery Backup Unit LED Displays
LED Appearance Meaning
Battery A Status LED Steady green light Indicates battery A is charged.
Flashing green light Indicates the battery is undergoing a
test.
Steady amber light Indicates a battery error.
No light BBUs or power supply is turned off.
0260_L_R1
Battery AStatus LED
Battery BStatus LED
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.1.8 Power Distribution Unit Lamps
InServ Storage Servers include four Power Distribution Units (PDUs). PDUs contain two power
bank lamps (Figure 4-9):
Figure 4-9. Power Distribution Unit Lamps
A blue illuminated lamp indicates that power is being supplied to a power bank. When the
blue lamp is not illuminated, the power bank is not receiving AC input.
Battery B Status LED Steady green light Indicates battery B is charged.
Flashing green light Indicates the battery is undergoing a
test.
Steady amber light Indicates a battery error.
No light BBUs or power supply is turned off.
Table 4-7. Battery Backup Unit LED Displays (continued)
LED Appearance Meaning
0261_L_R1
Power Bank 2
Power Bank Lamps
Power Bank 1
4.173PAR Confidential
4.18
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4.2 Service Processor LEDs
4.2.1 Wintec Service Processor
The Wintec service processor LEDs are defined in the following section. The LED's are located
at the top of the Wintec service processor (Figure 4-10).
Figure 4-10. Wintec Service Processor LEDs
Consult Table 4-8 to verify proper functioning of the Wintec service processor displays.
Hard Disk Drive LED
0009_L_R2
NIC Port 2 LED
NIC Port 1 LED
Power LED
Reset Button
Power Button
NOTE: The Wintec service processor NIC Port LEDs in front and Ethernet Ports in
the rear are criss-crossed. NIC Port 2 corresponds with ETH1 and NIC Port 1
corresponds with ETH0.
Table 4-8. Wintec Service Processor Front-Panel Displays
LED Appearance Meaning
Hard Disk No light Indicates no hard drive activity.
Flashing blue light Indicates hard drive activity.
NIC Port 2 No light Indicates no network activity.
Flashing amber light Indicates network activity.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.2.2 Supermicro Service Processor
The Supermicro service processor LEDs are defined in the following section. The LEDs are
located at the top of the service processor (Figure 4-11).
Figure 4-11. Supermicro Service Processor LEDs
Consult Table 4-9 to verify proper functioning of the Supermicro service processor displays.
NIC Port 1 No light Indicates no network activity.
Flashing amber light Indicates network activity
Power No light Indicates the system is off.
Steady blue light Indicates the system is powered
on.
Table 4-8. Wintec Service Processor Front-Panel Displays (continued)
LED Appearance Meaning
Hard Disk Drive LED
NIC Port 2 LEDNIC Port 1 LED
Power LED
Overheat LED
Power Button
0637_L_R1
Reset Button
4.193PAR Confidential
4.20
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Table 4-9. Supermicro Service Processor Front-Panel Displays
LED Appearance Meaning
Power No light Indicates the service processor is off.
Steady green light Indicates the service processor is on.
Hard Disk Drive No light Indicates no hard drive activity.
Flashing amber light Indicates hard drive activity.
NIC Port 2 No light Indicates the port is not connected.
Steady green light Indicates the port is connected.
Flashing green light Indicates network activity.
NIC Port 1 No light Indicates the port is not connected.
Steady green light Indicates the port is connected.
Flashing green light Indicates network activity.
Overheat No light Indicates the service processor
temperature is normal.
Steady red light Indicates the service processor
temperature is overheating.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4.2.3 Supermicro II Service Processor
The Supermicro II service processor LEDs are defined in the following section. The LEDs are
located at the top of the service processor (Figure 4-12).
Figure 4-12. Supermicro II Service Processor LEDs
Consult Table 4-10 to verify proper functioning of the Supermicro II service processor displays.
Table 4-10. Supermicro II Service Processor Front-Panel Displays
LED Appearance Meaning
Power No light Indicates the service processor is off.
Steady green light Indicates the service processor is on.
Hard Disk Drive No light Indicates no hard drive activity.
Flashing amber light Indicates hard drive activity.
NIC Port 2 No light Indicates the port is not connected.
Steady green light Indicates the port is connected and there is
network activity.
Flashing green light Indicates network activity.
Hard Disk Drive LED
NIC Port 2 LED
NIC Port 1 LED
Power LED
Overheat LED
0802_L_R1
Reset Button
Power Button
4.213PAR Confidential
4.22
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
NIC Port 1 No light Indicates the port is not connected.
Steady green light Indicates the port is connected and there is
network activity.
Flashing green light Indicates network activity.
Overheat No light Indicates the service processor
temperature is normal.
Steady red light Indicates the service processor is
overheating.
Flashing red light Indicates the service processor has a failed
fan.
Table 4-10. Supermicro II Service Processor Front-Panel Displays (continued)
LED Appearance Meaning
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5Powering Down the Storage Server
In this chapter
5.1 General Precautions 5.1
5.2 Power-Down Procedure 5.2
5.1 General PrecautionsWhen powering down the storage server, observe the precautions as described in Chapter 2,
Precautions.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
5.1Powering Down the Storage Server
3PAR Confidential
5.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
5.2 Power-Down ProcedureWhen it is necessary to remove power from the storage server, the following procedure
describes how to safely remove power from the storage server and the service processor.
To power-down the storage server:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 4, InServ Product Maintenance.
3 Select option 6, Halt an InServ cluster/node.
4 Select the desired InServ and confirm all prompts to halt the system.
5 Press x to return to the 3PAR Service Processor Menu.
6 Allow 2 to 3 minutes for the InServ to halt, then verify the node status LEDs are flashing
green and the node hot-plug LEDs are solid amber which indicate the nodes have halted
(Figure 5-1).
Figure 5-1. Hot-Plug LED and Power Status LED
0601_L_R3
NodeHot-plug LED
Node Status LED
Disk Hot-plug LED
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
7 Select option 1, SP Control/Status.
8 Select option 3, Halt SP.
9 When prompted, press y to confirm halting the SP.
10 Wait approximately 30 seconds and verify if the LED on the front of the SP is no longer
illuminated.
11 Remove AC to the storage server by turning off all eight PDU circuit breakers (two circuit
breakers per PDU) in the cabinet (Figure 5-2).
Figure 5-2. PDU Circuit Breakers
If necessary:
12 Replace the bezel at the front of the server.
13 Close and lock the rear door of the server.
14 Replace and secure the front fascias on the storage server frame if applicable.
0295_L_R2
Circuit Breaker CB-1 Circuit Breaker CB-2
5.33PAR Confidential
5.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
Drive Chassis Maintenance Procedures
3PAR Confidential
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
6Replacing a Disk on a Drive Magazine
In this chapter
6.1 General Precautions 6.1
6.2 Planning 6.2
6.2.1 Logging Mode 6.2
6.3 Drive Replacement Procedure 6.3
6.1 General PrecautionsWhen handling the disks and drive magazines, observe the precautions as described in
Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
6.1Replacing a Disk on a Drive Magazine
3PAR Confidential
6.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
6.2 PlanningReplacing a disk requires preparation which can take between 2-12 hours to complete prior to
the physical replacement procedure. This section provides helpful hints and estimated times
for migrating data.
The table below shows examples of the time allotment needed for running the CLI command
servicemag on disks at or near capacity (Table 6-1).
6.2.1 Logging Mode
For slower (NL) or large disks (NL or >146GB), it is recommended to use the -log option with
the CLI servicemag command.
Conditions for using Logging mode:
■ Use if only a single disk has failed.
■ Use if the disk replacement can be completed within 30 minutes.
■ Do not use if you have any RAID-0 sets on the drive magazine.
■ Do not use if there are multiple failed disks or multiple problems.
Additional CLI commands:
■ Recommended CLI command: servicemag start -log -pdid <pd_id>.
■ Use the -pdid option in conjunction to specify the disk to be replaced. This ensures the
data vacates from the disk to be replaced.
Table 6-1. Time Estimates for Running CLI Command servicemag on fully used drives
Drive Magazine Size Estimated Time Required
50 GB 1 Hour or less
146 GB 3 Hours
300 GB 6 Hours
500 GB or larger 10 to 12 Hours
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
6.3 Drive Replacement ProcedureTo replace a disk on a drive magazine:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the showpd command. Verify the location of the failed disk and if there are
adequate spare chunklets defined.
NOTE: If there are not enough spare chunklets defined, contact your technical
support representative for assistance.
cli% showpd ----Size(MB)----- ----Ports----Id CagePos Type Speed(K) State Total Free A B 0 0:0:0 FC 10 normal 139520 119808 0:0:1* 1:0:1 1 0:0:1 FC 10 normal 139520 122112 0:0:1 1:0:1*2 0:0:2 FC 10 normal 139520 119552 0:0:1* 1:0:1 3 0:0:3 FC 10 failed 139520 117504 0:0:1 1:0:1*4 0:1:0 FC 10 normal 139520 119552 0:0:1* 1:0:1 5 0:1:1 FC 10 normal 139520 122112 0:0:1 1:0:1*6 0:1:0 FC 10 normal 139520 119552 0:0:1* 1:0:1 7 0:1:1 FC 10 normal 139520 122112 0:0:1 1:0:1*...
6.33PAR Confidential
6.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
5 Issue the servicemag start -log -pdid <disk_id> command, where <disk_id> is the ID of the failed disk.
6 To monitor progress, issue the servicemag status -d command.
cli% servicemag start -log -pdid 3Are you sure you want to run servicemag?select q=quit y=yes n=no: yservicemag start -log -pdid 3... servicing disks in mag: 0 3... valid disks: WWN [2000001D38B11AC7] Id [ 1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [ 1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [ 1206] diskpos [2] .................... WWN [2000001D38B11277] Id [ 1207] diskpos [3] ... not valid disks:
The servicemag start operation will continue in the background.
cli% servicemag status -dCage 0, magazine 0:The magazine was successfully brought offline by a servicemag start command.The command completed Thu Feb 11 10:49:30 2010.The output of the servicemag start was:servicemag start -log -pdid 3... servicing disks in mag: 0 3... normal disks: WWN [2000001D38B11AC7] Id [1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [1207] diskpos [3] ... not normal disks: WWN [2000001D38B11277] Id [1206] diskpos [2] ... relocating chunklets to spare space...... relocating chunklets from degraded raid sets to spare space... relocating chunklets from degraded raid sets to spare space... logging chunklets from pd WWN [2000001D38B11AC7] Id [0] ... logging chunklets from pd WWN [2000001D38B114FE] Id [1] ... logging chunklets from pd WWN [2000001D38B119AB] Id [2] ... retrying logging chunklets...... spinning down disk WWN [2000001D38B11AC7] Id [0]... spinning down disk WWN [2000001D38B114FE] Id [1]... spinning down disk WWN [2000001D38B119AB] Id [2]... spinning down disk WWN [2000001D38B11277] Id [3]... bypassing mag 0 3... bypassed mag 0 3servicemag start -log -pdid 3 -- Succeeded
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
When the command completes successfully, Succeeded is returned on the display, the hot-
plug LED on the drive magazine is illuminated, and the drive status LEDs on the drive
magazine are blinking slowly (Figure 6-1).
Figure 6-1. DC4 Drive Magazine Status LEDs
7 To locate the drive cage, issue the locatecage cage<x> command to turn on all LEDs for
a short duration, where <x> is the cage number. Drive magazine locations within the drive
cage are shown in Figure 6-2.
DC4 0587_L_R1
Disk Status LEDs
Hot-Plug LED
Drive MagazineStatus LED
!0123
6.53PAR Confidential
6.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 Remove the bezel from the front of the drive chassis.
Figure 6-2. DC4 Drive Magazine Locations in the Drive Cage
9 Prepare an Electrostatic Discharge-safe (ESD-safe) work area.
10 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw
that secures the drive magazine to the drive chassis housing (Figure 6-3).
Figure 6-3. Loosening the Captive Screw on the Drive Magazine
0598_L_R2
Drive Magazines
0 1 2 3 4 5 6 7 8 9
DC4 0591_L_R1
Captive Screw
!0123
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11 With your right hand on the handle of the drive magazine and your left hand supporting
the drive magazine from beneath, slide the magazine out of the drive chassis.
12 Place the drive magazine on an ESD-safe, level work surface with the solid back panel
facing down.
13 Identify the disk requiring replacement. The disk status LEDs numbered on the front of the
drive magazine corresponds to the disks mounted on the drive magazine. The numbers are
also indicated along the side of the drive magazine, as shown in Figure 6-4.
Figure 6-4. Disk Drive Numbering in a DC4 and DC4 Type-2 Drive Magazine
0600_L_R5
3
3
2
2 1 0
2
2
2
1
1
1
1
0
0
0
0
Rear
Rear
Rear
Front
Front
Front
3
3
3
3 2 1 0
DC4 Type-2
DC4
DC4 with SSDs
6.73PAR Confidential
6.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
14 Use a #2 Phillips screwdriver to remove the screws from the drive mount on a DC4 drive
magazine as shown in Figure 6-5.
◆ For DC4 and DC4 Type-2 drive magazines, unscrew and remove each screw securing the
disk drives.
◆ For DC4 drive magazines populated with Solid State Drives (SSDs), loosen each screw
approximately one to one-half turn. It is not necessary to remove all the screws.
Figure 6-5. Loosening and Removing the Screws Securing the Disks
3
2 1 03
DC4 with SSDs
Screw (4x)
0597_L_R3
3 2
2
1
1
0
0
Screw (4x)
2 1 03
3
3
2
2
1
1
0
0
DC4 Type-2
DC4
Screw (3x)
NOTE: Some brackets used with SSDs do not have clearance slots. Brackets
without clearance slots require removal of all screws before unmounting the drive
assembly.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
15 After loosening the disk, slide the disk toward the top of the drive magazine. Angle the
disk up and then slide it out of the magazine, as shown in Figure 6-6.
◆ For DC4 drive magazine populated with SSDs, slide the drive assembly away from the
main connector until the screwheads clear the screw clearance slots and lift assembly at
an angle out of the magazine.
Figure 6-6. Sliding a Disk Out of the Magazine
0592_L_R3
2
2
1
1
0
0
3
3
3 2 1 0
DC4 Type-2
DC4 with SSDs
3
DC4
3
3
2
2
2
1
1 0
0
1 0
3
6.93PAR Confidential
6.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
16 Remove the replacement disk from its protective packaging and avoid touching the
exposed underside of the replacement disk.
17 To install the disk into the new drive magazine:
a Carefully insert the replacement disk into the opening in the drive magazine.
◆ For an SSD assembly, align the screw clearance slots with the screwheads and insert.
b Slide the disk down until the screw holes align with the screw holes in the drive mount.
At this point, the drive should be seated in its connector and the top of the disk should
be near flush with the top of the drive magazine and should lay flat within the
magazine.
c Secure the disk to the drive mount with the screws. Do not overtighten the screws.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
18 Insert the drive magazine into the drive chassis with the ejector handle completely
lowered, using the notch at the top of the drive chassis housing as a guide (Figure 6-7).
Figure 6-7. Inserting a Magazine into a Drive Chassis
19 When the drive magazine slides to a stop, quickly lift the ejector handle up to engage the
magazine into the drive chassis midplane.
0599_L_R1
CAUTION: The drive magazines should slide in-and-out easily. If a drive magazine
does not insert smoothly, do not force it. Confirm whether the drive magazine is
properly aligned with the guide notch at the top of the drive chassis housing and
apply moderate pressure toward the left side of the magazine while inserting.
NOTE: If any disks in the drive magazine fail to spin up, reseat the drive magazine
and be sure to close the ejector handle quickly.
6.113PAR Confidential
6.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
20 Secure the magazine to the chassis by tightening the captive screw at the front of the
magazine. Do not overtighten the screw.
21 Place the removed disk in the protective packaging for return to 3PAR.
22 Verify all disk status LEDs on the drive magazine appear steady green and the hot-plug LED
is not illuminated.
23 On the SP, issue the showpd command and verify the removed disk lists as failed and the
replacement disk lists as new.
NOTE: After inserting the magazine into the drive chassis, allow approximately
one minute for the disks on the magazine to spin up before checking the
magazine LEDs.
cli% showpd ----Size(MB)----- ----Ports---- Id CagePos Type Speed(K) State Total Free A B--- 0:2:3 FC 15 new 285440 0 6:1:3* 7:2:31196 0:0:0 NL 7 normal 953344 886272 6:1:3* 7:2:3 1197 0:0:1 NL 7 normal 953344 886528 6:1:3 7:2:3*1198 0:0:2 NL 7 normal 953344 886272 6:1:3* 7:2:3 1199 0:0:3 NL 7 normal 953344 886784 6:1:3 7:2:3*1200 0:1:0 SSD 150 normal 47360 28416 6:1:3* 7:2:3 1201 0:1:1 SSD 150 normal 47360 29184 6:1:3 7:2:3*1202 0:1:2 SSD 150 normal 47360 28416 6:1:3* 7:2:3 1203 0:1:3 SSD 150 normal 47360 29184 6:1:3 7:2:3*1204 0:2:0 FC 15 normal 285440 0 6:1:3* 7:2:3 1205 0:2:1 FC 15 normal 285440 0 6:1:3 7:2:3*1206 0:2:2 FC 15 normal 285440 0 6:1:3 7:2:3 1207 0:2:3 FC 15 failed 285440 0 6:1:3 -----1208 0:3:0 NL 7 normal 953344 886784 6:1:3* 7:2:3 1209 0:3:1 NL 7 normal 953344 886784 6:1:3 7:2:3*1210 0:3:2 NL 7 normal 953344 886528 6:1:3* 7:2:3 1211 0:3:3 NL 7 normal 953344 886528 6:1:3 7:2:3*...
----------------------------------------------------------------- 41 total 20484864 17538816
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
24 Issue the servicemag resume <X Z> command, where X is the drive cage number and
Z is the location of the drive magazine in the drive chassis.
The servicemag resume process may take several hours or more to complete, depending
on the number of chunklets to be relocated. Once servicemag status shows chunklets
have begun relocating from spare space, issue the servicemag status command (the -d is optional for additional detailed information) to monitor the servicemag completion.
NOTE: The new disk appears at the top of the listed disks in the showpd
command output.
cli% servicemag resume 0 3Are you sure you want to run servicemag?select q=quit y=yes n=no: yservicemag resume 0 3... mag 0 3 already onlooped... firmware is current on pd WWN [20000024B6284FE8] Id [933] ... firmware is current on pd WWN [2000001D38B11AC7] Id [1204] ... firmware is current on pd WWN [2000001D38B114FE] Id [1205] ... firmware is current on pd WWN [2000001D38B119AB] Id [1207] ... firmware is current on pd WWN [2000001D38B11277] Id [1206] ... checking for valid disks...... disks in mag : 0 3... normal disks: WWN [20000024B6284FE8] Id [933] diskpos [2] .................... WWN [2000001D38B11AC7] Id [1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [1207] diskpos [3] ... not normal disks: WWN [2000001D38B11277] Id [1206] ... verifying spare space for disks 1204 and 1204... verifying spare space for disks 1205 and 1205... verifying spare space for disks 1207 and 1207... playback chunklets from pd WWN [20000024B6284FE8] Id [933] ... playback chunklets from pd WWN [2000001D38B11AC7] Id [1204] ... playback chunklets from pd WWN [2000001D38B114FE] Id [1205] ... playback chunklets from pd WWN [2000001D38B119AB] Id [1207]
The servicemag resume operation will continue in the background.
6.133PAR Confidential
6.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
25 Issue the servicemag status -d <X Z> command, where <X Z> is the location of the
drive cage and magazine from the previously issued servicemag resume command.
cli% servicemag status -dCage 0, magazine 3:The magazine is being brought online due to a servicemag resume.The last status update was at Thu Feb 11 11:09:21 2010.Unable to provide a relocation estimateThe cumulative output so far is:servicemag resume 0 3... mag 0 3 already onlooped... firmware is current on pd WWN [20000024B6284FE8] Id [933] ... firmware is current on pd WWN [2000001D38B11AC7] Id [1204] ... firmware is current on pd WWN [2000001D38B114FE] Id [1205] ... firmware is current on pd WWN [2000001D38B119AB] Id [1207] ... firmware is current on pd WWN [2000001D38B11277] Id [1206] ... checking for valid disks...... disks in mag : 0 3... normal disks: WWN [20000024B6284FE8] Id [933] diskpos [2] .................... WWN [2000001D38B11AC7] Id [1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [1207] diskpos [3] ... not normal disks: WWN [2000001D38B11277] Id [1206] ... verifying spare space for disks 1204 and 1204... verifying spare space for disks 1205 and 1205... verifying spare space for disks 1207 and 1207... playback chunklets from pd WWN [20000024B6284FE8] Id [933] ... playback chunklets from pd WWN [2000001D38B11AC7] Id [1204] ... playback chunklets from pd WWN [2000001D38B114FE] Id [1205] ... playback chunklets from pd WWN [2000001D38B119AB] Id [1207] ... 170 chunklets still waiting to be played back or relocating...... All chunklets played back / relocated.... relocating chunklets from raid set to new disk... relocating chunklets from spare space
NOTE: Both step 26 and step 27 are not required when using CLI command
option -pdid. Continue to step 28 if applicable. These steps perform when the
servicemag resume command is complete.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
26 Issue the dismisspd <PD_ID> command to remove the replaced disk, where <PD_ID> is
the ID of the replaced physical disk.
27 Issue the showpd <PD_ID> command and verify if the replaced disk is removed.
28 Issue the checkhealth -svc command to verify your system is healthy.
29 In the SP window issue the exit command to stop the CLI session.
30 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
31 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
32 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
33 Close and lock the rear door of the InServ.
34 Replace the bezel that covers the front of the InServ.
35 Replace and secure the front fascia on the storage server if applicable.
cli% dismisspd 0
cli% showpd 0No data available for specified PD(s)
6.153PAR Confidential
6.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
7Replacing a Drive Magazine
In this chapter
7.1 General Precautions 7.1
7.2 Planning 7.2
7.2.1 Logging Mode 7.2
7.3 Drive Magazine Replacement Procedure 7.3
7.1 General PrecautionsWhen handling drive magazines, observe the precautions as described in Chapter 2,
Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
7.1Replacing a Drive Magazine
3PAR Confidential
7.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
7.2 PlanningReplacing a drive magazine requires preparation and can take between 20 minutes to 12 hours
to complete prior to the physical replacement procedure. This section provides estimated times
for migrating data.
The table below shows examples of the time allotment needed for running CLI command
servicemag on drive magazines at or near capacity (Table 7-1).
7.2.1 Logging Mode
When replacing a drive magazine, use the -log option with the CLI servicemag command.
Instances when Logging mode is not recommended:
■ Do not use if there are multiple drive magazine problems.
■ Do not use if there are multiple failures in the same drive cage.
■ Do not use if you have any RAID-0 sets on the drive magazine.
■ Do not use if there are multiple problems or failures.
Additional CLI commands:
■ Recommended CLI command: servicemag start -log -nodisks <cage_id> <mag_id>.
■ This option should be used only in conjunction with the ‘-log’ option when servicing a
magazine which has all valid drives and no disks need to be replaced.
Table 7-1. Time Estimates for Running CLI Command servicemag
Drive Magazine Size Estimated Time Required
50 GB 1 Hour or less
146 GB 3 Hours
300 GB 6 Hours
500 GB or larger 10 - 12 Hours
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
7.3 Drive Magazine Replacement ProcedureTo replace a drive magazine:
1 Start an spmaint session.
a Connect the Maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the showpd command. Verify the location of the failed drive magazine and there are
adequate spare chunklets defined.
NOTE: If there are not enough spare chunklets defined, contact your technical
support representative for assistance.
7.33PAR Confidential
7.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
5 Issue the servicemag start -log -nodisks <X Z>, where X is the drive cage
number and Z is the location of the drive magazine in the drive cage.
6 To monitor progress, issue the servicemag status -d <X Z>, where <X Z> is the
location of the drive cage and magazine from the previously issued servicemag start command.
NOTE: The servicemag start command moves all the required, used
chunklets on the magazine. This is executed simultaneously for each hard drive
and takes approximately 20 seconds for each used chunklet.
cli% servicemag start -log -nodisks 0 3Are you sure you want to run servicemag?select q=quit y=yes n=no: yservicemag start -log -nodisks 0 3... servicing disks in mag: 0 3... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks:
The servicemag start operation will continue in the background.
cli% servicemag status -d 0 3Cage 0, magazine 3:The magazine is being brought offline due to a servicemag start.The last status update was at Wed Nov 21 07:52:29 2007.The cumulative output so far is:servicemag start -log -nodisks 0 3... servicing disks in mag: 0 3... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... relocating chunklets to spare space...... relocating chunklets from degraded raid sets to spare space... logging chunklets from pd WWN [5000C50002841761] Id [56] ... logging chunklets from pd WWN [5000C500028486F2] Id [57] ... logging chunklets from pd WWN [5000C5000284173F] Id [58] ... logging chunklets from pd WWN [5000C50002841675] Id [59] ...
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
When the command completes successfully, Succeeded is returned on the display, the
hot-plug LED on the drive magazine is illuminated, and the drive status LEDs on the drive
magazine are blinking slowly (Figure 7-1).
Figure 7-1. DC4 Drive Magazine LEDs
7 To locate the drive cage, issue the locatecage cage<x> command to turn on all LEDs for
a short duration, where <x> is the cage number. Drive magazine locations within the drive
cage are shown in Figure 7-2.
DC4 0587_L_R1
Disk Status LEDs
Hot-Plug LED
Drive MagazineStatus LED
!0123
7.53PAR Confidential
7.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 Remove the bezel from the front of the drive cage.
Figure 7-2. DC4 Drive Magazine Locations in the Drive Cage
9 Prepare an Electrostatic Discharge-safe (ESD-safe) work area.
10 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw
that secures the drive magazine (Figure 7-3).
Figure 7-3. Loosening the Captive Screw on the DC4 Drive Magazine
0598_L_R2
Drive Magazines
0 1 2 3 4 5 6 7 8 9
DC4 0591_L_R1
Captive Screw
!0123
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11 With your right hand on the handle of the drive magazine and your left hand supporting
the magazine from beneath, slide the magazine out of the drive chassis.
12 Place the magazine on an ESD-safe, level work surface with the solid back panel facing
down.
13 Remove the replacement magazine from its protective packaging and set aside any
electrostatic preventative packing material protecting the magazine. It will be used to
package the replaced drive magazine.
14 Place the replacement magazine on the ESD-safe work surface next to the failed magazine.
Perform step 15 through step 17 for each disk.
NOTE: When removing and replacing the disks, you must replace the disks in the
same position on the replacement magazine.
7.73PAR Confidential
7.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
15 Use a #2 Phillips screwdriver to remove the screws from the drive mount on a DC4 drive
magazine drive magazine as shown in Figure 7-4.
Figure 7-4. Screws Securing the Disks
3
2 1 03
DC4 with SSDs
Screw (4x)
0597_L_R3
3 2
2
1
1
0
0
Screw (4x)
2 1 03
3
3
2
2
1
1
0
0
DC4 Type-2
DC4
Screw (3x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16 Remove each disk from the failed drive magazine by sliding it out of the drive mount, as
shown in Figure 7-5. Avoid touching the exposed underside of the disk.
Figure 7-5. Sliding a Disk Out of the Drive Magazine
0592_L_R3
2
2
1
1
0
0
3
3
3 2 1 0
DC4 Type-2
DC4 with SSDs
3
DC4
3
3
2
2
2
1
1 0
0
1 0
3
7.93PAR Confidential
7.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
17 To install the disk into the new drive magazine:
a Move all disks from the failed drive magazine into the replacement drive magazine.
Carefully insert the disk into the same position on the replacement drive magazine.
b Slide the disk down until the screw holes align with the screw holes in the drive mount.
At this point, the disk should be seated in its connector and the top of the disk should
be near flush with the top of the drive magazine and should lay flat within the
magazine.
c Secure the disk to the drive magazine with the screws. Do not overtighten the screws.
18 Place the removed magazine into the protective packaging for return to 3PAR.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
19 Insert the drive magazine into the drive chassis with the ejector handle completely
lowered, using the notch at the top of the drive chassis housing as a guide (Figure 7-6).
Figure 7-6. Inserting a Magazine into a Drive Chassis
0599_L_R1
CAUTION: The drive magazines should slide in easily. If a drive magazine does not
insert smoothly, do not force it. Confirm the drive magazine is properly aligned
with the guide notch at the top of the drive chassis housing and apply moderate
pressure toward the left side of the magazine when inserting.
7.113PAR Confidential
7.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
20 When the drive magazine slides to a stop, quickly lift the ejector handle up to engage the
magazine into the drive chassis midplane.
21 Secure the magazine to the chassis by tightening the captive screw at the front of the
magazine. Do not overtighten the screw.
22 Verify all disk status LEDs on the drive magazine appear steady green and the hot-plug LED
is not illuminated.
23 In the SP window, issue the showpd command and verify the four disks are installed and in
a valid state.
NOTE: After inserting the magazine into the drive chassis, allow approximately
one minute for the disks on the magazine to spin up before checking the
magazine LEDs.
NOTE: If any of the disks in the drive magazine fail to spin up, reseat the drive
magazine and be sure to close the ejector handle quickly.
NOTE: If you have difficulty inserting drive magazines into drive chassis that also
have drive magazine filler panels installed, it may be necessary to remove the
adjacent filler panel to insert the drive magazine more easily.
cli% showpd ----Size(MB)----- ----Ports----Id CagePos Type Speed(K) State Total Free A B 0 0:0:0 FC 15 normal 139520 119808 0:0:1* 1:0:1 1 0:0:1 FC 15 normal 139520 122112 0:0:1 1:0:1*2 0:0:2 FC 15 normal 139520 119552 0:0:1* 1:0:1 3 0:0:3 FC 15 normal 139520 117504 0:0:1 1:0:1*
...
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
24 Issue the servicemag resume <X Z> command, where X is the drive cage number and Z is the location of the drive magazine in the drive cage.
The servicemag resume process can take several hours or more to complete, depending
on the number of chunklets to be relocated. Once servicemag status -d shows that
chunklets are being relocated from spare space, skip to step 26 to disconnect. Servicemag
completion may be monitored with the servicemag status -d command in step 25 on
page 7.14
cli% servicemag resume 0 3Are you sure you want to run servicemag?select q=quit y=yes n=no: yservicemag resume 0 3... onlooping mag 0 3... checking for valid disks...... disks in mag : 0 3... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56... verifying disk 57 ... verifying spare space for disks 57 and 57... verifying disk 58 ... verifying spare space for disks 58 and 58... verifying disk 59 ... verifying spare space for disks 59 and 59... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59]
The servicemag resume operation will continue in the background.
7.133PAR Confidential
7.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
25 Issue the servicemag status -d <X Z> command, where X is the drive cage number
and Z is the location of the drive magazine in the drive cage from the previously issued
servicemag resume command.
When the command completes successfully, Succeeded is returned on the display.
cli% servicemag status -d 0 3The magazine was brought online by a successful servicemag resume command.The command completed at Wed Nov 21 07:57:38 2007.The output of the servicemag resume was:servicemag resume 0 3... onlooping mag 0 3... checking for valid disks...... disks in mag : 0 3... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56... verifying disk 57 ... verifying spare space for disks 57 and 57... verifying disk 58 ... verifying spare space for disks 58 and 58... verifying disk 59 ... verifying spare space for disks 59 and 59... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59] ... All chunklets played back / relocated.... no chunklets to moveservicemag resume 0 3 -- Succeeded
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
26 Issue the checkhealth -svc command to verify your system is healthy.
27 In the SP window issue the exit command to stop the CLI session.
28 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
29 Disconnect the serial cable from the maintenance PC, coil and replace the cable behind the
SP.
30 Disconnect the red cross-over Ethernet cable from the laptop and coil and place the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
31 Close and lock the rear door of the InServ.
32 Replace the bezel that covers the front of the InServ.
7.153PAR Confidential
7.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
8Replacing an SFP Module on an FC-AL
In this chapter
8.1 General Precautions 8.2
8.2 SFP Module Replacement Procedure 8.2
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
8.1Replacing an SFP Module on an FC-AL
3PAR Confidential
8.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8.1 General PrecautionsWhen handling drive cage SFP modules, observe the precautions as described in Chapter 2,
Precautions.
8.2 SFP Module Replacement ProcedureThis section describes the procedure for replacing an SFP module in an FC-AL.
To replace a drive cage SFP module:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 Issue the servicecage startfc <x> <cage> command, where <x> is the SFP module
to be replaced and <cage> is the name of the drive cage to be serviced.
Figure 8-1. FC-AL LED and Port Locations
cli% servicecage startfc 1 cage5cli%
0655_L_R1
(Typical)
FC-AL Status LED
Port B RX LED
Port A RX LED
Hot-Plug LED
Port B TX LED
Port A TX LED
Port B
Port A
Split Mode LED 4 Gb/s
8.33PAR Confidential
8.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
5 To locate the drive cage, issue the locatecage –t 15 <cage> command to turn on all
LEDs for a short duration, where 15 is the number of seconds the LEDs are illuminated and
<cage> is the cage number.
6 Issue the showcage –d <cage> command, where <cage> is the cage name and verify
that the FC-AL hot-plug is on.
7 Verify the hot-plug LED on the FC-AL module being worked on is lit. See Figure 8-1.
8 Detach the Fibre Channel cable from the SFP by squeezing the tabs on the sides of the cable
and pulling to remove.
cli% showcage -d cage4Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 30-38 2.37 2.37 DC4 n/a
-----------Cage detail info for cage4 ---------
Position: ---
Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps -- -- 4Gbps
----------------------------------SFP Info-----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes
Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off OffLEDS(system,hotplug) Green,Off Green,Amber...
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
9 Wearing a wrist grounding strap, lift up on the retaining clip of the defective SFP module.
See Figure 8-2.
Figure 8-2. Removing the SFP
10 Carefully slide the defective SFP module out of the SFP slot.
11 Remove the replacement SFP module from its protective packaging.
12 Place the removed SFP module into the protective packaging for return to 3PAR.
13 Insert the replacement SFP module into the FC-AL until fully seated.
14 Lock the SFP retaining clip in place.
15 Reconnect the Fibre-Channel cable.
16 Verify the TX (Transmit) and RX (Receive) LEDs are illuminated. See Figure 8-1.
17 Issue the servicecage endfc <x> <cage> command, where <x> is the FC-AL module
and <cage> is the name of the drive cage.
0799_L_R1
cli% servicecage endfc 1 cage0cli%
8.53PAR Confidential
8.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
18 Issue the showpd command and verify that the port for the replaced SFP is now active and
that disks are on the loop.
19 Issue the showcage –d <cage> command, where <cage> is the cage name and verify
that the SFP State is OK.
cli% showpd ----Size(MB)----- ----Ports----Id CagePos Type Speed(K) State Total Free A B 0 0:0:0 FC 10 normal 139520 119808 0:0:1* 1:0:1 1 0:0:1 FC 10 normal 139520 122112 0:0:1 1:0:1*2 0:0:2 FC 10 normal 139520 119552 0:0:1* 1:0:1 3 0:0:3 FC 10 normal 139520 117504 0:0:1 1:0:1*4 0:1:0 FC 10 normal 139520 119552 0:0:1* 1:0:1 5 0:1:1 FC 10 normal 139520 122112 0:0:1 1:0:1*
cli% showcage -d cage4Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 30-37 2.37 2.37 DC4 n/a
-----------Cage detail info for cage4 ---------
Position: ---
Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps -- -- 4Gbps
----------------------------------SFP Info-----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes
Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off OffLEDS(system,hotplug) Green,Off Green,Off
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
20 Issue the checkhealth -svc command to verify your system is healthy.
21 In the SP window issue the exit command to stop the CLI session.
22 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
23 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
24 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
25 Close and lock the rear door of the InServ.
26 Replace the bezel that covers the front of the InServ.
27 Replace and secure the front fascia on the storage server if applicable.
8.73PAR Confidential
8.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
9Replacing a Drive Cage FC-AL Module
In this chapter
9.1 General Precautions 9.1
9.2 FC-AL Replacement Procedure 9.2
9.1 General PrecautionsWhen handling drive cage FC-AL modules, observe the precautions as described in Chapter 2,
Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
9.1Replacing a Drive Cage FC-AL Module
3PAR Confidential
9.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
9.2 FC-AL Replacement ProcedureTo replace a drive cage FC-AL module:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the servicecage startfc <x> <cage> command, where <x> is the FC-AL
module to be replaced and <cage> is the cage name.
5 Issue the showcage –d <cage> command, where <cage> is the cage name and verify
the FC-AL hot-plug is Amber by checking the LED (system,hotplug) line:
cli% servicecage startfc 1 cage4Are you sure you want to run "servicecage startfc 1 cage4"?select q=quit y=yes n=no: y
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
cli% showcage -d cage4Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 29-37 2.36 2.36 DC4 n/a
-----------Cage detail info for cage4 ---------
Position: ---
Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps -- -- 4Gbps
----------------------------------SFP Info-----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes
Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off OffLEDS(system,hotplug) Green,Off Green,Amber
-----------Midplane Info----------- Firmware_status Old Product_Rev 2.36 State Normal Op Loop_Split 0VendorId,ProductId 3PARdata,DC4 Unique_ID 1062030000098E00...
9.33PAR Confidential
9.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
6 Note the location of all Fibre Channel cables to be reconnected after FC-AL replacement. If
necessary, mark the cables that connect to the FC-AL before removing them. The drive-side
Fibre Channel cables are marked to simplify this task.
Detach the Fibre Channel cables from the FC-AL module by squeezing the tabs on the sides
of the cable and pulling to remove.
7 Wearing a wrist grounding strap, pull down the retaining clip of the SFP module
(Figure 9-1).
Figure 9-1. SFP Module
8 Holding the retaining clip, slide the SFP module out of the defective FC-AL.
9 Use a #2 Phillips screwdriver to loosen the captive screw that secures the FC-AL (Figure 9-2).
Figure 9-2. FC-AL Captive Screw
0799_L_R1
Captive Screw
0800_L_R1
FC-AL Handle
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
10 Pull the FC-AL handle down and slide the FC-AL module out of the drive chassis using the
handle on the side of the module, as shown in Figure 9-3.
Figure 9-3. Removing the FC-AL
11 Remove the replacement FC-AL module from its protective packaging and electrostatic
packing material and set aside.
12 Place the removed FC-AL module into the protective packaging for return to 3PAR.
13 Insert the replacement FC-AL module into the drive chassis and lift up the FC-AL handle
until fully seated.
14 Tighten the screw that secures the FC-AL module to the drive chassis housing. Do not
overtighten the screw.
15 Insert the SFP module into the FC-AL until fully seated.
16 Lock the retaining clip in place.
17 Reconnect all Fibre-Channel cables.
0801_L_R1
CAUTION: Drive cage FC-AL modules should glide in-and-out smoothly. If an
FC-AL module does not easily insert, do not force it. Before continuing, confirm
that the FC-AL module is properly aligned with the card guides at the top and
bottom of the drive chassis housing.
9.53PAR Confidential
9.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
18 Issue the servicecage endfc <x> <cage> command, where <x> is the FC-AL module
replaced and <cage> is the drive cage being updated.
19 Issue the showcage –d <cage> command, where <cage> is the name of the drive cage
where the FC-AL module is replaced, and verify that the drive cage now contains the
correct firmware level shown below RevA and RevB.
cli% servicecage endfc 1 cage4Are you sure you want to run "servicecage endfc 1 cage4"?select q=quit y=yes n=no: yUpgrading cage cage4 cpuA from rev 2.36 to revision in file /opt/tpd/fw/cage/dc4/lbod_fw.bin-2.37.Beginning test after upgrade for cage4cage4 passed test after upgrade
cli% showcage -d cage4Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 29-37 2.37 2.37 DC4 n/a
-----------Cage detail info for cage4 ---------
Position: ---
Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps -- -- 4Gbps
----------------------------------SFP Info-----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes
Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off OffLEDS(system,hotplug) Green,Off Green,Off
-----------Midplane Info----------- Firmware_status Current Product_Rev 2.37 State Normal Op Loop_Split 0VendorId,ProductId 3PARdata,DC4 Unique_ID 1062030000098E00
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
20 Issue the showpd command and verify the port for the replaced
FC-AL module is now active and the disks are on the loop.
21 Issue the checkhealth -svc command to verify your system is healthy.
22 In the SP window issue the exit command to stop the CLI session.
23 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
24 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
25 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the Ethernet cable and all other cables to the
node.
26 Close and lock the rear door of the InServ.
27 Replace the bezel that covers the front of the InServ.
28 Replace and secure the front fascia on the storage server if applicable.
cli% showpd ----Size(MB)----- ----Ports----Id CagePos Type Speed(K) State Total Free A B 0 0:0:0 FC 10 normal 139520 119808 0:0:1* 1:0:1 1 0:0:1 FC 10 normal 139520 122112 0:0:1 1:0:1*2 0:0:2 FC 10 normal 139520 119552 0:0:1* 1:0:1 3 0:0:3 FC 10 normal 139520 117504 0:0:1 1:0:1*4 0:1:0 FC 10 normal 139520 119552 0:0:1* 1:0:1 5 0:1:1 FC 10 normal 139520 122112 0:0:1 1:0:1*...
9.73PAR Confidential
9.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
10Replacing a Drive Cage Midplane Assembly
In this chapter
10.1 General Precautions 10.1
10.2 Planning 10.2
10.3 Migrating Data Off the Drive Cage 10.2
10.4 Midplane Assembly Replacement Procedure 10.6
10.5 Migrating Data Back to the Drive Cage 10.11
10.1 General PrecautionsWhen handling a drive cage midplane assembly, observe the precautions as described in
Chapter 2, Precautions.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
10.1Replacing a Drive Cage Midplane Assembly
3PAR Confidential
10.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
10.2 PlanningReplacing a drive cage midplane requires preparations which are determined after reviewing
the customer’s system layout. Each site must be evaluated for an efficient and safe replacement
without bringing down the entire InServ Storage Server.
■ Determine if there is free disk space to migrate data from the drive cage midplane that is
being replaced.
10.3 Migrating Data Off the Drive CageTo migrate data off the drive cage:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the showpd -sortcol 1 command to determine all PD IDs in the cage. The 1 indicates
which column to sort by.
5 Set the selected PD’s allocation flags to OFF by issuing the setpd ldalloc off <pdid>
command for each disk ID, where <PD_ID> is the physical disk identification.
NOTE: If there are not enough spare chunklets defined, contact your technical
support representative for assistance.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
6 Confirm the setting by issuing the showpd -sortcol 1. The PDs set to OFF will indicate 0
free space.
7 Issue the servicemag start <X Z> command, where X is the drive cage number and Z is the location of the drive magazine in the drive chassis.
cli% showpd -sortcol 1 ---Size(MB)---- -----------Ports-----------Id CagePos Type Speed(K) State Total Free A0 B0 A1 B1 0 0:0:0 FC 15 normal 139520 69760 0:0:1* 2:0:1 1:0:1 3:0:1 1 0:1:0 FC 15 normal 139520 0 0:0:1* 2:0:1 1:0:1 3:0:1 2 0:2:0 FC 15 normal 139520 69760 0:0:1* 2:0:1 1:0:1 3:0:1...
NOTE: The servicemag start command moves all used chunklets on the
magazine. This is executed simultaneously for each disk drive and takes
approximately 20 seconds for each used chunklet.
cli% servicemag start 0 1Are you sure you want to run servicemag?select q=quit y=yes n=no: yservicemag start 0 1... servicing disks in mag: 0 1... normal disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not normal disks:
The servicemag start operation will continue in the background.
10.33PAR Confidential
10.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 To monitor progress, issue the servicemag status -d <X Z> command, where <X Z> is the location of the drive cage and magazine from the previously issued servicemag start command.
9 Repeat step 7 for all drive magazines in the cage then continue to Midplane Assembly
Replacement Procedure on page 10.6.
cli% servicemag status -dCage 0, magazine 1:The magazine is being brought offline due to a servicemag start.The last status update was at Wed Sep 16 07:52:29 2009.The cumulative output so far is:servicemag start 0 1... servicing disks in mag: 0 1... normal disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not normal disks: ... relocating chunklets to spare space...... relocating chunklets from degraded raid sets to spare space
NOTE: Up to five servicemag -start operations may be running at once. Ensure
one is proceeding before starting the next.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
When servicemag completes successfully, Succeeded is returned on the display, the
hot-plug LED on the drive magazine is illuminated, and the status LEDs on the drive
magazine are blinking slowly (Figure 10-1).
Figure 10-1. DC4 Drive Magazine Status LEDs
DC4 0587_L_R1
Disk Status LEDs
Hot-Plug LED
Drive MagazineStatus LED
!0123
NOTE: Servicemag cannot bypass and set the hot-plug LED on the last drive
magazine because the system does not want to lose communication with the
cage. Consequently, the last ESI drive magazine will not have the hot-plug LED
illuminated, but three of the four disks should be spundown. If this is the case and
all other servicemag operations in the cage are successful, the midplane may be
replaced.
10.53PAR Confidential
10.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
10.4 Midplane Assembly Replacement ProcedureTo replace a drive cage midplane assembly:
1 Set the power supplies at the rear of the drive cage to the OFF position.
2 Disconnect the AC cords from the power supplies in the drive cage.
a Loosen the power supply cord lock screw with a #1 Phillips screwdriver, as shown in
Figure 10-2 and rotate the retaining latch counter clock wise.
b Disconnect the AC cord.
Figure 10-2. Power Supply Cord Lock
0634_L_R1
Cord Lock Screw
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3 Remove the power supplies from the rear of the drive cage:
a Use a #1 Phillips screw drive to remove two screws securing each power supply to the
chassis (Figure 10-3).
b Pull the handle to remove the power supply from the drive cage.
Figure 10-3. Power Supply Screws
4 At the front of the server, note the imprinted Fibre Channel cable labels on the cables that
connect to the front of the FC-AL modules, recording the locations of all cables.
5 Detach the Fibre Channel cables from the FC-AL modules by squeezing the tabs on the sides
of the cables and pulling to remove.
6 Use a #2 Phillips screwdriver to loosen the screws that secure the two FC-AL modules to the
drive cage and then slide the boards out slightly to disengage from the midplane.
7 Use a #2 Phillips screwdriver to loosen the captive screws securing the drive magazines to
the drive cage and pull each magazine out slightly to disengage from the drive cage.
0635_L_R1
Screws (2x)
10.73PAR Confidential
10.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 At the rear of the server, use a #1 Phillips screwdriver to remove the four screws and spacers
that secure the midplane assembly to the drive chassis housing, see Figure 10-4.
9 Grasp the midplane bracket at the middle and pull the assembly out of the drive chassis,
see Figure 10-4.
Figure 10-4. Removing the Midplane Assembly
0797_L_R1
Midplane Bracket
Midplane Assembly Screws (4)& Spacers (4)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
10 Use a #1 Phillips screwdriver to remove the eight screws that attach the midplane to the
midplane assembly, see Figure 10-5.
Figure 10-5. Midplane Removal
11 Remove the replacement midplane from its shipping container.
Midplane Screws (8)0798_L_R1
10.93PAR Confidential
10.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
12 Verify the replacement midplane speed is switched to 4GB, see Figure 10-6.
Figure 10-6. Midplane Switch
13 Place the removed midplane into the container for return to 3PAR.
14 Use a #1 Phillips screwdriver to attach the new midplane to the midplane assembly by
securing the eight screws previously removed.
15 Slide the replacement drive cage midplane assembly into the drive chassis until it is fully
seated. Reinstall and tighten the screws that secure the assembly to the drive chassis
housing. Do not overtighten the screws.
16 At the front of the server, slide each drive magazine back into the drive cage and tighten
the screws securing them to the drive cage. Do not overtighten the screws.
17 Slide the two FC-AL cards back into the drive cage and tighten the screws securing them to
the drive cage. Do not overtighten the screws.
18 Reconnect the Fibre Channel cables to their respective FC-AL modules in the drive cage.
19 Replace the power supplies at the rear of the drive cage.
a Slide the power supply into the rear of the drive cage until fully seated.
b Use a #1 Phillips screwdriver to tighten the M3 screws that secure the power supply to
the drive chassis housing. Do not overtighten the screws.
20 Reconnect the AC cords and tighten the cord lock screws on the power supplies to prevent
accidental disconnection.
4GB
2GB
0678_L_R2
Midplane Switch
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
21 Set the power supplies to the ON position and verify all power supply status LEDs appear
green.
22 Return to the front of the drive chassis to verify all LEDs in the drive magazines and FC-AL
modules appear green or flashing green and that the hot-plug LEDs on the drive magazines
and drive cage FC-AL modules are not lit.
10.5 Migrating Data Back to the Drive Cage
To migrate data back to the drive cage:
1 In the SP window, issue the showcage command and note the new cage number to be
used with the servicemag resume command. Because the old cage number (name) will
no longer exist, servicemag resume must be issued to the new cage number (name).
NOTE: Allow two minutes for the disks on the magazine to spin up before
checking the magazine LEDs.
NOTE: The replacement of a midplane will give the cage a new number because
the midplane serial number is different.
cli% showcageId Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 0 cage0 0:0:1 0 2:0:1 0 16 31-34 08 08 DC4 n/a 1 cage1 0:0:2 0 2:0:2 0 16 31-36 08 08 DC4 n/a 2 cage2 0:2:1 0 2:2:1 0 16 26-29 08 08 DC4 n/a 3 cage3 0:2:2 0 2:2:2 0 16 29-32 08 08 DC4 n/a...
10.113PAR Confidential
10.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
2 Issue the showpd command and check that all drive magazines are in a valid state.
3 Issue the servicemag resume <X Z> command, where X is the new drive cage number
and Z is the location of the drive magazine in the drive chassis.
cli% showpd---Size(MB)---- -----------Ports-----------
Id CagePos Type Speed(K) State Total Free A0 B0 A1 B1 0 0:0:0 FC 15 normal 139520 0 0:0:1* 2:0:1 1:0:1 3:0:1 1 0:1:0 FC 15 normal 139520 0 0:0:1* 2:0:1 1:0:1 3:0:1 2 0:2:0 FC 15 normal 139520 0 0:0:1* 2:0:1 1:0:1 3:0:1 3 0:3:0 FC 15 normal 139520 0 0:0:1* 2:0:1 1:0:1 3:0:1...
cli% servicemag resume 4 0Are you sure you want to run servicemag?select q=quit y=yes n=no: yservicemag resume 4 0... onlooping mag 4 0... checking for valid disks...... disks in mag : 4 0... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56... verifying disk 57 ... verifying spare space for disks 57 and 57... verifying disk 58 ... verifying spare space for disks 58 and 58... verifying disk 59 ... verifying spare space for disks 59 and 59... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59]
The servicemag resume operation will continue in the background.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
The servicemag resume process can take several hours or more to complete, depending
on the number of chunklets to be relocated. Once servicemag status shows that
chunklets are being relocated from spare space, continue to start the next servicemag.
Servicemag completion may be monitored with the servicemag status command.
NOTE: Up to five servicemag -resume operations may be running at once.
10.133PAR Confidential
10.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4 Issue the servicemag status -d <X Z> command where X is the drive cage number
and Z is the location of the drive magazine in the drive chassis from the previously issued
servicemag start command.
When the command completes successfully, Succeeded is returned on the display.
cli% servicemag status -d 4 0The magazine was brought online by a successful servicemag resume command.The command completed at Wed Nov 21 07:57:38 2007.The output of the servicemag resume was:servicemag resume 4 0... onlooping mag 4 0... checking for valid disks...... disks in mag : 4 0... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56... verifying disk 57 ... verifying spare space for disks 57 and 57... verifying disk 58 ... verifying spare space for disks 58 and 58... verifying disk 59 ... verifying spare space for disks 59 and 59... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59] ... All chunklets played back / relocated.... no chunklets to moveservicemag resume 4 0 -- Succeeded
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Repeat step 3 until all drive magazines in the cage have been restored then continue to the
next step.
6 Issue the showcage -d command and check all the ports and connections are in operable
condition.
7 When all servicemag -resume operations have successfully completed, the old cage name
should be removed from the system’s memory by entering servicecage remove
<cage_name> where cage_name is the old (missing) cage number (name).
8 Issue the checkhealth -svc command to verify the system is healthy.
9 Re-connect the customer’s Ethernet cable, if applicable, and all other cables to the node
once the node has rebooted.
10 In the SP window, issue the exit command to stop the CLI session.
11 Log out of the spmaint session by selecting X to exit from the 3PAR Service Processor
Menu.
12 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
13 Remove the red crossover Ethernet cable from the laptop and coil and replace the cable
behind the SP.
14 Close and lock the rear door of the InServ.
15 Replace the bezel that covers the front of the InServ.
16 Replace and secure the front fascias on the storage server frame if applicable.
cli% showcage -d cage0Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side0 cage1 2:0:2 0 3:0:2 0 16 23-36 2.14 2.14 DC4 n/a1 cage2 2:0:3 0 3:0:1 0 16 23-35 2.14 2.14 DC4 n/a...
10.153PAR Confidential
10.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11Replacing a Controller Node
In this chapter
11.1 General Precautions 11.1
11.2 Controller Node Replacement Procedure 11.2
11.1 General PrecautionsWhen handling controller nodes, observe the precautions as described in Chapter 2,
Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
11.1Replacing a Controller Node
3PAR Confidential
11.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
11.2 Controller Node Replacement ProcedureTo replace a controller node:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP), using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the showversion –b command to display the version of the InForm OS currently in
use by the cluster. Make note of the Release version.
5 Type exit to end the CLI session and to return to the 3PAR Service Processor Menu
6 Select option 4, InServ Product Maintenance.
7 Select option 6, Halt an InServ cluster/node.
NOTE: If the failed node is already offline, it is not necessary to shutdown the
node because it is already not part of the cluster. Skip to step 11 on page 11.3.
cli% showversion –bRelease version 2.3.1.180Patches: None
Component Name Version CLI Server 2.3.1.180CLI Client 2.3.1.180 System Manager 2.3.1.180 Kernel 2.3.1.180 TPD Kernel Code 2.3.1.180 Utilities 2.3.1.180Software Updater 2.3.1.180
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
8 Select the desired InServ.
9 Select the desired node and confirm all prompts to halt the node.
10 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green
and the node hot-plug LED is solid amber indicating the node has been halted.
11 Disconnect the cables from the front of the controller node, noting the locations of all
cables. If necessary, mark the cables that connect to the controller nodes before removing
them. The drive-side Fibre Channel cables are marked to simplify this task.
12 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw
that secures the insertion/removal lever of the controller node (Figure 11-1).
Figure 11-1. Loosening the Captive Screw on a Controller Node
13 Pull the controller node insertion/removal lever (1) out to disengage the node from the
chassis midplane, see Figure 11-2.
CaptiveScrew
0570_L_R1
11.33PAR Confidential
11.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
14 With one hand on the handle (2) of the controller node and the other hand supporting the
controller node from the bottom, slide the node out of the chassis, as shown in Figure 11-2,
and place it on an Electrostatic Discharge-safe (ESD-safe) work surface.
Figure 11-2. Removing the Controller Node from the Chassis
15 Remove the replacement controller node from its protective packaging and place it onto
an ESD-safe work surface next to the failed node.
0569_L_R2
2
1
CAUTION: Always use a wrist grounding strap to perform this procedure. A wrist
grounding strap is provided with the InServ Storage Server. Attach the grounding
strap clip directly to an unpainted surface of the rack.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16 Use a #2 Phillips screwdriver to remove the two screws securing the lid covers at the rear of
the nodes and remove the covers of both nodes (Figure 11-3).
Figure 11-3. Controller Node Lid Screws
17 Use a #2 Phillips screwdriver to loosen the captive screw securing the PCI retention bar to
the node housing and remove the retention bar on both nodes, as shown in Figure 11-4.
Figure 11-4. Removing the PCI Adapter Retention Bar
Screws (2x)
Rear of Node0567_L_R1
0644_L_R2
11.53PAR Confidential
11.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
18 Remove each PCI card by grasping the sides of each card and pulling upward, noting the
position of each removed card in the node.
For a 3PAR Fibre Channel adapter, use the attached loop handle to remove the card.
19 Install the removed PCI cards into the same slot number of the replacement node. Push
down on each card until fully seated.
20 Replace the PCI adapter retention bar by carefully aligning the notches in the retention bar
with the PCI cards.
21 At the front of the nodes, examine the part numbers of the old and new controller nodes.
If the part numbers are the same, the riser cards with DIMMs may be moved intact. The
data cache riser cards in older nodes are not interchangeable with newer nodes, and the
DIMMs must be removed from the older riser cards and moved to the new riser cards.
22 Remove both data cache riser card retainers by pulling upward (Figure 11-5).
Figure 11-5. Removing the Data Cache Riser Card Retainers
Guides
Riser Card Retainers
0602_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
23 Remove the data cache riser cards from the failed node by grasping the lift holes of the
card and pulling upward (Figure 11-6).
Avoid touching the surface of the data cache DIMMs when handling the riser card.
Figure 11-6. Removing the Data Cache Riser Card
24 Install the data cache riser cards into the replacement node by inserting them into the slots
on the node and pushing down on the cards until they are fully seated.
Loop Handle (2x)
0564_L_R2
NOTE: If the data cache riser cards in the old and new nodes have the same part
numbers, they may be moved between nodes (with DIMMs intact). If they are
different, the DIMMs must be removed and installed in the new node's riser cards.
NOTE: Installing the 4-slot riser card takes much more force than the 2-slot riser
does. Two audible “pops” should be heard when seating it and the top of the
riser should be flush with the top of the bulkhead guide brackets.
11.73PAR Confidential
11.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
The data cache riser cards need to be inserted between the staggered guides in the
bulkhead of the controller node, see Figure 11-7.
Figure 11-7. Staggered Guides for the Data Cache Riser Card
25 Reinstall the riser card retainers into the controller node. Be sure to slide the riser card
retainers between the parallel guides of the bulkhead (Figure 11-8).
Figure 11-8. Parallel Guides for the Riser Card Retainer
4-Slot Data Cache Riser Card Guide
0603_L_R3
2-Slot Data Cache Riser Card Guide
Riser Card Retainer (2x)
0604_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
26 You may be able to swap the internal node disk between nodes to shorten replacement
time, provided the disk in the failed node is expected to be good. If the disk in the
outgoing node is questionable, do not swap the disks. See Chapter 17, Replacing a Disk in a
Node for additional information for replacing and rebuilding a disk.
a If the disks were swapped:
1) It is not necessary to perform the node-rescue procedure to install the software on
the node disk.
2) Properly install the blank disk into the failed node to prevent damage during
shipping.
b If the disks were not swapped, it is necessary to install software on the blank disk by
performing the node-rescue procedure.
27 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two
screws previously removed.
28 Properly secure the parts and cover on the failed controller node then place it into the
protective packaging for return to 3PAR.
29 Insert the replacement controller node into the chassis. Do not push the node lever all the
way in at this time.
a If the node-rescue procedure must be performed, see Appendix D, Node Rescue.
b If a node-rescue is not needed because the node-disks were swapped, continue
to step 30.
WARNING: After the new node is installed, do not connect the cables at this
time.
11.93PAR Confidential
11.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
30 While applying mild pressure to handle (1) push the insertion lever (2) in quickly until it is
flush with the node. The quick insertion of (2) helps to overcome the initial insertion force
of the connector (Figure 11-9).
Figure 11-9. Replacing the Controller Node
NOTE: “Quick” does not mean pushing more forcefully or harder.
0641_L_R2
1
2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
31 Use a #2 Phillips screwdriver to tighten the captive screw that secures the lever to the
controller node chassis. Do not overtighten the screw (Figure 11-10).
The node will boot one or two times depending on the BIOS level (the node requires
approximately seven minutes per boot cycle).
Figure 11-10. Node Captive Screw
32 Verify the node LED is blinking green indicating that the node has joined the cluster.
33 Select option 7, Interactive CLI for an InServ from the spmaint session.
34 Select the desired InServ.
35 Verify the node has joined the cluster by issuing the shownode command.
36 Reboot the replaced node one more time to synchronize software and hardware values by
issuing the shutdownnode reboot <node_ID> command.
CaptiveScrew
0570_L_R1
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
11.113PAR Confidential
11.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
37 After the node reboots (5 -10 minutes), monitor the node status LED and verify again that
all nodes joined the cluster by issuing the shownode command.
38 Issue the checkhealth -svc command to verify the system is healthy.
39 Re-connect the customer’s Ethernet cable, if applicable, and all other cables to the node
once the node has rebooted.
40 In the SP window, issue the exit command to stop the CLI session.
41 Log out of the spmaint session by selecting X to exit from the 3PAR Service Processor
Menu.
42 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
43 Remove the red crossover Ethernet cable from the laptop and coil and replace the cable
behind the SP.
44 Close and lock the rear door of the InServ.
45 Replace the bezel that covers the front of the InServ.
46 Replace and secure the front fascias on the storage server frame if applicable.
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
CAUTION: Do not reconnect host cables without verifying the controller node is
functioning properly.
3PAR Confidential
Controller Node Maintenance Procedures
3PAR Confidential
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
12Replacing an SFP on a PCI Adapter
In this chapter
12.1 General Precautions 12.1
12.2 SFP Module Replacement Procedure 12.2
12.1 General PrecautionsWhen handling SFP modules, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
12.1Replacing an SFP on a PCI Adapter
3PAR Confidential
12.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
12.2 SFP Module Replacement ProcedureThis section describes the procedure for replacing an SFP module in a 3PAR fibre channel
adapter. A maximum of four SFP modules are located in the 3PAR adapter located at the front
of the controller node (Figure 12-1).
To replace an SFP module:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the CLI command showport and verify which port has the degraded SFP.
cli% showportN:S:P Mode State ----Node_WWN---- -Port_WWN/HW_Addr- Type0:0:1 initiator offline 2FF70002AC0000A3 20010002AC0000A3 disk0:0:2 initiator ready 2FF70002AC0000A3 20020002AC0000A3 free0:0:3 initiator ready 2FF70002AC0000A3 20030002AC0000A3 free0:0:4 initiator ready 2FF70002AC0000A3 20040002AC0000A3 free0:6:1 peer ready 2FF70002AC0000A3 0002AC530016 rcip1:0:1 initiator ready 2FF70002AC0000A3 21010002AC0000A3 disk1:0:2 initiator ready 2FF70002AC0000A3 21020002AC0000A3 free1:6:1 peer ready 2FF70002AC0000A3 0002AC530019 rcip
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Issue the showport -sfp command and verify the SFP that requires replacement. See
Figure 12-1 for SFP numbering.
Figure 12-1. 3PAR Fibre Channel Adapter
To replace a 3PAR fibre channel adapter SFP:
1 Remove the bezel at the front of the storage server.
2 Wearing a wrist grounding strap, identify the SFP module that requires replacement and
disconnect the cable from the SFP.
3 Lift out on the retaining clip of the defective SFP module and carefully slide the SFP out of
the slot.
cli% showport -sfpN:S:P -State- -Manufacturer- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM0:0:1 Degraded FINISAR_CORP. 4.20 No No No Yes0:0:2 OK FINISAR_CORP. 4.20 No No Yes Yes0:0:3 OK FINISAR_CORP. 4.20 No No Yes Yes0:0:4 OK FINISAR_CORP. 4.20 No No Yes Yes
0796_L_R1
Port 4
Port 1
4
3
2
1
12.33PAR Confidential
12.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4 Remove the replacement SFP module from its protective packaging.
5 Place the defective SFP module into the protective packaging for return to 3PAR.
6 Carefully slide the replacement SFP module into the fibre channel adapter until fully seated
and close the wire handle to secure it in place.
7 Reconnect the cable to the SFP module.
8 Issue the CLI command showport and verify that the ports are in good condition.
9 Issue the showport -sfp command and verify the replaced SFP is connected.
10 Issue the checkhealth -svc command to verify your system is healthy.
11 In the SP window issue the exit command to stop the CLI session.
12 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
cli% showportN:S:P Mode State ----Node_WWN---- -Port_WWN/HW_Addr- Type0:0:1 initiator ready 2FF70002AC0000A3 20010002AC0000A3 disk0:0:2 initiator loss_sync 2FF70002AC0000A3 20020002AC0000A3 free0:0:3 initiator loss_sync 2FF70002AC0000A3 20030002AC0000A3 free0:0:4 initiator loss_sync 2FF70002AC0000A3 20040002AC0000A3 free0:6:1 peer offline - 0002AC530016 rcip1:0:1 initiator ready 2FF70002AC0000A3 21010002AC0000A3 disk1:0:2 initiator loss_sync 2FF70002AC0000A3 21020002AC0000A3 free1:6:1 peer offline - 0002AC530019 rcip
cli% showport -sfpN:S:P -State- -Manufacturer- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM0:0:1 OK FINISAR_CORP. 4.20 No No No Yes0:0:2 OK FINISAR_CORP. 4.20 No No No Yes0:0:3 OK FINISAR_CORP. 4.20 No No No Yes0:0:4 OK FINISAR_CORP. 4.20 No No No Yes
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
13 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
14 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
15 Close and lock the rear door of the InServ.
16 Replace the bezel that covers the front of the InServ.
17 Replace and secure the front fascia on the storage server if applicable.
12.53PAR Confidential
12.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
13Replacing a PCI Adapter
In this chapter
13.1 General Precautions 13.1
13.2 PCI Adapter Replacement Procedure 13.2
13.1 General PrecautionsWhen handling PCI adapters, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
13.1Replacing a PCI Adapter
3PAR Confidential
13.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
13.2 PCI Adapter Replacement ProcedureThis section describes the procedure for replacing a PCI adapter.
A maximum of six PCI adapters are located at the front of the controller nodes (Figure 13-1).
Figure 13-1. PCI Adapters in the Controller Node
NOTE: The GUI, as well as the CLI command showport -i, will display the PCI
card brand and model.
0593_L_R1PCI Slots
0 1 2 3 4 5
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
To replace a PCI adapter inside the controller node:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
2 Select option 4, InServ Product Maintenance.
3 Select option 6, Halt an InServ cluster/node.
4 Select the desired InServ.
5 Select the desired node and confirm all prompts to halt the node.
6 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green
and the node hot-plug LED is solid amber indicating that the node has been halted.
7 Disconnect the cables from the front of the controller node, noting the locations of all
cables. If necessary, mark the cables that connect to the controller nodes before removing
them. The drive-side Fibre Channel cables are marked to simplify this task.
8 Remove the controller node from the node chassis by following the procedure described in
Removing a Controller Node on page C.2.
9 Place the controller node on an ESD-safe, level work surface.
NOTE: If the node previously halted due to a PCI adapter problem, it is not
necessary to shutdown the node because it is already not part of the cluster.
13.33PAR Confidential
13.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
10 Use a #2 Phillips screwdriver to loosen the captive screw securing the PCI retention bar to
the node housing and remove the retention bar, as shown in Figure 13-2.
Figure 13-2. Removing the PCI Adapter Retention Bar
11 Locate the PCI adapter that requires replacement and remove the adapter by grasping the
sides of the card and pulling upward.
For a 3PAR Fibre Channel adapter, use the attached loop handle to remove the card.
12 Remove the replacement adapter from its protective packaging and insert it into the same
PCI slot that held the removed adapter.
13 Push down on the adapter until it is fully seated. Reinstall the PCI retention bracket and
tighten the screw that secures the PCI retention bar to the controller node housing.
0644_L_R2
NOTE: When replacing adapters, make sure that the EMI gasketing material is
aligned properly and does not obscure the adapter LEDs at the front of the
controller node.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
14 Replace the PCI adapter retention bar by carefully aligning the notches in the retention bar
with the PCI cards.
15 Reinstall the controller node by following the procedures described in Replacing a Serviced
Controller Node on page C.5.
Once installed, allow approximately 5 minutes for the node to boot. When the node has
rebooted, the node status LED will flash green (1 blink per second).
16 In the SP window, select option 7, Interactive CLI for an InServ.
17 Select the desired InServ.
18 Issue the shownode command and verify the node has joined the cluster.
19 Issue the showport command and verify the port is ready as shown in the example
below:
cli% shownode Control Data CacheNode --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100
NOTE: A port must be connected and correctly communicating to be ready.
Verify if the port (State column) is ready.
cli% showportN:S:P Mode State ----Node_WWN---- -Port_WWN/HW_Addr- Type0:0:1 initiator ready 2FF70002AC000074 20010002AC000074 free0:0:2 initiator ready 2FF70002AC000074 20020002AC000074 disk0:2:1 initiator ready 2FF70002AC000074 20210002AC000074 free0:2:2 initiator ready 2FF70002AC000074 20220002AC000074 free...
13.53PAR Confidential
13.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
20 Issue the showport -i command and verify the correct card is installed in the correct slot
as shown in the example below:
21 Issue the checkhealth -svc command to verify your system is healthy.
22 In the service processor window issue the exit command to stop the CLI session.
23 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
24 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
25 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
26 Close and lock the rear door of the InServ.
27 Replace the bezel that covers the front of the InServ.
28 Replace and secure the front fascia on the storage server if applicable.
cli% showport -iN:S:P Brand Model Rev Firmware Serial0:0:1 3PAR FC044X 02 2.00.17.00 59726620030:0:2 3PAR FC044X 02 2.00.17.00 59726620030:2:1 3PAR FC044X 02 2.00.17.00 39861831020:2:2 3PAR FC044X 02 2.00.17.00 3986183102...
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
14Replacing Control Cache
In this chapter
14.1 General Precautions 14.1
14.2 Control Cache Replacement Procedure 14.2
14.1 General PrecautionsWhen handling control cache, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
14.1Replacing Control Cache
3PAR Confidential
14.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
14.2 Control Cache Replacement ProcedureThis section describes the procedure for replacing a control cache DIMM. Controller nodes
contain two control cache DIMMs to support the node microprocessors.
To replace a control cache DIMM inside a controller node:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
NOTE: The replacement DIMM must be from the same manufacturer and must
have the same manufacturer part number as the failed DIMM. The DIMM
manufacturer and part number can be found using shownode -i and
shownode -mem. You can also visually inspect the DIMM.
NOTE: If the failed node is already halted, it is not necessary to shutdown the
node because it is already not part of the cluster.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 Issue the shownode -i command to identify the DIMM manufacturer and manufacturer
part number.
5 Type exit to end the CLI session and to return to the 3PAR Service Processor Menu
6 Select option 4, InServ Product Maintenance.
7 Select option 6, Halt an InServ cluster/node.
8 Select the desired InServ.
9 Select the desired node and confirm all prompts to halt the node.
10 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green
and the node hot-plug LED is solid amber indicating that the node has been halted.
11 Disconnect the cables from the front of the controller node, noting the locations of all
cables. If necessary, mark the cables that connect to the controller nodes before removing
them. The drive-side Fibre Channel cables are marked to simplify this task.
12 Remove the controller node from the node chassis by following the procedure described in
Removing a Controller Node on page C.2.
13 Place the controller node on an ESD-safe, level work surface.
cli% shownode -i-------------------------------------------Physical Memory----------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB) 2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 2048 2 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 2048 2 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048 2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048
14.33PAR Confidential
14.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
14 Use a #2 Phillips screwdriver to remove the two screws securing the lid cover at the rear of
the node and remove the cover (Figure 14-1).
Figure 14-1. Removing the Node Cover
15 Locate the control cache DIMM that requires replacement (Figure 14-2).
Figure 14-2. Controller Node Control Cache Locations
Screws (2x)
Rear of Node0567_L_R1
0574_L_R2
Control Cache DIMMs:DIMM 0
DIMM 1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16 Release the control cache DIMM by pressing outward on the two tabs on the sides of the
DIMM, as shown in Figure 14-3.
Figure 14-3. Releasing a Control Cache DIMM
17 Physically inspect the DIMM to make sure the manufacturer and manufacturer part number
match the failed DIMM. Use the following descriptions to identify the DIMM by
manufacturer:
◆ Simple Tech––Identified by STEC on top surface at the edge of the DIMM.
◆ Micron––Identified by M inside an ellipse on top surface at the edge of the DIMM.
18 Remove the replacement DIMM from its protective packaging.
0026_L_R1
14.53PAR Confidential
14.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
19 Avoid touching the surface of the DIMM when inserting it into the vacant slot in the
controller node (Figure 14-4).
Figure 14-4. Inserting a Replacement Control Cache DIMM
20 Insert the control cache DIMM by pushing downward on the edge of the DIMM until the
tabs on both sides snap into place.
21 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two
screws previously removed.
22 Replace the controller node by following the procedures described in Replacing a Serviced
Controller Node on page C.5.
23 In the service processor window, select option 7, Interactive CLI for an InServ from
the 3PAR Service Processor Menu.
24 Select the desired InServ.
25 Issue the shownode command and verify the node has joined the cluster.
0027_L_R1
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
26 Issue the shownode -i command and verify the control cache is operational.
27 Issue the checkhealth -svc command to verify your system is healthy.
28 In the service processor window issue the exit command to stop the CLI session.
29 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
30 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
31 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
32 Close and lock the rear door of the InServ.
33 Replace and secure the front fascia on the storage server if applicable.
cli% shownode -i-------------------------------------------Physical Memory----------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB) 2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 2048 2 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 2048 2 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048 2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048
14.73PAR Confidential
14.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
15Replacing Data Cache
In this chapter
15.1 General Precautions 15.1
15.2 Data Cache Replacement Procedure 15.2
15.1 General PrecautionsWhen handling data cache, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
15.1Replacing Data Cache
3PAR Confidential
15.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
15.2 Data Cache Replacement ProcedureThis section describes the procedure for replacing a data cache DIMM.
Data cache DIMMs are located on two data cache riser cards within the nodes. One riser card
holds four data cache DIMMs and the second riser card holds two data cache DIMMs.
To replace a data cache DIMM inside the controller node:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 4, InServ Product Maintenance.
3 Select option 6, Halt an InServ cluster/node.
4 Select the desired InServ.
NOTE: Data cache DIMMs must be replaced by the DIMMs with the same
manufacturing part number.
NOTE: If the failed node is already halted, it is not necessary to shutdown the
node because it is already not part of the cluster.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Issue the shownode -i command to identify the DIMM manufacturer and the
manufacturer part number.
6 Select the desired node and confirm all prompts to halt the node.
7 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green
and the node hot-plug LED is solid amber indicating that the node has been halted.
8 Disconnect the cables from the front of the controller node, noting the locations of all
cables. If necessary, mark the cables that connect to the controller nodes before removing
them. The drive-side Fibre Channel cables are marked to simplify this task.
9 Remove the controller node from the node chassis by following the procedure described in
Removing a Controller Node on page C.2.
10 Place the controller node on an ESD-safe, level work surface.
cli% shownode -i-------------------------------------------Physical Memory----------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB)
2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 20482 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 20482 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048
2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048 3 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E215539C 4431 2048 3 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A1 4431 2048 3 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8125 0300 2048 3 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8132 0300 2048 3 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8149 0300 2048 3 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8148 0300 2048 3 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A812D 0300 2048 3 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8164 0300 2048
15.33PAR Confidential
15.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
11 Use a #2 Phillips screwdriver to remove the two screws securing the lid cover at the rear of
the node and remove the cover (Figure 15-1).
Figure 15-1. Removing the Node Cover
12 Locate the data cache riser cards in the controller node (Figure 15-2).
Figure 15-2. Data Cache Riser Cards
Screws (2x)
Rear of Node0567_L_R1
4-Slot Riser Card 2-Slot Riser Card
0573_L_R2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
13 Identify the DIMM(s) requiring replacement and remove the appropriate data cache riser
card (Figure 15-3).
Figure 15-3. Data Cache DIMMs
0563_L_R3
Bank 2
Bank 0
Bank 1
DIMM 2.0 (J1300)DIMM 2.1 (J1200)
DIMM 1.0 (J0900)DIMM 1.1 (J0800)
DIMM 0.0 (J0901)DIMM 0.1 (J0801)
Data Cache 2-Slot Riser Card
Data Cache 4-Slot Riser Card
15.53PAR Confidential
15.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
14 Remove the appropriate data cache riser card retainer to access the data cache riser card by
pulling it upward (Figure 15-4).
Figure 15-4. Removing the Data Cache Riser Card Retainers
15 Remove the appropriate data cache riser card by grasping the lift holes of the card and
pulling upward as shown in Figure 15-5.
Avoid touching the surface of the data cache DIMMs when handling the riser card.
Figure 15-5. Removing the Data Cache Riser Card
Guide
Riser Card Retainers
0566_L_R2
Loop Handle (2x)
0564_L_R2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16 Place the data cache riser card on an ESD-safe, level work surface.
17 Release the data cache DIMM by pressing outward on the two tabs on the sides of the
DIMM, as shown in Figure 15-6.
Figure 15-6. Releasing the Data Cache DIMM from the Riser Card
18 Physically inspect the DIMM to make sure the manufacturer and manufacturer part number
match the failed DIMM. Use the following descriptions to identify the DIMM by
manufacturer:
◆ Simple Tech––Identified by STEC on top surface at the edge of the DIMM.
◆ Micron––Identified by M inside an ellipse on top surface at the edge of the DIMM.
0026_L_R1
15.73PAR Confidential
15.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
19 Remove the replacement data cache DIMM from its protective packaging.
20 Insert the replacement data cache DIMM into the slot that held the failed DIMM
(Figure 15-7).
Figure 15-7. Inserting Replacement Data Cache into the Riser Card
Avoid touching the surface of the data cache DIMMs.
21 Insert each data cache DIMM by pushing downward on the edge of the DIMM until the
tabs on both sides snap into place.
0027_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
22 Install the data cache riser card into the node by inserting it into the slot on the node and
pushing down on the card until it is fully seated.
The data cache riser cards need to be inserted between the staggered guides in the
bulkhead of the controller node, see Figure 15-8.
Figure 15-8. Staggered Guides for the Data Cache Riser Card
NOTE: Installing the 4-slot riser card requires more force than the 2-slot riser. Two
audible “pops” sounds when seating it and the top of the riser should be flush
with the top of the bulkhead guide brackets.
4-Slot Data Cache Riser Card Guide
0603_L_R3
2-Slot Data Cache Riser Card Guide
15.93PAR Confidential
15.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
23 Replace the riser card retainer in the controller node. Be sure to slide the riser card retainer
between the parallel guides of the bulkhead, see Figure 15-9.
Figure 15-9. Parallel Guides for the Riser Card Retainer
24 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two
screws previously removed.
25 Replace the controller node by following the procedures described in Replacing a Serviced
Controller Node on page C.5.
26 In the SP window, select option 7, Interactive CLI for an InServ from the 3PAR
Service Processor Menu.
27 Select the desired InServ.
28 Issue the shownode command and verify the node has joined the cluster.
Riser Card Retainer (2x)
0604_L_R1
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
29 Issue the shownode -i command and verify the memory is operational.
30 Issue the checkhealth -svc command to verify your system is healthy.
31 In the SP window issue the exit command to stop the CLI session.
32 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
33 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
34 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
35 Close and lock the rear door of the InServ.
36 Replace and secure the front fascia on the storage server if applicable.
cli% shownode -i-------------------------------------------Physical Memory----------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB)
2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 20482 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 20482 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048
2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048 3 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E215539C 4431 2048 3 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A1 4431 2048 3 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8125 0300 2048 3 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8132 0300 2048 3 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8149 0300 2048 3 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8148 0300 2048 3 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A812D 0300 2048 3 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8164 0300 2048
15.113PAR Confidential
15.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16Replacing a Data Cache Riser Card
In this chapter
16.1 General Precautions 16.1
16.2 Data Cache Riser Card Replacement Procedure 16.2
16.1 General PrecautionsWhen handling data cache riser cards, observe the precautions as described in Chapter 2,
Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
16.1Replacing a Data Cache Riser Card
3PAR Confidential
16.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
16.2 Data Cache Riser Card Replacement ProcedureThis section describes the procedure for replacing a data cache riser card. The controller node
contains two data cache riser cards. One riser card holds up to four data cache DIMMs and the
second riser card holds up to two data cache DIMMs.
To replace a data cache riser card inside the controller node:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 4, InServ Product Maintenance.
3 Select option 6, Halt an InServ cluster/node.
4 Select the desired InServ and confirm all prompts to halt the node.
5 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green
and the node hot-plug LED is solid amber which indicates the node has been halted.
6 Remove the controller node from the node chassis by following the procedure described in
Removing a Controller Node on page C.2.
7 Place the controller node on an ESD-safe, level work surface.
NOTE: There are different versions of riser cards, which are NOT interchangeable
between the original node (P/N 970-200006) and the second-generation node
(P/N 970-200067). Verify the replacement riser card is the same version as the riser
card being replaced.
NOTE: If the failed node is already halted, it is not necessary to shutdown the
node because it is already not part of the cluster.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
8 Use a #2 Phillips screwdriver to remove the two screws securing the lid cover at the rear of
the node and remove the lid (Figure 16-1).
Figure 16-1. Removing the Node Cover
9 Locate the data cache riser card that needs replacement (Figure 16-2).
Figure 16-2. Data Cache Riser Card
Screws (2x)
Rear of Node0567_L_R1
4-Slot Riser Card 2-Slot Riser Card
0573_L_R2
16.33PAR Confidential
16.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
10 Remove the appropriate data cache riser card retainer to access the data cache riser card by
pulling it upward (Figure 16-3).
Figure 16-3. Removing the Data Cache Riser Card Retainers
11 Remove the appropriate data cache riser card by grasping the lift holes of the card and
pulling upward as shown in Figure 16-4.
Avoid touching the surface of the data cache DIMMs when handling the riser card.
Figure 16-4. Removing the Data Cache Riser Card (2-Slot Card Shown)
12 Place the riser card on an ESD-safe, level work surface.
Guides
Riser Card Retainers
0602_L_R1
Loop Handle (2x)
0564_L_R2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
13 Remove the replacement data cache riser card from its protective packaging and place it
next to the removed riser card.
14 Release the data cache DIMMs by pressing outward on the two tabs on the sides of the
DIMM (Figure 16-5). Note which slots contain DIMMs.
Figure 16-5. Releasing a Data Cache DIMM
15 Insert the DIMMs into the same slot of the replacement data cache riser card by pushing
downward on the edge of the DIMM until the tabs on both sides snap into place
(Figure 16-6). Repeat for each DIMM.
Avoid touching the surface of the data cache DIMMs.
Figure 16-6. Inserting a Data Cache DIMM
0026_L_R1
0027_L_R1
16.53PAR Confidential
16.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
16 Replace the data cache riser card by inserting it into the slot in the controller node and
pushing down on the riser card until it is fully seated (Figure 16-7).
The data cache riser cards need to be inserted between the staggered guides in the
bulkhead of the controller node.
Figure 16-7. Staggered Guides for the Data Cache Riser Card
NOTE: Installing the 4-slot riser card takes much more force than the 2-slot riser
does. Two audible “pops” should be heard when seating it and the top of the
riser should be flush with the top of the bulkhead guide brackets.
4-Slot Data Cache Riser Card Guide
0603_L_R3
2-Slot Data Cache Riser Card Guide
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
17 Replace the riser card retainer in the controller node. Be sure to slide the riser card retainer
between the parallel guides of the bulkhead, see Figure 16-8.
Figure 16-8. Parallel Guides for the Riser Card Retainer
18 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two
screws previously removed.
19 Replace the controller node by following the procedures described in Replacing a Serviced
Controller Node on page C.5.
20 In the SP window, select option 7, Interactive CLI for an InServ from the 3PAR
Service Processor Menu.
21 Select the desired InServ.
22 Issue the shownode command and verify the node has joined the cluster.
Riser Card Retainer (2x)
0604_L_R1
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
16.73PAR Confidential
16.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
23 Issue the shownode -mem command and verify the memory is operational.
24 Issue the checkhealth -svc command to verify your system is healthy.
25 In the SP window issue the exit command to stop the CLI session.
26 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
27 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
28 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
29 Close and lock the rear door of the InServ.
30 Replace the bezel that covers the front of the InServ.
31 Replace and secure the front fascia on the storage server if applicable.
cli% shownode -memNode Riser Slot SlotID -Name-- -Usage- --Type--- --Manufacturer--- -Serial- -Latency- Size(MB)
0 n/a 0 J4200 DIMM0 Control FB-DIMM Micron Technology E20BC997 CL5.0/5.0 2048
0 n/a 1 J4300 DIMM1 Control FB-DIMM Micron Technology E20BC996 CL5.0/5.0 2048
0 2-slot 0 J0901 DIMM0.0 Data DDR_SDRAM Micron Technology E010DF65 CL2.0/2.5 2048
0 4-slot 1 J0900 DIMM1.0 Data DDR_SDRAM Micron Technology E010DF98 CL2.0/2.5 2048
0 4-slot 2 J1300 DIMM2.0 Data DDR_SDRAM Micron Technology E010DF64 CL2.0/2.5 2048
1 n/a 0 J4200 DIMM0 Control FB-DIMM Micron Technology E20BC995 CL5.0/5.0 2048
1 n/a 1 J4300 DIMM1 Control FB-DIMM Micron Technology E20BC992 CL5.0/5.0 2048
1 2-slot 0 J0901 DIMM0.0 Data DDR_SDRAM Micron Technology E010DF6A CL2.0/2.5 2048
1 4-slot 1 J0900 DIMM1.0 Data DDR_SDRAM Micron Technology E010DF6F CL2.0/2.5 2048 1 4-slot 2 J1300 DIMM2.0 Data DDR_SDRAM Micron Technology E010DF69 CL2.0/2.5 2048
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
17Replacing a Disk in a Node
In this chapter
17.1 General Precautions 17.1
17.2 Node Disk Replacement Procedure 17.2
17.2.1 Performing Node Rescue 17.4
17.1 General PrecautionsWhen handling a node disk, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
17.1Replacing a Disk in a Node
3PAR Confidential
17.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
17.2 Node Disk Replacement ProcedureTo replace the node disk assembly:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the showversion –b command to display the version of the InForm OS currently in
use in the cluster. You will need to know the InForm OS version when running node rescue.
NOTE: If the failed node is already offline, it is not necessary to shutdown the
node because it is not part of the cluster.
cli% showversion –bRelease version 2.3.1.180Patches: None
Component Name Version CLI Server 2.3.1.180 CLI Client 2.3.1.180 System Manager 2.3.1.180 Kernel 2.3.1.180TPD Kernel Code 2.3.1.180Utilities 2.3.1.180 Software Updater 2.3.1.180
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Type exit to end the CLI session and to return to the 3PAR Service Processor Menu.
6 Select option 4, InServ Product Maintenance.
7 Select option 6, Halt an InServ cluster/node.
8 Select the desired InServ.
9 Select the desired node and confirm all prompts to halt the node.
10 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is rapidly flashing
green (3 blinks per second) and the node hot-plug LED is steady amber. The disk
hot-plug LED should be a steady or solid amber to indicate the node has been halted.
Figure 17-1. Node LEDs
11 Use a #2 Phillips screwdriver to loosen the captive screw on the disk assembly.
Figure 17-2. Disk Assembly Captive Screw
0601_L_R3
NodeHot-plug LED
Node Status LED
Disk Hot-plug LED
0578 _L_R1
Captive Screw
17.33PAR Confidential
17.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
12 Slide the handle out then carefully slide the disk assembly out of the controller node.
13 Remove the replacement disk assembly from its protective packaging and set aside the
electrostatic preventative packing material that surrounds the carrier.
14 Place the failed disk assembly in the electrostatic packaging for return to 3PAR.
15 If necessary, use a #2 Phillips screwdriver to release the captive screw on the disk assembly
handle. Let the handle extend all the way out.
16 Hold the disk assembly by the handle and slide the assembly into the node. Be sure to
carefully slide the assembly tab past the node disk notch, as shown in Figure 17-3.
Figure 17-3. Disk Carrier Tab
17 Use a #2 Phillips screwdriver to secure the captive screw of the disk carrier handle. Do not
over tighten the screw.
17.2.1 Performing Node Rescue
To rebuild the internal drive in the controller node:
1 Prepare the maintenance PC as described in Chapter 3, Connecting the Maintenance PC.
Disk Carrier Slot
0577 _L_R1
NOTE: The Auto-Rescue utility of the service processor requires a functional
connection to the InServ Storage Server cluster that can process CLI commands.
Auto-Rescue builds the disk of the node so it contains the proper software for the
cluster.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
2 At the rear of the storage server, uncoil the red crossover Ethernet cable connected to the
3PAR private network connection of the service processor (Figure 17-4).
Figure 17-4. Connecting the Crossover Cable
3 Connect ETH1 of the SP to the ETH0 (E0) port of the node that is being rescued through the
crossover cable. Depending on the location of the service processor and the nodes, route
the cable under or around the side of the storage server cabinet.
4 If necessary, log in to the SP to start an spmaint session by entering your login name and
password.
5 Select option 4, InServ Product Maintenance.
6 Select option 11, Node Rescue.
7 Select option 1, Configure Node Rescue.
8 Select the desired InServ Storage Server.
9 Select option 3, Automatic Node Rescue.
10 Enter the desired node number.
11 Select y to confirm the correct node number.
0299_L_R1
Ethernet 0
Ethernet 1
ServiceProcessor
Node
CrossoverCable
17.53PAR Confidential
17.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Result: When communication from the SP to the node is established, the following appears on
the SP:
root@1200163-0 Tue Apr 01 16:53:19:~# beginning rescue function....255.248 -s 10.255.155.54155.53 -m 255.255 Informing system manager to not autoreset node1Resetting node 1Attempting to contact node 1 via internal serial portWaiting for node to respond (10 seconds elapsed)...Waiting for node to respond (20 seconds elapsed)...Waiting for node to respond (30 seconds elapsed)...=Successfully started inter-node serial link communicationStarting Whack, setting values, and loading image:Interacting with CBIOS on the node......Booting from net...TFTP "install" from 10.255.155.54................................completemknbi-1.2-7/first32.c (GPL)Top of ramdisk is 0X1FFFF000Ramdisk at 0X00800000, size 0X00500000...Kernel on remote node has been started.Waiting for node to join cluster. This usually takes around 10 minutes, but maytake 20 minutes or longer.Install kernel is running - please wait...Waiting for node to join cluster (0 minutes and 15 seconds elapsed)=Waiting for node to join cluster (0 minutes and 30 seconds elapsed)...Waiting for node to join cluster (13 minutes and 15 seconds elapsed)=Node 1 has joined the cluster; node rescue successful....Please wait...
Starting SP tasks.....
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
12 Verify the node status LED is blinking green which indicates the node has joined the cluster.
13 Select 1, Deconfigure (name of cluster) Node Rescue.
14 Select x, Return to previous menu.
15 Select option 7, Interactive CLI for an InServ.
16 Select the desired InServ.
17 Verify that the node has joined the cluster by issuing the shownode command.
18 Issue the checkhealth -svc command to verify your system is healthy.
19 In the SP window issue the exit command to stop the CLI session.
20 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
21 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
22 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
23 Close and lock the rear door of the InServ.
24 Replace the bezel that covers the front of the InServ.
25 Replace and secure the front fascia on the storage server if applicable.
NOTE: This process takes approximately 10 minutes. When complete, the node
reboots and becomes part of the cluster. If this takes longer than 20 minutes,
problems may exist and the node rescue process needs to be corrected.
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
17.73PAR Confidential
17.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
18Replacing a Clock Battery
In this chapter
18.1 General Precautions 18.1
18.2 Clock Battery Replacement Procedure 18.1
18.1 General PrecautionsWhen handling a clock battery, observe the precautions as described in Chapter 2, Precautions.
18.2 Clock Battery Replacement ProcedureThe clock inside the controller node uses a 3-V lithium coin battery that requires periodic
replacement.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
NOTE: Contact 3PAR to obtain batteries and other replacement parts for InServ
Storage Servers.
18.1Replacing a Clock Battery
3PAR Confidential
18.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
To replace the clock battery inside the controller node:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 4, InServ Product Maintenance.
3 Select option 6, Halt an InServ cluster/node.
4 Select the desired InServ and confirm all prompts to halt the node.
5 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is rapidly flashing
green (3 blinks per second) and the node hot-plug LED is steady amber indicating that the
node has been halted.
Figure 18-1. Controller Node LED
NOTE: If the failed node is already offline, it is not necessary to shutdown the
node because it is already not part of the cluster.
0601_L_R3
NodeHot-plug LED
Node Status LED
Disk Hot-plug LED
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
6 Remove the controller node from the node chassis by following the procedure described in
Removing a Controller Node on page C.2.
7 Place the controller node on an ESD-safe, level work surface.
It may be necessary, remove PCI adapters from slots four and five for easier access to
replace the clock battery.
8 Use a #2 Phillips screwdriver to loosen the captive screw securing the PCI retention bar to
the node housing and remove the retention bar, as shown in Figure 18-2.
Figure 18-2. Removing the PCI Adapter Retention Bar
0644_L_R2
18.33PAR Confidential
18.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
9 Remove the PCI adapters closest to the clock battery by grasping the sides of the card and
pulling upward.
For a 3PAR Fibre Channel adapter, use the attached loop handle to remove the card.
10 Place the PCI adapters on an ESD-safe surface.
Locate the clock battery, see Figure 18-3.
Figure 18-3. Controller Node Clock Battery
TOD Battery0596_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11 Remove the clock battery by pulling aside the retainer clip and pulling the battery up from
the battery holder, see Figure 18-4.
Avoid touching the internal node components when removing the battery.
Figure 18-4. Removing the Clock Battery
12 Insert the replacement 3-V lithium coin battery into the clock battery slot with the positive-
side facing the node disk.
13 Replace the PCI adapters in the same slots they were removed from by pressing firmly on
the top edge of the card until they are fully seated.
14 Replace the PCI adapter retention bar by carefully aligning the notches in the retention bar
with the PCI cards.
15 Replace the controller node by following the procedures described in Replacing a Serviced
Controller Node on page C.5.
16 In the service processor window, select option 7, Interactive CLI for an InServ from the
3PAR Service Processor Menu.
17 Select the desired InServ.
0646_L_R1
Retainer Clip
18.53PAR Confidential
18.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
18 Issue the shownode command and verify that the node has joined the cluster.
19 Issue the showdate command and confirm the clock setting is correct.
20 Issue the checkhealth -svc command to verify your system is healthy.
21 In the SP window issue the exit command to stop the CLI session.
22 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
23 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
24 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
25 Close and lock the rear door of the InServ.
26 Replace the bezel that covers the front of the InServ.
27 Replace and secure the front fascia on the storage server if applicable.
cli% shownode Control Data CacheNode --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
19Replacing a Controller Node Chassis
In this chapter
19.1 General Precautions 19.1
19.2 Removing a Controller Node Chassis 19.2
19.3 Unpacking a Controller Node Chassis 19.7
19.4 Installing a Replacement Controller Node Chassis 19.9
This chapter includes instructions for removing a controller node chassis, unpacking a
replacement chassis, and installing a replacement chassis into the storage server.
19.1 General PrecautionsWhen handling a controller node chassis, observe the precautions as described in Chapter 2,
Precautions.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
19.1Replacing a Controller Node Chassis
3PAR Confidential
19.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
19.2 Removing a Controller Node ChassisTo remove a controller node chassis, perform the following:
1 Remove power from the storage server. See Power-Down Procedure on page 5.2 for
instructions.
2 Detach the AC cords from the power supplies at the rear of the chassis. To detach an AC
cord, first loosen the power supply cord lock screw with a #1 Phillips screwdriver, as shown
in Figure 19-1.
Figure 19-1. Loosening the Cord Lock Screw on a Power Supply (Typical)
CAUTION: To avoid damage to hardware and the loss of data, never power off or
remove a controller node from an InServ Storage Server without confirming the
hot-plug LED on the node appears amber.
0054_L_R2Screw (2x)
Cord Lock Screw
AC Cord
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3 Detach the battery cables from the node power supplies.
4 Remove all the power supplies from the rear of the node chassis. Use a #1 Phillips
screwdriver to remove the screws on the power supply and then slide out the power supply
by pulling the handle (Figure 19-2).
Figure 19-2. Releasing a Power Supply
5 Disconnect the cables from the front of the controller nodes, noting the locations of all
cables. If necessary, mark the cables that connect to the controller nodes before removing
them. The drive-side Fibre Channel cables are marked to simplify this task.
6 Use a #2 Phillips screwdriver to remove the four screws securing the retainer bracket for the
chassis being replaced.
7 Note the location of all controller nodes in the chassis and mark the controller nodes with
these locations.
8 Use a #2 Phillips screwdriver to turn each screw 1/4 turn counterclockwise to remove the
front fascias of the storage server frame.
0273_L_R3Screws (2x)
19.33PAR Confidential
19.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
9 Remove the outer half of the cable manager by pulling the cable manager out toward you
(Figure 19-3).
Figure 19-3. Disassembling the Cable Manager
Repeat this step to remove each cable manager obstructing the path of the chassis you are
removing.
10 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screws
that secure the release levers (Figure 19-4).
Figure 19-4. Loosening the Screw on a Controller Node Release Lever
0493_L_R1
CaptiveScrew
0570_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
11 Pull the node lever out to disengage the controller node from the chassis midplane, see
(Figure 19-5).
12 With one hand on the handle of the controller node and the other hand supporting the
controller node from the bottom, slide the node out of the chassis, as shown in Figure 19-5.
and place it on an Electrostatic Discharge-safe (ESD-safe) work surface.
Repeat this procedure until you have removed all controller nodes from the chassis.
Figure 19-5. Removing the Controller Node from the Chassis
0569_L_R2
2
1
19.53PAR Confidential
19.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
13 Use an adjustable wrench to loosen the ball stud standoffs that secure the chassis to the
rack (Figure 19-6).
Figure 19-6. Loosening the Ball Stud Standoffs that Secure the Node-Chassis
14 Carefully slide out the controller node chassis. Use caution when lifting as the chassis is
heavy. If necessary, enlist the help of another person.
0606_L_R1
CAUTION: To prevent damage to the controller node chassis, do not hold or lift
the chassis by the top cover.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
19.3 Unpacking a Controller Node ChassisInServ T-Series Storage Server chassis arrive in wooden shipping crates due to their weight.
To unpack a controller node chassis from a crate:
1 Use a slotted screwdriver or crow bar to pry off the four spring clamps that secure the crate
door (Figure 19-7).
Figure 19-7. Removing the Spring Clamps that Secure the Crate Top
WARNING: The shipping crates are heavy. Do not attempt to move a crate
without using a pallet jack or fork lift.
0102_L_R1
19.73PAR Confidential
19.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
2 Remove the crate cover from the base by using the wooden side rails.
3 Remove any packing material that surrounds the controller node chassis.
4 With the help of another person, if necessary, lift the chassis to remove it from the
container.
Remove any slot filler panels and remaining packing materials and plastic covering from
the chassis, if necessary.
CAUTION: To prevent damage to the controller node chassis, do not hold or lift
the chassis by the top cover.
NOTE: After unpacking the replacement controller node chassis, place the failed
node-chassis into the crate for return to 3PAR.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
19.4 Installing a Replacement Controller Node ChassisTo install a replacement controller node chassis:
1 Slide the replacement controller node chassis into the rack until it rests flush against the
rack and the screw holes in the chassis align with the screw holes in the rack (Figure 19-9).
Figure 19-8. Inserting the Node Chassis into the Cabinet
2 Use an adjustable wrench to tighten the ball stud standoffs that secure the chassis to the
rack. Do not overtighten.
0606_L_R1
19.93PAR Confidential
19.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 At the front of the storage server, slide the node halfway into the chassis. Pull the insertion/
extraction lever (2) out all the way. Using the larger handle (1) push the node into the
chassis until it stops (Figure 19-9).
4 While applying mild pressure to handle (1) push the insertion lever (2) in quickly until it is
flush with the node. The quick insertion of (2) helps to overcome the initial insertion force
of the connector.
If the power supplies are ON, the PCI adapter LED’s and the node hot-plug LED should
illuminate within a few seconds of when the node is inserted.
Figure 19-9. Inserting the Controller Node into the Chassis
NOTE: “Quick” does not mean pushing more forcefully or harder.
0641_L_R2
1
2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Use a #2 Phillips screwdriver to tighten the captive screw that secures the controller node
lever to the controller node chassis (Figure 19-10). Do not overtighten the screw.
Repeat this step as necessary to replace each node in the chassis.
6 Replace slot filler panels over any empty node slots, if necessary.
7 Replace the outer half of the cable managers by pushing them into the inner half of the
cable manager until the outer half is fully seated (Figure 19-10).
Figure 19-10. Reassembling the Cable Manager
Repeat this step for each cable manager removed.
8 Reattach the Ethernet and Fibre Channel cables that connect to the front of the controller
nodes.
9 Replace the retainer bracket. Secure the bracket using the four previously removed screws.
10 Replace the power supplies at the rear of the controller node chassis by sliding each power
supply into the rear of the chassis until fully seated.
0308_L_R2
19.113PAR Confidential
19.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
11 Reconnect the AC cords and battery cables, and tighten all screws on the power supplies
with a #1 Phillips screwdriver (Figure 19-11). Do not overtighten the screws.
Figure 19-11. Securing a Power Supply
12 Tighten the cord lock screw on the AC cords with a #1 Phillips screwdriver (Figure 19-12).
Do not overtighten the screw.
Figure 19-12. Tightening the Cord Lock Screw on the Power Supply (Typical)
0274_L_R1
Screws (2x)
0054_L_R2Screw (2x)
Cord Lock Screw
AC Cord
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
13 Turn on AC power to the storage server by turning on the server’s PDU circuit breakers
(Figure 19-13).
Figure 19-13. PDU Circuit Breakers
14 Wait approximately 5 to 7 minutes for the nodes to boot then verify that all controller
node status LEDs are blinking in unison.
15 Issue a shownode command to verify all nodes are present.
16 Issue the checkhealth -svc command to verify your system is healthy.
17 In the SP window issue the exit command to stop the CLI session.
18 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
19 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
20 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
21 Close and lock the rear door of the InServ.
22 Replace the bezel that covers the front of the InServ.
23 Replace and secure the front fascia on the storage server if applicable.
0295_L_R2
Circuit Breaker CB-1 Circuit Breaker CB-2
cli% shownode Control Data CacheNode --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100...
19.133PAR Confidential
19.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
20Replacing a Controller Node Power Supply
In this chapter
20.1 General Precautions 20.1
20.2 Controller Node Power Supply Replacement Procedure 20.2
20.1 General PrecautionsWhen handling the power supply, observe the precautions as described in Chapter 2,
Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
20.1Replacing a Controller Node Power Supply
3PAR Confidential
20.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
20.2 Controller Node Power Supply Replacement ProcedureTo replace a power supply in a controller node chassis:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the shownode -ps command and confirm the node power supply’s LEDs and power
supply state.
5 At the rear of the controller node chassis, identify the power supply that requires
replacement and set it to the OFF position.
cli% shownode -psNode PS -Serial- -PSState- FanState ACState DCState -BatState- ChrgLvl(%) 0 0 730D0036 OK OK OK OK OK 100 0 1 730D0019 OK OK OK OK OK 100 1 0 0000 Failed OK OK Failed OK 100 1 1 730D0085 OK OK OK OK OK 100
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
6 Disconnect the AC cord from the power supply by loosening the power supply cord lock
screw with a #1 Phillips screwdriver, as shown in Figure 20-1, and disconnect the cord from
the power supply.
Figure 20-1. Loosening the Cord Lock Screw on the Power Supply (Typical)
7 Disconnect the battery backup unit cable from the power supply.
0531_L_R2
Cord Lock Screw
20.33PAR Confidential
20.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
8 Use a #1 Phillips screwdriver to remove the screws on the power supply and then slide out
the power supply by pulling the handle (Figure 20-2).
Figure 20-2. Releasing a Power Supply
9 Remove the replacement power supply from its protective packaging.
10 Place the removed power supply into the protective packaging for return to 3PAR.
11 Verify the replacement power supply is set to the OFF position.
12 Slide the replacement power supply into the rear of the controller node chassis until it is
fully seated, aligning the screw holes on the power supply with the holes in the chassis.
13 Use a #1 Phillips screwdriver to tighten the screws securing the power supply to the chassis.
Do not overtighten the screws.
14 Reconnect the AC cord and tighten the cord lock screw to prevent accidental disconnection
of the AC cord.
15 Reconnect the battery cable.
16 Set the power supply to the ON position.
0273_L_R3Screws (2x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
17 Confirm the power supplies and battery backup units show all power status LEDs as green.
In the service processor window, issue the shownode -ps command and verify the power
supply state.
18 Issue the checkhealth -svc command to verify your system is healthy.
19 In the SP window issue the exit command to stop the CLI session.
20 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
21 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
22 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
23 Close and lock the rear door of the InServ.
24 Replace the bezel that covers the front of the InServ.
25 Replace and secure the front fascia on the storage server if applicable.
cli% shownode -psNode PS -Serial- -PSState- FanState ACState DCState -BatState- ChrgLvl(%) 0 0 730D0036 OK OK OK OK OK 100 0 1 730D0019 OK OK OK OK OK 100 1 0 730D0090 OK OK OK OK OK 100 1 1 730D0085 OK OK OK OK OK 100
20.53PAR Confidential
20.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
Power System Maintenance Procedures
3PAR Confidential
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
21Replacing a Drive Chassis Power Supply
In this chapter
21.1 General Precautions 21.2
21.2 Drive Chassis Power Supply Replacement Procedure 21.2
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
21.1Replacing a Drive Chassis Power Supply
3PAR Confidential
21.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
21.1 General PrecautionsWhen handling a power supply, observe the precautions as described in Chapter 2,
Precautions.
21.2 Drive Chassis Power Supply Replacement ProcedureTo replace a power supply in a drive chassis:
1 Start an spmaint session.
a Connect the maintenance PC to the Service Processor (SP), using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 Issue the showcage –d <cage> command, where <cage> is the specific cage number,
and verify the power supply LED and power supply state as shown in the following screen.
cli% showcage -d cage0 -----LoopA----- -----LoopB-----Id Name A0 A1 Pos B0 B1 Pos Drives Temp RevA RevB Model Side 0 cage0 0:0:1 1:0:1 0 2:0:1 3:0:1 0 16 31-35 08 08 DC4 n/a
-----------Cage detail info for cage0 ---------
Position: --------------Midplane Info------------ VendorId,ProductId 3PARdata,DC4 Serial_Num OPS69907C0149F3 Node_WWN 20000050CC0149F3 TempSensor_State OK TempSensor_Value 39 OpsPanel_State OKAudible_Alarm_State Muted ID_Switch 1 Cage_State OK
Interface Board Info LoopA LoopB Firmware_status Current Current Product_Rev 08 08 IFC_State OK OK ESH_State OK OK Master_CPU Yes No Loop_Map valid valid Link_Speed 4Gbps 4Gbps Port0_State OK OK Port1_State No_SFP No_SFP Port2_State No_SFP No_SFP Port3_State OK OK
Power Supply Info State Fan State AC Model ps0 Failed Med Speed Failed -- ps1 OK Med Speed OK --. . .
21.33PAR Confidential
21.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
5 Identify the power supply requiring replacement. Set it to the OFF position (Figure 21-1).
Figure 21-1. Drive Chassis Power Supply Numbering
6 Disconnect the AC cord from the failed power supply.
a Loosen the power supply cord lock screw with a #1 Phillips screwdriver, as shown in
Figure 21-2 and rotate the retaining latch counter clock wise.
b Disconnect the AC cord.
Figure 21-2. Loosening the Cord Lock Screw on a Power Supply
0671_L_R1
320 1
0634_L_R1
Cord Lock Screw
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
7 Remove the power supplies from the rear of the drive cage:
a Use a #1 Phillips screw drive to remove two screws securing each power supply to the
chassis (Figure 21-3).
b Pull the handle to remove the power supply from the drive cage.
Figure 21-3. Releasing a Drive Chassis Power Supply
8 Remove the replacement power supply from its protective packaging and verify that the
power supply is set to the OFF position.
9 Place the removed power supply into the protective packaging for return to 3PAR.
10 Slide the replacement power supply into the rear of the drive chassis until fully seated.
11 Use a #1 Phillips screwdriver to tighten the screws that secure the power supply to the drive
chassis housing. Do not overtighten the screws.
12 Reconnect the AC cord and tighten the cord lock screw with a #1 Phillips screwdriver. Do
not overtighten the screw.
13 Set the power supply to the ON position and verify that the power supply LED is green.
0635_L_R1
Screws (2x)
21.53PAR Confidential
21.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
14 In the service processor window, issue the showcage –d <cage> command, where
<cage> is the specified cage, and verify the power status of the drive cage power supply is
OK.
cli% showcage -d cage0 -----LoopA----- -----LoopB-----Id Name A0 A1 Pos B0 B1 Pos Drives Temp RevA RevB Model Side 0 cage0 0:0:1 1:0:1 0 2:0:1 3:0:1 0 16 31-35 08 08 DC4 n/a
-----------Cage detail info for cage0 ---------
Position: --------------Midplane Info------------ VendorId,ProductId 3PARdata,DC4 Serial_Num OPS69907C0149F3 Node_WWN 20000050CC0149F3 TempSensor_State OK TempSensor_Value 39 OpsPanel_State OKAudible_Alarm_State Muted ID_Switch 1 Cage_State OK
Interface Board Info LoopA LoopB Firmware_status Current Current Product_Rev 08 08 IFC_State OK OK ESH_State OK OK Master_CPU Yes No Loop_Map valid valid Link_Speed 4Gbps 4Gbps Port0_State OK OK Port1_State No_SFP No_SFP Port2_State No_SFP No_SFP Port3_State OK OK
Power Supply Info State Fan State AC Model ps0 OK MedSpeed OK -- ps1 OK MedSpeed OK --
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
15 Issue the checkhealth -svc command to verify your system is healthy.
16 In the SP window issue the exit command to stop the CLI session.
17 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
18 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
19 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
20 Close and lock the rear door of the InServ.
21 Replace and secure the front fascia on the storage server if applicable.
21.73PAR Confidential
21.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
22Replacing a Battery Backup Unit
In this chapter
22.1 General Precautions 22.1
22.2 Battery Backup Unit Replacement Procedure 22.2
22.1 General PrecautionsWhen handling batteries, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
22.1Replacing a Battery Backup Unit
3PAR Confidential
22.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
22.2 Battery Backup Unit Replacement ProcedureTo replace a Battery Backup Unit (BBU):
1 Start an spmaint session:
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the SP by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 7, Interactive CLI for an InServ.
3 Select the desired InServ.
4 Issue the showbattery command to verify the battery’s information has failed.
5 Unlock and open the rear door of the storage server.
6 Locate the battery tray and identify the BBU that requires replacement, noting its location
in the battery tray.
7 At the front of the storage server, remove the bezel that covers the battery tray.
cli% showbatteryNode PS Bat Serial -State- ChrgLvl(%) -ExpDate-- Expired Testing 0 0 0 60308100 Fail 0 04/01/2007 Yes No 1 1 0 60308192 OK 100 10/11/2009 No No
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
8 At the rear of the storage server and use a #1 Phillips screwdriver to remove the M3 screws
that secure the BBU in the battery tray (Figure 22-1).
Figure 22-1. Releasing the BBU
9 Set the affected BBU power switches for both BATTERY A and BATTERY B to the OFF position.
10 Note the location of each battery cable and then disconnect the battery cables from the
BBU to be replaced. To disconnect the cables, press the white tab on the cable connector
and pull to remove.
0328_L_R1
22.33PAR Confidential
22.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
11 Remove the battery from the front of the storage server by pulling firmly on the handle
(Figure 22-2).
Figure 22-2. Removing BBU from the Battery Tray
12 Remove the replacement BBU from its protective packaging and verify that the power
switches are set to the OFF position.
13 Slide the replacement battery into the battery tray from the front of the storage server
until firmly seated.
14 Use a #1 Phillips screwdriver to tighten the screws that secure the BBU in the battery tray.
Do not overtighten the screws.
15 Place the removed BBU into the protective packaging for return to 3PAR.
0329_L_R1
CAUTION: The BBU weighs approximately 50 pounds. Use caution when
removing the BBU from the battery tray.
CAUTION: BBUs contain hazardous materials and should not be discarded. Return
used batteries to 3PAR for proper disposal.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16 Reconnect all battery cables. Each controller node must connect to two separate BBUs to
provide redundancy. For valid cable configurations, see Figure 22-3.
Figure 22-3. Valid BBU Cable Configurations
0662_L_R4
BatteryBackup
Units
ControllerNode
PowerSupplies
BatteryBackup
Units
BatteryBackupUnits
ControllerNodePowerSupplies
BatteryBackupUnits
ControllerNodePowerSupplies
BatteryBackupUnits
ControllerNodePowerSupplies
BatteryBackupUnits
InServ T800(6 nodes)
InServ T400 or T800*(2 nodes)
InServ T400 or T800*(4 nodes)
InServ T800(8 nodes)
Empty Node Slots
Empty Node Slots
1
3 2
0
45
7 6
01
23
5 4
67
01
237* 6*
4*5*01
237* 6*
4*5*
22.53PAR Confidential
22.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
17 Set the power switches to the ON position for both BATTERY A and BATTERY B in the
replacement BBU and verify that the battery status LEDs on all BBUs are green.
18 Replace the bezel that covers the front of the battery tray.
19 Issue the showbattery command to verify that the battery’s information is properly set.
20 Issue the checkhealth -svc command to verify your system is healthy.
21 In the SP window issue the exit command to stop the CLI session.
22 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
23 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
24 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
25 Close and lock the rear door of the InServ.
26 Replace the bezel that covers the front of the InServ.
27 Replace and secure the front fascia on the storage server if applicable.
NOTE: If the battery status LEDs are amber, turn off the battery, reconnect the
cables, and then power-on the battery.
cli% showbatteryNode PS Bat Serial -State- ChrgLvl(%) -ExpDate-- Expired Testing 0 0 0 60308194 OK 100 05/15/2010 No No 1 1 0 60308192 OK 100 10/11/2009 No No
NOTE: The serial number and expiration date is read by the InServ and
automatically set.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
23Replacing a Power Distribution Unit
In this chapter
23.1 General Precautions 23.1
23.2 Replacing PDUs in Cabinets that only have Rear PDUs 23.2
23.3 Replacing PDUs in Cabinets that have Front and Rear PDUs 23.8
23.1 General PrecautionsWhen handling a power distribution unit, observe the precautions as described in Chapter 2,
Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
23.1Replacing a Power Distribution Unit
3PAR Confidential
23.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
23.2 Replacing PDUs in Cabinets that only have Rear PDUsBefore replacing a PDU that has one or more unlit indicators, verify proper functioning of the
power source at the operating site by using a volt meter to test the AC line that services the
PDU. A properly functioning AC line supplies between 200 and 240 VAC +/– 10 percent (180
and 264 VAC).
Upon testing, if the AC line is:
■ not delivering between 200 and 240 VAC +/– 10 percent (180 and 264 VAC), consult a
qualified electrician.
■ not functioning properly, replace the failing PDU.
Depending on your system’s configuration, PDUs can be located at the rear of the storage
server, or located at the front and rear of the server.
To replace a PDU, perform the following:
1 Unlock and open the rear door of the storage server.
2 Confirm that the storage server has a valid redundant power configuration. To support
redundant power, each power domain must include two power supplies that connect to
separate PDUs, and each PDU must connect to an independent AC circuit (Four PDUs are
required for redundancy for each cabinet).
NOTE: If the status LED for more than one power supply is off, the cause may be a
failed Power Distribution Unit (PDU). Confirm the PDUs are functioning properly
by verifying that all power indicators on the PDUs appear blue.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Figure 23-1 illustrates a valid redundant power configuration for a storage server in a 2M
(40U) cabinet. For more information on redundant power, see the 3PAR InServ T-Class
Storage Server Installation and Deinstallation Guide.
Figure 23-1. T400 or Drive Chassis Cabinet Valid Redundant Power Configuration (1U PDUs)
0202_L_R3
Power Bank 1
Power Bank 2
PDU 0
PDU 1
PDU 2
PDU 3
1-R
0-R
4-R5-R
0-R
1-R
2-R
3-R
4-R
5-R
6-R
7-R
0-L
1-L
2-L
3-L
4-L
5-L
6-L
7-L
6-R7-R4-L
5-L
2-R
3-R
7-L6-L
0-L1-L
2-L3-L
23.33PAR Confidential
23.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 Set the power breakers on the failed PDU to the OFF position (Figure 23-2), and unplug the
PDU main power cord.
Figure 23-2. Setting the Power Breakers on the PDU to the OFF Position
4 Disconnect the PDU main AC cord from the customer’s power receptacle (Figure 23-3).
Figure 23-3. Unplugging the Power Receptacle Connector (Typical)
0083_L_R2
0080_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Disconnect the AC cords that connect the power supplies to the failed PDU as follows:
a Note the numbers indicated on the AC cord labels and the PDU circuit breakers to which
they connect. Figure 23-4 shows the location and order of the two circuit breakers in
the PDU.
Figure 23-4. Location and Order of the Circuit Breakers in the PDU
b Cut the plastic tie-wraps that secure the AC cords to the PDU, using care not to cut the
cords.
c Unplug all AC cords from the PDU that requires replacement.
6 Use an adjustable wrench to disconnect the ground wire from the cabinet, as shown in
Figure 23-5.
Figure 23-5. Disconnecting the Ground Wire from the Cabinet
0295_L_R2
Circuit Breaker CB-1 Circuit Breaker CB-2
0094_L_R1 0094_L_R1
23.53PAR Confidential
23.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
7 Go to the front of the storage server and remove the bezel covering the failed PDU.
8 Use a #2 Phillips screwdriver to remove the four screws securing the filler panel to the rack.
9 Remove the screws that secure the PDU to the rack using a #2 Phillips screwdriver
(Figure 23-6).
Figure 23-6. Removing the PDU from the Rack
10 If the PDU connector does not fit through the 1U opening, pull the PDU partly out from the
back of the rack and rotate the PDU 90 degrees.
11 Push the PDU back into the rack. Go to the front of the storage server and pull the PDU out
from the front of the rack.
12 Remove the replacement PDU from its protective packaging.
13 Place the failed PDU into the packaging for return to 3PAR.
14 At the front of the storage server, rotate the replacement PDU 90 degrees and slide it into
the front of the rack.
15 Route the replacement PDU’s power cable through the cabinet in a similar manner as the
other cables.
16 Go to the rear of the storage server and pull the PDU through the rear opening.
17 Rotate the PDU 90 degrees so that the PDU’s receptacles are facing you.
18 Slide the unit into the rack until the screw holes in the front of the PDU align with the
screw holes in the rack.
0315_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
19 Install the screws that secure the PDU to the rack using a #2 Phillips screwdriver. Do not
overtighten.
20 Locate the green ground wire on the PDU and attach it to the grounding terminal on the
cabinet where the failed PDU’s ground wire was attached using an adjustable wrench.
21 Confirm that the breakers on the replacement PDU are set to the OFF position before
reconnecting the AC cords that run from the power supplies to the PDU.
22 Secure the AC cords to the PDU.
a Position the AC cords between two holes in the cord retention bracket of the PDU.
b Route plastic tie-wraps through the holes in the bracket on either side of the AC cords
and tighten.
c Push on the AC cord connectors to ensure they are fully seated.
23 Go to the front of the storage server and reinstall the filler panel covering the PDU. Tighten
the four screws securing the panel to the rack.
24 Plug the replacement PDU’s main power cord into the customer’s grounded electrical
circuit.
25 Set the circuit breakers on the PDU to the ON position. Verify that the power indicator LEDs
appear blue.
26 Verify that all power supply status LEDs appear green.
27 Replace the bezel that covers the front of the storage server.
28 Close and lock the rear door of the storage server.
WARNING: The main power cords for InServ Storage Servers include safety
features to prevent them from being plugged into electrical circuits that are not
compatible with the storage server. To prevent serious injury to people and
damage to equipment, do not override this feature by using outlet adapters or by
altering the power cord.
23.73PAR Confidential
23.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
23.3 Replacing PDUs in Cabinets that have Front and Rear PDUs1 Unlock and open the rear door of the storage server.
2 Confirm that the storage server has a valid redundant power configuration. To support
redundant power, each power domain must include two power supplies that connect to
separate PDUs. Each PDU must connect to an independent AC circuit (Four PDUs are
required for redundancy for each cabinet).
Figure 23-7 illustrates a valid redundant power configuration for a storage server in a 2M
(40U) cabinet. For more information on redundant power, see the 3PAR InServ T-Class
Storage Server Installation and Deinstallation Guide.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Figure 23-7. T800 Node Cabinet Valid Redundant Power Configuration
0211_L_R3
PowerBank 1
PowerBank 2
PDU 0
PDU 1
PDU 2
PDU 3
1-R
0-R
5-R 6-R
Front Viewof Cabinet
Rear Viewof Cabinet
0-R
1-R
2-R
3-R
5-R
6-R
7-R
8-R
0-L
1-L
2-L
3-L
5-L
6-L
7-L
8-L
7-R 8-R
5-L 6-L
2-R
3-R
8-L7-L
0-L1-L
2-L3-L
23.93PAR Confidential
23.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 Go the front of the storage server and remove the bezel covering the failed PDU.
Depending on the location of the failed PDU, either stay at the front of the storage server
or move to the back of the server.
4 Set the power breakers on the failed PDU to the OFF position, and unplug the PDU main
power cord (Figure 23-8).
Figure 23-8. Setting the Power Breakers on the PDU to the OFF Position
0083_L_R2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
5 Disconnect the PDU main AC cord from the customer’s power receptacle (Figure 23-3).
Figure 23-9. Unplugging the Power Receptacle Connector (Typical)
6 Disconnect the AC cords that connect the power supplies to the failed PDU as follows:
a Note the numbers indicated on the AC cord labels and the PDU circuit breakers to which
they connect. Figure 23-10 shows the location and order of the two circuit breakers in
the PDU.
Figure 23-10. Location and Order of the Circuit Breakers in the PDU
b Cut the plastic tie-wraps that secure the AC cords to the PDU, using care not to cut the
cords.
c Unplug all AC cords from the PDU that requires replacement.
0080_L_R1
0295_L_R2
Circuit Breaker CB-1 Circuit Breaker CB-2
23.113PAR Confidential
23.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
7 Use a #2 Phillips screwdriver to remove the ground wire from the PDU.
8 Remove the screws securing the PDU to the rack using a #2 Phillips screwdriver
(Figure 23-6).
Figure 23-11. Removing the PDU from the Rack
9 Pull the failed PDU out from the rack.
10 Remove the replacement PDU from its protective packaging.
11 Place the failed PDU into the protective packaging for return to 3PAR.
12 Slide the replacement PDU into the rack until the screw holes in the front of the PDU align
with the screw holes in the rack.
13 Install the screws that secure the PDU to the rack using a #2 Phillips screwdriver. Do not
overtighten.
14 Locate the green ground wire on the rack and attach it to the PDU where the failed PDU’s
ground wire was attached.
15 Confirm that the breakers on the replacement PDU are set to the OFF position before
reconnecting the AC cords that run from the power supplies to the PDU.
0315_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
16 Secure the AC cords to the PDU.
a Position the AC cords between two holes in the cord retention bracket of the PDU.
b Route plastic tie-wraps through the holes in the bracket on either side of the AC cords
and tighten.
c Push on the AC cord connectors to ensure they are fully seated.
17 Plug the replacement PDU’s main power cord into the customer’s grounded electrical
circuit.
18 Set the circuit breakers on the PDU to the ON position. Verify that the power indicator LEDs
appear blue.
19 Verify that all power supply status LEDs appear green.
20 Replace the bezel that covers the front of the storage server.
21 Replace and secure the front fascias on the storage server frame if applicable.
22 Close and lock the rear door of the storage server.
WARNING: The main power cords for InServ Storage Servers include safety
features to prevent them from being plugged into electrical circuits that are not
compatible with the storage server. To prevent serious injury to people and
damage to equipment, do not override this feature by using outlet adapters or by
altering the power cord.
23.133PAR Confidential
23.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
24Replacing an AC Cord
In this chapter
24.1 General Precautions 24.1
24.2 AC Cord Replacement Procedure 24.2
24.1 General PrecautionsWhen handling an AC cord, observe the precautions as described in Chapter 2, Precautions.
NOTE: Guided maintenance scripts are available to facilitate this procedure. See
Appendix B, Guided Maintenance for additional information.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
24.1Replacing an AC Cord
3PAR Confidential
24.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
24.2 AC Cord Replacement ProcedureTo replace an AC cord:
1 Turn off the two power supplies the AC Y-cord is connected to.
2 If possible, remove the side cover of the server to have sufficient access for the removal of
the power cord.
For instructions to remove the side panel of the storage server, see Chapter 4 in the 3PAR
InServ T-Class Storage Server Installation, Deinstallation Guide.
3 Locate the faulty cable in the cable bundles secured to the storage server frame and make
note of its location.
4 Remove the plastic tie-wraps that secure the faulty cable bundle to the storage server
frame using wire cutters or equivalent.
5 Remove the plastic tie-wrap that secures the AC cord to the PDU.
6 Unplug the AC cord from the PDU.
7 Disconnect the damaged AC cord from the power supplies. To disconnect the AC cord, first
loosen the screws on the power supply cord locks with a #1 Phillips screwdriver, as shown in
Figure 24-1.
Figure 24-1. Loosening the Cord Lock Screw on the Power Supply
0054_L_R2Screw (2x)
Cord Lock Screw
AC Cord
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
8 Disconnect the damaged AC cord from the cable stud in the rack by using an adjustable
wrench to loosen the nut that secures the cable on the stud (Figure 24-2).
Figure 24-2. Disconnecting the AC Cord from the Stud
9 Remove the faulty Y-cord from the cabinet.
10 Remove the replacement AC cord from its packaging.
11 Locate the cable bundle from which the faulty cable was removed and add the replacement
cable to the bundle.
12 Label the replacement cable to correspond with the cable being replaced and then route
the replacement through the storage server frame. If possible, reuse the labels from the
failed AC cords.
0095_L_R1
24.33PAR Confidential
24.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
13 Secure the replacement AC cord to the rack by placing it on an available stud and
tightening the nut that holds the cable on the stud using an adjustable wrench.
14 Connect the replacement AC cord to the power supplies and tighten the cord lock screws
using a #1 Phillips screwdriver to prevent accidental disconnection.
15 Connect the replacement AC cord to the PDU receptacle previously occupied by the
damaged cord
16 Secure the AC cord to the PDU.
a Position the AC cord between two holes in the cord retention bracket of the PDU.
b Route a plastic tie-wrap through the holes in the bracket on either side of the AC cord
and tighten.
c Push on the AC cord connector to ensure it is fully seated.
17 Secure the bundle to its original location on the storage server frame using plastic
tie-wraps.
18 Turn on the two power supplies and ensure the power supply LEDs are green.
19 If removed, replace the side panel on the storage server frame.
20 Close and lock the rear door of the storage server.
3PAR Confidential
Service Processor Maintenance Procedures
3PAR Confidential
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
25Service Processor Replacement and Upgrade
In this chapter
25.1 General Precautions 25.1
25.2 Replacing a Service Processor 25.2
25.2.1 Replacing a Service Processor 25.2
25.1 General PrecautionsWhen handling a service processor, observe the precautions as described in Chapter 2,
Precautions.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
25.1Service Processor Replacement and Upgrade
3PAR Confidential
25.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
25.2 Replacing a Service ProcessorThe following section describes how to replace a service processor. If a functioning service
processor needs to be replaced due to a defective modem, CD, or serial and ethernet port, the
service processor configuration information can be retrieved prior to removing the
component. This expedites rebuilding a new service processor.
See Retrieving the Rescue File From the Service Processor on page 3.1 of the 3PAR Service
Processor Software Rebuild Instructions guide for additional information.
25.2.1 Replacing a Service Processor
To replace a 1U Service Processor:
1 Unlock and open the rear door of the storage server.
2 At the front of the storage server, remove the bezel covering the service processor.
3 Power down the service processor by starting an spmaint session.
a At the rear of the server, connect the maintenance PC to the service processor. See
Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
NOTE: A replacement SP FRU with 2.3.1 software installed can be used on an
InServ running InForm OS 2.2.4 or 2.3.1 and should not require rebuilding.
Configuration is required only.
NOTE: A replacement SP FRU with installed software 2.2.4.GA-28 or higher should
not require a base image installation. The base image should already be at 3.1-5.
NOTE: If the service processor is not functional, power down from the power
switch.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 In the service processor window, issue the spmaint command.
5 Select option 1, SP Control/Status.
6 Select option 3, Halt SP and confirm all prompts to halt the SP.
7 Verify the power LED on the front of the service processor is no longer illuminated.
8 At the rear of the storage server, disconnect all cables from the service processor making
note of their locations so they can be reconnected later.
9 At the front of the storage server, use a #2 Phillips screwdriver to remove the two captive
screws securing the service processor to the storage server.
10 Remove the service processor.
11 Remove the replacement service processor from its packaging. Insert the failed service
processor into the packaging for return to 3PAR.
12 Remove the SP-ID label from the old SP and affix the label onto the replacement SP.
13 Align the replacement service processor with its shelf on the storage server chassis. Push the
service processor into position until it locks into place.
14 Using a #2 Phillips screwdriver, secure the two screws.
15 Open the AC cord lock and place it around the cord end that connects to the SP and use a
#1 Phillips screwdriver to secure the captive screw (Figure 25-1).
Figure 25-1. Attaching the AC Cord Lock
0817_L_R1
25.33PAR Confidential
25.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
16 At the rear of the storage server, replace the AC cord and any removed cabling.
17 Secure the AC cord lock to the rear of the SP with a #2 Phillips screwdriver (Figure 25-2).
Figure 25-2. Connecting the AC Cord Lock to the Service Processor
18 At the front of the storage server, press the power button. Verify the power LED is
illuminated.
For information about rebuilding the software on a service processor, see the 3PAR Service
Processor Software Rebuild Instructions guide.
0818_L_R1
Captive Screw
3PAR Confidential
Appendices
3PAR Confidential
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
ATools
A.1 Tools Required for Performing Maintenance The following tools are required to perform the maintenance procedures on an InServ Storage
Server as described in this manual:
■ Electrostatic discharge (ESD) wrist grounding strap (provided with cabinet)
■ Electrostatic discharge (ESD) mat
■ #1 Phillips screwdriver
■ #2 Phillips screwdriver
■1/8-in. (3 mm) slotted screwdriver
■3/16 -in. (5 mm) slotted screwdriver
■ Diagonal cutting pliers
■ Adjustable wrench
A.1Tools
3PAR Confidential
A.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
BGuided Maintenance
B.1 OverviewGuided maintenance scripts are provided with the service processor to help facilitate the
removal and replacement of Field Replaceable Units (FRUs). The maintenance scripts execute
all CLI commands and, in some cases, select the appropriate failed component to minimize user
error when performing maintenance procedures.
Guided maintenance is currently available for the following FRUs:
■ Controller node FRUs:
◆ Controller node
◆ Internal node disk
◆ Battery backup unit
◆ Control cache DIMMs
◆ Data cache DIMMs
◆ Data cache riser card
◆ PCI adapter cards
◆ Controller node power supply
◆ SFP
B.1Guided Maintenance
3PAR Confidential
B.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
■ Drive cage FRUs:
◆ Drive magazine
◆ Power supply
◆ FC-AL module
◆ SFP
◆ Drive
■ Power system FRUs:
◆ AC power cord
◆ Power distribution unit
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
B.2 Accessing Guided MaintenanceTo access the guided maintenance scripts:
1 Log in to SPOCC. See Logging into the SP Onsite Customer Care Interface (SPOCC) on
page 3.22 for further instructions.
2 Click Support to access the guided maintenance procedures (Figure B-1).
Figure B-1. SPOCC Home Page
0674_S_R2
B.33PAR Confidential
B.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 On the Service Processor - Support page, click Guided Maintenance for the
cluster to perform maintenance (Figure B-2).
Figure B-2. SPOCC Support Page
A new browser window is launched from which you select a specific maintenance
procedure.
0676_S_R2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 In the Guided Maintenance window, select the guided maintenance procedure to start a
replacement activity (Figure B-3).
Figure B-3. Guided Maintenance Window
0675_S_R2
B.53PAR Confidential
B.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
CRemoving and Replacing a Controller Node
In this appendix
C.1 General Precautions C.1
C.2 Removing a Controller Node C.2
C.3 Replacing a Serviced Controller Node C.5
This chapter only provides instructions on the physical removal and replacement of the
controller node. Other chapters will refer to these instructions after the node has been halted.
C.1 General PrecautionsWhen handling controller nodes, observe the precautions as described in Chapter 2,
Precautions.
NOTE: If your storage server is equipped with an optional locking fascia kit, see
Appendix E, Locking Fascia for additional information on removal and
replacement.
C.1Removing and Replacing a Controller Node
3PAR Confidential
C.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
C.2 Removing a Controller NodeTo remove a controller node:
1 At the front of the storage server, remove the bezel that covers the controller node and
confirm that the hot-plug LED appears solid amber on the controller node that requires
removal (Figure C-1).
Figure C-1. The Hot-Plug LED on a Controller Node
CAUTION: To avoid damage to hardware and the loss of data, never power off or
remove a controller node from the storage server without confirming that the
hot-plug LED on the node appears solid amber.
0619_L_R1
Hot-plug LED
NOTE: If the Fibre Channel cables are in a large bundle, it might be helpful to
remove the front fascia next to the node before unplugging any cables to provide
adequate space for removing the controller node. See Removing the Locking
Fascia on page E.3 for instructions on removing the front fascias.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
2 Disconnect the cables from the front of the controller node, noting the locations of all
cables. If necessary, mark the cables that connect to the controller nodes before removing
them. The drive-side Fibre Channel cables are marked to simplify this task.
3 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw
that secures the lever of the controller node (Figure C-2).
Figure C-2. Loosening the Captive Screw on a Controller Node
4 Pull the node insertion/removal lever (1) out to disengage the controller node from the
chassis midplane, see Figure C-3.
CaptiveScrew
0570_L_R1
C.33PAR Confidential
C.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
5 With one hand on the handle of the controller node and the other hand supporting the
controller node from the bottom, slide the node out of the chassis, as shown in Figure C-3,
and place it on an Electrostatic Discharge-safe (ESD-safe) work surface.
Figure C-3. Removing the Controller Node from the Chassis
0569_L_R2
2
1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
C.3 Replacing a Serviced Controller NodeTo replace a controller node after servicing:
1 At the front of the storage server, slide the node halfway into the chassis. Pull the insertion/
extraction lever (2) out all the way. Using the larger handle (1) push the node into the
chassis until it stops (Figure C-4).
2 While applying mild pressure to handle (1) push the insertion lever (2) in quickly until it is
flush with the node. The quick insertion of (2) helps to overcome the initial insertion force
of the connector.
If the power supplies are ON, the PCI adapter LED’s and the node hot-plug LED should
illuminate within a few seconds of when the node is inserted.
Figure C-4. Replacing the Controller Node
NOTE: “Quick” does not mean pushing more forcefully or harder.
0641_L_R2
1
2
C.53PAR Confidential
C.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3 Use a #2 Phillips screwdriver to tighten the captive screw that secures the lever to the
controller node chassis. Do not overtighten the screw (Figure C-5).
Figure C-5. Node Captive Screw
4 Reconnect the cables that connect to the front of the controller node.
5 Verify that the power status LED on the controller node appears green.
6 Replace the bezel at the front of the server.
7 Replace and secure the front fascias on the storage server frame if applicable.
CaptiveScrew
0570_L_R1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
DNode Rescue
In this appendix
D.1 Performing an Auto-Node Rescue D.2
D.2 Performing Manual Node Rescue D.7
This appendix provides instructions on performing both auto-node and manual node rescue.
Always perform the auto-node rescue procedure unless otherwise instructed.
D.1Node Rescue
3PAR Confidential
D.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
D.1 Performing an Auto-Node RescueTo perform an Auto-Node Rescue:
1 Start an spmaint session:
a Connect the maintenance PC to the Service Processor (SP) using the serial connection.
Refer to Connecting to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 Select option 4, InServ Product Maintenance.
3 Select option 11, Node Rescue.
4 Select option 1, Configure Node Rescue.
5 Select the desired InServ.
6 Select option 3, Automatic Node Rescue.
7 Enter the desired node number.
8 Select y to confirm the correct node number. After the SP communicates with the controller
node, continue to the next step.
9 At the front of the storage server, gently slide the node into the chassis until it stops while
keeping the insertion/removal lever fully extended.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
10 At the rear of the storage server, uncoil the red crossover Ethernet cable connected to the
3PAR private network connection of the service processor.
11 Connect ETH1 of the service processor to the Ethernet port (ETH0) port of the node that is
being rescued through the crossover cable. Depending on the location of the service
processor and the nodes, route the cable under or around the side of the storage server
cabinet.
12 Push the nodes insertion/removal lever in to cam the node into the midplane and close the
handle quickly.
0299_L_R1
Ethernet 0
Ethernet 1
ServiceProcessor
Node
CrossoverCable
NOTE: Closing the insertion handle immediately supplies power to the controller
node.
D.33PAR Confidential
D.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Result: When communication from the SP to the node is established, the following appears on
the service processor:
root@1200163-0 Tue Apr 01 16:53:19:~# beginning rescue function....255.248 -s 10.255.155.54155.53 -m 255.255 Informing system manager to not autoreset node1Resetting node 1Attempting to contact node 1 via internal serial portWaiting for node to respond (10 seconds elapsed)...Waiting for node to respond (20 seconds elapsed)...Waiting for node to respond (30 seconds elapsed)...=Successfully started inter-node serial link communicationStarting Whack, setting values, and loading image:Interacting with CBIOS on the node......Booting from net...TFTP "install" from 10.255.155.54................................completemknbi-1.2-7/first32.c (GPL)Top of ramdisk is 0X1FFFF000Ramdisk at 0X00800000, size 0X00500000...Kernel on remote node has been started.Waiting for node to join cluster. This usually takes around 10 minutes, but maytake 20 minutes or longer.Install kernel is running - please wait...Waiting for node to join cluster (0 minutes and 15 seconds elapsed)=Waiting for node to join cluster (0 minutes and 30 seconds elapsed)...Waiting for node to join cluster (13 minutes and 15 seconds elapsed)=Node 1 has joined the cluster; node rescue successful....Please wait...
Starting SP tasks.....
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
13 Verify that the node status LED is blinking green indicating that the node has joined the
cluster, then press Enter to continue.
14 Select 1, Deconfigure <name of cluster> Node Rescue.
15 Select x, Return to previous menu until you return to the main menu.
16 Select option 7, Interactive CLI for an InServ.
17 Select the desired InServ.
18 Verify that all nodes have joined the cluster by issuing the shownode command.
19 Issue the checkhealth -svc command to verify your system is healthy.
If the system is running OS 2.2.4 or earlier, complete the following steps.
a Connect the red crossover Ethernet cable to your laptop. This connects the maintenance
PC to the SP private (ETH1) network.
b Type in the IP address (10.255.155.54) of the SP in the Web browser and press ENTER.
c Log in to the Service Processor Onsite Customer Care (SPOCC) interface from the
maintenance PC using a supported Web browser.
d Type your user name and password and click OK.
e From the SPOCC Homepage, click Support from the left column menu.
f Click CSStatus on the InServs Action menu.
g Verify CSStatus indicates the system is healthy.
h Log out of SPOCC by clicking Log Out on the upper right window.
NOTE: This process takes approximately fifteen minutes. When complete, the
node reboots and becomes part of the cluster. If this takes longer than twenty
minutes, problems may exist and the node rescue process needs to be corrected.
cli% shownodeControl Data Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100
D.53PAR Confidential
D.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
20 In the service processor window issue the exit command to stop the CLI session.
21 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
22 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
23 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
24 Close and lock the rear door of the InServ.
25 Replace the bezel that covers the front of the InServ.
26 Replace and secure the front fascia on the storage server if applicable.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
D.2 Performing Manual Node RescueThe following instructions describe how to perform a manual controller node rescue using the
maintenance PC:
1 Start an spmaint session:
a Connect the maintenance PC to the SP using the serial connection. Refer to Connecting
to the Service Processor on page 3.9 for additional information.
b Log in to the service processor by entering your login name and password.
The 3PAR Service Processor Menu appears:
2 In the service processor window, issue the spmaint command (if necessary).
3 Select option 4, InServ Product Maintenance.
4 Select option 11, Node Rescue.
5 Select option 1, Configure Node Rescue.
6 Select the desired InServ.
7 Select option 2, Manual Node Rescue.
8 Enter y to stop all service processor tasks.
NOTE: Manual-Rescue builds the node disk, so it contains the proper software for
the cluster.
D.73PAR Confidential
D.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
9 At the rear of the storage server, uncoil the red crossover Ethernet cable connected to the
SP (ETH1) private network connection of the service processor.
10 Connect ETH1 of the service processor to the E0 port of the node that is being rescued
through the crossover cable.
0299_L_R1
Ethernet 0
Ethernet 1
ServiceProcessor
Node
CrossoverCable
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
A screen appears displaying the steps to perform a manual node rescue. Continue to the
next step.
11 Disconnect the blue ethernet (serial) cable from the adapter on the SP.
This is the procedure for manually rescuing node(s) in InServ <name> 1. connect the node to be rescued to the SP's private network NOTE: this requires a hub or crossover cable 2. connect a laptop to the serial interface on the node to be rescued NOTE: 57600,N,8,1,XON/XOFF 3. reset, or power cycle, the node to be rescued 4. on the serial interface press ctrl-w after the 'PCI Fibre Channel Adapter Test' have started. 5. BIOS levels higher than 2.1.x support the "boot rescue" command which will automate the manual-rescue entries. FRU nodes have lower and higher levels of BIOS, however.
type: boot rescue<enter>
and if the node says it is an "unknown option", enter the manual-rescue information as indicated below, otherwise when the node asks for confirmation to erase the disk type: y<enter>
6. type: net netmask 255.255.255.248<enter> 7. type: net server 10.255.155.54<enter> 8. type: boot net install edit<enter> NOTE: the node will begin booting and then pause for input. 9. press the SPACEBAR once, and then type: ip=10.255.155.53 nm=255.255.255.248 rp=10.255.155.54::rescueide and press <enter> NOTE: type this line exactly!! The system will install the base OS,InFormOS, and reboot before joining the
cluster. Wait for this before proceeding. There may be additional instructions from 3PAR support if you are rescuing multiple nodes.
D.93PAR Confidential
D.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
12 Connect the cable to the serial port (C0) on the node being rescued.
13 Change the baud rate to 57,600.
14 Insert the node into the chassis with the Ethernet cable connected. It will begin to boot and
run tests.
15 Perform the following on the serial interface after the PCI Adapter tests (POST diagnostic
test #38) have been completed:
a Press CTRL+w.
b Type boot rescue and press ENTER.
c Select y to continue.
The system installs the base OS and InForm OS. See the following for typical output.
0661_L_R2
E0 C0
Field EngineerLaptop
Node
Service Processor
Eth1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
NOTE: This process takes approximately 10 to 15 minutes (rescue and rebuild of
disk = five minutes) + (reboot = 5-10 minutes). When complete, the node restarts
and becomes part of the cluster.
Whack>boot rescueThis is the procedure for manually rescuing a 3PAR InServ node (i.e.,rebuilding the software on the node's internal disk). The system will installthe base OS, BIOS, and InForm OS for the node before it joins the cluster.
You must first connect a Category 5 crossover Ethernet cable between the SP'sprivate/internal network (ETH-1) and the "E0" Ethernet port of the node to berescued. Note that the diagram below does not represent the physical portnumbers or configuration of all node types.
New Node Service Processor +------------+ +-----------------+ ||||||| | | | ||||||| | |ETH-0 ETH-1(Int) | ||||||| E0 C0| +-----------------+ +------------+ ^ ^ ^ |____Crossover ETH____| |__Maintenance PC (serial connection)
This procedure will execute the following Whack commands: 1. net addr 10.255.155.53 2. net netmask 255.255.255.248 3. net server 10.255.155.54 4. boot net install ipaddr=10.255.155.53 nm=255.255.255.248 rp=10.255.155.54::rescueide
This operation will completely erase and reinstall the node's local disk.Are you sure? (Y/N) YesTFTP "install" from 10.255.155.54............................................................................................................
D.113PAR Confidential
D.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
16 After 10 to 15 minutes, verify if the node LED is slowly blinking green which indicates the
node has joined the cluster.
17 Disconnect the blue Ethernet cable (serial) from the node and reconnect to the adapter on
the SP.
18 Change the baud rate to 38,400.
19 Log into spmaint. When you log in, you are prompted to confirm that Node Rescue is
complete.
20 Select option 1, Deconfigure Node Rescue.
21 Select option x, Return to previous menu until you return to the main menu.
22 Select option 7, Interactive CLI for an InServ.
23 Select the desired InServ Storage Server.
24 Verify that all nodes have joined the cluster by issuing the shownode command.
25 Issue the checkhealth -svc command to verify your system is healthy.
If the system is running OS 2.2.4 or earlier, complete the following steps:
a Connect the red crossover Ethernet cable to your laptop. This connects the maintenance
PC to the SP private (ETH1) network.
b Type in the IP address (10.255.155.54) of the SP in the Web browser and press ENTER.
c Log in to the Service Processor Onsite Customer Care (SPOCC) interface from the
maintenance PC using a supported Web browser.
d Type your user name and password and click OK.
e From the SPOCC Homepage, click Support from the left column menu.
f Click CSStatus on the InServs Action menu.
g Verify CSStatus indicates the system is healthy.
h Log out of SPOCC by clicking Log Out on the upper right window.
cli% shownode Control Data CacheNode --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
26 In the service processor window issue the exit command to stop the CLI session.
27 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service
Processor Menu.
28 Disconnect the serial cable from the maintenance PC and coil and place the cable behind
the SP.
29 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable
behind the SP, and if applicable, reconnect the customer’s Ethernet cable and all other
cables to the node.
30 Close and lock the rear door of the InServ.
31 Replace the bezel that covers the front of the InServ.
32 Replace and secure the front fascia on the storage server if applicable.
D.133PAR Confidential
D.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
ELocking Fascia
In this appendix
E.1 Locking Fascia E.2
E.1.1 Converting a Cabinet from Standard to Locking Fascias E.2
E.1.2 Removing the Locking Fascia E.3
E.1.3 Replacing the Locking Fascia E.4
E.2 Locking Fascia II E.6
E.2.1 Converting a Standard Cabinet to a Locking Fascia II E.6
E.2.2 Removing the Locking Fascia E.8
E.2.3 Replacing the Locking Fascia E.10
This appendix provides instructions on converting a standard fascia to a locking fascia
including instructions for removal and replacement of a locking fascia.
E.1Locking Fascia
3PAR Confidential
E.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
E.1 Locking Fascia
E.1.1 Converting a Cabinet from Standard to Locking Fascias
To convert a standard cabinet with standard fascias to one with locking fascias:
1 Remove the standard fascias from the cabinet.
2 Remove the four mounting brackets located at each inner corner of the cabinet, setting the
screws aside.
Figure E-1. Removing Locking Brackets
0793_L_R1
Brackets (2x)
Brackets (2x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3 Using the old screws, attach the new mounting brackets in place by inserting the guiding
pin to hold the bracket in place. Repeat for each bracket. Extra screws and PEM nuts are
included if the old screws or nuts are damaged.
4 Install the fascia and use the key to lock it in place.
E.1.2 Removing the Locking Fascia
To remove the locking fascias:
1 Unlock the bottom lock of the fascia.
2 With one hand supporting the fascia in place, unlock the top lock.
3 Carefully set the fascia aside so it does not interfere with the maintenance of the storage
server.
NOTE: If the PEM nut is stripped, use the longer screws and washers that
accompany the mounting brackets in the locking fascia kit.
E.33PAR Confidential
E.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4 Repeat the same procedure with the second fascia.
Figure E-2. Removing the Locking Fascia
E.1.3 Replacing the Locking Fascia
To replace the locking fascias:
1 Set the fascia in place and support it with one hand while locking the upper lock.
0672_L_R2
Fascia
Lock (2x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
2 Continue to support the fascia while locking the lower lock.
Figure E-3. Replacing the Locking Fascia
0794_L_R1
Fascia
Lock (2x)
E.53PAR Confidential
E.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
E.2 Locking Fascia II
E.2.1 Converting a Standard Cabinet to a Locking Fascia II
To convert a standard cabinet with standard fascias to one with locking fascias:
1 Remove the standard fascias from the cabinet.
2 Remove the four mounting brackets located at each inner corner of the cabinet, setting the
screws aside.
Figure E-4. Removing Locking Brackets
0793_L_R1
Brackets (2x)
Brackets (2x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3 Use a #2 Phillips screw driver to install the universal cosmetic/mounting bracket to the
upper and lower section of the cabinet. Screw the 10-32 x 1/2 screw and washer to the nut
under the cabinet. Repeat on other side of bracket.
Figure E-5. Installing Universal Cosmetic/Mounting Brackets
0810_L_R1
E.73PAR Confidential
E.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
4 Install the locking fascia by holding the pocket handles and locking both locks to the
brackets.
Figure E-6. Installing the Locking Fascia
5 Use a #2 Phillips screwdriver to secure the Quarter-Turn screw.
6 Repeat for second fascia.
E.2.2 Removing the Locking Fascia
To remove the locking fascia:
1 Turn the pocket handles out.
2 Unlock the bottom lock of the fascia.
3 With one hand supporting the fascia in place, unlock the top lock.
Lock (2)
0811_L_R1
Quarter-Turn Screw
Pocket Handles (2x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
4 Supporting the fascia by the pocket handles, set the fascia aside so it does not interfere
with the maintenance of the storage server.
5 Repeat the same procedure with the second fascia.
Figure E-7. Removing the Locking Fascia
Lock (2)
0812_L_R1
Quarter-Turn Screw
Pocket Handles (2x)
E.93PAR Confidential
E.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
E.2.3 Replacing the Locking Fascia
To replace the locking fascias:
1 Turn the pocket handles out, while holding the handles set the fascia in place and support
it with one hand while locking the upper lock.
2 Continue to support the fascia while locking the lower lock.
3 Use a #2 Phillips screwdriver to secure the Quarter-Turn screw on the center of the fascia.
Figure E-8. Replacing the Locking Fascia
4 Turn the pocket handles in so they are flush with the fascia and out of the way.
5 Repeat with other fascia.
Lock (2)
0811_L_R1
Quarter-Turn Screw
Pocket Handles (2x)
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
FIllustrated Parts Catalog
In this appendix
F.1 Storage Server Frame Components F.2
F.2 Drive Chassis Components F.6
F.3 Internal Node Components F.10
F.4 Miscellaneous Components F.14
This appendix contains the illustrated parts catalog for all Field Replaceable Units (FRUs) and
replaceable hardware.
Following each page of illustrated parts is a parts list containing part numbers and quantities.
Part numbers that are preceded with an F are identified as FRUs.
NOTE: For the most current and complete information about FRU part numbers,
see the FRU Parts Database in 3PAR’s STATS application.
F.1Illustrated Parts Catalog
3PAR Confidential
F.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
F.1 Storage Server Frame Components
Figure F-1. Storage Server Frame FRUs
Table F-1. Storage Server Frame FRUs
Ref.
Number
Base Part
Number Description Qty.
1 F800–0013 Battery Backup Unit up to 8
2 F970–0012
F970–0016
PDU, 1U, NEMA L6–30 cord
PDU, 1U, IEC–60309 cord
4
0325_L_R1
2
1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Figure F-2. Service Processor FRU
Table F-2. Service Processor FRUs
Ref.
Number
Part
Number Description Qty.
1 F975–0009 Service Processor, 1U (Wintec) 1
2 F975-200035
F979-200051
Service Processor, 1U (Supermicro) 1
3 F975-200010 Service Processor, 1U (Supermicro II) 1
0520_L_R1
1
0642_L_R1
2
0808_L_R1
3
F.33PAR Confidential
F.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Figure F-3. Node Chassis
Table F-3. Node Chassis
Ref.
Number
Part
Number Description Qty.
1 F970–200004 T400 Node Chassis 1
2 F970–200005 T800 Node Chassis 1
0327_L_R1
21
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Figure F-4. Controller Node Power Supply
BD
Table F-4. Controller Node Power Supply
Ref.
Number
Part
Number Description Qty.
1 F800–0019 Power Supply, Node 2 per node
0454_L_R1
1
F.53PAR Confidential
F.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
F.2 Drive Chassis Components
Figure F-5. Drive Chassis Component FRUs
BD
0627_L_R51 32 4
16
155
14
6 78
910
11
1213
Table F-5. Drive Chassis FRUs
Ref.
Number
Part
Number Description Qty Per Chassis
1 F970–200008 Drive Magazine, DC4, NL-SATA, 4GBIT up to 10
2 F970–0135 Drive Magazine, DC4, FC, 4GBIT up to 10
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
3 F970-200094 Drive Magazine, DC4, FC, TYPE-2, 4GBIT up to 10
4 F970–0136 FC-AL Module, DC4, 4GBIT 2
5 F810–200000
F810–200006
FC Disk, 146 GB, 15K RPM, Seagate, ROHS up to 40
6 F810-200008
F810-200012
FC Disk, 300 GB, 15K RPM, Seagate-
ST3300656FC
FC Disk, 300 GB, 15K RPM, Seagate-
ST3300657FC
up to 40
7 F810-200004 FC Disk, 400 GB, 10K RPM, Seagate, ROHS up to 40
8 F810-200016 FC Disk, 450 GB, 15K RPM, Seagate
(ST3450856FC)
up to 40
9 F810-200013 FC Disk, 600 GB, 15K RPM, Seagate up to 40
10 F810-0020-02-R5 NL-SATA Disk, 750 GB, 7.2 RPM, Seagate up to 40
11 F810-200007 NL-SATA Disk, 1TB, 7.2K RPM, Seagate up to 40
12 F810-200021 FC Disk, 300 GB, 15K RPM, Hitachi up to 40
13 F810-200022 FC Disk, 600 GB, 15K RPM, Hitachi up to 40
14 F810-200018 NL-SATA, 2TB, 7K RPM, Hitachi up to 40
15 F970-200017 SSD-SATA Drive, 50 GB, STEC up to 40
16 F180–0093 SFP Transceiver (Small Form-factor
Pluggable) 4GBIT, Finisar
up to 4
Table F-5. Drive Chassis FRUs (continued)
Ref.
Number
Part
Number Description Qty Per Chassis
F.73PAR Confidential
F.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Figure F-6. Drive Chassis Midplane
Table F-6. Drive Chassis Midplane
Ref.
Number
Part
Number Description Qty.
1 F920-1062-03 DC4 Drive Chassis Midplane Assembly 1
0626_L_R1
1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Figure F-7. Drive Chassis Power Supply
BD
Table F-7. Drive Chassis Power Supply
Ref.
Number
Part
Number Description Qty per Chassis
1 F800–200000 Power Supply, Drive Cage, Power-One 4
0643_L_R1
1
F.93PAR Confidential
F.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
F.3 Internal Node Components
Figure F-8. Internal Node FRUs
0645_L_R2
or
34
1
2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Table F-8. Internal Node FRUs
Ref. Number Part Number Description Qty.
1 F970–200006
F970–200067
Type-1, 2.33 GHz Node with SATA Disk
Type-2, 2.33 GHz Node with SATA Disk
1
2 F925–0027 iSCSI Adapter, 2 Port, (QLA4052C) up to 2
3 F970–0130 Fibre Channel Adapter, 4 Port, 4Gbit, (3PAR) up to 6
4 F970–200024
F970–200074
SATA Disk, Node, 100 GB 1
F.113PAR Confidential
F.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Figure F-9. DIMMs and Clock Battery
Control Cache DIMMs:
0639_L_R3
DIMM 0
DIMM 1
DIMM 2.0DIMM 2.1
DIMM 1.0DIMM 1.1
DIMM 0.0DIMM 0.1
Data Cache 2-Slot Riser Card Data Cache 4-Slot Riser Card
1
3
4
2
5
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Table F-9. DIMMs and TOD Battery for the Controller Node
Ref.
Number
Part
Number Description Qty.
1 F920-1058
F970-200065
2-Slot Data Cache Riser Card, Node
2-Slot Data Cache Riser Card, Node (Type 2) - Used in
Type-2 nodes (P/N F970-200067)
1
2 F920–1059
F970-200066
4-Slot Data Cache Riser Card, Node
4-Slot Data Cache Riser Card, Node (Type 2)
1
3 F922–200003
F922-200008
F922-200010
SDRAM, DDR, 2 GB DIMM (Data Cache-STEC)
SDRAM, DDR, 2 GB DIMM (Data Cache-Micron)
SDRAM, DDR, 2 GB DIMM (Data Cache-Micron)
6
4 F170–0012 TOD Battery, BR2032 1
5 F922–200001
F922-200009
F922-200013
SDRAM, DDR2, 2 GB FBDIMM (Control Cache-STEC)
SDRAM, DDR2, 2 GB FBDIMM (Control Cache-Micron)
SDRAM, DDR2, 2 GB FBDIMM (Control Cache-Micron)
2
NOTE: Both control cache and data cache DIMMs must be replaced by DIMMs
with the same manufacturing part number.
The T-Class Storage Server use DIMMs from the following manufacturers:
◆ SimpleTech––Identified by STEC on top surface at the edge of the DIMM.
◆ Micron––Identified by M inside an ellipse on the edge of the DIMM.
F.133PAR Confidential
F.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
F.4 Miscellaneous Components
Figure F-10. Storage Server Cables
0340_L_R2
1
2
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Table F-10. Storage Server Cables
Ref.
Number
Part
Number Description Qty.
1 F850–200000
F850–200001
F850–0034
F850–0035
F850–0036
FC Cable, 2 m, LC-LC, 50 micron
FC Cable, 4 m, LC-LC, 50 micron
FC Cable, 10 m, LC-LC, 50 micron
FC Cable, 50 m, LC-LC, 50 micron
FC Cable, 100 m, LC-LC, 50 micron
2 F850–0030 Cable, Battery Back Up Unit
Not shown F180–0055 RJ45 to DB9 Adapter, crossover
Not shown F180–0059 RJ45 to DB9 Adapter, straight
Not shown F850–0033 Ethernet Cable, crossover, 20 ft
F.153PAR Confidential
F.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
GAgency Compliance Statements
In this appendix
G.1 Safety Precautions G.2
G.2 Safety Agency Compliance Notices G.2
G.2.1 System Placement and Security G.2
G.2.2 Battery Replacement and Disposal G.5
G.2.3 Controller Nodes G.8
G.2.4 Drive Chassis G.13
G.3 3PAR Power Cables G.16
G.4 Japan Green Law Statement of Compliance G.16
This appendix contains safety precautions and agency compliance notices for InServ Storage
Servers and their components. Read this section before beginning any of the procedures
described in this guide.
G.1Agency Compliance Statements
3PAR Confidential
G.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
G.1 Safety PrecautionsTo be safe and to protect system data and equipment, always follow the instructions in this
manual when installing, maintaining, troubleshooting, and upgrading InServ Storage Servers
and their components.
In addition, please take the following precautions:
■ Install and maintain storage servers and their components in a restricted access location,
limiting access to storage server equipment, software, and documentation.
■ Follow all instructions, warnings, and cautions printed on individual storage server
components. Those instructions take precedence over statements made in this guide.
■ Before installing a storage server, verify that the voltage and frequency of the power
sources at the operating sites matches the voltage and frequency indicated on the system’s
electrical rating label.
G.2 Safety Agency Compliance NoticesInServ Storage Servers comply with safety standards for ITE equipment. For your safety,
observe the notices that follow.
G.2.1 System Placement and Security
Install and maintain storage servers and their components in a restricted access location,
limiting access to storage server equipment, software, and documentation. Each power supply
cord is to be connected to separate 30A branch circuits.
WARNING: Install this unit in a restricted access location.
ACHTUNG: Diese Einheit darf nicht frei zugänglich installiert werden.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
AVERTISSEMENT: Installer cette unité dans un endroit restreint d'accès.
WAARSCHUWING: Deze eenheid dient te worden geïnstalleerd op een beperkt
toegankelijke locatie.
ADVERTENCIA: Está unidad deberá ser instalada en una área de acceso
restringido.
G.33PAR Confidential
G.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
For storage servers with 3PAR cabinets, secure the system by locking the rear doors on all
cabinets.
WARNING: Hazardous energy is located behind the rear access door of the
storage server cabinet.
ACHTUNG: Hinter der rückwärtigen Zugangstür des Storage-Server-Schranks
liegen gefährliche Spannungen an.
AVERTISSEMENT: Énergie dangereuse située derrière la porte d'accès arrière du
coffret de serveur de stockage.
WAARSCHUWING: Achter de toegangsdeur van de opslagserverkast aan de
achterzijde ontstaat gevaarlijke energie.
ADVERTENCIA: Energía peligrosa esta localizada detrás de la puerta de acceso
trasera del gabinete del servidor de almacenamiento.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
G.2.2 Battery Replacement and Disposal
Storage server controller nodes contain 3-V lithium coin batteries. These batteries require
periodic replacement.
WARNING: There is danger of an explosion if the lithium coin battery inside the
controller node is incorrectly replaced. Replace the coin battery only with the
same or equivalent type recommended by the manufacturer.
ACHTUNG: Bei unsachgemäßem Austausch der Lithium-Knopfbatterie im
Steuerknoten besteht Explosionsgefahr. Die Knopfbatterie darf nur durch eine
gleiche bzw. vom Hersteller empfohlene gleichwertige Batterie ersetzt werden.
AVERTISSEMENT: Il y a un danger d'explosion si la batterie de lithium à
l'intérieur du contrôleur est incorrectement positionnée. Remplacez la batterie
seulement avec le même type ou équivalent recommandé par le fabricant.
WAARSCHUWING: Er bestaat kans op explosies als de lithium muntbatterij in de
controller node niet op de juiste wijze wordt vervangen. Vervang de muntbatterij
alleen door een type dat equivalent is aan het type dat door de fabrikant wordt
aanbevolen.
G.53PAR Confidential
G.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
ADVERTENCIA: Existe el peligro de explosión si la batería de litio dentro del
controlador del nodo es reemplazada incorrectamente. Reemplacela solamente
con una batería del mismo tipo o con una de tipo equivalente recomendado por
el fabricante.
CAUTION: Dispose of used batteries according to the manufacturer’s instructions.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
VORSICHT: Gebrauchte Batterien nur gemäß Herstelleranweisung entsorgen.
ATTENTION: Débarrassez-vous des batteries use selon les instructions de
fabricant.
WAARSCHUWING: Verwijder gebruikte batterijen volgens de instructies van de
fabrikant.
PRECAUCION: Deseche baterías usadas de acuerdo a las instrucciones del
fabricante.
G.73PAR Confidential
G.8
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
G.2.3 Controller Nodes
For controller nodes installed in cabinets not provided by 3PAR, please observe the following
precautions:
WARNING: Install this unit in a restricted access location.
ACHTUNG: Diese Einheit darf nicht frei zugänglich installiert werden.
AVERTISSEMENT: Installer cette unité dans un endroit restreint d'accès.
WAARSCHUWING: Deze eenheid dient te worden geïnstalleerd op een beperkt
toegankelijke locatie.
ADVERTENCIA: Está unidad deberá ser instalada en una área de acceso
restringido.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
WARNING: Hazardous energy located on rear connectors.
ACHTUNG: An den rückwärtigen Anschlüssen liegen gefährliche Spannungen an.
AVERTISSEMENT: Énergie dangereuse située sur les connecteurs arrière.
WAARSCHUWING: Gevaarlijke energievelden achter de aansluitingen aan de
achterzijde.
G.93PAR Confidential
G.10
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
ADVERTENCIA: Energía peligrosa localizada en los conectores traseros.
WARNING: There is danger of an explosion if the lithium coin battery inside the
controller node is incorrectly replaced. Replace the coin battery only with the
same or equivalent type recommended by the manufacturer.
ACHTUNG: Bei unsachgemäßem Austausch der Lithium-Knopfbatterie im
Steuerknoten besteht Explosionsgefahr. Die Knopfbatterie darf nur durch eine
gleiche bzw. vom Hersteller empfohlene gleichwertige Batterie ersetzt werden.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
AVERTISSEMENT: Il y a un danger d'explosion si la batterie de lithium à
l'intérieur du contrôleur est incorrectement positionnée. Remplacez la batterie
seulement avec le même type ou équivalent recommandé par le fabricant.
WAARSCHUWING: Er bestaat kans op explosies als de lithium muntbatterij in de
controller node niet op de juiste wijze wordt vervangen. Vervang de muntbatterij
alleen door een type dat equivalent is aan het type dat door de fabrikant wordt
aanbevolen.
ADVERTENCIA: Existe el peligro de explosión si la batería de litio dentro del
controlador del nodo es reemplazada incorrectamente. Reemplacela solamente
con una batería del mismo tipo o con una de tipo equivalente recomendado por
el fabricante.
G.113PAR Confidential
G.12
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
CAUTION: Dispose of used batteries according to the manufacturer’s instructions.
VORSICHT: Gebrauchte Batterien nur gemäß Herstelleranweisung entsorgen.
ATTENTION: Débarrassez-vous des batteries use selon les instructions de
fabricant.
WAARSCHUWING: Verwijder gebruikte batterijen volgens de instructies van de
fabrikant.
PRECAUCION: Deseche baterías usadas de acuerdo a las instrucciones del
fabricante.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
G.2.4 Drive Chassis
For drive chassis installed in cabinets not provided by 3PAR, observe the following precautions:
WARNING: Install this unit in a restricted access location.
ACHTUNG: Diese Einheit darf nicht frei zugänglich installiert werden.
AVERTISSEMENT: Installer cette unité dans un endroit restreint d'accès.
WAARSCHUWING: Deze eenheid dient te worden geïnstalleerd op een beperkt
toegankelijke locatie.
ADVERTENCIA: Está unidad deberá ser instalada en una área de acceso
restringido.
G.133PAR Confidential
G.14
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
WARNING: There is danger of an explosion if the battery is incorrectly replaced.
Replace only with the same or equivalent type recommended by the
manufacturer.
ACHTUNG: Bei unsachgemäßem Austausch der Batterie besteht
Explosionsgefahr. Sie darf nur durch eine gleiche bzw. vom Hersteller empfohlene
gleichwertige Batterie ersetzt werden.
AVERTISSEMENT: Il y a un danger d'explosion si la batterie est incorrectement
positionnée. Remplacez la batterie seulement avec le même type ou équivalent
recommandé par le fabricant.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
WAARSCHUWING: Er bestaat kans op een explosie als de batterij niet op de
juiste wijze wordt vervangen. Alleen te vervangen door een type dat equivalent is
aan het type dat door de fabrikant wordt aanbevolen.
ADVERTENCIA: Existe el peligro de explosión si la batería es reemplazada
incorrectamente. Reemplácela solamente con una batería del mismo tipo o un
tipo equivalente recomendado por el fabricante.
G.153PAR Confidential
G.16
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
G.3 3PAR Power CablesEnglish Compliance Statement
All power cables provided by 3PAR are for exclusive use for 3PAR products.
Japanese Compliance Statement
G.4 Japan Green Law Statement of ComplianceEnergy consumption efficiency*= 0.089
* Japan Green Law statement of compliance: The energy consumption efficiency value has
been calculated per requirements for Category-G Magnetic Disk Drive Units by dividing the
power consumption, measured according to the definition in the Law Concerning the Rational
Use of Energy, by the storage capacity defined in the Energy Conservation Law. The efficiency
value is based on a host-maximized T800 configuration using 750GB drives.
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Index
NUMERICS10 minute maximum before overheating, drive
chassis 430 minute maximum before overheating
drive replacement 33-V lithium coin battery 1
AAC line, testing 2adapters, Fibre Channel
location of 2altitude requirements and specifications 2
Bbatteries
clock, replacing 1disposing of 4explosion warning for 4, 5lithium, replacement and disposal of 5
battery backup units (BBUs)amber LEDs 6cache memory and power failure 17hazardous materials in 4LEDs 17
status and error display 17
Ccabinets
disconnecting the ground wire 5drive chassisground wire, disconnecting 5non-3PAR, controller node warnings 8
cables 13battery backup units (BBUs)
configuration example 5Maintenance PC connections, for 2part numbers 13
cache memory. See control cache memory and data cache memory
cautions, about 5circuit breakers, power distribution units (PDUs) 5,
11CLI commands, Maintenance PC for issuing 1clock battery
3-V lithium coin battery 1COM1, settings 13commands
exit 4, 11shownode 10, 4, 11spmaint 6
control cache memoryinserting DIMMs 6releasing DIMMs 5replacing 2
controller node chassisamber status light 11power supplies 5
part numbers 5removing 2–6
IX.1Index
3PAR Confidential
IX.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
two nodespart numbers 4
unpacking 7–8controller nodes
clock battery, replacing 1connecting to Maintenance PC 2–9control cache memory
replacing 2cover, removing 5data cache memory
replacing 2Fibre Channel adapters
location of 2handling precautions 1LEDs 9
hot-plug, location of 2location of 9status and error display 10
node disks, replacing 2non-3PAR cabinets, warnings for 8release lever 3removing 2
cover of 4replacing 4, 6
after servicing 4, 6riser card, removing 6, 4sliding out 4, 3
cord lock, tightening 12
Ddata cache memory 5
DIMMspart numbers 11
inserting 8inserting or releasing 7, 5location and number of DIMMs 2releasing 7, 5replacing 2
data cache riser cardreplacing 2
DB9 to RJ45 adapter 29DB9 to RJ54 crossover adapter 28diagnostics
storage server 20DIMMs
part numbers 11disk drives
captive screws, loosening 7drive replacement over 30 minutes 3node disks
replacing 2numbering of 8removing from the magazine 9, 8replacing 3spinning up before checking 11, 10, 7
dismisspd command 13documentation, related 1drive cages
FC-AL modulesLEDs, status and error displays 5
drive chassiscabinets, non-3PAR cabinets, warning for 13drive magazines, inserting 10, 9drive replacement, overheating at 30 minutes 3,
4FRUs 6
power supplies 6LEDs 3–8midplane assembly
part numbers 7non-3PAR cabinets, warning for 13power supplies
part numbers 8drive magazines
disksnumbering of 8sliding out 9, 8
filler panelsempty slot causing overheating 3
handling precautions 3, 3, 1, 2inserting into the drive chassis 10, 9LEDs
location of 7, 6power supplies 8precautions when handling 2, 3, 1
EEthernet
connectionssecure shell session 22–27service processor to Maintenance PC 16–27SPOCC, logging into 20
exit command 4, 11
Index
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
FFC-AL modules
handling precautions 2, 1LEDs
location ofDC4 4
status and error displays 5replacing 1–6, 1
Fibre Channeladapters
location of 2filler panels
empty slot causing overheating 3
Gground wire, disconnecting 5grounding strap 7, 6
Hhandling precautions
drive magazines 3, 3, 1, 2FC-AL modules 2, 1
hazardous materials in BBUs 4hot-plug status LEDs 6
controller nodes 10humidity specifications for servers 2HyperTerminal, connecting Maintenance PC with
3–15
Iinternal node FRUs 9
part numbers 9IP addresses, connecting Maintenance PC 20
LLEDs
battery backup units (BBUs) 17status and error display 17
controller nodes 9location of 9status and error display 10
disks, status and error display 8drive chassis 3–8
drive cage, FC-AL modules 4drive magazines
location of 7status, location of 6
Ethernet adapter 12power supplies 15
location of 15server diagnostics 2Wintec SP 19
lithium coin battery, explosion warning for 4
MMaintenance PC
cables for 2connecting 1–27
IP addresses for 20serial cable for 2
controller nodes, connecting to 2–9required for maintenance 1service processor
secure shell session 22–27SPOCC, logging into 20
service processor, connecting 9–27Ethernet connection 16–20serial connection 9–15
maintenance PCservice processor
serial connection to 9maintenance port
locating 2midplane assembly
loosening ball stud standoffs 6
Nnodes, internal, FRUs 9
part numbers 9notes, about 5
Ooverheating
drive chassis’ 10 minute maximum 4drive replacement’s 30 minute maximum 3
overview of this guide 2–4
Ppinout diagrams 28power banks
indicator lamps 18
IX.3Index
3PAR Confidential
IX.4
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
location and order of 5, 11power cords, AC
disconnecting 3evidence of damage or wear 6replacing 4
power distribution units (PDUs)circuit breakers 5, 11
setting to OFF 4, 10indicator lamps 18power banks, location and order of 5, 11removing from the rack 6, 12replacing 13
power receptacle connector, unplugging 4, 11power requirements
AC line 2power status LEDs, status and error display 10power supplies
AC cords, disconnecting 4, 3cord lock, tightening 12drive magazine 8
part numbers 8LEDs 15
location of 15redundant power configuration 3, 9setting to OFF 4
procedures, overview of 2–4PuTTY software, installing and using 25
Rracks
filler panelsempty slot causing overheating 3
redundant power, valid configuration example 3, 9
related documentation 1revision history 1
Ssafety agency compliance notices 2safety precautions 2Secure CRT software, installing and using 25security, of servers 2serial cable pinouts 28serial cable, connecting Maintenance PC with 2serial port, settings 13server maintenance
required tools 1
serversredundant power, configuration example 3, 9safety precautions 2
service processor1-U
replacing 2backup script 5connecting to Maintenance PC 9–27
Ethernet connection 16–20serial connection 9–15
connecting to maintenance PCserial connection 9
LEDs 12user interfaces 20
setbattery command 6showbattery command 3, 6showcage command 2shownode command 10, 4, 11software
Secure CRT, installing and using 25spmaint command 2, 5, 6SPOCC, logging into 20storage server midplane
replacing 7storage servers
cables 13part numbers 13
framesFRUs 2part listing 2
LEDs, for diagnostics 2lithium battery replacement 5placement and security 2security of 2
Ttemperature specifications for servers 2troubleshooting
storage server 20TUV compliance 2
UUL® compliance 2
Vvoltage and frequency verification 2
Index
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
voltage regulator modulereplacing 2
Wwarnings, about 5Wintec LEDs 19, 20
IX.5Index
3PAR Confidential
IX.6
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Index
3PAR Confidential
InForm OS Version 2.3.1 3PAR InServ T-Class Storage Server Maintenance Manual
Revision History
.Release Level Revision Summary
325–200090 Rev A
October 2009
First release of this manual to support the release of 3PAR InForm OS
2.3.1.
325-200090 Rev B
February 2010
Second release of this manual to support a new service processor and
Solid State Drives (SSD).
325-200090 Rev C
August 2010
Third release of this manual to support 3PAR Secure Service Agent
(SSA) and new storage hard drives.
RH.1Revision History
3PAR Confidential
RH.2
3PAR InServ T-Class Storage Server Maintenance Manual InForm OS Version 2.3.1
Revision History
3PAR Confidential