Front coverDraft Document for Review November 16, 2012 9:25 am
SG24-8085-00
IBM System Storage DS8870Architecture and Implementation
Dual IBM POWER7 based controllers with up to 1 TB of cache 400
GB SSDs with Full Disk Encryption support Improved Power Supplies
and extended Power Line Disturbance
Bertrand Dufrasne Peter Kimmel Pere Alcaide Istvan Paloczi Akin
Sakarcan Roland Wolf
ibm.com/redbooks
Draft Document for Review November 16, 2012 9:25 am
8085edno.fm
International Technical Support Organization IBM System Storage
DS8870 Architecture and Implementation October 2012
SG24-8085-00
8085edno.fm
Draft Document for Review November 16, 2012 9:25 am
Note: Before using this information and the product it supports,
read the information in Notices on page iii.
First Edition (October 2012) This edition applies to Version
???, Release ???, Modification ??? of ???insert-product-name???
(product number ????-???). This document was created or updated on
November 16, 2012.
Copyright International Business Machines Corporation 2012. All
rights reserved. Note to U.S. Government Users Restricted Rights --
Use, duplication or disclosure restricted by GSA ADP Schedule
Contract with IBM Corp.
Draft Document for Review November 16, 2012 9:25 am
8085spec.fm
NoticesThis information was developed for products and services
offered in the U.S.A. IBM may not offer the products, services, or
features discussed in this document in other countries. Consult
your local IBM representative for information on the products and
services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that
only that IBM product, program, or service may be used. Any
functionally equivalent product, program, or service that does not
infringe any IBM intellectual property right may be used instead.
However, it is the user's responsibility to evaluate and verify the
operation of any non-IBM product, program, or service. IBM may have
patents or pending patent applications covering subject matter
described in this document. The furnishing of this document does
not grant you any license to these patents. You can send license
inquiries, in writing, to: IBM Director of Licensing, IBM
Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A. The
following paragraph does not apply to the United Kingdom or any
other country where such provisions are inconsistent with local
law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR
IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE. Some states do not allow disclaimer of express or implied
warranties in certain transactions, therefore, this statement may
not apply to you. This information could include technical
inaccuracies or typographical errors. Changes are periodically made
to the information herein; these changes will be incorporated in
new editions of the publication. IBM may make improvements and/or
changes in the product(s) and/or the program(s) described in this
publication at any time without notice. Any references in this
information to non-IBM websites are provided for convenience only
and do not in any manner serve as an endorsement of those websites.
The materials at those websites are not part of the materials for
this IBM product and use of those websites is at your own risk. IBM
may use or distribute any of the information you supply in any way
it believes appropriate without incurring any obligation to you.
Any performance data contained herein was determined in a
controlled environment. Therefore, the results obtained in other
operating environments may vary significantly. Some measurements
may have been made on development-level systems and there is no
guarantee that these measurements will be the same on generally
available systems. Furthermore, some measurements may have been
estimated through extrapolation. Actual results may vary. Users of
this document should verify the applicable data for their specific
environment. Information concerning non-IBM products was obtained
from the suppliers of those products, their published announcements
or other publicly available sources. IBM has not tested those
products and cannot confirm the accuracy of performance,
compatibility or any other claims related to non-IBM products.
Questions on the capabilities of non-IBM products should be
addressed to the suppliers of those products. This information
contains examples of data and reports used in daily business
operations. To illustrate them as completely as possible, the
examples include the names of individuals, companies, brands, and
products. All of these names are fictitious and any similarity to
the names and addresses used by an actual business enterprise is
entirely coincidental. COPYRIGHT LICENSE: This information contains
sample application programs in source language, which illustrate
programming techniques on various operating platforms. You may
copy, modify, and distribute these sample programs in any form
without payment to IBM, for the purposes of developing, using,
marketing or distributing application programs conforming to the
application programming interface for the operating platform for
which the sample programs are written. These examples have not been
thoroughly tested under all conditions. IBM, therefore, cannot
guarantee or imply reliability, serviceability, or function of
these programs.
Copyright IBM Corp. 2012. All rights reserved.
iii
8085spec.fm
Draft Document for Review November 16, 2012 9:25 am
TrademarksIBM, the IBM logo, and ibm.com are trademarks or
registered trademarks of International Business Machines
Corporation in the United States, other countries, or both. These
and other IBM trademarked terms are marked on their first
occurrence in this information with the appropriate symbol ( or ),
indicating US registered or common law trademarks owned by IBM at
the time this information was published. Such trademarks may also
be registered or common law trademarks in other countries. A
current list of IBM trademarks is available on the Web at
http://www.ibm.com/legal/copytrade.shtml The following terms are
trademarks of the International Business Machines Corporation in
the United States, other countries, or both:AIX CICS Cognos DB2
DS4000 DS6000 DS8000 Enterprise Storage Server ESCON FICON
FlashCopy GDPS HACMP HyperSwap i5/OS IBM IMS iSeries NetView Power
Architecture POWER Hypervisor Power Systems POWER6+ POWER6 POWER7
PowerHA PowerPC POWER ProtecTIER pSeries Redbooks Redpaper
Redpapers Redbooks (logo) RMF S/390 System i System p System
Storage DS System Storage System x System z10 System z TDMF Tivoli
TotalStorage XIV z/OS z/VM z10 z9 zSeries
The following terms are trademarks of other companies: Intel,
Intel logo, Intel Inside logo, and Intel Centrino logo are
trademarks or registered trademarks of Intel Corporation or its
subsidiaries in the United States and other countries. Disk Magic,
IntelliMagic, and the IntelliMagic logo are trademarks of
IntelliMagic BV in the United States, other countries, or both.
Microsoft, Windows, and the Windows logo are trademarks of
Microsoft Corporation in the United States, other countries, or
both. Novell, SUSE, the Novell logo, and the N logo are registered
trademarks of Novell, Inc. in the United States and other
countries. Java, and all Java-based trademarks and logos are
trademarks or registered trademarks of Oracle and/or its
affiliates. QLogic, and the QLogic logo are registered trademarks
of QLogic Corporation. SANblade is a registered trademark in the
United States. SAP, and SAP logos are trademarks or registered
trademarks of SAP AG in Germany and in several other countries.
UNIX is a registered trademark of The Open Group in the United
States and other countries. Other company, product, or service
names may be trademarks or service marks of others.
iv
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085TOC.fm
ContentsNotices . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . xi Trademarks . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . xii Preface . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . xiii The team who wrote this book . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . xiv Now you can become a published author, too! . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv Stay
connected to IBM Redbooks . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . xvi Part 1. Concepts
and architecture. . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Chapter 1. Introduction to the IBM System Storage DS8870 . . . . .
. . . . . . . . . . . . . . . . 3 1.1 Introduction to the DS8870 .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 4 1.1.1 Features of the DS8870 . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 5 1.2 The DS8870 controller options and frames. . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 1.3
DS8870 architecture and functions overview . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 10 1.3.1 Overall
architecture and components . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 10 1.3.2 Storage capacity . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 13 1.3.3 Supported environments . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 13 1.3.4 Configuration flexibility . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
1.3.5 Copy Services functions . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 15 1.3.6 Resource
Groups for copy services scope limiting . . . . . . . . . . . . . .
. . . . . . . . . . 17 1.3.7 Service and setup . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 18 1.3.8 IBM Certified Secure Data Overwrite . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 1.4
Performance features . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 19 1.4.1
Sophisticated caching algorithms . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 19 1.4.2 Solid State Drives
(SSDs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 19 1.4.3 Multipath Subsystem Device
Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 20 1.4.4 Performance for System z. . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
1.4.5 Performance enhancements for IBM Power Systems . . . . . . .
. . . . . . . . . . . . . . 21 Chapter 2. IBM System Storage DS8870
models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.1 The System Storage DS8870 . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 2.2 Model
overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 2.3 DS8870 Disk
drive options . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 2.4 Additional licenses
needed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . Chapter 3. DS8870 hardware
components and architecture. . . . . . . . . . . . . . . . . . . .
. 3.1 Frames: DS8870 . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.1.1
Base frame: DS8870. . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 3.1.2 Expansion frames
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 3.1.3 Rack operator panel . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 3.2 DS8870 architecture overview . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3.2.1 The IBM POWER7 server . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 3.2.2 Peripheral
Component Interconnect Express adapters . . . . . . . . . . . . . .
. . . . . . 3.2.3 Storage facility processor complex (CEC) . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 3.2.4 Processor
memory and cache management . . . . . . . . . . . . . . . . . . . .
. . . . . . . . 3.2.5 Flexible service processor and system power
control network . . . . . . . . . . . . . . . 3.3 I/O enclosures .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 23 24 24 28 31 33 34 34
35 36 38 38 40 41 42 43 44
Copyright IBM Corp. 2012. All rights reserved.
v
8085TOC.fm
Draft Document for Review November 16, 2012 9:25 am
3.3.1 DS8870 I/O enclosure. . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 3.3.2 Host
adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 3.3.3 Device adapters
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . 3.4 Disk subsystem . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 3.4.1 Disk enclosures. . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 3.4.2 Disk drives . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . 3.5 Power and cooling. . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.6
Management console network . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 3.6.1 Ethernet
switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . Chapter 4. RAS on IBM
System Storage DS8870 . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 4.1 Names and terms for the DS8870 storage system . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 4.2 RAS
features of DS8870 Central Electronics Complex. . . . . . . . . . .
. . . . . . . . . . . . . . 4.2.1 POWER7 Hypervisor . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 4.2.2 POWER7 processor . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.3 AIX
operating system . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 4.2.4 Central Electronics
Complex dual hard drive rebuild . . . . . . . . . . . . . . . . . .
. . . . 4.2.5 Cross Cluster communication . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.6
Environmental monitoring . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 4.2.7 Resource
deallocation . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 4.3 Central Electronics Complex
failover and failback . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 4.3.1 Dual operational . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
4.3.2 Failover . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3.3
Failback. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3.4 NVS and
power outages . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 4.4 Data flow in DS8870 . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 4.4.1 I/O enclosures . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 4.4.2 Host connections . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
4.4.3 Metadata checks . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 4.5 RAS on
the HMC. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 4.5.1 Microcode
updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 4.5.2 Call Home and Remote
Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . 4.6 RAS on the disk system . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . 4.6.1 RAID configurations . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.2 Disk
path redundancy . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 4.6.3 Predictive Failure
Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 4.6.4 Disk scrubbing . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 4.6.5 Smart Rebuild . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 4.6.6 RAID 5 overview . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.7 RAID
6 overview . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 4.6.8 RAID 10 overview
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 4.6.9 Spare creation. . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 4.7 RAS on the power subsystem . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 4.7.1 Components . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7.2
Line power loss . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 4.7.3 Line power
fluctuation . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 4.7.4 Power control . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 4.7.5 Emergency power off . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 4.8 RAS and Full Disk Encryption . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.8.1
Deadlock recovery . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 4.8.2 Dual platform
TKLM servers . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 4.9 Other features . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 4.9.1 Internal network . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . .
44 45 47 48 48 52 53 57 57 59 60 61 61 62 65 65 66 67 67 68 68
69 71 71 72 72 73 76 78 78 79 80 81 82 82 83 83 84 85 86 87 89 89
92 92 93 94 95 95 96 97 97
vi
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085TOC.fm
4.9.2 Remote support . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 4.9.3
Earthquake resistance . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 98 Chapter 5.
Virtualization concepts . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 99 5.1 Virtualization
definition . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 100 5.2 The abstraction
layers for disk virtualization . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 100 5.2.1 Array sites . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . 101 5.2.2 Arrays . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 102 5.2.3 Ranks . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 103 5.2.4 Extent Pools . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . 104 5.2.5 Logical volumes . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
5.2.6 Space Efficient volumes . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 111 5.2.7
Allocation, deletion, and modification of LUNs/CKD volumes. . . . .
. . . . . . . . . . 114 5.2.8 Logical subsystem . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 119 5.2.9 Volume access . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
5.2.10 Virtualization hierarchy summary . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 123 5.3 Benefits of
virtualization . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 124 5.4 zDAC - z/OS FICON
discovery and Auto-Configuration . . . . . . . . . . . . . . . . .
. . . . . . 125 5.5 EAV V2 - Extended Address Volumes (CKD) . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 127 Chapter
6. IBM System Storage DS8000 Copy Services overview. . . . . . . .
. . . . . . . 6.1 Copy Services . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 6.2 FlashCopy and FlashCopy SE . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.1 Basic
concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 6.2.2 Benefits and use .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 6.2.3 FlashCopy options . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 6.2.4 FlashCopy SE-specific options . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.5 Remote
Pair FlashCopy . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 6.3 Remote Mirror and Copy . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 6.3.1 Metro Mirror . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 6.3.2 Global Copy . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.3
Global Mirror . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 6.3.4
Metro/Global Mirror . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 6.3.5 Multiple Global
Mirror sessions . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 6.3.6 Thin provisioning enhancements on
open environments . . . . . . . . . . . . . . . . . . 6.3.7 GM and
MGM improvement due to collision avoidance . . . . . . . . . . . .
. . . . . . . 6.3.8 z/OS Global Mirror . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.3.9 z/OS Metro/Global Mirror . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 6.3.10 Summary of
Remote Mirror and Copy function characteristics. . . . . . . . . .
. . . 6.3.11 Consistency group considerations . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 6.3.12 GDPS on zOS
environments . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . 6.3.13 TPC-R functionality . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 6.4 Resource Groups for copy services . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 7.
Architectured for Performance . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 7.1 DS8870 hardware: Performance
characteristics. . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 7.1.1 Vertical growth and scalability. . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 7.1.2 DS8870
Fibre Channel switched interconnection at the back-end . . . . . .
. . . . . 7.1.3 Fibre Channel device adapter . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.1.4
Eight-port and four-port host adapters . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 7.2 Software performance:
Synergy items . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 7.2.1 Synergy on System p . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
7.2.2 Synergy on System z . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 7.3 Performance
considerations for disk drives . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . .Contents
133 134 135 135 137 137 139 139 141 142 143 143 145 146 149 150
151 151 152 153 153 154 154 157 158 158 159 161 163 164 164 165 167
vii
8085TOC.fm
Draft Document for Review November 16, 2012 9:25 am
7.4 DS8000 superior caching algorithms . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 7.4.1 Sequential
Adaptive Replacement Cache. . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 7.4.2 Adaptive Multi-stream Prefetching . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.4.3
Intelligent Write Caching . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 7.5 Performance
considerations for logical configuration . . . . . . . . . . . . .
. . . . . . . . . . . . 7.5.1 Workload characteristics . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 7.5.2 Data placement in the DS8000 . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 7.5.3 Data
placement . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 7.6 I/O Priority Manager
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . 7.6.1 Performance policies for open
systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 7.6.2 Performance policies for System z . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 7.7 IBM Easy Tier . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 7.7.1 IBM Easy Tier operating
modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 7.7.2 IBM Easy Tier Statement of Direction . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 7.8
Performance and sizing considerations for open systems . . . . . .
. . . . . . . . . . . . . . . 7.8.1 Determining the number of paths
to a LUN. . . . . . . . . . . . . . . . . . . . . . . . . . . . .
7.8.2 Dynamic I/O load-balancing: SDD . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 7.8.3 Automatic port queues
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 7.8.4 Determining where to attach the host . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9
Performance and sizing considerations for System z . . . . . . . .
. . . . . . . . . . . . . . . . . 7.9.1 Host connections to System
z servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 7.9.2 Parallel Access Volume . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.3 z/OS
Workload Manager: Dynamic PAV tuning . . . . . . . . . . . . . . .
. . . . . . . . . . 7.9.4 HyperPAV . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 7.9.5 PAV in z/VM environments . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.6
Multiple Allegiance . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 7.9.7 I/O priority
queuing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 7.9.8 Performance considerations
on Extended Distance FICON . . . . . . . . . . . . . . . . 7.9.9
High Performance FICON for z . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 7.10 Performance Improvements
for Epic. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . .
170 170 172 173 174 174 174 175 181 182 182 183 185 188 188 188
188 189 189 190 190 191 193 194 196 197 198 200 201 203
Part 2. Planning and installation . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 205 Chapter 8. DS8870 Physical planning and
installation . . . . . . . . . . . . . . . . . . . . . . . . 8.1
Considerations prior to installation . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 8.1.1 Who should be
involved . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 8.1.2 What information is required . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 8.2 Planning for the physical installation . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.1
Delivery and staging area . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 8.2.2 Floor type and
loading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 8.2.3 Overhead cabling features . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 8.2.4 Room space and service clearance . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 8.2.5 Power
requirements and operating environment . . . . . . . . . . . . . .
. . . . . . . . . . 8.2.6 Host interface and cables . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8.2.7 Host adapter Fiber Channel specifics for Open environments..
. . . . . . . . . . . . . 8.2.8 FICON specifics on zOS environment.
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8.2.9 Best practice for host adapter (HA) cards. . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 8.2.10 WWNN and WWPN
determination . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 8.3 Network connectivity planning. . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8.3.1 Hardware Management Console and network access . . . . . . .
. . . . . . . . . . . . . 8.3.2 IBM Tivoli Storage Productivity
Center . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . 8.3.3 DS command-line interface DSCLI . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 8.3.4 Remote support
connection . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 207 208 209 209 210 210 210 212 213 214 216
217 217 217 218 221 221 222 222 223
viii
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085TOC.fm
8.3.5 Remote power control . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 8.3.6 Storage
Area Network connection . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 8.3.7 Tivoli Key Lifecycle Manager server
for encryption. . . . . . . . . . . . . . . . . . . . . . . 8.3.8
Lightweight Directory Access Protocol server for single sign-on . .
. . . . . . . . . . 8.4 Remote mirror and copy connectivity . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8.5 Disk capacity considerations . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 8.5.1 Disk
sparing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 8.5.2 Disk capacity . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . 8.5.3 DS8000 Solid State Drive
(SSD) considerations . . . . . . . . . . . . . . . . . . . . . . .
. 8.6 Planning for growth . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter
9. DS8870 HMC planning and setup . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 9.1 Hardware Management Console
overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 9.1.1 Storage Hardware Management Console hardware. . . . .
. . . . . . . . . . . . . . . . . 9.1.2 Private Ethernet networks .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 9.2 Hardware Management Console software . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 9.2.1 DS
Storage Manager GUI . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 9.2.2 Command-line interface .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . 9.2.3 DS Open Application Programming Interface . .
. . . . . . . . . . . . . . . . . . . . . . . . . 9.2.4 Web-based
user interface . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . 9.3 HMC activities . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 9.3.1 HMC planning tasks . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 9.3.2 Planning for microcode upgrades . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 9.3.3 Time
synchronization . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 9.3.4 Monitoring DS8870 with
the HMC. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 9.3.5 Call Home and remote support . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.4 HMC and
IPv6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 9.5 HMC user
management . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 9.6 External HMC . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 9.6.1 External HMC benefits . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 9.7 Configuration worksheets . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.8
Configuration flow . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 10.
IBM System Storage DS8000 features and license keys . . . . . . . .
. . . . 10.1 IBM System Storage DS8000 licensed functions . . . . .
. . . . . . . . . . . . . . . . . . . . . . 10.1.1 Licensing
additional content background . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 10.1.2 Licensing cost structure . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
10.2 Activation of licensed functions . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 10.2.1
Obtaining DS8000 machine information . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 10.2.2 Obtaining activation codes . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 10.2.3 Applying activation codes using the GUI. . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 10.2.4 Applying
activation codes using the DS CLI . . . . . . . . . . . . . . . . .
. . . . . . . . . . 10.3 Licensed scope considerations . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 10.3.1 Why you get a choice . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 10.3.2 Using a
feature for which you are not licensed . . . . . . . . . . . . . .
. . . . . . . . . . . 10.3.3 Changing the scope to All . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 10.3.4 Changing the scope from All to FB . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 10.3.5 Applying an
insufficient license feature key . . . . . . . . . . . . . . . . .
. . . . . . . . . . 10.3.6 Calculating how much capacity is used
for CKD or FB. . . . . . . . . . . . . . . . . . .
224 224 225 226 226 226 227 227 229 230 231 232 232 233 234 234
235 235 236 237 237 238 239 239 240 240 242 244 244 245 246 249 250
251 253 255 255 258 262 265 267 267 268 268 269 270 270
Part 3. Storage configuration. . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 273 Chapter 11. Configuration flow . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
275 11.1 Configuration worksheets . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . .
276Contents
ix
8085TOC.fm
Draft Document for Review November 16, 2012 9:25 am
11.2 Configuration flow . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
Chapter 12. Configuring IBM Tivoli Storage Productivity Center 5.1
for DS8000 . . . 12.1 Introducing IBM Tivoli Storage Productivity
Center 5.1. . . . . . . . . . . . . . . . . . . . . . . 12.2 IBM
Tivoli Storage Productivity Center Architecture . . . . . . . . . .
. . . . . . . . . . . . . . . 12.3 Adding a DS8000 storage system
with TPC 5.1 . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 12.4 Exploring DS8870 with TPC 5.1 Web-based GUI . . . . . . . .
. . . . . . . . . . . . . . . . . . . Chapter 13. Configuration
using the DS Storage Manager GUI . . . . . . . . . . . . . . . . .
13.1 DS Storage Manager GUI overview . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 13.1.1 Accessing the DS
GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . 13.1.2 DS GUI Overview window. . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
13.2 User management using the DS GUI . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 13.3 Logical
configuration process . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 13.4 Examples of configuring
DS8000 storage . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 13.4.1 Defining a storage complex . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.2
Creating arrays . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 13.4.3 Creating
ranks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 13.4.4 Creating Extent Pools
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 13.4.5 Configuring I/O ports . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . 13.4.6 Configuring logical host systems. . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 13.4.7 Creating
fixed block volumes . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . 13.4.8 Creating volume groups . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 13.4.9 Creating LCUs and CKD volumes. . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 13.4.10 Additional
actions on LCUs and CKD volumes . . . . . . . . . . . . . . . . . .
. . . . . . 13.5 Other DS GUl functions. . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
13.5.1 Easy Tier . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.5.2
I/O Priority Manager . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 13.5.3 Checking the
status of the DS8000 . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 13.5.4 Exploring the DS8000 hardware . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Chapter 14. Configuration with the DS Command-Line Interface . . .
. . . . . . . . . . . . 14.1 DS Command-Line Interface overview . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
14.1.1 Supported operating systems for the DS CLI . . . . . . . . .
. . . . . . . . . . . . . . . . . 14.1.2 User accounts . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 14.1.3 User management using the DS CLI . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.4 DS
CLI profile . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . 14.1.5 Configuring DS
CLI to use a second HMC . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 14.1.6 Command structure . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.7
Using the DS CLI application . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 14.1.8 Return codes. . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 14.1.9 User assistance . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 14.2 Configuring the I/O ports . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
14.3 Configuring the DS8000 storage for FB volumes . . . . . . . .
. . . . . . . . . . . . . . . . . . . 14.3.1 Creating arrays . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 14.3.2 Creating ranks. . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 14.3.3 Creating Extent Pools . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.4
Creating FB volumes . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 14.3.5 Creating volume
groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . 14.3.6 Creating host connections . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 14.3.7 Mapping open systems host disks to storage unit volumes .
. . . . . . . . . . . . . . 14.4 Configuring DS8000 storage for CKD
volumes. . . . . . . . . . . . . . . . . . . . . . . . . . . . .
14.4.1 Create arrays . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.2 Ranks
and Extent Pool creation . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . xIBM System Storage DS8870
Architecture and Implementation
279 280 280 282 287 293 294 294 298 301 305 306 306 309 314 317
322 323 328 332 337 343 345 345 346 347 349 353 354 354 355 355 357
359 360 360 363 363 365 366 366 367 367 370 375 377 379 381 381
381
Draft Document for Review November 16, 2012 9:25 am
8085TOC.fm
14.4.3 Logical control unit creation . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 14.4.4 Creating
CKD volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 14.4.5 Resource Groups . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 14.4.6 Performance I/O Priority Manager . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.7 Easy
Tier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 14.5 Metrics with DS
CLI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 14.6 Private network security
commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . 14.7 Copy Services commands . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
383 384 390 390 390 390 394 395
Part 4. Maintenance and upgrades . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 397 Chapter 15. Licensed machine code . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 15.1 How new
microcode is released . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 15.2 Bundle installation . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 15.3 Concurrent and non-concurrent
updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . 15.4 Code updates . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
15.5 Host adapter firmware updates . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 15.6 Loading the
code bundle . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 15.7 Post-installation
activities . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 15.8 Summary . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . Chapter 16. Monitoring with Simple
Network Management Protocol . . . . . . . . . . . . 16.1 Simple
Network Management Protocol overview . . . . . . . . . . . . . . .
. . . . . . . . . . . . 16.1.1 SNMP agent . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . 16.1.2 SNMP manager . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.3 SNMP
trap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . 16.1.4 SNMP
communication. . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 16.1.5 SNMP Requirements . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 16.1.6 Generic SNMP security. . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.7
Message Information Base . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 16.1.8 SNMP trap request . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 16.1.9 DS8000 SNMP configuration . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2
SNMP notifications . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 16.2.1
Serviceable event using specific trap 3. . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 16.2.2 Copy Services event traps
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 16.2.3 I/O Priority Manager SNMP. . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2.4 Thin
Provisioning SNMP . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . 16.3 SNMP configuration . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 16.3.1 SNMP preparation . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
16.3.2 SNMP configuration from the HMC. . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 16.3.3 SNMP configuration
with the DS CLI . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . Chapter 17. Remote support . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.1
Introduction to remote support . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 17.1.1 Suggested
reading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . 17.1.2 Organization of this chapter
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 17.1.3 Terminology and definitions . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.2 IBM
policies for remote support . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 17.3 VPN rationale and
advantages . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 17.4 Remote connection types . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . 17.4.1 Asynchronous modem . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . 17.4.2 IP
network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 17.4.3 IP network
with traditional VPN. . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . 17.4.4 AOS . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . .Contents
399 400 402 404 404 405 406 406 406 407 408 408 409 409 409 410
410 411 411 411 412 412 412 419 420 421 421 421 424 425 426 426 426
427 428 428 429 429 431 432 432 xi
8085TOC.fm
Draft Document for Review November 16, 2012 9:25 am
17.5 DS8870 support tasks . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.5.1
Call Home and heartbeat (outbound) . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . 17.5.2 Data offload (outbound) . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 17.5.3 Code download (inbound) . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.5.4
Remote support (inbound and two-way) . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . 17.6 Remote connection scenarios . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . 17.6.1 No connections . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
17.6.2 Modem only . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 17.6.3 VPN only
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 17.6.4 Modem and network
with no VPN. . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . 17.6.5 Modem and traditional VPN . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7
ASSIST ON-SITE . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . 17.7.1 AOS
components . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . 17.7.2 AOS Security . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . 17.7.3 Support Session modes . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
17.7.4 Port Forwarding and AOS Gateway for the DS8870. . . . . . .
. . . . . . . . . . . . . . 17.7.5 AOS Best Practices for DS8870 .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. 17.7.6 AOS with VPN vs Modem . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . 17.8 Further Remote
Support Enhancements . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . 17.9 Audit logging . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . Chapter 18. DS8870 Capacity upgrades and CoD . . . .
. . . . . . . . . . . . . . . . . . . . . . . . 18.1 Installing
capacity upgrades . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . 18.1.1 Installation order of
upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . 18.1.2 Checking how much total capacity is
installed . . . . . . . . . . . . . . . . . . . . . . . . . 18.2
Using Capacity on Demand (CoD) . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . 18.2.1 What is Capacity on
Demand . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . 18.2.2 Determining if a DS8870 has CoD disks. . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 18.2.3 Using
the CoD storage . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . Appendix A. Tools and service
offerings . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . Planning and administration tools . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Capacity Magic . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disk
Magic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . Storage Tier
Advisor Tool . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . IBM Tivoli Storage
FlashCopy Manager . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . IBM Service offerings . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . IBM Global Technology Services: Service offerings . .
. . . . . . . . . . . . . . . . . . . . . . . . . IBM STG Lab
Services: Service offerings. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . .
432 433 433 436 437 437 437 438 439 439 440 441 442 443 444 445
447 453 454 457 459 460 461 462 464 464 464 469 471 472 472 474 476
479 480 480 480
Abbreviations and acronyms . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . 483 Related
publications . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . IBM Redbooks
publications . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . Other publications . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . Online resources . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . How to get IBM Redbooks publications
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . Help from IBM . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . 487 487 488 488 488 489
xii
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085pref.fm
PrefaceThis IBM Redbooks publication describes the concepts,
architecture, and implementation of the IBM System Storage DS8870
storage system. The book provides reference information to assist
readers who need to plan for, install, and configure the DS8870.
The IBM System Storage DS8870 is the most advanced model in the IBM
DS8000 lineup and is equipped with IBM POWER7 based controllers.
Various configuration options are available that scale from dual
2-core systems up to dual 16-core systems with up to 1 TB of cache.
The DS8870 also features enhanced 8 Gpbs device adapters and host
adapters. Connectivity options, with up to 128 Fibre Channel/FICON
ports for host connections, make the DS8870 suitable for multiple
server environments in both open systems and IBM System z
environments. The DS8870 supports advanced disaster recovery
solutions and business continuity solutions and also supports thin
provisioning. All disk drives in the DS8870 storage system have the
Full Disk Encryption (FDE) feature. If desired, the DS8870 can be
integrated in an LDAP infrastructure. The DS8870 is equipped with
high-density storage enclosures populated with 24 small-formfactor
SAS-2 drives or storage enclosures for 12 large-form-factor
nearline SAS drives. The DS8870 storage subsystems can also be
equipped with Solid-State Drives (SSDs). The DS8870 can
automatically optimize the use of each storage tier, particularly
SSD drives through the IBM Easy Tier feature, which is available
for no extra fee. For details about Easy Tier, refer to IBM System
Storage DS8000: Easy Tier Concepts and Usage, REDP-4667. Host
attachment and interoperability topics for the DS8000 series
including are now covered in IBM System Storage DS8000: Host
Attachment and Interoperability, SG24-8887. For information related
to specific features, refer to IBM System Storage DS8000: Easy Tier
Concepts and Usage, REDP-4667, IBM System Storage DS8000: Priority
Manager, REDP-4760, IBM System Storage DS8000: Copy Services
Resource Groups, REDP-4758, IBM System Storage DS8700 Disk
Encryption Implementation and Usage Guidelines, REDP-4500, and IBM
System Storage DS8000: LDAP Authentication, REDP-4505. To read
about DS8000 Copy Services functions, refer to IBM System Storage
DS8000: Copy Services for Open Environments, SG24-6788, and IBM
System Storage DS8000: Copy Services for IBM System z,
SG24-6787.
Copyright IBM Corp. 2012. All rights reserved.
xiii
8085pref.fm
Draft Document for Review November 16, 2012 9:25 am
The team who wrote this bookThis book was produced by a team of
specialists from around the world working for the International
Technical Support Organization (ITSO), at the European Storage
Competence Center (ESCC) in San Jose. Bertrand Dufrasne is an IBM
Certified IT Specialist and Project Leader for System Storage disk
products at the International Technical Support Organization, San
Jose Center. He has worked at IBM in various IT areas. He has
written many IBM Redbooks publications and has also developed and
taught technical workshops. Before joining the ITSO, he worked for
IBM Global Services as an Application Architect. He holds a Masters
degree in Electrical Engineering. Pere Alcaide joined IBM in 1996
and is working as a Support Center Representative after a long
experience as a Sales Support Representative. He holds a degree in
Technical Telecommunications Engineering from the Universitat
Politcnica de Catalunya, Barcelona. Since 2005 his main focus has
been IBM DS8000 Family Series hardware. Collaborations with the IBM
testing team and DS8K DA Development team are part of his
experience. Peter Kimmel is an IT Specialist and ATS team lead of
the Enterprise Disk Solutions team at the European Storage
Competence Center (ESCC) in Mainz, Germany. He joined IBM Storage
in 1999 and since then worked with all the various ESS (Enterprise
Storage Server) and System Storage DS8000 generations, with a focus
on architecture and performance. He has co-authored several DS8000
IBM Redbooks publications. Peter holds a Diploma (MSc) degree in
Physics from the University of Kaiserslautern. lstvan Paloczi is a
Test Engineer working for the DS8000 manufacturing in Vac, Hungary.
He has three years of experience in high-end disk testing, test
process optimization, and new product implementation. He holds a
degree in Electrical Engineering, with a specialization in
Telecommunication, from the University of Pecs, Hungary. His focus
is hardware and software qualification for all the supported DS8000
releases in the manufacturing environment. Akin Sakarcan is working
as a Storage CTS (Client Technical Specialist) for Systems &
Technology Group in IBM Turkey. He has 10 years of experience in
the server/storage field. He has been working at IBM for 3 years as
the subject matter expert and systems software blackbelt for IBM
storage solutions. His areas of expertise include planning, design
and analysis of IBM storage solutions. lRoland Wolf is a Certified
IT Specialist in Germany. He has worked at IBM for 26 years and has
extensive experience with high-end disk-storage hardware in System
z and Open Systems. He works in Technical Sales Support and his
areas of expertise include performance analysis and disaster
recovery solutions in enterprises using the unique capabilities and
features of the IBM disk storage servers, DS8000, and IBM XIV. He
has contributed to various IBM Redbooks publications including,
ESS, DS8000 Architecture, and DS8000 Copy Services. He holds a
Ph.D. in Theoretical Physics.
xiv
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085pref.fm
Many thanks to the following people who helped with equipment
provisioning and preparation: Mike Schneider, Dietmar Schniering,
Gnter Schmitt, Uwe Heinrich Mller, Uwe Schweikhard, Jrg Zahn,
Hans-Joachim Sachs, Edwin Weinheimer, Roland Beisele, Stephan
Schorn, Stephan Weyrich, Seven Bittlingmayer IBM Systems Lab
Europe, Mainz, Germany Special thanks to the Enterprise Disk team
manager, Bernd Mller, and the ESCC director, Klaus-Jrgen Rnger, for
their continuous interest and support regarding the ITSO Redbooks
projects. Thanks to the following people for their contributions to
this project: John Bynum, Allen Wright, John Cherbini, Allen Marin,
Stephen Manthorpe, Craig Gordon, John Elliott, Brian Rinaldi, Dale
H Anderson, Chip Jarvis, Jared Minch, Jeff Steffan, David
Whitworth. Kavita Shah, Jason Piepelman, Thomas Fiege, Bjoern
Wesselbaum, Hubertus Wegel, Volker Kiemes, Juan Brandenburg, Kai
Jehnen IBM
Now you can become a published author, too!Here's an opportunity
to spotlight your skills, grow your career, and become a published
authorall at the same time! Join an ITSO residency project and help
write a book in your area of expertise, while honing your
experience using leading-edge technologies. Your efforts will help
to increase product acceptance and customer satisfaction, as you
expand your network of technical contacts and relationships.
Residencies run from two to six weeks in length, and you can
participate either in person or as a remote resident working from
your home base. Find out more about the residency program, browse
the residency index, and apply online at:
ibm.com/redbooks/residencies.html
Comments welcomeYour comments are important to us! We want our
books to be as helpful as possible. Send us your comments about
this book or other IBM Redbooks publications in one of the
following ways: Use the online Contact us review Redbooks form
found at: ibm.com/redbooks Send your comments in an email to:
[email protected] Mail your comments to: IBM Corporation,
International Technical Support Organization Dept. HYTD Mail
Station P099 2455 South Road Poughkeepsie, NY 12601-5400
Preface
xv
8085pref.fm
Draft Document for Review November 16, 2012 9:25 am
Stay connected to IBM RedbooksFind us on Facebook:
http://www.facebook.com/IBMRedbooks Follow us on Twitter:
http://twitter.com/ibmredbooks Look for us on LinkedIn:
http://www.linkedin.com/groups?home=&gid=2130806 Explore new
Redbooks publications, residencies, and workshops with the IBM
Redbooks weekly newsletter:
https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay
current on recent Redbooks publications with RSS Feeds:
http://www.redbooks.ibm.com/rss.html
xvi
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085p01.fm
Part 1
Part
1
Concepts and architectureThis part gives an overview of the IBM
System Storage DS8000 concepts and architecture. The topics covered
include: Introduction to the IBM System Storage DS8870, the latest
member of the DS8000 series Overview of the IBM System Storage
DS8870 models Detailed information about the DS8870 hardware
components and architecture Presentation of the RAS features of the
IBM System Storage DS8870 A review of the DS8000 virtualization
concepts An overview of the IBM System Storage DS8000 Copy Services
A discussion of the DS8870 performance features.
Copyright IBM Corp. 2012. All rights reserved.
1
8085p01.fm
Draft Document for Review November 16, 2012 9:25 am
2
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085ch_Introduction.fm
1
Chapter 1.
Introduction to the IBM System Storage DS8870This chapter
introduces the features and functions of the IBM System Storage
DS8000 series and its newest member, the DS8870 storage system.
More detailed information about functions and features is provided
in subsequent chapters. The topics presented here are: The
advantages of a POWER7 based storage system DS8870 architecture and
functions overview Performance features Previous models like the
DS8700 and DS8800 are described in the IBM Redbooks publication,
IBM System Storage DS8000 Architecture and Implementation,
SG24-8886.
Copyright IBM Corp. 2012. All rights reserved.
3
8085ch_Introduction.fm
Draft Document for Review November 16, 2012 9:25 am
1.1 Introduction to the DS8870IBM has a wide range of product
offerings based on open standards and share a common set of tools,
interfaces, and innovative features. The System Storage DS8000
family is designed as a high performance, high capacity, and
resilient series of disk storage systems. The DS8870 offers high
availability, multiplatform support including System z, and
simplified management tools to help provide a cost-effective path
to an on-demand world. Customers expect from a high end storage
subsystem that it is: High performance Highly available Cost
efficient Energy efficient Scalable Has Business Continuity and
Data Protection functions The DS8870 (Figure 1-1 on page 5) is IBMs
fifth-generation high-end disk system in the DS8000 series. It is
designed to support the most demanding business applications with
its exceptional all-around performance and data throughput. The
DS8000 architecture is server based. Powerful POWER7 servers manage
the cache to minimize disk I/Os to maximize performance and
throughput. Combined with the world-class business resiliency and
encryption features, the storage server, provides a unique
combination of high availability, performance, and security. The
DS8870 is equipped with encryption capable disk drives or SSDs. You
just need to pair it with an IBM Tivoli Key Lifecycle Manager
(TKLM) to encrypt data on the DS8870. The DS8870 is tremendously
scalable, has broad server support, and virtualization
capabilities. These features can help simplify the storage
environment by consolidating multiple storage systems. High density
storage enclosures offer a considerable reduction in footprint and
energy consumption. A new power supply system based on direct
current uninterruptible power supply DC-UPS is much more
energy-efficient than the Power Distribution System of previous
models making the DS8870 the most energy-efficient model in the
DS8000 series. The DS8870 is designed to comply with the emerging
ENERGY STAR specifications. ENERGY STAR is a joint program of the
U.S. Environmental Protection Agency and the U.S. Department of
Energy helping us all to save money and protect the environment
through energy efficient products and practices (see
http://www.energystar.gov).
4
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085ch_Introduction.fm
Figure 1-1 DS8870 Base Frame
1.1.1 Features of the DS8870The DS8870 offers the following
features: Storage virtualization offered by the DS8000 series
allows organizations to allocate system resources more effectively
and better control application quality of service. The DS8000
series improves the cost structure of operations and lowers energy
consumption through a tiered storage environment. The DS8870 is
available with different processor options ranging from dual 2-core
systems up to dual 16-cores covering a wide range of performance
needs. The DS8870 supports a broad range of disk drives starting
from very fast 400 GB SSDs, fast 146 GB 15K RPM SAS disk drives, to
high-capacity nearline-SAS 3 TB drives. Cache configurations are
available that range from 16 GB up to 1 TB cache. The server
architecture of the DS8870 with its powerful POWER7 processors
makes it possible to manage large caches with small cache segments
of 4 KB (and hence large segment tables) without the need to
partition the cache. The POWER7 processors have enough power to
implement sophisticated caching algorithms. These algorithms and
the small cache segment size optimize cache hits. Therefore the
DS8870 provides excellent I/O response times. Write data is always
protected by maintaining a copy of write-data in Non-volatile
Storage until the data is destaged to disks. Adaptive Multi-stream
Prefetching (AMP) caching algorithm can dramatically improve
sequential performance, thereby reducing times for backup,
processing for business intelligence, and streaming media.
Sequential Adaptive Replacement Cache is a caching algorithm that
allows you to run different workloads like sequential and random
workloads without negatively impacting each other. For example,
sequential workload does not fill upChapter 1. Introduction to the
IBM System Storage DS8870
5
8085ch_Introduction.fm
Draft Document for Review November 16, 2012 9:25 am
the cache and does not impact cache hits for random workload.
Intelligent Write Caching (IWC) improves the Cache Algorithm for
random writes. IBM proves the performance of its storage systems by
publishing standardized benchmark results. See
http://www.storageperformance.org for benchmark results of the
DS8870. 8 Gbps host adapters (HAs): The DS8870 model offers
enhanced connectivity with 4 and 8-port Fibre Channel/FICON host
adapters located in the I/O enclosures that are directly connected
to the internal processor complexes. The 8 Gbps Fibre Channel/FICON
host adapter also supports FICON attachment to IBM System zEC12,
IBM zEnterprise 196 (z196), IBM System z114, and IBM System z10.
Each port can be configured by the user to operate as a Fibre
Channel Port, a FICON port or a Fibre Channel port used for
mirroring. High Performance FICON for System z (zHPF): zHPF is
z/OSs new I/O architecture. Step by step z/OSs access methods have
been converted to use the new I/O commands. zHPF is an optional
feature of the DS8870. The DS8870 is at the most up-to-date support
level for zHPF. Recent enhancements to zHPF include Extended
Distance capability, zHPF List Pre-fetch support for IBM DB2 and
utility operations, and zHPF support for sequential access methods.
All DB2 I/O is now zHPF capable. Peripheral Component Interconnect
Express (PCI Express Generation 2) I/O enclosures: To improve I/O
Operations Per Second (IOPS) and sequential read/write throughput,
the I/O enclosures are directly connected to the internal servers
with point-to-point PCI Express cables. Storage Pool Striping
(rotate extents) provides a mechanism to distribute a volumes or
LUNs data across many RAID arrays and hence across many disk
drives. Storage Pool Striping helps maximize performance without
special tuning and greatly reduces hot spots in arrays. Easy Tier:
This free of charge feature enables automatic dynamic data
relocation capabilities. Data areas that are accessed frequently
are moved to higher tier disks, for example to SSDs while
infrequently accessed data areas are moved to lower tiers, for
example nearline-SAS drives. Easy Tier optimizes the usage of each
tier, especially the utilization of SSDs. It supports a combination
of three classes or storage tiers (nearline, Solid State Drives,
and Enterprise Disks). No manual tuning is required. Configuration
flexibility and overall storage cost-performance can greatly
benefit from the exploitation of this feature. The auto-balancing
algorithms also provide benefits when homogeneous disk pools are
used to eliminate hot spots on disk arrays. Easy Tier also allows
several manual data relocation capabilities (extent pools merge,
rank depopulation, volume migration). Easy Tier can also be used
when encryption support is turned on. Please refer to the Chapter
7.7, IBM Easy Tier on page 183 for more information. Storage Tier
Advisor Tool: This tool is used in conjunction with the Easy Tier
facility to help clients understand their current disk system
workloads and provides guidance on how much of their existing data
would be better suited for the various drive types (Spinning disk
or Solid-State Drives). I/O Priority Manager: This is an optional
feature that provides application-level Quality of Service (QoS)
for workloads that share a storage pool. This feature provides a
way to manage quality of service for I/O operations associated with
critical workloads and gives them priority over other I/O
operations associated with non-critical workloads. For z/OS the I/O
Priority Manager allows increased interaction with the host side.
Refer to Chapter 1.4.4, Performance for System z on page 20 and
Chapter 7.6, I/O Priority Manager on page 181 for more
information.
6
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085ch_Introduction.fm
Large volume support: The DS8870 supports LUN sizes up to 16 TB.
This helps to simplify storage management tasks. In a z/OS
environment Extended Address Volumes (EAVs) with sizes up to 1 TB
are supported. Active Volume Protection: This is a feature that
prevents the deletion of volumes still in use. T10 DIF support. The
Data Integrity Field standard of SCSI T10 enables end-to-end data
protection from the application or host HBA down to the disk
drives. The DS8870 supports the T10 DIF standard. The Dynamic
Volume Expansion simplifies management by enabling easier, online
volume expansion (for Open Systems and System z) to support
application data growth, and to support data center migration and
consolidation to larger volumes to ease addressing constraints.
Thin Provisioning: This feature allows the creation of
over-provisioned devices for more efficient usage of the storage
capacity for Open Systems. Copy Services is now available for Thin
Provisioning. Refer to Chapter 6, IBM System Storage DS8000 Copy
Services overview on page 133 for further information. Quick
Initialization: This feature provides very fast volume
initialization (for Open Systems LUNs and CKD volumes) and
therefore allows the creation of devices, making them available as
soon as the command completes. The Full Disk Encryption (FDE) can
protect business-sensitive data by providing disk-based hardware
encryption combined with a sophisticated key management software
(IBM Tivoli Key Lifecycle Manager). The Full Disk Encryption is
available for all disk and drives, including SSDs. Since encryption
is done by the disk drive it is completely transparent to host
systems and can be used in any environment including z/OS. To find
out more about this feature refer to IBM System Storage DS8700 Disk
Encryption Implementation and Usage Guidelines, REDP-4500. Disk
encryption key management that helps address Payment Card Industry
Data Security Standard (PCI-DSS) requirements: Encryption deadlock
recovery key option: When enabled, this option allows the user to
restore access to a DS8000 when the encryption key for the storage
is unavailable due to an encryption deadlock scenario. Dual
platform key server support: This is important if key servers on
z/OS share keys with key servers on Open Systems. The DS8000
requires an isolated key server in encryption configurations. The
isolated key server currently defined is an IBM System x server.
Dual platform key server support allows two server platforms to
host the key manager with either platform operating in either clear
key or secure key mode. Recovery key Enabling/Disabling and Rekey
data key option for the Full Disk Encryption (FDE) feature: Both of
these enhancements can help clients satisfy Payment Card Industry
(PCI) security standards Resource Groups: This feature is a
policy-based resource scope limiting function that enables the
secure use of Copy Services functions by multiple users on a DS8000
series storage subsystem. Resource Groups are used to define an
aggregation of resources and policies for configuration and
management of those resources. The scope of the aggregated
resources can be tailored to meet each hosted customers Copy
Services requirements for any given operating system platform
supported by the DS8000 series. Refer to IBM System Storage DS8000
Resource Groups, REDP-4758 for more information. FlashCopy:
FlashCopy is an optional feature that allows the creation of volume
copies (and dataset copies for z/OS) nearly instantaneously.
Different options are available to create full copies, incremental
copies or copy-on-write copies. The concept of Consistency
Chapter 1. Introduction to the IBM System Storage DS8870
7
8085ch_Introduction.fm
Draft Document for Review November 16, 2012 9:25 am
Groups provide a means to copy several volumes consistently even
across several DS8000 systems. FlashCopy can be used to do backup
operations parallel to production or to create test systems.
FlashCopy can be managed with the help of IBMs FlashCopy Manager
product from within certain applications like DB2, Oracle, SAP, or
Microsoft Exchange. FlashCopy is also supported by z/OS backup
functions like DFSMS and DB2 BACKUP SYSTEM. The IBM FlashCopy SE
capability enables more space efficient utilization of capacity for
copies, enabling improved cost effectiveness. Remote Mirroring
options: The DS8870 provides the same remote mirroring options as
previous models of the DS8000 family. Synchronous remote mirroring
(Metro Mirror) is supported up to 300 km. Asynchronous copy (Global
Mirror) is supported for unlimited distances. Three-site options
are available by combining Metro Mirror and Global Mirror. In
co-operation with z/OSs Data Mover another option is available for
z/OS: Global Mirror for z/OS. Another important feature for z/OS
Global Mirror (2-site) and z/OS Metro/Global Mirror (3-site) is
Extended Distance FICON, which can help reduce the need for channel
extenders configurations by increasing the number of read commands
in flight. Metro Mirror, Global Copy, Global Mirror, Metro/Global
Mirror, z/OS Global Mirror, and z/OS Metro/Global Mirror business
continuity solutions are designed to provide the advanced
functionality and flexibility needed to tailor a business
continuity environment for almost any recovery point or recovery
time objective. The Copy Services can be managed and automated with
IBM Tivoli Storage Productivity Center for Replication (TPC-R). For
z/OS environments, IBMs GDPS provides an automated disaster
recovery solution. Remote Pair FlashCopy: Allows you to establish a
FlashCopy relationship where the target is a remote mirror Metro
Mirror primary volume keeping the pair in the full duplex state.
The DS8870 provides an improved DS GUI management interface to
configure the DS8870 or query status information. The DS8870 DS GUI
has the same look-and-feel as the GUIs of other IBM storage
products making it easier for a storage administrator to work with
different IBM storage products. Consult Chapter 13, Configuration
using the DS Storage Manager GUI on page 295 for additional
information. LDAP authentication support, which allows single
sign-on functionality, can simplify user management by allowing
both the DS8000 to rely on a centralized LDAP directory rather than
a local user repository. Refer to IBM System Storage DS8000: LDAP
Authentication, REDP-4505 for more information The DS8000 series
has been certified as meeting the requirements of the IPv6 Read
Logo program, indicating its implementation of IPv6 mandatory core
protocols and the ability to interoperate with other IPv6
implementations. The IBM DS8000 can be configured in native IPv6
environments. The logo program provides conformance and
interoperability test specifications based on open standards to
support IPv6 deployment globally. Furthermore, the US National
Institute of Standards and Technology has tested IPv6 with the
DS8000 thus granting it support form the USGV6 profile and testing
program.
8
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085ch_Introduction.fm
1.2 The DS8870 controller options and framesThe IBM System
Storage DS8870 adds Models 961 (base frame) and 96E (expansion
unit) to the 242x machine type family. Compared with its
predecessors, IBM System Storage DS8100, DS8300, DS8700, and
DS8800, the DS8870 is designed to provide capabilities for the
combination of price and efficiency. The DS8870 features: IBM
POWER7 processor technology: The DS8870 features the IBM POWER7
server technology for high performance. Compared to the POWER6
processor in the DS8800, the POWER7 processor can deliver up to
three times more throughput in I/O operations per second (IOPS) in
transaction processing workload environments. The DS8870 utilizes
the simultaneous multithreading (SMT) capabilities of the POWER7
architecture. Additionally, sequential workloads can receive as
much as 60% bandwidth improvement. The DS8700 offers either a dual
2-core processor complex, a dual 4-core processor complex, a dual
8-core processor complex, and a dual 16-core processor complex. A
non-disruptive upgrade path for the DS8870 configurations and
additional Model 96E expansion frames allows processor, cache, and
storage enhancement to be performed concurrently, that is without
disrupting applications. The air-flow system allows optimal
horizontal cool down of the storage system. The DS8870 is designed
for hot and cold aisle data center design, drawing air for cooling
from the front of the system and exhausting hot air at the rear.
Refer to Chapter 3.5, Power and cooling on page 53 for additional
information. Improved configuration options The DS8870 also
provides a Business Class configuration option. The Business Class
option offers an entry level configuration cost. The Business Class
model can be upgraded nondisruptively to a standard configuration.
High density storage enclosures The DS8870 provides storage
enclosure support for 24 small form factor (SFF, 2.5-inch) drives
in 2U of rack space. This option helps improve the storage density
for disk drive modules (DDMs) as compared to previous enclosures.
Improved high-density frame design The DS8870 can support a total
of 1536 drives in a small footprint (three frames) supporting high
density and helping to preserve valuable raised floor space in data
center environments. Coupled with this improved cooling
implementation and small form factor SAS-2.0 Enterprise drives, a
fully configured DS8870 consumes up to 20% less power than its
predecessor model DS8800. The DS8870 base frame supports up to 240
drives, with the first expansion frame supporting up to 576 drives,
the second expansion frame supporting up to 1,056 drives and the
third expansion supporting up to 1536 drives in the size of 2.5?.
As an alternative, the DS8870 also supports 3.5? disk drives with
up to 120 drives with the base frame, with the first expansion
frame supporting up to 288 drives, the second expansion frame
supporting 528 drives, and the third expansion frame supporting 768
drives in the size of 3.5?.
Chapter 1. Introduction to the IBM System Storage DS8870
9
8085ch_Introduction.fm
Draft Document for Review November 16, 2012 9:25 am
1.3 DS8870 architecture and functions overviewFrom an
architectural point of view, the DS8870 offers continuity with
respect to the fundamental architecture of their predecessors the
DS8100, DS8300, DS8700, and DS8800 models. This ensures that the
DS8870 can use a stable and well-proven operating environment,
offering optimal availability. The hardware is optimized to provide
higher performance, connectivity, and reliability.
1.3.1 Overall architecture and componentsThe DS8870 is available
with separate configurations, which are discussed in detail in
Chapter 2, IBM System Storage DS8870 models on page 23.
IBM POWER 7 processor technologyThe DS8870 uses IBM POWER7
processor technology. The POWER7 processor chip is fabricated using
the IBM 45 nm Silicon-On-Insulator (SOI) technology using copper
interconnect and implements an on-chip L3 cache using eDRAM. The
DS8870s P7 processor runs at 3.55 GHz. An enhancement with the
POWER7 processor is the addition of the Simultaneous
Multi-Threading SMT4 mode. SMT4 enables four instruction threads to
execute simultaneously in each POWER7 processor core. It maximizes
the throughput of the processor core by offering an increase in
core efficiency. These multithreading capabilities help to improve
the I/O throughput of the DS8870 storage server. The DS8870 offers
either a dual 2-core processor complex, a dual 4-core processor
complex, a dual 8-core processor complex, or a dual 16-core
processor complex. A processor complex is also referred to as a
storage server or Central Electronics Complex (CEC). For more
information, see Chapter 4, RAS on IBM System Storage DS8870 on
page 59.
Internal PCIe-based fabricThe DS8870 uses direct point-to-point
high-speed PCI Express (PCIe) connections to the I/O enclosures to
communicate with the device adaptors and host adapters. Each single
PCIe connection operates at a speed of 2 GBps in each direction.
There are up to 16 PCIe connections from the processor complexes to
the I/O enclosures. For more information, see Chapter 3, DS8870
hardware components and architecture on page 33.
Device adaptersThe DS8870 offers4-port Fibre Channel Arbitrated
Loop (FC-AL) Device Adapters (DA). All adapters provide improved
IOPS, throughput, and scalability over previous DS8000s. They are
optimized for SSD technology and architected for long-term support
for scalability growth. These capabilities complement the POWER
server family to provide significant performance enhancements
allowing up to a 400% improvement in performance over previous
generations (DS8700). For more information, see Chapter 3, DS8870
hardware components and architecture on page 33.
Switched Fibre Channel arbitrated loopThe DS8870 uses a switched
Fibre Channel arbitrated loop (FC-AL) architecture as the backend
for its disk interconnection. The DAs connect to the controller
cards in the storage enclosures using FC-AL with optical short wave
multi-mode interconnection. The Fibre Channel Interface Controller
cards (FCIC) offer a point-to-point connection to each drive and
device adapter, so that there are four paths available from the
DS8000 processor complexes
10
IBM System Storage DS8870 Architecture and Implementation
Draft Document for Review November 16, 2012 9:25 am
8085ch_Introduction.fm
to each disk drive. For more information, see Chapter 3, DS8870
hardware components and architecture on page 33.
Disk drivesThe DS8870 offers a variety of disk drives to meet
the requirements of various workload and configurations. For more
information, see Chapter 8, DS8870 Physical planning and
installation on page 207. 146, and 300 GB (15K RPM) Enterprise disk
drives can be installed in the DS8870 if high performance is
required. The DS8870 also supports 600 GB, and 900 GB (10K RPM)
disk drives for standard performance requirements. Additionally, 3
TB (7200K RPM) Nearline-SAS disk drives are supported for large
capacity requirements. The DS8870 also supports 400 GB Solid-State
Drives (SSDs) for highest performance demands. All drives in the
DS8870 are now Full Disk Encryption (FDE) capable drives. You do
not need to use encryption, but if you want to encrypt your data
you need at least two key servers like the Tivoli Key Lifecycle
Manager or IBM Security Key Lifecycle Manager for z/OS. Solid-State
Drives are the best choice for I/O-intensive workloads. They
provide up to 100 times the throughput and 10 times lower response
time than 15K rpm spinning disks. They also consume less power than
traditional spinning disks. For more information, see Chapter 8,
DS8870 Physical planning and installation on page 207.
Easy TierEasy Tier enables the DS8870 to automatically balance
I/O access to disk drives to avoid hot spots on disk arrays. Easy
Tier can place data in the storage tier that best suits the access
frequency of the data. Highly-accessed data can be moved
nondisruptively to a higher tier, for example to SSD disks while
cold data or data that is primarily accessed sequentially can be
moved to a lower tier, for example to Nearline disks. However, Easy
Tie