software.fujitsu.comsoftware.fujitsu.com/jp/manual/manualfiles/m170002/j2s21591/04enz... · Preface This manual describes the setting up and managing of GDS (Global Disk Services)

J2S2-1591-04ENZ0(03)April 2017

Oracle Solaris

FUJITSU SoftwarePRIMECLUSTERGlobal Disk Services

Configuration and AdministrationGuide 4.3

PrefaceThis manual describes the setting up and managing of GDS (Global Disk Services) and GDS Snapshot, an optional product of GDS,discussing the supported functions.

Purpose

This manual aims to help users understand GDS and GDS Snapshot, including environment configuration, operation and maintenance.

Target Reader

This manual is devoted to all users who will operate and manage GDS and GDS Snapshot and programmers who will create applicationsrunning in GDS environments.

Organization

This manual consists as follows:

"YES" in the Operator or Administrator column indicates who would benefit from reading that portion.

Headers Contents Operator Administrator

Chapter 1Functions

Explains the features of GDS and GDS Snapshot. YES YES

Chapter 2Objects

Explains the objects used by GDS and GDSSnapshot.

YES YES

Chapter 3Starting and Exiting GDSManagement View

Explains how to start and exit GDS Managementand the required browser environment.

YES YES

Chapter 4Management View ScreenElements

Explains the contents of Management View. YES YES

Chapter 5Operation

Explains the details about GDS operation such asoperation flow, settings, maintenance andmanagement.

YES YES

Chapter 6Backing Up and Restoring

Explains how to back up and restore data on disksmanaged by GDS.

YES YES

Chapter 7How to Set and CancelSystem Disk MirroringUsing Commands

Explains how to set and cancel a system disk usingcommands.

- YES

Appendix AGeneral Notes

Explains guidelines, general precautions, andconfiguration tips necessary for using GDS.

- YES

Appendix BLog Viewing with Web-Based Admin View

For details, see the supplementary "Web-BasedAdmin View Operation Guide."

- YES

Appendix CWeb-Based Admin ViewOperating EnvironmentSetting

For details, see the supplementary "Web-BasedAdmin View Operation Guide."

YES YES

Appendix DCommand Reference

Explains the commands available in GDS andGDS Snapshot.

- YES

- i -

Headers Contents Operator Administrator

Appendix EGDS Messages

Explains the contents, possible causes, andresolutions for GDS messages that appear whensetting or operating GDS and GDS Snapshot.

YES YES

Appendix FTroubleshooting

Explains resolutions for abnormality of objectsand physical disks managed by GDS.

- YES

Appendix GFrequently AskedQuestions (FAQ)

Lists frequently asked questions regarding GDSand GDS Snapshot.

YES YES

Appendix HServer and StorageMigration

Explains how to migrate servers and storage tonew units on the system where GDS is used.

YES YES

Appendix I Disaster Recovery

Explains how to configure and operate the disasterrecovery system where GDS is used.

YES YES

Appendix J Cloning

Explains how to clone the existing system onwhich GDS is installed and set to create anothersystem.

YES YES

Appendix K Startup Scripts and StartupDaemons in GDS

Explains the GDS startup script and startupdaemon.

- YES

Appendix L SMF Services and PortNumbers in GDS

Explains the SMF service and startup daemon andthe port number used in GDS.

- YES

Appendix MRelease Information

Explains new features, manual update details, andchanges in specifications of GDS and GDSSnapshot, depending on the versions.

YES YES

GlossaryExplains GDS and GDS Snapshot terminology.Please refer to it as necessary.

YES YES

Related documentation

Please refer to the following documents according to need.

- PRIMECLUSTER Concepts Guide

- PRIMECLUSTER Configuration and Administration Guide

- PRIMECLUSTER Web-Based Admin View Operation Guide

- PRIMECLUSTER Global File Services Configuration and Administration Guide

- Software Release Guide PRIMECLUSTER(TM) GDS

- PRIMECLUSTER GDS Installation Guide

- Software Release Guide PRIMECLUSTER(TM) GDS Snapshot

- PRIMECLUSTER GDS Snapshot Installation Guide

- FJQSS (Information Collection Tool) User's Guide

Manual Printing

Use the PDF file to print this manual.

Adobe Reader is required to read and print this PDF file. To get Adobe Reader, see Adobe Systems Incorporated's website.

- ii -

Symbol

The following conventions are used in this manual:

- [4.3A10] indicates that the description is for GDS 4.3A10.

- [4.3A20 or earlier] indicates that the description is for GDS 4.3A20 or earlier.

- [4.3A20 or later] indicates that the description is for GDS 4.3A20 or later.

- [4.3A40 or later] indicates that the description is for GDS 4.3A40 or later.

Point

Main points are explained.

Note

Items that require attention are explained.

Information

Useful information is given.

See

Manual names and sections of this manual you should refer to are given.

Abbreviated name

- ETERNUS SF AdvancedCopy Manager is abbreviated as ACM.

- Oracle Solaris might be described as Solaris, Solaris Operating System, or Solaris OS.

- Oracle Solaris 10 is abbreviated as Solaris 10.

- Oracle Solaris 11 is abbreviated as Solaris 11.

- Oracle Solaris 11.1 is abbreviated as Solaris 11.1.

- Oracle Solaris Zones is abbreviated as Solaris Zones.

- Oracle VM Server for SPARC is abbreviated as Oracle VM.

Export Controls

Exportation/release of this document may require necessary procedures in accordance with the regulations of your resident country and/orUS export control laws.

Trademarks

Microsoft and Windows are registered trademarks of Microsoft Corporation, in the United States and other countries.

All other trademarks are property of their respective owners.

Window images are used according to the guidelines given by Microsoft Corporation.

- iii -

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

EMC, PowerPath, SRDF, Symmetrix and TimeFinder are registered trademarks of EMC Corporation.

SAN Manager is a trademark of EMC Corporation.

PRIMECLUSTER is a registered trademark of Fujitsu LIMITED.

Other product names that appear in this manual are product names, trademarks, or registered trademarks of respective companies.

Notice

- No part of this manual may be reproduced without permission.

- This manual is subject to change without advance notice.

Date of publication and edition

June 2015, Fourth editionJuly 2015, 4.1 editionDecember 2015, 4.2 editionApril 2017, 4.3 edition

All Rights Reserved, Copyright (C) FUJITSU LIMITED 2012-2017.

Revision History

Revision Location Edition

SAS3.0(12Gbps SAS) is supported. 5.3.4 Disk Swap6.1.2 Restoring7.1 System Disk Mirroring in a ZFS BootEnvironment (GDS Mirroring)7.2 System Disk Mirroring in a ZFS BootEnvironment (ZFS Mirroring)A.2.17 Swapping Disks (SAS)E.4.1 Error Messages (60000-60499)F.1.5 System Disk Abnormality

4.1

Changed the descriptions of the error message "device isMPxIO disabled".

A.2.1 Physical Disk Driver

Changed the descriptions of Note. F.3.1 sdxsystem - Enforced Cancellation ofSystem Disk Mirroring

Added the description to the note "In PRIMECLUSTERsystems."

5.1 Operation Outline 4.2

Added the description regarding the procedure to change theclass name of the class registered in the cluster application.

5.4.1 Class Configuration

Added the necessary procedure when the file system is createdon the volume.

5.5.2 Removing a Volume

Added the note "Permission of the /etc/vfstab file and the /etc/system file."

6.3.6 Backing Up

Removed an unnecessary step of restarting the system. 6.6.3 Restoring from Backup Disks

Added the note to "How to swap the system disk which ismirrored by ZFS mirroring."

A.2.9 System Disk Mirroring in a ZFS BootEnvironment

- iv -

Revision Location Edition

Added the descriptions of the procedure when upgrading EMCPowerPath.

A.2.26 Upgrading Procedure for EMC PowerPath

Added the descriptions to "Explanation" and "Resolution" ofthe internal error message 26000.

E.2.4 Internal Error Messages (26000)

Changed the section title. F.1.8 Errors in EMC Storage Units

Added the descriptions of the procedure when restoring the filesystem on the volume.

F.1.10 File System Related Errors

Changed the procedure to delete the configuration informationof the local class.

J.5 Setting up Copy Destination System

Added the note "High-capacity EFI label disk." 5.2 SettingsD.2 sdxdisk - Disk operations

4.3

Changed the command to delete resources. 5.2.3.1 Class Configuration5.2.3.2 Cluster System Class ConfigurationA.2.18 Swapping Disks (SAS)H.2.1 Using the GDS Snapshot Online DiskMigrationH.2.2 Using the Copy Function of Storage Unitsand the sdxconfig Command

Added the reference "Disk size." 5.2.3.4 Volume Configuration

Added the note "Initialization of mirror disk." 6.1.2 Restoring

Deleted the description of PRIMEPOWER. " 6.1.2 RestoringA.2.9 System Disk MirroringF.1.5 System Disk Abnormality

Changed the procedure on how to check the physical slicename.

6.2.1 Backing Up6.2.2 Restoring (When the System Can BeBooted)6.2.3 Restoring (When the System Cannot BeBooted)

Added a procedure for cluster system. 6.6.3 Restoring from Backup Disks

Added a procedure to attach label to the disk to be restored. 6.6.3 Restoring from Backup Disks

Added "A.2.6 Group Size." A.2.6 Group Size

Added a description of root class to "Size of a private slice." A.2.7 Disk Size

Added "Registration/deletion of high-capacity EFI labeldisk."

A.2.7 Disk Size

Deleted the description of Solaris 32 bit. A.2.11 Keep Disk

Changed the procedure for specifying device name of the newdisk.

A.2.18 Swapping Disks (SAS)

Added "A.2.25 Excluded Device List." A.2.25 Excluded Device List

Added the explanation of Excluded Device List in GDS. A.2.26 To Use EMC Storage Units

Added a note when performing live migration. A.2.39 Usage in Oracle VM Environment

Added a note when using GDS on both service domain andguest domain.

A.2.39 Usage in Oracle VM Environment

Added a note about hot spare function. A.2.39 Usage in Oracle VM Environment

Added a description "How to use GDS in kernel zones." A.2.40 Usage in Solaris Kernel ZonesEnvironment

Added a description when installing GDS a message is output. E.3.1 Halt Messages (40000-40099)

- v -

Revision Location Edition

Added a description when installing GDS an internal errormessage is output.

E.3.5 Internal Error Messages (48000)

Changed the description of "Resolution" in "(4) System cannotbe booted (Failure in all boot disk devices)." on how to checkphysical disk name.

F.1.5 System Disk Abnormality

Changed the procedure on how to start the cluster applicationindicated in "Resolution" of "(5) The disk space of a filesystem on a shared disk is "Full" (100%)."

F.1.9 Cluster System Related Error

Added a procedure to attach disk label to the storage ofmigration destination.

H.2.2 Using the Copy Function of Storage Unitsand the sdxconfig Command

Added descriptions to startup scripts and startup daemons inGDS.

Appendix K Startup Scripts and Startup Daemonsin GDS

Added descriptions to SMF services and port number in GDS. Appendix L SMF Services and Port Numbers inGDS

- vi -

ContentsChapter 1 Functions................................................................................................................................................................. 1

1.1 GDS Features.......................................................................................................................................................................................11.2 Functions for High Availability...........................................................................................................................................................2

1.2.1 Disk Mirroring.............................................................................................................................................................................. 31.2.1.1 System Disk Mirroring.......................................................................................................................................................... 31.2.1.2 Mirroring between Disk Array Unit...................................................................................................................................... 41.2.1.3 Shared Disk Mirroring........................................................................................................................................................... 51.2.1.4 Disk Mirroring in Virtual Environment.................................................................................................................................6

1.2.2 Hot Spare...................................................................................................................................................................................... 61.2.3 Hot Swap.......................................................................................................................................................................................91.2.4 Just Resynchronization Mechanism (JRM)................................................................................................................................ 101.2.5 I/O Timeout.................................................................................................................................................................................11

1.3 Functions for High Manageability.....................................................................................................................................................121.3.1 Operation Management Interface............................................................................................................................................... 121.3.2 Centralized Disk Management....................................................................................................................................................131.3.3 Name Management..................................................................................................................................................................... 141.3.4 Single System Image Environment.............................................................................................................................................151.3.5 Access Control............................................................................................................................................................................161.3.6 Realizing Large Capacity and I/O Load Balancing.................................................................................................................... 18

1.3.6.1 Logical Partitioning............................................................................................................................................................. 181.3.6.2 Disk Concatenation..............................................................................................................................................................181.3.6.3 Disk Striping........................................................................................................................................................................ 191.3.6.4 Combining Disk Striping with Mirroring............................................................................................................................ 20

1.3.7 Online Volume Expansion..........................................................................................................................................................201.3.8 Snapshots by Slice Detachment..................................................................................................................................................22

1.4 GDS Snapshot Features..................................................................................................................................................................... 241.5 Proxy Volume.................................................................................................................................................................................... 24

1.5.1 Snapshot by Synchronization......................................................................................................................................................261.5.2 Snapshot Function with No Load to the Server/SAN.................................................................................................................301.5.3 Instant Snapshot by OPC............................................................................................................................................................ 311.5.4 Instant Restore............................................................................................................................................................................ 321.5.5 Online Disk Migration................................................................................................................................................................ 341.5.6 Creating an Alternative Boot Environment................................................................................................................................ 35

1.6 Shadow Volume.................................................................................................................................................................................361.6.1 Accessing Volumes from an External Server............................................................................................................................. 361.6.2 Using the Copy Function of a Disk Unit.................................................................................................................................... 37

Chapter 2 Objects...................................................................................................................................................................392.1 SDX Object........................................................................................................................................................................................39

2.1.1 Disk Class................................................................................................................................................................................... 392.1.2 SDX Disk....................................................................................................................................................................................422.1.3 Disk Group..................................................................................................................................................................................452.1.4 Logical Volume.......................................................................................................................................................................... 472.1.5 Logical Slice............................................................................................................................................................................... 52

2.2 GDS Snapshot Objects.......................................................................................................................................................................562.2.1 Proxy Object............................................................................................................................................................................... 562.2.2 Shadow Object............................................................................................................................................................................60

2.2.2.1 Shadow Class.......................................................................................................................................................................612.2.2.2 Shadow Disk........................................................................................................................................................................ 632.2.2.3 Shadow Group..................................................................................................................................................................... 662.2.2.4 Shadow Volume...................................................................................................................................................................672.2.2.5 Shadow Slice........................................................................................................................................................................73

Chapter 3 Starting and Exiting GDS Management View........................................................................................................743.1 Preparation for Starting GDS Management View............................................................................................................................. 74

3.1.1 Deciding the User Group............................................................................................................................................................ 74

- vii -

3.1.1.1 User Group Types................................................................................................................................................................743.1.1.2 Creating User Groups.......................................................................................................................................................... 743.1.1.3 Registering to a User Group................................................................................................................................................ 74

3.1.2 Setting up the Client Environment..............................................................................................................................................753.1.3 Setting up the Web Environment................................................................................................................................................75

3.2 Starting the GDS Management View................................................................................................................................................ 753.2.1 Starting Web-Based Admin View Operation Menu................................................................................................................... 753.2.2 Web-Based Admin View Operation Menu Functions................................................................................................................763.2.3 Starting GDS Management View............................................................................................................................................... 77

3.3 Exiting GDS Management View....................................................................................................................................................... 783.4 Changing the Web-Based Admin View Settings...............................................................................................................................79

Chapter 4 Management View Screen Elements.....................................................................................................................804.1 Screen Configuration......................................................................................................................................................................... 804.2 Menu Configuration and Functions................................................................................................................................................... 83

4.2.1 General........................................................................................................................................................................................834.2.2 Settings........................................................................................................................................................................................844.2.3 Operation.................................................................................................................................................................................... 914.2.4 View............................................................................................................................................................................................944.2.5 Help.............................................................................................................................................................................................94

4.3 Icon Types and Object Status............................................................................................................................................................ 944.4 Object Information.............................................................................................................................................................................98

Chapter 5 Operation.............................................................................................................................................................1005.1 Operation Outline............................................................................................................................................................................ 100

5.1.1 System Disk Settings................................................................................................................................................................ 1005.1.2 Automatic Configuration.......................................................................................................................................................... 1015.1.3 Configuration Settings.............................................................................................................................................................. 101

5.1.3.1 Single Volume Configuration Settings.............................................................................................................................. 1015.1.3.2 Other Volume Configuration Settings............................................................................................................................... 102

5.1.4 Backup...................................................................................................................................................................................... 1035.1.4.1 Backup (by Slice Detachment).......................................................................................................................................... 1035.1.4.2 Backup (by Synchronization)............................................................................................................................................ 1045.1.4.3 Backup (by OPC)...............................................................................................................................................................106

5.1.5 Restore...................................................................................................................................................................................... 1065.1.6 Disk Swap................................................................................................................................................................................. 1075.1.7 Disk Migration..........................................................................................................................................................................1085.1.8 Configuration Change...............................................................................................................................................................1085.1.9 Unmirroring the System Disk................................................................................................................................................... 1095.1.10 Operations from GDS Management View..............................................................................................................................110

5.2 Settings.............................................................................................................................................................................................1135.2.1 System Disk Settings................................................................................................................................................................ 1135.2.2 Automatic Configuration Wizard............................................................................................................................................. 1195.2.3 Operating from the Settings Menu............................................................................................................................................125

5.2.3.1 Class Configuration........................................................................................................................................................... 1255.2.3.2 Cluster System Class Configuration.................................................................................................................................. 1295.2.3.3 Group Configuration..........................................................................................................................................................1315.2.3.4 Volume Configuration....................................................................................................................................................... 134

5.2.4 File System Configuration [4.3A20 or earlier].........................................................................................................................1385.2.5 Proxy Configuration................................................................................................................................................................. 140

5.2.5.1 Join.....................................................................................................................................................................................1405.2.5.2 Relate................................................................................................................................................................................. 145

5.3 Operation in Use.............................................................................................................................................................................. 1495.3.1 Viewing Configurations/Statuses and Monitoring Statuses..................................................................................................... 149

5.3.1.1 Confirming SDX Object Configuration.............................................................................................................................1495.3.1.2 Viewing Proxy Object Configurations.............................................................................................................................. 1545.3.1.3 Monitoring Object Status...................................................................................................................................................1595.3.1.4 Viewing Object Statuses....................................................................................................................................................161

- viii -

5.3.2 Backup...................................................................................................................................................................................... 1625.3.2.1 Backup (by Slice Detachment).......................................................................................................................................... 1625.3.2.2 Backup (by Synchronization)............................................................................................................................................ 1685.3.2.3 Backup (by OPC)...............................................................................................................................................................174

5.3.3 Restore...................................................................................................................................................................................... 1775.3.4 Disk Swap................................................................................................................................................................................. 1815.3.5 Disk Migration..........................................................................................................................................................................1865.3.6 Copying Operation....................................................................................................................................................................189

5.4 Changes............................................................................................................................................................................................1935.4.1 Class Configuration.................................................................................................................................................................. 1935.4.2 Group Configuration.................................................................................................................................................................1995.4.3 Volume Configuration.............................................................................................................................................................. 201

5.5 Removals......................................................................................................................................................................................... 2025.5.1 Removing a File System [4.3A20 or earlier]............................................................................................................................2035.5.2 Removing Volume....................................................................................................................................................................2035.5.3 Removing a Group....................................................................................................................................................................2055.5.4 Removing a Class..................................................................................................................................................................... 2065.5.5 Unmirroring the System Disk................................................................................................................................................... 2085.5.6 Breaking a Proxy...................................................................................................................................................................... 210

Chapter 6 Backing Up and Restoring...................................................................................................................................2136.1 Backing Up and Restoring a System Disk in a ZFS Boot Environment......................................................................................... 213

6.1.1 Backing Up............................................................................................................................................................................... 2136.1.2 Restoring...................................................................................................................................................................................214

6.2 Backing Up and Restoring a System Disk in a UFS Boot Environment.........................................................................................2226.2.1 Backing Up............................................................................................................................................................................... 2226.2.2 Restoring (When the System Can Be Booted)..........................................................................................................................2276.2.3 Restoring (When the System Cannot Be Booted).................................................................................................................... 231

6.3 Backing Up and Restoring a System Disk through an Alternative Boot Environment...................................................................2376.3.1 System Configuration............................................................................................................................................................... 2376.3.2 Summary of Backup................................................................................................................................................................. 2396.3.3 Summary of Restore................................................................................................................................................................. 2406.3.4 Summary of Procedure............................................................................................................................................................. 2426.3.5 Configuring an Environment.................................................................................................................................................... 2426.3.6 Backing Up............................................................................................................................................................................... 2456.3.7 Restoring...................................................................................................................................................................................250

6.4 Backing Up and Restoring Local Disks and Shared Disks..............................................................................................................2566.4.1 Offline Backup..........................................................................................................................................................................2566.4.2 Online Backup (by Slice Detachment)..................................................................................................................................... 2576.4.3 Restoring...................................................................................................................................................................................259

6.5 Online Backup and Instant Restore through Proxy Volume............................................................................................................2606.5.1 Online Backup (by Synchronization)....................................................................................................................................... 2626.5.2 Online Backup (Snapshot by OPC).......................................................................................................................................... 2676.5.3 Instant Restore.......................................................................................................................................................................... 272

6.6 Backing Up and Restoring through Disk Unit's Copy Functions.................................................................................................... 2766.6.1 Configuring an Environment.................................................................................................................................................... 2766.6.2 Backing Up............................................................................................................................................................................... 2776.6.3 Restoring from Backup Disks...................................................................................................................................................280

6.7 Backing Up and Restoring through an External Server...................................................................................................................2836.7.1 Backing Up and Restoring a Logical Volume with No Replication.........................................................................................286

6.7.1.1 System Configuration........................................................................................................................................................ 2866.7.1.2 Summary of Backup.......................................................................................................................................................... 2876.7.1.3 Summary of Restore.......................................................................................................................................................... 2886.7.1.4 Summary of Procedure...................................................................................................................................................... 2896.7.1.5 Configuring an Environment............................................................................................................................................. 2906.7.1.6 Backing Up........................................................................................................................................................................ 2916.7.1.7 Restoring............................................................................................................................................................................295

- ix -

6.7.2 Backing Up and Restoring through Snapshot by Slice Detachment........................................................................................ 3006.7.2.1 System Configuration........................................................................................................................................................ 3016.7.2.2 Summary of Backup.......................................................................................................................................................... 3016.7.2.3 Summary of Restore.......................................................................................................................................................... 3036.7.2.4 Summary of Procedure...................................................................................................................................................... 3046.7.2.5 Configuring an Environment............................................................................................................................................. 3056.7.2.6 Backing Up........................................................................................................................................................................ 3066.7.2.7 Restoring............................................................................................................................................................................311

6.7.3 Backing Up and Restoring Using Snapshots from a Proxy Volume........................................................................................ 3176.7.3.1 System Configuration........................................................................................................................................................ 3176.7.3.2 Summary of Backup.......................................................................................................................................................... 3186.7.3.3 Summary of Restore from a Proxy Volume...................................................................................................................... 3196.7.3.4 Summary of Restore from Tape.........................................................................................................................................3206.7.3.5 Summary of Procedure...................................................................................................................................................... 3226.7.3.6 Configuring an Environment............................................................................................................................................. 3236.7.3.7 Backing Up........................................................................................................................................................................ 3246.7.3.8 Restoring from a Proxy Volume........................................................................................................................................3286.7.3.9 Restoring from Tape.......................................................................................................................................................... 329

6.7.4 Backing Up and Restoring by the Disk Unit's Copy Function................................................................................................. 3336.7.4.1 System Configuration........................................................................................................................................................ 3346.7.4.2 Summary of Backup.......................................................................................................................................................... 3356.7.4.3 Summary of Restore from a BCV......................................................................................................................................3376.7.4.4 Summary of Restore from Tape.........................................................................................................................................3386.7.4.5 Summary of Procedure...................................................................................................................................................... 3406.7.4.6 Configuring an Environment............................................................................................................................................. 3416.7.4.7 Backing Up........................................................................................................................................................................ 3426.7.4.8 Restoring form a BCV....................................................................................................................................................... 3486.7.4.9 Restoring from Tape.......................................................................................................................................................... 349

6.8 Backing Up and Restoring Object Configurations.......................................................................................................................... 3556.8.1 Backing Up............................................................................................................................................................................... 3556.8.2 Restoring...................................................................................................................................................................................356

Chapter 7 How to Set and Cancel System Disk Mirroring Using Commands...................................................................... 3587.1 System Disk Mirroring in a ZFS Boot Environment (GDS Mirroring).......................................................................................... 358

7.1.1 System Disk Mirroring Settings in a ZFS Boot Environment (GDS Mirroring)......................................................................3587.1.1.1 Flow of System Disk Mirroring Settings (ZFS Boot Environment: GDS Mirroring).......................................................3607.1.1.2 Procedure for System Disk Mirroring Settings (ZFS Boot Environment: GDS Mirroring)............................................. 362

7.1.2 System Disk Mirroring Cancellation in a ZFS Boot Environment (GDS Mirroring).............................................................. 3697.1.2.1 Flow of System Disk Mirroring Cancellation (ZFS Boot Environment: GDS Mirroring)............................................... 3707.1.2.2 Procedure for System Disk Mirroring Cancellation (ZFS Boot Environment: GDS Mirroring)...................................... 372

7.2 System Disk Mirroring in a ZFS Boot Environment (ZFS Mirroring)............................................................................................3847.2.1 System Disk Mirroring Settings in a ZFS Boot Environment (ZFS Mirroring).......................................................................384

7.2.1.1 Flow of System Disk Mirroring Settings (ZFS Boot Environment: ZFS Mirroring)........................................................3857.2.1.2 Procedure for System Disk Mirroring Settings (ZFS Boot Environment: ZFS Mirroring)...............................................387

7.2.2 Procedure for System Disk Mirroring Cancellation (ZFS Mirroring)......................................................................................3947.2.2.1 Flow of System Disk Mirroring Cancellation (ZFS Boot Environment: ZFS Mirroring).................................................3957.2.2.2 Procedure for System Disk Mirroring Cancellation (ZFS Boot Environment: ZFS Mirroring)....................................... 397

7.3 System Disk Mirroring in a UFS Boot Environment...................................................................................................................... 405

Appendix A General Notes...................................................................................................................................................406A.1 Rules............................................................................................................................................................................................... 406

A.1.1 Object Name............................................................................................................................................................................ 406A.1.2 Number of Classes................................................................................................................................................................... 407A.1.3 Number of Disks...................................................................................................................................................................... 407A.1.4 Number of Groups................................................................................................................................................................... 408A.1.5 Number of Volumes.................................................................................................................................................................408A.1.6 Number of Keep Disks.............................................................................................................................................................408A.1.7 Creating Group Hierarchy........................................................................................................................................................408

- x -

A.1.8 Proxy Configuration Preconditions..........................................................................................................................................410A.1.9 Number of Proxy Volumes...................................................................................................................................................... 411A.1.10 Proxy Volume Size................................................................................................................................................................ 411A.1.11 Proxy Group Size...................................................................................................................................................................411

A.2 Important Points..............................................................................................................................................................................411A.2.1 Physical Disk Driver................................................................................................................................................................ 411A.2.2 Managing System Disks.......................................................................................................................................................... 412A.2.3 Restraining Access to Physical Special File............................................................................................................................ 413A.2.4 Initializing Disk....................................................................................................................................................................... 413A.2.5 Disk Label................................................................................................................................................................................414A.2.6 Group Size............................................................................................................................................................................... 415A.2.7 Disk Size.................................................................................................................................................................................. 415A.2.8 Volume Size.............................................................................................................................................................................416A.2.9 System Disk Mirroring............................................................................................................................................................ 417A.2.10 System Disk Mirroring in a ZFS Boot Environment............................................................................................................. 418A.2.11 Keep Disk...............................................................................................................................................................................420A.2.12 Booting from a CD-ROM Device (or Network)....................................................................................................................421A.2.13 Emergency Startup Disk for Restoration............................................................................................................................... 421A.2.14 System Reconfiguration.........................................................................................................................................................421A.2.15 Hot Spare............................................................................................................................................................................... 421A.2.16 Swapping Physical Disks.......................................................................................................................................................425A.2.17 Swapping Internal Disks (FC-AL).........................................................................................................................................427A.2.18 Swapping Disks (SAS).......................................................................................................................................................... 432A.2.19 Creating a Snapshot by Slice Detachment............................................................................................................................. 437A.2.20 The Difference between a Mirror Slice and a Proxy Volume............................................................................................... 437A.2.21 Just Resynchronization Mechanism (JRM)........................................................................................................................... 437A.2.22 Object Operation When Using Proxy.................................................................................................................................... 439A.2.23 Using the Advanced Copy Function in a Proxy Configuration............................................................................................. 439A.2.24 Instant Snapshot by OPC....................................................................................................................................................... 440A.2.25 Excluded Device List.............................................................................................................................................................441A.2.26 To Use EMC Storage Units................................................................................................................................................... 441A.2.27 Using EMC TimeFinder or EMC SRDF in a Proxy Configuration.......................................................................................445A.2.28 Upgrading Procedure for EMC PowerPath............................................................................................................................446A.2.29 Ensuring Consistency of Snapshot Data................................................................................................................................ 449A.2.30 Online Volume Expansion.....................................................................................................................................................449A.2.31 Volume Access Mode............................................................................................................................................................ 450A.2.32 Data Consistency at the time of Simultaneous Access.......................................................................................................... 451A.2.33 Operation in Cluster System.................................................................................................................................................. 451A.2.34 Changing Over from Single Nodes to a Cluster System........................................................................................................451A.2.35 Disk Switch............................................................................................................................................................................452A.2.36 Shadow Volume.....................................................................................................................................................................452A.2.37 Configuration Tables............................................................................................................................................................. 455A.2.38 GDS Management View........................................................................................................................................................ 455A.2.39 Usage in Oracle VM Environment........................................................................................................................................ 455A.2.40 Usage in Solaris Kernel Zones Environment.........................................................................................................................457A.2.41 Usage in Solaris Zones Environment.....................................................................................................................................458A.2.42 If Using ZFS.......................................................................................................................................................................... 465A.2.43 Mounting the iSCSI Device................................................................................................................................................... 469A.2.44 Operating when there is a disk in DISABLE status or there is a class not displayed with the sdxinfo command................469

A.3 General Points.................................................................................................................................................................................470A.3.1 Guidelines for Mirroring..........................................................................................................................................................470A.3.2 Guidelines for Striping.............................................................................................................................................................470A.3.3 Guidelines for Concatenation.................................................................................................................................................. 470A.3.4 Guidelines for Combining Striping with Mirroring.................................................................................................................471

Appendix B Log Viewing with Web-Based Admin View....................................................................................................... 472

Appendix C Web-Based Admin View Operating Environment Setting.................................................................................473

- xi -

Appendix D Command Reference........................................................................................................................................474D.1 sdxclass - Class operations..............................................................................................................................................................474D.2 sdxdisk - Disk operations................................................................................................................................................................475D.3 sdxgroup - Group operations.......................................................................................................................................................... 484D.4 sdxvolume - Volume operations..................................................................................................................................................... 488D.5 sdxslice - Slice operations...............................................................................................................................................................493D.6 sdxinfo - Display object configuration and status information.......................................................................................................496D.7 sdxattr - Set objects attributes......................................................................................................................................................... 511D.8 sdxswap - Swap disk.......................................................................................................................................................................518D.9 sdxfix - Restore a failed object....................................................................................................................................................... 520D.10 sdxcopy - Synchronization copying operation..............................................................................................................................522D.11 sdxroot - Root file system mirroring definition and cancellation ................................................................................................ 524D.12 sdxparam - Configuration parameter operations...........................................................................................................................527D.13 sdxconfig - Object configuration operations.................................................................................................................................528D.14 sdxproxy - Proxy object operations.............................................................................................................................................. 533D.15 sdxshadowdisk - Shadow disk operations.....................................................................................................................................543D.16 sdxshadowgroup - Shadow group operations............................................................................................................................... 548D.17 sdxshadowvolume - Shadow volume operations..........................................................................................................................551D.18 Volume Creation Using Commands............................................................................................................................................. 554D.19 Snapshot Creation Using Command.............................................................................................................................................558D.20 Volume Expansion Using Commands.......................................................................................................................................... 560

Appendix E GDS Messages.................................................................................................................................................568E.1 Web-Based Admin View Messages (0001-0099)........................................................................................................................... 568E.2 Driver Messages.............................................................................................................................................................................. 568

E.2.1 Panic Messages (20000)...........................................................................................................................................................569E.2.2 Warning Messages (22000-22099).......................................................................................................................................... 569E.2.3 Information Messages (24000-24099)..................................................................................................................................... 573E.2.4 Internal Error Messages (26000)..............................................................................................................................................576

E.3 Daemon Messages...........................................................................................................................................................................577E.3.1 Halt Messages (40000-40099)..................................................................................................................................................578E.3.2 Error Messages (42000-42099)................................................................................................................................................ 580E.3.3 Warning Messages (44000-44099).......................................................................................................................................... 593E.3.4 Information Messages (46000-46199)..................................................................................................................................... 603E.3.5 Internal Error Messages (48000)..............................................................................................................................................623

E.4 Command Messages........................................................................................................................................................................623E.4.1 Error Messages (60000-60499)................................................................................................................................................ 625E.4.2 Warning Messages (62000-62099).......................................................................................................................................... 704E.4.3 Information Messages (64000-64099)..................................................................................................................................... 709E.4.4 Fix Messages (66000).............................................................................................................................................................. 724E.4.5 Internal Error Messages (68000)..............................................................................................................................................725

E.5 Operation Management View Messages.........................................................................................................................................725E.5.1 Error Messages (5000-5099).................................................................................................................................................... 725E.5.2 Warning Messages (5000,5100-5199)..................................................................................................................................... 730E.5.3 Information Messages (5200-5299)......................................................................................................................................... 741

E.6 Error Codes (90000-90099).............................................................................................................................................................750

Appendix F Troubleshooting.................................................................................................................................................753F.1 Resolving Problems.........................................................................................................................................................................753

F.1.1 Slice Status Abnormality.......................................................................................................................................................... 753F.1.2 Disk Status Abnormality.......................................................................................................................................................... 760F.1.3 Volume Status Abnormality..................................................................................................................................................... 762F.1.4 Class Status Abnormality......................................................................................................................................................... 778F.1.5 System Disk Abnormality........................................................................................................................................................ 781F.1.6 GDS Management View Abnormality..................................................................................................................................... 806F.1.7 Proxy Object Abnormality........................................................................................................................................................809F.1.8 Errors in EMC Storage Units....................................................................................................................................................810F.1.9 Cluster System Related Error................................................................................................................................................... 815

- xii -

F.1.10 File System Related Errors..................................................................................................................................................... 822F.1.11 Shadow Object Errors.............................................................................................................................................................828F.1.12 Disk Unit Error....................................................................................................................................................................... 828

F.2 Collecting Investigation Material.................................................................................................................................................... 829F.2.1 Collecting with fjsnap Command............................................................................................................................................. 829F.2.2 Collecting Initial Investigation Material with sdxsnap.sh Script............................................................................................. 830F.2.3 Collecting Investigation Material with FJQSS [4.3A40 or later] ............................................................................................830

F.3 Maintenance Tool............................................................................................................................................................................ 831F.3.1 sdxsystem - Enforced Cancellation of System Disk Mirroring................................................................................................831

F.3.1.1 Outline............................................................................................................................................................................... 831F.3.1.2 Usage of sdxsystem........................................................................................................................................................... 831F.3.1.3 sdxsystem Command Messages........................................................................................................................................ 831

F.3.2 sdxrootck - Confirmation of System Disk Mirroring Cancellation..........................................................................................834F.3.2.1 Outline............................................................................................................................................................................... 834F.3.2.2 Usage of sdxrootck ........................................................................................................................................................... 835F.3.2.3 sdxrootck command message............................................................................................................................................ 836

Appendix G Frequently Asked Questions (FAQ)..................................................................................................................843G.1 Operation Design............................................................................................................................................................................ 843G.2 Environment Configuration............................................................................................................................................................ 846G.3 Operation.........................................................................................................................................................................................847

Appendix H Server and Storage Migration...........................................................................................................................850H.1 Server Migration............................................................................................................................................................................. 850H.2 Storage Migration........................................................................................................................................................................... 851

H.2.1 Using the GDS Snapshot Online Disk Migration.................................................................................................................... 851H.2.2 Using the Copy Function of Storage Units and the sdxconfig Command...............................................................................853

Appendix I Disaster Recovery.............................................................................................................................................. 856I.1 Building a Disaster Recovery System.............................................................................................................................................. 856I.2 Switching to a Disaster Recovery System........................................................................................................................................857I.3 Restoration to the Operation System from a Disaster Recovery System......................................................................................... 857

Appendix J Cloning...............................................................................................................................................................858J.1 Summary.......................................................................................................................................................................................... 858J.2 Preconditions....................................................................................................................................................................................858J.3 Preparation....................................................................................................................................................................................... 858J.4 Copying Disk Data........................................................................................................................................................................... 859J.5 Setting up Copy Destination System................................................................................................................................................859

Appendix K Startup Scripts and Startup Daemons in GDS..................................................................................................861K.1 Explanation Formats....................................................................................................................................................................... 861K.2 Startup Script Lists..........................................................................................................................................................................861

Appendix L SMF Services and Port Numbers in GDS......................................................................................................... 862L.1 Explanation Formats........................................................................................................................................................................862L.2 SMF services list............................................................................................................................................................................. 862

Appendix M Release Information......................................................................................................................................... 864M.1 New Features..................................................................................................................................................................................864

M.1.1 New Features in 4.2A00..........................................................................................................................................................864M.1.2 New Features in 4.3A10..........................................................................................................................................................866M.1.3 New Features in 4.3A20..........................................................................................................................................................868M.1.4 New Features in 4.3A40..........................................................................................................................................................869

M.2 Manual Changes.............................................................................................................................................................................869M.2.1 4.2A00 Manual Changes......................................................................................................................................................... 869M.2.2 4.3A10 Manual Changes......................................................................................................................................................... 872M.2.3 4.3A20 Manual Changes......................................................................................................................................................... 876M.2.4 4.3A40 Manual Changes......................................................................................................................................................... 880

- xiii -

M.3 Specification Changes Other Than New Features..........................................................................................................................881M.3.1 Specification Changes in 4.1A40............................................................................................................................................ 881

M.3.1.1 Command Error Message Changes.................................................................................................................................. 881M.3.2 Specification Changes in 4.2A00............................................................................................................................................ 881

M.3.2.1 The sdxproxy Command Option -e delay........................................................................................................................ 882M.3.3 Specification changes in 4.3A10.............................................................................................................................................882M.3.4 Specification changes in 4.3A20.............................................................................................................................................882M.3.5 Specification changes in 4.3A40.............................................................................................................................................882

M.3.5.1 File System Configuration screen of GDS Management View....................................................................................... 882M.3.5.2 Changes of the warning message "5119" in the Volume Configuration screen.............................................................. 882

Glossary............................................................................................................................................................................... 883

- xiv -

Chapter 1 FunctionsThis chapter describes the features and functions of GDS (Global Disk Services) and GDS Snapshot.

1.1 GDS FeaturesGDS is volume management software that improves the availability and manageability of disk-stored data. GDS protects disk data fromhardware failures and operational mistakes and supports the management of disk units.

GDS has closely related functions below:

- To improve availability of disk data

- To improve manageability of disk data

GDS's mirroring function protects data from hardware failures by maintaining replicas of disk data on multiple disks. This allows users tocontinue to access disk data without stopping the application in the event of unexpected trouble.

Figure 1.1 Disk Mirroring

GDS allows users to integrate management of all disk units connected to a Solaris server. In a PRIMECLUSTER system, GDS also allowsusers to manage all disk units connected to all servers in an integrated manner for shared in a SAN (Storage Area Network) storageenvironment as well as for local disk units connected to specific servers.

- 1 -

Figure 1.2 SAN (Storage Area Network)

In general, multiple servers can be connected to multiple disk units in a SAN environment. Disk-stored data can be accessed from thoseservers. This allows simultaneous access to file systems or databases and improves the efficiency of data duplication between the serversand backup procedures. The problem is that it also carries the risk of data damage, as multiple servers will compete to access the shared disk.Therefore, volume management functions suitable for the SAN environment are essential.

Since GDS's management function is suitable for a SAN environment, advanced system operation for disk management can be performedwith ease.

The user-friendly functions simplify management, and at the same time, prevent data corruption by operational mistakes.

Figure 1.3 Access Control Mechanism in a SAN Environment

1.2 Functions for High AvailabilityFailure of hardware related to disk unit interrupts data access, causing applications or systems to stop.

- 2 -

This section explains functions which protect data from unexpected hardware problems, and improve system availability.

1.2.1 Disk MirroringDisk mirroring utilizes multiple disks to maintain data synchronization.

GDS provides disk mirroring by creating one logical disk from multiple physical disks.

With GDS disk mirroring, applications can continue disk accesses even if one mirror disk (a disk that is mirrored) fails. Therefore, all thedata in disk is not damaged and applications can continue normal operations.

Figure 1.4 Disk Mirroring

GDS also supports mirroring of a single disk unit and mirroring of disk arrays. It can mirror disk units of various usage and configuration,including a system disk installed with an operating system, and a disk connected to multiple servers.

Examples of special mirroring implementation are explained below.

1.2.1.1 System Disk MirroringSystem disk mirroring can mirror system disks with Solaris operating system installed.

If a system disk failure occurs, the entire system probably stops and even booting will become impossible, and operating systemreinstallation will be required. As a result, service stop may remain for a long time.

System disk mirroring ensures continuous system operation even when a failure occurs in part of the disks.Additionally, it enables system boot in a situation where disk failure has occurred.

The following system disks can also be mirrored:

- SAN Boot environment

- Guest domain in Oracle VM [4.3A20 or later]

- 3 -

Figure 1.5 System Disk Mirroring

1.2.1.2 Mirroring between Disk Array UnitGDS can provide mirroring between high-performance and high-reliability disk arrays.

Mirroring two disk arrays connected with Fibre Channel can protect data from unexpected accidents and power shortage.

Moreover, disk units with redundant access paths can also be mirrored with specific software.

- 4 -

Figure 1.6 Mirroring between Disk Array Unit

1.2.1.3 Shared Disk MirroringGDS can mirror shared disk units connected with a cluster system composed of multiple servers (also referred to as nodes).

Such mirroring is called shared disk mirroring in distinction from local disk mirroring that mirrors disks connected to a single node.

The GDS's shared disk mirroring function can be used with applications, such as the GFS Shared File System, that provide simultaneousaccess from multiple servers to shared disks, not to mention switch-over or standby type applications.

Figure 1.7 Shared Disk Mirroring

- 5 -