Top Banner

Click here to load reader

Cisco SFS InfiniBand Redundancy Configuration Guide · PDF file iii Cisco SFS InfiniBand Redundancy Configuration Guide 78-12957-02 CONTENTS Preface vii Audience vii Organization vii

Jul 29, 2020

ReportDownload

Documents

others

  • Cisco SFS InfiniBand Redundancy Configuration Guide Release 2.10 December 2007

    Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000

    800 553-NETS (6387) Fax: 408 527-0883

    Text Part Number: OL-12957-02

    http://www.cisco.com

  • F INAL REV IEW—CISCO CONF IDENT IAL

    THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

    THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

    The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.

    NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.

    IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

    Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any examples, command display output, and figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental.

    Cisco SFS InfiniBand Redundancy Configuration Guide © 2007 Cisco Systems, Inc. All rights reserved.

    CCVP, the Cisco logo, and Welcome to the Human Network are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn is a service mark of Cisco Systems, Inc.; and Access Registrar, Aironet, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, EtherSwitch, Fast Step, Follow Me Browsing, FormShare, GigaDrive, HomeLink, Internet Quotient, IOS, iPhone, IP/TV, iQ Expertise, the iQ logo, iQ Net Readiness Scorecard, iQuick Study, LightStream, Linksys, MeetingPlace, MGX, Networkers, Networking Academy, Network Registrar, PIX, ProConnect, ScriptShare, SMARTnet, StackWise, The Fastest Way to Increase Your Internet Quotient, and TransPath are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.

    All other trademarks mentioned in this document or Website are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0711R)

  • 78-12957-02

    C O N T E N T S

    Preface vii

    Audience vii

    Organization vii

    Conventions viii

    Related Documentation ix

    x

    C H A P T E R 1 Overview 1-1

    C H A P T E R 2 Cisco SFS 7008P and SFS 7000 Series Server Switch Redundancy 2-1

    Cisco SFS 7008P Server Switch Redundancy 2-2 Software Redundancy 2-2 Power Supply Module Redundancy 2-4 Fan Tray Redundancy 2-4 Management Interface Module Redundancy 2-5 Fabric Controller Redundancy 2-6 Line Interface Module Redundancy 2-6 IB Fabric Redundancy 2-8

    Cisco SFS 7000P and SFS 7000D Server Switch Redundancy 2-9 Power Supply Redundancy 2-9 Port Redundancy 2-10 IB Fabric Redundancy 2-10

    C H A P T E R 3 InfiniBand Server Switch Module Redundancy for the IBM BladeCenter 3-1

    C H A P T E R 4 Cisco SFS 3504 and Cisco SFS 3000 Series Server Switch Redundancy 4-1

    Cisco SFS 3504 Server Switch Redundancy 4-2 Software Redundancy 4-2 IB Switch Module Redundancy 4-2 Fabric Redundancy 4-2 AC Power-Fan Module Redundancy 4-3 Ethernet Gateway Redundancy and Fibre Channel Gateway Redundancy 4-4

    iii Cisco SFS InfiniBand Redundancy Configuration Guide

  • Contents

    Cisco SFS 3012R Server Switch Redundancy 4-5 Power Supply Redundancy 4-5 Blower Redundancy 4-6 Controller Module Redundancy 4-6 InfiniBand Switch Module Redundancy 4-7 Ethernet Gateway Redundancy and Fibre Channel Gateway Redundancy 4-7 Fabric Redundancy 4-7

    Cisco SFS 3001 Server Switch Redundancy 4-9 Power Supply Module Redundancy 4-9 Fan Redundancy 4-9 Fabric Redundancy 4-10

    C H A P T E R 5 Subnet Manager Redundancy 5-1

    Embedded Subnet Manager 5-3

    High-Performance Subnet Manager 5-4

    Setting up Master and Standby Subnet Managers 5-4 Setting up Master and Standby Subnet Managers Using Embedded Subnet Managers 5-4 Setting up Master and Standby Subnet Managers with High-Performance Subnet Managers 5-6

    Setting Up Database Synchronization 5-8 Setting up Database Synchronization for Embedded Subnet Managers 5-9 Setting up Database Synchronization for High-Performance Subnet Managers 5-10

    C H A P T E R 6 Host Redundancy, and IPoIB and SRP Redundancies 6-1

    HCA Redundancy 6-1 Single HCA Redundancy 6-1 Multiple HCA Redundancy 6-3 Two HCAs with the IBM BladeCenter 6-3

    IPoIB High Availability 6-4 Cisco SFS IPoIB High Availability 6-4

    Merging Physical Ports 6-4 Unmerging Physical Ports 6-5

    OFED IPoIB High Availability 6-6 Configuring IPoIB High Availability 6-6 Verifying IPoIB High Availability 6-8

    OFED SRP High Availability 6-8

    C H A P T E R 7 Ethernet Gateway and IPoIB Redundancies 7-1

    Configuring Ethernet Gateway Redundancy with the Cisco SFS 3504 Server Switch 7-3

    iv Cisco SFS InfiniBand Redundancy Configuration Guide

    78-12957-02

  • Contents

    Verifying Redundancy Configuration for Cisco SFS 3504 Server Switches 7-6 Verifying Bridge Group Configuration for Cisco SFS 3504 Server Switches 7-8

    Configuring Ethernet Gateway Redundancy Using the Cisco SFS 3012R Server Switch 7-10 Configuring Ethernet Gateway Redundancy Using a Single Cisco SFS 3012R Server Switch 7-10

    Verifying Redundancy Group Configuration for a Single Cisco SFS 3012R Server Switch 7-13 Verifying Bridge Group Configuration for a Single Cisco SFS 3012R Server Switch 7-14

    Configuring Ethernet Gateway Redundancy Using Dual Cisco SFS 3012R Server Switches 7-15 Verifying Redundancy Group Configuration for Dual Cisco SFS 3012R Server Switches 7-19 Verifying Bridge Group Configuration for Dual Cisco SFS 3012R Server Switches 7-20

    Configuring Ethernet Gateway Redundancy for the Cisco SFS 3001 Server Switch 7-23 Verifying Redundancy Group Configuration for Cisco SFS 3001 Server Switches 7-27 Verifying Bridge Group Configuration for Cisco SFS 3001 Server Switches 7-28

    C H A P T E R 8 Fibre Channel Gateway and SRP Redundancies 8-1

    Dynamic Load Balancing 8-2

    Dynamic Gateway Failover 8-2

    Path Affinity 8-2

    Configuring Fibre Channel Gateway Redundancy for the Cisco SFS 3504 Server Switch 8-3 Verifying Configured Initiator 8-5 Verifying IT 8-6 Verifying LU 8-7

    Configuring Fibre Channel Gateway Redundancy Using the Cisco SFS 3012R Server Switch 8-8 Configuring Fibre Channel Gateway Redundancy Using a Single Cisco SFS 3012 Server Switch 8-8 Verifying Configuration for a Single Cisco SFS 3012R Server Switch 8-10 Configuring Fibre Channel Gateway Redundancy Using Two Cisco SFS 3012R Server Switches 8-12 Verifying Configuration for Two Cisco SFS 3012R Server Switches 8-13

    Configuring Fibre Channel Gateway Redundancy for the Cisco SFS 3001 Server Switch 8-16 Configuring Two Cisco SFS 3001 Server Switches 8-16 Verifying Redundancy Configuration for Cisco SFS 3001 Server Switches 8-17

    C H A P T E R 9 Typical Redundancy Use Case 9-1

    A P P E N D I X A Acronyms and Abbreviations A-1

    I N D E X

    v Cisco SFS InfiniBand Redundancy Configuration Guide

    78-12957-02

  • Contents

    vi Cisco SFS InfiniBand Redundancy Configuration Guide

    78-12957-02

  • Preface

    This preface describes who should read the Cisco SFS InfiniBand Redundancy Configuration Guide, how it is organized and its document conventions. It contains the following sections:

    • Audience, page vii

    • Organization, page vii

    • Conventions, page viii

    • Related Documentation, page ix

    • Obtaining Documentation and Submitting a Service Request, page x

    Audience The intended audience for this document is the administrator responsible for the Enterprise data center who configures redundancy in a Server Fabric Switch environment. This administrator should have experience configuring and managing equipment such as server switches, the Subnet Manager, Ethernet gateways, Host Channel Adapters, and software drivers.

    Organization This guide is organized as follows:

    Chapter Title Descriptio

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.