STF3-3-FC-SAN

© 2006 EMC Corporation. All rights reserved.

Fibre Channel Storage Area Networks (SAN)Fibre Channel Storage Area Networks (SAN)

Module 3.3

© 2006 EMC Corporation. All rights reserved. Storage Area Networks (SAN) - 2

Fibre Channel Storage Area Networks (SAN)

Upon completion of this module, you will be able to:

Describe the features and benefits of SAN.

Describe the physical and logical elements of SAN.

List common SAN topologies.

Compare and contrast connectivity devices.

Describe connectivity options of SAN.

Describe the I/O flow in the SAN environment.

List SAN management considerations.

Describe applications of a SAN strategy.


In this module …

This module contains the following lessons:

Fibre Channel SAN Overview.

The Components of a SAN.

FC SAN Connectivity.

SAN Management.

SAN Deployment Examples.

Case Study and Applications of FC SAN.


Lesson: Fibre Channel SAN Overview

Upon completion of this lesson, you will be able to:

Define a FC SAN.

Describe the features of FC SAN based storage.

Describe the benefits of an FC SAN based storage strategy.


Business Needs and Technology Challenges

Information when and where the business user needs it

Integrate technology infrastructure with business processes

Flexible, resilient architecture


What is a SAN?

Dedicated storage network

Organized connections among:

Storage

Communication devices

Systems

Secure

Robust

Server

Servers

Array

Switches

Storage


Evolution of Fibre Channel SAN

SAN IslandsFC

Arbitrated Loop

InterconnectedSANs

FCSwitched Fabric

Enterprise SANs FC Switched Fabric

HUB

Servers

Arrays

Storage

Switches

Switches

Servers

Servers

Storage

Storage


Benefits of a SAN

High bandwidth – Fibre Channel

SCSI extension– Block I/O

Resource Consolidation – Centralized storage and management

Scalability– Up to 16 million devices

Secure Access– Isolation and filtering


Lesson Summary

Topics in this lesson included:

Definition of a SAN

Features and Benefits of SANs


Lesson: The Components of a SAN


Describe the elements of a SAN.– Host Bus Adapter (HBA)

– Fiber Cabling

– Fibre Channel Switch /Hub

– Storage Array

– Management System


Components of a Storage Area Network

Host Bus Adapter (HBA)

Fiber Cabling

Fibre Channel Switch /Hub

Storage Array

Management System

HBAHBA

SAN-attached Server

SAN

Arrays

Switches


Nodes, Ports, & Links

Node

HBA

Port 0Port 0

Port 1Port 1

Port nPort n

Link

Port 0Port 0Rx

Tx


HBA

Host Bus Adapters

HBAs perform low-level interface functions automatically to minimize the impact on host processor performance

HBAArraysSwitches

Server


Connectivity

Single Mode Fiber

Storage

Multimode Fiber

Host

Switches


Connectors

Node Connectors:

SC Duplex Connectors

LC Duplex Connectors

Patch panel Connectors

ST Simplex Connectors


Connectivity Devices

Basis for SAN communication– Hubs, Switches and Directors

HBAArrays

SwitchesServer


Storage Resources

Storage Array– Provides storage consolidation and

centralization

Features of an array– High Availability/Redundancy

– Performance

– Business Continuity

– Multiple host connect HBAArraysSwitches

Server


SAN Management Software A suite of tools used in a SAN

to manage the interface between host and storage arrays.

Provides integrated management of SAN environment.

Web based GUI or CLI


Lesson: Summary


The elements of a SAN:– Host Bus Adapter (HBA)

– Fiber Cabling

– Fibre Channel Switch /Hub

– Storage Array

– Management System


Lesson: Fibre Channel SAN Connectivity


Describe the Fibre Channel SAN connectivity methods and topologies

Describe Fibre Channel devices

Describe Fibre Channel communication protocols

Describe Fibre Channel login procedures


Fibre Channel SAN Connectivity

Core networking principles applied to storage

Servers are attached to 2 distinct networks– Back-end

– Front-end

Users &Application

Clients

Storage & Application

Data

Servers & Applications

SANswitchesdirectors

IPnetwork


What is Fibre Channel?

SAN Transport Protocol– Integrated set of standards (ANSI)

– Encapsulates SCSI

A High Speed Serial Interface– Allows SCSI commands to be transferred over a storage network.

Standard allows for multiple protocols over a single interface.


Fibre Channel Ports

Node

Node

Node

Switch

Node

Node

Node

Node

E Port

NL Port

NL Port

N Port

F Port

N Port

F Port

N Port

F PortN Port

F Port

E Port

FL Port FL Port

NL Port

NL Port

HUBHUB

NL Port

Servers

Server

Server

Storage

ArrayArray

Storage

Switch

Switch


World Wide Names

Unique 64 bit identifier.

Static to the port.– Used to physically identify a port or node within the SAN

– Similar to a NIC MAC address

Additionally, each node is assigned a unique port ID (address) within the SAN– Used to communicate between nodes within the SAN

– Similar in functionality to an IP address on a NIC


World Wide Names: Example

World Wide Name - HBA

1 0 0 0 0 0 0 0 c 9 2 0 d c 4 0Reserved

12 bitsCompany OUI

24 bitsCompany Specific

24 bits

World Wide Name – Array

5 0 0 6 0 1 6 0 0 0 6 0 0 1 B 20101 0000 0000 0110 0000 0001 0110 0000 0000 0000 0110 0000 0000 0001 1011 0010

Company ID24 bits

Port Model seed 32 bits


Fabric

Fibre Channel Logins

N Port 1 F Port F Port N Port 2Process x

Process y

Process z

Process a

Process b

Process c


Fibre Channel Addressing

Fibre Channel addresses are used for transporting frames from source ports to destination ports.

Address assignment methods vary with the associated topology (loop vs switch)– Loop – self assigning

– Switch – centralized authority

Certain addresses are reserved – FFFFFC is Name Server

– FFFFFE is Fabric Login


What is a Fabric?

Virtual space used by nodes to communicate with each other once they are joined.

Component identifiers:– Domain ID

– Worldwide Name (WWN)

Fabric

Switches

Servers

Arrays

Storage


Fibre Channel Topologies

Arbitrated Loop (FC-AL)– Devices attached to a shared

“loop”

– Analogous to Token Ring

Switched Fabric (FC-SW)– All devices connected to a “Fabric

Switch” – Analogous to an IP switch

– Initiators have unique dedicated I/O paths to Targets

HUB

Switch

Clients

Arrays

Storage

Clients


Switch versus Hub Comparison

Switches (FC-SW)– FC-SW architecture scalable to

millions of connections.

– Bandwidth per device stays constant with increased connectivity.

– Bandwidth is scalable due to dedicated connections.

– Higher availability than hubs.

– Higher cost.

Hubs (FC-AL)– FC-AL is limited to 127

connections (substantially fewer connections can be implemented for ideal system performance).

– Bandwidth per device diminishes with increased connectivity due to sharing of connections.

– Low cost connection.


How an Arbitrated Loop Hub Works

Transmit

Transmit

Receive

Receive

Receive

Transmit

Receive

Transmit

Byp

Byp

Byp

Byp

Hub_Pt Hub_Pt

Hub_Pt Hub_Pt

Node A

Node B Node C

Node D

Byp

Byp

NL_Port #4

HBA

NL_Port #4

HBA

NL_Port #1

HBA

NL_Port #1

HBA

NL_Port #3

FA

NL_Port #3

FA

NL_Port #2

HBA

NL_Port #2

HBA

Byp

Byp


Port

How a Switched Fabric Works

Transmit

Transmit

Receive

Receive

Receive

Transmit

Receive

Transmit

NL_Port #1

HBA

NL_Port #4

HBA

NL_Port #2

HBA

N_Port #1

HBA

Port

N_Port #4

HBA

N_Port #2

Storage Port

Port

Port

Node A

Node B Node C

Node D

NL_Port #3

FA

N_Port #3

Storage Port


Metro ring or point-to-pointtopologies with or without

path protection

Inter Switch Links (ISLs)

Multimode Fiber

1Gb=500m 2Gb=300m

Single-mode Fiber

up to10 km

Switch

Switch

Switch

Switch

Switch

Switch

Router Router


Topology: Mesh Fabric

Can be either partial or full mesh

All switches are connected to each other

Host and Storage can be located anywhere in the fabric

Host and Storage can be localized to a single switch

Partial Mesh Full Mesh


Full Mesh Benefits

Benefits– All storage/servers are a maximum of one ISL hop away.

– Hosts and storage may be located anywhere in the fabric.

– Multiple paths for data using the Fabric Shortest Path First (FSPF) algorithm.

– Fabric management made simpler.


Topology: Simple Core-Edge Fabric Can be two or three tiers

– Single Core Tier– One or two Edge Tiers

In a two tier topology, storage is usually connected to the Core

Benefits– High Availability– Medium Scalability– Medium to maximum

Connectivity

Storage Tier

Host Tier


Core-Edge Benefits

Simplifies propagation of fabric data.– One ISL hop access to all storage in the fabric.

Efficient design based on node type.– Traffic management and predictability.

Easier calculation of ISL loading and traffic patterns.


Lesson: Summary


The Fibre Channel SAN connectivity methods and topologies

Fibre Channel devices

Fibre Channel communication protocols

Fibre Channel login procedures


Lesson: SAN Management


Describe SAN management functions– Infrastructure protection

– Provisioning

– Capacity Management

– Performance Management


SAN Management Overview

Infrastructure protection

Fabric Management

Storage Allocation

Capacity Tracking

Performance Management


Infrastructure Security

Physical security– Locked data center

Centralized server and storage infrastructure– Controlled administrator access

Storage Arrays

Switch Switch

Secure VPNor

FirewallServers

Control Station

Corporate LAN

Management LAN (Private)

In-band (FC)

Out-band (IP)


Switch/Fabric Management Tools

Vendor supplied management software– Embedded within the switch

– Graphical User Interface (GUI) or Command Line Interface (CLI)

Functionality– Common functions

Performance monitoring Discovery Access Management (Zoning)

– Different “look and feel” between vendors

Additional third party software add-ons– Enhanced functionality, such as automation


Fabric Management: Zoning

Servers

Arrays


Zoning Components

Zone Zone ZoneZones

(Library)

Zone SetZones Sets(Library)

Members(WWN’s) Member Member Member MemberMember Member


Types of Zoning

Examples:

WWN Zone 1 = 10:00:00:00:C9:20:DC:40; 50:06:04:82:E8:91:2B:9E

Port Zone 1 = 21,1; 25,3

Mixed Zone 1 = 10:00:00:00:C9:20:DE:56; Port 21/1

WWN 10:00:00:00:C9:20:DC:40 WWN

50:06:04:82:E8:91:2B:9E

Domain ID = 21Port = 1

Domain ID = 25Port = 3

WWN 10:00:00:00:C9:20:DE:56

Servers

ArraySwitches


Single HBA Zoning

Optimally, one HBA per zone. – Nodes can only “talk” to Storage in the same zone

Storage Ports may be members of more than one zone.

HBA ports are isolated from each other to avoid potential problems associated with the SCSI discovery process.– Also known as “chatter”

Decreases the impact of a changes in a Fabric by reducing the amount of nodes that must communicate.


Provisioning: LUN Masking Restricts volume access to

specific hosts and/or host clusters.

Servers can only access the volumes that they are assigned.

Access controlled in the storage and not in the fabric– Makes distributed administration

secure

Tools to manage masking– GUI– Command Line

ServersArray

Switch


Capacity Management

Tracking and managing assets – Number of ports assigned

– Storage allocated

Utilization profile– Indicates resource utilization over time

– Allows for forecasting

SAN management software provides the tools– Inventory databases

– Report writers


Performance Management

What is it?– Capturing metrics and monitoring trends

– Proactively or Reactively responding

– Planning for future growth

Areas and functions– Host, Fabric and Storage Performance

– Building baselines for the environment


Lesson: Summary

Topics in this lesson included:– Infrastructure protection

– Provisioning

– Capacity Management

– Performance Management


Lesson: SAN Deployment Examples


Describe common SAN deployment considerations

Explain SAN deployment examples

Describe SAN Challenges


When Should a SAN be Used?

SANs are optimized for high bandwidth block level I/O

Suited for the demands of real time applications – Databases: OLTP (online transaction processing)

– Video streaming

Any applications with high transaction rate and high data volatility– Stringent requirements on I/O latency and throughput

Used to consolidate heterogeneous storage environments– Physical consolidation

– Logical consolidation


Consolidation Example: DAS Challenge

ServersServersServers

Storage


Consolidation Example: SAN Solution

Servers Servers

Array

Switch

Servers


Connectivity Example: Challenge

Server

SwitchesArray

Array

Server

Server

Server

Server


Connectivity Example: Solution

ServerServer

Server

Server

Server

Array

Switches


FC SAN Challenges

Infrastructure– New, separate networks are required.

Skill-sets– As a relatively new technology, FC SAN administrative skills need to

be cultivated.

Cost– Large investments are required for effective implementation.


Lesson: Summary


Common SAN deployment considerations.

SAN Implementation Scenarios– Consolidation

– Connectivity

SAN Challenges


Module Summary

Topics in this module included:

The features and benefits of SAN.

The physical and logical elements of SAN.

The common SAN topologies.

Comparison of SAN connectivity devices.

The connectivity options of SAN.

The I/O flow in the SAN environment.

SAN management considerations.

Applications of a SAN strategy.


Check Your Knowledge

Name three key features of a SAN implementation.

What is a Switch?

Describe how a SAN can be connected?

What is one common SAN topology?

What are two management considerations for a SAN environment?

What is a Fabric?

What is a Core-Edge Fabric?


Apply Your Knowledge

Connectrix™ Family of

SAN Switches and Directors


Apply Your Knowledge…

Upon completion of this topic, you will be able to:

Describe EMC’s product implementation of the Connectrix™ Family of SAN Switches and Directors.


The Connectrix Family

MDS-9120

MDS-9140

DS-220B

MDS-9509

ED-140M

MP-1620M

MDS-9506

MDS-9216i/A

AP-7420B

MP-2640M

DS-4100B

ED-10000M

ED-48000B

DS-4700M

DS-4400M

High-speed Fibre Channel connectivity- 1 to 10 gigabits per second

Highly resilient switching technology, and

options for IP storage networking.

configure to adapt to any business need


Switches versus Directors

Connectrix Switches– High availability through

redundant deployment

– Redundant fans and power supplies

– Departmental deployment or part of Data Center deployment

– Small to medium fabrics

– Multi-protocol possibilities

Connectrix Directors– “Redundant everything”

provides optimal serviceability and highest availability

– Data center deployment

– Maximum scalability

– Maximum performance

– Large fabrics

– Multi-protocol


Connectrix Switch - DS-220B

Provides eight, 12, or 16 ports– Auto-detecting 1, 2, and 4 Gb/s Fibre Channel ports

– Single, fixed power supply

– Field-replaceable optics

– Redundant cooling

Simplified setup—no previous SAN experience needed– Eliminates the need for advanced skills to manage IP addressing or

Zoning


Connectrix Director – MDS 9509

Multi-transport switch—Fibre Channel, FICON, iSCSI, FCIP– 16 to 224 Fibre Channel ports

– 4–56 Gigabit Ethernet ports for iSCSI or FCIP

– Non-blocking fabric

– 1 / 2 Gb/s auto-sensing ports

All components are fully redundant

MDS-9509


Connectrix Management Interfaces

MDS-SeriesFabric Manager

MDS-SeriesFabric Manager

M-SeriesWeb Server

M-SeriesWeb Server

B-SeriesWeb Tools

B-SeriesWeb Tools


Module Summary

The Connectrix Family of Switches and Directors;

Has three product sets:– Connectrix B-Series

– Connectrix MDS 9000 Series

– Connectrix M-Series

Provides highly available access to storage.

Connects a wide range of host and storage technologies.

STF3-3-FC-SAN

Documents

storage area

host bus adapter

world wide

san management

world wide

connectrix

edge fabric

rights reserved