Storage Virtualization Strategies

Storage Virtualization StrategiesStorage Virtualization Strategies

Arun Taneja

Founder, Taneja Group

September 25, 2006

AgendaAgenda

• Next Generation Data Center & Virtualization

• Storage Virtualization Approaches, Architecture, & Players

• Other Types of Virtualization & their Impact on Storage

• Recommendations to End Users

Virtual Server Virtual Server Virtual Server Virtual Server

• “Pools” of commonly grouped physical resources

• Dynamic allocations based on application level grouping and usage policies

• Interconnected and controlled through an intelligent interconnect fabric

Server Processing I/O StorageApplications

Intelligent Fabric

Stand-By

Resource Pool

Compute Networking and Storage VirtualizationCompute Networking and Storage Virtualization

Virtualized Data CenterVirtualized Data Center

• Four main types of virtualization technologies emerging:

– Server Virtualization

• Virtualizes the physical CPU, Memory, I/O of servers

– I/O Virtualization

• Virtualizes the physical network topology and mappings between

servers and storage

– File Virtualization

• Virtualizes files and namespaces across file servers

– Storage Virtualization

• Virtualizes physical block storage devices

The State of Data StorageThe State of Data StorageA Snapshot of “Where We Are” Today:

• Data Tsunami Continues• Data Scattered across data centers and remote

locations• Stringent Compliance And Regulatory Environment• Data Protection is at a break point• Can’t add IT staff indiscriminately to keep up with

capacity growth• Storage management tools are archaic• Storage tiers still infancy. Data is not mobile.

Typical SAN TodayTypical SAN Today

Ultimate Vision of SAN is Incomplete

SANSAN

V1V1

V2V2V3V3

V4V4 V5V5

Server 1Server 1

V1V1

V2V2 V3V3 V4V4 V5V5

Server 2Server 2 Server 3Server 3 Server 4Server 4

Why Storage Virtualization is En Vogue Again…Why Storage Virtualization is En Vogue Again…

• Heterogeneous Storage is a Reality

• Data Migration, Data Consolidation are Disruptive Processes Today

• V has Passed the “Hype” and “Low Point” Stages and into “Reality” Stage

• Big guys have Ratified the Concept (IBM, EMC, HDS)

What is Storage Virtualization?What is Storage Virtualization?

• Separation of Physical and Logical

• Enables One Common Set of Applications

• Physical can be Heterogeneous or Homogeneous

• Underwear

RAID equals elemental storage virtualization

Heterogeneous & Homogeneous Heterogeneous & Homogeneous VirtualizationVirtualization

EMCEMC

Virtualization LayerVirtualization Layer

Common Storage ApplicationsCommon Storage Applications

EMCEMC HDSHDS JBODJBOD

What Does Storage Virtualization Enable?What Does Storage Virtualization Enable?

• Consistent Interface for All Storage Applications

• Non-disruptive LUN Creation, Expansion, Deletion

• Non-disruptive Data Consolidation, Data Migration

• Non-disruptive RAID Level Changes

• Tiering of Storage Using Hetero Storage

• Replication Across Hetero Storage

• Backup/Restore, Archival, Thin Provisioning, etc.

Storage Virtualization Completes SAN Vision…

Where Can It Be Done?Where Can It Be Done?Host-based Host-based

VolumeVolumeManagementManagement

Network-basedNetwork-basedVirtualizationVirtualization

ApplianceAppliance Purpose BuiltPurpose BuiltAppliance (PBA)Appliance (PBA)

Controller-basedController-basedVirtualizationVirtualization

SANSAN

Intelligent SwitchIntelligent Switch

Types of Network-based SolutionsTypes of Network-based Solutions1. Intel-based platforms (Appliance):

– Simple and cost-effective form factor

– Most widely deployed approach to date

– Rich set of advanced storage applications available

– Examples: IBM SVC, DataCore, FalconStor

2. Purpose-built appliances (PBA):– Strong interoperability support in heterogeneous environments

– Support for multiple storage applications

– Designed for mid-range to mission-critical apps

– Require two management interfaces

– Examples: QLogic/Troika

Types of Network-based Solutions ContinuedTypes of Network-based Solutions Continued

3. Intelligent Switches:– Promises highest levels of scalability, availability, and

performance

– Data-center ready design

– Virtualization controller software unproven & lack key storage applications

– Relatively higher cost per port

– Switch Examples: Brocade, Cisco, McData

– Virtualization Controller Examples: EMC InVista, Incipient, StoreAge

Fundamental ConceptsFundamental Concepts• Metadata Server

– Maintains Configuration Database

– Virtualization Mapping Tables

• Control Path Software– Provides Interface Between Metadata Server and Data Path Server

– Performs Background I/O Tasks

• Data Path Software– Moves Data from Server to Storage (and vice versa)

– Performs Translation from Virtual to Physical Addresses

Note: Datapath Software is Always in the Data Path

Virtualization Architectures: In-Band vs. Virtualization Architectures: In-Band vs. Out-of-BandOut-of-Band• In-Band

– Data and Control Data are managed by same compute elements

– Initial implementations lacked scalability and performance

– Newer implementations much more scalable and “enterprise-class”

– Examples: IBM SVC, FalconStor

• Out-of-Band

– Separates data and control paths

– Requires host agents creating management complexity and potential for security breaches

– Example: StoreAge

Virtualization Architectures: Split Path Virtualization Architectures: Split Path Architecture for Intelligent Devices (SPAID)Architecture for Intelligent Devices (SPAID)

• Hybrid of In-Band & Out-of-Band Approaches

– Separates control path from the data path

– Leverages port-level processing capabilities of intelligent

switches or purpose-built controllers

– Unproven approach given the lack of availability of intelligent

switches (holds highest potential)

– Example: EMC InVista, Incipient, StoreAge

SPAID ArchitectureSPAID Architecture

Arrays

Hosts

Fabric AFabric B

Split Path Architecture Most I/O are routed through the Fast Path at near

line speeds on purpose-built ASICs Few I/Os are faulted to the Control Path (CP) No state / no cache Full fabric bandwidth Scalable across entire fabric

Intelligent FC Switch

Players and StrategyPlayers and Strategy

• IBM (SVC on Appliance)

• EMC (InVista on Intelligent Switches)

• Incipient (Incipient on Intelligent Switches)

• HDS (Internal Controller)

• QLogic/Troika (PBA via Partnerships with Software Vendors)

• StoreAge (Out of band Appliance or Intelligent Switch)

• FalconStor (Appliance)

• Cloverleaf (Appliance)

• Cisco, Brocade/McData (Intelligent Switches via Partnerships)

File System VirtualizationFile System Virtualization

• Abstraction of logical relationships above

individual file system image

• Separates user and group relationships from

specific devices

• Enables creation of exports and shares

Creates a global namespace

Server Virtualization & StorageServer Virtualization & Storage• Server virtualization presents unique challenges

for storage– Much higher SAN attach rate than traditional applications

– Shared storage & CLVM is common deployment for VM

mobility (e.g. VMotion & Live Migration)

– HBAs must be specifically qualified to run at hypervisor level

for VMWare

– Single HBA shared across all virtualized guest OSes

Server Virtualization & Virtual HBAsServer Virtualization & Virtual HBAs• Enables HBAs to be virtualized using industry-standard N-Port ID Virtualization

(NPIV)• Enables SAN best practices, standard management tools in a virtualized

environment– Examples: Fabric zoning, Array-based LUN masking

NPIV HBAs

A B C

Hypervisor

A B C

Hypervisor

HBAs

Server

OS

Single Fibre Channel

view shared among all virtual machines Logical views for each VM

or group of VMs

Server

OS OS OSOS OS

I/O I/O I/O

I/O

SAN (single view) AB

C

Example: Example: EmulexEmulex

Network & I/O VirtualizationNetwork & I/O VirtualizationIO Virtualization

– Quickly map and re-map server and storage

configuration (e.g. MAC & WWN identifiers, boot images,

etc) so that applications can be provisioned and re-

provisioned without changes to fabric or servers.

– Step toward virtual data center and stateless servers

that change personality based on demand

– Ex. HP Virtual Connect, Cisco VFrame, Voltaire

GridVision

Recommendations to UsersRecommendations to Users

• If Mostly Homogeneous, virtualization is still

important.– Stay with existing vendor’s virtualization solution.

• If Highly Heterogeneous, go with intelligent

switch, PBA, or appliance

• Ensure the Applications you want are Available

• Be Wary of Internal Controller Approaches

• Ensure Solution is Not “All or Nothing”

QuestionsQuestions

Arun Taneja

[email protected]