SAS technology making the bridgebtw Capacity and Performance · Capacity and Performance … Technology inside ... half-height blades in c7000 Enclosure 3. ... Performance Chassis

SAS technology making the bridge btwgy g gCapacity and Performance …

Technology inside…

Barnabas NAGY, Storage, SecurityFeb/04/2011 --- [email protected]

© Copyright 2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Confidentiality label goes here

ATA P ATA SATA FATA FC SCSI iSCSI SSD é SAS

FibreChannel technology, but why ?ATA, P-ATA, SATA, FATA, FC, SCSI, iSCSI, SSD és SAS

Why do we need FibreChannel?y• Memory Channel and high performance parallelizm

2

ATA P ATA SATA FATA FC SCSI iSCSI SSD d SASFibreChannel technology, but why ?

ATA, P-ATA, SATA, FATA, FC, SCSI, iSCSI, SSD and SAS

Why did we changed to SAS?y g

– SCSI fall short of new SCSI 1280: o Performance vs length – SCSI 640o Performance vs. length SCSI 640o Parallel cables strep \ overheating

– SAS – Serial Attached SCSI o Inicialisator, Target and Expander

3

P f d t

FibreChannel technology, but why ?Performance data

4

Serial Attached SCSI – SAS technológy levelsS i l

Any additional text can go here

Serial …

y gand can have multiple lines of content• Any additional text can go here

d h lti l li f t tand can have multiple lines of content

5

Serial Attached SCSI – SAS technology capabilitiesMultiple disk connectionMultiple disk connection

Multiple Disk connectionsSerial Attached SCSI – SAS technology capabilitiesMultiple Disk connections

7

Zoning and the managementsSerial Attached SCSI – SAS technology capabilitiesZoning and the managements

ZoningSerial Attached SCSI – SAS technology capabilitiesZoning

9

Multi-node SAS cluster – FC local loop topology: NoSPoF ASICSerial Attached SCSI – SAS technology capabilities

Multi-node SAS cluster – FC local loop topology: NoSPoF, ASIC chipsets

10

Architecture inside. Multy tenancy.

Traditional, Monolithic architecture

3PAR InSpire® Architektúra

pont‐pont or switch connections

Monolithic architecture

pont‐pont or switch connections

Tradicional Modular Architecture

autonomic loadbalanced Cluster

Host Connection

Adat Cache

Diszk Connection

balanced Cluster

Hardware Based for PerformanceThin Built inZero Detect

Fast RAID 10, 50 & 60 Rapid RAID RebuildIntegrated XOR Engine

Tightly‐Coupled ClusterHigh Bandwidth, Low Latency 

Interconnect

Mixed WorkloadIndependent Metadata and Data 

Processing

Mixed Workload: multy tenancy workload

Unified Processor

strong throughput MB\s

I/O :  traditional data storagehosts

DiskHost Unified Processor and/or Memory disk

strong transaction I/Olow IOPs waits for more IOPs

Disk interface

Host interface

I/O :  MultyTenancy Controller Nodehosts

= control information (metadata)= data

Control Processor  & Memory

SAS ASIC & Memorystrong throughput MB\s

strong transaction I/O 

Host interface disk

Disk interface

Control information and data different path

IBRIX Fusion Solves Two Enterprise Storage Problemsp g• High Capacity

− Need extremely scalable storage to y gsupport high volume, unstructured data growth

• Infinite capacity scalabilityp y y

• Just-in-time scalability

• Better manageability

• High PerformanceN d f d l bl

14 4 February 2011

− Need fast and scalable access to data-intensive applications

• Remove I/O bottlenecks

The Storage Stack of the 21st Century • The File System (a.k.a. namespace) has become the common abstraction• A Segmented File System aggregates a powerful but monolithic file system

allowing scalability and manageability and enabling new data managementallowing scalability and manageability and enabling new data management capabilities

EXT3 or ZFS

Sna

psho

ts

Bac

kup

Rep

licat

ion

HSM

SRM

Clu

ster

ing

Device Drivers

Volume ManagerEXT3 or ZFS

15 4 February 2011

Monolithic File System IBRIX: Parallelize Monolithic File System

Challenges of Scaling Storage:Traditional Monolithic File Systems

Challenges:Many Small File Systems

Management/Administration Overhead Explodes

Data Layout Issues• Data Layout Issues (Hotspots & Duplication)

• Multiple File SystemsMount Point Management

OR

C O N S T R A I N E D

Issue: Management Complexity

• Mount Point Management

Faults will Happen, Statistically• Operational Faults

All or NothingFile Systems

C O N S T R A I N E D

16 4 February 2011

• Operational Faults• System FaultsIssue: Scalability Limited by

System/Box , Architecture/Capacity

Challenges of Scaling Storage:What Customers Need: Best of BothWhat Customers Need: Best of Both

Scalable Single Name Space Fil S i h R ili d

Many Small File Systems

File System with Resiliency and Fault Containment

All or NothingFile Systems

Advantages:

• Independent Performance and Capacity Scaling

17 4 February 2011

Capacity Scaling• Manageability• Availability

Previous Solutions Have Bottlenecks Centralized ArchitecturesMetadata ServerNamespace Server

Doesn’t Scale

pLock ManagerToken Manager

• Most enterprise application workloads are metadata intensive

− Small files, small I/Os, random t d t ti

Data

access, metadata operations Central component is a bottleneck

Distributed Lock ManagersAny server can modify any portion of the file systemData

18 4 February 2011

portion of the file system

X9320 Network Storage System Hardware componentsS l tf− Server platform processor

• 2x HP X9300 file serving node, Intel® Xeon® Processor E5520 Quad Core 2.26 GHz; 1 standard

− Memory• 48GB (6 x 8GB)

− Internal Controller• Internal Smart Array Controller with internal SAS port for O/S drives

− Internal Storage• 2 x 146GB 3G SAS 15K 3.5" ENT hot-plug LFF HDDs (O/S mirror)

− Network Ports:• 8 x 1GbE (1GbE models) or• 4 x 1GbE + 2 x 10GbE (10GbE models)

− Management Ports• 1 Integrated Lights Out (iLO2) port

− Server expansion slots• 6 x PCIe HP X9320 12U (2 servers and 4x 2U disk enclosures)

− RAID Controllers• 2x MSA 2312sa SAS (48TB “capacity” models)• 4x MSA 2312sa SAS (21.6 TB “performance” models)

− Disk enclosures• 4 x 2U-12 drive enclosures (48 drive bays)

− Drives• 450GB 3G 15K 3.5 inch Dual-port SAS HDD• 1TB 7.2K rpm 3.5 inch SATA HDD

Couplet VDisk & LUN LayoutPerformance Couplet Disk Assignments

vdisk 1SAS spare

vdisk 1

vdisk 1vdisk 1vdisk 1

vdisk 2vdisk 2vdisk 2

vdisk 2vdisk 2disk 2

Capacity Couplet Disk Assignments

vdisk 1SATA spare vdisk 1

vdisk 1vdisk 1vdisk 1

vdisk 1vdisk 2 00

0

vdisk 3vdisk 3

vdisk 5

vdisk 1vdisk 3

vdisk 5vdisk 5

vdisk 1

vdisk 3vdisk 3

vdisk 4vdisk 4

vdisk 6vdisk 6

vdisk 2

vdisk 4

vdisk 4

vdisk 6

vdisk 2

vdisk 4vdisk 4

vdisk 6

SATA sparevdisk 2vdisk 2

vdisk 3

vdisk 1vdisk 2

vdisk 3vdisk 3

vdisk 1

vdisk 2vdisk 2

vdisk 2vdisk 2

vdisk 4vdisk 4

vdisk 1

vdisk 3

vdisk 3

vdisk 4

vdisk 2

vdisk 3vdisk 3

vdisk 4SATA spare

MSA

2000 M

SA

2000

SAS spare

vdisk 3

vdisk 5vdisk 5

vdisk 7vdisk 7

vdisk 5

vdisk 7

vdisk 8

vdisk 6

vdisk 8

vdisk 6

vdisk 8

vdisk 8

vdisk 6vdisk 6

vdisk 8vdisk 8

vdisk 7vdisk 7

vdisk 7

vdisk 3vdisk 3

vdisk 3

vdisk 4vdisk 5

vdisk 3

vdisk 5

vdisk 5

vdisk 4

vdisk 5

vdisk 4

vdisk 5

vdisk 5

vdisk 4vdisk 4

vdisk 5vdisk 5

vdisk 4vdisk 4

SATA spare

M

MS

A20

• 4 global hot spares• 4X 7+2 and 1X 6+2 RAID6 VDisks• VDisk1, VDisk3 and VDisk5 assigned to Controller A• VDisk2 and VDisk4 assigned to Controller B

• 2 global hot spares• 6X 5+1 RAID5 and 2X 4+1 RAID5 VDisks• VDisks 1, 3, 5, 7 assigned to Controller A• VDisks 2, 4, 6, 8 assigned to Controller B

• 1 LUN per VDisk• 5 LUNs *(segments) per couplet

• 1 LUN per VDisk• 8 LUNs per couplet

HP StorageWorks X9720 Extreme Data Storage System

1. Software – Proven in Content Rich EnvironmentsI t t d t t

Integrated hardware/software solution

– Integrated system management– Simplified performance and capacity scaling– Multiple access protocols

NFS CIFS X90002. Performance Blocks – Scale Performance

– Up to 12.8 cores/UStarting at 3 blades expand up to 16 blades

• NFS, CIFS, X9000

– Starting at 3 blades, expand up to 16 blades– Quad-core, half-height blades in c7000 Enclosure

3. Capacity Blocks – Industry Leading DensityU t 12TB/U– Up to 12TB/U

– Starting at 82TB, expand to 656TB– Scales in 82TB Capacity Blocks

HP StorageWorks X9720System Specifications

System• Standard HP 42U Rack 12.8 cores/U and Power*Standard HP 42U Rack 12.8 cores/U and 12TB/U (increases with cores/capacities)• 3-16 Blade Servers• 1-8 Capacity Blocks

• 4 in base rack (328 drives)• 4 in expansion rack (328 drives)

• Min config: 13.8A, 3.23kW• Max config: 54A, 12.42kW• Performance block: .9A, 0.2kW• Capacity block: 9A, 2.07kW

• 4 in expansion rack (328 drives)• Complete Redundancy, NSPOF• NFS and CIFS Protocol Support

Weight• Base Min: 1,159lbs• Max Expansion: 1,697lbs• Per Performance Block: 14lbs• Per Capacity Block: 359lbsPer Capacity Block: 359lbs

Performance Capability• 16GB/s Blades to Ethernet Switch• 5 4GB/s Storage to Chassis (seq read)

Thermal• Base Min: 11,002 Btu/hr• Expansion Max: 28,252 Btu/hr• Performance Block: 682 Btu/hr• 5.4GB/s Storage to Chassis (seq read)

• 2.6GB/s Storage to Chassis (seq write)• Performance Block: 682 Btu/hr• Capacity Block: 7,063 Btu/hr

HP StorageWorks X9720 Blade Server

Blade Server• Dual Quad Core Intel Xeon Processors 2.53 Ghz• Two Internal 2.5-inch 300 GB 10K SAS drives

D l 10Gb NIC (PCA)• Dual 10Gb NICs (PCA)• Dual 3 Gb/sec SAS Connections (Mezzanine Slot)• 16GB Memory

Chassis• 16 Blade Server Bays 10U• 16 Blade Server Bays, 10U• 8 Interconnect Bays• Bays 1&2, Network modules, two HP Virtual Connect Flex-10 10Gb

Ethernet Module (455880-B21), Note: Requires transceivers for networking connectivity

• Bays 3&4 Redundant 3Gbit SAS Switches 8 4x ports (32 SAS lanes)• Bays 3&4, Redundant 3Gbit SAS Switches, 8-4x ports (32 SAS lanes) each

• Bays 5,6,7&8, Reserved for future use

HP StorageWorks X9720Performance Chassis

Flex-10 VC Modules 1-2

SAS SwitchesBay 1: VC Module 1 Bay 2: VC Module 2

Bay 3: SAS switch Bay 4: SAS switch

Reserved for Future Use

Bay 5: Reserved for Future Use Bay 6: Reserved for Future Use

Bay 7: Reserved for Future Use Bay 8: Reserved for Future Use

Redundant Onboard Administrator

HP StorageWorks X9720 Capacity Blocks

Disk Drives• 1TB 7200 RPM Dual-Port SAS Midline• Standard Hot Swappable HP carriers

Capacity Block• 82 drives in 7U• Dual-Redundant Active-Active Controllers• Redundant 3Gbit SAS Connect• Eight 8+2 RAID6 groups, 2 hot spares, 78% storage

ffi iefficiency• 340lbs with drives loaded

HP StorageWorks X9720X9720cx: cascaded dense storageg• Dual drawer

− Fully connected and operational when pulled outwhen pulled out

• 70x1TB SAS midline disks drives in 5U− All hot swappable

• 4 SAS expansion ports − 2 per drawer

• Dual redundant power supplies and fans per drawer

Power supplyFront Display

and fans per drawer− All hot swappable

• Front display showing drive status (green, orange, …)

Fan

(green, orange, …)

IO Module

HP StorageWorks X9720SAS backend (simplified connection diagram)( p g )

Bla

de1

P700mha

ssi

3-16 blades (aka X9720 Blade Servers)

Bla

de N

P700m

SAS Switch 1 SAS Switch 2

Ch

RAID Controller 1

X9720c

apac

ity

RAID Controller 2

RAID Controller 1

X9720c

RAID Controller 2

X972

0 C

aB

lock

X972

0cx

5x7=35 disks per drawer

5x7=35 disks per drawer

1-8 X9720 capacity blocks

X972

0cx

5x7=35 disks per drawer

5x7=35 disks per drawer

Standard (4x) Configuration #4 (Minimum)26 HDD Per Server

28

BladeSystem Storage Unbound HP offers customer choice

iSCSI

Storage Host Interface

FCiSCSI

SASInfiniband

Zoned and Shared Storage choices

MSA & innovative

Virtualization choicesHP VSE, VMware, XenSource, MS Veridian

choicesJBOD expansion

Internal Direct Attach and Shared Storage choicesInternal DAS Internal shared Internal Shared

SSD and HDD Storage choices

External NAS or SAN:

SB40c AiO SB600c SB50c

File/Print and Block

Coming soon

External NAS or SAN: AiO, PSS, MSA, EVA, XP, Scalable File storage choices

Internal Tape

Internal and external Data Protection choices

External Tape LibraryDisk Backup

File/Print and BlockStorage choices

April 2009 – HP Restricted. For HP and channel partner internal use.LTO 4

MSL Tape LibraryVLS LibraryPSS/ AiO

April 2009 – HP Restricted. For HP and channel partner internal use.30