SAS technology making the bridge btwgy g gCapacity and Performance …
Technology inside…
Barnabas NAGY, Storage, SecurityFeb/04/2011 --- [email protected]
© Copyright 2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Confidentiality label goes here
ATA P ATA SATA FATA FC SCSI iSCSI SSD é SAS
FibreChannel technology, but why ?ATA, P-ATA, SATA, FATA, FC, SCSI, iSCSI, SSD és SAS
Why do we need FibreChannel?y• Memory Channel and high performance parallelizm
2
ATA P ATA SATA FATA FC SCSI iSCSI SSD d SASFibreChannel technology, but why ?
ATA, P-ATA, SATA, FATA, FC, SCSI, iSCSI, SSD and SAS
Why did we changed to SAS?y g
– SCSI fall short of new SCSI 1280: o Performance vs length – SCSI 640o Performance vs. length SCSI 640o Parallel cables strep \ overheating
– SAS – Serial Attached SCSI o Inicialisator, Target and Expander
3
P f d t
FibreChannel technology, but why ?Performance data
4
Serial Attached SCSI – SAS technológy levelsS i l
Any additional text can go here
Serial …
y gand can have multiple lines of content• Any additional text can go here
d h lti l li f t tand can have multiple lines of content
5
Serial Attached SCSI – SAS technology capabilitiesMultiple disk connectionMultiple disk connection
Multiple Disk connectionsSerial Attached SCSI – SAS technology capabilitiesMultiple Disk connections
7
Zoning and the managementsSerial Attached SCSI – SAS technology capabilitiesZoning and the managements
ZoningSerial Attached SCSI – SAS technology capabilitiesZoning
9
Multi-node SAS cluster – FC local loop topology: NoSPoF ASICSerial Attached SCSI – SAS technology capabilities
Multi-node SAS cluster – FC local loop topology: NoSPoF, ASIC chipsets
10
Architecture inside. Multy tenancy.
Traditional, Monolithic architecture
3PAR InSpire® Architektúra
pont‐pont or switch connections
Monolithic architecture
pont‐pont or switch connections
Tradicional Modular Architecture
autonomic loadbalanced Cluster
Host Connection
Adat Cache
Diszk Connection
balanced Cluster
Hardware Based for PerformanceThin Built inZero Detect
Fast RAID 10, 50 & 60 Rapid RAID RebuildIntegrated XOR Engine
Tightly‐Coupled ClusterHigh Bandwidth, Low Latency
Interconnect
Mixed WorkloadIndependent Metadata and Data
Processing
Mixed Workload: multy tenancy workload
Unified Processor
strong throughput MB\s
I/O : traditional data storagehosts
DiskHost Unified Processor and/or Memory disk
strong transaction I/Olow IOPs waits for more IOPs
Disk interface
Host interface
I/O : MultyTenancy Controller Nodehosts
= control information (metadata)= data
Control Processor & Memory
SAS ASIC & Memorystrong throughput MB\s
strong transaction I/O
Host interface disk
Disk interface
Control information and data different path
IBRIX Fusion Solves Two Enterprise Storage Problemsp g• High Capacity
− Need extremely scalable storage to y gsupport high volume, unstructured data growth
• Infinite capacity scalabilityp y y
• Just-in-time scalability
• Better manageability
• High PerformanceN d f d l bl
14 4 February 2011
− Need fast and scalable access to data-intensive applications
• Remove I/O bottlenecks
The Storage Stack of the 21st Century • The File System (a.k.a. namespace) has become the common abstraction• A Segmented File System aggregates a powerful but monolithic file system
allowing scalability and manageability and enabling new data managementallowing scalability and manageability and enabling new data management capabilities
EXT3 or ZFS
Sna
psho
ts
Bac
kup
Rep
licat
ion
HSM
SRM
Clu
ster
ing
Device Drivers
Volume ManagerEXT3 or ZFS
15 4 February 2011
Monolithic File System IBRIX: Parallelize Monolithic File System
Challenges of Scaling Storage:Traditional Monolithic File Systems
Challenges:Many Small File Systems
Management/Administration Overhead Explodes
Data Layout Issues• Data Layout Issues (Hotspots & Duplication)
• Multiple File SystemsMount Point Management
OR
C O N S T R A I N E D
Issue: Management Complexity
• Mount Point Management
Faults will Happen, Statistically• Operational Faults
All or NothingFile Systems
C O N S T R A I N E D
16 4 February 2011
• Operational Faults• System FaultsIssue: Scalability Limited by
System/Box , Architecture/Capacity
Challenges of Scaling Storage:What Customers Need: Best of BothWhat Customers Need: Best of Both
Scalable Single Name Space Fil S i h R ili d
Many Small File Systems
File System with Resiliency and Fault Containment
All or NothingFile Systems
Advantages:
• Independent Performance and Capacity Scaling
17 4 February 2011
Capacity Scaling• Manageability• Availability
Previous Solutions Have Bottlenecks Centralized ArchitecturesMetadata ServerNamespace Server
Doesn’t Scale
pLock ManagerToken Manager
• Most enterprise application workloads are metadata intensive
− Small files, small I/Os, random t d t ti
Data
access, metadata operations Central component is a bottleneck
Distributed Lock ManagersAny server can modify any portion of the file systemData
18 4 February 2011
portion of the file system
X9320 Network Storage System Hardware componentsS l tf− Server platform processor
• 2x HP X9300 file serving node, Intel® Xeon® Processor E5520 Quad Core 2.26 GHz; 1 standard
− Memory• 48GB (6 x 8GB)
− Internal Controller• Internal Smart Array Controller with internal SAS port for O/S drives
− Internal Storage• 2 x 146GB 3G SAS 15K 3.5" ENT hot-plug LFF HDDs (O/S mirror)
− Network Ports:• 8 x 1GbE (1GbE models) or• 4 x 1GbE + 2 x 10GbE (10GbE models)
− Management Ports• 1 Integrated Lights Out (iLO2) port
− Server expansion slots• 6 x PCIe HP X9320 12U (2 servers and 4x 2U disk enclosures)
− RAID Controllers• 2x MSA 2312sa SAS (48TB “capacity” models)• 4x MSA 2312sa SAS (21.6 TB “performance” models)
− Disk enclosures• 4 x 2U-12 drive enclosures (48 drive bays)
− Drives• 450GB 3G 15K 3.5 inch Dual-port SAS HDD• 1TB 7.2K rpm 3.5 inch SATA HDD
Couplet VDisk & LUN LayoutPerformance Couplet Disk Assignments
vdisk 1SAS spare
vdisk 1
vdisk 1vdisk 1vdisk 1
vdisk 2vdisk 2vdisk 2
vdisk 2vdisk 2disk 2
Capacity Couplet Disk Assignments
vdisk 1SATA spare vdisk 1
vdisk 1vdisk 1vdisk 1
vdisk 1vdisk 2 00
0
vdisk 3vdisk 3
vdisk 5
vdisk 1vdisk 3
vdisk 5vdisk 5
vdisk 1
vdisk 3vdisk 3
vdisk 4vdisk 4
vdisk 6vdisk 6
vdisk 2
vdisk 4
vdisk 4
vdisk 6
vdisk 2
vdisk 4vdisk 4
vdisk 6
SATA sparevdisk 2vdisk 2
vdisk 3
vdisk 1vdisk 2
vdisk 3vdisk 3
vdisk 1
vdisk 2vdisk 2
vdisk 2vdisk 2
vdisk 4vdisk 4
vdisk 1
vdisk 3
vdisk 3
vdisk 4
vdisk 2
vdisk 3vdisk 3
vdisk 4SATA spare
MSA
2000 M
SA
2000
SAS spare
vdisk 3
vdisk 5vdisk 5
vdisk 7vdisk 7
vdisk 5
vdisk 7
vdisk 8
vdisk 6
vdisk 8
vdisk 6
vdisk 8
vdisk 8
vdisk 6vdisk 6
vdisk 8vdisk 8
vdisk 7vdisk 7
vdisk 7
vdisk 3vdisk 3
vdisk 3
vdisk 4vdisk 5
vdisk 3
vdisk 5
vdisk 5
vdisk 4
vdisk 5
vdisk 4
vdisk 5
vdisk 5
vdisk 4vdisk 4
vdisk 5vdisk 5
vdisk 4vdisk 4
SATA spare
M
MS
A20
• 4 global hot spares• 4X 7+2 and 1X 6+2 RAID6 VDisks• VDisk1, VDisk3 and VDisk5 assigned to Controller A• VDisk2 and VDisk4 assigned to Controller B
• 2 global hot spares• 6X 5+1 RAID5 and 2X 4+1 RAID5 VDisks• VDisks 1, 3, 5, 7 assigned to Controller A• VDisks 2, 4, 6, 8 assigned to Controller B
• 1 LUN per VDisk• 5 LUNs *(segments) per couplet
• 1 LUN per VDisk• 8 LUNs per couplet
HP StorageWorks X9720 Extreme Data Storage System
1. Software – Proven in Content Rich EnvironmentsI t t d t t
Integrated hardware/software solution
– Integrated system management– Simplified performance and capacity scaling– Multiple access protocols
NFS CIFS X90002. Performance Blocks – Scale Performance
– Up to 12.8 cores/UStarting at 3 blades expand up to 16 blades
• NFS, CIFS, X9000
– Starting at 3 blades, expand up to 16 blades– Quad-core, half-height blades in c7000 Enclosure
3. Capacity Blocks – Industry Leading DensityU t 12TB/U– Up to 12TB/U
– Starting at 82TB, expand to 656TB– Scales in 82TB Capacity Blocks
HP StorageWorks X9720System Specifications
System• Standard HP 42U Rack 12.8 cores/U and Power*Standard HP 42U Rack 12.8 cores/U and 12TB/U (increases with cores/capacities)• 3-16 Blade Servers• 1-8 Capacity Blocks
• 4 in base rack (328 drives)• 4 in expansion rack (328 drives)
• Min config: 13.8A, 3.23kW• Max config: 54A, 12.42kW• Performance block: .9A, 0.2kW• Capacity block: 9A, 2.07kW
• 4 in expansion rack (328 drives)• Complete Redundancy, NSPOF• NFS and CIFS Protocol Support
Weight• Base Min: 1,159lbs• Max Expansion: 1,697lbs• Per Performance Block: 14lbs• Per Capacity Block: 359lbsPer Capacity Block: 359lbs
Performance Capability• 16GB/s Blades to Ethernet Switch• 5 4GB/s Storage to Chassis (seq read)
Thermal• Base Min: 11,002 Btu/hr• Expansion Max: 28,252 Btu/hr• Performance Block: 682 Btu/hr• 5.4GB/s Storage to Chassis (seq read)
• 2.6GB/s Storage to Chassis (seq write)• Performance Block: 682 Btu/hr• Capacity Block: 7,063 Btu/hr
HP StorageWorks X9720 Blade Server
Blade Server• Dual Quad Core Intel Xeon Processors 2.53 Ghz• Two Internal 2.5-inch 300 GB 10K SAS drives
D l 10Gb NIC (PCA)• Dual 10Gb NICs (PCA)• Dual 3 Gb/sec SAS Connections (Mezzanine Slot)• 16GB Memory
Chassis• 16 Blade Server Bays 10U• 16 Blade Server Bays, 10U• 8 Interconnect Bays• Bays 1&2, Network modules, two HP Virtual Connect Flex-10 10Gb
Ethernet Module (455880-B21), Note: Requires transceivers for networking connectivity
• Bays 3&4 Redundant 3Gbit SAS Switches 8 4x ports (32 SAS lanes)• Bays 3&4, Redundant 3Gbit SAS Switches, 8-4x ports (32 SAS lanes) each
• Bays 5,6,7&8, Reserved for future use
HP StorageWorks X9720Performance Chassis
Flex-10 VC Modules 1-2
SAS SwitchesBay 1: VC Module 1 Bay 2: VC Module 2
Bay 3: SAS switch Bay 4: SAS switch
Reserved for Future Use
Bay 5: Reserved for Future Use Bay 6: Reserved for Future Use
Bay 7: Reserved for Future Use Bay 8: Reserved for Future Use
Redundant Onboard Administrator
HP StorageWorks X9720 Capacity Blocks
Disk Drives• 1TB 7200 RPM Dual-Port SAS Midline• Standard Hot Swappable HP carriers
Capacity Block• 82 drives in 7U• Dual-Redundant Active-Active Controllers• Redundant 3Gbit SAS Connect• Eight 8+2 RAID6 groups, 2 hot spares, 78% storage
ffi iefficiency• 340lbs with drives loaded
HP StorageWorks X9720X9720cx: cascaded dense storageg• Dual drawer
− Fully connected and operational when pulled outwhen pulled out
• 70x1TB SAS midline disks drives in 5U− All hot swappable
• 4 SAS expansion ports − 2 per drawer
• Dual redundant power supplies and fans per drawer
Power supplyFront Display
and fans per drawer− All hot swappable
• Front display showing drive status (green, orange, …)
Fan
(green, orange, …)
IO Module
HP StorageWorks X9720SAS backend (simplified connection diagram)( p g )
Bla
de1
P700mha
ssi
3-16 blades (aka X9720 Blade Servers)
Bla
de N
P700m
SAS Switch 1 SAS Switch 2
Ch
RAID Controller 1
X9720c
apac
ity
RAID Controller 2
RAID Controller 1
X9720c
RAID Controller 2
X972
0 C
aB
lock
X972
0cx
5x7=35 disks per drawer
5x7=35 disks per drawer
1-8 X9720 capacity blocks
X972
0cx
5x7=35 disks per drawer
5x7=35 disks per drawer
Standard (4x) Configuration #4 (Minimum)26 HDD Per Server
28
BladeSystem Storage Unbound HP offers customer choice
iSCSI
Storage Host Interface
FCiSCSI
SASInfiniband
Zoned and Shared Storage choices
MSA & innovative
Virtualization choicesHP VSE, VMware, XenSource, MS Veridian
choicesJBOD expansion
Internal Direct Attach and Shared Storage choicesInternal DAS Internal shared Internal Shared
SSD and HDD Storage choices
External NAS or SAN:
SB40c AiO SB600c SB50c
File/Print and Block
Coming soon
External NAS or SAN: AiO, PSS, MSA, EVA, XP, Scalable File storage choices
Internal Tape
Internal and external Data Protection choices
External Tape LibraryDisk Backup
File/Print and BlockStorage choices
April 2009 – HP Restricted. For HP and channel partner internal use.LTO 4
MSL Tape LibraryVLS LibraryPSS/ AiO
April 2009 – HP Restricted. For HP and channel partner internal use.30