Top Banner
Flash Memory Arrays in Enterprise Applications Ken Ow-Wing, Senior Product Line Manager Violin Memory, Inc. 685 Clyde Ave, Mountain View, CA 94043 Office: 650-396-1603 Mobile: 415-608-7773 Santa Clara, CA August 2011 1
32

Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Apr 30, 2018

Download

Documents

lephuc
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Flash Memory Arrays in Enterprise Applications

Ken Ow-Wing, Senior Product Line ManagerViolin Memory, Inc.

685 Clyde Ave, Mountain View, CA 94043Office: 650-396-1603 Mobile: 415-608-7773

Santa Clara, CAAugust 2011 1

Page 2: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Agenda

Santa Clara, CAAugust 2011 2

Enterprise Customer RequirementsNew Product CategoryEnterprise Use CasesBusiness Benefits

AppendixEconomicsArray Characteristics

Page 3: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Enterprise Environments: Requirements

Santa Clara, CAAugust 2011 3

Flash Performance Consistent Low Response Time Reliability Availability Serviceability Scalability Manageability Resource Utilization

Page 4: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Evolution of Use of Flash

8/4/20114

3RD GENERATION

2ND GENERATION

1ST GENERATION

PURPOSE-BUILT ENTERPRISE SOLUTIONNetworked/shared storage

Sustained R/W throughput

7x24x365 operation

Workstation/GamingMemory extension/cacheLimitations for High End Data Center Usage

Direct drive replacementCost sensitiveLimitations for High End Data Center Usage

Flash Memory Array

Flash Memory Array

Page 5: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Flash Memory Arrays

8/4/2011Violin Memory Inc. Proprietary5

Flash Chips4GB

Flash Package32GB

1344 Packages

Capacity VIMMs512GB

84 memory modules

Capacity Flash Systems40TB in 3U

Flash Memory Array

10,400Chips

Data Center packaging reduces capital cost, space, power and operations costs. Infrastructure Consolidation

Flash vRAID Group2560GB

16 Groups

Page 6: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Flash Memory Storage – 2PB

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

6

Silicon Virtualized Data Center

Page 7: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA7

Available as shelves

Available by the rack

Flash Memory Arrays

Fits in Virtualized Environments

Page 8: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

High Performance Database Solution for OLTPArchitecture View512GB memory15 TB max DB size100M OLTP trans / hr

Production DatabaseIn Flash Memory Array

Disk)

2 x 10GbE Switches

Production Server

App/Test/Dev Server

SoftwareProduction Data BaseStorage mgmt

Database Appliance – 20,000 users

• Fits in OEM system

Page 9: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Difference Benefit* No support for rotating media Optimum performance with flash* Distributed Garbage Collection Sustained Writes, no “Write Cliff”* Purpose Built “vRAID” for Flash Sustained Writes, no “R/M/W”* vRAID not blocked by erasures Significant Latency reduction* vRAID protects flash devices No replacement on flash failure* Flash Packaging Density > 10TB per RU

What’s Different about Flash Memory Arrays?

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

9

* Flash Memory Arrays are different from SSD and/or flash cards

Compared to SSD

Page 10: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

FLA

SH

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECC

FLA

SH

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECCFL

AS

H

VIMM

RC ECCRC ECCRC ECC

FLA

SH

VIMM

RC ECCRC ECCRC ECC

A1 A2 A3 A4 Ap

B1 B2 B3 B4 Bp

RAID Group 1

RAID Group 2

Spare VIMM

External Hosts or

SAN

RA

ID C

ontr

olle

r(s)

RC ECCUser Data

A B

Failure Handling Result: Data rebuilt on same VIMM VIMM stays in service No data loss Increases MTBF 4X

Details – Example Flash chip fails (Red) vRAID rebuilds data on

same VIMM (Blue) Garbage collection avoided,

performance maintained Rebuilt data on extra NAND HW RAID in Controller

Hardware Flash RAID

8/4/2011Violin Memory, Inc. Proprietary

10

1st Purpose Built RAID for Flash Memory Arrays

* Violin Intelligent Memory Module

Page 11: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Difference Benefit* No support for rotating media Optimum performance with flash* Distributed Garbage Collection Sustained Writes, no “Write Cliff”* Purpose Built “vRAID” for Flash Sustained Writes, no “R/M/W”* vRAID not blocked by erasures Significant Latency reduction* vRAID protects flash devices No replacement on flash failure* Hot swappable components No outage or data loss* Shareability Max utilization by many servers* Scalability Lg. dataset w/simplicity* Flash Packaging Density > 10TB per RU

What’s Different about Flash Memory Arrays?

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

11

* Flash Memory Arrays are different from SSD and/or flash cards

CCompared to PCIe Card with Flash

Page 12: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Violin Memory, Inc Proprietary12

The Infamous SSD “Write Cliff”The elephant in the room everyone tries to ignore

Source: SC 2010

PeroEmpty device

(their Datasheet numbers)

PeroReal performance

Page 13: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Violin Memory, Inc Proprietary13

Sustained Performance(Violin Datasheet number)

220,000+ IOPS

Violin – Sustained performance

Page 14: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

14

Enterprise Use Cases

Page 15: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Violin Memory Inc. Proprietary

15

Multi-coreCPU

RESPONSE TIME (Access Delay)

10 TB

1 PB

1 TB

100 TB

ns 2ms 8ms 20ms1µs

Processor Cache

DRA

M

SATA

Arr

ay

150µs

SLC

Flas

h A

rray

s

Application Acceleration

DRAM-like Performance

Persistent block-storage

Databases/Caches/Logs

Tiered Storage 2.0

400 TB

SSD

sEm

ulat

ing

HD

Ds

15K

Dis

kA

rray

Stor

age

Cach

eN

VRA

M

500µs

Capa

city

Fla

sh A

rray

s

400µs

Infrastructure Consolidation

HDD-like Density/Cost

Storage-Cache Latency

File storage

CAPACITY/RACK

Page 16: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA16 146 GB 15K 600 GB 15K 2 TB SATA 15K

100’s of servers

Tape Archive

Co-exist with Legacy HDD Systems

Co-exist with Legacy HDD Systems

Transaction Processing

Page 17: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA17

400 to 600 GB FC disk

2-4 TB SATA/ SAS disk

OLTP DW/ODS Nearline Archive

Fully UtilizeDisk Capacity

60 GB tape

Flash Memory Arrays

Move high performance transactions to Flash Memory Arrays

Short-Stroked 146-600GB 15K FC disk

400-600 GB FC disk

Transaction Processing

High IOPsLow Latency>Server Utilization> IOPs/sq. foot

Page 18: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Multi-Tenancy

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

18

Max Availability,Isolation,Utilization

Big Host

Little Hosts

Combine containers: Max HA & I/O

2 partitions are HA with 2 PCI-E each

Or Container Level Isolation

Each customer gets their own partition

Page 19: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

OLTP, DW, ODS

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

19

Net Benefit: Analytics For Big Data

Big Host

Little Hosts

OLTP

Operational Data Store (ODS) -Analytics

Data Warehouse (DW)

Data Marts

Page 20: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Facilitates:Movement to HighEnd Commercial Data Center usage

Next evolutionary step beyond capabilities ofSSD and Flash PCIe boards

Extend Benefits of Flash beyond current performance and latencybenefits

Extending the Use of Flash…..

Enablers:ScalabilityShare-abilityManageabilityI/O

Sustained WritesHot SwapHARAIDFail-in-placeRemote mgmt.Partitions

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

20

Page 21: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

SNMPInterface - System and network mgmt Ex: HP NNM and IBM Tivoli tools

Array mgmt Wear mgmt 5 Year MLC lifetime

under std maintenance agreement

Manageability

REST APIInterface to proprietary provisioning systemsXLM interface to management systems

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

21

Remote AdminSingle Web GUI & CLIXML API & SNMPEmail alertsSingle multi-PB image

Page 22: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

22

Business Benefits

Page 23: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Application Acceleration w/HP

8/4/2011

+ = $0.63 with Flash RAID

vs. $2.40 (Oracle Exadata 2)or $1.01 without RAID

(Oracle SuperCluster 2011)

Open ArchitectureScales Linearly

OLTP Results November, 2010

Total System Cost: Transactions/Min Price/Performance

$2,126,304 ($900,000 = Oracle SW)

3,388,535 $0.63 (per transaction per minute)

Processors/Cores Database Manager Operating System

8/64

Intel Xeon 2.26 GHz

Oracle Database 11g Rel 2 Enterprise

Oracle Linux Basic

TUXEDO 11gR1

HP ProLiant DL980 G7

Flash Memory Array

70% ReductionsCostRack spacePowerResponse time

Database Options:Oracle 8/9/10/11/RACMS SQL ServerSybase + Others

Page 24: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Application Acceleration Meet & Exceed SLAs Simpler System Architectures Deploy new apps faster Reduce tuning costs

Infrastructure Consolidation

Reduce CapEx and OpEX Fewer Spindles, licenses, servers Less Power, space, service Leverage existing infrastructure Enable Virtualization

Lower $ per Application

Key Business Benefits

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

24

SAN/LAN

After Flash Memory Array

Before Flash Memory Array

Flash Memory Array

SAN/LAN

Low CPUUtilization

High CPUUtilization

Server Farm

Server Farm

Page 25: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Data Center Transformation

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

25

“The transition from spinning to solid-statestorage is already underway.”

Steve O’Donnell, ESG

Resource utilization OpEx Reduction Reliability Availability Serviceability Power Space Cooling

Page 26: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

26

Key Take Always

Flash Memory Arrays:

Suitable for High End Enterprise Applications

Meet Enterprise Application requirements**

**Summary of requirements:

Flash Performance Consistent low response timeReliability, Availability, Serviceability ScalabilityManageability Resource Utilization

Page 27: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

27

Appendix

Page 28: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Category Characteristic (8 racks) UsesScalability* 2 + PB Large Active Data Sets

IOPS** 64,000,000 Migrate from short-stroked 15K FC HDD

Bandwidth** 400 GB/sec read 256 GB/sec write

Excellent ingest and data distribution

Latency 25 µs write 75 µs read

Max server utilization

Availability HA and RAID High end applicationsManageability XLM/SNMP interfaces High end applications

Protocols FC, iSCSI, IB (Q3), NFS Multiple environments

I/O (512) 8 Gbit FC ports or(512) 10 GbE ports(64) 40 GB/sec IB ports (Q3)

Max resource utilization

Flash Memory Array Characteristics

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

28* Raw ** Theoretical

Page 29: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

Cost per Application

Flash MemoryArrays

SATA/SAS FC

$/IOPS (4K) $1.00 $17.00 $20.00

Compelling Economics

8/4/2011

Flash Memory Summit, August 2011 Santa Clara, CA

29

PerformancePer Rack

Flash Memory Arrays

ConventionalHDD Arrays

HDD/SDD Combination

IOPS 2,000,000* 24,000 40,000Latency 200 µsec 5000 µsec 2000 µsec

* Based on one rack with 8 memory arrays

Cost per GBFlash

Flash Memory Arrays

RAID-1 SSDs in Array

PCIe Flash in Mirrored Systems

$/GB with RAID $22.00 $100 - $200 $60.00

Page 30: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

600+ Terabytes and countingProblem: ORACLE Ad Server Reporting only met 8 hour SLA twice in 6 months

Goal: consistent sustainable IO performance to meet SLA under EMC’s Enterprise Storage management tools

Result: On Violin Arrays without any tuning, haven’t missed SLAs

AOL is now able to further enhance their Ad Campaign Reporting Reinforcing what works, pruning what doesn’t

Potential for positive revenue impact going forward

AOL was one of EMC’s VPLEX key launch customers• Global production prior to official launch by EMC

• Significant amount of VPLEX support matrix was validated @ AOL

• Violin 3200 Memory Array certified under EMC VPLEX Winning combination of consistent sustainable performance under world-class enterprise management

system

• VPLEX certification enables Violin’s products to be seamlessly used in EMC environments

Flagship Customer

8/4/201130 Violin Memory, Inc Proprietary

Page 31: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

HP & Microsoft - Best of Breed

TPC-E Blade server world Record – June 2010 This is the first use of non-HP storage in an HP TPC benchmark Flash Memory Arrays only operating at 35% utilization Other HP benchmarks due shortly The TPC-E benchmark simulates the OLTP workload of a brokerage firm. The focus of the benchmark is the central

database that executes transactions related to the firm’s customer accounts. Although the underlying business model of TPC-E is a brokerage firm, the database schema, data population, transactions, and implementation rules have been designed to be broadly representative of modern OLTP systems.

8/4/2011 CONFIDENTIAL 31

Page 32: Flash Memory Arrays in Enterprise Applications · Infrastructure Consolidation. Flash vRAID Group. 2560GB. ... App/Test/Dev Server. ... consistent sustainable IO performance to meet

8/4/2011Flash Memory Summit, August 2011 Santa Clara, CA

32

Thank You