How Open Source Will Change How You Think about Storage - LGI Tech Summit

SCOTT RYAN, SVP & GM STORAGE PRODUCTS

HOW OPEN SOURCE WILL CHANGE THE WAY YOU THINK ABOUT STORAGESeptember 14, 2014

STORAGE MARKET DYNAMICS

THE RISE OF OPEN SOURCE STORAGE PROJECTS

- RETHINKING STORAGE

SESSION OUTLINE

THE RISE OF OPEN SOURCE STORAGE PROJECTS

- RETHINKING STORAGE

SESSION OUTLINE

STORAGE MARKET DYNAMICS

DATA STORAGE “SHORTFALL”Data stores are growing exponentially, while IT budgets are not

20232013

IT BUDGET2% CAGR

(2013-2023)

IT ProfessionalsWill Shoulder a Greater Storage

Burden

STORAGE CAPACITY62% CAGR

(2013-2023)

230 GBPer IT Pro

2013

1,231 GB

Per IT Pro2023

HDDs are becoming more dense, but $/GB decline is slowing

Software and hardware advances are needed to close the gap

Source: IDC, The Digital Universe of Opportunities: Rich Dataand the Increasing Value of the Internet of Things, April 2014

ORGANIZATIONS ARE RETHINKING STORAGE

2016 2017 2018 2019 2020$0

$5,000

$10,000

$15,000

$20,000

$25,000

$30,000

$35,000

$40,000

$45,000

$50,000

Hyperscale Software-defined StorageEnterprise Software-defined StorageEnterprise Traditional Storage

TAM

(milli

ons)

Source: Wikibon

Traditional SAN/NAS storage market is in accelerating

decline

Software-defined storage (SDS) grows from 12% to 49%

between 2016-2020

Most of the SDS marketis hyperscale today

Enterprise SDS is smaller to date, but where the faster

growth is expected

SOFTWARE-DEFINED STORAGE (SDS)SDS ENABLES ABSTRACTION OF THE

HARDWAREFROM THE SOFTWARE

Independence from

high-cost proprietary HW +

SW systems leads to better

pricing and freedom of choice

Hardware is treated

as a pool, scalableacross multiple storage systems

Innovative functionality,

easier to manage, faster to

implement,and more flexible

to scale-out

Integral part of the software-defined

data center (SDDC)

KEY BENEFITS

TRADITIONAL VS. SDS

Lower cost, standardized supply chain

Increased operational flexibility

More programmability, agility, and control

More flexible, well-integrated technology

TRADITIONAL SDS

ProprietaryHardware

Scale-UpArchitecture

Hardware-BasedInnovation

Closed DevelopmentProcess

Common,Off-The-Shelf

HardwareScale-Out

Architecture

Software-BasedInnovation

Open DevelopmentProcess

STORAGE MARKET DYNAMICS

THE RISE OF OPEN SOURCE STORAGE PROJECTS

SESSION OUTLINE

- RETHINKING STORAGE

OPEN SOURCE =GOOD BUSINESS

NEARLY 9 in 10 SAY THAT OPEN SOURCEGREATLY IMPACTS THE SPEED OF INNOVATION – ALIGNING WITH TIME TO MARKET FOR NEW PRODUCTS

UP FROM 45% IN 2014

NEARLY 8 in 10 SAY THAT OPEN SOURCE IMPROVES MARGINS AND GROWS REVENUE

OVER

65%GAIN COMPETITIVE

ADVANTAGE

COTS HARDWARE + OPEN SOURCE SOFTWARE + COMMUNITYWHAT IS OPEN SOURCE STORAGE?

Support & Maintenance

Proprietary Software

Proprietary HardwareCPUCPUCPU

DiskDiskDisk

Enterprise Products & Services

Open Source Software

COTS Hardware

By 2018 Open Source Storage will gain 20% of the market, approx. $10B*

CPUCPUCPU

DiskDiskDisk

*(Gartner, “2014 Strategic Roadmap for Storage”, March 2014)

OPEN SOURCE STORAGE STACKDISTRIBUTEDPROCESSING

CLOUDCOMPUTING

OS

STORAGE

DATABASE

SWIFT

TOP OPEN SOURCE STORAGE PROJECTS• Number one storage choice for OpenStack installations• Contributors include RedHat, Intel, SanDisk, CERN, and

Yahoo• Block, File, Object: RADOS, RBD, Ceph FS, S3, Swift

• Over 11M downloads in the last 12 months• File: GlusterFS, CIFS, NFS• RedHat ownership increasing project interest

92 authors/last mo

1,139 commits/last mo

39 authors/last mo

234 commits/last mo

• Part of the OpenStack project• Contributors include SwiftStack, RedHat, HPE, Intel,

Rackspace, IBM• Object: Swift

30 authors/last mo

48 commits/last mo

SWIFT

CEPH INTRODUCTION• Open source software-defined storage • Massively scalable• Object, block and file system storage in a single

platform• Runs on COTS hardware – saving cost and offering

improved flexibilityOBJECTRADOS S3/SWIFT

ObjectObject

Object

Object

Object

Object

Object

FILENFS CIFS

BLOCKRBD

CEPH BASICS• Massively Scalable to Exabytes• Self-healing and Self-managing• Automatic distribution of replicas• Auto-rebalancing• Redundancy though data replication• Rack and data center aware• No need for RAID• Fully distributed – no single point of

failure• APIs and cloud integration for self-

service

RGWA web

services gateway for

object storage

LIBRADOSA library allowing apps to directly access

RADOS

RADOSA software-based reliable, autonomous,

distributed object store comprised of self-healing, self-managing, intelligent storage

nodes and lightweight monitors

RBDA reliable,

fully distributed

block device

CEPH FSA

distributed file system with POSIX semantics

Application Host / VM Client

WHAT ABOUT THE HARDWARE?Original Design Manufacturers (ODM)• Provide a more cost effective storage

infrastructure- ODMs operate on 10% GM versus 60-70%

• Strong ecosystem of design and build partners• Have built strength in parts depots and field

support• Through necessity with many large web-scale

companies buying direct• Intel white-box design helps fast-track their

designs• Quick release cycles and adopt newer

technology quickly

STORAGE MARKET DYNAMICS

THE RISE OF OPEN SOURCE STORAGE PROJECTS

SESSION OUTLINE

- RETHINKING STORAGE

File & Object Services Node(Provides S3, Swift, NFS, CIFS)

Performance Data Node(2 SSDs, 10 HDDs)

Capacity Data Node(6 SSDs, 30 HDDs)

Starts small,

Expands tomultiple racks

Applications

OPENEXASCALESTORAGE

OPENEXASCALESTORAGE

RADOS RBD NFS CIFSS3 Swift

Object Pools Block Pools

Self-Healing

Auto-Balancing Scrubbing Thin

Provisioning Snapshots

HA Ethernet

CRUSH Map & Placement Groups

VolumesBuckets VolumesBuckets

Cap Data Nodes Perf Data NodesHigh Cap Data Nodes

SSDs HDDs SSDs HDDsSSDs HDDs

Software-defined Storage Delivered on Qualified Hardware Support for Hardware & Software

of the Top 25 Service Providers in North America

Several of the Top Service Providers

in Europe

6

Including

TRUST

VISION

PERFORMANCE

COST

Proven Performance

VOD, Cloud DVR need consistent speed

Multi-workload & Open Source

Economics of SDS are Strong

FEATURES Fast-paced community development

WHY?

CUSTOMERS

VIDEO OPENSTACK SYNC-N-SHARE BACK-UP / DR

OPEN STORAGE USE CASES

Power next generation

video services with advanced, proven

storage.

Simplify storage management

and service provisioning

for OpenStack.

Solve the “shadow IT”

problem – maintain compliance and

secure intellectual property

Utilize the cost economics

and scaling of object on one

multi-workload system

• Media file storage for customer-facing application• Drop-in replacement for legacy object backend• Minimal resistance to increasing scale• Multi-protocol capable for future service• Fast transaction capable

FOR MEDIA

QUESTIONS?