SCOTT RYAN, SVP & GM STORAGE PRODUCTS HOW OPEN SOURCE WILL CHANGE THE WAY YOU THINK ABOUT STORAGE September 14, 2014
Apr 13, 2017
SCOTT RYAN, SVP & GM STORAGE PRODUCTS
HOW OPEN SOURCE WILL CHANGE THE WAY YOU THINK ABOUT STORAGESeptember 14, 2014
STORAGE MARKET DYNAMICS
THE RISE OF OPEN SOURCE STORAGE PROJECTS
- RETHINKING STORAGE
SESSION OUTLINE
THE RISE OF OPEN SOURCE STORAGE PROJECTS
- RETHINKING STORAGE
SESSION OUTLINE
STORAGE MARKET DYNAMICS
DATA STORAGE “SHORTFALL”Data stores are growing exponentially, while IT budgets are not
20232013
IT BUDGET2% CAGR
(2013-2023)
IT ProfessionalsWill Shoulder a Greater Storage
Burden
STORAGE CAPACITY62% CAGR
(2013-2023)
230 GBPer IT Pro
2013
1,231 GB
Per IT Pro2023
HDDs are becoming more dense, but $/GB decline is slowing
Software and hardware advances are needed to close the gap
Source: IDC, The Digital Universe of Opportunities: Rich Dataand the Increasing Value of the Internet of Things, April 2014
ORGANIZATIONS ARE RETHINKING STORAGE
2016 2017 2018 2019 2020$0
$5,000
$10,000
$15,000
$20,000
$25,000
$30,000
$35,000
$40,000
$45,000
$50,000
Hyperscale Software-defined StorageEnterprise Software-defined StorageEnterprise Traditional Storage
TAM
(milli
ons)
Source: Wikibon
Traditional SAN/NAS storage market is in accelerating
decline
Software-defined storage (SDS) grows from 12% to 49%
between 2016-2020
Most of the SDS marketis hyperscale today
Enterprise SDS is smaller to date, but where the faster
growth is expected
SOFTWARE-DEFINED STORAGE (SDS)SDS ENABLES ABSTRACTION OF THE
HARDWAREFROM THE SOFTWARE
Independence from
high-cost proprietary HW +
SW systems leads to better
pricing and freedom of choice
Hardware is treated
as a pool, scalableacross multiple storage systems
Innovative functionality,
easier to manage, faster to
implement,and more flexible
to scale-out
Integral part of the software-defined
data center (SDDC)
KEY BENEFITS
TRADITIONAL VS. SDS
Lower cost, standardized supply chain
Increased operational flexibility
More programmability, agility, and control
More flexible, well-integrated technology
TRADITIONAL SDS
ProprietaryHardware
Scale-UpArchitecture
Hardware-BasedInnovation
Closed DevelopmentProcess
Common,Off-The-Shelf
HardwareScale-Out
Architecture
Software-BasedInnovation
Open DevelopmentProcess
STORAGE MARKET DYNAMICS
THE RISE OF OPEN SOURCE STORAGE PROJECTS
SESSION OUTLINE
- RETHINKING STORAGE
OPEN SOURCE =GOOD BUSINESS
NEARLY 9 in 10 SAY THAT OPEN SOURCEGREATLY IMPACTS THE SPEED OF INNOVATION – ALIGNING WITH TIME TO MARKET FOR NEW PRODUCTS
UP FROM 45% IN 2014
NEARLY 8 in 10 SAY THAT OPEN SOURCE IMPROVES MARGINS AND GROWS REVENUE
OVER
65%GAIN COMPETITIVE
ADVANTAGE
COTS HARDWARE + OPEN SOURCE SOFTWARE + COMMUNITYWHAT IS OPEN SOURCE STORAGE?
Support & Maintenance
Proprietary Software
Proprietary HardwareCPUCPUCPU
DiskDiskDisk
Enterprise Products & Services
Open Source Software
COTS Hardware
By 2018 Open Source Storage will gain 20% of the market, approx. $10B*
CPUCPUCPU
DiskDiskDisk
*(Gartner, “2014 Strategic Roadmap for Storage”, March 2014)
OPEN SOURCE STORAGE STACKDISTRIBUTEDPROCESSING
CLOUDCOMPUTING
OS
STORAGE
DATABASE
SWIFT
TOP OPEN SOURCE STORAGE PROJECTS• Number one storage choice for OpenStack installations• Contributors include RedHat, Intel, SanDisk, CERN, and
Yahoo• Block, File, Object: RADOS, RBD, Ceph FS, S3, Swift
• Over 11M downloads in the last 12 months• File: GlusterFS, CIFS, NFS• RedHat ownership increasing project interest
92 authors/last mo
1,139 commits/last mo
39 authors/last mo
234 commits/last mo
• Part of the OpenStack project• Contributors include SwiftStack, RedHat, HPE, Intel,
Rackspace, IBM• Object: Swift
30 authors/last mo
48 commits/last mo
SWIFT
CEPH INTRODUCTION• Open source software-defined storage • Massively scalable• Object, block and file system storage in a single
platform• Runs on COTS hardware – saving cost and offering
improved flexibilityOBJECTRADOS S3/SWIFT
ObjectObject
Object
Object
Object
Object
Object
FILENFS CIFS
BLOCKRBD
CEPH BASICS• Massively Scalable to Exabytes• Self-healing and Self-managing• Automatic distribution of replicas• Auto-rebalancing• Redundancy though data replication• Rack and data center aware• No need for RAID• Fully distributed – no single point of
failure• APIs and cloud integration for self-
service
RGWA web
services gateway for
object storage
LIBRADOSA library allowing apps to directly access
RADOS
RADOSA software-based reliable, autonomous,
distributed object store comprised of self-healing, self-managing, intelligent storage
nodes and lightweight monitors
RBDA reliable,
fully distributed
block device
CEPH FSA
distributed file system with POSIX semantics
Application Host / VM Client
WHAT ABOUT THE HARDWARE?Original Design Manufacturers (ODM)• Provide a more cost effective storage
infrastructure- ODMs operate on 10% GM versus 60-70%
• Strong ecosystem of design and build partners• Have built strength in parts depots and field
support• Through necessity with many large web-scale
companies buying direct• Intel white-box design helps fast-track their
designs• Quick release cycles and adopt newer
technology quickly
STORAGE MARKET DYNAMICS
THE RISE OF OPEN SOURCE STORAGE PROJECTS
SESSION OUTLINE
- RETHINKING STORAGE
File & Object Services Node(Provides S3, Swift, NFS, CIFS)
Performance Data Node(2 SSDs, 10 HDDs)
Capacity Data Node(6 SSDs, 30 HDDs)
Starts small,
Expands tomultiple racks
Applications
OPENEXASCALESTORAGE
OPENEXASCALESTORAGE
RADOS RBD NFS CIFSS3 Swift
Object Pools Block Pools
Self-Healing
Auto-Balancing Scrubbing Thin
Provisioning Snapshots
HA Ethernet
CRUSH Map & Placement Groups
VolumesBuckets VolumesBuckets
Cap Data Nodes Perf Data NodesHigh Cap Data Nodes
SSDs HDDs SSDs HDDsSSDs HDDs
Software-defined Storage Delivered on Qualified Hardware Support for Hardware & Software
of the Top 25 Service Providers in North America
Several of the Top Service Providers
in Europe
6
Including
TRUST
VISION
PERFORMANCE
COST
Proven Performance
VOD, Cloud DVR need consistent speed
Multi-workload & Open Source
Economics of SDS are Strong
FEATURES Fast-paced community development
WHY?
CUSTOMERS
VIDEO OPENSTACK SYNC-N-SHARE BACK-UP / DR
OPEN STORAGE USE CASES
Power next generation
video services with advanced, proven
storage.
Simplify storage management
and service provisioning
for OpenStack.
Solve the “shadow IT”
problem – maintain compliance and
secure intellectual property
Utilize the cost economics
and scaling of object on one
multi-workload system
• Media file storage for customer-facing application• Drop-in replacement for legacy object backend• Minimal resistance to increasing scale• Multi-protocol capable for future service• Fast transaction capable
FOR MEDIA
QUESTIONS?