Keynote 11 Data Center Evolution: Hyperscale vs. Enterprise Architectures Val Bercovici Cloud and Big Data Czar NetApp, Inc. @valb00 2015 Santa Clara, California
Keynote 11Data Center Evolution:Hyperscale vs. Enterprise ArchitecturesVal BercoviciCloud and Big Data CzarNetApp, Inc.
@valb00
2015Santa Clara, California
Science (Fiction?)
2 © 2015 NetApp, Inc. All rights reserved.
Exponential Growth of Computing20th Through 21st Centuries
URL: http://www.singularity.com/charts/page70.html
3
Analytics
Competitive advantage463%
Cloud
of CIOs indicate that cloud is one of their Top 5 priorities3
60%
Social
productivity increase125%
Mobile
of the world’s population have a mobile device2
75%© 2015 NetApp, Inc. All rights reserved.
SSOCIAL
MMOBILE
AANALYTICS
CCLOUD
NoSQLNewSQL
OLTP Enterprise Hyperscale Emerging
Application
Data Model
BlockFile
Key-Value Store
Columnar,Document,Graph
Streaming,Resource Mgmt
at Scale
Evolving Application Architecture Landscape
4 © 2015 NetApp, Inc. All rights reserved.
© 2015 NetApp, Inc. All rights reserved.
Product CatalogDocument Store
Financial Transactions
Relational StoreShopping CartKV Session Store
AnalyticsColumn Store
Product ImagesObject Store
User SessionsKV Store
Personalized Recommendations Graph Store
Sample Polyglot App
5
Unintended Consequences
6
Data Management Ramifications
Supply Chain Trends
SMAC
© 2015 NetApp, Inc. All rights reserved.
SSOCIAL
MMOBILE
AANALYTICS
CCLOUD
Economics Driving Polarization of Storage
7Access Latency
$$$
SLCeMLC
MLCTLC
SCM
Solid State95% R / 5% W
Cloud
Archive
HDD1% R / 99% W
DRAM
TAPE
EntDrive
Performance Capacity
© 2015 NetApp, Inc. All rights reserved.
Google Quarterly Spend $3.5BYearly Spend $14B
All?Yearly Spend $50B<
3D
Storage Intelligence 1.0
Storage Intelligence
1.0
T10 T13
“NetApp selected Samsung solid-state drives to bring enterprise-grade performance and capacity to a customer base that also expects the cost effectiveness of V-NAND TLC flash. The combination of NetApp Clustered Data ONTAP software value with Samsung hardware component expertise has helped the NetApp All Flash FAS array become the fastest growing product in NetApp history.”
– Lee Caswell, VPProduct and Solutions Marketing
NetApp, Inc.© 2015 NetApp, Inc. All rights reserved. 8
New Memory / Storage Tiers
© 2015 NetApp, Inc. All rights reserved. 9
NVM/Persistent Memory Programming Model – pmem.io
10
Hardware
Kernel
User
NVM Driver
Optimized Applications
Naming Layer
Open NVM Kernel API
NVM Management NVM User-space API
NVM Hardware
Block Layer
Middleware (e.g. JVM)
Raw Access
File Access
File File or Raw Access
Management Applications
(GUI, CLI, CIM)
File System
File Access
NVM Customer Kernel Modules
Control Path
Data Path
Standard Access NVM Regions Exposed as Files NVM API
© 2015 NetApp, Inc. All rights reserved.
Management in the SCM Data Path: Latency Rules
11
NFS/Block/LRSE
AFF ClusterServer-side
Persistence Store Server
Application
Data Model
SCM DriverOperating System
HypervisorServer-side Persistence Store
Server
Application
Data Model
SCM DriverOperating System
Hypervisor
Server
Application
Data Model
SCM DriverOperating System
Hypervisor
Server
Application
Data Model
SCM DriverOperating System
HypervisorServer-side Persistence Store Server-side Persistence Store
OnCommand.Next
© 2015 NetApp, Inc. All rights reserved.
New Data Center Storage Stack Circa 2020
12
XaaS
DataNode
DataNode
DataNode
DataNode
DataNode
ComputeNode
ComputeNode
ComputeNode
ComputeNode
ComputeNode
Distributed/Parallel Processing
Host CacheSoftware
Memßà Mem RDMA (iWARP/RoCE) SCM
Independent Scaling
1 μsec
Shared Storage (POSIX + Object)
Data Globally Managed by
Federated/Shared Storage
Persistence/Intelligent Caching Layer
© 2015 NetApp, Inc. All rights reserved.
2015Santa Clara, California
Waterfall “Lean Cloud” (Enterprise & Hyperscale)Lifecycle ComparisonsApp/Container lifecycle placement tomaximize hybrid cloud economics
Summary: Cloud Landscape Since 1/1/2012
The BVP Cloud IndexBessemer Venture PartnersAugust 2015
14
Source: Gartner, July 2013Note: Estimates per 2013. Cloud includes SaaS, PaaS and IaaS. Overall IT includes worldwide spend in Data Center Systems, Enterprise Software and IT Services.
Cost of Cloud Price Index Specification Over Timen = Market Weighted Average of 70% of Market
Cloud Price Index, 451 Research, July 16, 2015
© 2015 NetApp, Inc. All rights reserved. 15
LoB Tech Spend
2014Enterprise Technology Spend Ratios
16
IT Budget
66%
2008
Run
20%Grow
© 2015 NetApp, Inc. All rights reserved.
14%Transform
Tech Spend à Mapped to Project Lifecycles
Transform14%
Grow20%
Run66%
17 © 2015 NetApp, Inc. All rights reserved.
Application Lifecycles
Dev/TestLab
Deploy/ScaleNew Infrastructure
MaintainLegacy Infrastructure
18 © 2015 NetApp, Inc. All rights reserved.
19
Amazon Web Services IaaS (Storage) Deployments: Analysis and Insight IDC #255387April 2015
Economics of a Hybrid Cloud Ecosystem
HyperscaleAWS, Azure,GCE, Aliyun
(M)SPVerizon, T-Systems,Telstra, HP, Rackspace
Hosting/On-PremiseGoDaddy, Dreamhost
20
LowerProductionCosts
Burst forPeak
Workloads
HostStatic
Workloads© 2015 NetApp, Inc. All rights reserved.
Scale-Up Scale-Out In-Memory
New Resource Managers and Control Points
21 © 2015 NetApp, Inc. All rights reserved.
ConvergedHCI / RSA
Redis / TachyonSpark / FlinkSwift / Riak
HDFS / CEPH
OpenStack / Mesos / YARN / Kubernetes
StoragePersistence
Infrastructure
Management
Architecture Biases: Today
22
Hyperscale
(M)SPHosting/On-Premise
© 2015 NetApp, Inc. All rights reserved.
Scale-Up Scale-OutScale-Up
StoragePersistence
Infrastructure
Management
Scale-Out
Architecture Biases: Tomorrow
23
Hyperscale
(M)SPHosting/On-Premise
© 2015 NetApp, Inc. All rights reserved.
In-Memory
Scale-Up
Scale-Out
StoragePersistence
Infrastructure
Management
Scale-UpScale-Up
2015Santa Clara, California
Thank You