Batten Down the Hatches for the Data Deluge Bradley King Chief Architect
Jan 12, 2015
Batten Down the Hatches for the Data Deluge
Bradley King Chief Architect
This is NOT a drill – the deluge is real!
- EMC’s Digital Universe 2011: 1.8 Zettabytes created during the year and in the next decade 75X more data !
- Forbes 2012: 1 Billion GB/minute transferred by mobile devices alone
- Annual growth rate estimates vary between 50-100%
- EMC Digital Universe 2012 graph
2 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
What does the deluge look like to you?
Like the picture from The Economist? A confident executive using the deluge of data to grow his business
3 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
What does the deluge look like to you?
Or what Icelanders call “Jökulhlaups”? A volcano melts ice until it breaks an ice dam and… the result is inevitable
4 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
What does the deluge look like to you?
Or Thursday 12th to Friday the 13th in Boulder Colorado? Unprepared for the unexpected
5 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
A bit of history and a bit of Forecast
A Short History of e-mail quota table-stakes
7
0
5000
10000
15000
20000
25000
1998 2000 2002 2004 2006 2008 2010 2012 2014
Free Quota ‐MB
Free Quota ‐ MB
| OX Summit 2013: Scality – Batten down the hatches for the data deluge
The Forecast
- The Social nature of messaging and collaboration is here to stay – and nobody wants to pay for it!
8 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
The Forecast
- The Social nature of messaging and collaboration is here to stay – and nobody wants to pay for it!
- User Interfaces “disappear.” No more manuals!
9
“Make things as simple as possible , but no simpler.”Albert Einstein
| OX Summit 2013: Scality – Batten down the hatches for the data deluge
The Forecast
- The Social nature of messaging and collaboration is here to stay – and nobody wants to pay for it!
- User Interfaces “disappear.” No more Manuals! Think OX
- The Heading is Mobile (You knew that right?)
Ericsson Mobility Report : By Q1 2013, total mobile subscriptions exceeded 6.4 billion
10 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
The Forecast
- The Social nature of messaging and collaboration is here to stay – and nobody wants to pay for it!
- User Interfaces “disappear.” No more Manuals! Think OX
- The Heading is Mobile
- You knew all of that right? So where are YOU going?
11 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
- The volume of messages & documents that service providers must store and the revenue obtained by storing them are only loosely coupled
- It is going to be “worse” than you think – Exponential changes always are.
- The opportunities created by the data deluge are real
What are the implications?
12 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
Navigating with Scality
For Safe Navigation, service platforms must be:
- Economical
- Reliable & Disaster Resistant
- Easy to Manage
- Elastic and Supple: Billions of small files, millions of huge files
- Source of knowledge, not a source of problems
- Always on – maintenance windows are no longer an option
14 | OX Summit 2013: Scality – Batten down the hatches for the data deluge
The Scality Solution
Scality RING Organic Storage 4
x86x86
RingTopology
P2P
End-to-EndParallelism
DATA
MD
ObjectStorage
MESANewSQL DB
Replication
ARC
ErasureCoding
GeoRedundancy
Tiering
HTTP/RESTS3, CDMINFS, CIFS
SOFS
AccessMethods
Management
Enterprise &Cloud Email
System
File Storage
Scale Out File SystemNFS & CIFS
StaaS
S3 & CDMI API
Big Data
DataProcessing
with Hadoop
HPC
HighThroughput
Storage
Digital Media
Origin ServerMedia Asset Management
Fast File Transfer
| OX Summit 2013: Scality – Batten down the hatches for the data deluge15
Some companies Scality is helping navigate the deluge
16
Telcos
Big DataMedias
Service Providers
| OX Summit 2013: Scality – Batten down the hatches for the data deluge
Thank you for your time
&
Stop by the Scality Demopoint