1 10/31/2013 Software Big Data overview & future considerations for the BCM Professional Matthew Johnston Managing Director, South Asia Dell | Software
Nov 07, 2014
1 10/31/2013 Software
Big Data overview & future
considerations for the BCM Professional
Matthew Johnston Managing Director, South Asia Dell | Software
2 10/31/2013 Software
Agenda
Big Data defined
Big Data use cases BCM + Big Data Why Dell Software?
3 10/31/2013 Software
Big Data defined
4 10/31/2013 Software
increase every five years
from new data types
connected devices per adult
use social media
10X
85%
4.3
By 2015, organizations that build a modern information management system will outperform their peers financially by 20 percent. Gartner, “Information Management in the 21st Century“
27%
The world of data is changing
5 10/31/2013 Software
Data is created and consumed at a rapid pace…
$600 billion dollars in waste annually for bad data or poor quality data.
70% of data is created by consumers. But enterprises are responsible for storing and managing 80% of it.
1.8 Zettabytes of business data in use in 2011, up 30% from 2010.
$232 billion dollars will be spent on Big Data through 2016
4.4 million IT jobs globally will be created to support big data. Only 1/3 will be filled.
37.5% of large organizations said that analyzing big data is their biggest challenge.
247 billion emails are sent every day. 80% are spam.
48 hours of video are uploaded to YouTube every minute, resulting in 8 yeas of content daily.
200 million photos are uploaded to Facebook every day. That’s 6 billion pictures every month.
6 10/31/2013 Software
…generating new sets of questions
6
Why is our product more popular with teenagers?
How will my social media campaign impact my product launch?
How do I capture, analyze, and manage all of this data?
Will monsoons impact my sales in Indonesia and parts availability from my suppliers next quarter?
How do I make the connections?
How do I turn this data into operational intelligence?
Advanced Analytics Social and Web Analytics Live Data Feeds
7 10/31/2013 Software
What is Big Data?
capture
manage
analyze
Results in datasets too large or complex for typical database or data management tools to…
7
Volume A large amount of data, growing at rapid rates
Information of increasing…
Velocity Data that must be processed at high speed to facilitate
rapid decisions
Variety Wide range of data types and structure
8 10/31/2013 Software
Big Data versus traditional database
1. Reads are fast 2. Standards and governance
1. Loads are fast 2. Flexibility and agility
Pros
Traditional Database “Schema-on-Write”
Big Data (Hadoop) “Schema-on-Read”
• Schema must be created before any data can be loaded
• An explicit load operation has to take place in order to transform data to the DB internal structure
• New columns must be added explicitly before new data for those columns can be loaded into the database
• Data is simply copied to the file store (HDFS), no transformation is needed
• As data is being read into HDFS, the required columns are extracted during the process
• New data can start flowing at any time since the schema is created as part of the process
9 10/31/2013 Software
HPC Enabling exascale computing on massive data sets
Cloud Helping enterprises build open interoperable clouds
Open Source Contributing code and fostering ecosystem
Forces driving Big Data advancement
9
10 10/31/2013 Software
Think Big Data when…
Relevant data exists across multiple data sources and various formats
Streams of data are being generated, but capturing, storing and processing presents challenges
Cost to scale is prohibitively high
Large volumes of useful archived data resides on tapes (unrecoverable after a certain period of time)
Most of the data needs to be analyzed rather than just a small subset of the data
Impossible / impractical to perform data analysis with existing technology stack
11 10/31/2013 Software
Big Data use cases
12 10/31/2013 Software
Big Data in action: Mobile subscriber QoS
Replicate thin to save • Measure, compare and understand what factors influence the number of people visiting a location at any time
• Use analysis to improve subscriber quality of service
13 10/31/2013 Software
Big Data in action: IP TV subscriber recommendation engine
13
• Collect subscriber clickstreams and viewing history
• Add subscriber metadata from web-based movie database
• Provide viewing recommendations to subscribers
Clickstreams
EPG
VoD
14 10/31/2013 Software
Big Data in action: Financial services
Overcome increasingly cumbersome data volumes scaling into petabytes that hinder analysis Gain operational efficiency by moving jobs to technology designed to process multiple data types Empower business users to ask different questions to improve decision making
15 10/31/2013 Software
BCM + Big Data Usage Trends
16 10/31/2013 Software
What is BCM and why Big Data?
Business Continuity Management (BCM)
Big Data
Is a holistic management process which helps to assess, plan and strengthen the resilience of your value chain. Business Continuity National Focal Point - http://www.bcm.org.sg/
Enables the assessment & analysis of large disparate data sets.
17 10/31/2013 Software
Use cases for Big Data (Hadoop)
Operational Data Processing (data pain points)
EDW Augmentation
ETL Offload Batch Processing Data Reservoir Log Processing
Customer 360 View
Content Optimization
Recommendation Engine
Network Analytics Fraud Detection
Predictive Analytics (bigger questions)
18 10/31/2013 Software
Use cases relevant to BCM
Operational Data Processing (data pain points)
EDW Augmentation
ETL Offload Batch Processing Data Reservoir Log Processing
Customer 360 View
Content Optimization
Recommendation Engine
Network Analytics Fraud Detection
Predictive Analytics (bigger questions)
19 10/31/2013 Software
Why Dell Software?
20 10/31/2013 Software
Information Management
Database management
Application & data integration
Business intelligence and Big data analytics
Integrate data disparate data stores, cloud and on-prem
Discover trends and make informed decisions with
analysis based on all data
Manage data and databases across
structured and non-structured data
sources - cloud or on-premise
21 10/31/2013 Software
Information Management
Database management
Application & data integration
Business intelligence and Big data analytics
One Vendor – Complete Tool Chain - All Data
Data location agnostic
Data type
agnostic
Vendor agnostic
22 10/31/2013 Software
Data center & cloud management
Client management
Performance management
Virtualization & cloud mgmt
Windows server mgmt
Mobile device mgmt
Desktop virtualization
Application/data access
Secure remote access
Information management
Database management
Application & data integration
Business intelligence/analytics
Dell Software Solutions
Mobile workforce management
Identity & access management
Network security
Endpoint security
Email security
Security Data protection
Enterprise backup & recovery
Virtual protection
Application protection
Disaster recovery
23 10/31/2013 Software
Summary
• BCM is about risk mitigation
• Big Data is about understanding data
• BCM + Big Data = Better understanding & analysis of the risk
Thank you