Big Data in Real-Time Uğur CANDAN SAP Turkey - Chief Operating Officer @ugurcandan ugurcandan.net
Jan 27, 2015
Big Data in Real-TimeUğur CANDANSAP Turkey - Chief Operating [email protected]
© 2011 SAP AG. All rights reserved. 2
Youtube in-memory database
© 2011 SAP AG. All rights reserved. 3
© 2011 SAP AG. All rights reserved. 4
© 2011 SAP AG. All rights reserved. 5
© 2011 SAP AG. All rights reserved. 6
© 2011 SAP AG. All rights reserved. 7
© 2011 SAP AG. All rights reserved. 8
© 2011 SAP AG. All rights reserved. 9
© 2011 SAP AG. All rights reserved. 10
© 2011 SAP AG. All rights reserved. 11
© 2011 SAP AG. All rights reserved. 12
© 2011 SAP AG. All rights reserved. 13
© 2011 SAP AG. All rights reserved. 14
© 2011 SAP AG. All rights reserved. 15
© 2011 SAP AG. All rights reserved. 16
© 2011 SAP AG. All rights reserved. 17
© 2011 SAP AG. All rights reserved. 18
© 2011 SAP AG. All rights reserved. 19
© 2011 SAP AG. All rights reserved. 20
© 2011 SAP AG. All rights reserved. 21
© 2011 SAP AG. All rights reserved. 22
Technology today requires tradeoffA breakthrough in today’s information processing architecture is needed
DEEPComplex & interactive questions
on granular data
BROADBig data,
many data types
HIGH SPEEDFast response-time,
interactivity
SIMPLENo data preparation, no pre-aggregates,
no tuning
DEEPComplex & interactive questions
on granular data
SIMPLENo data preparation, no pre-aggregates,
no tuning
REAL -TIMERecent data, preferably real-
time
HIGH SPEEDFast response-time,
interactivity
OR
© 2011 SAP AG. All rights reserved. 23
Supports any Device
Any AppsAny App Server
SAP Business Suite and BW ABAP App Server
JSONR Open ConnectivityMDXSQL
Other AppsLocationsReal-timeHADOOPMachineUnstructuredTransaction
SAP HANA Platform
SQL, SQLScript, JavaScript
Integration Services
Spatial
Business Function Library
Search Text Mining
Predictive Analysis Library
DatabaseServices
Stored Procedure & Data Models
Planning Engine Rules Engine
Application & UI Services
SAP HANA Platform – More than just a database
SAP HANA Platform Converges Database, Data Processing and Application Platform Capabilities & Provides Libraries for Predictive, Planning, Text, Spatial, and
Business Analytics to enable business to operate in real-time.
© 2011 SAP AG. All rights reserved. 24
Dünyanın en büyük in-memory veritabanı sistemi – Santa Clara, CA
250 HANA sunucusu | 250TB Ana Bellek | 10,000 x86 Core
© 2011 SAP AG. All rights reserved. 25
Breakthrough solutions from startups & ISVsA single platform powering next generation of applications
Platform to imagine new generation of applications
Simple consumption model – lowering barriers to entry
Rapid commercialization of innovation
Industry solutions - Healthcare, Capital Markets
Consumer and enterprise applications
www.startups.saphana.com (700+ Startups & ISVs)
DRIVING ADOPTION RECENT PROJECTS
© 2011 SAP AG. All rights reserved. 26
C4.5decision tree
Weighted score tables
Regression
ABC classification
Spatial, Machine,
Real-time data
Hadoop/ Sybase IQ,
Sybase ASE, Teradata
Unstructured
PAL
R-scripts
SQL ScriptOptimized Query Plan
Main Memory
Virtual Tables
Spatial Data
R-Engine
KNN classification
K-means
Associate analysis:
market basket
Text Analysis
SAP HANA
HANA Studio/AFM,
Apps & Tools
Predictive Analytics & Machine Learning Transforming the Future with Insight Today
Accelerate predictive analysis and scoring with in-database
algorithms delivered out-of-the-box.
Adapt the models frequently
Execute R commands as part of overall query plan by
transferring intermediate DB tables directly to R as vector-
oriented data structures
Predictive analytics across multiple data types and sources.
(e.g.: Unstructured Text, Geospatial, Hadoop)
© 2011 SAP AG. All rights reserved. 27
Innovation Previously InfeasiblePredict and analyzes game player behavior in real-time
Real-time insights, analysis, and consumer engagement for increased revenue and decreased churn
© 2011 SAP AG. All rights reserved. 28
Simplicity Previously UnachievableeBay Early Signal Detection System powered by Predictive Analytics
Automated signal detection system to proactively respond to real-time market dynamics
© 2011 SAP AG. All rights reserved. 29
Product: Agile Datamart
Business Challenges
Lack of real-time insights into POS data make it difficult to create effective, tailored sales promotions and marketing campaigns
Need shorter response time for customer segmentation to plan sales campaigns
Technical Challenges
Inability to process big data (billions) POS records quickly because of high latency and static reporting
Shop floor staff not able to access relevant information on-the-fly, with iPad
Benefits
Real-time insights into POS data improve customer satisfaction and merchandising
Dynamic personalized offerings while customer is at store or on web site
250 million POS sales order line items
10-12 minute sales campaign planning (not possible before)
100,000x faster sales analysis – from 3 days to 2-3 seconds
Yodobashi - POS Data Analizi
12,000 Staff with 3,200 pure scientist, 650,000 patients/year, 1,4 B€ revenue
500,000 data points from each cancer patient. Instant patient data analysis during treatment
© 2011 SAP AG. All rights reserved. 31
Mitsui Knowledge IndustryHealthcare industry – Cancer cell genomic analysis
408,000x faster than traditional disk-based systems in technical PoC
216x faster DNA analysis results - from 2,5 days to 20 minutes
Thank you