Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1
Jan 26, 2015
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1
NoSQL Technology and Enterprise applications – Where the Rubber Meets the Road
Dave Segleau
Director Product Management, Oracle
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3
Agenda
How we got here
Where we are today
What’s important
Sample Use Cases
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4
NoSQL and Big Data Where did it come from?
SQL
JDBC,
ODBC
General
Purpose
Managed
Schemas
Security,
Backups
Analytics
…
Distributed
Processing
Distributed,
Replicated
File System
Driver
Application
NoSQL databases
Flexible
Schemas
Sharded,
Replicated
Database
High Speed,
Simple Ops
More Flexible Schema
Management
Globally Distributed,
“Always On” data
Competitive Advantages
of “Fast Data”
Lower TCO,
commodity HW scale-out
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5
Oracle NoSQL Database Where is it used?
Simple Data
Management
Globally Distributed,
“Always On” data
Competitive Advantages
of “Fast Data”
Lower TCO,
commodity HW scale-out
ERP
EAM
Inventory
Control
Accting
& Payroll
Process
Mgmt
Business
Analytics
CRM
…
Driver
Application Real Time
Event
Processing
Distributed,
Web-scale
Applications
Online
Gaming
…
Mobile Data
Management
Sensor Data
Capture
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6
The NoSQL Landscape
Pioneers –
Built their own
Global Enterprise Technology Adopters Source: NoSQL Market Forecast 2013-2018 by Market Research Media
Oracle has invested in
NoSQL as a key data
management technology
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7
What is Oracle NoSQL Database?
SOCIAL
BLOG
SMART
METER
1011001010010
0100110101010
1011100101010
100100101
VALUE VARIETY VELOCITY VOLUME
Non-relational database designed for cost effective simple queries of
high volume, velocity & variety data. Provides high performance & availability
data storage of Big Data’s simple data using a scale-out of servers design.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8
Oracle NoSQL Database Distributed, Scalable, Highly Available, Key-Value Database
Simple Administration
Flexible Data Model
Predictable Performance
ACID Transactions at scale
Transparent Integration
Commercial grade software and support
Application
Storage Nodes
Datacenter B
Storage Nodes
Datacenter A
Application
Driver
Application
Driver
Application
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 9
What’s Really Important?
Technical Feature Importance Why
Storage Model Not really Will merge over time
Specific Features Somewhat Application requirements?
Performance Somewhat Rapid changes, YMWV
Integration Critical Long term, Repetitive cost
Reliability/Support Critical Early products, Product
direction
Predictability Critical Production reqs & SLAs
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10
Query NoSQL data from Oracle Database
Access NoSQL data from Hadoop for DW and analytics
Share data with Coherence for extensible in-memory cache grid
Persist history & event streams for processing with OEP
Store & query RDF data using Oracle RDF for NoSQL
Integration Oracle NoSQL Database: Integrated out of the box
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11
Reliability & Support
Decades of widespread, reliable deployment experience
15+ years of mission-critical non-relational database technology
Oracle Support available for both Enterprise and Community Edition
Oracle NoSQL Database: Enterprise-Grade Software & Support
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12
Predictability Oracle NoSQL Database: Designed for Predictability - Insert Test
0
50000
100000
150000
200000
250000
300000
350000
400000
450000
0.2 1.8 3.5 5.2 6.8 8.5 10.2 11.8 13.5 15.2 16.8 18.5
Th
rou
gh
pu
t (o
ps
/se
c)
Time (minutes)
Insert Performance
Oracle NoSQL … Other NoSQL …
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13
Predictability Oracle NoSQL Database: Designed for Predictability
0
1
2
3
4
5
6
7
8
0
10,000
20,000
30,000
40,000
50,000
60,000
70,000
80,000
144 (48x3)
20% 40% 60% 80% 216 (72x3)
216* (72x3)
Avera
ge L
ate
ncy (
ms)
Th
rou
gh
pu
t (o
ps
/se
c)
Nodes (Shards x RF)
95/5 Read/Update Throughput
Throughput (ops/sec) Read Latency (ms) Update Latency (ms)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14
Oracle NoSQL Database When it really matters
Integration
Predictability
Reliability & Support
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15
Agenda
How we got here
Where we are today
What’s important
Sample Use Cases
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16
Point Flexibility Point
Web-Scale
Transaction Processing
High velocity, volume,
variety, data capture and
update
Web browsing, E-Retail,
Online Gaming, CDR
processing, Sensor data
capture
Web-Scale
Personalization
Guaranteed low latency
simple lookups for end-
customers and users
Advertising, Product
Recommendations, Online
Catalogs, Social Media,
Profile Management,
Personalization
Real-Time
Event Processing
Real time events trigger
rules that perform low
latency lookups
Medical Monitoring, Factory
Automation, Quality of
Service, Oil & Gas, Geo-
location Tracking
Oracle NoSQL Database Use Case Summary
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17
NoSQL for Web Commerce Customer Service Call center routing and context retrieval
Objectives
Solution
Benefits
Web commerce customer service
Enable call center routing and dispatch
Improved product up-sell and cross-sell
Oracle NoSQL database for customer
profile data capture and access
Build repository for unstructured and
variable data record formats
Deploy distributed database for world-wide
access
Easy to use flexible data formats
Horizontally scalable, low latency database
Predictable performance
Geographically distributed enterprise access
NoSQL DB Driver
Application
Customer Service
Customer Profiles
End Customers
Click-2-Call
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18
NoSQL for Customer Experience Management Brand enhancement and loyalty enrichment
Objectives
Solution
Benefits
Centralized view of customer data within
federated database environment
Dynamic, customer influence tactics
Oracle NoSQL database for central
repository of meta data for customer
activity, scheduling and “next generation
experience” events
Oracle database for financial data,
reservation and property management
Simple, flexible data format
Highly scalable with predictable performance
Enterprise support, technology commitment and
roadmap
NoSQL DB Driver
Event Scheduling
Application
Staff & End Customers
Customer Profiles
Customer Care & End
Customers
Reservation Systems
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19
360 Degree Customer Profile Managing what you know
Legacy Transactional
Systems
Driver
Web Service Application
Customer Service
360 View Customer Profiles
End Customers
Click-2-Call
Recommendation
Engine
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20
360 Degree Customer Profile
Major Key
Minor Key
Value
Customer ID
Purchases
Date JSON
Date JSON
Web Traffic
Date JSON
Date JSON
Profile JSON
Interests JSON
Future?
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21
Real-Time Event Processing
Event
Processing
Incoming
Stream
Event
Buffer
Long-Term
Storage
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22
NoSQL for Fraud Scoring Financial Services coordinated theft prevention
Objectives
Solution
Benefits
Application Data Ingestion
Tra
nsa
ctio
n A
uth
ori
za
tio
n
Pro
ce
sso
r
Combine data sources for complex scoring
Detect, alert analyst with low latency
Handle burst seasonal transaction volumes
Oracle Coherence cluster for real time
transaction object management
Oracle NoSQL Database for fraud model
and customer profile management
Oracle Database for statistics and fraud
modeling-related data
Simple data model, flexible transactions
Scalable, Low Latency data management
Easy configuration and administration
Enterprise Support
NoSQL DB Driver
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23
Engineered System
Commodity Cluster
Deployment Options
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24
Oracle NoSQL Database
Predictability
Reliability & Support
Integration
When you need:
Web-Scale Transaction Processing
Real-Time Event Processing
Web-Scale Personalization
For Applications that do:
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 26
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 27
Appendix
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 28
Choose the RIGHT tool for the job
Hadoop Distributed File
System (HDFS) Oracle NoSQL Database Oracle Database
File System Key-Value Database Relational Database
No inherent structure Simple data structure Complex data structures, rich SQL
High volume writes High volume random reads and
writes High volume OLTP with 2-PC
Limited functionality,
roll-your-own applications
Simple get/put high speed storage,
flex configuration
Security, Backup/Restore, Data life
cycle mgmt, XML, etc.
Batch Oriented Real-Time, web-scale specialized
applications
General purpose SQL platform,
multiple applications, ODBC, JDBC
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 29
Web-Scale Transaction Processing
Driver
Application
Acquire Analyze Organize
Enterprise
Data Warehouse
Salient Aspects
•NoSQL DB for High velocity, high
volume, high variety, transactional
data capture
•Hadoop and Data Warehouse for
analytics
•Applications: Web browsing, Web
Retail, CDR processing, Sensor data
capture
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 30
Web-Scale Personalization
Salient Aspects
• Platform for real-time content delivery
• Content & market segmentation is acquired
and analyzed in Hadoop & RDBMS
• NoSQL provides low latency content lookup
and delivery to end-customers or users
• Applications: Advertising, Product
Recommendations, Online Catalogs, Social
Media, Profile Management,
Personalization
Multi-Reporting
Dimensional
Driver
Application
Acquire, Analyze, Prepare Content Delivery
Business Users End Customers
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 31
Real-Time Event Processing
Salient Aspects
• Real time events trigger rule execution in
Oracle Event Processor
• OEP rules perform low latency lookups
to Oracle NoSQL DB for additional data
• Applications: Utilities, Medical
Monitoring, Factory Automation, Quality
of Service, Oil & Gas Exploration, Geo-
location Tracking
Driver
Rule Action
Low Latency
Lookups
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 32
NoSQL for Social, Online Betting Real-time, In-Play Gaming Platform
Objectives
Scalable in-play sports betting platform
Increase new business revenue
Improve operational efficiency
Solution
Match in-play bets with incoming events
Promote interaction between customers
Scale system with customers and events
Feeds MySQL database for revenue
tracking and operational reporting
James Anthony Chief Technology Officer
Passoker
“Oracle NoSQL Database enabled the rapid,
scalable processing of incoming XML, ensuring
high available and guaranteed event ordering.”
NoSQL DB MySQL
Accounting &
Operations
Event Capture
& Store Customers
Real-Time, In-Play Sports Betting
Providers
XML App
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 33
NoSQL for Web Scale Retail Dynamic catalog and customer insight profiling
Objectives
Solution
Benefits
Handle exponential growth in products and
customers with highly dynamic profiles
Defend competitive margins – new players
Oracle NoSQL database for rich customer
profile management, product catalog
browsing and shopping cart management
Oracle Database for financial transactions,
inventory and order fulfillment, business
analytics and insight
Easily manage volatile, evolving data formats
Scalable, Low Latency data management
Flexible transaction options
Online, easy configuration and administration
E-Retail & Order Fulfillment Delivery Order Processing
NoSQL DB Driver
Application
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 34
NoSQL for Data Scalable PaaS Subscription Web-Scale services infrastructure for financial industry
Objectives
Provide special purpose application
server services to financial institutions
Provide cost competitive subscriptions
Solution
Oracle NoSQL Database for unstructured
data capture and application object
persistence
Oracle Database for business analytics and
insight into the data collected
NoSQL DB Driver
Application
Alex Korotkoff Chief Executive Officer
EngineON
“Oracle NoSQL DB delivers high availability, scalability
and performance for our customers who are dealing with
unprecedented data volume, velocity and variability
challenges.”
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 35
NoSQL for Customer Loyalty Coupon redemption, Vendor recommendations
Objectives
Scalable customer loyalty portal
New multi-channel consumer model
Improve operational efficiency
Solution
Personalized multi-channel coupon
generation and redemption
Cross-promote affiliated vendors
Scale system with customers and
participating retailers
NoSQL DB Driver
Application
Retail Partners
Customer
Profiles
End Customers
Available Coupons Market Segmentation
Frank Puechl Senior Data Architect
PAYBACK
“Oracle NoSQL DB handles high volumes of
customer loyalty operations every day, minimizing
the load to our OLTP Oracle RAC Database.”
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 36
NoSQL in Oracle Communications Mgmt Elastic Charging Engine
Objectives
Improve billing and revenue management
Calculate charges for any service combo
Provide scalable CDR processing
Solution
Benefits
Coherence cluster for real time event rating
NoSQL database for rated event
persistence and consumption by
downstream systems
Coherence memory optimization using
NoSQL database for out of band data
Manages rapid growth in data volumes
Cost effective High Performance and Scalability
Integrated with Oracle Coherence
NoSQL DB Driver
Application Data Ingestion
OC
M R
ate
d E
ve
nt s
Pro
ce
sso
r