Top Banner
©Continuent 2012. Future-Proofing MySQL for the Worldwide Data Revolution Robert Hodges, CEO
21

Future Proofing MySQL by Robert Hodges, Continuent

Jul 02, 2015

Download

Documents

Eero Teerikorpi

Future-proofing = creating systems that last while parts change and improve. MySQL is not losing out to other solutions for data management. The real problem is using MySQL as a building block with other technologies that are changing rapidly.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012.

Future-Proofing MySQL for the Worldwide

Data Revolution

Robert Hodges, CEO

Page 2: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

What is Future-Proo!ng?

• Future-proo!ng = creating systems that last while parts change and improve

• MySQL is not losing out to other solutions for data management

• The real problem is using MySQL as a building block with other technologies that are changing rapidly

2

Page 3: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

But Wait... Isn’t MySQL Dead??

3

MySQL

“You were so open”Born

May 25, 1995

Died2008, 2009, 2010,

2011, 2012, ...

Page 4: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Oracle/MySQL 5.6 Replication (On the Way)

• Global transaction IDs

• Parallel slave threads

• Crash safe slaves

• Optimized row updates

• Time delay replication

• Informational log events

4

Page 5: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Galera Synchronous Clusters (New Arrival in 2012)

• Multi-master for InnoDB

• Synchronous replication avoids data loss

• Automatic cluster membership management

• Simple node provisioning model

• Based on innovative state-machine work from Fernando Pedone

5

Page 6: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Tungsten Async Replication (2011 Belle of the Ball)

• All 5.6 features including parallel replication for MySQL 5.0 onwards

• Optimized support for failover

• Programmable transaction !ltering

• Backup/restore integration

• Multi-master, fan-in, and star replication

• Replication to/from Oracle and batch loading of data warehouses

• Replication to MongoDB

6

Page 7: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Not Bad for a Dying Market

7

MySQL,'88%'

NoSQL,'5%'

NewSQL,'2%'

My/NewSQL,'5%'

0"100"200"300"400"500"600"700"800"900"1000"

2011" 2012" 2013" 2014" 2015"

THE$TOTAL$MARKET$FOR$MYSQL,$NOSQL$$AND$NEWSQL$$

Text

(451Group)

Page 8: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

• Cloud and Big Data investment dwarf the MySQL marketplace

MySQL Is Part of Bigger Trends

8

Page 9: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

21st Century CRM/Call Center

9

CRM WebApplication

Telephony Data Streams

CRM WebApplication

Telephony Data Streams

Legacy Oracle

Fat ClientAccounting

Call Session Data

Hadoop Analytics

Online TransactionProcessing

Amazon Web ServicesOn-Premise

Page 10: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Revolutionary Challenges for MySQL

• Failures in unstable cloud environments

• Zero-downtime maintenance

• Rapidly growing data volumes, esp. in cloud

• Distributing data to geographical regions

• Integration between MySQL, NoSQL, commercial RDBMS

• Supplying real-time analytics

• Technology upgrade/replacement

10

Page 11: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

The Cure for Mixed System Spaghetti

11

Encapsulated, fault-tolerant, horizontally scalable, globally

accessible, integrated data

Data Fabrics

Page 12: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Data Fabric Design Patterns

• Connector

• Fault-Tolerant Data Service

• Sharded Data Service

• Multi-Site Data Service

• Real-Time Data Bridge

12

Tungsten Connector

Three-node Tungsten Cluster

Page 13: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

• Single point of entry for applications

• Service catalog locates data within fabric

• Transparent connectivity, multiple protocols

• Security, auditing, performance management

1. Connector

13

Connector

Connector

ApplicationStack

ApplicationStack

Page 14: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

2. Fault-Tolerant Data Service

• Encapsulate redundant database copies

• Sync and async clustering models

• Protect against local DBMS failure

• Rolling maintenance of replicas

14

Master/Slave

Multi-Master

Page 15: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

3. Sharded Data Service

• Partition datasets based on RAM / storage speed / resident set size

• Multiple buckets per server

• Look-up methods for locating data in buckets

• Re-sharding / migration for high growth

15

Page 16: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

4. Multi-Site Data Service

• Robust protection against region/site failures

• Geographic distribution of data

• Primary/DR vs. multi-master

• Eventually consistent replication for SQL

16

Amazon East

Rackspace DFWAPAC TokyoUS East

EU West

Page 17: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

5. Real-Time Data Bridge

• Replicate from logs in real-time

• Enable apps to get data from one data source

• Heterogeneous transfer and transformation

• High performance, low application impact

17

Bridge

Bridge

Bridge

Page 18: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Future-Proofed CRM/Call Center Data

18

CRM WebApplication

CRM WebApplication

Legacy Oracle

Fat ClientAccounting

Bridge

Bridge

FabricConnector

FabricConnector

OLTP Primary

Data Marts

Bridge

Bridge HadoopAnalytics

Telephony Data Streams

Telephony Data Streams

FabricConnector

FabricConnector

FabricConnector

OLTP DR

Bridge

Call Session Data

Page 19: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

Future-Proofed CRM/Call Center Data

19

CRM WebApplication

CRM WebApplication

Legacy Oracle

Fat ClientAccounting

Bridge

Bridge

FabricConnector

FabricConnector

OLTP Primary

Data Marts

Bridge

Bridge HadoopAnalytics

Telephony Data Streams

Telephony Data Streams

FabricConnector

FabricConnector

OLTP DR

Bridge

Call Session Data

FabricConnector

Page 20: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012

MySQL Future-Proo!ng: Conclusion

20

• MySQL is doing great but the cloud and Big Data have created a new set of challenges

• Data Fabric architecture cures mixed system spaghetti and future-proofs MySQL

• Continuent products implement fabric design patterns

• Our humble ambition: cover the entire Data Fabric, not just MySQL

Page 21: Future Proofing MySQL by Robert Hodges, Continuent

©Continuent 2012.

Continuent Web Page:http://www.continuent.com

Our Blogs:http://scale-out-blog.blogspot.comhttp://datacharmer.blogspot.comhttp://www.continuent.com/news/blogs

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009e-mail: [email protected]