MySQL in the Cloud, is Amazon RDS for you?

Copyright © 2014 VMware, Inc.

MySQL in the Cloud,is Amazon RDS for you?

MC Brown, Senior Product Line Manager


Introducing Continuent

2

• The leading provider of clustering and replication for open source DBMS

• Our Product: Continuent Tungsten

• Clustering - Commercial-grade HA, performance scaling and data management for MySQL

• Replication - Flexible, high-performance data movement


Quick Continuent Facts

• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data

• Largest installation by transaction volume handles up to 8 billion transactions daily

• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop in production

• Cross-site topologies widely deployed

3

Copyright © 2014 VMware, Inc. 4

Continuent Tungsten Customers


The Cloud Data Stampede


Enterprises Racing to the Cloud

6


Important Questions for Data

• What features are required for enterprise data management?

• How do you ensure full control over the DBMS environment and upgrades?

• How do you integrate cloud and on-premises operation?

• What is the right level of support for your business?

7


Point and Click DBMS: Amazon RDS

8


How it Works Inside

9

DRBDReplication

(Synchronous)

Read Replicas

MySQL NativeReplication(Async)

Active Primary

Inactive Standby

Applications

DNS CNAME

Amazon RDSArchitecture


RDS Illustrates Limits of Pure Cloud Data Services

• Operates only in Amazon cloud

• Replicas tied to a single AWS region

• Maintenance requires downtime

• Connectivity to replicas is an application problem

• No direct control over/access to DBMS

• Weak integration with other DBMS types

• Minimalist support model

10


Another Approach to Cloud Data Management

11

Database-as-a-Service enabled for easy

enterprise operation in any environment


Tungsten Cloud-Enabled Clusters for MySQL


Tungsten Database-as-a-Service

13

Tungsten clusters combine off-the-shelf open source DBMS servers into data services with:

• 24x7 data access • Scaling of load on replicas • Simple management commands

...without app changes or data migration

Amazon US West

apache /php

GonzoPortal.com

Connector Connector


Cluster Architecture

14

Application

Tungsten Connector

Application

Tungsten Connector

Replicator

Db2

Replicator

Db3Db1

Replicator

Slave SlaveMaster

Manager Manager Manager

Monitoring and Control

Monitoring and Control

Data Service: sjc


Tungsten Connector Basics

• Any MySQL client can connect

• Initiates connections using JDBC

15

App Native protocol COM_QUERY

COM_INIT_DBCOM_DROP_DB

Connector


Tungsten Connector Basics

• Pass-through operation after connection

• Full transparency & low overhead for clients

16

App

Protocol packet COM_QUERY

select * from t

ConnectorProtocol packet

OKResultSet Rows:1


Mapping Tungsten to Amazon Cloud

17

US-East-1

AZAZ

AZ AZ

EU-West-1

AZ

AZ AZ

US-West-1

AZ

AZ AZ AZAZ AZ AZAZ

AZ

Replicas across availability zones

Clusters across regions


Tungsten Primary/DR Deployment

18

Warm data and apps in secondary region(s)

ApplicationApplications ApplicationApplications

Amazon Region Amazon Region

Live data and apps

in primary region only

Multi-AZ deployment

Async replication between sites

Run in Amazon or on-premise


Tungsten Multi-Master Deployment

19

No app or data coupling across regions


Amazon Region Amazon Region

Live data and apps

in all regions

Multi-AZ deployment

Async replication between sites

Run in Amazon or on-premise


Top-to-Bottom Control of DBMS Services


Cloud-Ready Automation

• Vagrant host provisioning

• Host configuration using Puppet

• Install cluster using .ini file

21

[defaults]application-password=secretapplication-port=3306application-user=appreplication-password=secretreplication-port=13306replication-user=tungstenstart-and-report=trueuser=tungsten

[alpha]connectors=web1,web2,web3master=db1members=db1,db2,db3

https://github.com/continuent-vagrant

https://github.com/continuent-vagrant


Demo: Multi-AZ Continuent Tungsten

Clusters


A Familiar Trouble-Shooting Model

23

Login and fix it!


Zero-Downtime SQL Schema Upgrade

24

Final UpgradeSwitchSlave Upgrade Slave Upgrade

• Shun slave 1, run upgrade, and return to cluster (Discard and recover on failure)

• Upgrade old master

(Cluster schema is now fully upgraded)

• Repeat for additional slave(s)

(Discard and recover on failure)

• Switch master to an upgraded slave (Revert to old master on failure)


Hybrid Cloud Operation


Competing Economic Models

26


Perils of a Single Vendor

27

Date Duration Amazon Failure Description

Apr 2011 2 days US-East EBS failure - “Cloudpocalypse”

Aug 2011 1 day EU-West power outage causes multi-AZ EBS, EC2, and RDS failures

Jun 2012 1-2 days US-East AZs fail due to weather, EBS & other services down

Oct 2012 6+ hours US-East EBS failure triggered by bug brings down RDS and ELB

Aug 2013 1+ hours US-East EC2 networking failure

Dec 2013 3 hours US-East EC2 connectivity failures (again)


On-Ramp to Cloud with Hybrid Operation

28

Use Amazon as DR

location


On-Prem Primary Cloud DR

Establish primary in

existing data center

Hardware-based cluster

Async replication between locations

Multi-AZ in Amazon

©Continuent 2014 29

Data Management Needs of Business-Critical

Applications

©Continuent 2014

What are the big trends in the market?

• High performance transaction processing with 24x7 availability

• Data distribution across sites

• Cloud and on-premises operation

• Real-time reporting on all corporate data

30

©Continuent 2014

Growth of Analytics Capabilities

31

©Continuent 2014

Most Valuable Features According to Continuent Customers

32

Automatic Failover

Zero-Downtime Maintenance

Load Balancing

Performance

Multi-Site Ops

Disaster Recovery

Percentage of Respondents

0% 20% 40% 60% 80%

25%

29%

30%

36%

53%

72%

©Continuent 2014

Customer Growth Trends

33

Increasing Clusters

Adding Analytics

Adding Both

Percentage of Respondents

0% 10% 20% 30% 40%

14%

32%

38%

50%


Continuent Tungsten 3.0

• Continuent Tungsten Clustering

• Certified Replication to Datawarehouse

• Straight from the cluster

• Hadoop (MapR, HortonWorks, Cloudera, IBM, Pivotal, Apache, Amazon EMR)

• HP Vertica

• Amazon RedShift

• Oracle (Bi-Directional)

34

©Continuent 2014

Real-time Loading from Clustered MySQL to Data Warehouses

35

TungstenReplicator

cluster1 AmazonRedshift

cluster2


Hybrid Data Integration

36

Web-facing transaction processing

ApplicationApplications

AmazonEnterpriseResourcePlanning(ERP)

Corporate DC

Private Cloud

Hadoop-based analytics

AsynchronousReplication

AsynchronousReplication

©Continuent 2014

Roadmap for CT 3.0 release

37

• All features described here are working with anchor customers

• We are polishing integrations and improving documentation

• We are looking for 3.0 beta customers now

• Full product release will occur during Q4


Enterprise-Class Support from Continuent

• Worldwide support team with 24x7 response

• Advice, workarounds, and bug fixes

• 1st line staffed by MySQL/clustering experts

• Fast escalation to engineering for problems

• Collaborative support model using Zendesk and GotoMeeting

• Implementation services for new deployments and upgrades

38


Wrap-Up


Tungsten clusters offer a better alternative to pure cloud services

• Cloud-only database services have significant limitations

• Tungsten enterprise-ready clusters function equally well in cloud and on-prem

• Continuent offers software and support to manage business-critical data for the most demanding applications

• Continued 24x7 transaction processing based on economical MySQL DBMS

• Certified hybrid multi-site operation

• Cloud-optimized Puppet/Chef provisioning

• Certified HA / analytics integration

40


www.continuent.comFollow us on Twitter @continuent

Tungsten Replicator:http://code.google.com/p/tungsten-replicator

Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://mcslp.com http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]

http://www.continuent.com

http://code.google.com/p/tungsten-replicator

http://scale-out-blog.blogspot.com

http://datacharmer.blogspot.com

http://continuent-tungsten.blogspot.com

http://flyingclusters.blogspot.com/

mailto:[email protected]

MySQL in the Cloud, is Amazon RDS for you?

Technology

amazon cloud replicas

tungsten database

mapping tungsten

cloud data stampedecopyright

amazon cloudreplicas

amazon rdscopyright

cloud datamanagementcopyright

data volumeprocesses