©Continuent 2014 Picking the Right Clustering for MySQL : Cloud-only Services or Flexible Tungsten Clusters? Robert Hodges, CEO
Picking the Right Clustering for MySQL - Cloud-only Services or Flexible Tungsten Clusters?
Jun 24, 2015
As businesses head into the cloud, it is tempting to use the first product that offers to make database operation relatively simple by punching a few buttons on a menu. However, there's a big difference between firing up cloud database services, such as Amazon RDS, for testing or development and finding a real data management solution, such as Continuent Tungsten, that can handle hundreds of millions of transactions daily.
This webinar explores how your business can benefit from Continuent Tungsten, a flexible clustering solution that helps data-driven businesses handle billions of transactions daily across a wide range of environments. We'll focus on the following problems in particular:
- Ensuring fully capable cloud DBMS operation
- Avoiding lock-in by choosing solutions that run across clouds as well as on-premises
- Spreading MySQL data over regions using flexible primary/DR and multi-master topologies
- Controlling maintenance intervals and the DBMS stack directly
- Integrating in real-time to data warehouses and on-premises DBMS like Oracle
- Ensuring immediate access to top-notch, 24x7 support when things go south.
Your data is too precious to take shortcuts. Learn how you can use Continuent Tungsten to build scalable management solutions that offer the economic benefits of the cloud with the enterprise capabilities required by businesses that live and die by their data.
This webinar explores how your business can benefit from Continuent Tungsten, a flexible clustering solution that helps data-driven businesses handle billions of transactions daily across a wide range of environments. We'll focus on the following problems in particular:
- Ensuring fully capable cloud DBMS operation
- Avoiding lock-in by choosing solutions that run across clouds as well as on-premises
- Spreading MySQL data over regions using flexible primary/DR and multi-master topologies
- Controlling maintenance intervals and the DBMS stack directly
- Integrating in real-time to data warehouses and on-premises DBMS like Oracle
- Ensuring immediate access to top-notch, 24x7 support when things go south.
Your data is too precious to take shortcuts. Learn how you can use Continuent Tungsten to build scalable management solutions that offer the economic benefits of the cloud with the enterprise capabilities required by businesses that live and die by their data.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
©Continuent 2014
Picking the Right Clustering for MySQL : Cloud-only Services or
Flexible Tungsten Clusters?
Robert Hodges, CEO
©Continuent 2014
Introducing Continuent
2
• The leading provider of clustering and replication for open source DBMS
• Our Product: Continuent Tungsten
• Clustering - Commercial-grade HA, performance scaling and data management for MySQL
• Replication - Flexible, high-performance data movement
©Continuent 2014
Quick Continuent Facts
• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data
• Largest installation by transaction volume handles up to 8 billion transactions daily
• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop in production
• Cross-site topologies widely deployed
3
©Continuent 2014©Continuent 2014
Continuent Tungsten Customers
4
1
©Continuent 2014 5
The Cloud Data Stampede
©Continuent 2014
Enterprise IT: The Race to the Cloud
6
©Continuent 2014
Important Questions for Data
• What are the real features required for enterprise data management?
• How do you preserve full control over the environment and upgrades?
• How do you integrate cloud and on-premises operation?
• What is the right level of support for your business?
7
©Continuent 2014
Amazon RDS Is An Obvious Solution
8
©Continuent 2014
How Amazon RDS Works
9
DRBD Replication
(Synchronous)
Read Replicas
MySQL Native Replication (Async)
Active Primary
Inactive Standby
Applications
DNS CNAME
©Continuent 2014
Amazon RDS vs Enterprise Requirements
• Operates only in Amazon cloud
• DBMS clusters tied to a single AWS region
• Connectivity to RDS is a user problem
• No direct control/access in DBMS
• Cumbersome maintenance model
• Weak integration with other DBMS types
• No enterprise-level support
10
©Continuent 2014 11
Tungsten Cloud Clusters for MySQL
©Continuent 2014
Tungsten Database-as-a-Service
12
Tungsten clusters combine off-the-shelf open source DBMS servers into data services with: !
• 24x7 data access • Scaling of load on replicas • Simple management commands !...without app changes or data migration
Amazon US West
apache /php
GonzoPortal.com
Connector Connector
©Continuent 2014
Cluster Architecture
13
Application
Tungsten Connector
Application
Tungsten Connector
Replicator
Db2
Replicator
Db3Db1
Replicator
Slave SlaveMaster
Manager Manager Manager
Monitoring and Control
Monitoring and Control
Data Service: sjc
©Continuent 2014
Tungsten Connector Basics
• Any MySQL client can connect
• Initiates connections using JDBC
14
App Native protocol
!COM_QUERY
COM_INIT_DBCOM_DROP_DB
Connector
©Continuent 2014
Tungsten Connector Basics
• Pass-through operation after connection
• Full transparency & low overhead for clients
15
App
Protocol packet COM_QUERY
select * from t
ConnectorProtocol packet
OKResultSet Rows:1
©Continuent 2013
Tungsten Primary/DR Deployment
16
Warm data and apps in secondary region(s)
ApplicationApplications ApplicationApplications
Amazon Region Amazon Region
Live data and apps
in primary region only
Multi-AZ deployment
Async replication between sites
Run in Amazon or on-premise
©Continuent 2013
Tungsten Multi-Master Deployment
17
No app or data coupling across regions
ApplicationApplications ApplicationApplications
Amazon Region Amazon Region
Live data and apps
in all regions
Multi-AZ deployment
Async replication between sites
Run in Amazon or on-premise
©Continuent 2014 18
Demo: Cross-Regional Multi-Master Clusters
in Amazon
©Continuent 2014 19
Top-to-Bottom Control of DBMS Services
©Continuent 2014
Rolling SQL Schema Upgrade
20
Final UpgradeSwitchSlave Upgrade Slave Upgrade
• Shun slave 1, run upgrade, and return to cluster. Discard and recover on failure
• Upgrade old master. Cluster schema is now fully upgraded
• Repeat for additional slave(s)
• Switch master to promote an upgraded slave
©Continuent 2014
Rolling MySQL Parameter Changes
21
Final UpgradeSwitchSlave Upgrade Slave Upgrade
• Shun slave 1, change parameter, and restart. Reverse and restart on failure
• Change parameter on old master. All DBMS are now fixed.
• Repeat for additional slave(s)
• Switch master
©Continuent 2014 22
Exploring Hybrid Cloud Operation
©Continuent 2013
Cloud vs. On-Premises Operation
23
©Continuent 2014
Perils of a Single Vendor
24
Date Duration Amazon Failure Description
Apr 2011 2 days US-East EBS failure - “Cloudpocalypse”
Aug 2011 1 day EU-West power outage causes multi-AZ EBS, EC2, and RDS failures
Jun 2012 1-2 days US-East AZs fail due to weather, EBS & other services down
Oct 2012 6+ hours US-East EBS failure triggered by bug brings down RDS and ELB
Aug 2013 1+ hours US-East EC2 networking failure
Dec 2013 3 hours US-East EC2 connectivity failures (again)
©Continuent 2013
Hybrid Primary/DR Is a Common Pattern
25
Use Amazon as DR
location
ApplicationApplications ApplicationApplications
On-Prem Primary Cloud DR
Establish primary in
existing data center
Hardware- based cluster
Async replication between locations
Multi-AZ in Amazon
©Continuent 2013
Hybrid Data Integration
26
No app or data coupling across regions
ApplicationApplications ApplicationApplications
Amazon Region Amazon Region
Live data and apps
in all regions
Multi-AZ deployment
Async replication between sites
Run in Amazon or on-premise
©Continuent 2014 27
Demo: Cross-Regional Multi-Master Clusters
in Amazon
©Continuent 2014
Further Cross-Site Topologies
28
Data Warehouse
All Masters
Fan-In
©Continuent 2014 29
Enterprise Support with Fingerspitzengefühl
©Continuent 2014
What Do We Mean by That?
30
Fingerspitzengefühl: finger tips feeling !
• Ability to respond appropriately and tactfully
• A superior ability to respond to an escalated situation
!
Wikipedia
©Continuent 2014
Enterprise-Class Support from Continuent
• Worldwide support team with 24x7 response
• Advice, workarounds, and bug fixes
• 1st line staffed by MySQL/clustering experts
• Fast escalation to engineering for problems
• Collaborative support model using Zendesk and GotoMeeting
• Implementation services for new deployments and upgrades
31
©Continuent 2014 32
Wrap-Up
©Continuent 2014
Tungsten clusters offer an enterprise alternative to pure cloud services
• Even the best cloud-only MySQL services do not meet enterprise requirements fully
• Tungsten clusters have enterprise-ready features that function equally well in cloud and on-prem
• Continuent offers software and support necessary to manage business-critical data for the most demanding enterprises
33
©Continuent 2014
www.continuent.com Follow us on Twitter @continuent
!
Tungsten Replicator: http://code.google.com/p/tungsten-replicator
Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/
560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]
Related Documents
