Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB

Copyright 2017 Severalnines AB

An Overview of Ops Manager & ClusterControl

24th October 2017

Ruairí Newman, Senior Support Engineer, SeveralninesTyler Duzan, Product Manager, Percona

Presenters

[email protected] [email protected]

How to Manage MongoDB & Percona Server for MongoDB

mailto:[email protected]

mailto:[email protected]


I'm Jean-Jérôme from the Severalnines Team and I'm your host for today's webinar!

Feel free to ask any questions in the Questions section of this application or via the Chat box.

You can also contact me directly via the chat box or via email: [email protected] during or after the webinar.

Your host & some logistics



About Severalnines and ClusterControl


What We Do

Manage Scale

Monitor Deploy


ClusterControl Automation & Management

Management● Multi-Cluster / Multi-DC

● Automate Repair &

Recovery

● Database Upgrades

● Backups

● Configuration Management

● Database Cloning

● One-Click Scaling

Deployment● Deploy a Cluster in Minutes

● On-Premises or in the Cloud (AWS)

Monitoring● Systems View with 1sec Resolution

● DB / OS stats & Performance Advisors

● Configurable Dashboards

● Query Analyzer

● Real-time / historical


Supported Databases

Copyright 2012 Severalnines ABCopyright 2012 Severalnines AB

Our Customers


An Overview of Ops Manager & ClusterControl

24th October 2017

Ruairí Newman, Senior Support Engineer, SeveralninesPresenter

[email protected]

MongoDB: How to Automate and Manage Operations


High-Level Feature Comparison

ClusterControl Ops Manager

Deploy Replica Set, Sharded Cluster Yes Yes

Metrics Monitored Host metrics, MongoDB Metrics Host metrics, MongoDB Metrics

Custom Dashboards Yes, plus “Advisors” Yes

Cloud/IaaS Provider Integration AWS S3 (for Backups)* AWS S3 (for Backups)

Consistent Backups (Sharded) Yes Yes

User & Group Mgmt, LDAP Yes Yes

Secure Installation Default Supported

Auto Recovery Explicit No

Scriptable Command Line Yes No


Installation:● Ops Manager

○ Downloadable from mongodb.com○ Enterprise MongoDB Subscription○ MongoDB Licences for for servers required to support Ops Manager○ Production vs Test deployment

● ClusterControl○ Downloadable from severalnines.com--install-cc script○ Installs required open source dependencies○ Community edition, Advanced, and Enterprise

Installation Requirements:● Ops Manager

○ Production○ “Test”

● ClusterControl

The Basics - Getting Started


Standard Installation of MongoDB Ops Manager


Highly Available Ops Manager Architecture

In this scenario, a highly available Ops Manager requires 8 physical servers, not including the HTTP load balancer.

Apart from the HTTP Services, the solution requires 3 MongoDB replica sets of 3 data nodes each;

One each for the Application Database, and the Backup Blockstore Databases #1 & #2.


ClusterControl uses a single MySQL / MariaDB database server, to which its core services connect to store and retrieve data.

Redundancy can be achieved through deploying a database snapshot on a second node, and installing the ClusterControl applications.

With a HTTP proxy in front, requests can be directed to the live node. ClusterControl services such as auto-recovery should be stopped on the second node to avoid complications.

ClusterControl Architecture


Installation


❏ EC2 instances

❏ 4 x “t2.small” CentOS 7.3 EC2 instances: 1 for ClusterControl, 3 for a

MongoDB Replica Set deployment

❏ Obtain and install ClusterControl installation script from severalnines.com

❏ Deploy a 3-node MongoDB Replica Set

❏ Review key functionality

Installation of ClusterControl


Installation of Ops Manager “Test”

❏ EC2 instances

❏ 1 x “t2.large” CentOS 7.3 EC2 instance for Ops Manager “test” install

❏ 3 x “t2.small” CentOS 7.3 EC2 instances for 3-Node MongoDB Replica Set

❏ Obtain and install MongoDB installation RPM

❏ Deploy a 3-node MongoDB Replica Set

❏ Review key functionality


Integrations

❏ ClusterControl integrations

❏ PagerDuty, VictorOps, Ops Genie, Telegram, Slack

❏ Webhooks

❏ Ops Manager Integrations

❏ New Relic, PagerDuty, Flowdock, Hipchat Slack

❏ Webhooks


s9s – The Command Line Interface

❏ Fully Scriptable Command Line interface

❏ Basic Monitoring: status of Nodes and Clusters

❏ Create, Stop, Start Clusters

❏ Add, Remove, Restart Nodes

❏ Create & Manage database users, load balancers, backups

❏ RPC API


Percona Server for MongoDB


● First GA release in December 2015● Maintains drop-in compatibility with upstream● Focused on performance and stability improvements layered on

top of MongoDB Community Edition● Provides a place to develop new storage engines and capabilities● Implements many MongoDB Enterprise features in an open-source

release● Expedited bug fixes for Percona Support customers and these fixes

are shared with the community

What is Percona Server for MongoDB


What is Percona Server for MongoDB


● Enhanced Security Capabilities○ Auditing○ Log Redaction○ LDAP Authentication

● New Storage Engines○ Percona Memory Engine (compatible with Memory Engine in MongoDB EE)○ MongoRocks is integrated

● Native Hot Backup Capability○ Supports both MongoRocks and Wired Tiger storage engines

● Integration with Percona Toolkit and Percona Monitoring and Management (PMM) for query performance analytics and troubleshooting

● Enhanced Query Profiling

Percona Server vs MongoDB Community Edition


● Added to Percona Server for MongoDB in partnership with Facebook● Based on the open-source RocksDB library derived from LevelDB● Uses LSM-trees instead of B-trees for indexes, optimizes for write-heavy

workloads● Has native support for Snappy, LZ4, and Zlib compression● LSM-Trees are append-only, so are fast regardless of disk size or available

space.● Writes go to Memtables first before being flushed to disk, reads are

serviced from memory if possible● Compared to Wired Tiger, MongoRocks uses less disk space, maintains

higher insert rates, and has better response times.

MongoRocks: RocksDB for MongoDB


● QAN for MongoDB was announced at Percona Live Europe in Dublin, September 2017

● Query Profiling in the upstream implementation can incur significant performance overhead

● Percona Server for MongoDB implements an optimized query profiler that supports setting rate limits

● For example to profile all operations only for queries which are slower than 200ms and every 100th fast query, you would do the following:

○ mongod --profile 2 --slowms 200 --rateLimit 100

● Integrates with Percona Toolkit using pt-mongodb-query-digest tool

Query Profiling and PMM


● Severalnines ClusterControl meets and exceeds the capabilities of MongoDB Ops Manager

● Percona Server for MongoDB provides MongoDB Enterprise Edition features at no licensing cost, with additional storage engines and performance improvements

● With Percona Server for MongoDB and Severalnines ClusterControl together, you have the capabilities of MongoDB Enterprise Edition with Ops Manager at a reduced TCO while gaining additional features and capabilities

Percona Server for MongoDB + Severalnines ClusterControl



Q&A


● Download: ClusterControl ● White Paper: Bringing MongoDB to Production● Download: Percona Server for MongoDB

● The replay & slides of today’s webinar will be online within the next 48 hours

Some Resources

https://severalnines.com/download-clustercontrol-database-management-system

https://severalnines.com/resources/whitepapers#download_whitepaper/5081

https://www.percona.com/software/mongo-database/percona-server-for-mongodb


Thank You!

Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB

Internet