Top Banner
MANAGING A HEALTHY COUCHBASE SERVER DEPLOYMENT Alex Ma | Principal Solutions Engineer | [email protected]
26

Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

Jul 26, 2015

Download

Technology

Couchbase
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

MANAGING A HEALTHY COUCHBASE SERVER DEPLOYMENT

Alex Ma | Principal Solutions Engineer | [email protected]

Page 2: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 2

Whats Available?

What does all of that mean??????

External Monitoring systems

Agenda

Page 3: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

Whats Available?

Page 4: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 4

High Level Command line statistics

Page 5: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 5

High Level Command line statistics

CBStats command – ALL 281 Statistics available EP-engine specific metrics Key Value format Cumulative and Snapshot metrics Per bucket – node level or cluster wide. Integrates with traditional Monitoring systems

Page 6: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 6

Lower Level Statistics

Page 7: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 7

Lower Level Statistics

CBStats command - TIMINGS Histogram format Better for real time analysis

Page 8: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 8

Stats through REST

Page 9: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 9

Stats through REST

Metrics for all components available. JSON Format Last 60 Measurements returned by default Snapshot metrics

Page 10: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 10

Web Console Stats

Page 11: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 11

Web Console Stats

Best for real time troubleshooting Cluster or node specific statistics Summarized Logging Some alerting Details on Statistics

Page 12: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 12

System Level Statistics

Page 13: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

What does it all mean?

Page 14: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 14

Application Performance

1 2 3

4 5

Page 15: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 15

Application Performance

General workload Resident Percentage High and Low

watermarks Cache Miss Ratio Disk reads per second Temp OOM

Page 16: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 16

DISK

Disk Space Compaction Rebalance

Disk IO Sustained vs Peak load Disk write queue and

Backoffs Drain vs Fill rates

Page 17: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 17

DISK

Disk Space Compaction Rebalance

Disk IO Sustained vs Peak load Disk write queue and

Backoffs Drain vs Fill rates

Page 18: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 18

DISK

Disk Space Compaction Rebalance

Disk IO Sustained vs Peak load Disk write queue and

Backoffs Drain vs Fill rates

Page 19: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 19

DISK

Disk Space Compaction Rebalance

Disk IO Sustained vs Peak load Disk write queue and

Backoffs Drain vs Fill rates

Page 20: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

Safety

‘Active vBuckets’ count across all the servers should be

equal to “1024”

‘Replica vBuckets’ count across all the servers should

be equal to “1024 * <num of replica’s configured>”

Page 21: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 21

Network

Connections Current Usage/Limits Connections in

CLOSE_WAIT

Network utilization

Page 22: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 22

Network

Connections Current Usage/Limits Connections in

CLOSE_WAIT

Network utilization

Page 23: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

External Monitoring Systems

Page 24: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

©2015 Couchbase Inc. 24

External Monitoring Systems

Page 25: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

Questions?

Page 26: Best Practices: Managing a Healthy Couchbase Server Deployment: Couchbase Connect 2015

Thank you.