Online training - Couchbase 101 - Installation

Technical Evangelist

twi0er: @scalabl3email: [email protected]

Jasdeep Jaitla

Couchbase 101: Architecture, Install & Config

mailto:[email protected]

ARCHITECTURE

Evolution from memcached

•Founders were key contributors to memcached

•Evolved into Membase, a distributed and persisted key-‐value store

•Evolved into Couchbase Document Store with JSON support and Map-‐Reduce Indexes, ElasTc Search IntegraTon, and Cross-‐Data Center ReplicaTon

Couchbase Server Core Principles

Easy Scalability

Consistent High Performance

Always On 24x365

Grow cluster without applicaTon changes, without downTme with a single click

Consistent sub-‐millisecond read and write response Tmes with consistent high throughput

No downTme for soWware upgrades, hardware maintenance, etc.

Flexible Data Model

JSON Anywhere document model with no fixed schema.

JSONJSONJSON

JSONJSON

PERFORMANCE

Couchbase Server 2.0 Architecture

Heartbeat

Process m

onito

r

Glob

al singleton supe

rviso

r

Confi

guraTo

n manager

on each node

Rebalance orchestrator

Nod

e he

alth m

onito

r

one per cluster

vBucket state and

replicaT

on m

anager

hDpRE

ST m

anagem

ent A

PI/W

eb UI

HTTP 8091

Erlang port mapper 4369

Distributed Erlang 21100 -‐ 21199

Erlang/OTP

storage interface

Couchbase EP Engine

11210 Memcapable 2.0

Moxi


Memcached

New Persistence Layer

8092 Query API

Que

ry Engine

Data Manager Cluster Manager

Couchbase Server 2.0 Architecture

New Persistence Layer

storage interface

Couchbase EP Engine


Moxi


Object-‐level Cache

Disk Persistence

8092 Query API

Que

ry Engine

HTTP 8091

Erlang port mapper 4369

Distributed Erlang 21100 -‐ 21199

Heartbeat

Process m

onito

r

Glob

al singleton supe

rviso

r

Confi

guraTo

n manager

on each node

Rebalance orchestrator

Nod

e he

alth m

onito

r

one per cluster

vBucket state and

replicaT

on m

anager

hDp

REST m

anagem

ent A

PI/W

eb UI

Erlang/OTP

Server/Cluster Management & CommunicaYon

(Erlang)

RAM Cache, Indexing & Persistence Management

(C)

Couchbase OrganizaTon

•Couchbase operates like a Key-‐Value Document Store

• Key is a UTF-‐8 string up to 256 Bytes

• Values can be:

-‐ Simple Datatypes: strings, numbers, dateTme, boolean, and binary data can be stored -‐-‐ they are stored as Base64 encoded strings

-‐ Complex Datatypes: dicTonaries/hashes, arrays/lists, can be stored in JSON format (simple lists can be string based with delimiter)

-‐ JSON is a special class of string with a specific format for encoding simple and complex data structures

• Schema is unenforced and implicit, schema changes are programmaTc, done online, and can vary from Document to Document

Metadata and Documentsmeta {

“id”: “u::[email protected]”, “rev”: “1-‐0002bce0000000000”, “flags”: 0, “expiraYon”: 0, “type”: “json”

} !!document {

“uid”: 123456, “firstname”: “jasdeep”, “lastname”: “Jaitla”, “age”: 22, “favorite_colors”: [“blue”, “black”], “email”: “[email protected]”

}

Meta InformaYon Including Key (id)

!All Keys Unique and

Kept in RAM

Document Value !

Most Recent In RAM And Persisted To Disk

Retrieval Operations

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server

Replica Couchbase Cluster Machine


Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


get


Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


get

Storage Operations

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


Storage Operations

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


set/add/replace

Storage Operations

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


set/add/replace

Storage Operations

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


set/add/replace

Storage Operations

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


set/add/replace

Consistency

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


Consistency

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


get

Ejection, NRU, Cache Miss

Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server



Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


set/add/replaceset/add/replaceset/add/replace


Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


FULL (90%)

NRU Documents Ejected


Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server



Couchbase Server

EP EngineRAM Cache

Disk Write Queue

Replication Queue

Application Server


get

Non-‐Resident Document

("Cache Miss")

Clients Connect Directly to Couchbase Nodes

Application Servers

MAP

1024

8 GB RAMPartitions

3 IO Workers


Application Servers

MAP

1024

8 GB RAMPartitions

3 IO Workers


Application Servers

MAP

MAP

MAP

1024

8 GB RAMPartitions

3 IO Workers

Key Hash-Partitioning

Application Servers

MAP

MAP

MAP

1024

8 GB RAMPartitions

3 IO Workers

ClientHashFuncYon("[email protected]") => ParYYon[0..1023] {25} ClusterMap[P(25)] => [x.x.x.x] => IP of Server Responsible for ParYYon 25

Application Servers8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

Horizontal Scale-Rebalance

TOTAL

16 GB RAM

6 IO Workers

1024

Partitions

1024

Partitions

TOTAL

8 GB RAM

3 IO Workers

1024

Partitions

Application Servers8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers


TOTAL

16 GB RAM

6 IO Workers

1024

Partitions1024

Partitions

512

Partitions

512

Partitions


TOTAL

32 GB RAM

12 IO Workers

1024

Partitions

Application Servers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

512

Partitions

512

Partitions

TOTAL

16 GB RAM

6 IO Workers

1024

Partitions

MAP

MAP MAP

MAP


TOTAL

32 GB RAM

12 IO Workers

1024

Partitions

Application Servers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

512

Partitions

512

Partitions

256

Partitions

256

Partitions

256

Partitions

256

Partitions

TOTAL

16 GB RAM

6 IO Workers

1024

Partitions

MAP

MAP

MAP

MAP

MAP

MAP

MAP

MAP


TOTAL

32 GB RAM

12 IO Workers

1024

Partitions

Application Servers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

8 GB RAM

3 IO Workers

512

Partitions

512

Partitions

256

Partitions

256

Partitions

256

Partitions

256

Partitions

MAP

MAP

MAP

MAP

MAP

MAP

MAP

MAP

!!!!!

All Metadata for All Documents

(64 bytes + Key Length) !

Document Values (NRU Ejected if RAM Quota

Used > 90%) !!!

Also Leave RAM For OS: !

[Filesystem Cache >> Views]

!!!!!!

Document Indexing !

Monitoring !

XDCR !!

Recommended: !

minimum 4 Cores + 1 core per design document + 1 core per XDCR replicated

bucket

!!!!!!

Persisted Documents !

All Indexes for Design Documents/Views

!Append-‐Only Disk Format

& CompacYon !!

Performance: !

MulYple EBS Volumes High IOPS Raid 0 on Amazon

RAM, CPU and IO Guidelines

RAM CPU Disk IO

Binary Socket Operations (11210/1)• get (key)

– Retrieve a document

• set (key, value)

– Store a document, overwrites if exists

• add (key, value)

– Store a document, error/exception if exists

• replace (key, value)

– Store a document, error/exception if doesn’t exist

• incr (key)

– Create/Increment Atomic Counter

• decr (key)

– Decrement Atomic Counter

• cas (key, value, cas)

– Compare and swap, set document only if it hasn’t changed (Optimistic Lock)

HTTP Operations (8092)

• View Querying

– Range Queries

– Index-Key Match Queries

– Set Match Queries

– Aggregate Reduces

– Group Level + Grouping Queries

INSTALL SERVER

Download Couchbasewww.couchbase.com/download

Install on Amazon via AMI

Install on Amazon via AMI

Run Couchbase and Open Browserlocalhost:8091 or ec2-‐xx-‐xx-‐xx-‐xx.compute-‐1.amazonaws.com:8091

Setup: Step 1 - Storage Paths & RAM Maximum

Setup: Step 1 - Storage Paths & RAM Maximum

Setup: Step 2 - Sample Buckets

Setup: Step 3 - Configure Default Bucket

Setup: Step 3 - Configure Default Bucket

Setup: Step 4 - Register & Agree

Setup: Step 5 - Admin password

Setup: Complete

SETUP SDK

Supported SDK'swww.couchbase.com/communiYes

• Each supported SDK page has instrucTons for setup

• PHP, Ruby, and Python clients are wrappers around libcouchbase C library, so libcouchbase must be installed first

• For other community clients, click on "All Clients" on leW nav, scroll down the page and you can see clients for Go, Erlang, Clojure, TCL, Perl and others.

Installing Libcouchbase

• Mac Tips before Libcouchbase & SDK Install

• Make sure you have XCode & Command Line Tools Installed

• Install Homebrew if you don't have it already

• Do a $ brew update, $ brew upgrade and $ brew doctor to be sure you're up to date

www.couchbase.com/communiYes/c/geqng-‐started

Installing Libcouchbase

• Mac Via Homebrew

• $ brew install libcouchbase

• PC-‐Windows

• Download appropriate Zip from website

• Redhat/CentOS

• wget the yum repositories

• $ sudo yum install -‐y libcouchbase2-‐libevent libcouchbase-‐devel

• Ubuntu

• wget ubuntu repositories

• $ sudo apt-‐get install libcouchbase2-‐libevent libcouchbase-‐dev

www.couchbase.com/communiYes/c/geqng-‐started

More On Development

Training: Couchbase 102 -‐ OperaYons www.couchbase.com/webinars

SERVER MONITORING

Store and Retrieve Operations



Storage Ops/sRetrieve Ops/sRetrieve off DiskTotal Ops/s


Storage Ops/sRetrieve Ops/sRetrieve off DiskTotal Ops/s

Item CountDelete Ops/s CAS Ops/s % Documents in RAM



RAM FULL + Very High Velocity Writes!



RAM Used for Metadata + Data



Begin EjecYon of Replicas from RAM

Begin EjecYon of AcYve from RAM

RAM Used for Metadata + Data



Disk Creates Disk Updates Disk Queue SizeDisk Reads (Cache Miss)


Disk Creates Disk Updates Disk Queue SizeDisk Reads (Cache Miss)

Total Disk UsageDocs Data Size (Compressed) Docs Size on Disk FragmentaYon

(from Appends)


Disk Queue Size


Disk Queue SizeDisk Queue Size (Need More IO!)

Partition (vbucket) Details


Partition (vbucket) DetailsAcYve ParYYons

Partition (vbucket) DetailsAcYve ParYYons Replica ParYYons

Partition (vbucket) DetailsAcYve ParYYons Replica ParYYons Pending ParYYons

(Rebalance)



Item Count


% Documents in RAM

Item Count


% Documents in RAM

CreaYons

Item Count


EjecYons (RAM Full)

% Documents in RAM

CreaYons

Item Count


Documents

EjecYons (RAM Full)

% Documents in RAM

CreaYons

Item Count


Metadata

Documents

EjecYons (RAM Full)

% Documents in RAM

CreaYons

Item Count



Note: 64 ParYYons on Mac OS X! This is simply to avoid altering

default file descriptor limits, don't XDCR with other OperaYng

Systems

Disk IO Information

Disk IO Information

AcYve ParYYons

Disk IO Information

AcYve ParYYons Replica ParYYons

Disk IO Information

AcYve ParYYons Replica ParYYons Pending ParYYons (Rebalance)

Disk IO Information

Disk IO Information

Queue Size

Disk IO Information

Queue Fill Rate

Queue Size

Disk IO Information

Queue Fill Rate

Queue Drain Rate

Queue Size

Disk IO Information

Average Age of Queue Items

Queue Fill Rate

Queue Drain Rate

Queue Size

QUICK DEMO

Q & A

Focused on Beginning Development This Thursday!

www.couchbase.com/webinars

COUCHBASE 102

Focused on Beginning Development This Thursday!

www.couchbase.com/webinars

Online training - Couchbase 101 - Installation

Technology

schemachangesare programmatc

hardware maintenance

perf o r

allkeysuniqueand keptinram