Webinar - Introduction to Couchbase Server

Couchbase Server 2.0Introduction

Couchbase Open Source Project

•Leading NoSQL database project focused on distributed database technology and surrounding ecosystem

•Supports both key-value and document-oriented use cases

•All components are available under the Apache 2.0 Public License

•Obtained as packaged software in both enterprise and community editions.

Couchbase Open Source Project

Easy Scalability

Consistent High Performance

Always On

24x365

Grow cluster without application changes, without downtime with a single click

Consistent sub-millisecond read and write response times

with consistent high throughput

No downtime for software upgrades, hardware maintenance, etc.

Flexible Data Model

JSON document model with no fixed schema.

Couchbase Server Core Principles

New in 2.0

JSON support Indexing and Querying

Cross Datacenter ReplicationIncremental Map Reduce

JSONJSONJSON

JSONJSON

• Database stays online, no downtime for schema changes• Records can have different structures, there is no fixed schema• Model Data easier and faster -- agile rapid application

development

{ “ID”: 1, “FIRST”: “Dipti”, “LAST”: “Borkar”, “ZIP”: “94040”, “CITY”: “MV”, “STATE”: “CA”

JSONJSON JSON

Flexible Data Model

Architecture

Couchbase Server 2.0 Architecture

on each node

one per cluster

httpRE

HTTP8091

Erlang port mapper4369

Distributed Erlang21100 - 21199

Erlang/OTP

storage interface

Couchbase EP Engine

11210Memcapable 2.0

11211Memcapable 1.0

Memcached

New Persistence Layer

8092Query API

Data Manager Cluster Manager

Couchbase Server 2.0 Architecture

on each node

one per cluster

HTTP8091

Erlang port mapper4369

Distributed Erlang21100 - 21199

Erlang/OTP

storage interface

Couchbase EP Engine

11210Memcapable 2.0

11211Memcapable 1.0

Built-in Cache

New Persistence Layer

8092Query API

Couchbase Operations

3333 22

Single node - Couchbase Write Operation

Managed Cache

Replication Queue

App Server

Couchbase Server Node

Doc 1Doc 1

To other node

3333 22

Single node - Couchbase Update Operation

Managed Cache

Replication Queue

App Server

Doc 1’

Doc 1’Doc 1

Doc 1’

To other node

3333 22

Single node - Couchbase Read Operation

Replication Queue

App Server

Doc 1Doc 1

Managed Cache

To other node

3333 22

Single node - Couchbase Cache Eviction2

Replication Queue

App Server

Doc 6Doc 5Doc 4Doc 3Doc 2

Doc 6 Doc 5 Doc 4 Doc 3 Doc 2

Managed Cache

To other node

3333 22

Single node – Couchbase Cache Miss2

Replication Queue

App Server

Doc 3Doc 5 Doc 2Doc 4

Doc 6 Doc 5 Doc 4 Doc 3 Doc 2

Managed Cache

To other node

Couchbase Server Cluster

Cluster-wide Basic Operation

• Docs distributed evenly across servers

• Each server stores both active and replica docsOnly one server active at a time

• Client library provides app with simple interface to database

• Cluster map provides map to which server doc is onApp never needs to know

• App reads, writes, updates docs

• Multiple app servers can access same document at same time

User Configured Replica Count = 1

READ/WRITE/UPDATE

Active

Server 1

Active

Server 2

Active

REPLICA

Server 3

App Server 1

COUCHBASE Client LibraryCOUCHBASE Client Library

Cluster Map

App Server 2

Add Nodes to Cluster

• Two servers addedOne-click operation

• Docs automatically rebalanced across clusterEven distribution of docsMinimum doc movement

• Cluster map updated

• App database calls now distributed over larger number of servers

REPLICA

Active

Server 1

REPLICA

Active

Server 2

REPLICA

Active

Server 3 Server 4 Server 5

REPLICA

Active

REPLICA

Active

Doc 8 Doc

Doc 9 Doc

Doc 2 Doc

Doc 8 Doc

Doc 5 Doc

READ/WRITE/UPDATE READ/WRITE/UPDATE

App Server 1

Cluster Map

App Server 2

Fail Over Node

REPLICA

Active

Server 1

REPLICA

Active

Server 2

REPLICA

Active

Server 3 Server 4 Server 5

REPLICA

Active

REPLICA

Active

Doc Doc 6 Doc

Doc 5 Doc

Doc 8 Doc

• App servers accessing docs

• Requests to Server 3 fail

• Cluster detects server failedPromotes replicas of docs to activeUpdates cluster map

• Requests for docs now go to appropriate server

• Typically rebalance would follow

Doc 1 Doc 3

App Server 1

Cluster Map

App Server 2

Indexing and Querying – The basics

• Define materialized views on JSON documents and then query across the data set

• Using views you can define• Primary indexes • Simple secondary indexes (most common use case)• Complex secondary, tertiary and composite indexes• Aggregations (reduction)

• Indexes are eventually indexed

• Queries are eventually consistent

• Built using Map/Reduce technology • Map and Reduce functions are written in Javascript

3333 22

Eventually indexed Views – Data flow2

Managed Cache

Replication Queue

App Server

Doc 1Doc 1

To other node

View engine

Indexing and Querying

Active

Server 1

REPLICA

App Server 1

Cluster Map

App Server 2

• Indexing work is distributed amongst nodes

• Large data set possible

• Parallelize the effort

• Each node has index for data stored on it

• Queries combine the results from required nodes

Active

Server 2

REPLICA

Active

Server 3

REPLICA

Cross Data Center Replication – The basics

•Replicate your Couchbase data across clusters

•Clusters may be spread across geos

•Configured on a per-bucket (per-database) basis

•Supports unidirectional and bidirectional operation

•Application can read and write from both clusters Active – Active replication

•Replication throughput scales out linearly

•Different from intra-cluster replication

3333 22

Cross data center replication – Data flow2

Managed Cache

Replication Queue

App Server

Doc 1Doc 1

To other node

XDCR Queue

To other cluster

Cross Data Center Replication (XDCR)Couchbase Server Cluster

NY DATA CENTERActive

Server 1

Server 2 Server 3

Doc Doc Doc

Active

Doc RAM

Active

DocRAM

Doc Doc Doc

Couchbase Server ClusterSF DATA CENTER

Active

Server 1

Server 2 Server 3

Doc Doc Doc

Active

Doc RAM

Active

DocRAM

Doc Doc Doc

Elasticsearch Integration (via XDCR)

RAM CACHERAM CACHE

SERVER 1

DISKDISK

RAM CACHERAM CACHE

SERVER 2

DISKDISK

RAM CACHERAM CACHE

SERVER 3

DISKDISK

Couchbase Cluster

ES SERVER 1

Elasticsearch Cluster

ES SERVER 2 ES SERVER 3

CouchbaseCouchbaseTransport Transport

PluginPlugin

Demo: Data for Social Game

3 Objects (documents) within game:• Players•Monsters• Items

Gameplay:• Players fight monsters•Monsters drop items• Players own items

Player Document

{"jsonType": "player","uuid": "35767d02-a958-4b83-8179-616816692de1","name": "Keith4540","hitpoints": 75,"experience": 663,"level": 4,"loggedIn": false

Player ID

Item Document

{"jsonType": "item","name": "Katana_e5890c94-11c6-65746ce6c560","uuid": "e5890c94-11c6-4856-a7a6-65746ce6c560","ownerId": "Dale9887"

Item ID

Player ID

Monster Document

{"jsonType": "monster","name": "Bauchan9932","uuid": "d10dfc1b-0412-4140-b4ec-affdbf2aa5ec","hitpoints": 370,"experienceWhenKilled": 52,"itemProbability": 0.5050581341872865

Monster ID

Official SDKs

Community SDKs

www.couchbase.com/develop

PythonRuby

Go Clojure

Thank you!anil@couchbase.com

@anilkumar1129

Get Couchbase Server at http://www.couchbase.com/downloa

Webinar - Introduction to Couchbase Server

Technology

Performance & scalability of Couchbase Server – Couchbase....

Couchbase 104 Webinar

Best Practices with Views in Couchbase Server: Couchbase...

Architectural Overview of Couchbase Server · 2 Overview of...

Webinar - Couchbase Lite Under the Hood

Securing Your Couchbase Environment in Couchbase Server 4.0:...

Couchbase Mobile Webinar: Building Apps for Couchbase Mobile...

Securing Your Couchbase Server Deployment Using Vormetric:.....

Launch Webinar - Introducing Couchbase Server 2.0

Deploying Couchbase Server on Microsoft Azure Cloud –...

Webinar - Einfuehrung in Couchbase

Using Couchbase Server to Address Memcached Challenges -...

What’s New In Couchbase Server...

Deploying Couchbase Server Using Docker: Couchbase Connect.....

Webinar - Moving from MySQL to Couchbase

Introduction à Couchbase Server 2.0