Tugdual Grall, profile picture
Uploaded byTugdual Grall
349 views

FOSDEM 2013 : Getting Started with Couchhbase Server 2.0

The document outlines the features and architecture of Couchbase Server 2.0, highlighting its capabilities for high scalability, performance, and ease of development. It emphasizes the software's use of a JSON document model and principles such as consistent uptime and efficient data handling across distributed servers. Additionally, it provides an overview of operational procedures like document retrieval and commands, along with the setup for development across various operating systems.

Embed presentation

Monday, February 4, 13
Ge#ng  Started  with   Couchbase Tugdual  “Tug”  Grall Technical  Evangelist email:  tug@couchbase.com twi0er:  @tgrall Monday, February 4, 13
Ge#ng  Started  with   Couchbase Tugdual  “Tug”  Grall Technical  Evangelist email:  tug@couchbase.com twi0er:  @tgrall Monday, February 4, 13
Couchbase  Server  Core  Principles Easy   Consistent  High   Scalability PE RF O R M A N C E Performance Grow  cluster  without   Consistent  sub-­‐millisecond   applica7on  changes,  without   read  and  write  response  7mes   down7me  with  a  single  click with  consistent  high  throughput Always  On   JSON JSON JSO Flexible  Data   24x365 Model JSON N JSON No  down7me  for  so>ware   JSON  document  model  with  no   upgrades,  hardware   fixed  schema. maintenance,  etc. Monday, February 4, 13
Couchbase  2.0  New  Features JSON support Indexing and Querying Incremental Map Cross data center Reduce replication Monday, February 4, 13
Couchbase  Handles  Real  World  Scale Monday, February 4, 13
8092 Couchbase  Server  2.0  Architecture 11211 11210 Query  API Memcapable    1.0 Memcapable    2.0 Sub:tle Moxi Query  Engine REST  management  API/Web  UI vBucket  state  and  replica7on  manager Memcached Global  singleton  supervisor Rebalance  orchestrator Configura7on  manager Node  health  monitor Process  monitor Couchbase  EP  Engine Heartbeat Data  Manager Cluster  Manager storage  interface New  Persistence  Layer hDp on  each  node one  per  cluster Erlang/OTP HTTP Erlang  port  mapper Distributed  Erlang 8091 4369 21100  -­‐  21199 Monday, February 4, 13
Couchbase  Server  2.0  Architecture 8092 11211 11210 Query  API Memcapable    1.0 Memcapable    2.0 Moxi Query  Engine REST  management  API/Web  UI vBucket  state  and  replica7on  manager Object-­‐level  Cache Global  singleton  supervisor RAM  Cache,   Rebalance  orchestrator Configura7on  manager Node  health  monitor Server/Cluster   Process  monitor Indexing  &   Heartbeat Couchbase  EP  Engine Management  &   Persistence   storage  interface CommunicaYon Management (Erlang) New  (C  Persistence Disk   &  V8) Persistence  Layer hDp on  each  node one  per  cluster Erlang/OTP The Unreasonable Effectiveness of C by Damien Katz HTTP Erlang  port  mapper Distributed  Erlang 8091 4369 21100  -­‐  21199 Monday, February 4, 13
Open  Source  Project Apache  2.0 hIps://github.com/couchbase/ Gerrit: hIp://review.couchbase.org/ hIps://github.com/couchbaselabs/ Monday, February 4, 13
Monday, February 4, 13
SETTING  UP  TO  DEVELOP Monday, February 4, 13
Install  Couchbase  Server  2.0 Ubuntu RedHat Mac  OS  X Windows or  build  from  sources Monday, February 4, 13
Official  SDKs Ruby libcouchbase Clojure Python www.couchbase.com/develop Go Monday, February 4, 13
Monday, February 4, 13
COUCHBASE  OPERATIONS Monday, February 4, 13
Monday, February 4, 13
DEMONSTRATION Monday, February 4, 13
Write  OperaJon Doc  1 App  Server 3 3 Managed  Cache 2 To  other  node Replica7on   Queue Disk  Queue Disk Couchbase  Server  Node Monday, February 4, 13
Write  OperaJon App  Server 3 3 Managed  Cache 2 To  other  node Replica7on   Doc  1 Queue Disk  Queue Disk Couchbase  Server  Node Monday, February 4, 13
Write  OperaJon App  Server 3 3 Managed  Cache 2 To  other  node Replica7on   Doc  1 Doc  1 Doc  1 Queue Disk  Queue Disk Couchbase  Server  Node Monday, February 4, 13
Basic  OperaJons • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs • MulYple  app  servers  can  access  same   document  at  same  Yme COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA • MulYple  app  servers  can  access  same   Doc  4 Doc Doc  6 Doc Doc  7 Doc document  at  same  Yme Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA • MulYple  app  servers  can  access  same   Doc  4 Doc Doc  6 Doc Doc  7 Doc document  at  same  Yme Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   READ/WRITE/UPDATE • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA • MulYple  app  servers  can  access  same   Doc  4 Doc Doc  6 Doc Doc  7 Doc document  at  same  Yme Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Basic  OperaJons • get  (key) –  Retrieve  a  document • set  (key,  value) –  Store  a  document,  overwrites  if  exists • add  (key,  value) –  Store  a  document,  error/excep7on  if  exists • replace  (key,  value) –  Store  a  document,  error/excep7on  if  doesn’t  exist • cas  (key,  value,  cas) –  Compare  and  swap,  mutate  document  only  if  it  hasn’t  changed  while   execu7ng  this  opera7on Monday, February 4, 13
Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc • Cluster  detects  server  failed Promotes  replicas  of  docs  to  ac7ve Updates  cluster  map • Requests  for  docs  now  go  to   appropriate  server REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc Doc  8 Doc • Typically  rebalance   would  follow Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc • Cluster  detects  server  failed Promotes  replicas  of  docs  to  ac7ve Updates  cluster  map • Requests  for  docs  now  go  to   appropriate  server REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc Doc  8 Doc • Typically  rebalance   would  follow Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc Doc  8 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc Doc • Cluster  detects  server  failed Promotes  replicas  of  docs  to  ac7ve Updates  cluster  map Doc  1 Doc  3 • Requests  for  docs  now  go  to   appropriate  server REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc  8 Doc • Typically  rebalance   would  follow Doc Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP Query SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
Cross  Data  Center  ReplicaJon  (XDCR) Couchbase  Cluster Couchbase  Cluster West  Coast  Data  Center East  Coast  Data  Center SERVER  1 SERVER  2 SERVER  3 SERVER  1 SERVER  2 SERVER  3 RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc DISK DISK DISK DISK DISK DISK Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Monday, February 4, 13
Cross  Data  Center  ReplicaJon  (XDCR) Couchbase  Cluster Couchbase  Cluster West  Coast  Data  Center East  Coast  Data  Center SERVER  1 SERVER  2 SERVER  3 SERVER  1 SERVER  2 SERVER  3 RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc DISK DISK DISK DISK DISK DISK Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Monday, February 4, 13
GeoCouch  R-­‐Tree  Index • Optimized for bulk loading of large data sets • Simplified query model (bounding box, nearest neighbor) Monday, February 4, 13
ElasJc  Search  Adaptor • Elastic Search is good for ad-hoc queries and faceted browsing • Our adapter is aware of changing Couchbase topology • Indexed by Elastic Search after stored to disk in Couchbase ElasYcSearch Monday, February 4, 13
I’m  Excited  to  See  What  You  Build, Q  &  A Couchbase  Docs Contact  me  on  TwiDer www.couchbase.com/docs/index-­‐full.html @tgrall Couchbase  Forums Contact  me  by  Email www.couchbase.com/forums tug@couchbase.com IRC Learn  More  About  Design  PaDerns #couchbase CouchbaseModels.com #libcouchbase Seeng  up  for  Ruby  on  Rails CouchbaseOnRails.com Monday, February 4, 13
Monitoring Monday, February 4, 13

More Related Content

PPTX
Introduction to Couchbase Server 2.0
byDipti Borkar
 
PPTX
Launch webinar-introducing couchbase server 2.0-01202013
byDipti Borkar
 
PDF
Introduction to Couchbase Server 2.0 - CouchConf SF - Tour and Demo
byDipti Borkar
 
PPT
Snapmirror Design
byOkieUnix
 
PDF
Couchbase Korea User Gorup 2nd Meetup #1
bywon min jang
 
PDF
Oracle Arch
byqiuye
 
PDF
Virt Exchange2k7 Final Frontier V Mworld2007
byKong Yang
 
PDF
Upgrade approaches share_pointproducts
byArd van Someren
 
Introduction to Couchbase Server 2.0
byDipti Borkar
 
Launch webinar-introducing couchbase server 2.0-01202013
byDipti Borkar
 
Introduction to Couchbase Server 2.0 - CouchConf SF - Tour and Demo
byDipti Borkar
 
Snapmirror Design
byOkieUnix
 
Couchbase Korea User Gorup 2nd Meetup #1
bywon min jang
 
Oracle Arch
byqiuye
 
Virt Exchange2k7 Final Frontier V Mworld2007
byKong Yang
 
Upgrade approaches share_pointproducts
byArd van Someren
 

What's hot

PDF
Advanced mysql replication techniques
byGiuseppe Maxia
 
PDF
Netgear ReadyNAS Comparison
byAltaware, Inc.
 
PPT
Approaches to Designing a High-Performance Switch Router
byVishal Sharma, Ph.D.
 
PDF
1006 Z2 Intro Complete
byHenning Blohm
 
KEY
L0001 - The Terminology of the Eclipse Platform
byTonny Madsen
 
PDF
SLES 11 SP2 PerformanceEvaluation for Linux on System z
byIBM India Smarter Computing
 
PDF
Replication using golden gate 11g
byGreg Turmel
 
PDF
Share Point 2010 Deployment
byKamol Sagwan
 
Advanced mysql replication techniques
byGiuseppe Maxia
 
Netgear ReadyNAS Comparison
byAltaware, Inc.
 
Approaches to Designing a High-Performance Switch Router
byVishal Sharma, Ph.D.
 
1006 Z2 Intro Complete
byHenning Blohm
 
L0001 - The Terminology of the Eclipse Platform
byTonny Madsen
 
SLES 11 SP2 PerformanceEvaluation for Linux on System z
byIBM India Smarter Computing
 
Replication using golden gate 11g
byGreg Turmel
 
Share Point 2010 Deployment
byKamol Sagwan
 

Viewers also liked

PDF
Obamacare markets debut as early hurdles may slow signups hCentive news
byAlisha North
 
PDF
Veg Oil Motoring
byQW9
 
PDF
Obamacare markets debut as early hurdles may slow signups - hCentive news
byAlisha North
 
PDF
Health care law providing work for local companies - hCentive news
byAlisha North
 
PDF
In obamacare, tech entrepreneur envisions a new expedia - hCentive news
byAlisha North
 
PDF
6 fields where obamacare is creating jobs- hCentive news
byAlisha North
 
PDF
Obamacare crashes onths in coming not easily repaired - hCentive news
byAlisha North
 
PDF
Back end errors at u.s. health website jeopardize sign-up-hCentive news
byAlisha North
 
PDF
caricatura
byluzdelluvia
 
Obamacare markets debut as early hurdles may slow signups hCentive news
byAlisha North
 
Veg Oil Motoring
byQW9
 
Obamacare markets debut as early hurdles may slow signups - hCentive news
byAlisha North
 
Health care law providing work for local companies - hCentive news
byAlisha North
 
In obamacare, tech entrepreneur envisions a new expedia - hCentive news
byAlisha North
 
6 fields where obamacare is creating jobs- hCentive news
byAlisha North
 
Obamacare crashes onths in coming not easily repaired - hCentive news
byAlisha North
 
Back end errors at u.s. health website jeopardize sign-up-hCentive news
byAlisha North
 
caricatura
byluzdelluvia
 

Similar to FOSDEM 2013 : Getting Started with Couchhbase Server 2.0

PDF
Eigrp
byfirey
 
PDF
Quantum Networks
byOpenCity Community
 
PPTX
Virtualizing Latency Sensitive Workloads and vFabric GemFire
byCarter Shanklin
 
PPT
Building FOSS clouds
bySebastien Goasguen
 
PPTX
Ambari Meetup: Architecture and Demo
byHortonworks
 
PDF
Building Server Applications with EclipseRT
byGunnar Wagenknecht
 
PDF
TBIZ2011 - Juniper. Next Generation Data Center
byTechnologyBIZ
 
PDF
Big Data Israel Meetup : Couchbase and Big Data
byTugdual Grall
 
PPTX
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
byOntico
 
PDF
Couchbase b jmeetup
bymysqlops
 
PDF
Developer's Most Frequent Hadoop Headaches & How to Address Them__HadoopSumm...
byYahoo Developer Network
 
KEY
NoSQL "Tools in Action" talk at Devoxx
byNGDATA
 
PDF
Windows Azure Interoperability
byMihai Dan Nadas
 
PDF
2012 CloudStack Design Camp in Taiwan--- CloudStack Overview-2
bytcloudcomputing-tw
 
PDF
RuG Guest Lecture
byfvanvollenhoven
 
PDF
Next Generation Cassandra
byAcunu
 
PPTX
Cloud Foundry Open Tour - London
bymarklucovsky
 
PDF
Supercharging Cassandra - GOTO Amsterdam
byAcunu
 
PDF
Google Compute and MapR
byMapR Technologies
 
PDF
Cloud Foundry Anniversary: Technical Slides
bymarklucovsky
 
Eigrp
byfirey
 
Quantum Networks
byOpenCity Community
 
Virtualizing Latency Sensitive Workloads and vFabric GemFire
byCarter Shanklin
 
Building FOSS clouds
bySebastien Goasguen
 
Ambari Meetup: Architecture and Demo
byHortonworks
 
Building Server Applications with EclipseRT
byGunnar Wagenknecht
 
TBIZ2011 - Juniper. Next Generation Data Center
byTechnologyBIZ
 
Big Data Israel Meetup : Couchbase and Big Data
byTugdual Grall
 
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
byOntico
 
Couchbase b jmeetup
bymysqlops
 
Developer's Most Frequent Hadoop Headaches & How to Address Them__HadoopSumm...
byYahoo Developer Network
 
NoSQL "Tools in Action" talk at Devoxx
byNGDATA
 
Windows Azure Interoperability
byMihai Dan Nadas
 
2012 CloudStack Design Camp in Taiwan--- CloudStack Overview-2
bytcloudcomputing-tw
 
RuG Guest Lecture
byfvanvollenhoven
 
Next Generation Cassandra
byAcunu
 
Cloud Foundry Open Tour - London
bymarklucovsky
 
Supercharging Cassandra - GOTO Amsterdam
byAcunu
 
Google Compute and MapR
byMapR Technologies
 
Cloud Foundry Anniversary: Technical Slides
bymarklucovsky
 

More from Tugdual Grall

PPTX
MongoDB and Hadoop
byTugdual Grall
 
PDF
Introduction to Streaming with Apache Flink
byTugdual Grall
 
PDF
Big Data Journey
byTugdual Grall
 
PDF
Introduction to Streaming with Apache Flink
byTugdual Grall
 
PPTX
Lambda Architecture: The Best Way to Build Scalable and Reliable Applications!
byTugdual Grall
 
PDF
Fast Cars, Big Data - How Streaming Can Help Formula 1
byTugdual Grall
 
PDF
Introduction to NoSQL with Couchbase
byTugdual Grall
 
PDF
Softshake 2013: Introduction to NoSQL with Couchbase
byTugdual Grall
 
PDF
Why and How to integrate Hadoop and NoSQL?
byTugdual Grall
 
PDF
NoSQL Matters 2013 - Introduction to Map Reduce with Couchbase 2.0
byTugdual Grall
 
PDF
Proud to be polyglot
byTugdual Grall
 
PDF
Enabling Telco to Build and Run Modern Applications
byTugdual Grall
 
PDF
Proud to be Polyglot - Riviera Dev 2015
byTugdual Grall
 
PDF
Devoxx 2014 : Atelier MongoDB - Decouverte de MongoDB 2.6
byTugdual Grall
 
PDF
Opensourceday 2014-iot
byTugdual Grall
 
PDF
Neotys conference
byTugdual Grall
 
PDF
Some cool features of MongoDB
byTugdual Grall
 
PDF
Building Your First MongoDB Application
byTugdual Grall
 
PDF
Introduction to NoSQL with MongoDB - SQLi Workshop
byTugdual Grall
 
PDF
Drop your table ! MongoDB Schema Design
byTugdual Grall
 
MongoDB and Hadoop
byTugdual Grall
 
Introduction to Streaming with Apache Flink
byTugdual Grall
 
Big Data Journey
byTugdual Grall
 
Introduction to Streaming with Apache Flink
byTugdual Grall
 
Lambda Architecture: The Best Way to Build Scalable and Reliable Applications!
byTugdual Grall
 
Fast Cars, Big Data - How Streaming Can Help Formula 1
byTugdual Grall
 
Introduction to NoSQL with Couchbase
byTugdual Grall
 
Softshake 2013: Introduction to NoSQL with Couchbase
byTugdual Grall
 
Why and How to integrate Hadoop and NoSQL?
byTugdual Grall
 
NoSQL Matters 2013 - Introduction to Map Reduce with Couchbase 2.0
byTugdual Grall
 
Proud to be polyglot
byTugdual Grall
 
Enabling Telco to Build and Run Modern Applications
byTugdual Grall
 
Proud to be Polyglot - Riviera Dev 2015
byTugdual Grall
 
Devoxx 2014 : Atelier MongoDB - Decouverte de MongoDB 2.6
byTugdual Grall
 
Opensourceday 2014-iot
byTugdual Grall
 
Neotys conference
byTugdual Grall
 
Some cool features of MongoDB
byTugdual Grall
 
Building Your First MongoDB Application
byTugdual Grall
 
Introduction to NoSQL with MongoDB - SQLi Workshop
byTugdual Grall
 
Drop your table ! MongoDB Schema Design
byTugdual Grall
 

Recently uploaded

PDF
Digit Expo 2025 - EICC Edinburgh 27th November
byRay Bugg
 
PDF
Unlocking the Power of Salesforce Architecture: Frameworks for Effective Solu...
byvarsha30tiwari
 
PDF
Vibe Coding vs. Spec-Driven Development [Free Meetup]
byHaim Michael
 
PDF
Generative AI in UiPath: Mastering the Generative Extractor for Intelligent D...
byDianaGray10
 
PPTX
Basics of Identity Access Management In mordern Infrastructure
byPrinceXavier18
 
PDF
Agentic Automation for Testers – A Hands-On Deep Dive
byUiPathCommunity
 
PDF
API206-S: Transforming Supply Chains with Amazon Bedrock AgentCore - AWS re:I...
byChris Bingham
 
PPTX
THIS IS CYBER SECURITY NOTES USED IN CLASS ON VARIOUS TOPICS USED IN CYBERSEC...
byMelissaGblinwon
 
PDF
eResource Scheduler Enterprise Resource Management and Scheduling Software.pdf
byeResource Scheduler
 
PDF
AI and Computer Architecture: 200 Years Together
byDmitry Zinoviev
 
PDF
How Mobile Apps Are Shaping the Future of Digital Innovation
byWilliam Taylor
 
PDF
Safeguarding AI-Based Financial Infrastructure
byYasir Naveed Riaz
 
PDF
Generative AI in 2026: Hype, Bubble, Winter or The Real Deal?
byDr. Tathagat Varma
 
PDF
Top 7 Manufacturing Software for Small Businesses Boosting Growth in 2025
byEnvertis Software Solutions
 
PDF
The Ultimate Guide to Problem Management Dashboards for IT Teams.pdf
byomnex systems
 
PDF
TPPmark2025 Kenta Inoue's answer 12/04/2025
byKenta Inoue
 
PDF
TrustArc Webinar - Assessing AI Risk with Confidence
byTrustArc
 
PDF
Innovative AI Solutions for Business Growth.pdf
byVox Works
 
PDF
Ransomware_Resilience_Strategic_Playbook.pdf
byAfonso Henrique Rodrigues Alves
 
PDF
Top Cybersecurity Threats 2025 Guide by Sureshdas
byPrintersassist
 
Digit Expo 2025 - EICC Edinburgh 27th November
byRay Bugg
 
Unlocking the Power of Salesforce Architecture: Frameworks for Effective Solu...
byvarsha30tiwari
 
Vibe Coding vs. Spec-Driven Development [Free Meetup]
byHaim Michael
 
Generative AI in UiPath: Mastering the Generative Extractor for Intelligent D...
byDianaGray10
 
Basics of Identity Access Management In mordern Infrastructure
byPrinceXavier18
 
Agentic Automation for Testers – A Hands-On Deep Dive
byUiPathCommunity
 
API206-S: Transforming Supply Chains with Amazon Bedrock AgentCore - AWS re:I...
byChris Bingham
 
THIS IS CYBER SECURITY NOTES USED IN CLASS ON VARIOUS TOPICS USED IN CYBERSEC...
byMelissaGblinwon
 
eResource Scheduler Enterprise Resource Management and Scheduling Software.pdf
byeResource Scheduler
 
AI and Computer Architecture: 200 Years Together
byDmitry Zinoviev
 
How Mobile Apps Are Shaping the Future of Digital Innovation
byWilliam Taylor
 
Safeguarding AI-Based Financial Infrastructure
byYasir Naveed Riaz
 
Generative AI in 2026: Hype, Bubble, Winter or The Real Deal?
byDr. Tathagat Varma
 
Top 7 Manufacturing Software for Small Businesses Boosting Growth in 2025
byEnvertis Software Solutions
 
The Ultimate Guide to Problem Management Dashboards for IT Teams.pdf
byomnex systems
 
TPPmark2025 Kenta Inoue's answer 12/04/2025
byKenta Inoue
 
TrustArc Webinar - Assessing AI Risk with Confidence
byTrustArc
 
Innovative AI Solutions for Business Growth.pdf
byVox Works
 
Ransomware_Resilience_Strategic_Playbook.pdf
byAfonso Henrique Rodrigues Alves
 
Top Cybersecurity Threats 2025 Guide by Sureshdas
byPrintersassist
 

FOSDEM 2013 : Getting Started with Couchhbase Server 2.0

  • 1.
  • 2.
    Ge#ng  Started  with   Couchbase Tugdual  “Tug”  Grall Technical  Evangelist email:  tug@couchbase.com twi0er:  @tgrall Monday, February 4, 13
  • 3.
    Ge#ng  Started  with   Couchbase Tugdual  “Tug”  Grall Technical  Evangelist email:  tug@couchbase.com twi0er:  @tgrall Monday, February 4, 13
  • 4.
    Couchbase  Server  Core  Principles Easy   Consistent  High   Scalability PE RF O R M A N C E Performance Grow  cluster  without   Consistent  sub-­‐millisecond   applica7on  changes,  without   read  and  write  response  7mes   down7me  with  a  single  click with  consistent  high  throughput Always  On   JSON JSON JSO Flexible  Data   24x365 Model JSON N JSON No  down7me  for  so>ware   JSON  document  model  with  no   upgrades,  hardware   fixed  schema. maintenance,  etc. Monday, February 4, 13
  • 5.
    Couchbase  2.0  New  Features JSON support Indexing and Querying Incremental Map Cross data center Reduce replication Monday, February 4, 13
  • 6.
    Couchbase  Handles  Real  World  Scale Monday, February 4, 13
  • 7.
    8092 Couchbase  Server  2.0  Architecture 11211 11210 Query  API Memcapable    1.0 Memcapable    2.0 Sub:tle Moxi Query  Engine REST  management  API/Web  UI vBucket  state  and  replica7on  manager Memcached Global  singleton  supervisor Rebalance  orchestrator Configura7on  manager Node  health  monitor Process  monitor Couchbase  EP  Engine Heartbeat Data  Manager Cluster  Manager storage  interface New  Persistence  Layer hDp on  each  node one  per  cluster Erlang/OTP HTTP Erlang  port  mapper Distributed  Erlang 8091 4369 21100  -­‐  21199 Monday, February 4, 13
  • 8.
    Couchbase  Server  2.0  Architecture 8092 11211 11210 Query  API Memcapable    1.0 Memcapable    2.0 Moxi Query  Engine REST  management  API/Web  UI vBucket  state  and  replica7on  manager Object-­‐level  Cache Global  singleton  supervisor RAM  Cache,   Rebalance  orchestrator Configura7on  manager Node  health  monitor Server/Cluster   Process  monitor Indexing  &   Heartbeat Couchbase  EP  Engine Management  &   Persistence   storage  interface CommunicaYon Management (Erlang) New  (C  Persistence Disk   &  V8) Persistence  Layer hDp on  each  node one  per  cluster Erlang/OTP The Unreasonable Effectiveness of C by Damien Katz HTTP Erlang  port  mapper Distributed  Erlang 8091 4369 21100  -­‐  21199 Monday, February 4, 13
  • 9.
    Open  Source  Project Apache  2.0 hIps://github.com/couchbase/ Gerrit: hIp://review.couchbase.org/ hIps://github.com/couchbaselabs/ Monday, February 4, 13
  • 10.
  • 11.
    SETTING  UP  TO  DEVELOP Monday, February 4, 13
  • 12.
    Install  Couchbase  Server  2.0 Ubuntu RedHat Mac  OS  X Windows or  build  from  sources Monday, February 4, 13
  • 13.
    Official  SDKs Ruby libcouchbase Clojure Python www.couchbase.com/develop Go Monday, February 4, 13
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
    Write  OperaJon Doc  1 App  Server 3 3 Managed  Cache 2 To  other  node Replica7on   Queue Disk  Queue Disk Couchbase  Server  Node Monday, February 4, 13
  • 19.
    Write  OperaJon App  Server 3 3 Managed  Cache 2 To  other  node Replica7on   Doc  1 Queue Disk  Queue Disk Couchbase  Server  Node Monday, February 4, 13
  • 20.
    Write  OperaJon App  Server 3 3 Managed  Cache 2 To  other  node Replica7on   Doc  1 Doc  1 Doc  1 Queue Disk  Queue Disk Couchbase  Server  Node Monday, February 4, 13
  • 21.
    Basic  OperaJons • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs • MulYple  app  servers  can  access  same   document  at  same  Yme COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 22.
    Basic  OperaJons • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA • MulYple  app  servers  can  access  same   Doc  4 Doc Doc  6 Doc Doc  7 Doc document  at  same  Yme Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 23.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA • MulYple  app  servers  can  access  same   Doc  4 Doc Doc  6 Doc Doc  7 Doc document  at  same  Yme Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 24.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 25.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 26.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 27.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 28.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 29.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 30.
    Basic  OperaJons APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP • Docs  distributed  evenly  across  servers   READ/WRITE/UPDATE • Each  server  stores  both  acYve  and  replica   SERVER  1 SERVER  2 SERVER  3 docs Only  one  doc  ac7ve  at  a  7me ACTIVE ACTIVE ACTIVE • Client  library  provides  app  with  simple   Doc  5 Doc Doc  4 Doc Doc  1 Doc interface  to  database Doc  2 Doc Doc  7 Doc Doc  2 Doc • Cluster  map  provides  map   to  which  server  doc  is  on Doc  9 Doc Doc  8 Doc Doc  6 Doc App  never  needs  to  know • App  reads,  writes,  updates  docs REPLICA REPLICA REPLICA • MulYple  app  servers  can  access  same   Doc  4 Doc Doc  6 Doc Doc  7 Doc document  at  same  Yme Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  8 Doc Doc  2 Doc Doc  5 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 31.
    Basic  OperaJons • get  (key) –  Retrieve  a  document • set  (key,  value) –  Store  a  document,  overwrites  if  exists • add  (key,  value) –  Store  a  document,  error/excep7on  if  exists • replace  (key,  value) –  Store  a  document,  error/excep7on  if  doesn’t  exist • cas  (key,  value,  cas) –  Compare  and  swap,  mutate  document  only  if  it  hasn’t  changed  while   execu7ng  this  opera7on Monday, February 4, 13
  • 32.
    Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc • Cluster  detects  server  failed Promotes  replicas  of  docs  to  ac7ve Updates  cluster  map • Requests  for  docs  now  go  to   appropriate  server REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc Doc  8 Doc • Typically  rebalance   would  follow Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
  • 33.
    Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc • Cluster  detects  server  failed Promotes  replicas  of  docs  to  ac7ve Updates  cluster  map • Requests  for  docs  now  go  to   appropriate  server REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc Doc  8 Doc • Typically  rebalance   would  follow Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
  • 34.
    Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc Doc  8 Doc Doc  1 Doc Doc  3 Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
  • 35.
    Fail  Over  Node APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 SERVER  4 SERVER  5 • App  servers  accessing  docs ACTIVE ACTIVE ACTIVE ACTIVE ACTIVE Doc  5 Doc Doc  4 Doc Doc  1 Doc Doc  9 Doc Doc  6 Doc • Requests  to  Server  3  fail Doc  2 Doc Doc  7 Doc Doc  2 Doc Doc  8 Doc Doc • Cluster  detects  server  failed Promotes  replicas  of  docs  to  ac7ve Updates  cluster  map Doc  1 Doc  3 • Requests  for  docs  now  go  to   appropriate  server REPLICA REPLICA REPLICA REPLICA REPLICA Doc  4 Doc Doc  6 Doc Doc  7 Doc Doc  5 Doc  8 Doc • Typically  rebalance   would  follow Doc Doc Doc  9 Doc Doc  2 Doc COUCHBASE  SERVER    CLUSTER User  Configured  Replica  Count  =  1 Monday, February 4, 13
  • 36.
    Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 37.
    Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 38.
    Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 39.
    Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP Query SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 40.
    Indexing  and  Querying APP  SERVER  1 APP  SERVER  2 COUCHBASE  Client  Library COUCHBASE  Client  Library CLUSTER  MAP CLUSTER  MAP SERVER  1 SERVER  2 SERVER  3 ACTIVE • Indexing  work  is  distributed  amongst   ACTIVE ACTIVE nodes Doc  5 Doc Doc  5 Doc Doc  5 Doc • Large  data  set  possible Doc  2 Doc Doc  2 Doc Doc  2 Doc • Parallelize  the  effort Doc  9 Doc Doc  9 Doc Doc  9 Doc • Each  node  has  index  for  data  stored  on  it REPLICA REPLICA REPLICA • Queries  combine  the  results  from   required  nodes Doc  4 Doc Doc  4 Doc Doc  4 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  8 Doc Doc  8 Doc Doc  8 Doc COUCHBASE  SERVER    CLUSTER Monday, February 4, 13
  • 41.
    Cross  Data  Center  ReplicaJon  (XDCR) Couchbase  Cluster Couchbase  Cluster West  Coast  Data  Center East  Coast  Data  Center SERVER  1 SERVER  2 SERVER  3 SERVER  1 SERVER  2 SERVER  3 RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc DISK DISK DISK DISK DISK DISK Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Monday, February 4, 13
  • 42.
    Cross  Data  Center  ReplicaJon  (XDCR) Couchbase  Cluster Couchbase  Cluster West  Coast  Data  Center East  Coast  Data  Center SERVER  1 SERVER  2 SERVER  3 SERVER  1 SERVER  2 SERVER  3 RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE RAM  CACHE Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  1 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  2 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc Doc  6 Doc DISK DISK DISK DISK DISK DISK Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Doc Monday, February 4, 13
  • 43.
    GeoCouch  R-­‐Tree  Index • Optimized for bulk loading of large data sets • Simplified query model (bounding box, nearest neighbor) Monday, February 4, 13
  • 44.
    ElasJc  Search  Adaptor • Elastic Search is good for ad-hoc queries and faceted browsing • Our adapter is aware of changing Couchbase topology • Indexed by Elastic Search after stored to disk in Couchbase ElasYcSearch Monday, February 4, 13
  • 45.
    I’m  Excited  to  See  What  You  Build, Q  &  A Couchbase  Docs Contact  me  on  TwiDer www.couchbase.com/docs/index-­‐full.html @tgrall Couchbase  Forums Contact  me  by  Email www.couchbase.com/forums tug@couchbase.com IRC Learn  More  About  Design  PaDerns #couchbase CouchbaseModels.com #libcouchbase Seeng  up  for  Ruby  on  Rails CouchbaseOnRails.com Monday, February 4, 13
  • 46.