NoSQL  – the  Vital  Open  Source  
Ingredient  for  Modern  Success
Arun  Gupta
VP,  Developer  Advocacy,  Couchbase
@arungupta
arun@couchbase.com
©2015  Couchbase  Inc. 2@arungupta
Who am I?
©2015  Couchbase  Inc. 3
The  Big  Picture:  
Companies  across  
industries  are  “going  
digital”  in  a  big  way
©2015  Couchbase  Inc. 4@arungupta
The  shift  to  digital  is  driving  new  database  requirements
©2015  Couchbase  Inc. 5@arungupta
How  much  unstructured  data?
90%
When  connected  and  used  properly,  such  information  
typically  can  help  increase  revenue,  reduce  costs,  
respond  to  customer  needs  more  quickly and  accurately,  
or  bring  products  to  market  faster
http://www.idc.com/getdoc.jsp?containerId=prUS24993814
©2015  Couchbase  Inc. 6@arungupta
Responsive Scalable Agile
Mobile Geo-­‐distributed Easy  to  Manage
Requirements  for  modern  web,  mobile  &  IoT applications
©2015  Couchbase  Inc. 7@arungupta
NoSQL  is  often  a  better  fit  for  web,  mobile  &  IoT applications
RDBMS NoSQL
1960’s -­‐ 1970’s  origin Mid-­‐2000’s  origin
Mainframe  /  Client-­‐Server  era Internet  /  Mobile  /  Big Data  era
Rigid  schema   Flexible
Structured  data Structured,  semi-­‐structured,  unstructured
Scale  up Scale  out
©2015  Couchbase  Inc. 8@arungupta
Origin  and  evolution  of  NoSQL
2000
2003
2004-2006
2008
2009
2011
Releases Couchbase
Server
2012
Merger of
CouchOne (CouchDB) &
Membase (memcached)
©2015  Couchbase  Inc. 9@arungupta
Who’s  using  NoSQL?
Internet companies were the originators and early adopters.
©2015  Couchbase  Inc. 10@arungupta
Who’s  using  NoSQL?
Today, NoSQL is mainstream!
Industrial  Equipment
Internet  of  Things
Communications Hospitality Airlines Financial  Services
Customer  Data  Mgmt Reservation  Systems Mobile  Application Fraud  Detection
Tax  Preparation Media  Metadata  Mgmt Content  Mgmt System Product  Catalog
Theme  Park  
Customer  Service
Streaming  Media Publishing Retail EntertainmentBusiness  Services
©2015  Couchbase  Inc. 11@arungupta
NoSQL  at  Gannett:  Re-­‐engineering  the  CMS
©2015  Couchbase  Inc. 12@arungupta
Gannett:  Challenges  of  RDBMS
• SQL  Server  is  extremely  expensive
• Utilize  on-­‐premise pet  servers  that  have  difficulty  
scaling
• Significant  replication  latency  issue  with  SQL  Server
• Business  logic  coded  into  Stored  Procedures
• Causes  significant  delay  between  publish  time  and  presentation  time
©2015  Couchbase  Inc. 13@arungupta
Gannett:  Transition  Goals
• Decrease  the  latency  between  publish  time  and  
presentation  time
• Remove  business  logic  from  data  layer
• Allow  for  growth  and  scalability  in  the  cloud
• Move  away  from  pet  servers
• Lower  cost  – Couchbase  operates  at  25%  of  RBDMS
©2015  Couchbase  Inc. 14@arungupta
Gannett:  Replatforming  with  NoSQL
Before After
NoSQL
NoSQL
©2015  Couchbase  Inc. 15@arungupta
How  Gannett  used  to  retrieve  an  asset  
©2015  Couchbase  Inc. 16@arungupta
How  Gannett  now  retrieves  an  asset
©2015  Couchbase  Inc. 17@arungupta
Couchbase  and  Gannett
https://www.youtube.com/watch?v=mor2p0UqZ14
Couchbase  has  become  an  
integral  part  of  GANNETT’s  next  
generation  publishing  systems
©2015  Couchbase  Inc. 18@arungupta
NoSQL  at  Marriott:  Moving  from  mainframe  to  distributed
Leading  international  hotel  
provider  with  4,200+  properties  
in  79  countries
Replatforming from  
mainframe-­‐based  DB2/Z  to  
distributed  architecture
©2015  Couchbase  Inc. 19@arungupta
Marriott:  Why  replatform?
• Moving  from  legacy  to  distributed
• Skill  sets  available
• Open  source
• Application  development  cost  savings
• Infrastructure  cost  savings
• Leverage  cloud  strategy
• Data-­‐driven  logic  vs  embedded  rules  logic
©2015  Couchbase  Inc. 20@arungupta
Marriott:  Why  Open  Source  and  NoSQL?
• Well  suited  for  cloud  deployment  on  commodity  
hardware
• Scalability  and  High  Availability
• Taking  advantage  of  the  myriad  of  Open  Standards  
vs  Proprietary  Vendor  Solutions
• Native  JSON  processing  
• Couchbase:  N1QL,  LDAP  integration,  Filtered  XDCR,  
Service  scaling
©2015  Couchbase  Inc. 21@arungupta
Couchbase  at  Marriott
Marriott  Data  Center
Compute  Cluster Couchbase  Cluster
MARSHAMARSHA
JSON  DocumentsReservation  Data
Internal  UsersInternal  Users
§ 13  Million  Documents  in  Couchbase
§ 200  Transactions/Second
Initial  Deployment
§ 30  Million  Documents  in  Couchbase
§ 4000  Transactions/Second
Future  Rollout
©2015  Couchbase  Inc. 22@arungupta
NoSQL  at  CenterEdge Software
Leading  provider  of  facility  
management  for  amusement  &  
entertainment  industries:
Family  Entertainment  Centers
Waterparks
Trampoline  Parks
Amusement  Parks
Skating  Rinks
Bowling  Centers
Zoos  &  Museums  
Replacing  RDBMS  with  NoSQL  
for  better  scalability  and  
reliability  in  the  cloud
©2015  Couchbase  Inc. 23@arungupta
We  knew  that  we  needed  to  re-­‐architect  and  move  to  something  
that  didn’t  involve  SQL  at  all.  The  vertical  scaling  of  SQL  is  
just  very  limiting.
We  had  a  bunch  of  SQL  Serversup  in  the  cloud  serving  up  the  
web  stores.  That  basically  melted  on  a  Black  Friday
Why  NoSQL  at  CenterEdge:  Avoid  “Black  Friday  meltdown”
http://diginomica.com/2015/10/15/how-­‐centeredge-­‐went-­‐from-­‐black-­‐friday-­‐blues-­‐to-­‐cloud-­‐scale-­‐with-­‐couchbase/
more  cost  savings will  be  achieved  as  SQL  database  contracts  
are  phased  out
©2015  Couchbase  Inc. 24@arungupta
Why  NoSQL  at  CenterEdge:  Avoid  “Black  Friday  meltdown”
http://diginomica.com/2015/10/15/how-­‐centeredge-­‐went-­‐from-­‐black-­‐friday-­‐blues-­‐to-­‐cloud-­‐scale-­‐with-­‐couchbase/
• Using  Couchbase  since  1.8,  originally  for  caching,  
now  for  persistence  as  well
Couchbase  has  enabled  us  to  do  this  far  more  easily  than  we  
ever  could  have,  compared  to  trying  to  deal  with  large  SQL  
servers  and  dividing  it  up  and  partitioning  data…  Unlike  SQL  
Server,  as  we  grow,  we  just  add  nodes.  We  need  another  
node,  we’d  spin  one  up.  Zero  down  time.
©2015  Couchbase  Inc. 25@arungupta
NoSQL  lines  of  influence
(Columns,  Consistent)
(Values,  Available)
Consistent
Documents
(Values)  
Wide  Column
Available
(Columns,  Available) (Documents,  Consistent)
©2015  Couchbase  Inc. 26@arungupta
Couchbase’s  Open  Source  heritage
ForestDB
(CouchOne) (Membase)
2011:  
CouchOne &  Membase merge  to  
form  Couchbase
2014:  
Couchbase  releases  ForestDB storage  
engine  as  Open  Source  project
2015:  
Couchbase  releases  Couchbase  Server  4.0,  
leveraging  bleve open  source  project  for  
search
©2015  Couchbase  Inc. 27@arungupta
Couchbase  is  Open  Source  -­‐ Apache  2.0  license
©2015  Couchbase  Inc. 28@arungupta
Couchbase  lines  of  influence
(Columns,  Consistent)
(Values,  Available)
(Documents,  Consistent)
Consistent
Documents
(Values)
(In-­‐Memory)
©2015  Couchbase  Inc. 29@arungupta
Choose  how  to  build  your  apps,  and  where  to  run  them
Frameworks
Languages
Platforms
Infrastructure
C  /  C++
Mobile
Mobile
Couchbase  supports  a  wide  range  of  frameworks,  languages,  platforms,  and  infrastructure  choices  
©2015  Couchbase  Inc. 30@arungupta
Couchbase  integrates  with  the  Big  Data  ecosystem
Business  Intelligence
Offline  Analytics
Storage
Search Streaming  Analytics
Messaging
©2015  Couchbase  Inc. 31@arungupta
Couchbase  can  be  deployed  for  multiple  purposes
High  availability  
cache
Key-­‐value  
store
Document  
database
Embedded  
database  
(mobile  devices)
Sync  
management
©2015  Couchbase  Inc. 32@arungupta
Key  capabilities  in  Couchbase
Query Index Search Scale Replicate
©2015  Couchbase  Inc. 33@arungupta
N1QL  (“nickel”)  query  language  =  SQL  for  JSON  data
Query Index Search Scale Replicate
©2015  Couchbase  Inc. 34@arungupta
Global  Secondary  Indexing  – fast,  efficient  indexes  
Query Index Search Scale Replicate
©2015  Couchbase  Inc. 35@arungupta
Geospatial  search  
Query Index Search Scale Replicate
©2015  Couchbase  Inc. 36@arungupta
Multi-­‐Dimensional  Scaling:  Isolate  query,  index,  read-­‐write
Query Index Search Scale Replicate
©2015  Couchbase  Inc. 37@arungupta
Cross  data  center  replication  (XDCR)  with  filtering
Query Index Search Scale Replicate
©2015  Couchbase  Inc. 38@arungupta
Summary
§ Why  Open  Source?
– More  choice,  More  flexibility,  Less  risk,  Lower  cost
§ Why  NoSQL?
– Flexible  data  model,  Structured  &  Un-­‐structured  data,  Scale-­‐out  architecture  
§ Why  Couchbase?
– Performance,  Availability,  Scalability,  Flexibility,  Ease  of  Use
©2015  Couchbase  Inc. 39@arungupta
Want  to  know  more?
Download  Couchbase: couchbase.com/download
Developer  Portal: developer.couchbase.com
Free  online  training: training.couchbase.com/online
©2015  Couchbase  Inc. 40@arungupta
Questions?
©2015  Couchbase  Inc. 41@arungupta
Thank  You.
@arungupta
arun@couchbase.com

NoSQL - Vital Open Source Ingredient for Modern Success

  • 1.
    NoSQL  – the Vital  Open  Source   Ingredient  for  Modern  Success Arun  Gupta VP,  Developer  Advocacy,  Couchbase @arungupta arun@couchbase.com
  • 2.
    ©2015  Couchbase  Inc.2@arungupta Who am I?
  • 3.
    ©2015  Couchbase  Inc.3 The  Big  Picture:   Companies  across   industries  are  “going   digital”  in  a  big  way
  • 4.
    ©2015  Couchbase  Inc.4@arungupta The  shift  to  digital  is  driving  new  database  requirements
  • 5.
    ©2015  Couchbase  Inc.5@arungupta How  much  unstructured  data? 90% When  connected  and  used  properly,  such  information   typically  can  help  increase  revenue,  reduce  costs,   respond  to  customer  needs  more  quickly and  accurately,   or  bring  products  to  market  faster http://www.idc.com/getdoc.jsp?containerId=prUS24993814
  • 6.
    ©2015  Couchbase  Inc.6@arungupta Responsive Scalable Agile Mobile Geo-­‐distributed Easy  to  Manage Requirements  for  modern  web,  mobile  &  IoT applications
  • 7.
    ©2015  Couchbase  Inc.7@arungupta NoSQL  is  often  a  better  fit  for  web,  mobile  &  IoT applications RDBMS NoSQL 1960’s -­‐ 1970’s  origin Mid-­‐2000’s  origin Mainframe  /  Client-­‐Server  era Internet  /  Mobile  /  Big Data  era Rigid  schema   Flexible Structured  data Structured,  semi-­‐structured,  unstructured Scale  up Scale  out
  • 8.
    ©2015  Couchbase  Inc.8@arungupta Origin  and  evolution  of  NoSQL 2000 2003 2004-2006 2008 2009 2011 Releases Couchbase Server 2012 Merger of CouchOne (CouchDB) & Membase (memcached)
  • 9.
    ©2015  Couchbase  Inc.9@arungupta Who’s  using  NoSQL? Internet companies were the originators and early adopters.
  • 10.
    ©2015  Couchbase  Inc.10@arungupta Who’s  using  NoSQL? Today, NoSQL is mainstream! Industrial  Equipment Internet  of  Things Communications Hospitality Airlines Financial  Services Customer  Data  Mgmt Reservation  Systems Mobile  Application Fraud  Detection Tax  Preparation Media  Metadata  Mgmt Content  Mgmt System Product  Catalog Theme  Park   Customer  Service Streaming  Media Publishing Retail EntertainmentBusiness  Services
  • 11.
    ©2015  Couchbase  Inc.11@arungupta NoSQL  at  Gannett:  Re-­‐engineering  the  CMS
  • 12.
    ©2015  Couchbase  Inc.12@arungupta Gannett:  Challenges  of  RDBMS • SQL  Server  is  extremely  expensive • Utilize  on-­‐premise pet  servers  that  have  difficulty   scaling • Significant  replication  latency  issue  with  SQL  Server • Business  logic  coded  into  Stored  Procedures • Causes  significant  delay  between  publish  time  and  presentation  time
  • 13.
    ©2015  Couchbase  Inc.13@arungupta Gannett:  Transition  Goals • Decrease  the  latency  between  publish  time  and   presentation  time • Remove  business  logic  from  data  layer • Allow  for  growth  and  scalability  in  the  cloud • Move  away  from  pet  servers • Lower  cost  – Couchbase  operates  at  25%  of  RBDMS
  • 14.
    ©2015  Couchbase  Inc.14@arungupta Gannett:  Replatforming  with  NoSQL Before After NoSQL NoSQL
  • 15.
    ©2015  Couchbase  Inc.15@arungupta How  Gannett  used  to  retrieve  an  asset  
  • 16.
    ©2015  Couchbase  Inc.16@arungupta How  Gannett  now  retrieves  an  asset
  • 17.
    ©2015  Couchbase  Inc.17@arungupta Couchbase  and  Gannett https://www.youtube.com/watch?v=mor2p0UqZ14 Couchbase  has  become  an   integral  part  of  GANNETT’s  next   generation  publishing  systems
  • 18.
    ©2015  Couchbase  Inc.18@arungupta NoSQL  at  Marriott:  Moving  from  mainframe  to  distributed Leading  international  hotel   provider  with  4,200+  properties   in  79  countries Replatforming from   mainframe-­‐based  DB2/Z  to   distributed  architecture
  • 19.
    ©2015  Couchbase  Inc.19@arungupta Marriott:  Why  replatform? • Moving  from  legacy  to  distributed • Skill  sets  available • Open  source • Application  development  cost  savings • Infrastructure  cost  savings • Leverage  cloud  strategy • Data-­‐driven  logic  vs  embedded  rules  logic
  • 20.
    ©2015  Couchbase  Inc.20@arungupta Marriott:  Why  Open  Source  and  NoSQL? • Well  suited  for  cloud  deployment  on  commodity   hardware • Scalability  and  High  Availability • Taking  advantage  of  the  myriad  of  Open  Standards   vs  Proprietary  Vendor  Solutions • Native  JSON  processing   • Couchbase:  N1QL,  LDAP  integration,  Filtered  XDCR,   Service  scaling
  • 21.
    ©2015  Couchbase  Inc.21@arungupta Couchbase  at  Marriott Marriott  Data  Center Compute  Cluster Couchbase  Cluster MARSHAMARSHA JSON  DocumentsReservation  Data Internal  UsersInternal  Users § 13  Million  Documents  in  Couchbase § 200  Transactions/Second Initial  Deployment § 30  Million  Documents  in  Couchbase § 4000  Transactions/Second Future  Rollout
  • 22.
    ©2015  Couchbase  Inc.22@arungupta NoSQL  at  CenterEdge Software Leading  provider  of  facility   management  for  amusement  &   entertainment  industries: Family  Entertainment  Centers Waterparks Trampoline  Parks Amusement  Parks Skating  Rinks Bowling  Centers Zoos  &  Museums   Replacing  RDBMS  with  NoSQL   for  better  scalability  and   reliability  in  the  cloud
  • 23.
    ©2015  Couchbase  Inc.23@arungupta We  knew  that  we  needed  to  re-­‐architect  and  move  to  something   that  didn’t  involve  SQL  at  all.  The  vertical  scaling  of  SQL  is   just  very  limiting. We  had  a  bunch  of  SQL  Serversup  in  the  cloud  serving  up  the   web  stores.  That  basically  melted  on  a  Black  Friday Why  NoSQL  at  CenterEdge:  Avoid  “Black  Friday  meltdown” http://diginomica.com/2015/10/15/how-­‐centeredge-­‐went-­‐from-­‐black-­‐friday-­‐blues-­‐to-­‐cloud-­‐scale-­‐with-­‐couchbase/ more  cost  savings will  be  achieved  as  SQL  database  contracts   are  phased  out
  • 24.
    ©2015  Couchbase  Inc.24@arungupta Why  NoSQL  at  CenterEdge:  Avoid  “Black  Friday  meltdown” http://diginomica.com/2015/10/15/how-­‐centeredge-­‐went-­‐from-­‐black-­‐friday-­‐blues-­‐to-­‐cloud-­‐scale-­‐with-­‐couchbase/ • Using  Couchbase  since  1.8,  originally  for  caching,   now  for  persistence  as  well Couchbase  has  enabled  us  to  do  this  far  more  easily  than  we   ever  could  have,  compared  to  trying  to  deal  with  large  SQL   servers  and  dividing  it  up  and  partitioning  data…  Unlike  SQL   Server,  as  we  grow,  we  just  add  nodes.  We  need  another   node,  we’d  spin  one  up.  Zero  down  time.
  • 25.
    ©2015  Couchbase  Inc.25@arungupta NoSQL  lines  of  influence (Columns,  Consistent) (Values,  Available) Consistent Documents (Values)   Wide  Column Available (Columns,  Available) (Documents,  Consistent)
  • 26.
    ©2015  Couchbase  Inc.26@arungupta Couchbase’s  Open  Source  heritage ForestDB (CouchOne) (Membase) 2011:   CouchOne &  Membase merge  to   form  Couchbase 2014:   Couchbase  releases  ForestDB storage   engine  as  Open  Source  project 2015:   Couchbase  releases  Couchbase  Server  4.0,   leveraging  bleve open  source  project  for   search
  • 27.
    ©2015  Couchbase  Inc.27@arungupta Couchbase  is  Open  Source  -­‐ Apache  2.0  license
  • 28.
    ©2015  Couchbase  Inc.28@arungupta Couchbase  lines  of  influence (Columns,  Consistent) (Values,  Available) (Documents,  Consistent) Consistent Documents (Values) (In-­‐Memory)
  • 29.
    ©2015  Couchbase  Inc.29@arungupta Choose  how  to  build  your  apps,  and  where  to  run  them Frameworks Languages Platforms Infrastructure C  /  C++ Mobile Mobile Couchbase  supports  a  wide  range  of  frameworks,  languages,  platforms,  and  infrastructure  choices  
  • 30.
    ©2015  Couchbase  Inc.30@arungupta Couchbase  integrates  with  the  Big  Data  ecosystem Business  Intelligence Offline  Analytics Storage Search Streaming  Analytics Messaging
  • 31.
    ©2015  Couchbase  Inc.31@arungupta Couchbase  can  be  deployed  for  multiple  purposes High  availability   cache Key-­‐value   store Document   database Embedded   database   (mobile  devices) Sync   management
  • 32.
    ©2015  Couchbase  Inc.32@arungupta Key  capabilities  in  Couchbase Query Index Search Scale Replicate
  • 33.
    ©2015  Couchbase  Inc.33@arungupta N1QL  (“nickel”)  query  language  =  SQL  for  JSON  data Query Index Search Scale Replicate
  • 34.
    ©2015  Couchbase  Inc.34@arungupta Global  Secondary  Indexing  – fast,  efficient  indexes   Query Index Search Scale Replicate
  • 35.
    ©2015  Couchbase  Inc.35@arungupta Geospatial  search   Query Index Search Scale Replicate
  • 36.
    ©2015  Couchbase  Inc.36@arungupta Multi-­‐Dimensional  Scaling:  Isolate  query,  index,  read-­‐write Query Index Search Scale Replicate
  • 37.
    ©2015  Couchbase  Inc.37@arungupta Cross  data  center  replication  (XDCR)  with  filtering Query Index Search Scale Replicate
  • 38.
    ©2015  Couchbase  Inc.38@arungupta Summary § Why  Open  Source? – More  choice,  More  flexibility,  Less  risk,  Lower  cost § Why  NoSQL? – Flexible  data  model,  Structured  &  Un-­‐structured  data,  Scale-­‐out  architecture   § Why  Couchbase? – Performance,  Availability,  Scalability,  Flexibility,  Ease  of  Use
  • 39.
    ©2015  Couchbase  Inc.39@arungupta Want  to  know  more? Download  Couchbase: couchbase.com/download Developer  Portal: developer.couchbase.com Free  online  training: training.couchbase.com/online
  • 40.
    ©2015  Couchbase  Inc.40@arungupta Questions?
  • 41.
    ©2015  Couchbase  Inc.41@arungupta Thank  You. @arungupta arun@couchbase.com