Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
What’s New In
Couchbase Server 4.0
Chin Hong |VP Product Management,Couchbase
©2015 Couchbase Inc. 2
Simplified
Development
Connected
Bigdata
Experience
Improved
Performance
Simplified
Security
Compli...
N1QL
©2015 Couchbase Inc. 4
What is N1QL?
4
Flexibility of JSONPower of SQL
©2015 Couchbase Inc. 5
How Does One Evaluate a Query Language?
Expressive
Declarative
Ecosystem
©2015 Couchbase Inc. 6
N1QL is Expressive: E-Commerce Examples
SELECT product.name, SUM(items.count) AS unitsSold
FROM pur...
©2015 Couchbase Inc. 7
N1QL is Expressive: Image Processing Example
SELECT
m.image AS gallery_image,
s.image AS source_ima...
©2015 Couchbase Inc. 8
N1QL is Declarative: What vs. How
You specify WHAT
Couchbase Server figures out HOW
©2015 Couchbase Inc. 9
N1QL is Declarative:Top 10 Selling Products
SELECT product.name, SUM(items.count) AS unitsSold
FROM...
©2015 Couchbase Inc. 10
N1QL ConnectsToYour Enterprise Ecosystem
Standards-based drivers
Integrations, partnerships
ODBC /...
©2015 Couchbase Inc. 11
Sessions on N1QL
 Introducing N1QL: New SQL Based Query Language for JSON
1:15 pm – 1:55 pm, Gran...
Indexing
©2015 Couchbase Inc. 13
Why DoWe Need Indexes?
Indexes are used to quickly look up objects
meeting user-specified criteria...
©2015 Couchbase Inc. 14
What Are the DifferentTypes of Indexes?
Primary Indexes
Secondary Indexes
Spatial Indexes
Text Ind...
©2015 Couchbase Inc. 15
IndexTypes … Let’s Use the Library Analogy
Source: http://www.montel.com/en/markets/library/
©2015 Couchbase Inc. 16
Secondary Indexes
Local secondary indexes – Map/Reduce views in 3.0
 Co-located with data
 Highe...
©2015 Couchbase Inc. 17
Box on Points Box Intersects Multi Dimensions Geo + Others
Spatial Indexes
 Experimental in 3.0, ...
©2015 Couchbase Inc. 18
Text Indexes (Developer Preview)
…
wise
…
engineer
…
…
…
…, akay1980, …
…, akay1980, …
engineers
e...
©2015 Couchbase Inc. 19
Sessions on Indexes
 UnderstandingViews in Couchbase Server
11:45 am – 12:25 pm, Screening Room
...
Multi-Dimensional Scaling
©2015 Couchbase Inc. 21
Workload and Scaling
Horizontal scaling
 Partitions a dataset onto one or more homogenous nodes
...
©2015 Couchbase Inc. 22
Multi-Dimensional Scaling
Isolated Service for minimized interference
 Independent “zones” for qu...
©2015 Couchbase Inc. 23
Multi-Dimensional Scaling
Independent scalability for the best computational capacity
per service
...
©2015 Couchbase Inc. 24
Session on Multi-Dimensional Scaling
 Deep Dive into N1QL with Global Secondary Indexes
4:35 pm –...
ForestDB: Next-Generation Storage Engine
©2015 Couchbase Inc. 26
Common Storage Structures – B+-Tree
26
Reads Writes Engines
B+-Tree Good read performance if the
f...
©2015 Couchbase Inc. 27
Common Storage Structures – LSM-Tree
27
Reads Writes Engines
LSM-
Tree
Reads may have to traverse
...
©2015 Couchbase Inc. 28
Fast Storage – ForestDB
Fundamentally rethinking the requirements for
fast storage
 Compact and e...
©2015 Couchbase Inc. 29
ForestDB
ForestDB Evaluations: LevelDB, RocksDB
29
Throughput
UP TO
FASTER
6X
Future Proof
FITTED
...
©2015 Couchbase Inc. 30
Trie (prefix tree) for which the nodes are B+-Trees
– HB+-Trie was originally presented at ACM SIG...
©2015 Couchbase Inc. 31
Sessions on ForestDB
 Next Generation Storage Engine: ForestDB
5:20 pm – 6:00 pm, Grand Ballroom
Security
©2015 Couchbase Inc. 33
Previously… In 2.2 In 2.5 In 3.0 New in 4.0
SASL AuthN
with Bucket
Passwords
Admin User
Secure Bui...
©2015 Couchbase Inc. 34
External Identity Management Using LDAP
34
Centralized identity management
 Define multiple read-...
©2015 Couchbase Inc. 35
Admin Auditing in Couchbase
35
Rich audit events
 Over 25+ different, detailed admin audit events...
©2015 Couchbase Inc. 36
Auditing a successful login
36
{
"timestamp":"2015-02-20T08:48:49.408-08:00",
"id":8192,
"name":"l...
©2015 Couchbase Inc. 37
Sessions on Security
 SecuringYour Couchbase Server Deployment
2:45 pm –3:25 pm, Grand Ballroom
...
©2015 Couchbase Inc. 38
Simplified
Development
Connected
Bigdata
Experience
Improved
Performance
Simplified
Security
Compl...
Get Started with Couchbase Server 4.0: developer.couchbase.com/server
GetTrained on Couchbase: training.couchbase.com
Upcoming SlideShare
Loading in …5
×

What's New in Couchbase Server 4.0 – Couchbase Live New York 2015

468 views

Published on

In this session we will do a lap around the full Couchbase Server 4.0 product. Couchbase VP of Product Management, Chin Hong will explore new capabilities in the latest release including N1QL, Global Secondary Indexing, Multi-Dimensional Scaling and more. In this session, you will: 1) Learn how Couchbase Server 4.0 simplifies querying with N1QL and new global secondary indexing 2) Explore the benefits offered by spatial views 3) Look at how compliance with security rules gets easier and 4) Review architectural advances in ForestDB, Couchbase’s next generation storage engine. This is the grand tour and is the session for you if you want an end-to-end look at all the new capabilities that Couchbase Server 4.0 has to offer.

Published in: Software

What's New in Couchbase Server 4.0 – Couchbase Live New York 2015

  1. 1. What’s New In Couchbase Server 4.0 Chin Hong |VP Product Management,Couchbase
  2. 2. ©2015 Couchbase Inc. 2 Simplified Development Connected Bigdata Experience Improved Performance Simplified Security Compliance Improved HA & DR Improved Provisioning Simplified Familiar and Flexible Query with N1QL Integrated BI with ODBC/JDBC Spatial Queries for Location Aware Applications New Frameworks and Languages - LINQ, - Spring, - Go Surround Big-data - Spark SQL - Spark Streams - Kafka, - Sqoop, - Elastic, - SOLR Global Secondary Indexes for Snappy Queries Independent Scaling with Multi-dimensional Scaling Faster Reporting and Interactive Analytics with Views Queries Enhanced Storage Performance with ForestDB and Bloom Filters Integrated Enterprise Identity Management with LDAP Integration Security Forensics with Admin Auditing Improved Data Protection with Lower latency XDCR High Performance Global Data Distribution with XDCR Filtering Deployment with High Performance Containers: Docker Expanded Public and Private Cloud Support - AWS, - Google, - Azure, - Joyent, - Cisco, - Verizon New Enterprise Platforms - SUSE - Oracle Ent.Linux
  3. 3. N1QL
  4. 4. ©2015 Couchbase Inc. 4 What is N1QL? 4 Flexibility of JSONPower of SQL
  5. 5. ©2015 Couchbase Inc. 5 How Does One Evaluate a Query Language? Expressive Declarative Ecosystem
  6. 6. ©2015 Couchbase Inc. 6 N1QL is Expressive: E-Commerce Examples SELECT product.name, SUM(items.count) AS unitsSold FROM purchases UNNEST purchases.lineItems AS items JOIN product ON KEYS items.product GROUP BY product ORDER BY unitsSold DESC LIMIT 10 SELECT SUBSTR(purchases.purchasedAt, 0, 7) AS month, ROUND(SUM(product.unitPrice * items.count)/1000000, 3) revenueMillion FROM purchases UNNEST purchases.lineItems AS items JOIN product ON KEYS items.product GROUP BY SUBSTR(purchases.purchasedAt, 0, 7) ORDER BY month
  7. 7. ©2015 Couchbase Inc. 7 N1QL is Expressive: Image Processing Example SELECT m.image AS gallery_image, s.image AS source_image, s.x, s.y, m.r AS gallery_r, m.g AS gallery_g, m.b AS gallery_b, s.r AS source_r, s.g AS source_g, s.b AS source_b, FROM SourcePixels s JOIN GalleryMeans m ON KEY s.rgb Source: http://www.metanautix.com/tr01 Learn more about N1QL @ query.couchbase.com/tutorial
  8. 8. ©2015 Couchbase Inc. 8 N1QL is Declarative: What vs. How You specify WHAT Couchbase Server figures out HOW
  9. 9. ©2015 Couchbase Inc. 9 N1QL is Declarative:Top 10 Selling Products SELECT product.name, SUM(items.count) AS unitsSold FROM purchases UNNEST purchases.lineItems AS items JOIN product ON KEYS items.product GROUP BY product ORDER BY unitsSold DESC LIMIT 10 WHAT HOW
  10. 10. ©2015 Couchbase Inc. 10 N1QL ConnectsToYour Enterprise Ecosystem Standards-based drivers Integrations, partnerships ODBC / JDBC App CB Node ODBC / JDBC ETL ODBC / JDBC BI ODBC / JDBC Visualization CB Node CB Node
  11. 11. ©2015 Couchbase Inc. 11 Sessions on N1QL  Introducing N1QL: New SQL Based Query Language for JSON 1:15 pm – 1:55 pm, Grand Ballroom  N1QL and SDK Support for Java, .NET, and Node.js 3:50 pm – 4:30 pm,The Library  Deep Dive into N1QL with Global Secondary Indexes 4:35 pm – 5:15 pm, Grand Ballroom  Agile Data Modeling at DIRECTV 2:00 pm – 2:40 pm, Stillman  Evolution of Couchbase at CenterEdge: FromCache to Query 3:50 pm – 4:30 pm, Stillman  Nielsen’s Interactive Data Analytics with Couchbase N1QL 4:35 pm – 5:15 pm, Stillman  Introduction to BI with Couchbase Server usingTableau, Informatica, Excel and more 4:35 pm – 5:15 pm,The Library
  12. 12. Indexing
  13. 13. ©2015 Couchbase Inc. 13 Why DoWe Need Indexes? Indexes are used to quickly look up objects meeting user-specified criteria without having to search over every object in the database.
  14. 14. ©2015 Couchbase Inc. 14 What Are the DifferentTypes of Indexes? Primary Indexes Secondary Indexes Spatial Indexes Text Indexes
  15. 15. ©2015 Couchbase Inc. 15 IndexTypes … Let’s Use the Library Analogy Source: http://www.montel.com/en/markets/library/
  16. 16. ©2015 Couchbase Inc. 16 Secondary Indexes Local secondary indexes – Map/Reduce views in 3.0  Co-located with data  Higher write performance  Lower read performance: scatter-gather  Scaling bottleneck with a high number of indexes or data nodes Global secondary indexes (GSI) – New in 4.0  Higher query performance  Async writes to a large number of global indexes  Independently scaled and partitioned  Isolated from Key-Value operations
  17. 17. ©2015 Couchbase Inc. 17 Box on Points Box Intersects Multi Dimensions Geo + Others Spatial Indexes  Experimental in 3.0, now GA in 4.0 – Performance and stability improvements  GeoJSON output  Bounding-box and range queries on multiple dimensions
  18. 18. ©2015 Couchbase Inc. 18 Text Indexes (Developer Preview) … wise … engineer … … … …, akay1980, … …, akay1980, … engineers engineer Exact Match Inverted Index Apply the same text analysis at search time that we used at index time.
  19. 19. ©2015 Couchbase Inc. 19 Sessions on Indexes  UnderstandingViews in Couchbase Server 11:45 am – 12:25 pm, Screening Room  Deep Dive into N1QL with Global Secondary Indexes 4:35 pm – 5:15 pm, Grand Ballroom  Developer Preview of FullText Search labs.couchbase.com/cbft
  20. 20. Multi-Dimensional Scaling
  21. 21. ©2015 Couchbase Inc. 21 Workload and Scaling Horizontal scaling  Partitions a dataset onto one or more homogenous nodes  Each node runs the same mixed workloads  Re-partition dataset with additional hardware capacity Node 8 Index Service Couchbase Cluster Query Service Data Service Node 1
  22. 22. ©2015 Couchbase Inc. 22 Multi-Dimensional Scaling Isolated Service for minimized interference  Independent “zones” for query, index, and data services Minimize indexing and query overhead on core key-value operations. Index Service Couchbase Cluster Query Service Data Service Node 1 Node 8
  23. 23. ©2015 Couchbase Inc. 23 Multi-Dimensional Scaling Independent scalability for the best computational capacity per service Couchbase Cluster node1 Node 8 Node 9 Data Service Index ServiceQuery Service More storage for indexing: scale up index service nodes. More cores for query processing: scale up query service nodes. Node 1
  24. 24. ©2015 Couchbase Inc. 24 Session on Multi-Dimensional Scaling  Deep Dive into N1QL with Global Secondary Indexes 4:35 pm – 5:15 pm, Grand Ballroom
  25. 25. ForestDB: Next-Generation Storage Engine
  26. 26. ©2015 Couchbase Inc. 26 Common Storage Structures – B+-Tree 26 Reads Writes Engines B+-Tree Good read performance if the fan-out is high (“short” tree) for small fixed-length keys. Read performance degrades for variable-length keys. Update-In-Place results in random writes and bad write latency. Append-Only file improves write performance but requires periodic compaction. BerkeleyDB, InnoDB, Couchstore (append-only), WiredTiger B+ 04/26 … … … Key Value (or Pointer) longer keys
  27. 27. ©2015 Couchbase Inc. 27 Common Storage Structures – LSM-Tree 27 Reads Writes Engines LSM- Tree Reads may have to traverse multiple trees – typically worse than B+ tree. WAL(Write-Ahead Log) improves writes with in-memory trees that are appended to the end of the log. LevelDB, RocksDB, Cassandra, WiredTiger LSM … In-memory Sequential log flush/merge merge C1 tree C2 tree merge Capacity increases exponentially
  28. 28. ©2015 Couchbase Inc. 28 Fast Storage – ForestDB Fundamentally rethinking the requirements for fast storage  Compact and efficient storage for a variety of data  Unified engine that performs well for various workloads  Unified engine that scales from small devices to large servers  Optimized for new SSD storage technology 28 ForestDB provides a compact index structure that significantly reduces the disk I/O and write amplification.
  29. 29. ©2015 Couchbase Inc. 29 ForestDB ForestDB Evaluations: LevelDB, RocksDB 29 Throughput UP TO FASTER 6X Future Proof FITTED FOR SSD Efficiency UP TO 5XCOMPACT
  30. 30. ©2015 Couchbase Inc. 30 Trie (prefix tree) for which the nodes are B+-Trees – HB+-Trie was originally presented at ACM SIGMOD 2011 Programming Contest, by Jung-Sang Ahn who works at Couchbase (http://db.csail.mit.edu/sigmod11contest/sigmod_2011_contest_poster_jungsang_ahn.pdf) HB+-Trie (Hierarchical B+-Trie)
  31. 31. ©2015 Couchbase Inc. 31 Sessions on ForestDB  Next Generation Storage Engine: ForestDB 5:20 pm – 6:00 pm, Grand Ballroom
  32. 32. Security
  33. 33. ©2015 Couchbase Inc. 33 Previously… In 2.2 In 2.5 In 3.0 New in 4.0 SASL AuthN with Bucket Passwords Admin User Secure Build Platform Read-Only User Easy Admin Password Reset Non-Root User Deployments Secure Communication for XDCR Encrypted Client- Server Communication Encrypted Admin Access Access Log Data-at-Rest Encryption • Simplified compliance with admin auditing • External identity management for admins using LDAP Couchbase Security Features In a few slides .. 33
  34. 34. ©2015 Couchbase Inc. 34 External Identity Management Using LDAP 34 Centralized identity management  Define multiple read-only admins and full-admins  Centralized security policy management for admin accounts for stronger passwords, password rotation, and auto lockouts Individual accountability; simplified compliance  Define UIDs in LDAP, and map UIDs to the read-only/full admin role in Couchbase  Comprehensive audit trails with LDAP UIDs in audit records
  35. 35. ©2015 Couchbase Inc. 35 Admin Auditing in Couchbase 35 Rich audit events  Over 25+ different, detailed admin audit events  Auditing for tools including backup Configurable auditing  Configurable file target  Support for time-based log rotation and audit filtering Easy integration  JSON format allows for easy integration with downstream systems using flume, logstash, and syslogd
  36. 36. ©2015 Couchbase Inc. 36 Auditing a successful login 36 { "timestamp":"2015-02-20T08:48:49.408-08:00", "id":8192, "name":"login success", "description":"Successful login to couchbase cluster", "role":"admin", "real_userid": { "source":"ns_server", "user":"bjones” }, "sessionid":"0fd0b5305d1561ca2b10f9d795819b2e", "remote":{"ip":"172.23.107.165", "port":59383} } WHEN WH O WHAT HO W
  37. 37. ©2015 Couchbase Inc. 37 Sessions on Security  SecuringYour Couchbase Server Deployment 2:45 pm –3:25 pm, Grand Ballroom  Transparent Data Encryption in Couchbase usingVormetric 3:50 pm –4:30 pm, Grand Ballroom
  38. 38. ©2015 Couchbase Inc. 38 Simplified Development Connected Bigdata Experience Improved Performance Simplified Security Compliance Improved HA & DR Improved Provisioning Simplified Familiar and Flexible Query with N1QL Integrated BI with ODBC/JDBC Spatial Queries for Location Aware Applications New Frameworks and Languages - LINQ, - Spring, - Go Surround Big-data - Spark SQL - Spark Streams - Kafka, - Sqoop, - Elastic, - SOLR Global Secondary Indexes for Snappy Queries Independent Scaling with Multi-dimensional Scaling Faster Reporting and Interactive Analytics with Views Queries Enhanced Storage Performance with ForestDB and Bloom Filters Integrated Enterprise Identity Management with LDAP Integration Security Forensics with Admin Auditing Improved Data Protection with Lower latency XDCR High Performance Global Data Distribution with XDCR Filtering Deployment with High Performance Containers: Docker Expanded Public and Private Cloud Support - AWS, - Google, - Azure, - Joyent, - Cisco, - Verizon New Enterprise Platforms - SUSE - Oracle Ent.Linux
  39. 39. Get Started with Couchbase Server 4.0: developer.couchbase.com/server GetTrained on Couchbase: training.couchbase.com

×