NoSQL has exploded on the developer scene promising alternatives to RDBMS that make rapidly developing, Internet scale applications easier than ever. However, as a trade off to the ease of development and scale, some of the familiarity with other well-known query interfaces such as SQL, has been lost. Until now that is...N1QL (pronounced ‘N1QL’) is a SQL like query language for querying JSON, which brings the familiarity of RDBMS back to the NoSQL world. In this session you will learn about the syntax and basics of this new language as well as Integration with the Couchbase SDKs.

1. Bringing the SQL back to NoSQL
Querying JSON w/N1QL

2. ©2014 Couchbase Inc.
Titanium Sponsors
Platinum Sponsors
Gold Sponsors

3. ©2014 Couchbase Inc.
About Me: Jeff Morris
 Software Engineer @Couchbase
 Maintain several open source projects…
 Official Couchbase .NET SDK
 Linq2Couchbase
 CouchbaseASP.NET Extensions
 Former Enterprise Architect
 Work primarily with .NET, but some Java and arch. ex. with
PHP
 Family, Surfing and Fishing
3

4. ©2014 Couchbase Inc.
Agenda
 Intro
 Couchbase 101, Data in Couchbase
 N1QL
 N1QL vs SQL, Language Structure, Queries and Results
 Advanced
 How do queries work, 2i, Predicate filters
 SDK Support
 RESTAPI,Ad hoc queries, Linq, Java DSL
 Q&A
4

5. Couchbase 101
Prerequisites…
5

6. ©2014 Couchbase Inc.
Couchbase Server: About
 High throughput, low latency
 Built-in distributed cache
 Commodity hardware
 Distributed, shared nothing architecture
 Nodes are peers
 Strong consistency
 Elastic scalability
 XDCR

7. ©2014 Couchbase Inc.
Storage Engine
Cluster Manager
Data Service
Projector & Router
New Services in Couchbase Server 4.0
Query ServiceIndex Service
Supervisor
Index maintenance &
Scan coordinator
Index#2Index#1
Query Processor
cbq-engine
Bucket#1 Bucket#2
DCP Stream
Index#4Index#3
...
B
u
c
k
e
t
#
2
B
u
c
k
e
t
#
1
1809311211 18901
ManagedCache

8. ©2014 Couchbase Inc.
Full Cluster Architecture
STORAGE
Couchbase Server 1
SHARD
7
SHARD
9
SHARD
5
SHARDSHARDSHARD
Managed
Cache
Cluster
Manager
Cluster
Manager
Managed
Cache
Storage
Data Service
Index Service
Query Service STORAGE
Couchbase Server 2
SHARD
7
SHARD
9
SHARD
5
SHARDSHARDSHARD
Managed
Cache
Cluster
Manager
Cluster
Manager
Managed
Cache
Storage
Data Service
Index Service
Query Service STORAGE
Couchbase Server 3
SHARD
7
SHARD
9
SHARD
5
SHARDSHARDSHARD
Managed
Cache
Cluster
Manager
Cluster
Manager
Managed
Cache
Storage
Data Service
Index Service
Query Service STORAGE
Couchbase Server 4
SHARD
7
SHARD
9
SHARD
5
SHARDSHARDSHARD
Managed
Cache
Cluster
Manager
Cluster
Manager
Managed
Cache
Storage
Data Service
Index Service
Query Service STORAGE
Couchbase Server 5
SHARD
7
SHARD
9
SHARD
5
SHARDSHARDSHARD
Managed
Cache
Cluster
Manager
Cluster
Manager
Managed
Cache
Storage
Data Service
Index Service
Query Service STORAGE
Couchbase Server 6
SHARD
7
SHARD
9
SHARD
5
SHARDSHARDSHARD
Managed
Cache
Cluster
Manager
Cluster
Manager
Managed
Cache
Storage
Data Service
Index Service
Query Service

9. ©2014 Couchbase Inc.
Couchbase Server: Core concepts
 Node
 Cluster
 Bucket
 Views and Design Documents
 Key/Value
 Cluster Map
 “Smart” clients
 Multi-dimensional scaling (> 4.0)
9

10. Introducing N1QL
Just the basics…

11. ©2014 Couchbase Inc.
Data In Couchbase
 Data is stored as a binary blob or a document
 Every datum has a primary key
 A document is a JSON object
 Documents are of arbitrary length and depth
 Documents contain scalars, other objects and arrays or
collections
 Each document has it’s own implied schema
 Documents are agile; they can evolve over time

12. ©2014 Couchbase Inc.
N1QL and SQL differences
 Data model
 Static vs Fluid
 Data is constrained by a “key space”
 Projection differences
 Columns vs “rich model”
 Reshaping of data is possible
 Selection differences
 Table vs Keyspace
 New operators: “.” and “[]”
 Filtering differences
 Irregular shape: IS MISSING, IS NULL
 ANY, SOME, EVERY 12

13. ©2014 Couchbase Inc.
Language Structure
 Statements
 Data Definition Language (DDL)
 Data Manipulations Language (DML)
 Query statements
 Expressions
 Comments
13

14. ©2014 Couchbase Inc.
Queries and Results
 Submit queries using SELECT statements
 Nested subqueries are possible
 Query across multiple documents with JOINs
 Operators and function allow navigation through arrays
 Use predicates in theWHERE clause to return ill regular data
 GROUP BY, ORDER BY, LIMIT and OFFSET and functions to transform
results
 N1QL provide paths to support nested data
 Paths are used with arrays and nested objects to get attributes
 Array syntax is used to get the information: orders[0].product_id
14

15. ©2014 Couchbase Inc.
Queries and Results: example
15
SELECT name, brewery_id from `beer-sample`
WHERE brewery_id IS NOT MISSING
LIMIT 2;

16. ©2014 Couchbase Inc.
Query results
 Returned as a JSON document
 Results are nested within additional data
 Request Id
 Signature
 Status
 Metrics
 Errors messages are also returned with “hints”
16

17. ©2014 Couchbase Inc.
Query Results: Example
17
{
"requestID": "fbea9e79-a2e2-4ab8-9fdc-14e098838cc1",
"signature": { "brewery_id": "json", "name": "json" },
"results": [
{ "brewery_id": "big_horn_brewing_the_ram_2", "name": "Schaumbergfest" },
{ "brewery_id": "ballast_point_brewing", "name": "Wahoo Wheat Beer" } ],
"status": "success",
"metrics": { "elapsedTime": "131.492184ms",
"executionTime": "131.261322ms",
"resultCount": 2,
"resultSize": 205 }
}

18. ©2014 Couchbase Inc.
System Information
 N1QL has a system catalogue that stores metadata
 The system catalog is a namespace called “system”
 Each artifact has a keyspace
 Logical hierarchy
 Data stores
 Namespaces
 Keyspaces
 Indexes
 Duals
 All system keyspaces are queryable!
18

19. Advanced N1QLTopics
What you need to know…

20. ©2014 Couchbase Inc.
NEST

21. ©2014 Couchbase Inc.
UNNEST
21

22. ©2014 Couchbase Inc.
Index Hints
22

23. ©2014 Couchbase Inc.
EXPLAIN
23

24. ©2014 Couchbase Inc.
Creating Indexes
24

25. REST API, SDK support, ODBC/JDBC and
Connectors
How to access it…

26. ©2014 Couchbase Inc.
REST API

27. ©2014 Couchbase Inc.
SDK Support
27

28. ©2014 Couchbase Inc.
ODBC and JDBC Drivers
28

29. ©2014 Couchbase Inc.
Connectors and 3rd part integration
29

30. Q&A
You ask, I answer…mmmaybe

31. Thank you.