In the world of NoSQL, each database has its own strengths and weaknesses. Understanding which open source database is "the right tool for the job" is half the battle if you want to start building better applications quickly. IBM developer advocate Glynn Bird explores practical examples of how two popular NoSQL databases - the Cloudant JSON document store and the Redis in-memory key-value store - can be used together to create performant and scalable Web applications. It also includes real world use cases you can try today, for free, using the IBM Cloud Data Services suite of fully managed NoSQL databases-as-a-service.

1. NoSQL use-cases you can use today
Practical NoSQL
Glynn Bird
Developer Advocate, IBM Cloud Data Services
glynn.bird@uk.ibm.com
@glynn_bird

2. Agenda
• NoSQL vs. SQL
• Types of NoSQL
• Redis
• Cloudant

3. SQL vs. NoSQL

4. RDBMS
• Relational Database Management Systems
• SQL language developed by IBM in the 1970s
• RDBMS power lots of IT systems
• Oracle, IBM DB2, MySQL, PostgreSQL, etc.

5. RDBMS downsides
• Scalability
• Availability
• Price

6. NoSQL
• NoSQL = “Not Only SQL”
• Response to use-cases that an RDBMS is not a good fit
• Easier to scale

7. Key-Value
Document
BigTable
Graph

8. Redis

9. Redis
• Key-value store
• In-memory storage
• Simple data storage structures
• Libraries for many programming languages
• Available as-a-service through Compose.io
! Auto-failover
! Free daily backups
! Scalable
! Enterprise Edition

10. Create a deployment

11. Demo

12. Simple Log Sharing Service https://logshare.mybluemix.net/
!

13. Redis use-cases
• Cache – time-limited data
• Pubsub – sharing a data stream with many clients
• Queues – distributing work
• Leaderboards – sorted sets
• Counting – incrementing, unique users
• Auto-complete – custom indexes

14. Cloudant

15. What is Apache CouchDB?
• Free, open-source, NoSQL database
• JSON data store
• Built for the web - HTTP
• RESTful API
• It syncs!
• http://couchdb.apache.org

16. Graphite &
Riemann
Monitoring
Chef
Configuration
Management
rsyslog
Federated Logging
CollectD
Continuous
Integration
CouchDB
JSON storage, API,
Replication
Dynamo
Clustering, Scaling,
Fault Tolerance
Lucene
Text indexing &
Search
Haproxy
Geo-Load Balancing
GeoJSON
Geospatial indexing
& query
Jenkins
Continuous
Integration

17. Cloudant scales
• Distributed database
• Add nodes to scale
• Fault-tolerance
• RESTful API

18. 18!
CRUD – Document
Primary
Index
Secondary Index
(view)
Search
Index
GeoSpatial Index
Cloudant
Query
• Direct document
look up by _id!
• Exists “OOTB”!
• stored in a b-tree!
• Primary key "
doc._id!
• Built using
MapReduce!
• stored in a b-tree!
• Key " user-
defined field(s)!
• Built using
Lucene!
• FTI: Any or all
fields can be
indexed!
• stored in R*, TPR,
KD tree!
• Lat/Long
coorindates in
GeoJSON!
• “Mongo-style”
querying!
• Built natively in
erlang!
• Use when you
want a single
document and
can find by its _id!
• Use when you
can find
documents based
on their _id!
• Pull back a range
of keys!
• Use when you
need to analyze
data or get a
range of keys!
• Ex: count data
fields, sum/
average numeric
results, advanced
stats, group by
date, etc.!
• Ad-hoc queries!
• Find documents
based on their
contents!
• Can do groups,
facets, and basic
geo queries (bbox
& sort by
distance)!
• Complex
geometries
(polygon,
circularstring,
etc.) !
• Advanced
relations
(intersect,
overlaps, etc.)!
• Ad-hoc queries!
• Lots of operators
(>, <, IN, OR,
AND, etc.)!
• Intuitive for
people coming
from Mongo or
SQL backgrounds!

19. Demo

20. Simple Search Service
• Free, open-source Bluemix App – install
with one click
• Upload your .csv or .tsv
# Imports data into cloudant
# Indexes everything for search
# Presents HTTP Search API
• Demo!
https://developer.ibm.com/clouddataservices/simple-search-service

21. Simple Search Service – Architecture

22. Simple Search Service – Production Architecture

23. https://developer.ibm.com/clouddataservices/simple-search-service/
https://cloudant.com/blog/turning-a-spreadsheet-into-a-faceted-
search-engine-with-cloudant/

24. Cloudant Use Cases
• Big Data – Large Data Sets
• Scalable operational data store
• Search – faceted, full-text search
• Geospatial – geographic, GIS systems, GeoJSON
• Offline-first – replicated data to mobile devices

25. Developer Advocate
Glynn.Bird@uk.ibm.com
developer.ibm.com/
clouddataservices/
Thanks!
Glynn Bird
Twitter: @glynn_bird
www.glynnbird.com
!