Considerations for using
{"no":"SQL"} technology on
your next IT project
Akmal B. Chaudhri
(艾克摩 曹理)
Abstract
Over the past few years, we have seen the emergence
and growth in NoSQL technology. This has attracted
interest f...
Agenda
In a packed program ...
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 

Introduction
Market analysis
NoSQL
Security and vulnerability
Polyg...
In a packed program ...
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 

Introduction
Market analysis
NoSQL
Security and vulnerability
Polyg...
In a packed program ...
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 

Introduction
Market analysis
NoSQL
Security and vulnerability
Polyg...
In a packed program ...
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 

Introduction
Market analysis
NoSQL
Security and vulnerability
Polyg...
In a packed program ...
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 

Introduction
Market analysis
NoSQL
Security and vulnerability
Polyg...
Introduction
My background
•  ~25 years experience in IT
– 
– 
– 
– 
– 
– 
– 

Developer (Reuters)
Academic (City University)
Consultan...
History
Have you run into limitations with
traditional relational databases? Don’t
mind trading a query language for
scala...
Your road leads to NoSQL?

NoSQL

NoSQL

NoSQL

NoSQL

NoSQL

NoSQL
NoSQL

NoSQL
Gartner hype curve

NoSQL
Magic quadrant ...
hot
SQL

lame

DB

ugly

Source: After “say No! No! and No! (=NoSQL Parody)” Jens Dittrich (2013)

cool
Magic quadrant

Source: Gartner (October 2013)
Innovation adoption lifecycle

Source: http://en.wikipedia.org/wiki/Technology_adoption_lifecycle
Crossing the chasm
Chasm
20 years ago
10 years ago
Today
The way developers really think
XML
NoSQL
OO
Object vs. Relational

Source: Inspired by comments from Esther Dyson during the 1990s
XML vs. Relational

Source: Inspired by https://webspace.utexas.edu/curtispe/NatConf/tam2005.html
NoSQL vs. Relational

Source: Inspired by http://www.slideshare.net/mongodb/webinar-the-opex-business-plan-for-nosql/ and
...
But ...
NoSQL is developer-friendly
Other Stakeholders

Developers
But ...
Riak ... We’re talking about nearly a year
of learning.[1]
Things I wish I knew about MongoDB a
year ago[2]
I am l...
NoSQL hoopla and hype
Extra! extra! ...
Extra! extra! ...

Source: Inspired by “The Next Big Thing 2012” The Wall Street Journal 27 September 2012
Extra! extra! ...
Extra! extra! ...
Extra! extra! ...

Source: Inspired by “MongoDB: Second Round” Thomas Jaspers 8 November 2012
Extra! extra! ...

Source: Inspired by “Why MongoDB is Awesome” John Nunemaker 15 May 2010 and
“Why Neo4J is awesome in 5 ...
Extra! extra! ...
Extra! extra! ...
Extra! extra! ...

Source: Inspired by “Saturday Night Live” Season 1 Episode 9 (1976)
Extra! extra!

Source: Inspired by the movie “Airplane!” (1980)
Past proclamations of the imminent
demise of relational technology
•  Object databases vs. relational
–  GemStone, ObjectS...
Market analysis
NoSQL market size ...
•  Private companies do
not publish results
•  Venture Capital (VC)
funding 10s/100s of
millions of ...
NoSQL market size

Source: http://wikibon.org/wiki/v/Big_Data_Vendor_Revenue_and_Market_Forecast_2012-2017
NoSQL job trends

Example:
100,000
x 0.1 %
= 100 jobs!

Source: http://regulargeek.com/2012/08/30/nosql-job-trends-august-...
NoSQL jobs in the UK
•  Database and
Business Intelligence
–  MongoDB (901)
–  Cassandra (363)
–  Redis (292)
–  HBase (14...
NoSQL LinkedIn skills index ...

Source: 451 Research
NoSQL LinkedIn skills index

Source: 451 Research
NoSQL vs. the world ...

Source: After http://www.kchodorow.com/blog/2011/05/05/nosql-vs-the-world/ (October 2013)
NoSQL vs. the world ...

Source: After http://www.kchodorow.com/blog/2011/05/05/nosql-vs-the-world/ (October 2013)
NoSQL vs. the world

Source: After http://www.kchodorow.com/blog/2011/05/05/nosql-vs-the-world/ (October 2013)
DB-Engines ranking ...

Source: http://db-engines.com/en/ranking/ (October 2013)
DB-Engines ranking

Source: http://db-engines.com/en/ranking/ (October 2013)
NoSQL in enterprise apps

Source: “Cloud Software: Where Next?” InformationWeek August 2013
Use of NoSQL products

Source: “State of Database Technology 2013” InformationWeek April 2013
Hosting example ...

Source: Jelastic, used with permission
Hosting example

Source: Jelastic, used with permission
NoSQL
“The Stars, Like Dust”
... a squadron of small, flitting ships that
had struck and vanished, then struck
again, and made s...
NoSQL The Movie!

Sequel
SQL

Not
Only

SQL
Why did NoSQL datastores arise?
•  Some applications need very few database
features, but need high scale
•  Desire to avo...
NoSQL drivers

Source: Couchbase NoSQL Survey (December 2011)
Big data
Variety

Velocity

Volume
Big data infrastructure

Source: “Analytics: The real-world use of big data” IBM and University of Oxford (October 2012)
Scenario where NoSQL is useful

A.N. Other

ownsCar

2000 VW

A.N. Other

ownsHouse

123 High St, London

A.N. Other

owns...
Brewer’s CAP Theorem ...

ACID

Consistency
CA

Availability AP

?

CP
Partition
Tolerance

BASE
Brewer’s CAP Theorem

Consistency
CA
Availability AP

CP
Partition
Tolerance
ACID vs. BASE ...
• 
• 
• 
• 

Atomicity
Consistency
Isolation
Durability

•  Basically Available
•  Soft state
•  Eventua...
ACID vs. BASE
ACID
•  Strong consistency
•  Isolation
•  Focus on “commit”
•  Nested transactions
•  Conservative (pessimi...
But ...
... we find developers spend a significant
fraction of their time building extremely
complex and error-prone mecha...
Tuneable CAP
•  Examples
–  Cassandra
–  Riak
Source: 451 Research, used with permission
How many systems? ...
There are a lot of Key/Value stores and
distributed schema-free Document
Oriented Databases out ther...
How many systems?

Source: http://nosql-database.org/ (October 2013)
Major categories of NoSQL ...
Type
Document store
Column store
Key-value store
Graph store

Examples
Source: 451 Research, used with permission
Major categories of NoSQL
Document store
Key

Column store

Document
(collection of keyvalues)

Key

CF1:
C1

CF1:
C2

Nod...
Source: Ilya Katsov, used with permission
Commercialization examples
Document store
•  Represent rich, hierarchical data structures,
reducing the need for multi-table joins
•  Structure of th...
MongoDB example
{

{
"namespace 1": any json object,
"namespace 2": any json object,
...

"namespace 1": [
{
"_id": "key 1...
Connection
private static final String DBNAME = "demodb";
private static final String COLLNAME = "people";
...
MongoClient...
Create
BasicDBObject document = new BasicDBObject();
List<String> likes = new ArrayList<String>();
likes.add("satay");
lik...
Read
BasicDBObject document = new BasicDBObject();
document.put("name", "akmal");
DBCursor cursor = collection.find(docume...
Update
BasicDBObject document = new BasicDBObject();
document.put("name", "akmal");
BasicDBObject newDocument = new BasicD...
Delete
BasicDBObject document = new BasicDBObject();
document.put("name", "akmal");
collection.remove(document);
Connection
var async = require('async');
var MongoClient = require('mongodb').MongoClient;
MongoClient.connect("mongodb://...
Create
function (callback) {
collection.insert(document, {w:1}, function(err, result) {
if (err) {
return callback(err);
}...
Read
function (callback) {
collection.findOne({'name':'akmal'}, function(err, item) {
if (err) {
return callback(err);
}
c...
Update
function (callback) {
collection.update({'name':'akmal'}, {$set:{'age':29}}, {w:1},
function(err, result) {
if (err...
Delete
function (callback) {
collection.remove({'name':'akmal'}, function(err, result) {
if (err) {
return callback(err);
...
Column store ...
•  Manage structured data, with multiple-attribute
access
•  Columns are grouped together in “columnfamil...
Column store
•  Scale using replication, multi-node distribution
for high availability and easy failover
•  Optimized for ...
Cassandra example
{

{
"column family 1": {
"key 1": {
"property 1": "value",
"property 2": "value"
},
"key 2": {
"propert...
Connection
Class.forName("org.apache.cassandra.cql.jdbc.CassandraDriver");
connection = DriverManager.getConnection(
"jdbc...
Create
String query =
"BEGIN BATCHn" +
"INSERT INTO people (name, age, date, likes) VALUES ('akmal', 40, '"
+ new Date() +...
Read
String query = "SELECT * FROM people";
Statement statement = connection.createStatement();
ResultSet cursor = stateme...
Update
String query =
"UPDATE people SET age = 29 WHERE name = 'akmal'";
Statement statement = connection.createStatement(...
Delete
String query =
"BEGIN BATCHn" +
"DELETE FROM people WHERE name = 'akmal'n" +
"APPLY BATCH;";
Statement statement = ...
Key-value store
•  Simplest NoSQL stores, provide low-latency
writes but single key/value access
•  Store data as a hash t...
Redis and Riak examples
{

{
database number: {
"key 1": "value",
"key 2": [ "value", "value",
"value" ],
"key 3": [
{ "va...
Connection
Jedis j = new Jedis("localhost", 6379);
j.connect();
System.out.println("Connected to Redis");
Create
String id = Long.toString(j.incr("global:nextUserId"));
j.set("uid:" + id + ":name", "akmal");
j.set("uid:" + id + ...
Read
String id = j.hget("uid:lookup:name", "akmal");
print("name ", j.get("uid:" + id + ":name"));
print("age ", j.get("ui...
Update
String id = j.hget("uid:lookup:name", "akmal");
j.set("uid:" + id + ":age", "29");
Delete
String id = j.hget("uid:lookup:name", "akmal");
j.del("uid:" + id + ":name");
j.del("uid:" + id + ":age");
j.del("u...
Graph store
•  Use nodes, relationships between nodes, and
key-value properties
•  Access data using graph traversal, navi...
Connection
private static final String DB_PATH =
"C:/neo4j-community-1.8.2/data/graph.db";
private static enum RelTypes im...
Create
Transaction tx = graphDb.beginTx();
try {
firstNode = graphDb.createNode();
firstNode.setProperty("name", "akmal");...
Read
Transaction tx = graphDb.beginTx();
try {
print("name", firstNode.getProperty("name"));
print("age", firstNode.getPro...
Update
Transaction tx = graphDb.beginTx();
try {
firstNode.setProperty("age", 29);
tx.success();
} finally { tx.finish(); ...
Delete
Transaction tx = graphDb.beginTx();
try {
firstNode.getSingleRelationship(RelTypes.LIKES,
Direction.OUTGOING).delet...
NoSQL use cases ...
•  Online/mobile gaming
–  Leaderboard (high score table) management
–  Dynamic placement of visual el...
NoSQL use cases
•  Dynamic content management and publishing
(news and media)
–  Store content from distributed authors, w...
Use case requirements ...
•  Schema flexibility and development agility
–  Application not constrained by fixed pre-define...
Use case requirements ...
•  Consistent low latency, even under high load
–  Typically milliseconds or sub-milliseconds, f...
Use case requirements
•  High availability
–  24 x 7 x 365 availability
–  (Today) Requires data distribution and replicat...
Security and
vulnerability
Security
MongoDB security
The most effective way to reduce risk for
MongoDB deployments is to run your
entire MongoDB deployment, i...
CouchDB security
When you start out fresh, CouchDB allows
any request to be made by anyone ...
While it is incredibly easy...
Redis security
Redis is designed to be accessed by
trusted clients inside trusted environments.
This means that usually it...
NoSQL injection attacks ...
•  NoSQL systems are
vulnerable
•  Various types of
attacks
•  Understand the
vulnerabilities ...
NoSQL injection attacks
•  Popular NoSQL
products will attract
more interest and
scrutiny
•  Features of some
programming
...
Polyglot
persistence

Source: Heroku, used with permission
Polyglot persistence
User Sessions

Financial Data

Shopping Cart

Recommendations

Product Catalog

Reporting

Analytics
...
Polyglot persistence examples
•  Disney
–  Cassandra, Hadoop, MongoDB

•  Interactive Mediums
–  CouchDB, MySQL

•  Mendel...
Polyglot persistence
•  NoSQL product specialization requires
developer knowledge and skills for each platform
•  Differen...
Public API for NoSQL store
In some cases, the team decided to hide
the platform’s complexity from users; not
to facilitate...
Asynchronous message
passing
(Actors)

Module
1

(Actors)

Module
3

Graph-structured
domain rules

Document
structures

C...
Multi-paradigm example
•  Application that routes picking baskets for
inventory in a warehouse
•  A graph with bins of inv...
Polyglot persistence with
EclipseLink JPA
•  Java Persistence API (JPA) for access to
NoSQL systems
•  Annotations and XML...
Benchmarks and
performance
Yahoo Cloud Serving BM ...
•  Originally Tested Systems
–  Cassandra, HBase, Yahoo!’s PNUTS,
sharded MySQL

•  Tier 1 (per...
Yahoo Cloud Serving BM
•  Yahoo Cloud Serving
Benchmark (YCSB)
–  Research paper
–  Slide deck

•  Altoros Report
–  50+ p...
“Can the Elephants Handle the
NoSQL Onslaught?”
•  DSS Workload (TPC-H)
–  Hive vs. Parallel Data Warehouse

•  Modern OLT...
Linked Data Benchmark Council

•  EU-funded project
•  Develop Graph and RDF benchmarks
Stress testing
•  Jepsen project
–  Rigorously test how various database
systems handle partitions
–  Evaluate consistency...
BI/Analytics
Architectures
• 
• 
• 
• 
• 
• 

NoSQL reports
NoSQL thru and thru
NoSQL + MySQL
NoSQL as ETL source
NoSQL programs in BI ...
NoSQL via BI database (SQL)
LIVE OR CACHED
PENTAHO.PRPT

ALL_CONTRACTS

VIEWS

15 min

local_
ALL_CONTRACTS

DOCS

view: "...
NoSQL alternatives
Source: 451 Research, used with permission
NewSQL
•  Today, new challenges and requirements
–  “Web changes everything”

• 
• 
• 
• 

Need more OLTP throughput
Need ...
Connection
Class.forName("com.nuodb.jdbc.Driver");
Properties properties = new Properties();
properties.put("user", "dba")...
Create
PreparedStatement statement = connection.prepareStatement(
"INSERT INTO people (name, age, date, likes) VALUES (?, ...
Read
String query = "SELECT * FROM people;";
Statement statement = connection.createStatement();
ResultSet cursor = statem...
Update
String query =
"UPDATE people SET age = 29 WHERE name = 'akmal';";
Statement statement = connection.createStatement...
Delete
String query = "DELETE FROM people WHERE name = 'akmal';";
Statement statement = connection.createStatement();
stat...
Relational
•  Vendors adding NoSQL capabilities
–  Documents (e.g. XML, JSON)
–  Linked data (e.g. RDF)
Relational vs. XML vs. RDF
Relational

XML

RDF

Tables

Trees

Graphs

Flat, highly
structured

Hierarchical data

Linked...
What about Oracle?
Summary
Source: ParElastic, used with permission
Relational does NoSQL
Often the overhead of managing data in
multiple databases is more than the
advantages of the other s...
Structured vs. unstructured

Structured

Unstructured
Relational vs. NoSQL toolbox
Relational vs. NoSQL ...
It is specious to compare NoSQL
databases to relational databases; as
you’ll see, none of the so-...
Relational vs. NoSQL
Limitations of NoSQL
•  Lack of standardized or well-defined semantics
–  Transactions? Isolation levels?

•  Reduced cons...
Choices, choices
Simple
Slow
Small

Value of Individual Data Item

Aggregate Data Value

Velocity

Hadoop, etc.

NoSQL

Data
Warehouse

New...
Understand your use case

Source: http://www.techvalidate.com/tvid/F66-11B-178/
Understand vendor-speak
What vendor says

What vendor means

The biggest in the world

The biggest one we’ve got

The bigg...
The great debate ...
The great debate ...
About every ten years or so, there is a
“great debate” between, on the one hand,
those who see the pr...
The great debate ...
Refuseniks: Hah! You relational people
with your flat tables and silly query
languages! You are so un...
The great debate
R-people: You make some good points.
But unfortunately a) there is an enormous
amount of money invested i...
It’s the people ...
... MongoDB Day London ... the problem is
the people! They all talk like this:
1.  Some problem that j...
It’s the people
... most of the business people driving the
Big Data NoSQL databases are data
management illiterate; don’t...
Final thoughts
We are clearly in the phase of a new
technology adoption in which the category
is hyped, its benefits over-...
Contact details
Find me on ...
–  http://www.linkedin.com/in/akmalchaudhri
–  http://twitter.com/akmalchaudhri
–  http://www.quora.com/Akm...
Akmal B. Chaudhri
firstname.lastname@live.com
{"thank":"You"}
Resources
History
•  First NoSQL meetup
–  http://nosql.eventbrite.com/
–  http://blog.oskarsson.nu/post/22996139456/nosqlmeetup

• ...
NoSQL Search roadshow
•  Multi-city tour 2013
–  Munich
–  Berlin
–  San Francisco
–  Copenhagen
–  Zurich
–  Amsterdam
– ...
Web sites
•  NoSQL Databases and Polyglot Persistence: A
Curated Guide
–  http://nosql.mypopescu.com/

•  NoSQL: Your Ulti...
Free books ...

•  Data Access for Highly-Scalable Solutions: Using SQL,
NoSQL, and Polyglot Persistence
–  http://www.mic...
Free books ...

•  The Little MongoDB Book
–  http://openmymind.net/2011/3/28/The-Little-MongoDB-Book/

•  The Little Redi...
Free books ...

•  CouchDB: The Definitive Guide
–  http://guide.couchdb.org/

•  A Little Riak Book
–  http://littleriakb...
Free books

•  Understanding The Top 5 Redis Performance Metrics
–  http://info.datadoghq.com/top-5-redis-performance-metr...
Free training
CERTIFICATE

CERTIFICATE

Dec. 24th, 2012

Dec. 24th, 2012

This is to certify that

This is to certify that...
Articles and reports
•  Saying Yes to NoSQL
–  http://www.nofluffjuststuff.com/s/magazine/
NFJS_theMagazine_Vol3_Issue3_Ma...
White papers
•  The CIO’s Guide to
NoSQL
–  http://
documents.dataversity
.net/whitepapers/thecios-guide-tonosql.html
Product selection ...
•  101 Questions to Ask When Considering a
NoSQL Database
–  http://highscalability.com/blog/2011/6/...
Product selection
•  NoSQL Options Compared: Different Horses for
Different Courses
–  http://www.slideshare.net/tazija/no...
Short product overviews ...
•  Picking the Right NoSQL Database Tool
–  http://blog.monitis.com/index.php/2011/05/22/picki...
Short product overviews ...
•  A Look at Some NoSQL Databases -- MongoDB,
Redis and Basho Riak
–  http://blog.monitis.com/...
Short product overviews
•  Cassandra vs MongoDB vs CouchDB vs Redis
vs Riak vs HBase vs Couchbase vs Neo4j vs
Hypertable v...
Case studies ...
•  Real World NoSQL: HBase at Trend Micro
–  http://gigaom.com/cloud/real-world-nosql-hbase-attrend-micro...
Case studies
•  Real World NoSQL: Amazon SimpleDB at Netflix
–  http://gigaom.com/cloud/real-world-nosql-amazonsimpledb-at...
Negative NoSQL comments ...
•  Scaling with MongoDB
–  http://opensourcebridge.org/wiki/2011/
Scaling_with_MongoDB
–  http...
Negative NoSQL comments ...
•  Why MongoDB Never Worked Out at Etsy
–  http://mcfunley.com/why-mongodb-never-worked-outat-...
Negative NoSQL comments ...
•  MongoDB is to NoSQL like MySQL to SQL -- in
the most harmful way
–  http://use-the-index-lu...
Negative NoSQL comments ...
•  Do Developers Use NoSQL Because They're
Too Lazy to Use RDBMS Correctly?
–  http://architec...
Negative NoSQL comments
•  7 hard truths about the NoSQL revolution
–  http://www.infoworld.com/d/data-management/7-hardtr...
Security ...
•  NoSQL, no security?
–  http://www.slideshare.net/wurbanski/nosql-nosecurity/

•  NoSQL, No Injection!?
–  ...
Security
•  NoSQL Database Security
–  http://conference.auscert.org.au/conf2011/
presentations/Louis Nyffenegger V1.pdf

...
Polyglot persistence ...
•  Polyglot Persistence
–  http://www.slideshare.net/jwoodslideshare/polyglotpersistence-two-grea...
Polyglot persistence
•  Polyglot Persistence: EclipseLink with MongoDB
and Derby
–  http://java.dzone.com/articles/polyglo...
Performance benchmarks ...
•  Yahoo Cloud Serving Benchmark
–  http://research.yahoo.com/node/3202/
–  http://altoros.com/...
Performance benchmarks ...
•  Ultra-High Performance NoSQL Benchmarking
–  http://thumbtack.net/solutions/
ThumbtackWhiteP...
Performance benchmarks ...
•  MongoDB Performance Pitfalls -- Behind The
Scenes
–  http://blog.trackerbird.com/content/mon...
Performance benchmarks ...
•  Can the Elephants Handle the NoSQL
Onslaught?
–  http://vldb.org/pvldb/vol5/
p1712_avriliafl...
Performance benchmarks
•  Benchmarking Graph Databases
–  http://istc-bigdata.org/index.php/benchmarking-graphdatabases/

...
Stress testing
•  Jepsen
–  http://www.aphyr.com/tags/jepsen

•  Jepsen: Testing the Partition Tolerance of
PostgreSQL, Re...
BI/Analytics
•  BI/Analytics on NoSQL: Review of Architectures
Part 1
–  http://www.dataversity.net/bianalytics-on-nosqlre...
Various graphics ...
•  NoSQL LinkedIn Skills Index -- September 2013
–  http://blogs.the451group.com/
information_managem...
Various graphics ...
•  Necessity is the mother of NoSQL
–  http://blogs.the451group.com/
information_management/2011/04/2...
Various graphics
•  The NoSQL vs. SQL hoopla, another turn of the
screw!
–  http://www.parelastic.com/blog/nosql-vs-sql-ho...
Discussion fora
•  LinkedIn NoSQL
–  http://www.linkedin.com/groups?gid=2085042

•  LinkedIn NewSQL
–  http://www.linkedin...
NoSQL jokes/humour ...
•  LinkedIn discussion thread
–  http://www.linkedin.com/groups/NoSQL-JokesHumour-2085042.S.1773212...
NoSQL jokes/humour
•  When someone brags about scaling MongoDB
to a whopping 100GB
–  http://dbareactions.tumblr.com/post/...
Miscellaneous ...
•  PowerPoint template
–  http://www.articulate.com/rapid-elearning/heres-afree-powerpoint-template-how-...
Miscellaneous ...
•  Bar and Column charts
–  http://www.diychart.com/

•  Newspaper headlines
–  http://www.imagechef.com...
Miscellaneous
•  Icons and images
–  http://www.geekpedia.com/icons.php
–  http://cemagraphics.deviantart.com/
–  http://w...
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri
Upcoming SlideShare
Loading in...5
×

Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri

4,886

Published on

Presentation given by Akmal Chaudhri (Hortonworks) to the BCS Data Management Specialist Group on 24th October 2013.
The presentation provides a balanced view of the state of NoSQL technology and tools and options for selection on projects.
A video of the presentation is available on YouTube at https://www.youtube.com/watch?v=FYfJ8C_YcvI

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
4,886
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
73
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Considerations for using NoSQL technology on your next IT project - Akmal Chaudhri

  1. 1. Considerations for using {"no":"SQL"} technology on your next IT project Akmal B. Chaudhri (艾克摩 曹理)
  2. 2. Abstract Over the past few years, we have seen the emergence and growth in NoSQL technology. This has attracted interest from organizations looking to solve new business problems. There are also examples of how this technology has been used to bring practical and commercial benefits to some organizations. However, since it is still an emerging technology, careful consideration is required in finding the relevant developer skills and choosing the right product. This presentation will discuss these issues in greater detail. In particular, it will focus on some of the leading NoSQL products and discuss their architectures and suitability for different problems
  3. 3. Agenda
  4. 4. In a packed program ... •  •  •  •  •  •  •  •  •  •  Introduction Market analysis NoSQL Security and vulnerability Polyglot persistence Benchmarks and performance BI/Analytics NoSQL alternatives Summary Resources
  5. 5. In a packed program ... •  •  •  •  •  •  •  •  •  •  Introduction Market analysis NoSQL Security and vulnerability Polyglot persistence Benchmarks and performance BI/Analytics NoSQL alternatives Summary Resources
  6. 6. In a packed program ... •  •  •  •  •  •  •  •  •  •  Introduction Market analysis NoSQL Security and vulnerability Polyglot persistence Benchmarks and performance BI/Analytics NoSQL alternatives Summary Resources
  7. 7. In a packed program ... •  •  •  •  •  •  •  •  •  •  Introduction Market analysis NoSQL Security and vulnerability Polyglot persistence Benchmarks and performance BI/Analytics NoSQL alternatives Summary Resources
  8. 8. In a packed program ... •  •  •  •  •  •  •  •  •  •  Introduction Market analysis NoSQL Security and vulnerability Polyglot persistence Benchmarks and performance BI/Analytics NoSQL alternatives Summary Resources
  9. 9. Introduction
  10. 10. My background •  ~25 years experience in IT –  –  –  –  –  –  –  Developer (Reuters) Academic (City University) Consultant (Logica) Technical Architect (CA) Senior Architect (Informix) Senior IT Specialist (IBM) TI (Hortonworks) •  Broad industry experience •  Worked with various technologies –  Programming languages –  IDE –  Database Systems •  Client-facing roles –  Developers –  Senior executives –  Journalists •  Community outreach •  10 books, many presentations
  11. 11. History Have you run into limitations with traditional relational databases? Don’t mind trading a query language for scalability? Or perhaps you just like shiny new things to try out? Either way this meetup is for you. Join us in figuring out why these new fangled Dynamo clones and BigTables have become so popular lately. Source: http://nosql.eventbrite.com/
  12. 12. Your road leads to NoSQL? NoSQL NoSQL NoSQL NoSQL NoSQL NoSQL NoSQL NoSQL
  13. 13. Gartner hype curve NoSQL
  14. 14. Magic quadrant ... hot SQL lame DB ugly Source: After “say No! No! and No! (=NoSQL Parody)” Jens Dittrich (2013) cool
  15. 15. Magic quadrant Source: Gartner (October 2013)
  16. 16. Innovation adoption lifecycle Source: http://en.wikipedia.org/wiki/Technology_adoption_lifecycle
  17. 17. Crossing the chasm Chasm
  18. 18. 20 years ago
  19. 19. 10 years ago
  20. 20. Today
  21. 21. The way developers really think XML NoSQL OO
  22. 22. Object vs. Relational Source: Inspired by comments from Esther Dyson during the 1990s
  23. 23. XML vs. Relational Source: Inspired by https://webspace.utexas.edu/curtispe/NatConf/tam2005.html
  24. 24. NoSQL vs. Relational Source: Inspired by http://www.slideshare.net/mongodb/webinar-the-opex-business-plan-for-nosql/ and http://www.slideshare.net/lj101197/couchbase-overview033113long/
  25. 25. But ...
  26. 26. NoSQL is developer-friendly Other Stakeholders Developers
  27. 27. But ... Riak ... We’re talking about nearly a year of learning.[1] Things I wish I knew about MongoDB a year ago[2] I am learning Cassandra. It is not easy.[3] [1] http://productionscale.com/blog/2011/11/20/building-an-application-upon-riak-part-1.html [2] http://snmaynard.com/2012/10/17/things-i-wish-i-knew-about-mongodb-a-year-ago/ [3] http://planetcassandra.org/blog/post/datastax-java-driver-for-apache-cassandra
  28. 28. NoSQL hoopla and hype
  29. 29. Extra! extra! ...
  30. 30. Extra! extra! ... Source: Inspired by “The Next Big Thing 2012” The Wall Street Journal 27 September 2012
  31. 31. Extra! extra! ...
  32. 32. Extra! extra! ...
  33. 33. Extra! extra! ... Source: Inspired by “MongoDB: Second Round” Thomas Jaspers 8 November 2012
  34. 34. Extra! extra! ... Source: Inspired by “Why MongoDB is Awesome” John Nunemaker 15 May 2010 and “Why Neo4J is awesome in 5 slides” Florent Biville 29 October 2012
  35. 35. Extra! extra! ...
  36. 36. Extra! extra! ...
  37. 37. Extra! extra! ... Source: Inspired by “Saturday Night Live” Season 1 Episode 9 (1976)
  38. 38. Extra! extra! Source: Inspired by the movie “Airplane!” (1980)
  39. 39. Past proclamations of the imminent demise of relational technology •  Object databases vs. relational –  GemStone, ObjectStore, Objectivity, etc. •  In-memory databases vs. relational –  TimesTen, SolidDB, etc. •  Persistence frameworks vs. relational –  Hibernate, OpenJPA, etc. •  XML databases vs. relational –  Tamino, BaseX, etc. •  Column-store databases vs. relational –  Sybase IQ, Vertica, etc.
  40. 40. Market analysis
  41. 41. NoSQL market size ... •  Private companies do not publish results •  Venture Capital (VC) funding 10s/100s of millions of US $[1] •  NoSQL software revenue was US $20 million in 2011[2] [1] http://blogs.the451group.com/information_management/2011/11/15/ [2] http://blogs.the451group.com/information_management/2012/05/
  42. 42. NoSQL market size Source: http://wikibon.org/wiki/v/Big_Data_Vendor_Revenue_and_Market_Forecast_2012-2017
  43. 43. NoSQL job trends Example: 100,000 x 0.1 % = 100 jobs! Source: http://regulargeek.com/2012/08/30/nosql-job-trends-august-2012/ (October 2013)
  44. 44. NoSQL jobs in the UK •  Database and Business Intelligence –  MongoDB (901) –  Cassandra (363) –  Redis (292) –  HBase (146) –  CouchDB (141) –  Hive (130) –  Couchbase (120) Source: http://www.itjobswatch.co.uk/jobs/uk/nosql.do (October 2013)
  45. 45. NoSQL LinkedIn skills index ... Source: 451 Research
  46. 46. NoSQL LinkedIn skills index Source: 451 Research
  47. 47. NoSQL vs. the world ... Source: After http://www.kchodorow.com/blog/2011/05/05/nosql-vs-the-world/ (October 2013)
  48. 48. NoSQL vs. the world ... Source: After http://www.kchodorow.com/blog/2011/05/05/nosql-vs-the-world/ (October 2013)
  49. 49. NoSQL vs. the world Source: After http://www.kchodorow.com/blog/2011/05/05/nosql-vs-the-world/ (October 2013)
  50. 50. DB-Engines ranking ... Source: http://db-engines.com/en/ranking/ (October 2013)
  51. 51. DB-Engines ranking Source: http://db-engines.com/en/ranking/ (October 2013)
  52. 52. NoSQL in enterprise apps Source: “Cloud Software: Where Next?” InformationWeek August 2013
  53. 53. Use of NoSQL products Source: “State of Database Technology 2013” InformationWeek April 2013
  54. 54. Hosting example ... Source: Jelastic, used with permission
  55. 55. Hosting example Source: Jelastic, used with permission
  56. 56. NoSQL
  57. 57. “The Stars, Like Dust” ... a squadron of small, flitting ships that had struck and vanished, then struck again, and made scrap of the lumbering titanic ships that had opposed them ... abandoning power alone, stressed speed and co-operation ... -- Isaac Asimov Source: “The Stars, Like Dust” Isaac Asimov (1951)
  58. 58. NoSQL The Movie! Sequel
  59. 59. SQL Not Only SQL
  60. 60. Why did NoSQL datastores arise? •  Some applications need very few database features, but need high scale •  Desire to avoid data/schema pre-design altogether for simple applications •  Need for a low-latency, low-overhead API to access data •  Simplicity -- do not need fancy indexing -- just fast lookup by primary key
  61. 61. NoSQL drivers Source: Couchbase NoSQL Survey (December 2011)
  62. 62. Big data Variety Velocity Volume
  63. 63. Big data infrastructure Source: “Analytics: The real-world use of big data” IBM and University of Oxford (October 2012)
  64. 64. Scenario where NoSQL is useful A.N. Other ownsCar 2000 VW A.N. Other ownsHouse 123 High St, London A.N. Other ownsComp 2007 MacBook Pro
  65. 65. Brewer’s CAP Theorem ... ACID Consistency CA Availability AP ? CP Partition Tolerance BASE
  66. 66. Brewer’s CAP Theorem Consistency CA Availability AP CP Partition Tolerance
  67. 67. ACID vs. BASE ... •  •  •  •  Atomicity Consistency Isolation Durability •  Basically Available •  Soft state •  Eventual consistency
  68. 68. ACID vs. BASE ACID •  Strong consistency •  Isolation •  Focus on “commit” •  Nested transactions •  Conservative (pessimistic) •  Availability •  Difficult evolution BASE •  Weak consistency •  Availability first •  Best effort •  Approximate answers OK •  Aggressive (optimistic) •  Simpler, faster •  Easier evolution Source: After “Towards Robust Distributed Systems” Eric Brewer (2000)
  69. 69. But ... ... we find developers spend a significant fraction of their time building extremely complex and error-prone mechanisms to cope with eventual consistency and handle data that may be out of date. We think this is an unacceptable burden to place on developers and that consistency problems should be solved at the database level. Source: http://research.google.com/pubs/pub41344.html
  70. 70. Tuneable CAP •  Examples –  Cassandra –  Riak
  71. 71. Source: 451 Research, used with permission
  72. 72. How many systems? ... There are a lot of Key/Value stores and distributed schema-free Document Oriented Databases out there. They’re springing up like weeds in a spring garden. And folks love to blog about them and/or talk about how their favorite is better than the others (or MySQL). -- Jeremy Zawodny Source: http://blog.zawodny.com/2010/03/28/nosql-is-software-darwinism/
  73. 73. How many systems? Source: http://nosql-database.org/ (October 2013)
  74. 74. Major categories of NoSQL ... Type Document store Column store Key-value store Graph store Examples
  75. 75. Source: 451 Research, used with permission
  76. 76. Major categories of NoSQL Document store Key Column store Document (collection of keyvalues) Key CF1: C1 CF1: C2 Node 1 Key Binary Data Key CF3: C1 Node 2 Properties Key Properties Relationship 1 Key Key-value store CF2: C1 Properties Graph store
  77. 77. Source: Ilya Katsov, used with permission
  78. 78. Commercialization examples
  79. 79. Document store •  Represent rich, hierarchical data structures, reducing the need for multi-table joins •  Structure of the documents need not be known a priori, can be variable, and evolve instantly, but a query can understand the contents of a document •  Use cases: rapid ingest and delivery for evolving schemas and web-based objects
  80. 80. MongoDB example { { "namespace 1": any json object, "namespace 2": any json object, ... "namespace 1": [ { "_id": "key 1", "property 1": "value", "property 2": { "property 3": "value", "property 4": [ "value", "value", "value" ] }, ... }, ... ] } } Source: Frank Denis, used with permission
  81. 81. Connection private static final String DBNAME = "demodb"; private static final String COLLNAME = "people"; ... MongoClient mongoClient = new MongoClient("localhost", 27017); DB db = mongoClient.getDB(DBNAME); DBCollection collection = db.getCollection(COLLNAME); System.out.println("Connected to MongoDB");
  82. 82. Create BasicDBObject document = new BasicDBObject(); List<String> likes = new ArrayList<String>(); likes.add("satay"); likes.add("kebabs"); likes.add("fish-n-chips"); document.put("name", "akmal"); document.put("age", 40); document.put("date", new Date()); document.put("likes", likes); collection.insert(document);
  83. 83. Read BasicDBObject document = new BasicDBObject(); document.put("name", "akmal"); DBCursor cursor = collection.find(document); while (cursor.hasNext()) System.out.println(cursor.next()); cursor.close();
  84. 84. Update BasicDBObject document = new BasicDBObject(); document.put("name", "akmal"); BasicDBObject newDocument = new BasicDBObject(); newDocument.put("age", 29); BasicDBObject updateObj = new BasicDBObject(); updateObj.put("$set", newDocument); collection.update(document, updateObj);
  85. 85. Delete BasicDBObject document = new BasicDBObject(); document.put("name", "akmal"); collection.remove(document);
  86. 86. Connection var async = require('async'); var MongoClient = require('mongodb').MongoClient; MongoClient.connect("mongodb://localhost:27017/demodb", function(err, db) { if (err) { return console.log(err); } console.log("Connected to MongoDB"); var collection = db.collection('people'); var document = { 'name':'akmal', 'age':40, 'date':new Date(), 'likes':['satay', 'kebabs', 'fish-n-chips'] };
  87. 87. Create function (callback) { collection.insert(document, {w:1}, function(err, result) { if (err) { return callback(err); } callback(); }); },
  88. 88. Read function (callback) { collection.findOne({'name':'akmal'}, function(err, item) { if (err) { return callback(err); } console.log(item); callback(); }); },
  89. 89. Update function (callback) { collection.update({'name':'akmal'}, {$set:{'age':29}}, {w:1}, function(err, result) { if (err) { return callback(err); } callback(); }); },
  90. 90. Delete function (callback) { collection.remove({'name':'akmal'}, function(err, result) { if (err) { return callback(err); } callback(); }); },
  91. 91. Column store ... •  Manage structured data, with multiple-attribute access •  Columns are grouped together in “columnfamilies/groups”; each storage block contains data from only one column/column set to provide data locality for “hot” columns •  Column groups defined a priori, but support variable schemas within a column group
  92. 92. Column store •  Scale using replication, multi-node distribution for high availability and easy failover •  Optimized for writes •  Use cases: high throughput verticals (activity feeds, message queues), caching, web operations
  93. 93. Cassandra example { { "column family 1": { "key 1": { "property 1": "value", "property 2": "value" }, "key 2": { "property 1": "value", "property 4": "value", "property 5": "value" } }, ... "column family 2": { "super key 1": { "key 1": { "property 1": "value", "property 2": "value" }, "key 2": { "property 1": "value", "property 4": "value", "property 5": "value" }, ... }, ... }, ... } } Source: Frank Denis, used with permission
  94. 94. Connection Class.forName("org.apache.cassandra.cql.jdbc.CassandraDriver"); connection = DriverManager.getConnection( "jdbc:cassandra://localhost:9160/demodb"); System.out.println("Connected to Cassandra");
  95. 95. Create String query = "BEGIN BATCHn" + "INSERT INTO people (name, age, date, likes) VALUES ('akmal', 40, '" + new Date() + "', {'satay', 'kebabs', 'fish-n-chips'})n" + "APPLY BATCH;"; Statement statement = connection.createStatement(); statement.executeUpdate(query); statement.close();
  96. 96. Read String query = "SELECT * FROM people"; Statement statement = connection.createStatement(); ResultSet cursor = statement.executeQuery(query); while (cursor.next()) for (int j = 1; j < cursor.getMetaData().getColumnCount()+1; j++) System.out.printf("%-10s: %s%n", cursor.getMetaData().getColumnName(j), cursor.getString(cursor.getMetaData().getColumnName(j))); cursor.close(); statement.close();
  97. 97. Update String query = "UPDATE people SET age = 29 WHERE name = 'akmal'"; Statement statement = connection.createStatement(); statement.executeUpdate(query); statement.close();
  98. 98. Delete String query = "BEGIN BATCHn" + "DELETE FROM people WHERE name = 'akmal'n" + "APPLY BATCH;"; Statement statement = connection.createStatement(); statement.executeUpdate(query); statement.close();
  99. 99. Key-value store •  Simplest NoSQL stores, provide low-latency writes but single key/value access •  Store data as a hash table of keys where every key maps to an opaque binary object •  Easily scale across many machines •  Use-cases: applications that require massive amounts of simple data (sensor, web operations), applications that require rapidly changing data (stock quotes), caching
  100. 100. Redis and Riak examples { { database number: { "key 1": "value", "key 2": [ "value", "value", "value" ], "key 3": [ { "value": "value", "score": score }, { "value": "value", "score": score }, ... ], "key 4": { "property 1": "value", "property 2": "value", "property 3": "value", ... }, ... } } Source: Frank Denis, used with permission "bucket 1": { "key 1": document + content-type, "key 2": document + content-type, "link to another object 1": URI of other bucket/key, "link to another object 2": URI of other bucket/key, }, "bucket 2": { "key 3": document + content-type, "key 4": document + content-type, "key 5": document + content-type ... }, ... }
  101. 101. Connection Jedis j = new Jedis("localhost", 6379); j.connect(); System.out.println("Connected to Redis");
  102. 102. Create String id = Long.toString(j.incr("global:nextUserId")); j.set("uid:" + id + ":name", "akmal"); j.set("uid:" + id + ":age", "40"); j.set("uid:" + id + ":date", new Date().toString()); j.sadd("uid:" + id + ":likes", "satay"); j.sadd("uid:" + id + ":likes", "kebabs"); j.sadd("uid:" + id + ":likes", "fish-n-chips"); j.hset("uid:lookup:name", "akmal", id);
  103. 103. Read String id = j.hget("uid:lookup:name", "akmal"); print("name ", j.get("uid:" + id + ":name")); print("age ", j.get("uid:" + id + ":age")); print("date ", j.get("uid:" + id + ":date")); print("likes ", j.smembers("uid:" + id + ":likes"));
  104. 104. Update String id = j.hget("uid:lookup:name", "akmal"); j.set("uid:" + id + ":age", "29");
  105. 105. Delete String id = j.hget("uid:lookup:name", "akmal"); j.del("uid:" + id + ":name"); j.del("uid:" + id + ":age"); j.del("uid:" + id + ":date"); j.del("uid:" + id + ":likes");
  106. 106. Graph store •  Use nodes, relationships between nodes, and key-value properties •  Access data using graph traversal, navigating from start nodes to related nodes according to graph algorithms •  Faster for associative data sets •  Use cases: storing and reasoning on complex and connected data, such as inferencing applications in healthcare, government, telecom, oil, performing closure on social networking graphs
  107. 107. Connection private static final String DB_PATH = "C:/neo4j-community-1.8.2/data/graph.db"; private static enum RelTypes implements RelationshipType { LIKES } ... graphDb = new GraphDatabaseFactory().newEmbeddedDatabase(DB_PATH); registerShutdownHook(graphDb); System.out.println("Connected to Neo4j");
  108. 108. Create Transaction tx = graphDb.beginTx(); try { firstNode = graphDb.createNode(); firstNode.setProperty("name", "akmal"); firstNode.setProperty("age", 40); firstNode.setProperty("date", new Date().toString()); secondNode = graphDb.createNode(); secondNode.setProperty("food", "satay, kebabs, fish-n-chips"); relationship = firstNode.createRelationshipTo(secondNode, RelTypes.LIKES); relationship.setProperty("likes", "likes"); tx.success(); } finally { tx.finish(); }
  109. 109. Read Transaction tx = graphDb.beginTx(); try { print("name", firstNode.getProperty("name")); print("age", firstNode.getProperty("age")); print("date", firstNode.getProperty("date")); print("likes", secondNode.getProperty("food")); tx.success(); } finally { tx.finish(); }
  110. 110. Update Transaction tx = graphDb.beginTx(); try { firstNode.setProperty("age", 29); tx.success(); } finally { tx.finish(); }
  111. 111. Delete Transaction tx = graphDb.beginTx(); try { firstNode.getSingleRelationship(RelTypes.LIKES, Direction.OUTGOING).delete(); firstNode.delete(); secondNode.delete(); tx.success(); } finally { tx.finish(); }
  112. 112. NoSQL use cases ... •  Online/mobile gaming –  Leaderboard (high score table) management –  Dynamic placement of visual elements –  Game object management –  Persisting game/user state information –  Persisting user generated data (e.g. drawings) •  Display advertising on web sites –  Ad Serving: match content with profile and present –  Real-time bidding: match cookie profile with advert inventory, obtain bids, and present advert
  113. 113. NoSQL use cases •  Dynamic content management and publishing (news and media) –  Store content from distributed authors, with fast retrieval and placement –  Manage changing layouts and user generated content •  E-commerce/social commerce –  Storing frequently changing product catalogs •  Social networking/online communities •  Communications –  Device provisioning
  114. 114. Use case requirements ... •  Schema flexibility and development agility –  Application not constrained by fixed pre-defined schema –  Application drives the schema –  Ability to develop a minimal application rapidly, and iterate quickly in response to customer feedback –  Ability to quickly add, change or delete “fields” or data-elements –  Ability to handle a mix of structured and unstructured data –  Easier, faster programming, so faster time to market and quick to adapt
  115. 115. Use case requirements ... •  Consistent low latency, even under high load –  Typically milliseconds or sub-milliseconds, for reads and writes –  Even with millions of users •  Dynamic elasticity –  Rapid horizontal scalability –  Ability to add or delete nodes dynamically –  Application transparent elasticity, such as automatic (re)distribution of data, if needed –  Cloud compatibility
  116. 116. Use case requirements •  High availability –  24 x 7 x 365 availability –  (Today) Requires data distribution and replication –  Ability to upgrade hardware or software without any down time •  Low cost –  Commonly available hardware –  Lower cost software, such as open source or pay-peruse in cloud –  Reduced need for database administration, and maintenance
  117. 117. Security and vulnerability
  118. 118. Security
  119. 119. MongoDB security The most effective way to reduce risk for MongoDB deployments is to run your entire MongoDB deployment, including all MongoDB components (i.e. mongod, mongos and application instances) in a trusted environment. Source: http://docs.mongodb.org/manual/administration/security/ (October 2012)
  120. 120. CouchDB security When you start out fresh, CouchDB allows any request to be made by anyone ... While it is incredibly easy to get started with CouchDB that way, it should be obvious that putting a default installation into the wild is adventurous. Any rogue client could come along and delete a database. relax Source: http://guide.couchdb.org/draft/security.html (October 2012)
  121. 121. Redis security Redis is designed to be accessed by trusted clients inside trusted environments. This means that usually it is not a good idea to expose the Redis instance directly to the internet or, in general, to an environment where untrusted clients can directly access the Redis TCP port or UNIX socket. Source: http://redis.io/topics/security/ (October 2012)
  122. 122. NoSQL injection attacks ... •  NoSQL systems are vulnerable •  Various types of attacks •  Understand the vulnerabilities and consequences
  123. 123. NoSQL injection attacks •  Popular NoSQL products will attract more interest and scrutiny •  Features of some programming languages, e.g. PHP •  Server-Side JavaScript (SSJS)
  124. 124. Polyglot persistence Source: Heroku, used with permission
  125. 125. Polyglot persistence User Sessions Financial Data Shopping Cart Recommendations Product Catalog Reporting Analytics User Activity Logs Source: Adapted from http://martinfowler.com/bliki/PolyglotPersistence.html
  126. 126. Polyglot persistence examples •  Disney –  Cassandra, Hadoop, MongoDB •  Interactive Mediums –  CouchDB, MySQL •  Mendeley –  HBase, MongoDB, Solr, Voldemort •  Netflix –  Cassandra, Hadoop/HBase, RDBMS, SimpleDB •  Twitter –  Cassandra, FlockDB, Hadoop/HBase, MySQL
  127. 127. Polyglot persistence •  NoSQL product specialization requires developer knowledge and skills for each platform •  Different APIs –  Develop public API for each NoSQL store (Disney)
  128. 128. Public API for NoSQL store In some cases, the team decided to hide the platform’s complexity from users; not to facilitate its use, but to keep loosecannon developers from doing something crazy that could take down the whole cluster. It could show them all the controls and knobs in a NoSQL database, but “they tend to shoot each other,” Jacob said. “First they shoot themselves, then they shoot each other.” Source: “How Disney built a big data platform on a startup budget” Derrick Harris (2012)
  129. 129. Asynchronous message passing (Actors) Module 1 (Actors) Module 3 Graph-structured domain rules Document structures Columnar data Access with decentralization Document structures with offline processing Module 2 Source: Debasish Ghosh, used with permission Module 4
  130. 130. Multi-paradigm example •  Application that routes picking baskets for inventory in a warehouse •  A graph with bins of inventory (nodes) along aisles (edges) •  Store graph in Neo4j for performance •  Asynchronously persist in MySQL for reporting •  Move data using asynchronous message queue •  Faster performance, easier development, simpler scaling, and reduced cost Source: http://akfpartners.com/techblog/2011/06/21/multi-paradigm-data-storage-architectures/
  131. 131. Polyglot persistence with EclipseLink JPA •  Java Persistence API (JPA) for access to NoSQL systems •  Annotations and XML to identify stored NoSQL entities •  An application can use multiple database systems •  Single composite Persistence Unit (PU) supports relational and non-relational data •  Support for MongoDB and Oracle NoSQL with other products planned
  132. 132. Benchmarks and performance
  133. 133. Yahoo Cloud Serving BM ... •  Originally Tested Systems –  Cassandra, HBase, Yahoo!’s PNUTS, sharded MySQL •  Tier 1 (performance) –  Latency by increasing the server load •  Tier 2 (scalability) –  Scalability by increasing the number of servers
  134. 134. Yahoo Cloud Serving BM •  Yahoo Cloud Serving Benchmark (YCSB) –  Research paper –  Slide deck •  Altoros Report –  50+ pages •  Thumbtack Report –  40+ pages
  135. 135. “Can the Elephants Handle the NoSQL Onslaught?” •  DSS Workload (TPC-H) –  Hive vs. Parallel Data Warehouse •  Modern OLTP Workload (YCSB) –  MongoDB vs. SQL Server •  Conclusions –  NoSQL systems are behind relational systems in performance
  136. 136. Linked Data Benchmark Council •  EU-funded project •  Develop Graph and RDF benchmarks
  137. 137. Stress testing •  Jepsen project –  Rigorously test how various database systems handle partitions –  Evaluate consistency •  Conclusions –  Don’t rely on vendor marketing, product documentation or “pull the plug” test
  138. 138. BI/Analytics
  139. 139. Architectures •  •  •  •  •  •  NoSQL reports NoSQL thru and thru NoSQL + MySQL NoSQL as ETL source NoSQL programs in BI tools NoSQL via BI database (SQL) Source: Nicholas Goodman
  140. 140. NoSQL via BI database (SQL) LIVE OR CACHED PENTAHO.PRPT ALL_CONTRACTS VIEWS 15 min local_ ALL_CONTRACTS DOCS view: "all" javascript, map, reduce Source: http://www.nicholasgoodman.com/bt/blog/2011/06/22/sql-access-to-couchdb-views-easy-reporting/
  141. 141. NoSQL alternatives
  142. 142. Source: 451 Research, used with permission
  143. 143. NewSQL •  Today, new challenges and requirements –  “Web changes everything” •  •  •  •  Need more OLTP throughput Need real-time analytics ACID support Preserve SQL –  Automatic query optimization •  Preserve investment –  Existing skills and tools
  144. 144. Connection Class.forName("com.nuodb.jdbc.Driver"); Properties properties = new Properties(); properties.put("user", "dba"); properties.put("password", "goalie"); properties.put("schema", "test"); connection = DriverManager.getConnection( "jdbc:com.nuodb://localhost/test", properties); System.out.println("Connected to NuoDB");
  145. 145. Create PreparedStatement statement = connection.prepareStatement( "INSERT INTO people (name, age, date, likes) VALUES (?, ?, ?, ?)"); statement.setString(1, "akmal"); statement.setInt(2, 40); statement.setString(3, new Date().toString()); statement.setString(4, "satay kebabs fish-n-chips"); statement.addBatch(); statement.executeBatch(); connection.commit();
  146. 146. Read String query = "SELECT * FROM people;"; Statement statement = connection.createStatement(); ResultSet cursor = statement.executeQuery(query); while (cursor.next()) { System.out.print(cursor.getString(1) + " "); System.out.print(cursor.getInt(2) + " "); System.out.print(cursor.getString(3) + " "); System.out.println(cursor.getString(4)); } cursor.close(); statement.close();
  147. 147. Update String query = "UPDATE people SET age = 29 WHERE name = 'akmal';"; Statement statement = connection.createStatement(); statement.executeUpdate(query); connection.commit(); readData(connection);
  148. 148. Delete String query = "DELETE FROM people WHERE name = 'akmal';"; Statement statement = connection.createStatement(); statement.executeUpdate(query); connection.commit();
  149. 149. Relational •  Vendors adding NoSQL capabilities –  Documents (e.g. XML, JSON) –  Linked data (e.g. RDF)
  150. 150. Relational vs. XML vs. RDF Relational XML RDF Tables Trees Graphs Flat, highly structured Hierarchical data Linked data Rows in a table Nodes in a tree Triples describe links Fixed schema No or flexible schema Highly flexible SQL (ANSI/ISO) XPath/XQuery (W3C) SPARQL (W3C)
  151. 151. What about Oracle?
  152. 152. Summary
  153. 153. Source: ParElastic, used with permission
  154. 154. Relational does NoSQL Often the overhead of managing data in multiple databases is more than the advantages of the other store being faster. You can do “NoSQL” inside and around a hackable database like PostgreSQL, not just as a separate one. -- Hannu Krosing Source: http://2013.nosql-matters.org/cgn/abstracts/#abstract_hannu_krosing/
  155. 155. Structured vs. unstructured Structured Unstructured
  156. 156. Relational vs. NoSQL toolbox
  157. 157. Relational vs. NoSQL ... It is specious to compare NoSQL databases to relational databases; as you’ll see, none of the so-called “NoSQL” databases have the same implementation, goals, features, advantages, and disadvantages. So comparing “NoSQL” to “relational” is really a shell game. -- Eben Hewitt Source: “Cassandra: The Definitive Guide” Eben Hewitt (2010)
  158. 158. Relational vs. NoSQL
  159. 159. Limitations of NoSQL •  Lack of standardized or well-defined semantics –  Transactions? Isolation levels? •  Reduced consistency for performance and scalability –  “Eventual consistency” –  “Soft commit” •  •  •  •  Limited forms of access, e.g. often no joins, etc. Proprietary interfaces Large clusters, failover, etc.? Security?
  160. 160. Choices, choices
  161. 161. Simple Slow Small Value of Individual Data Item Aggregate Data Value Velocity Hadoop, etc. NoSQL Data Warehouse NewSQL Traditional RDBMS Transactional Interactive Analytic Real-time Analytics Source: VoltDB, used with permission Record Lookup Historical Analytics Exploratory Analytics Data Value Application Complexity Fast Complex Large
  162. 162. Understand your use case Source: http://www.techvalidate.com/tvid/F66-11B-178/
  163. 163. Understand vendor-speak What vendor says What vendor means The biggest in the world The biggest one we’ve got The biggest in the universe The biggest one we’ve got There is no limit to ... It’s untested, but we don’t mind if you try it A new and unique feature Something the competition has had for ages Currently available feature We are about to start Beta testing Planned feature Something the competition has, that we wish we had too, that we might have one day Highly distributed International offices Engineered for robustness Comes in a tough box Source: “Object Databases: An Evaluation and Comparison” Bloor Research (1994)
  164. 164. The great debate ...
  165. 165. The great debate ... About every ten years or so, there is a “great debate” between, on the one hand, those who see the problem of data modelling through a more or less relational lens, and on the other, a noisier set of “refuseniks” who have a hot new thing to promote. The debate usually goes like this:
  166. 166. The great debate ... Refuseniks: Hah! You relational people with your flat tables and silly query languages! You are so unhip! You simply cannot deal with the problem of [INSERT NEW THING HERE]. With an [INSERT NEW THING HERE]-DBMS we will finish you, and grind your bones into dust!
  167. 167. The great debate R-people: You make some good points. But unfortunately a) there is an enormous amount of money invested in building scalable, efficient and reliable database management products and no one is going to drop all of that on the floor and b) you are confusing DBMS engineering decisions with theoretical questions. We plan to incorporate the best of these ideas into our products. Source: Paul Brown
  168. 168. It’s the people ... ... MongoDB Day London ... the problem is the people! They all talk like this: 1.  Some problem that just doesn’t really exist (or hasn’t existed for a very long time) with relational databases 2.  MongoDB 3.  Profit! -- Gaius Hammond Source: http://gaiustech.wordpress.com/2013/04/13/mongodb-days/
  169. 169. It’s the people ... most of the business people driving the Big Data NoSQL databases are data management illiterate; don’t recognize the lack of NoSQL data management facilities ... and don’t know anything about availability, referential integrity and normalized data designs. -- Dave Beulke Source: http://davebeulke.com/big-data-day-recap/
  170. 170. Final thoughts We are clearly in the phase of a new technology adoption in which the category is hyped, its benefits over-promised, its limitations poorly understood, and its value oversold. -- Tim Berglund Source: “Saying Yes to NoSQL” Tim Berglund (2011)
  171. 171. Contact details
  172. 172. Find me on ... –  http://www.linkedin.com/in/akmalchaudhri –  http://twitter.com/akmalchaudhri –  http://www.quora.com/Akmal-Chaudhri –  http://www.facebook.com/akmal.chaudhri –  http://plus.google.com/ 105126255575427189842/ –  http://www.slideshare.net/VeryFatBoy/ –  http://www.youtube.com/VeryFatBoyVideos/
  173. 173. Akmal B. Chaudhri firstname.lastname@live.com
  174. 174. {"thank":"You"}
  175. 175. Resources
  176. 176. History •  First NoSQL meetup –  http://nosql.eventbrite.com/ –  http://blog.oskarsson.nu/post/22996139456/nosqlmeetup •  First NoSQL meetup debrief –  http://blog.oskarsson.nu/post/22996140866/nosqldebrief •  First NoSQL meetup photographs –  http://www.flickr.com/photos/russss/sets/ 72157619711038897/
  177. 177. NoSQL Search roadshow •  Multi-city tour 2013 –  Munich –  Berlin –  San Francisco –  Copenhagen –  Zurich –  Amsterdam –  London Source: http://nosqlroadshow.com/
  178. 178. Web sites •  NoSQL Databases and Polyglot Persistence: A Curated Guide –  http://nosql.mypopescu.com/ •  NoSQL: Your Ultimate Guide to the NonRelational Universe! –  http://nosql-database.org/
  179. 179. Free books ... •  Data Access for Highly-Scalable Solutions: Using SQL, NoSQL, and Polyglot Persistence –  http://www.microsoft.com/en-us/download/details.aspx?id=40327
  180. 180. Free books ... •  The Little MongoDB Book –  http://openmymind.net/2011/3/28/The-Little-MongoDB-Book/ •  The Little Redis Book –  http://openmymind.net/2012/1/23/The-Little-Redis-Book/
  181. 181. Free books ... •  CouchDB: The Definitive Guide –  http://guide.couchdb.org/ •  A Little Riak Book –  http://littleriakbook.com
  182. 182. Free books •  Understanding The Top 5 Redis Performance Metrics –  http://info.datadoghq.com/top-5-redis-performance-metricsebook
  183. 183. Free training CERTIFICATE CERTIFICATE Dec. 24th, 2012 Dec. 24th, 2012 This is to certify that This is to certify that Akmal Chaudhri Akmal Chaudhri successfully completed successfully completed M101: MongoDB for Developers M102: MongoDB for DBAs a course of study offered by 10gen, The MongoDB Company a course of study offered by 10gen, The MongoDB Company Dwight Merriman 10gen, Inc. Andrew Erlichson Dwight Merriman Vice President, Education 10gen, Inc. Authenticity of this certificate can be verified at https://education.10gen.com/downloads/certificates/1e73378509f046f28cbcb2212f3d7cff/Certificate.pdf 10gen, Inc. Andrew Erlichson Vice President, Education 10gen, Inc. Authenticity of this certificate can be verified at https://education.10gen.com/downloads/certificates/c0e418e393e247eb818d82d0472549f4/Certificate.pdf •  Free courses on MongoDB –  https://education.mongodb.com/
  184. 184. Articles and reports •  Saying Yes to NoSQL –  http://www.nofluffjuststuff.com/s/magazine/ NFJS_theMagazine_Vol3_Issue3_May2011.pdf •  The State of NoSQL –  http://www.infoq.com/articles/State-of-NoSQL/ •  D. Feinberg, M. Adrian and N. Heudecker (2013) Magic Quadrant for Operational Database Management Systems, Gartner, ID:G00251780, 21 October 2013 –  http://info.marklogic.com/gartner-odbms.html
  185. 185. White papers •  The CIO’s Guide to NoSQL –  http:// documents.dataversity .net/whitepapers/thecios-guide-tonosql.html
  186. 186. Product selection ... •  101 Questions to Ask When Considering a NoSQL Database –  http://highscalability.com/blog/2011/6/15/101questions-to-ask-when-considering-a-nosqldatabase.html •  35+ Use Cases for Choosing Your Next NoSQL Database –  http://highscalability.com/blog/2011/6/20/35-usecases-for-choosing-your-next-nosql-database.html
  187. 187. Product selection •  NoSQL Options Compared: Different Horses for Different Courses –  http://www.slideshare.net/tazija/nosql-optionscompared/ •  NoSQL Data Modeling Techniques –  http://highlyscalable.wordpress.com/2012/03/01/ nosql-data-modeling-techniques/ •  Choosing a NoSQL data store according to your data set –  http://00f.net/2010/05/15/choosing-a-nosql-data-storeaccording-to-your-data-set/
  188. 188. Short product overviews ... •  Picking the Right NoSQL Database Tool –  http://blog.monitis.com/index.php/2011/05/22/pickingthe-right-nosql-database-tool/ •  NoSQL Databases -- A Look at Apache Cassandra –  http://blog.monitis.com/index.php/2011/05/24/nosqldatabases-a-look-at-apache-cassandra/ •  The NoSQL Databases -- A Look at HBase –  http://blog.monitis.com/index.php/2011/05/31/thenosql-databases-a-look-at-hbase/
  189. 189. Short product overviews ... •  A Look at Some NoSQL Databases -- MongoDB, Redis and Basho Riak –  http://blog.monitis.com/index.php/2011/06/06/a-lookat-some-nosql-databases-mongodb-redis-and-bashoriak/ •  Picking the Right NoSQL Database, Part 4 -CouchDB and Membase –  http://blog.monitis.com/index.php/2011/06/17/pickingthe-right-nosql-database-part-4-couchdb-andmembase/
  190. 190. Short product overviews •  Cassandra vs MongoDB vs CouchDB vs Redis vs Riak vs HBase vs Couchbase vs Neo4j vs Hypertable vs ElasticSearch vs Accumulo vs VoltDB vs Scalaris comparison –  http://kkovacs.eu/cassandra-vs-mongodb-vscouchdb-vs-redis/ •  vsChart.com –  http://vschart.com/list/database/
  191. 191. Case studies ... •  Real World NoSQL: HBase at Trend Micro –  http://gigaom.com/cloud/real-world-nosql-hbase-attrend-micro/ •  Real World NoSQL: MongoDB at Shutterfly –  http://gigaom.com/cloud/real-world-nosql-mongodbat-shutterfly/ •  Real World NoSQL: Cassandra at Openwave –  http://gigaom.com/cloud/realworld-nosql-cassandraat-openwave/
  192. 192. Case studies •  Real World NoSQL: Amazon SimpleDB at Netflix –  http://gigaom.com/cloud/real-world-nosql-amazonsimpledb-at-netflix/ •  Real World NoSQL: Membase at Tribal Crossing –  http://gigaom.com/cloud/real-world-nosql-membaseat-tribal-crossing/ •  How Disney built a big data platform on a startup budget –  http://gigaom.com/data/how-disney-built-a-big-dataplatform-on-a-startup-budget/
  193. 193. Negative NoSQL comments ... •  Scaling with MongoDB –  http://opensourcebridge.org/wiki/2011/ Scaling_with_MongoDB –  https://speakerdeck.com/robotadam/postgres-aturban-airship/ •  A Year with MongoDB –  http://blog.engineering.kiip.me/post/20988881092/ayear-with-mongodb/ –  https://speakerdeck.com/mitsuhiko/a-year-ofmongodb/
  194. 194. Negative NoSQL comments ... •  Why MongoDB Never Worked Out at Etsy –  http://mcfunley.com/why-mongodb-never-worked-outat-etsy/ •  Goodbye, CouchDB –  http://sauceio.com/index.php/2012/05/goodbyecouchdb/ •  Don’t use NoSQL –  https://speakerdeck.com/roidrage/dont-use-nosql/ –  http://vimeo.com/49713827/
  195. 195. Negative NoSQL comments ... •  MongoDB is to NoSQL like MySQL to SQL -- in the most harmful way –  http://use-the-index-luke.com/blog/2013-10/mysql-isto-sql-like-mongodb-to-nosql •  The Genius and Folly of MongoDB –  http://nyeggen.com/blog/2013/10/18/the-genius-andfolly-of-mongodb/
  196. 196. Negative NoSQL comments ... •  Do Developers Use NoSQL Because They're Too Lazy to Use RDBMS Correctly? –  http://architects.dzone.com/articles/do-developersuse-nosql/ –  http://gaiustech.wordpress.com/2013/04/13/mongodbdays/ •  The parallels between NoSQL and self-inflicted torture –  http://www.parelastic.com/blog/parallels-betweennosql-and-self-inflicted-torture/
  197. 197. Negative NoSQL comments •  7 hard truths about the NoSQL revolution –  http://www.infoworld.com/d/data-management/7-hardtruths-about-the-nosql-revolution-197493 •  Google goes back to the future with SQL F1 database –  http://www.theregister.co.uk/2013/08/30/ google_f1_deepdive/
  198. 198. Security ... •  NoSQL, no security? –  http://www.slideshare.net/wurbanski/nosql-nosecurity/ •  NoSQL, No Injection!? –  http://www.slideshare.net/wayne_armorize/nosql-nosql-injections-4880169/ •  Attacking MongoDB –  http://www.slideshare.net/cyber-punk/mongo-db-eng/ •  NoSQL, But Even Less Security –  http://blogs.adobe.com/asset/files/2011/04/NoSQLBut-Even-Less-Security.pdf
  199. 199. Security •  NoSQL Database Security –  http://conference.auscert.org.au/conf2011/ presentations/Louis Nyffenegger V1.pdf •  Does NoSQL Mean No Security? –  http://www.darkreading.com/database-security/ 167901020/security/news/232400214/does-nosqlmean-no-security.html •  A Response To NoSQL Security Concerns –  http://www.darkreading.com/blog/232600288/aresponse-to-nosql-security-concerns.html
  200. 200. Polyglot persistence ... •  Polyglot Persistence –  http://www.slideshare.net/jwoodslideshare/polyglotpersistence-two-great-tastes-that-taste-greattogether-4625004/ •  HBase at Mendeley –  http://www.slideshare.net/danharvey/hbase-atmendeley/ •  Polyglot Persistence Patterns –  http://abhishek-tiwari.com/post/polyglot-persistencepatterns/
  201. 201. Polyglot persistence •  Polyglot Persistence: EclipseLink with MongoDB and Derby –  http://java.dzone.com/articles/polyglot-persistence-0/ •  D. Ghosh (2010) Multiparadigm data storage for enterprise applications. IEEE Software. Vol. 27, No. 5, pp. 57-60
  202. 202. Performance benchmarks ... •  Yahoo Cloud Serving Benchmark –  http://research.yahoo.com/node/3202/ –  http://altoros.com/nosql-research –  http://www.slideshare.net/tazija/evaluating-nosqlperformance-time-for-benchmarking/ •  Benchmarking Couchbase Server –  http://www.slideshare.net/Couchbase/t1-s4couchbase-performancebenchmarkingv34/
  203. 203. Performance benchmarks ... •  Ultra-High Performance NoSQL Benchmarking –  http://thumbtack.net/solutions/ ThumbtackWhitePaper.html •  Benchmarking Top NoSQL Databases –  http://www.datastax.com/resources/whitepapers/ benchmarking-top-nosql-databases
  204. 204. Performance benchmarks ... •  MongoDB Performance Pitfalls -- Behind The Scenes –  http://blog.trackerbird.com/content/mongodbperformance-pitfalls-behind-the-scenes/ •  MySQL vs. MongoDB Disk Space Usage –  http://blog.trackerbird.com/content/mysql-vsmongodb-disk-space-usage/ •  MongoDB: Scaling write performance –  http://www.slideshare.net/daumdna/mongodb-scalingwrite-performance/
  205. 205. Performance benchmarks ... •  Can the Elephants Handle the NoSQL Onslaught? –  http://vldb.org/pvldb/vol5/ p1712_avriliafloratou_vldb2012.pdf •  Solving Big Data Challenges for Enterprise Application Performance Management –  http://vldb.org/pvldb/vol5/ p1724_tilmannrabl_vldb2012.pdf •  NoSQL RDF –  http://ribs.csres.utexas.edu/nosqlrdf/index.php
  206. 206. Performance benchmarks •  Benchmarking Graph Databases –  http://istc-bigdata.org/index.php/benchmarking-graphdatabases/ •  Benchmarking Graph Databases -- Updates –  http://istc-bigdata.org/index.php/benchmarking-graphdatabases-updates/ •  Linked Data Benchmark Council –  http://ldbc.eu/
  207. 207. Stress testing •  Jepsen –  http://www.aphyr.com/tags/jepsen •  Jepsen: Testing the Partition Tolerance of PostgreSQL, Redis, MongoDB and Riak –  http://www.infoq.com/articles/jepsen/ •  The Man Who Tortures Databases –  http://www.informationweek.com/software/ information-management/the-man-who-torturesdatabases/240160850/
  208. 208. BI/Analytics •  BI/Analytics on NoSQL: Review of Architectures Part 1 –  http://www.dataversity.net/bianalytics-on-nosqlreview-of-architectures-part-1/ •  BI/Analytics on NoSQL: Review of Architectures Part 2 –  http://www.dataversity.net/bianalytics-on-nosqlreview-of-architectures-part-2/
  209. 209. Various graphics ... •  NoSQL LinkedIn Skills Index -- September 2013 –  http://blogs.the451group.com/ information_management/2013/10/01/nosql-linkedinskills-index-september-2013/ •  Updated Database Landscape map -- June 2013 –  http://blogs.the451group.com/ information_management/2013/06/10/updateddatabase-landscape-map-june-2013/
  210. 210. Various graphics ... •  Necessity is the mother of NoSQL –  http://blogs.the451group.com/ information_management/2011/04/20/necessity-isthe-mother-of-nosql/ •  NoSQL, Heroku, and You –  https://blog.heroku.com/archives/2010/7/20/nosql/
  211. 211. Various graphics •  The NoSQL vs. SQL hoopla, another turn of the screw! –  http://www.parelastic.com/blog/nosql-vs-sql-hooplaanother-turn-screw/ •  Navigating the Database Universe –  http://www.slideshare.net/lisapaglia/navigating-thedatabase-universe/
  212. 212. Discussion fora •  LinkedIn NoSQL –  http://www.linkedin.com/groups?gid=2085042 •  LinkedIn NewSQL –  http://www.linkedin.com/groups/NewSQL-4135938 •  Google groups –  http://groups.google.com/group/nosql-discussion •  Quora –  https://www.quora.com/NoSQL/
  213. 213. NoSQL jokes/humour ... •  LinkedIn discussion thread –  http://www.linkedin.com/groups/NoSQL-JokesHumour-2085042.S.177321213 •  NoSQL Better Than MySQL? –  http://www.youtube.com/watch?v=QU34ZVD2ylY –  Shorter version of “Episode 1 - MongoDB is Web Scale” •  say No! No! and No! (=NoSQL Parody) –  http://www.youtube.com/watch?v=fXc-QDJBXpw
  214. 214. NoSQL jokes/humour •  When someone brags about scaling MongoDB to a whopping 100GB –  http://dbareactions.tumblr.com/post/62989609976/ when-someone-brags-about-scaling-mongodb-to-a •  C.R.U.D. –  http://crudcomic.tumblr.com/ •  Twitter –  @mongodbfacts –  @BigDataBorat
  215. 215. Miscellaneous ... •  PowerPoint template –  http://www.articulate.com/rapid-elearning/heres-afree-powerpoint-template-how-i-made-it/ •  Autostereogram –  http://www.all-freeware.com/images/full/46590free_stereogram_screensaver_audio___multimedia_o ther.jpeg •  Theatre Curtain Animations –  http://www.slideshare.net/chinateacher1/theatercurtain-animations/
  216. 216. Miscellaneous ... •  Bar and Column charts –  http://www.diychart.com/ •  Newspaper headlines –  http://www.imagechef.com/ic/make.jsp? tid=Newspaper+Headline •  Pie charts –  http://www.onlinecharttool.com/
  217. 217. Miscellaneous •  Icons and images –  http://www.geekpedia.com/icons.php –  http://cemagraphics.deviantart.com/ –  http://www.freestockphotos.biz/ –  http://www.graphicsfuel.com/2011/09/commentsspeech-bubble-icon-psd/ –  http://icondock.com/
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×