SQL, NoSQL, NewSQL? What's a developer to do?

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

SQL, NoSQL, NewSQL?
What's a developer to do?

Chris Richardson

Author of POJOs in Action
Founder of CloudFoun...

Overall presentation goal

The joy and pain of
building Java
applications that use
NoSQL and NewSQL

2

About Chris

3

(About Chris)

4

About Chris()

5

About Chris

6

About Chris

http://www.theregister.co.uk/2009/08/19/springsource_cloud_foundry/

7

About Chris

Developer Advocate for
CloudFoundry.com

Signup at CloudFoundry.com
using promo code JFokus

...

Agenda
o  Why NoSQL? NewSQL?
o  Persisting entities
o  Implementing queries

2/14/12 Copyright (c) 2011 Chris...

Food to Go

o  Take-out food delivery
service
o  “Launched” in 2006
o  Used a relational
database (naturally)

...

Success è Growth challenges
o  Increasing traffic
o  Increasing data volume
o  Distribute across a few data centers
o...

Limitations of relational databases

o  Scaling
o  Distribution
o  Updating schema
o  O/R impedance mismatch
o  Handl...

Solution: Spend Money
o  Buy SSD and RAM
...

Solution: Use NoSQL
Benefits

Higher Limited
performance tran...

MongoDB
o  Document-oriented database
n  JSON-style documents: Lists, Maps, primitives
n  Schema-less
o  Transacti...

Apache Cassandra
o  Column-oriented database/Extensible row store
n  Think Row ~= java.util.SortedMap
o  Transacti...

Other NoSQL databases
Type Examples

Extensible columns/Column- Hbase
orien...

Solution: Use NewSQL
o  Relational databases with SQL and
ACID transactions
AND...

Stonebraker’s motivations

“…Current databases are designed for
1970s hardwa...

About VoltDB
o  Open-source
o  In-memory relational database
o  Durability thru replication; snapshots
and logging
...

The future is polyglot persistence

e.g. Net...

Spring Data is here to help

For

NoSQL databases

http://www.spr...

Agenda
o  Why NoSQL? NewSQL?
o  Persisting entities
o  Implementing queries

2/14/12 Copyright (c) 2011 Chri...

Food to Go – Place Order use case

1.  Customer enters delivery address and
delivery time
2.  System displays availabl...

Food to Go – Domain model (partial)

class Restaurant { class TimeRange {
long id; ...

Database schema
ID Name …
REST...

How to implement the repository?
public interface AvailableRestaurantRepository {

void add(Restaurant res...

MongoDB: persisting restaurants is easy
Server
...

Spring Data for Mongo code
@Repository
public class AvailableRestaurantRepositoryMongoDbImpl
implements Availabl...

Spring Configuration
@Configuration
public class MongoConfig extends AbstractDatabaseConfig {

@Value("#{mongoDbPropertie...

Cassandra data model
Column Column
Row Name Value
Key ...

Cassandra– inserting/updating data
Column Family

...

Cassandra– retrieving data
Column Family

K1 N1 V1 ...

Option #1: Use a column per attribute

Column Name = path/expression to access property value

...

Option #2: Use a single column
Column value = serialized object graph, e.g. JSON

...

Cassandra code
public class AvailableRestaurantRepositoryCassandraKeyImpl
implements AvailableRestaurantReposito...

Using VoltDB
o  Use the original schema
o  Standard SQL statements

BUT YOU MUST

o  Write stored p...

About VoltDB stored procedures
o  Key part of VoltDB
o  Replication = executing stored
procedure on replica
o  Logg...

About partitioning

Partition column

RESTAURANT table

ID ...

Example cluster

Partition 1a Partition 2a Partition 3a...

Single partition procedure: FAST
SELECT * FROM RESTAURANT WHERE ID = 1

High-performance lock free code

ID Nam...

Multi-partition procedure: SLOWER
SELECT * FROM RESTAURANT WHERE NAME = ‘Ajanta’

Communication/Co...

Chosen partitioning scheme

<partitions>
<partition table="restaurant" column="id"/>
<partition table="service_a...

Stored procedure – AddRestaurant
@ProcInfo( singlePartition = true, partitionInfo = "Restaurant.id: 0”)
public class AddRe...

VoltDb repository – add()
@Repository
public class AvailableRestaurantRepositoryVoltdbImpl
implements Available...

VoltDbTemplate wrapper class
public class VoltDbTemplate {

private Client client; VoltDB client API

public...

VoltDb server configuration
<?xml version="1.0"?> <deployment>
<project>
<info>
...

Agenda
o  Why NoSQL? NewSQL?
o  Persisting entities
o  Implementing queries

2/14/12 Copyright (c) 2011 Chris...

Finding available restaurants
Available restaurants =
Serve the zip code of the delivery address
AND
Are open ...

Finding available restaurants on Monday,
6.15pm for 94619 zip

select r.* Straightforward
from restaurant r ...

MongoDB = easy to query
{
serviceArea:"94619", Find a
openingHours: {
$elemMatch : { ...

MongoTemplate-based code
@Repository
public class AvailableRestaurantRepositoryMongoDbImpl
...

BUT how to do this with Cassandra??!
o  How can Cassandra support a query that has

?
n...

Simplification #1: Denormalization
Restaurant_id Day_of_week Open_time Close_time Zip_code

1 Monday...

Simplification #2: Application filtering

SELECT restaurant_id, open_time
FROM time_range_zip_code
WHERE day_of_week = ...

Simplification #3: Eliminate multiple =’s with
concatenation

Restaurant_id Zip_dow Open_time Close_time

...

Column family with composite column
names as an index
Restaurant_id Zip_dow Open_time ...

Querying with a slice
Column Family: AvailableRestaurants

...

Needs a few pages of code
private void insertAvailability(Restaurant restaurant) {
for (String zi...

What did I just do to query the data?

60

Mongo vs. Cassandra
DC1 DC2

Shard A...

VoltDB - attempt #1
@ProcInfo( singlePartition = false)
public class FindAvailableRestaurants extends VoltProcedure { ... ...

VoltDB - attempt #2
@ProcInfo( singlePartition = true, partitionInfo = "Restaurant.id: 0”)
public class AddRestaurant exte...

VoltDB - attempt #3
<partitions>
...
<partition table="available_time_range" column="zip_code"/>
</partitions>

@Pro...

Summary…
o  Relational databases are great BUT there
are limitations
o  Each NoSQL database solves some
problems...

… Summary
o  Very carefully pick the NewSQL/
NoSQL DB for your application
o  Consider a polyglot persistence
ar...

Thank you!

Signup at CloudFoundry.com
using promo code JFokus
My contact info:
chris.richard...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

SQL? NoSQL? NewSQL?!? What’s a Java... by Chris Richardson 1356 views
NewSQL vs NoSQL for New OLTP by DATAVERSITY 3291 views
NewSQL by hyeongchae lee 4323 views
Choosing a Next Gen Database: the N... by ScaleBase 9495 views
NewSQL Database Overview by Steve Min 4678 views
NewSQL overview, Feb 2015 by Ivan Glushkov 31954 views

View on Slideshare

1 of 67 Ad

View on Slideshare

1 of 67 Ad