The State of NoSQL

The State of NoSQL bensco'ield – viget labs developer day durham 27 february 2010

Motivations

Performance Scalability

Flexibility Complexity Functionality

“Comics” Is Hard

Charlie Chaplin Jet Li Hank Mann Marian Collier

Taxonomy

Key-‐Value Stores

distributed hash tables

Performance high Scalability high Flexibility high Complexity none Functionality variable (none)

Dynamo GT.M PStore Redis

Column-‐Oriented Stores

semi-‐structured

Performance high Scalability high Flexibility moderate Complexity low Functionality minimal

BigTable Cassandra HBase

Document-‐Oriented Stores

also semi-‐structured

Performance high Scalability variable (high) Flexibility high Complexity low Functionality variable (low)

CouchDB MongoDB RDDB Riak

Graph Databases

graph theory

Performance variable Scalability variable Flexibility high Complexity high Functionality graph theory

ActiveRDF AllegroGraph Neo4J

Relational Databases

Performance variable Scalability variable Flexibility low Complexity moderate Functionality relational algebra

Examples

Data Types strings lists sets sorted sets

In-‐Memory semi-‐persistent / fully persistent master-‐slave replication memory-‐bound

require 'redis' gl = Redis.new # A string gl['name'] = 'Kyle Rayner' gl['name'] gl.delete('name') # A list gl.push_tail 'to-dos', 'Lose Ion power' gl.push_tail 'to-dos', 'Mourn dead loved ones' gl.push_tail 'to-dos', 'Blow up zombie lanterns' gl.list_range('to-dos', 0, -1)

Tokyo Cabinet

Data Types binary data strings

Tables!?

Related Projects tyrant dystopia promenade

require 'rufus/tokyo' # Key-value jli = Rufus::Tokyo::Cabinet.new('jl.tch') jli['members'] = [ 'Batman', 'Black Canary', 'Blue Beetle', 'Captain Marvel', 'Doctor Light', 'Doctor Fate', 'Guy Gardner', 'Martian Manhunter', 'Mister Miracle' ].to_yaml YAML.load(jli['members'])

require 'rufus/tokyo' # Table big7 = Rufus::Tokyo::Table.new('big7.tct') big7['s'] = {'name' => 'Superman', 'role' => 'deus ex machina'} big7['b'] = {'name' => 'Batman', 'role' => 'mastermind'} big7['gl'] = {'name' => 'Green Lantern', 'role' => 'space cop'} big7['f'] = {'name' => 'Flash', 'role' => 'speedster'} big7['mm'] = {'name' => 'Martian Manhunter', 'role' => '?'} big7['ww'] = {'name' => 'Wonder Woman', 'role' => 'hitter'} big7['a'] = {'name' => 'Aquaman', 'role' => 'fish-talking'} big7.query {|q| q.add_condition 'role', :streq, 'fish-talking' }

Cassandra

Genealogy Dynamo BigTable

Column-‐Oriented columns supercolumns column families

Distributed automatic replication eventual consistency easy expansion

Availability weak reads/writes quorum reads/writes

require 'cassandra' op = Cassandra.new('OnePiece') op.insert(:People, '1', {'name' => 'Luffy'}) op.insert(:People, '2', {'name' => 'Crocodile'}) op.insert(:People, '3', {'name' => 'Mr. 3'}) op.insert(:Fights, '1', {'opponents' => {UUID.new => '2'}}) op.insert(:Fights, '1', {'opponents' => {UUID.new => '3'}}) luffy_fights = op.get(:Fights, '1', 'opponents') luffy_fights.map {|t, opp| op.get(:People, opp, 'name')}

CouchDB

Web-‐Inspired JSON storage HTTP / RESTful interface

Views predeWined, updated incrementally javascript for map/reduce

Updates full, including embedded documents

require 'couchrest' konoha = CouchRest.database!('http://127.0.0.1:5984/konoha') naruto = konoha.save_doc { 'name' => 'Naruto Uzumaki', 'chakra' => 'wind' } shikamaru = konoha.save_doc { 'name' => 'Shikamaru Nara', 'chunin' => true } konoha.save_doc { '_id' => '_design/first', :views => { :chunin => { :map => 'function(doc){if(doc.chunin){emit(null, doc);}}' } } } puts konoha.views('first/chunin')['rows'].inspect

MongoDB

Storage binary JSON documents http://bsonspec.org

Access native clients

Queries dynamic index-‐based

Updates allows partial updates

require 'mongo' avengers = Mongo::Connection.new.db('avengers') members = avengers.collection('members') members.insert {'name' => 'Ant-Man'} members.insert {'name' => 'Hulk'} members.insert {'name' => 'Iron Man'} members.insert {'name' => 'Thor'} members.insert {'name' => 'Wasp'} members.create_index('name') pym = members.find {'name' => 'Ant-Man'} pym['name'] = 'Giant-Man' pym.save members.remove {'name' => 'Hulk'} members.insert {'name' => 'Captain America'}

Ask Sean

also Web-‐Inspired JSON storage HTTP / RESTful interface links for relationships

Decentralized no privileged nodes

ConWigurable store / read / write

require 'jiak' jc = JiakClient.new('127.0.0.1', 8098) jc.set_bucket_schema('supervillains', { 'allowed_fields' => ['name', 'alias', 'power'] }) jc.store({ 'bucket' => 'supervillains', 'key' => 'Normie', 'object' => { 'name' => 'Norman Osborn', 'alias' => 'Green Goblin', 'power' => 'Supreme jerkfacedness' }, 'links' => [] }) kth = jc.fetch('supervillains', 'Normie')

Structure nodes and edges key-‐value pairs

Queries lucene gremlin

require 'neo4j' class Person include Neo4j::NodeMixin property :name, :mutant index :name, :mutant has_n :crushes has_n :hookups has_n :marriages def initialize(name, mutant = true) name = name mutant = mutant end end

Neo4j::Transaction.run do magneto = Person.new('Magneto') esme = Person.new('Esme') rogue = Person.new('Rogue') magda = Person.new('Magda', false) wasp = Person.new('Wasp', false) magneto.crushes << wasp magneto.hookups << rogue magneto.marriages << magda esme.crushes << magneto rogue.hookups << magneto magda.marriages << magneto end

magneto = Person.find(:name => 'Magneto') # Who likes Magneto? magneto.relationships.incoming(:crushes).nodes # Which non-mutants has Magneto dated? magneto.hookups{ !mutant? }.to_a

Simulations

Structure

people { ‘name’:‘Jimmy Olsen’ ‘title’:‘Superman’s Pal’ ‘company_id’:12441 } companies { _id:12441 ‘name’:‘Daily Planet’ }

Lack of Structure

mysql> SELECT * FROM people LIMIT 1 G *************************** 1. row *************************** id: 1 content: --- company: Daily Planet name: Jimmy Olsen title: Superman’s Pal

But wait! friendfeed friendly

Not Only SQL

Polyglot Persistence

Caching

Already in Use memcached

Queues

Long-‐running processes resque

Logging

Rails Log Replacement http://github.com/peburrows/mongo_db_logger

Hybrid Domains

different domains

Publishing e-‐commerce documents

Dating e-‐commerce social graph

different scales

Photo Sharing user accounts uploaded photos

Next Steps

Explore

Database List http://internetmindmap.com/database_software NoSQL Google Group http://groups.google.com/group/nosql-‐discussion

Ignore the Database

Logical Modeling First be mindful

Change the Default

Application Templates start with something new

benscoWield @bscoWield ben.scoWield@viget.com http:/ /spkr8.com/bscoWield http:/ /viget.com/extend http: /benscoWield.com /

http://www.slideshare.net	29
http://coderwall.com	25
http://speakerrate.com	24
http://www.linkedin.com	3
http://localhost:3000	1

The State of NoSQL

by Ben Scofield

Accessibility

Categories

Upload Details

Usage Rights

5 Embeds 82

Statistics

The State of NoSQL Presentation Transcript