PLAYING NICE WITH OTHERS
Jeremy Hinegardner / jeremy@hinegardner.org / @copiousfreetime

COLLECTIVE INTELLECT

Ruby (30+ gems, 20+ rails apps)
COLLECTIVE INTELLECT
Java(7) C++(1)
C (2) Groovy(1)

SURVEY SAYS?

COMMONALITIES

DATA STRUCTURES

Array Struct
List
Set Stack
DATA STRUCTURES
Hash String
Number Queue

COMMUNICATION

Network based
COMMUNICATION

Network based
COMMUNICATION
Library, API, IPC based

PERSISTENCE

None
PERSISTENCE

None
PERSISTENCE
Snapshot

None
PERSISTENCE
Snapshot Lifetime

NAME THAT TOOL!
(HAVE YOU BEEN PAYING ATTENTION?)

Network Communication

Network Communication
+ No Persistence

Network Communication
+ No Persistence
+ Hash data structure

Network Communication
+ No Persistence
+ Hash data structure
memcached

Network Communication

Network Communication
+ Lifetime persistence

Network Communication
+ Lifetime persistence
+ Struct data structure

Network Communication
+ Lifetime persistence
+ Struct data structure
Postgresql

Network Communication
+ Lifetime persistence
+ Struct data structure
Postgresql
Mysql

Network Communication
+ Lifetime persistence
+ Struct data structure
Postgresql
Mysql
DB2

Network Communication
+ Lifetime persistence
+ Struct data structure
Postgresql
Mysql
DB2
Oracle

Network Communication
+ Lifetime persistence
+ Struct data structure
Postgresql
Mysql
DB2
Oracle
Insert favorite RDBMS (server)

Data Structure
(wide selection)

Data Structure
(wide selection)
Communication
(Network, Local)

Data Structure
(wide selection)
Communication
(Network, Local)
Persistence
(none, snapshot, lifetime)

Data Structure
(wide selection)
Communication
(Network, Local)
Persistence
(none, snapshot, lifetime)
Supported Languages
( at least 3 )

TOKYO PRODUCTS

Tokyo Cabinet
Homepage: http://tokyocabinet.sourceforge.net/
Data Structures : Array, Hash, Struct
Communication : Local
Persistence : Lifetime
API Languages : C, perl, ruby, java, lua, python

Tokyo Tyrant
Homepage: http://tokyocabinet.sourceforge.net/tyrantdoc/
Data Structures : Array, Hash, Struct
Communication : Network
Persistence : Lifetime
Client Lib Languages : C, perl, ruby, java, python, php, erlang

Tokyo Bonuses
Compression
Tyrant - Memcached protocol
Tyrant - RESTful API
Tyrant - Lua extensions
Tyrant - Replication

REDIS

Redis
Homepage : http://code.google.com/p/redis/
Data Structures : List, Hash, Set
Communication : Network
Persistence : Snapshot
Client Lib Languages : Ruby, Python, PHP, Erlang, Tcl, Perl,
Lua, Java

Redis Bonuses
Replication
Server-to-Server data movement
In-server Set operations
In-server Sorting
Asynchronous snapshots

LIBJLOG

libjlog
Homepage : https://labs.omniti.com/trac/jlog
Data Structure : Queue
Communication : Local
Persistence : Lifetime
API Languages : C, Perl, PHP, Ruby is on its way
Bonus : Publish/Subscribe behavior

BEANSTALKD

beanstalkd
Homepage : http://xph.us/software/beanstalkd/
Data Structure : Queue
Communication : Network
Persistence : None now, Snapshot in v1.4
Bonus : Job Queue behavior

ZEROMQ

0MQ
Homepage : http://www.zeromq.org/
Data Structure : Queue
Communication : Network
Persistence : Lifetime
API Languages : C, C++, Java, Python, .Net, Mono, Ruby,
Fortran, COBOL

0MQ Bonuses
Implement your own messaging models
Excellent examples
White papers for everything
Fastest. Messaging. Ever.

Local Communication
None Snapshot Lifetime
Array N/A ? N/A ? Tokyo Cabinet
Hash N/A ? N/A ? Tokyo Cabinet
List N/A ? N/A ? Tokyo Cabinet
Set N/A ? N/A ? Tokyo Cabinet
Struct N/A ? N/A ? Tokyo Cabinet
Queue N/A ? N/A ? TC / libjlog

Network Communication
None Snapshot Lifetime
Array Tokyo Tyrant
Hash TT/Memcache Redis Tokyo Tyrant
List Redis
Set Redis
Struct TT/RDBMS
Queue Beanstalk Beanstalk (1.4) 0MQ

Even More!
MongoDB couchdb
nmdb netcdf
luxIO solr
ehcache rabbitmq
flare ejabberd
cassandra Your favorite?

DEMOS