edo
cabinet
http://tinyurl.com/edocabinet
Sunday, July 19, 2009

ruby and
tokyo cabinet
http://www.flickr.com/photos/kiim/3185168797/
Sunday, July 19, 2009

jmettraux
swiss guy
wants to write less code
ends up writing too much
http://github.com/jmettraux/
Sunday, July 19, 2009

why rufus-tokyo ?
need to persist data quickly
Sunday, July 19, 2009

Tokyo Cabinet|Tyrant
key/value store
persistent
fast, fast, fast
http://tokyocabinet.sourceforge.net/
Sunday, July 19, 2009

Hirabyashi-san is providing
ruby bindings
but no “sudo gem install”
and it’s ‘extconf’
and ...
http://tokyocabinet.sourceforge.net/rubydoc/
Sunday, July 19, 2009

Sunday, July 19, 2009

what I want
{}
Sunday, July 19, 2009

Sunday, July 19, 2009

what I want
what I built
Sunday, July 19, 2009

rufus-tokyo
ruby gem
Tokyo Cabinet
Tokyo Tyrant
ruby FFI
Sunday, July 19, 2009

http://blog.headius.com/2008/10/ffi-for-ruby-now-available.html
Sunday, July 19, 2009

ruby FFI
Sunday, July 19, 2009

FFI
Foreign Function Interface
common lisp
haskell
Sunday, July 19, 2009

ruby FFI
from Rubinius
thanks to Wayne Meissner
to jruby and ruby
http://wmeissner.blogspot.com/2008/11/more-on-ruby-ffi.html
Sunday, July 19, 2009

ruby FFI
an example
the ‘crypt’ function
Sunday, July 19, 2009

Sunday, July 19, 2009

http://files.getdropbox.com/u/76595/rk_crypt.rb
Sunday, July 19, 2009

ruby FFI
an example
‘uuid_generate’
Sunday, July 19, 2009

http://files.getdropbox.com/u/76595/rk_uuid.rb
Sunday, July 19, 2009

ruby FFI flow
1) attach functions
2) call functions
Sunday, July 19, 2009

ruby FFI
an example
libevent
Sunday, July 19, 2009

http://files.getdropbox.com/u/76595/rk_libev.rb
Sunday, July 19, 2009

http://files.getdropbox.com/u/76595/rk_libev.rb
Sunday, July 19, 2009

Sunday, July 19, 2009

ruby FFI
more fun
from ruby to lua
Sunday, July 19, 2009

http://jmettraux.wordpress.com/2009/03/16/ruby-to-lua/
Sunday, July 19, 2009

http://github.com/remogatto/ffi-inliner/
Sunday, July 19, 2009

Sunday, July 19, 2009

Tokyo Cabinet|Tyrant
Sunday, July 19, 2009

Mikio Hirabayashi is the
author
mixi.jp is the source
http://tokyocabinet.sourceforge.net/index.html
Sunday, July 19, 2009

http://alpha.mixi.co.jp/blog/?author=3
Sunday, July 19, 2009

http://www.slideshare.net/estraier/introduction-to-tokyo-products
Sunday, July 19, 2009

Sunday, July 19, 2009

rufus-tokyo
Sunday, July 19, 2009

2 products
Tokyo Cabinet
local file
Tokyo Tyrant
remote cabinet file
over TCP socket
(or Unix socket)
Sunday, July 19, 2009

local cabinet lib
Sunday, July 19, 2009

remote tyrant server
cabinet lib
Sunday, July 19, 2009

tt
memcached tyrant server
http
cabinet lib
Sunday, July 19, 2009

2 flavours
- key/value (abstract)
- key/hash of values (table)
Sunday, July 19, 2009

{ k => v } { k => { k => v } }
hash
B+ tree table
fixed length
Sunday, July 19, 2009

{ k => v } { k => { k => v } }
abstract table
Sunday, July 19, 2009

key/value
like { }
Sunday, July 19, 2009

Sunday, July 19, 2009

key/hash of values (table)
like a { pk => { } }
Sunday, July 19, 2009

Sunday, July 19, 2009

Sunday, July 19, 2009

local remote
Rufus::Tokyo:: Rufus::Tokyo:: Rufus::Tokyo:: Rufus::Tokyo::
Cabinet Table Tyrant TyrantTable
{} { pk => { } } {} { pk => { } }
1+ accesses
1 access
lua embedded
Sunday, July 19, 2009

tt-src $ .configure --enable-lua
tt-src $ make
tt-src $ sudo make install
http://openwferu.rubyforge.org/tokyo.html
Sunday, July 19, 2009

http://jmettraux.wordpress.com/2009/04/07/rufus-tokyo-0112-extlua/
Sunday, July 19, 2009

http://www.igvita.com/2009/07/13/extending-tokyo-cabinet-db-with-lua/
Sunday, July 19, 2009

Sunday, July 19, 2009

Rufus::Edo
Sunday, July 19, 2009

FFI
+ ruby, jruby
+ no compilation when ‘gem install’
- slower than classical c extension
=> Rufus::Edo
Sunday, July 19, 2009

Sunday, July 19, 2009

local remote
Rufus::Tokyo::
FFI Cabinet Table Tyrant TyrantTable
Rufus::Edo::
c ext Cabinet Table ? ?
pure ruby NetTyrant NetTyrantTable
Sunday, July 19, 2009

ruby to tyrant, the fastest
http://github.com/actsasflinn/
ruby-tokyotyrant/
ruby c extension for Tyrant
rufus-tokyo friendly
Sunday, July 19, 2009

projects using rufus-tokyo
(github search)
- wycats/moneta
- jcrosby/cloudkit
- elisehuard/tokyo_cabinet4r
- terralien/metry
- nofxx/tokyo_store
- sethyates/content_manager
- heycarsten/gcoder
- joshbuddy/tokyo_cache_cow
- ...
Sunday, July 19, 2009

many thanks to
Mikio Hirabayashi
Zev Blut
Ilya Grigorik
Justin Reagor
Flinn Muller
Wayne E. Seguin
Matthew King
Yuki Satow
Wayne Meissner
Kim Erlandsen (picture)
and many others
Sunday, July 19, 2009