Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Voldemortの紹介

392 views

Published on

「RDB技術者のためのNoSQLガイド」出版記念セミナー http://nosqlguid.connpass.com/event/27331/ LT発表資料

Published in: Data & Analytics
  • Be the first to comment

  • Be the first to like this

Voldemortの紹介

  1. 1. Voldemort @ HBase
  2. 2. • 
 IT • • LinkedIn Kafka Pinot • • Netflix github Web
  3. 3. Voldemort • P2P Key-Value Store • Inspired by Amazon Dynamo • (A) (P) / Cassandra • LinkedIn (OSS; Apache 2.0 license) • : Jive, Mendeley, eBay, Ameba,
  4. 4. Voldemort
  5. 5. Voldemort
  6. 6. Voldemort API • value = store.get(key) • store.put(key, value) • store.delete(key) Y^Y^Y^Y^Y Simple TCP Socket
 HTTP REST
  7. 7. Voldemort http://www.project-voldemort.com/voldemort/design.html • • • •
  8. 8. <key-serializer> <type>avro-generic-versioned</type> <schema-info version="0">{ "name": "key", "type": “record", 
 “fields": [{ "name": "user_id", "type": "int" }] }</schema-info> </key-serializer> <value-serializer> <type>avro-generic-versioned</type> <schema-info version="0"> { "name": "value", "type": "record", "fields": [{ "name": "user_id", "type": "int" }, { "name": "gender", "type": "string" }, { "name": "age", "type": "int", "optional": true }] put '{"user_id": "123"}' "{}" Unexpected error: org.apache.avro.AvroTypeException: Expected int. Got VALUE_STRING put '{"user_id": 123}' '{"gender":"man", "age": 20}' Unexpected error: org.apache.avro.AvroTypeException: Expected field name user_id got gender
  9. 9. : • • JSON ( ), , , Java , ProtocolBuffers, Thrift, AVRO, • • MySQL, Krati, BerkeleyDB, HDFS (Read-only), ( ; ),
  10. 10. : • Solving Big Data Challenges for Enterprise Application Performance Management, VLDB2012 R=READ95%, RW=50%, W=WRITE99% http://vldb.org/pvldb/vol5/p1724_tilmannrabl_vldb2012.pdf
  11. 11. • 6 NoSQL+RDB Read/Write
  12. 12. Voldemort • (Build-and-Push) • • Serving Large-scale Batch Computed Data with Project Voldemort, FAST2012 http://static.usenix.org/events/fast12/tech/ full_papers/Sumbaly.pdf
  13. 13. Voldemort • (Build-and-Push) • • Serving Large-scale Batch Computed Data with Project Voldemort, FAST2012 http://static.usenix.org/events/fast12/tech/ full_papers/Sumbaly.pdf
  14. 14. • Voldemort (≒ 1ms; HBase Cassandra ) • Cassandra • • • Sqoop (export) • HBase

×