1.
3 Hadoop
Hadoop MR + Cassandra
2010/06/28
@ryu_kobayashi

2.
• Hadoop MapReduce
• Cassandra
• MapReduce + Cassandra
• Cassandra MapReduce
•

3.
•
•
• ...
• ...
• Twitter @ryu_kobayashi

4.
Hadoop MapReduce
Google MapReduce

5.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3

6.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3

7.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3
• Facebook

8.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3
• Facebook
• Twitter

9.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3
• Facebook
• Twitter
•

10.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3
• Facebook
• Twitter
•
•

11.
Cassandra
Facebook KVS NoSQL DB
0.6.2 0.6.3
• Facebook
• Twitter
•
•
@shot6

12.
Hadoop MR + Cassandra

13.
Hadoop MR + Cassandra

14.
Hadoop MR + Cassandra

15.
Hadoop MR + Cassandra
Cassandra Contributer

16.
Hadoop MR + Cassandra

17.
Hadoop MR + Cassandra

18.
Hadoop MR + Cassandra

19.
Hadoop MR + Cassandra
Hadoop Cassandra H

20.
H

21.
Hadoop MR + Cassandra

22.
Hadoop MR + Cassandra
• MR HDFS

23.
Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

24.
Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40
• Cassandra 0.6 Hadoop
(API )

25.
Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40
• Cassandra 0.6 Hadoop
(API )
• KVS HDFS
Hbase

26.
Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40
• Cassandra 0.6 Hadoop
(API )
• KVS HDFS
Hbase
•
Cassandra InputFormat
RDBS
AWS EMR(Elastic MapReduce + S3

27.
Hadoop MR + Cassandra

28.
Hadoop MR + Cassandra

29.
Hadoop MR + Cassandra

30.
Hadoop MR + Cassandra
Cassandra HDFS +TaskTracker
Cassandra

31.
Hadoop MR + Cassandra
Cassandra HDFS +TaskTracker
Cassandra
Contribute

32.
Cassandra MapReduce
• org.apache.cassandra.hadoop
• storage-conf.xml
# Thrift storage-conf.xml
• Jar Cassadra Thrift
classpath
• OutputFormat HDFS
(0.7 )
• 1000 Map
# FAQ Issue http://goo.gl/5Q3Z

33.
Cassandra MapReduce
github
http://bit.ly/9nwgSu

34.
Cassandra-GUI
http://code.google.com/p/cassandra-gui/