Developers summit cassandraで見るNoSQL

Cassandra NoSQL 17-E-5 2011/02/17 @ryu_kobayashi

•• ✴ ...• ... Hadoop• http://beter-max.blogspot.com( ...)• Twitter @ryu_kobayashi• ✴ Cassndra GUI ‣ http://code.google.com/p/cassandra-gui/ ✴ Amazon Elastic MapReduce 6

Cassndra The Deﬁnitive Guide• 0.7•• ...

No! SQL!(SQL )

NoSQL =Not Only SQL

1998 Carlo Stozzi2009 Eric Evans Cassnadra ACIDML SQLNoSQL = Not Only SQL

17-C-1Bit Data

KVS NoSQL

KVS =Key Value Store

KVS ... DB(Cassandra) ... = =Excel

Cassandra GUI RDBMS DBRDBMS

Cassandra ... = =

NoSQLCassandra(Facebook) HBase(Yahoo!)BigTable(Google) Dynamo(Amazon)SimpleDB(Amazon) Windows Azure Table(Microsoft)Roma( ) Flare(gree)Tokyo Tyrant(mixi) Kyoto CabinetMongoDB Kumofs ...

NoSQLhttp://nosql-database.org

RDBMS NoSQL•RDBMS•NoSQL•RDBMS SQL•NoSQL API SQL•

NoSQL•

NoSQL••

NoSQL•• ★Web 2.0 ✴AJAX ✴FLASH ✴ ✴etc...

NoSQL ...

NoSQL ...NoSQL DDL

Cassandra

Cassandra Cassandra =Bigtable + Dynamo

CassandraFacebook NoSQL DB 0.7.2 0.6.x 0.6.11

CassandraFacebook NoSQL DB 0.7.2 0.6.x 0.6.11 • Facebook

CassandraFacebook NoSQL DB 0.7.2 0.6.x 0.6.11 • Facebook HBase

CassandraFacebook NoSQL DB 0.7.2 0.6.x 0.6.11 • Facebook HBase • Twitter

CassandraFacebook NoSQL DB 0.7.2 0.6.x 0.6.11 • Facebook HBase • Twitter •

CassandraFacebook NoSQL DB 0.7.2 0.6.x 0.6.11 • Facebook HBase • Twitter • •

Cassandra0.6 0.70.7 0.8

CassandraUse Case Twitter Cassandra Cassandra

Cassandra•••• SPOF• Thrift Java C++• APP• 0.7 I/O Hadoop MapReduce

Cassandra 2 1 3 4

CassandraRandom Partitioner MD5Ordering Preserved PartitionerCollating Order-Preserving PartitionerByte-Order Partitioner 0.7

Cassandra 2 1 3 4

Cassandra 2 1 3Consistency Level 4

Cassandra 2 1 3Consistency Level 4 Consistency Level APP •ONE 1 OK •ALL OK •QUORUM (N/2 + 1) OK

Cassandra 2 1 3 4 SPOF

Cassandra 2 1 3 Consistency Level 4

Cassandra 2 1 3 4 DC

Cassandra Consistency Level•ONE•QUORUM ✴ ✴ Consistency Level ✴ ✴ Read Repair ✴ Read Repair ★Cassandra

CassandraGossip Protocol••••••• Consistency Level

Cassandra Cassandra•Bloom Filter•Commit Log•Memtable•SSTable•Compaction ✴Major Compaction ✴Minor Compaction•etc...

Hadoop MapReduce !!

Hadoop MR + Cassandra

Hadoop MR + Cassandra =

Hadoop MR + Cassandra = Hassandra!!

Cassandra TwitterOSS 0.7 0.8 Distributed Counters trunk 0.8

NoSQL RDBMSCassandra

RDBMS NoSQL

PARTAKE

PARTAKE !?

ACID RDBMScommit rollback MVCC

API Cassandra ThriftAmazon SimpleDB Google Bigtable(GQL) SQLSQL

CassandraCassandra 0.7Distributed counters select count(*) from counter

RDBMSJava Hibernate O/R KVS Cassandra DB

joinRDBMS join Java Hibernate KVS Cassandra

joinRDBMS join Java Hibernate KVS Cassandra RDBMSNoSQL RDBMS

RDBMSNoSQL

1 PV ...

RDBMSCassandra

Cassandra Join

m(_ _)m

Facebook MySQLCassandra

CassandraHBase (-_- ) Cassandra

1 NoSQL

•NoSQL RDBMS

•NoSQL RDBMS•

•NoSQL RDBMS••

•NoSQL RDBMS•••

17-E-5 2011/02/17 @ryu_kobayashi

http://beter-max.blogspot.com	414
http://mistymagich.wordpress.com	240
http://d.hatena.ne.jp	156
http://devsummary.miukoba.net	50
http://beter-max.blogspot.jp	49
http://webcache.googleusercontent.com	21
http://ura-58-58.blogspot.com	16
url_unknown	4

Developers summit cassandraで見るNoSQL

by Ryu Kobayashi

Accessibility

Categories

Upload Details

Usage Rights

8 Embeds 950

Statistics

Developers summit cassandraで見るNoSQL Presentation Transcript