Mongo DBを半年運用してみた

MongoDB Masakazu Matsushita @matsukaz2011 7 28

• @matsukaz • • Ameba Pico • DevLOVE2011 7 28

2011 7 28

Ameba Pico • • 2010 32011 7 28

(2011 7 ) • 390 MAU 60 • 10 20 • 3:7 •2011 7 28

2011 7 28

• MongoDB • Ameba Pico • MongoDB2011 7 28

MongoDB2011 7 28

Document-oriented storage • • BSON (Binary JSON) > db.users.save( { name : "hoge", age : 20 } ) > db.users.save( { name : "fuga" } ) > db.users.ﬁnd() { "_id" : ObjectId("4d6b7ef5934c0000000053a4"), "name" : "hoge", "age" : 20 } { "_id" : ObjectId("4d6b7f06934c0000000053a5"), "name" : "fuga" }2011 7 28

Full Index Support • Index • Unique Index Index2011 7 28

Replication • ReplicaSet mongod Member 1 (PRIMARY) mongod mongod Member 2 Member 3 (SECONDARY) (SECONDARY)2011 7 28

Replication • ReplicaSet mongod Member 1 (DOWN) mongod mongod Member 2 Member 3 (PRIMARY) (SECONDARY)2011 7 28

Replication • ReplicaSet mongod Member 1 (RECOVERING) mongod mongod Member 2 Member 3 (PRIMARY) (SECONDARY)2011 7 28

Replication • ReplicaSet mongod Member 1 (SECONDARY) mongod mongod Member 2 Member 3 (PRIMARY) (SECONDARY)2011 7 28

Auto-Sharding • Shard Key Shard 1 users name1 name2 name3 name4 name5 name6 name7 name8 name9 items item1 item2 item32011 7 28

Auto-Sharding • Shard Key Shard 1 Shard 2 users name1 name2 name3 name4 name5 name6 name7 name8 name9 items item1 item2 item32011 7 28

Auto-Sharding • Shard Key Shard 1 Shard 2 users users name1 name2 name3 name7 name8 name9 name4 name5 name6 name7 name8 name9 items item1 item2 item3 Chunk (Shard Key Range)2011 7 28

Auto-Sharding • Shard Key Shard 1 Shard 2 users users name1 name2 name3 name7 name8 name9 name4 name5 name6 items mongos item1 item2 item3 client client mongos mongoc Shard2011 7 28

Ameba Pico2011 7 28

2011 1 Shard 1 mongoc mongos mongod mongod mongod Shard 2 Web Socket mongos mongoc mongod mongod mongod Shard 3 mongos mongoc mongod mongod mongod (memcached) LB ID/Point/ (HAProxy) MySQLEC2 m2.2xlarge (Mem 34.2GB / 13 EC2CU) c1.xlarge (Mem 7GB / 20 EC2CU) m1.large (Mem 7.5GB / 4 EC2CU) c1.medium (Mem 1.7GB / 5 EC2CU) m1.small (Mem 1.7GB / 1 EC2CU) EBS S3 CloudFront Elastic MapReduce2011 7 28

2011 3 Shard 1 mongoc mongos mongod mongod mongod Shard 2 Web Socket mongos mongoc mongod mongod mongod Shard 3 mongos mongoc mongod mongod mongod (memcached) Shard 4 mongos mongod mongod mongod LB ID/Point/ (HAProxy) MySQLEC2 m2.2xlarge (Mem 34.2GB / 13 EC2CU) c1.xlarge (Mem 7GB / 20 EC2CU) m1.large (Mem 7.5GB / 4 EC2CU) c1.medium (Mem 1.7GB / 5 EC2CU) m1.small (Mem 1.7GB / 1 EC2CU) EBS S3 CloudFront Elastic MapReduce2011 7 28

2011 5 Shard 1 mongoc mongos mongod mongod mongod Shard 2 Web Socket mongos mongoc mongod mongod mongod Shard 3 mongos mongoc mongod mongod mongod (memcached) Shard 4 mongos mongod mongod mongod LB ID/Point/ Shard 5 (HAProxy) MySQL mongod mongod mongodEC2 m2.2xlarge (Mem 34.2GB / 13 EC2CU) Shard 6 c1.xlarge (Mem 7GB / 20 EC2CU) m1.large (Mem 7.5GB / 4 EC2CU) mongod mongod mongod c1.medium (Mem 1.7GB / 5 EC2CU) m1.small (Mem 1.7GB / 1 EC2CU) EBS S3 CloudFront Elastic MapReduce2011 7 28

2011 7 Shard 1 mongoc mongod mongod mongod mongos mongos Shard 2 Web Socket mongoc mongod mongod mongod Shard 3 mongos mongoc mongod mongod mongod (memcached) Shard 4 mongod mongod mongod LB ID/Point/ Shard 5 (HAProxy) MySQL mongod mongod mongodEC2 m2.2xlarge (Mem 34.2GB / 13 EC2CU) Shard 6 c1.xlarge (Mem 7GB / 20 EC2CU) m1.large (Mem 7.5GB / 4 EC2CU) mongod mongod mongod c1.medium (Mem 1.7GB / 5 EC2CU) m1.small (Mem 1.7GB / 1 EC2CU) EBS S3 CloudFront Elastic MapReduce2011 7 28

MongoDB2011 7 28

2011 22011 7 28

2011 7 28

mongod Repair2011 7 28

2011 7 28

2011 32011 7 28

Shard2011 7 28

2011 7 28

http://www.ﬂickr.com/photos/andreasmarx/190619661/2011 7 28

62011 7 28

2011 52011 7 28

Shard 22011 7 28

OFF2011 7 28

MongoDB2011 7 28

2011 7 28

2 Shard2011 7 28

2011 7 28

2011 62011 7 28

mongos2011 7 28

2011 7 28

2011 72011 7 28

MongoDB 1.6.5 → 1.8.22011 7 28

2011 7 28

chunk chunk2011 7 28

http://www.ﬂickr.com/photos/madhorse5/415958992/2011 7 28

2011 7 28

4 Shard2011 7 28

2011 7 28

Shard 2 EC22011 7 28

30 Repair2011 7 28

2011 7 28

mongod 12011 7 28

2011 7 28

http://d.hatena.ne.jp	4389
http://ameblo.jp	3892
http://snip-snap.posterous.com	132
http://s.ameblo.jp	61
http://slide.localhost	49
http://webcache.googleusercontent.com	39
http://twitter.com	30
http://www.slideshare.net	18
http://blog.ameba.jp	18
https://twitter.com	17
http://storage.zetta.flab.fujitsu.co.jp	15
http://s.deeeki.com	9
http://translate.googleusercontent.com	8
http://www.twylah.com	6
http://feedblog.ameba.jp	5
http://b.hatena.ne.jp	4
http://tweetedtimes.com	2
http://cache.yahoofs.jp	2
http://tube.deldig.com	2
http://posterous.com	1
http://tr398.posterous.com	1

Mongo DBを半年運用してみた

by Masakazu Matsushita

Accessibility

Categories

Upload Details

Usage Rights

21 Embeds 8,700

Statistics