Sharding with MongoDB (Eliot Horowitz)
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Sharding with MongoDB (Eliot Horowitz)

on

  • 24,146 views

 

Statistics

Views

Total Views
24,146
Views on SlideShare
15,939
Embed Views
8,207

Actions

Likes
40
Downloads
425
Comments
0

21 Embeds 8,207

http://doryokujin.hatenablog.jp 4459
http://d.hatena.ne.jp 2384
http://www.slideshare.net 572
http://rafinguer.blogspot.com 369
http://rafinguer.blogspot.com.es 88
http://www.10gen.com 86
http://rafinguer.blogspot.mx 73
http://www.nosqldatabases.com 60
http://webcache.googleusercontent.com 40
http://rafinguer.blogspot.com.ar 28
http://mongospanish.blogspot.com 14
http://lanyrd.com 13
http://www.mongodb.org 6
http://translate.googleusercontent.com 5
http://www.relitec.es 4
http://www.lmodules.com 1
http://localhost:3000 1
http://localhost:8080 1
http://rafinguer.blogspot.nl 1
http://rafinguer.blogspot.cz 1
http://rafinguer.blogspot.fr 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • <br />
  • <br />
  • sharding isn&#x2019;t new <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • osa thai - open bar, food <br />

Sharding with MongoDB (Eliot Horowitz) Presentation Transcript

  • 1. open-source, high-performance, document-oriented database
  • 2. Why Sharding • Vertical scaling is limited by physics and cost • Hard to scale vertically in the cloud • Can scale wider than higher
  • 3. What is Sharding • ad-hoc partitioning • consistent hashing (Dynamo) • range based partitioning (BigTable/PNUTS)
  • 4. Overview • Automatic partitioning and management • range based • Can convert from single master to sharded system with 0 downtime • Almost no functionality lost over single master • Fully consistent
  • 5. Range Based • collection is broken into chunks by range
  • 6. Auto-sharding Shards mongo mongo mongo .. Config mongo mongo mongo Servers mongod mongod mongod mongos mongos .. client
  • 7. Config Servers • 3 of them • changes are made with 2 phase commit • if any are down, meta data goes read only • system is online as long as 1/3 is up
  • 8. Shards • Can be master, master/slave or replica sets • Replica sets gives sharding + full auto- failover • Regular mongod processes
  • 9. mongos • Sharding Router • Acts just like a mongod to clients • Can have 1 or as many as you want • Can run on appserver so no extra network traffic
  • 10. Writes • Inserts : require shard key, routed • Removes: routed and/or scattered • Updates: routed or scattered
  • 11. Queries • By shard key: routed • sorted by shard key: routed in order • by non shard key: scatter gather • sorted by non shard key: distributed merge sort
  • 12. Operations • split: breaking a chunk into 2 • migrate: move a chunk from 1 shard to another
  • 13. Balancing • distributes chunks automatically • can look at: disk ops, cpu, data size
  • 14. Multi DataCenter • intelligent geo honing • auto failover
  • 15. Sharding Limitations • Unique indexes not based on shard key • current version limited to ~ 20 petabytes
  • 16. After Party! Download MongoDB http://www.mongodb.org and let us know what you think @eliothorowitz @mongodb