Multi Data Center Strategies

Data CenterAwareness

@spf13 AKASteve Francia15+ years buildingthe internet Father, husband, skateboarderChief Solutions Architect @responsible for drivers,integrations, web & docs

IntroductionThe most importantfeature ever...When you need it

MultipleData CentersLet’s describe our scenario

We will BuildA Social Network

A Global Social NetworkFor simplicity.. let’s focus on 3 locations

ChallengesData ConsistencyMaintain good userexperienceScaling

Single Database location DB

Single Database location DB Fast Slo

Single Write location Write DB Read DB Read DB

We Need MoreData is localized (for themost part)Users interact local toregion (mostly)

GoalsRoute data locallyMinimize global failuresRemote data low latencyMinimize remote dataaccess

MongoDB

Local WriteWrite DB Read DB ReplicaDB Read Set

Local Write Write DB Read DB Read DB Replica Set

3 locations 3 Replica SetsWrite DB Write DB Write DB Read DB Read DB Read DB Read DB Read DB Read DBReplica Set Replica Set Replica Set

3 locations 3 Replica Sets Read DB Write DB Read DBWrite DB Read DB Read DB Replica Set Replica Set Replica Set Read DB Read DB Write DB

Local WritesLocal REads (w/delays) Write DB Write DB Read DB Read DB Read DB Read DB Write DB Read DB Read DB

Write Concern

Write Concern &If a write requires areturn tripWhat the return trip shoulddepend on

Write Concernw:the number of servers to replicate to.wtimeout:timeout in ms waiting for replication.j:wait for journal synctags:ensure replication to certain tagged nodes

Write ConcernMongo mongo = new Mongo( new MongoURI("mongodb://127.0.0.1:27017,127.0.0.1:27018"));mongo.setWriteConcern( new WriteConcern(2, 1000));

Write ConcernMongo mongo = new Mongo( new MongoURI("mongodb://127.0.0.1:27017,127.0.0.1:27018"));DBCollection users =mongo.getDB(“myapp”).getCollection(“users”);users.insert( new DBObject("name", "Kyle"), new WriteConcern(2, 1000))

GoalsRoute data locallyMinimize global failuresRemote data low latencyMinimize remote dataaccess

IssuesDoesn’t work withShardingCan’t control which nodeto read fromApp needs to be aware(at some level)

MongoDB

Upcoming FeaturesGeoAware ShardingRead Preferences

Geo-Aware shardingAdding second dimensionto shard keySecond range can beused for locality awaresharding

Read Preferences Read from: Primary Secondary Primary Only Secondary Only Nearestsecondary queryingrouted to speciﬁc tags

Scenarios

Scenarios1. Social Network2. Analysis3. Establishing Auth Key4. Administration

Social Network Write DB Write DB Read DBRead DB Read DBRead DB Write DB Read DB Read DB

Analysis Write DB Write DB Read DBRead DB Read DBRead DB Write DB Read DB Read DB

Analysis Write DB Write DB Read DBRead DB Read DBRead DB Write DB ReadPref : Read DB Read DB PrimaryOnly

Auth Keys Write DB Write DB Read DBRead DB Read DBRead DB Write DB Read DB Read DB

Auth Keys Write DB Write DB Read DBRead DB Read DBRead DB Write DB Read DB Read DB WriteConcern w : all

Administration Write DB Write DB Read DBRead DB Read DBRead DB Write DB Read DB Read DB

Administration Write DB Write DB Read DBRead DB Read DBRead DB Write DB ReadPref : Read DB Read DB PrimaryOnly

Administration Write DB Write DB Read DBRead DB Read DBRead DB Write DB ReadPref : Read DB Read DB PrimaryOnly WriteConcern w : all

ConclusionMongoDBOpen source enterprisefeatures for when youneed them

http://spf13.com http://github.com/s @spf13Questions? download at mongodb.org We’re hiring!! Contact us at jobs@10gen.com

http://architects.dzone.com	624
http://understeer.hatenablog.com	491
http://spf13.com	308
http://lanyrd.com	43
http://feeds.feedburner.com	35
http://www.tuicool.com	7
http://webcache.googleusercontent.com	6
http://localhost	3
https://si0.twimg.com	1
http://www.dzone.com	1
http://10.224.64.62	1
http://10.237.125.73	1

Multi Data Center Strategies

by Steve Francia on Jun 04, 2012

Accessibility

Categories

Upload Details

Usage Rights

12 Embeds 1,521

Statistics

Multi Data Center Strategies Presentation Transcript