• Email
  • Like
  • Save
  • Private Content
  • Embed
 

1,000,000 daily users and no cache (Splash 2011)

by on Oct 25, 2011

  • 38,562 views

Online games pose a few interesting challenges on their backend: A single user generates one http call every few seconds and the balance between data read and write is close to 50/50 which makes the ...

Online games pose a few interesting challenges on their backend: A single user generates one http call every few seconds and the balance between data read and write is close to 50/50 which makes the use of a write through cache or other common scaling approaches less effective.

Starting from a rather classic Ruby on Rails application as the traffic grew we gradually changed it in order to meet the required performance. And when small changes no longer were enough we turned inside out parts of our data persistency layer migrating from SQL to NoSQL without taking downtimes longer than a few minutes.

Follow the problems we hit, how we diagnosed them, and how we got around limitations. See which tools we found useful and which other lessons we learned by running the system with a team of just two developers without a sysadmin or operation team as support.

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Adobe PDF

Usage Rights

© All Rights Reserved

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

Cancel

42 Embeds 7,303

http://www.netmagazine.com 3334
http://blog.nosqlfan.com 2071
http://mrjaba.posterous.com 298
http://www.developpez.net 205
http://www.worldit.info 192
http://a0.twimg.com 187
http://people.tivort.com 173
http://moin.neocoin.net 172
http://www.wooga.com 121
http://asyncionews.com 98
http://m.netmagazine.com 91
http://feed.feedsky.com 86
http://us-w1.rockmelt.com 56
http://www.kuqin.com 34
http://geekgabyte.com 20
http://xianguo.com 20
http://zhuaxia.com 19
https://twitter.com 17
http://paper.li 16
http://www.zhuaxia.com 10
http://reader.youdao.com 10
http://feeds.feedburner.com 8
http://blog.newitfarmer.com 7
http://profeo.pl 7
http://wiki.baby.com.cn 7
http://lanyrd.com 7
http://twitter.com 6
http://erlangmmo.blogspot.com 6
http://translate.googleusercontent.com 5
http://www.techgig.com 4
http://www.viewbix.com 2
http://socialmediawealth.net 2
http://reguemusik.wikispaces.com 2
http://webcache.googleusercontent.com 2
http://131.253.14.98 1
http://tweetedtimes.com 1
http://www.onlydoo.com 1
https://si0.twimg.com 1
http://local.techpostmedia.com 1
http://profeo.ac 1
http://t.qq.com 1
http://www.uplook.cn 1

More...

Statistics

Likes
120
Downloads
894
Comments
12
Embed Views
7,303
Views on SlideShare
31,259
Total Views
38,562

110 of 12 previous next Post a comment

  • wooga Wooga at Wooga At peak we do about 8,000 https requests that generate 100,000 DB operations per second (of which 50,000 are updates). Most http requests generate only 2-3 DB updates, but there are a few very complex requests that cause dozens of updates, hence the high ratio. 1 year ago
    Are you sure you want to
  • lipingtababa lipingtababa page 12 said you got 14 billion requests/month, wihch equals with 4,000 requests per second, while there are 5000 DB updates per second. It seems these two number do not fit with each other. 1 year ago
    Are you sure you want to
  • wooga Wooga at Wooga Re myst1313: We only serve the landing page using SSL (400 million hits per month). We just added another load balancer to handle the load. Our Flash client does not use SSL to call our API so we do not have a problem there. 1 year ago
    Are you sure you want to
  • wooga Wooga at Wooga Re Алик Нематов: Redis is a NoSQL solution that matches our requirements. For other projects we also use CouchDB and Riak. We have experimented with Cassandra, too. Nice product but Redis was better suited for this game. 1 year ago
    Are you sure you want to
  • myst1313 myst1313 Hi! Very nice. You never talk about https. Facebook impose to use ssl to access to apps since beginning of october and i think ssl impose big bottleneck as it takes a lot of time (at least the firsts requests) for ssl negotiations. How you handle this and how it impact the load ? Just curious to see your graphs after october. 1 year ago
    Are you sure you want to
  • eagle1maledetto Gianluca Zamagni I think it was Munin 1 year ago
    Are you sure you want to
  • ssuser1783f5 Алик Нематов, Server-Side Developer at PlayDemand Hey guys, did you ever consider NoSQL solutions, like Cassandra? 1 year ago
    Are you sure you want to
  • StevenBaker2 Steven Baker, Senior Application Developer at WorkCover Queensland Very nice, I love hearing about stories like these. 1 year ago
    Are you sure you want to
  • wooga Wooga at Wooga Yes, you can argue that Redis is just a cache. According to that the title then could have been 'without a database' as Redis is not in front of MySQL but replaced it. I think that mostly depends if your definition of a cache is 'in-memory' or 'on-front-of-a-database' - I did go for the second definition. 1 year ago
    Are you sure you want to
  • forsparta forsparta er. redis *is* an in-memory cache (AKA key/value store). so you served 1,000,000+ users without a cache by actually using a cache? well done you. 1 year ago
    Are you sure you want to

110 of 12 previous next

Post Comment
Edit your comment

1,000,000 daily users and no cache (Splash 2011) 1,000,000 daily users and no cache (Splash 2011) Presentation Transcript