Scalability Boot Camp SXSW 2008

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

3 comments

Comments 1 - 3 of 3 previous next Post a comment

  • + juarezpaf Juarez P. a. filho 2 years ago
    Nice tips about Scalability! Really great!! Thanks.
  • + Jakobo Jakob Heuser 2 years ago
    Thanks! I'm glad people got a lot of value out of it. At Kevin Rose's 'Scalable Web Ventures' panel, everyone retouched on Ganglia which seems to be the current monitoring tool of choice.
  • + jboutelle Jonathan Boutelle 2 years ago
    Awesome slideshow! (Very relevant to my world). I agree that monitoring is critical once your system starts getting heavy production use.
Post a comment
Embed Video
Edit your comment Cancel

15 Favorites & 1 Event

Scalability Boot Camp SXSW 2008 - Presentation Transcript

  1. Scalability Boot Camp SXSW 2008 Jakob Heuser Alan Kasindorf Blaine Cook Sandy Jen Kerry Miller
  2. Briefing Panelists Kerry Miller - BusinessWeek Alan Kasindorf (aka dormando) - Six Apart Jakob Heuser - Gaia Online Blaine Cook - Twitter Sandy Jen - Meebo Kerry Miller - BusinessWeek
  3. Why Scale • Good problem • Doesn’t have to cost • It’s an “everybody” thing Kerry Miller - BusinessWeek
  4. The Regimen • Problem • Concepts • Abstract Solutions • Google Time • Conversation Kerry Miller - BusinessWeek
  5. Monitoring avoid working in the dark Sandy Jen - Meebo
  6. Get it on the radar • Understand the “pain points” • Live and die by monitoring • Monitor EVERYTHING Sandy Jen - Meebo
  7. “Everything”? • Disk I/O • Memory • Bandwidth • Page Load Times • The list goes on... Sandy Jen - Meebo
  8. Google Time • Ganglia • Hyperic • sar and sysstat - simple, you already have it • Know your tool, whatever it is Sandy Jen - Meebo
  9. Content Delivery Network images, static files, and the like left out - n/a
  10. Friendly fire Bandwidth Usage During Digg Effect left out - n/a
  11. Down in the trenches YSlow Output On Retrieving a Page left out - n/a
  12. “Better you than me” • Put the right content on it • Do not “bolt it on” later • Use many subdomains • Cross domain situations left out - n/a
  13. Google Time (2) • CDN - wikipedia • Akamai • Panther Express • Coral CDN left out - n/a
  14. File System Solutions users like making tons of lolcats and storing them on your website Jakob Heuser - Gaia Online
  15. Never gonna be a hero Disk IO Graph Jakob Heuser - Gaia Online
  16. Use what you have • Don’t waste capacity • Use someone else’s space • Avoid a single “authority” on a file Jakob Heuser - Gaia Online
  17. Google Time • DRBD + OCFS • Amazon S3 • MogileFS (Danga Software) • lustre Jakob Heuser - Gaia Online
  18. The Database Layer your most common, but hardest to solve bottleneck Alan Kasindorf - Six Apart
  19. Enemy diversion Disk IO CPU Usage Alan Kasindorf - Six Apart
  20. The real problem Show Processlist Output Alan Kasindorf - Six Apart
  21. Another war zone • Make “:) SQL” not “:( SQL” • Horizontal Partitioning • Caching Layer Alan Kasindorf - Six Apart
  22. Google Time • Memcache • HiveDB • CouchDB / Hypertable • MySQL Consultant Alan Kasindorf - Six Apart
  23. Parallel Processing you don’t have to do it all right now Blaine Cook - Twitter
  24. Under siege Slow Query Log Blaine Cook - Twitter
  25. Smarter, not stronger • Consistent for current user, not everyone • Design code for parallel steps • cronjobs Blaine Cook - Twitter
  26. Google Time • Starling • Gearman • TheSchwartz Blaine Cook - Twitter
  27. Regroup Jakob Heuser - Gaia Online
  28. Regroup • All these technologies are built to be asynchronous • An amazing amount of your app can be asynchronous too Jakob Heuser - Gaia Online
  29. http://www.slideshare.net/Jakobo Scalability Boot Camp SXSW 2008 Jakob Heuser Alan Kasindorf Blaine Cook Sandy Jen Kerry Miller
  30. Resources Monitoring http://ganglia.sourceforge.net http://www.hyperic.com http://www.nagios.org http://pagesperso-orange.fr/sebastien.godard/ http://www.cacti.net CDN http://en.wikipedia.org/wiki/Content_Delivery_Network http://en.wikipedia.org/wiki/Akamai_Technologies
  31. Resources File Systems http://www.danga.com/mogilefs/ http://www.lustre.org http://www.drbd.org http://oss.oracle.com/projects/ocfs/ Database http://www.planetmysql.com http://datacharmer.blogspot.com/ http://www.danga.com/memcached/ Job and Queue Systems http://www.danga.com/gearman/ http://rubyforge.org/projects/starling/
  32. Image Credit http://www.history.noaa.gov/stories_tales/radar.html (radar) http://www.thatpoliticalblog.com/serendipity/plugin/tag/TPB+Information (bar chart) http://www.digitalearth.com.au/category/general/ (disk on fire) http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&item=160210671355 (dump truck) http://420.thrashbarg.net/ (marching penguins)

+ Jakob HeuserJakob Heuser, 2 years ago

custom

2973 views, 15 favs, 0 embeds more stats

SXSW Presentation by Jakob Heuser (Gaia Online), Al more

More Info

CC Attribution License

Go to text version
  • Total Views 2973
    • 2973 on SlideShare
    • 0 from embeds
  • Comments 3
  • Favorites 15
  • Downloads 147
Most viewed embeds

more

All embeds

less

Flagged as inappropriate Flag as inappropriate
Flag as innappropriate

Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

Cancel

Categories

Groups / Events