This document summarizes Naoya Nakazawa's notes and presentation from the Velocity 2009 conference. The conference took place from June 22-24, 2009 in San Jose, CA at the Fairmont Hotel. It covered topics like infrastructure management with Puppet, Hadoop operations, scaling Twitter, and frontend performance at Facebook. Many talks discussed lessons learned from scaling sites like Flickr, Google, Facebook and Twitter to handle massive traffic. Overall the conference provided insights into building fast, scalable and efficient web applications and services.

1. Velocity 2009 Report
Naoya Nakazawa
http://www.slideshare.net/n0ts

2. Agenda
About Velocity 2009
Velocity Day 1
Velocity Day 2
Velocity Day 3
My Comment

3. http://en.oreilly.com/velocity2009

4. Velocity

5. FAST

6. SCALABLE

7. EFFICIENT

8. AVAILABLE

9. Web Operations
&
Performance

13. Schedule & Hotel
2009 6 22 24 (3 )
1
2/3
Fairmont San Jose, CA

14. +
$1,145-$1,395
: 330

16. Velocity Day 1

17. Death of a Web Server: Crisis in
Caching
Introduction to Managed
Infrastructure with Puppet
Hadoop Operations: Managing Big
Data Clusters
Scalable Internet Architectures

18. Introduction to Managed
Infrastructure with Puppet

19. Puppet Luke Kanies (Reductive
Labs) Puppet
Reductive Labs

20. http://reductivelabs.com/downloads/presentations/
velocity_puppet_workshop_2009/project.html

21. Hadoop Operations: Managing Big
Data Clusters

22. Facebook Couldera Jeff
Hammerbacher Hadoop
Hadoop
HDFS(The Hadoop Distributed File
System)
60
http://assets.en.oreilly.com/1/event/29/Hadoop%20Operations_%20Managing%20Big
%20Data%20Clusters%20Presentation.pdf

23. Velocity Ignite
http://ignite.oreilly.com/

25. LT(Lighting Talk)
5
15 20

26. Image Weight Loss
Clinic
by Stoyan Stefanov
http://twitter.com/stoyanstefanov

27. Yahoo!
GIF PNG
Velocity
30%

30. Velocity Day 2

31. Keynote
10+ Deploys Per Day: Dev and Ops
Cooperation at Flickr
Infrastructure in the Cloud Era
Migrating www.aol.com from a
Proprietary Web Platform to Open
Source

32. Building OpenDNS Stats
Machines or MegaWatts
Best I/O is No I/O
Load Balancing Roundup

33. Fixing Twitter: Improving the Performance and
Scalability of the World's Most Popular Micro-
blogging Site
http://en.oreilly.com/velocity2009/public/schedule/detail/7479

34. 2008 Twitter
752% (2000 )

35. Gangalia + Custom gMetrics
RRD
Nagios
Flickr

36. Google Analytics 503

37. SVN
Ganglia
Campfire

38. Apache HTTPD Server
Mongrel
Varnish( )
MySQL
Memcached(db query)

39. AMD Intel
-30%

40. Memcached
libmemcached + FNV Hash
50%
twitter libmemcached

41. RabbitMQ Kestrel
Memcached
Scala

42. MySQL

43. status.twitter
Tumblr

46. 10+ Deploys Per Day: Dev and Ops
Cooperation at Flickr

47. Flickr

48. Flickr
3 40,000 /

49. Chef, CFEngine, BCfg2, FAI, System
Imager, Puppet, Cobbler

51. 1
1

53. #php
if ($cfg['enable_feature_video'])
{
…
}
{* smarty *}
{if $cfg.enable_feature_beehive}
…
{/if}

54. IRC IM

56. Velocity Day 3

57. Keynote
In Search of ... A better, faster,
stronger Web
Performance Tools
Shopzilla's Site Redo - You Get
What You Measure

58. High Performance at Massive Scale -
Lessons Learned at Facebook
Drizzle: Scaling for the Clouds
MySQL Performance from Day #1
Frontend Performance Engineering in
Facebook

59. Creating Instant Response Time
Predictions with neXpert
Native CPU Performance in the
Browser with Google Native Client
State of Performance

60. In Search of ...
A better, faster, stronger Web

61. Google
10
30 +0.5

62. Google Reader
2009 1
IE 6/8
+1.5

63. Google Checkout
Checkout
table
+2%

64. Google Maps
12%
2-3

65. Google
http://code.google.com/speed

66. Performance Tools

67. AOL PageTest

68. IE 6/7
HTTP

69. HttpWatch

70. IE 6/7/8, Firefox 2.0/3.0/3.5
HTTP
AOL PageTest

71. http://www.httpwatch.com/

72. YSlow 2.0

73. smush.it
Firebug ( ?)

74. smush.it

75. Visual Round Trip Analyzer

76. .NET Framework 3.0, Netmon
L7

77. Firebug

78. Frontend Performance Engineering in
Facebook

79. 2 40 PV/
1/10,000

80. Haste
home.php
-50%
-25%

81. Quickling
Ajax
LinkController, HistoryManager,
Bootloader

82. /
URL URL
http://www.facebook.com/home.php
http://www.facebook.com/home.php#/cjiang?ref=profle
http://www.facebook.com/home.php#/friends/?ref=tn

83. Quickling
IE/Firefox
( 9 )
6
-40% -50%

84. PageCache

85. 3 5
/

87. -20%

90. My Comment

91. Facebook, Google, Twitter

92. !!! !!! !!!

93. &
http://en.oreilly.com/velocity2009/public/schedule/proceedings
http://velocityconference.blip.tv/
Velocity 09
http://www.youtube.com/user/OreillyMedia
http://secure.ddo.jp/~kaku/tdiary/20090626.html

103. http://www.flickr.com/photos/
naoya_n/

104. Puppet
Tokyo Tyrant & Tokyo Cabinet
Cobbler
Chef

105. Cacti vs Ganglia vs Munin
Varnish vs Squid
Virtualization Technology (Xen,
VMware, KVM)
Cloud Computing (EC2, AppEngine...)
My Server Infrastructure(JIMAN)