Velocity 2009 Report
Naoya Nakazawa
http://www.slideshare.net/n0ts

Agenda
About Velocity 2009
Velocity Day 1
Velocity Day 2
Velocity Day 3
My Comment

http://en.oreilly.com/velocity2009

Velocity

FAST

SCALABLE

EFFICIENT

AVAILABLE

Web Operations
&
Performance

Schedule & Hotel
2009 6 22 24 (3 )
1
2/3
Fairmont San Jose, CA

+
$1,145-$1,395
: 330

Velocity Day 1

Death of a Web Server: Crisis in
Caching
Introduction to Managed
Infrastructure with Puppet
Hadoop Operations: Managing Big
Data Clusters
Scalable Internet Architectures

Introduction to Managed
Infrastructure with Puppet

Puppet Luke Kanies (Reductive
Labs) Puppet
Reductive Labs

http://reductivelabs.com/downloads/presentations/
velocity_puppet_workshop_2009/project.html

Hadoop Operations: Managing Big
Data Clusters

Facebook Couldera Jeff
Hammerbacher Hadoop
Hadoop
HDFS(The Hadoop Distributed File
System)
60
http://assets.en.oreilly.com/1/event/29/Hadoop%20Operations_%20Managing%20Big
%20Data%20Clusters%20Presentation.pdf

Velocity Ignite
http://ignite.oreilly.com/

LT(Lighting Talk)
5
15 20

Image Weight Loss
Clinic
by Stoyan Stefanov
http://twitter.com/stoyanstefanov

Yahoo!
GIF PNG
Velocity
30%

Velocity Day 2

Keynote
10+ Deploys Per Day: Dev and Ops
Cooperation at Flickr
Infrastructure in the Cloud Era
Migrating www.aol.com from a
Proprietary Web Platform to Open
Source

Building OpenDNS Stats
Machines or MegaWatts
Best I/O is No I/O
Load Balancing Roundup

Fixing Twitter: Improving the Performance and
Scalability of the World's Most Popular Micro-
blogging Site
http://en.oreilly.com/velocity2009/public/schedule/detail/7479

2008 Twitter
752% (2000 )

Gangalia + Custom gMetrics
RRD
Nagios
Flickr

Google Analytics 503

SVN
Ganglia
Campfire

Apache HTTPD Server
Mongrel
Varnish( )
MySQL
Memcached(db query)

AMD Intel
-30%

Memcached
libmemcached + FNV Hash
50%
twitter libmemcached

RabbitMQ Kestrel
Memcached
Scala

MySQL

status.twitter
Tumblr

10+ Deploys Per Day: Dev and Ops
Cooperation at Flickr

Flickr

Flickr
3 40,000 /

Chef, CFEngine, BCfg2, FAI, System
Imager, Puppet, Cobbler

1
1

#php
if ($cfg['enable_feature_video'])
{
…
}
{* smarty *}
{if $cfg.enable_feature_beehive}
…
{/if}

IRC IM

Velocity Day 3

Keynote
In Search of ... A better, faster,
stronger Web
Performance Tools
Shopzilla's Site Redo - You Get
What You Measure

High Performance at Massive Scale -
Lessons Learned at Facebook
Drizzle: Scaling for the Clouds
MySQL Performance from Day #1
Frontend Performance Engineering in
Facebook

Creating Instant Response Time
Predictions with neXpert
Native CPU Performance in the
Browser with Google Native Client
State of Performance

In Search of ...
A better, faster, stronger Web

Google
10
30 +0.5

Google Reader
2009 1
IE 6/8
+1.5

Google Checkout
Checkout
table
+2%

Google Maps
12%
2-3

Google
http://code.google.com/speed

Performance Tools

AOL PageTest

IE 6/7
HTTP

HttpWatch

IE 6/7/8, Firefox 2.0/3.0/3.5
HTTP
AOL PageTest

http://www.httpwatch.com/

YSlow 2.0

smush.it
Firebug ( ?)

smush.it

Visual Round Trip Analyzer

.NET Framework 3.0, Netmon
L7

Firebug

Frontend Performance Engineering in
Facebook

2 40 PV/
1/10,000

Haste
home.php
-50%
-25%

Quickling
Ajax
LinkController, HistoryManager,
Bootloader

/
URL URL
http://www.facebook.com/home.php
http://www.facebook.com/home.php#/cjiang?ref=profle
http://www.facebook.com/home.php#/friends/?ref=tn

Quickling
IE/Firefox
( 9 )
6
-40% -50%

PageCache

3 5
/

-20%

My Comment

Facebook, Google, Twitter

!!! !!! !!!

&
http://en.oreilly.com/velocity2009/public/schedule/proceedings
http://velocityconference.blip.tv/
Velocity 09
http://www.youtube.com/user/OreillyMedia
http://secure.ddo.jp/~kaku/tdiary/20090626.html

http://www.flickr.com/photos/
naoya_n/

Puppet
Tokyo Tyrant & Tokyo Cabinet
Cobbler
Chef

Cacti vs Ganglia vs Munin
Varnish vs Squid
Virtualization Technology (Xen,
VMware, KVM)
Cloud Computing (EC2, AppEngine...)
My Server Infrastructure(JIMAN)