Velocity 2009 Report

          Naoya Nakazawa
   http://www.slideshare.net/n0ts
Agenda
About Velocity 2009
Velocity Day 1
Velocity Day 2
Velocity Day 3
My Comment
http://en.oreilly.com/velocity2009
Velocity
FAST
SCALABLE
EFFICIENT
AVAILABLE
Web Operations
      &
 Performance
Schedule & Hotel

 2009   6   22   24   (3   )

 1

 2/3



 Fairmont San Jose, CA
+

$1,145-$1,395


    : 330
Velocity Day 1
Death of a Web Server: Crisis in
Caching

Introduction to Managed
Infrastructure with Puppet

Hadoop Operations: Managing ...
Introduction to Managed
Infrastructure with Puppet
Puppet        Luke Kanies (Reductive
Labs)        Puppet




         Reductive Labs
http://reductivelabs.com/downloads/presentations/
  velocity_puppet_workshop_2009/project.html
Hadoop Operations: Managing Big
        Data Clusters
Facebook                             Couldera                   Jeff
Hammerbacher                                         ...
Velocity Ignite


 http://ignite.oreilly.com/
LT(Lighting Talk)

5

15      20
Image Weight Loss
      Clinic
          by Stoyan Stefanov
  http://twitter.com/stoyanstefanov
Yahoo!




GIF        PNG

Velocity
           30%
Velocity Day 2
Keynote

10+ Deploys Per Day: Dev and Ops
Cooperation at Flickr

Infrastructure in the Cloud Era

Migrating www.aol.com fr...
Building OpenDNS Stats

Machines or MegaWatts

Best I/O is No I/O

Load Balancing Roundup
Fixing Twitter: Improving the Performance and
Scalability of the World's Most Popular Micro-
                  blogging Si...
2008    Twitter

752%   (2000      )
Gangalia + Custom gMetrics

RRD

Nagios

Flickr
Google Analytics   503
SVN

Ganglia



Campfire
Apache HTTPD Server

Mongrel

Varnish(    )

MySQL

Memcached(db query)
AMD      Intel
  -30%
Memcached

 libmemcached + FNV Hash
                     50%

 twitter      libmemcached
RabbitMQ    Kestrel

Memcached

Scala
MySQL
status.twitter

  Tumblr
10+ Deploys Per Day: Dev and Ops
      Cooperation at Flickr
Flickr
Flickr

 3       40,000   /
Chef, CFEngine, BCfg2, FAI, System
Imager, Puppet, Cobbler
1




1
#php
if ($cfg['enable_feature_video'])
{
…
}

{* smarty *}
{if $cfg.enable_feature_beehive}
 …
{/if}
IRC   IM
Velocity Day 3
Keynote

 In Search of ... A better, faster,
 stronger Web

 Performance Tools

 Shopzilla's Site Redo - You Get
 What You...
High Performance at Massive Scale -
Lessons Learned at Facebook

Drizzle: Scaling for the Clouds

MySQL Performance from D...
Creating Instant Response Time
Predictions with neXpert

Native CPU Performance in the
Browser with Google Native Client

...
In Search of ...

A better, faster, stronger Web
Google




         10

 30      +0.5
Google Reader

 2009     1



 IE 6/8

                +1.5
Google Checkout

                  Checkout
                     table



     +2%
Google Maps

 12%



              2-3
Google

 http://code.google.com/speed
Performance Tools
AOL PageTest
IE 6/7

HTTP
HttpWatch
IE 6/7/8, Firefox 2.0/3.0/3.5



HTTP




AOL PageTest
http://www.httpwatch.com/
YSlow 2.0
smush.it

Firebug    (   ?)
smush.it
Visual Round Trip Analyzer
.NET Framework 3.0, Netmon

L7
Firebug
Frontend Performance Engineering in
             Facebook
2         40   PV/

1/10,000
Haste




 home.php

               -50%

        -25%
Quickling

 Ajax



 LinkController, HistoryManager,
 Bootloader
/



                     URL          URL


http://www.facebook.com/home.php
http://www.facebook.com/home.php#/cjiang?ref...
Quickling

 IE/Firefox
 (   9                 )

     6

              -40%   -50%
PageCache
3   5



/
-20%
My Comment
Facebook, Google, Twitter
!!!   !!!   !!!
&

http://en.oreilly.com/velocity2009/public/schedule/proceedings
http://velocityconference.blip.tv/
 Velocity 09

http://...
http://www.flickr.com/photos/
          naoya_n/
Puppet

Tokyo Tyrant & Tokyo Cabinet

Cobbler

Chef
Cacti vs Ganglia vs Munin

Varnish vs Squid

Virtualization Technology (Xen,
VMware, KVM)

Cloud Computing (EC2, AppEngine...
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Velocity Report 2009
Upcoming SlideShare
Loading in …5
×

Velocity Report 2009

3,005 views

Published on

Published in: Technology, Design
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
3,005
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
28
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Velocity Report 2009

  1. 1. Velocity 2009 Report Naoya Nakazawa http://www.slideshare.net/n0ts
  2. 2. Agenda About Velocity 2009 Velocity Day 1 Velocity Day 2 Velocity Day 3 My Comment
  3. 3. http://en.oreilly.com/velocity2009
  4. 4. Velocity
  5. 5. FAST
  6. 6. SCALABLE
  7. 7. EFFICIENT
  8. 8. AVAILABLE
  9. 9. Web Operations & Performance
  10. 10. Schedule & Hotel 2009 6 22 24 (3 ) 1 2/3 Fairmont San Jose, CA
  11. 11. + $1,145-$1,395 : 330
  12. 12. Velocity Day 1
  13. 13. Death of a Web Server: Crisis in Caching Introduction to Managed Infrastructure with Puppet Hadoop Operations: Managing Big Data Clusters Scalable Internet Architectures
  14. 14. Introduction to Managed Infrastructure with Puppet
  15. 15. Puppet Luke Kanies (Reductive Labs) Puppet Reductive Labs
  16. 16. http://reductivelabs.com/downloads/presentations/ velocity_puppet_workshop_2009/project.html
  17. 17. Hadoop Operations: Managing Big Data Clusters
  18. 18. Facebook Couldera Jeff Hammerbacher Hadoop Hadoop HDFS(The Hadoop Distributed File System) 60 http://assets.en.oreilly.com/1/event/29/Hadoop%20Operations_%20Managing%20Big %20Data%20Clusters%20Presentation.pdf
  19. 19. Velocity Ignite http://ignite.oreilly.com/
  20. 20. LT(Lighting Talk) 5 15 20
  21. 21. Image Weight Loss Clinic by Stoyan Stefanov http://twitter.com/stoyanstefanov
  22. 22. Yahoo! GIF PNG Velocity 30%
  23. 23. Velocity Day 2
  24. 24. Keynote 10+ Deploys Per Day: Dev and Ops Cooperation at Flickr Infrastructure in the Cloud Era Migrating www.aol.com from a Proprietary Web Platform to Open Source
  25. 25. Building OpenDNS Stats Machines or MegaWatts Best I/O is No I/O Load Balancing Roundup
  26. 26. Fixing Twitter: Improving the Performance and Scalability of the World's Most Popular Micro- blogging Site http://en.oreilly.com/velocity2009/public/schedule/detail/7479
  27. 27. 2008 Twitter 752% (2000 )
  28. 28. Gangalia + Custom gMetrics RRD Nagios Flickr
  29. 29. Google Analytics 503
  30. 30. SVN Ganglia Campfire
  31. 31. Apache HTTPD Server Mongrel Varnish( ) MySQL Memcached(db query)
  32. 32. AMD Intel -30%
  33. 33. Memcached libmemcached + FNV Hash 50% twitter libmemcached
  34. 34. RabbitMQ Kestrel Memcached Scala
  35. 35. MySQL
  36. 36. status.twitter Tumblr
  37. 37. 10+ Deploys Per Day: Dev and Ops Cooperation at Flickr
  38. 38. Flickr
  39. 39. Flickr 3 40,000 /
  40. 40. Chef, CFEngine, BCfg2, FAI, System Imager, Puppet, Cobbler
  41. 41. 1 1
  42. 42. #php if ($cfg['enable_feature_video']) { … } {* smarty *} {if $cfg.enable_feature_beehive} … {/if}
  43. 43. IRC IM
  44. 44. Velocity Day 3
  45. 45. Keynote In Search of ... A better, faster, stronger Web Performance Tools Shopzilla's Site Redo - You Get What You Measure
  46. 46. High Performance at Massive Scale - Lessons Learned at Facebook Drizzle: Scaling for the Clouds MySQL Performance from Day #1 Frontend Performance Engineering in Facebook
  47. 47. Creating Instant Response Time Predictions with neXpert Native CPU Performance in the Browser with Google Native Client State of Performance
  48. 48. In Search of ... A better, faster, stronger Web
  49. 49. Google 10 30 +0.5
  50. 50. Google Reader 2009 1 IE 6/8 +1.5
  51. 51. Google Checkout Checkout table +2%
  52. 52. Google Maps 12% 2-3
  53. 53. Google http://code.google.com/speed
  54. 54. Performance Tools
  55. 55. AOL PageTest
  56. 56. IE 6/7 HTTP
  57. 57. HttpWatch
  58. 58. IE 6/7/8, Firefox 2.0/3.0/3.5 HTTP AOL PageTest
  59. 59. http://www.httpwatch.com/
  60. 60. YSlow 2.0
  61. 61. smush.it Firebug ( ?)
  62. 62. smush.it
  63. 63. Visual Round Trip Analyzer
  64. 64. .NET Framework 3.0, Netmon L7
  65. 65. Firebug
  66. 66. Frontend Performance Engineering in Facebook
  67. 67. 2 40 PV/ 1/10,000
  68. 68. Haste home.php -50% -25%
  69. 69. Quickling Ajax LinkController, HistoryManager, Bootloader
  70. 70. / URL URL http://www.facebook.com/home.php http://www.facebook.com/home.php#/cjiang?ref=profle http://www.facebook.com/home.php#/friends/?ref=tn
  71. 71. Quickling IE/Firefox ( 9 ) 6 -40% -50%
  72. 72. PageCache
  73. 73. 3 5 /
  74. 74. -20%
  75. 75. My Comment
  76. 76. Facebook, Google, Twitter
  77. 77. !!! !!! !!!
  78. 78. & http://en.oreilly.com/velocity2009/public/schedule/proceedings http://velocityconference.blip.tv/ Velocity 09 http://www.youtube.com/user/OreillyMedia http://secure.ddo.jp/~kaku/tdiary/20090626.html
  79. 79. http://www.flickr.com/photos/ naoya_n/
  80. 80. Puppet Tokyo Tyrant & Tokyo Cabinet Cobbler Chef
  81. 81. Cacti vs Ganglia vs Munin Varnish vs Squid Virtualization Technology (Xen, VMware, KVM) Cloud Computing (EC2, AppEngine...) My Server Infrastructure(JIMAN)

×