Your SlideShare is downloading. ×
0
Scaling in the Cloud
Speaker:

Jesse Robbins CEO
  ‣ jesse@opscode.com
  ‣ @jesserobbins
  ‣ www.opscode.com
             ...
Opscode makes a new kind of
Infrastructure Automation,
offered as a hosted Service.


          Copyright © 2010 Opscode, ...
http://www.flickr.com/photos/
timyates/2854357446/sizes/l/
• Developers?



                http://www.flickr.com/photos/
                timyates/2854357446/sizes/l/
• Developers?
• Systems Administrators?




                 http://www.flickr.com/photos/
                 timyates/285435...
• Developers?
• Systems Administrators?

• Executives/Leaders?
                 http://www.flickr.com/photos/
             ...
For Developers...
For Developers...

• Do it yourself.
For Developers...

• Do it yourself.
• The infrastructure is the application
  (and vice versa).
For Developers...

• Do it yourself.
• The infrastructure is the application
  (and vice versa).

• You are not a Systems ...
For Developers...

• Do it yourself.
• The infrastructure is the application
  (and vice versa).

• You are not a Systems ...
Sysadmins..




                                                                                                 http://co...
Sysadmins..
    • Say “Yes”.




                                                                                         ...
Sysadmins..
    • Say “Yes”.
    • You never liked rack
            and stack that much
            anyway.




          ...
Sysadmins..
    • Say “Yes”.
    • You never liked rack
            and stack that much
            anyway.

    • You hav...
Sysadmins..
    • Say “Yes”.
    • You never liked rack
            and stack that much
            anyway.

    • You hav...
Executives...
Executives...

•   Not a magic unicorn
Executives...

•   Not a magic unicorn

•   Benefits come from efficiency, not raw Capex
Executives...

•   Not a magic unicorn

•   Benefits come from efficiency, not raw Capex

•   Has real cultural implications...
Executives...

•   Not a magic unicorn

•   Benefits come from efficiency, not raw Capex

•   Has real cultural implications...
“Traditional” Operations                                                   Operations - The “Secret Sauce”
             50...
“Traditional” Operations                                                   Operations - The “Secret Sauce”
             50...
You are 10% Unique
You are 10% Unique




   And itʼs probably
the things you did wrong
Infrastructure is Hard




                Copyright © 2010 Opscode, Inc - All Rights Reserved   9
Infrastructure is Hard
1999
 Inventory, packaged file transers and desktops




                  Copyright © 2010 Opscode,...
Infrastructure is Hard
1999
 Inventory, packaged file transers and desktops
2005
 Unattended bare metal servers “very very”...
Infrastructure is Hard
1999
 Inventory, packaged file transers and desktops
2005
 Unattended bare metal servers “very very”...
Infrastructure is Hard
1999
 Inventory, packaged file transers and desktops
2005
 Unattended bare metal servers “very very”...
Infrastructure is Hard
1999
 Inventory, packaged file transers and desktops
2005
 Unattended bare metal servers “very very”...
Infrastructure is changing




               Copyright © 2010 Opscode, Inc - All Rights Reserved   10
Infrastructure is changing

‣ Easier to get (good!)
  ...but harder to manage (bad!)




                        Copyright...
Infrastructure is changing

‣ Easier to get (good!)
  ...but harder to manage (bad!)

‣ Demand is dynamic




            ...
Infrastructure is changing

‣ Easier to get (good!)
  ...but harder to manage (bad!)

‣ Demand is dynamic

‣ Developers ar...
Infrastructure is changing

‣ Easier to get (good!)
  ...but harder to manage (bad!)

‣ Demand is dynamic

‣ Developers ar...
Infrastructure is changing

‣ Easier to get (good!)
  ...but harder to manage (bad!)

‣ Demand is dynamic

‣ Developers ar...
Infrastructure is changing

‣ Easier to get (good!)
  ...but harder to manage (bad!)

‣ Demand is dynamic

‣ Developers ar...
Managing Infrastructure Is Hard
                                                                           Has Always Been...
Google, Amazon, Microsoft
built their own tools
          Copyright © 2010 Opscode, Inc - All Rights Reserved   12
but it’s “secret sauce”
     Copyright © 2010 Opscode, Inc - All Rights Reserved   13
P




                                 everyone else is here

            ... inexperienced & poorly
            equipped ...
“Cloud”
Alistair’s mom’s definition


 Cloud
Alistair’s mom’s definition


 Cloud   =   Web
Alistair’s mom’s definition


 Cloud   =   Web   =   Internet
Alistair’s mom’s definition


 Cloud   =   Web   =   Internet   =   Useless
Slide courtesy Alistair Croll - alistair@rednod.com
Private                                           Public




          Slide courtesy Alistair Croll - alistair@rednod.com
Private                                                 Public




                                                       ...
Private                                                 Public




    IaaS                                               ...
Private                                                 Public




   PaaS                                                ...
Private                                                 Public



                                                        ...
Private                                                 Public



                     nt t o SaaS
                   a
  ...
Infrastructure as a Service
                    (IaaS)
Amazon EC2, Rackspace Cloud, Terremark,
Gogrid, Joyent (and nearly ...
Dedicated    On-premise                  Virtual                      Third-party
hardware    private clouds           pri...
Slide courtesy Alistair Croll - alistair@rednod.com
Always on
  premise
     Private
  Compliance-
   enforced
Need to track and
      audit
   Legislative
 Data near local
 ...
Always on                  Can be done
  premise                    anywhere
     Private
  Compliance-                   ...
Always on                  Can be done                                    Always in
  premise                    anywhere ...
Always on                  Can be done                                                          Always in
  premise       ...
Always on                              Can be done                                                          Always in
  pr...
Virtual machine
                                                                                                          ...
Compute task
                                                                                                             ...
Automation
Bootstrapping
Bootstrapping Approaches
                          Good                         Bad                Time

                 ...
Configuration



curl -O http://brainspl.at/velocity.sh && sh velocity.sh
Configuration Approaches
                            Good                               Bad

                              ...
Command and
  Control
Command and Control
                                    Good                             Bad

                            ...
Lightning Strikes!
           DOOM


    Webservers




                 Database Servers




    Webservers
Lightning Strikes!
           DOOM

      X
    Webservers
                  XX
                 Database Servers




    ...
Lightning Strikes!
                          DOOM

                 X    1
                      1            2
          ...
Lightning Strikes!
  Monitoring
Signals Nanite
 /node/down
   Service
                           DOOM

                  X...
Lightning Strikes!                  Nanite
                                           boots new EC2

Nanite removes       ...
Lightning Strikes!
                          DOOM

                 X    1
                      1            2
          ...
Lightning Strikes!
                                        DOOM

                               X    1
                   ...
Lightning Strikes!
                                        DOOM

   Chef
                               X    1
           ...
A word about Scaling...
Typical Peak Load


1.Bring on capacity as traffic ramps up
2.Take down capacity as it ramps down
3.10-15 Minutes on either...
Atypical Load
 No way                                                                   However,
 around                  ...
Capacity Planning is
       king.




      http://www.flickr.com/photos/allspaw/2095439645/sizes/l/
Have a queue?
Have a queue?


Does it scale linearly with more resources?
Have a queue?


Does it scale linearly with more resources?




  Congratulations - you can auto-scale!
NoSQL


http://www.flickr.com/photos/wingler/3429634150/sizes/l/
CAP Theorem

• Consistency           Pick
                        Two
• Availability
• Partition Tolerance
Most SQL Databases


• Choose Consistency over all
• Availability comes distant second
Web Applications need...

• Availability
• Partition Tolerance
“Global temporal
consistency is a fiction”
  Christopher Brown
Choosing Consistency
 for your Web App...
 Means failure is global
When you choose
 Partition Tolerance and
       Availability...


You fail or succeed for a subset of
               users
Apologies




• Apologize after the fact for failures
• Better than nothing at all
NoSQL

• Many different tools
• They tweak CAP differently
 • CouchDB
 • Cassandra
 • Redis
 • MongoDB
Scaling in the Cloud
Speaker:

Jesse Robbins CEO
  ‣ jesse@opscode.com
  ‣ @jesserobbins
  ‣ www.opscode.com
             ...
Gov 2.0: Scaling, Automation, & Management in the Cloud
Gov 2.0: Scaling, Automation, & Management in the Cloud
Upcoming SlideShare
Loading in...5
×

Gov 2.0: Scaling, Automation, & Management in the Cloud

5,149

Published on

Gov 2.0: Scaling, Automation, & Management in the Cloud

Published in: Technology

Transcript of "Gov 2.0: Scaling, Automation, & Management in the Cloud"

  1. 1. Scaling in the Cloud Speaker: Jesse Robbins CEO ‣ jesse@opscode.com ‣ @jesserobbins ‣ www.opscode.com Copyright © 2010 Opscode, Inc - All Rights Reserved 1
  2. 2. Opscode makes a new kind of Infrastructure Automation, offered as a hosted Service. Copyright © 2010 Opscode, Inc. – Confidential – Do Not Redistribute 2
  3. 3. http://www.flickr.com/photos/ timyates/2854357446/sizes/l/
  4. 4. • Developers? http://www.flickr.com/photos/ timyates/2854357446/sizes/l/
  5. 5. • Developers? • Systems Administrators? http://www.flickr.com/photos/ timyates/2854357446/sizes/l/
  6. 6. • Developers? • Systems Administrators? • Executives/Leaders? http://www.flickr.com/photos/ timyates/2854357446/sizes/l/
  7. 7. For Developers...
  8. 8. For Developers... • Do it yourself.
  9. 9. For Developers... • Do it yourself. • The infrastructure is the application (and vice versa).
  10. 10. For Developers... • Do it yourself. • The infrastructure is the application (and vice versa). • You are not a Systems Administrator.
  11. 11. For Developers... • Do it yourself. • The infrastructure is the application (and vice versa). • You are not a Systems Administrator. • You need tools.
  12. 12. Sysadmins.. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft
  13. 13. Sysadmins.. • Say “Yes”. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft
  14. 14. Sysadmins.. • Say “Yes”. • You never liked rack and stack that much anyway. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft
  15. 15. Sysadmins.. • Say “Yes”. • You never liked rack and stack that much anyway. • You have never been more critical. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft
  16. 16. Sysadmins.. • Say “Yes”. • You never liked rack and stack that much anyway. • You have never been more critical. • Lean into it. http://covers.oreilly.com/images/9780596007836/lrg.jpg Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft
  17. 17. Executives...
  18. 18. Executives... • Not a magic unicorn
  19. 19. Executives... • Not a magic unicorn • Benefits come from efficiency, not raw Capex
  20. 20. Executives... • Not a magic unicorn • Benefits come from efficiency, not raw Capex • Has real cultural implications at every level
  21. 21. Executives... • Not a magic unicorn • Benefits come from efficiency, not raw Capex • Has real cultural implications at every level • You are the biggest asset to success
  22. 22. “Traditional” Operations Operations - The “Secret Sauce” 50 50 40 40 # of Hours 30 30 20 20 Hardware OS Install 10 10 Config Upkeep 20 20 15 15 Servers 10 10 New 5 5 Existing 0 0 1 2 3 4 5 6 7 9 10 11 12 1 2 3 4 5 6 7 9 10 11 12 Week # Week # (http://radar.oreilly.com/archives/2007/10/operations-advantage.html) Copyright © 2010 Opscode, Inc - All Rights Reserved 7
  23. 23. “Traditional” Operations Operations - The “Secret Sauce” 50 50 This is the secret of 40 40 Cloud Computing. Every other virtue stems from # of Hours 30 30 here. 20 20 Hardware OS Install 10 10 Config Upkeep 20 20 15 15 Servers 10 10 New 5 5 Existing 0 0 1 2 3 4 5 6 7 9 10 11 12 1 2 3 4 5 6 7 9 10 11 12 Week # Week # (http://radar.oreilly.com/archives/2007/10/operations-advantage.html) Copyright © 2010 Opscode, Inc - All Rights Reserved 7
  24. 24. You are 10% Unique
  25. 25. You are 10% Unique And itʼs probably the things you did wrong
  26. 26. Infrastructure is Hard Copyright © 2010 Opscode, Inc - All Rights Reserved 9
  27. 27. Infrastructure is Hard 1999 Inventory, packaged file transers and desktops Copyright © 2010 Opscode, Inc - All Rights Reserved 9
  28. 28. Infrastructure is Hard 1999 Inventory, packaged file transers and desktops 2005 Unattended bare metal servers “very very” hard 7k Nodes took 5 days w/90 success Copyright © 2010 Opscode, Inc - All Rights Reserved 9
  29. 29. Infrastructure is Hard 1999 Inventory, packaged file transers and desktops 2005 Unattended bare metal servers “very very” hard 7k Nodes took 5 days w/90 success 2007 Unattended bare metal in under 10 minutes Fully configured in under 3 mins Copyright © 2010 Opscode, Inc - All Rights Reserved 9
  30. 30. Infrastructure is Hard 1999 Inventory, packaged file transers and desktops 2005 Unattended bare metal servers “very very” hard 7k Nodes took 5 days w/90 success 2007 Unattended bare metal in under 10 minutes Fully configured in under 3 mins 2008 Unattended server in 2 minutes 5000 servers in a week Copyright © 2010 Opscode, Inc - All Rights Reserved 9
  31. 31. Infrastructure is Hard 1999 Inventory, packaged file transers and desktops 2005 Unattended bare metal servers “very very” hard 7k Nodes took 5 days w/90 success 2007 Unattended bare metal in under 10 minutes Fully configured in under 3 mins 2008 Unattended server in 2 minutes 5000 servers in a week 2010 10k Nodes in under 5 minutes Copyright © 2010 Opscode, Inc - All Rights Reserved 9
  32. 32. Infrastructure is changing Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  33. 33. Infrastructure is changing ‣ Easier to get (good!) ...but harder to manage (bad!) Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  34. 34. Infrastructure is changing ‣ Easier to get (good!) ...but harder to manage (bad!) ‣ Demand is dynamic Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  35. 35. Infrastructure is changing ‣ Easier to get (good!) ...but harder to manage (bad!) ‣ Demand is dynamic ‣ Developers are crucial to Operations Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  36. 36. Infrastructure is changing ‣ Easier to get (good!) ...but harder to manage (bad!) ‣ Demand is dynamic ‣ Developers are crucial to Operations ‣ Web / Cloud services are proliferating ...and Enterprise is following along. Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  37. 37. Infrastructure is changing ‣ Easier to get (good!) ...but harder to manage (bad!) ‣ Demand is dynamic ‣ Developers are crucial to Operations ‣ Web / Cloud services are proliferating ...and Enterprise is following along. ‣ Manual configuration no longer a crutch Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  38. 38. Infrastructure is changing ‣ Easier to get (good!) ...but harder to manage (bad!) ‣ Demand is dynamic ‣ Developers are crucial to Operations ‣ Web / Cloud services are proliferating ...and Enterprise is following along. ‣ Manual configuration no longer a crutch ‣ Few tools to solve a ubiquitous problem Copyright © 2010 Opscode, Inc - All Rights Reserved 10
  39. 39. Managing Infrastructure Is Hard Has Always Been Proprietary Solutions Previous Attempts Typically... 1980 • Solve very little of the problem... 1989 • Reach just a handful of large, enterprise customers 1999 • Require custom implementations with large professional services bills • Deployed exclusively on-premise 2001 • Acquired by companies with large consulting organizations (IBM, HP, CA) Copyright © 2010 Opscode, Inc - All Rights Reserved
  40. 40. Google, Amazon, Microsoft built their own tools Copyright © 2010 Opscode, Inc - All Rights Reserved 12
  41. 41. but it’s “secret sauce” Copyright © 2010 Opscode, Inc - All Rights Reserved 13
  42. 42. P everyone else is here ... inexperienced & poorly equipped for the world they must now operate in. Copyright © 2010 Opscode, Inc - All Rights Reserved 14
  43. 43. “Cloud”
  44. 44. Alistair’s mom’s definition Cloud
  45. 45. Alistair’s mom’s definition Cloud = Web
  46. 46. Alistair’s mom’s definition Cloud = Web = Internet
  47. 47. Alistair’s mom’s definition Cloud = Web = Internet = Useless
  48. 48. Slide courtesy Alistair Croll - alistair@rednod.com
  49. 49. Private Public Slide courtesy Alistair Croll - alistair@rednod.com
  50. 50. Private Public Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com
  51. 51. Private Public IaaS IaaS Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com
  52. 52. Private Public PaaS PaaS IaaS IaaS Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com
  53. 53. Private Public SaaS PaaS PaaS IaaS IaaS Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com
  54. 54. Private Public nt t o SaaS a w d s, o u lo u y c If l k PaaS rs t.PaaS t a ne f i i ck o IaaS p IaaS Managed Virtualization hosting Slide courtesy Alistair Croll - alistair@rednod.com
  55. 55. Infrastructure as a Service (IaaS) Amazon EC2, Rackspace Cloud, Terremark, Gogrid, Joyent (and nearly every private cloud built on Zenserver or VMWare.) Slide courtesy Alistair Croll - alistair@rednod.com
  56. 56. Dedicated On-premise Virtual Third-party hardware private clouds private clouds public clouds Slide courtesy Alistair Croll - alistair@rednod.com
  57. 57. Slide courtesy Alistair Croll - alistair@rednod.com
  58. 58. Always on premise Private Compliance- enforced Need to track and audit Legislative Data near local computation Slide courtesy Alistair Croll - alistair@rednod.com
  59. 59. Always on Can be done premise anywhere Private Compliance- Testing enforced Training Need to track and Prototyping audit Batch processing Legislative Seasonal load Data near local computation Slide courtesy Alistair Croll - alistair@rednod.com
  60. 60. Always on Can be done Always in premise anywhere cloud Private Partner access Compliance- Testing enforced Proximity to cloud Training services (storage, Need to track and Prototyping CDN, etc.) audit Batch processing Massively grid/ Legislative Seasonal load parallel (genomic, Data near local modelling) computation Slide courtesy Alistair Croll - alistair@rednod.com
  61. 61. Always on Can be done Always in premise anywhere cloud Load/pricing engine Private Partner access Compliance- Testing enforced Proximity to cloud Training services (storage, Need to track and Prototyping CDN, etc.) audit Batch processing Massively grid/ Legislative Seasonal load parallel (genomic, Data near local modelling) computation Slide courtesy Alistair Croll - alistair@rednod.com
  62. 62. Always on Can be done Always in premise anywhere cloud Load/pricing engine Private Partner access Compliance- Testing enforced Proximity to cloud Training services (storage, Policy engine Need to track and Prototyping CDN, etc.) audit Batch processing Massively grid/ Legislative Seasonal load parallel (genomic, Data near local modelling) computation Slide courtesy Alistair Croll - alistair@rednod.com
  63. 63. Virtual machine (infrastructure cloud) Always on Can be done Always in premise anywhere cloud Load/pricing engine Private Partner access Compliance- Testing enforced Proximity to cloud Training services (storage, Policy engine Need to track and Prototyping CDN, etc.) audit Batch processing Massively grid/ Legislative Seasonal load parallel (genomic, Data near local modelling) computation Slide courtesy Alistair Croll - alistair@rednod.com
  64. 64. Compute task (service cloud) Always on Can be done Always in premise anywhere cloud Load/pricing engine Private Partner access Compliance- Testing enforced Proximity to cloud Training services (storage, Policy engine Need to track and Prototyping CDN, etc.) audit Batch processing Massively grid/ Legislative Seasonal load parallel (genomic, Data near local modelling) computation Slide courtesy Alistair Croll - alistair@rednod.com
  65. 65. Automation
  66. 66. Bootstrapping
  67. 67. Bootstrapping Approaches Good Bad Time Known Costs, No High Waste (Hoarding) Variation. Red Tape Corp Approvals Anything you want, as long Expensive ($/Time) 6-8w as IT pre-approved it. Long lead time Lower Waste Agile Corp Known Costs. Less Red Tape Total Hardware Control. Still slow 2-4w Approvals Trivial Approvals. Expensive ($/Time) Shorter lead time Variable Costs. Highly Adaptable. Variable Costs. Cloud Minimal lead time. Trivial approvals. No control over hardware. Must re-train. 5-10m No humans needed.
  68. 68. Configuration curl -O http://brainspl.at/velocity.sh && sh velocity.sh
  69. 69. Configuration Approaches Good Bad Slow. You can do anything. Error Prone (Bus Error!) Manual Results in an intimate knowledge of the details. Non-repeatable. Difficult knowledge transfer. Rarely idempotent. More repeatable. Hard to collaborate. Ad-Hoc Knowledge is dispersed. Built your way, with your model. Brittle. No API. Repeatable. Infrastructure Idempotent. Agile. Have to learn how to use it. Hard things remain hard. as Code Sharable. Self documenting. Not magic. (Yet!)
  70. 70. Command and Control
  71. 71. Command and Control Good Bad Super flexible. Error Prone. Can do almost anything. Slow. Meatcloud* Always easy to find someone to blame. Expensive to Scale. Not repeatable. Free will. Free will. One-off by neccessity. More repeatable. Tooling sprawl. Ad-Hoc Easier to scale. Less error prone (hopefully!) Hard to share solutions. Much higher learning curve. One system to learn. Scales well. Not everything maps cleanly. Framework Paint by numbers. Repeatable. Trades depth of knowledge for ease of use. Two-Way. *Meatcloud appears in this presentation courtesy of Andrew Shafer - http://is.gd/Ega
  72. 72. Lightning Strikes! DOOM Webservers Database Servers Webservers
  73. 73. Lightning Strikes! DOOM X Webservers XX Database Servers Webservers
  74. 74. Lightning Strikes! DOOM X 1 1 2 1 Signals Moar! XX Monitoring Command & Bootstrapping System Webservers Updates Control Provisions 2 1 3 1 5 1 3 1 Database Servers 4 1 4 1 Configuration Webservers
  75. 75. Lightning Strikes! Monitoring Signals Nanite /node/down Service DOOM X 1 1 2 1 Signals Moar! XX Monitoring Command & Bootstrapping System Webservers Updates Control Provisions 2 1 3 1 5 1 3 1 Database Servers 4 1 4 1 Configuration Webservers
  76. 76. Lightning Strikes! Nanite boots new EC2 Nanite removes DOOM Instances, with Chef Role + nodes in Chef Attribute X 1 1 2 1 Signals Moar! XX Monitoring Command & Bootstrapping System Webservers Updates Control Provisions 2 1 3 1 5 1 3 1 Database Servers 4 1 4 1 Configuration Webservers
  77. 77. Lightning Strikes! DOOM X 1 1 2 1 Provisions Instances, EBS, Signals Moar! Elastic IPs XX Monitoring Command & Bootstrapping System Webservers Updates Control Provisions 2 1 3 1 5 1 3 1 Database Servers 4 1 4 1 Configuration Webservers
  78. 78. Lightning Strikes! DOOM X 1 1 2 1 Signals Moar! XX Monitoring Command & Bootstrapping System Webservers Updates Control Provisions 2 1 3 1 5 1 3 1 Chef Database Servers configures nodes 4 1 4 1 according to Configuration assigned Webservers
  79. 79. Lightning Strikes! DOOM Chef X 1 1 2 1 Signals Moar! updates the XX Monitoring Command & Bootstrapping monitoring System Webservers Updates Control Provisions system 5 1 2 1 3 1 3 1 Database Servers 4 1 4 1 Configuration Webservers
  80. 80. A word about Scaling...
  81. 81. Typical Peak Load 1.Bring on capacity as traffic ramps up 2.Take down capacity as it ramps down 3.10-15 Minutes on either side, fully unattended Graphs in this portion of the presentation taken from Theo Schlossnagle http://omniti.com/seeds/dissecting-todays-internet-traffic-spikes
  82. 82. Atypical Load No way However, around you are Capacity still better Planning off! 1.Hope you know it is coming. 2.Increase capacity in advance. 3.Take down capacity as it ramps down. Graphs in this portion of the presentation taken from Theo Schlossnagle http://omniti.com/seeds/dissecting-todays-internet-traffic-spikes
  83. 83. Capacity Planning is king. http://www.flickr.com/photos/allspaw/2095439645/sizes/l/
  84. 84. Have a queue?
  85. 85. Have a queue? Does it scale linearly with more resources?
  86. 86. Have a queue? Does it scale linearly with more resources? Congratulations - you can auto-scale!
  87. 87. NoSQL http://www.flickr.com/photos/wingler/3429634150/sizes/l/
  88. 88. CAP Theorem • Consistency Pick Two • Availability • Partition Tolerance
  89. 89. Most SQL Databases • Choose Consistency over all • Availability comes distant second
  90. 90. Web Applications need... • Availability • Partition Tolerance
  91. 91. “Global temporal consistency is a fiction” Christopher Brown
  92. 92. Choosing Consistency for your Web App... Means failure is global
  93. 93. When you choose Partition Tolerance and Availability... You fail or succeed for a subset of users
  94. 94. Apologies • Apologize after the fact for failures • Better than nothing at all
  95. 95. NoSQL • Many different tools • They tweak CAP differently • CouchDB • Cassandra • Redis • MongoDB
  96. 96. Scaling in the Cloud Speaker: Jesse Robbins CEO ‣ jesse@opscode.com ‣ @jesserobbins ‣ www.opscode.com Copyright © 2010 Opscode, Inc - All Rights Reserved 43
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×