Implementing Private Clouds
Andrew Clay Shafer
QCon SF 2010
Andrew Clay Shafer
@littleidea
Andrew Clay Shafer
@littleidea
Andrew Clay Shafer
@littleidea
Andrew Clay Shafer
@littleidea
Andrew Clay Shafer
@littleidea
Andrew Clay Shafer
@littleidea
Andrew Clay Shafer
@littleidea
real artists ship
great artists steal
pri·vate
http://www.flickr.com/photos/athomeinscottsdale/3279949186/
pri·vate
• confined to or intended
only for the persons
immediately concerned;
confidential
http://www.flickr.com/photos/at...
pri·vate
• confined to or intended
only for the persons
immediately concerned;
confidential
• not open or accessible
to th...
pri·vate
• confined to or intended
only for the persons
immediately concerned;
confidential
• not open or accessible
to th...
cloud
cloud
- noun
• a dim or obscure area
in something
otherwise clear or
transparent.
cloud
- noun
• a dim or obscure area
in something
otherwise clear or
transparent.
- verb
• to make obscure or
indistinct; ...
Chance of Tangential Ranting
and Meandering Editorialization
Warning
is_a?(Cloud)
Cloud
Taxonomies
Cloud
Taxonomies
Cloud
Taxonomies
Too Much *aaS
Cloud
Standards
Cloud
Standards
Cloud
Standards
I have no standards.
If someone tells you they have a cloud solution you
can install in a rack...
If someone tells you they have a cloud solution you
can install in a rack...
ask them for the brochure with the architectu...
If someone tells you they have a cloud solution you
can install in a rack...
ask them for the brochure with the architectu...
If someone tells you they have a cloud solution you
can install in a rack...
ask them for the brochure with the architectu...
Where did cloud arise?
Where did cloud arise?
Where did cloud arise?
Where did cloud arise?
Where did cloud arise?
Where did cloud arise?
Industrial Revolution
Revolutionized
Scale Changes Everything
So, you are sold, you are ready to build your
own robotics IT factory, what’s next?
Shall we build a compute cloud?
NO
We will build web applications that brokers
access to compute resources.
NO
Automation
Automation
Abstraction
Automation
Abstraction
Reliability
Automation
Abstraction
Reliability
Innovation
Automation
Abstraction
Reliability
Innovation
Disruption
To hypervise or not to hypervise, that is the question?
To hypervise or not to hypervise, that is the question?
So many choices
“It works at my desk”
quacks_like_a?(Cloud)
Reliability...
6 Laws Of Reliability
Isolation
Concurrency
Failure Detection
Fault Identification
Live Upgrade
Stable Storage
6 Laws Of Reliability
Isolation
Concurrency
Failure Detection
Fault Identification
Live Upgrade
Stable Storage
Joe Armstrong
if p( fail | one unit) = 10-3 then
p( fail | n units) = 10-3xn
Isolation
if p( fail | one unit) = 10-3 then
p( fail | n units) = 10-3xn
Isolation
So 10 nines should be easy, we
just need 4 units,...
n > 1
Concurrent
Problem Solved?
Cloudin’ it up
Cloudin’ it up
Sorta...
Simple Services: Single Responsibility
Some people, when confronted with a problem,
think “I know, I'll use a message bus.”
Some people, when confronted with a problem,
think “I know, I'll use a message bus.”
Now they have queue problems.
The plot thickens...
Users? Images?
Kernels?
Metering?
Performance?
Auditing? Upgrades?
Deployment?
Security?
Authenticati...
Complexity Much?
Users? Images?
Kernels?
Metering?
Performance?
Auditing? Upgrades?
Deployment?
Security?
Authentication?
...
But wait, the cloud IS an application?
How do we build and deploy that?
automate the automation
automate the automation
If it’s not meta-circular, you are doin’ it wrong.
Configuration Management
Configuration Management
solve this problem
Developers, Developers,
Developers...
Developers, Developers,
Developers...
It’s the applications stupid...
How do you deliver value?
Continuous Delivery/
Deployment
Black’s Theorem:
the wrong abstraction is worse than no abstraction.
Live Upgrade
Live Upgrade
systems that never stop
Speaking of frameworks...
Communities of Practice
Communities of Practice
6 Laws Of Reliability
6 Laws Of Reliability
Isolation
Concurrency
Failure Detection
Fault Identification
Live Upgrade
Stable Storage
6 Laws Of Reliability
Isolation
Concurrency
Failure Detection
Fault Identification
Live Upgrade
Stable Storage
unmentionabl...
6 Laws Of Reliability
Isolation
Concurrency
Failure Detection
Fault Identification
Live Upgrade
Stable Storage
unmentionabl...
If a cloud falls in a forest and no one is there to
hear it, do we still have 100% uptime?
Undeliberate
Discovery
oh.
Undeliberate
Discovery
oh.
Oh!
Undeliberate
Discovery
oh.
Oh!
WTF?!??
Undeliberate
Discovery
oh.
Oh!
WTF?!??
OMG?!??
Undeliberate
Discovery
oh.
Oh!
WTF?!??
OMG?!??
Undeliberate
Discovery
*crying*
Untested Vs. Unmonitored
Untested Vs. Unmonitored
a well behaved cloud should inform you of it's health
Cloud Hobbyists
TCO and ROI crossing the chasm
cause cloudin’ ain’t easy
cause cloudin’ ain’t easy
scale
cause cloudin’ ain’t easy
web ops
scale
cause cloudin’ ain’t easy
web ops
networkingscale
cause cloudin’ ain’t easy
web ops
networking
storage
scale
cause cloudin’ ain’t easy
web ops
networking
storage
scale
power
cause cloudin’ ain’t easy
web ops
networking
storage
scale
coolingpower
cause cloudin’ ain’t easy
web ops
networking
storage
scale
coolingpower
people
cause cloudin’ ain’t easy
web ops
networking
storage
scale
coolingpower
support
people
cause cloudin’ ain’t easy
web ops
networking
storage
scale
coolingpower
training
support
people
SO YOU THINK YOU CAN
CLOUD
SO YOU THINK YOU CAN
CLOUD now holding auditions across the
world, looking for the top clouders...
fin
andrew@cloudscaling.com
@littleidea
•IRC and mailing lists
•http://cloudscaling.com/blog
•http://perspectives.mvdirona.com/
•http://www.kitchensoap.com/
•http...
Building private-clouds-qconsf
Building private-clouds-qconsf
Building private-clouds-qconsf
Building private-clouds-qconsf
Upcoming SlideShare
Loading in...5
×

Building private-clouds-qconsf

1,452

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,452
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
22
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Building private-clouds-qconsf

  1. 1. Implementing Private Clouds Andrew Clay Shafer QCon SF 2010
  2. 2. Andrew Clay Shafer @littleidea
  3. 3. Andrew Clay Shafer @littleidea
  4. 4. Andrew Clay Shafer @littleidea
  5. 5. Andrew Clay Shafer @littleidea
  6. 6. Andrew Clay Shafer @littleidea
  7. 7. Andrew Clay Shafer @littleidea
  8. 8. Andrew Clay Shafer @littleidea
  9. 9. real artists ship
  10. 10. great artists steal
  11. 11. pri·vate http://www.flickr.com/photos/athomeinscottsdale/3279949186/
  12. 12. pri·vate • confined to or intended only for the persons immediately concerned; confidential http://www.flickr.com/photos/athomeinscottsdale/3279949186/
  13. 13. pri·vate • confined to or intended only for the persons immediately concerned; confidential • not open or accessible to the general public http://www.flickr.com/photos/athomeinscottsdale/3279949186/
  14. 14. pri·vate • confined to or intended only for the persons immediately concerned; confidential • not open or accessible to the general public • undertaken individually or personally http://www.flickr.com/photos/athomeinscottsdale/3279949186/
  15. 15. cloud
  16. 16. cloud - noun • a dim or obscure area in something otherwise clear or transparent.
  17. 17. cloud - noun • a dim or obscure area in something otherwise clear or transparent. - verb • to make obscure or indistinct; confuse
  18. 18. Chance of Tangential Ranting and Meandering Editorialization Warning
  19. 19. is_a?(Cloud)
  20. 20. Cloud Taxonomies
  21. 21. Cloud Taxonomies
  22. 22. Cloud Taxonomies Too Much *aaS
  23. 23. Cloud Standards
  24. 24. Cloud Standards
  25. 25. Cloud Standards I have no standards.
  26. 26. If someone tells you they have a cloud solution you can install in a rack...
  27. 27. If someone tells you they have a cloud solution you can install in a rack... ask them for the brochure with the architecture...
  28. 28. If someone tells you they have a cloud solution you can install in a rack... ask them for the brochure with the architecture... and how much it costs...
  29. 29. If someone tells you they have a cloud solution you can install in a rack... ask them for the brochure with the architecture... and how much it costs... and if they will throw in a free bridge.
  30. 30. Where did cloud arise?
  31. 31. Where did cloud arise?
  32. 32. Where did cloud arise?
  33. 33. Where did cloud arise?
  34. 34. Where did cloud arise?
  35. 35. Where did cloud arise?
  36. 36. Industrial Revolution
  37. 37. Revolutionized
  38. 38. Scale Changes Everything
  39. 39. So, you are sold, you are ready to build your own robotics IT factory, what’s next? Shall we build a compute cloud?
  40. 40. NO
  41. 41. We will build web applications that brokers access to compute resources. NO
  42. 42. Automation
  43. 43. Automation Abstraction
  44. 44. Automation Abstraction Reliability
  45. 45. Automation Abstraction Reliability Innovation
  46. 46. Automation Abstraction Reliability Innovation Disruption
  47. 47. To hypervise or not to hypervise, that is the question?
  48. 48. To hypervise or not to hypervise, that is the question? So many choices
  49. 49. “It works at my desk”
  50. 50. quacks_like_a?(Cloud)
  51. 51. Reliability...
  52. 52. 6 Laws Of Reliability Isolation Concurrency Failure Detection Fault Identification Live Upgrade Stable Storage
  53. 53. 6 Laws Of Reliability Isolation Concurrency Failure Detection Fault Identification Live Upgrade Stable Storage Joe Armstrong
  54. 54. if p( fail | one unit) = 10-3 then p( fail | n units) = 10-3xn Isolation
  55. 55. if p( fail | one unit) = 10-3 then p( fail | n units) = 10-3xn Isolation So 10 nines should be easy, we just need 4 units, amirite?
  56. 56. n > 1 Concurrent
  57. 57. Problem Solved?
  58. 58. Cloudin’ it up
  59. 59. Cloudin’ it up Sorta...
  60. 60. Simple Services: Single Responsibility
  61. 61. Some people, when confronted with a problem, think “I know, I'll use a message bus.”
  62. 62. Some people, when confronted with a problem, think “I know, I'll use a message bus.” Now they have queue problems.
  63. 63. The plot thickens... Users? Images? Kernels? Metering? Performance? Auditing? Upgrades? Deployment? Security? Authentication? Server Size?
  64. 64. Complexity Much? Users? Images? Kernels? Metering? Performance? Auditing? Upgrades? Deployment? Security? Authentication? Server Size?
  65. 65. But wait, the cloud IS an application?
  66. 66. How do we build and deploy that?
  67. 67. automate the automation
  68. 68. automate the automation If it’s not meta-circular, you are doin’ it wrong.
  69. 69. Configuration Management
  70. 70. Configuration Management solve this problem
  71. 71. Developers, Developers, Developers...
  72. 72. Developers, Developers, Developers... It’s the applications stupid...
  73. 73. How do you deliver value?
  74. 74. Continuous Delivery/ Deployment
  75. 75. Black’s Theorem: the wrong abstraction is worse than no abstraction.
  76. 76. Live Upgrade
  77. 77. Live Upgrade systems that never stop
  78. 78. Speaking of frameworks...
  79. 79. Communities of Practice
  80. 80. Communities of Practice
  81. 81. 6 Laws Of Reliability
  82. 82. 6 Laws Of Reliability Isolation Concurrency Failure Detection Fault Identification Live Upgrade Stable Storage
  83. 83. 6 Laws Of Reliability Isolation Concurrency Failure Detection Fault Identification Live Upgrade Stable Storage unmentionables
  84. 84. 6 Laws Of Reliability Isolation Concurrency Failure Detection Fault Identification Live Upgrade Stable Storage unmentionables WWJAD
  85. 85. If a cloud falls in a forest and no one is there to hear it, do we still have 100% uptime?
  86. 86. Undeliberate Discovery
  87. 87. oh. Undeliberate Discovery
  88. 88. oh. Oh! Undeliberate Discovery
  89. 89. oh. Oh! WTF?!?? Undeliberate Discovery
  90. 90. oh. Oh! WTF?!?? OMG?!?? Undeliberate Discovery
  91. 91. oh. Oh! WTF?!?? OMG?!?? Undeliberate Discovery *crying*
  92. 92. Untested Vs. Unmonitored
  93. 93. Untested Vs. Unmonitored a well behaved cloud should inform you of it's health
  94. 94. Cloud Hobbyists
  95. 95. TCO and ROI crossing the chasm
  96. 96. cause cloudin’ ain’t easy
  97. 97. cause cloudin’ ain’t easy scale
  98. 98. cause cloudin’ ain’t easy web ops scale
  99. 99. cause cloudin’ ain’t easy web ops networkingscale
  100. 100. cause cloudin’ ain’t easy web ops networking storage scale
  101. 101. cause cloudin’ ain’t easy web ops networking storage scale power
  102. 102. cause cloudin’ ain’t easy web ops networking storage scale coolingpower
  103. 103. cause cloudin’ ain’t easy web ops networking storage scale coolingpower people
  104. 104. cause cloudin’ ain’t easy web ops networking storage scale coolingpower support people
  105. 105. cause cloudin’ ain’t easy web ops networking storage scale coolingpower training support people
  106. 106. SO YOU THINK YOU CAN CLOUD
  107. 107. SO YOU THINK YOU CAN CLOUD now holding auditions across the world, looking for the top clouders...
  108. 108. fin andrew@cloudscaling.com @littleidea
  109. 109. •IRC and mailing lists •http://cloudscaling.com/blog •http://perspectives.mvdirona.com/ •http://www.kitchensoap.com/ •http://www.planetdevops.net/ •http://www.jedi.be/blog/ •http://highscalability.com/ •Velocity, Surge, LISA
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×