Your SlideShare is downloading. ×
0
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Failure Happens Interop Nyc
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Failure Happens Interop Nyc

922

Published on

Published in: Technology, Travel
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
922
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Failure Happens F***, the F***ing thing is F***king F***ed* *Official WebOps term from Artur Bergman Jesse Robbins jesse@oreilly.com
  • 2. This will be on the test: FAILURE HAPPENS!
  • 3. 25% 75%
  • 4. 25% 75% Paranoid
  • 5. 25% Pyromaniac 75% Paranoid
  • 6. Good Book!
  • 7. “multiple and unexpected interactions of failures are inevitable” -­‐Charles  Perrow
  • 8. Failure Happens
  • 9. define: Nines (roughly)
  • 10. define: Nines (roughly) 99% 5256 min (3.5 days)
  • 11. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours )
  • 12. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min
  • 13. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min 99.999% 5 min
  • 14. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min 99.999% 5 min 99.9999% 30 Seconds
  • 15. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min 99.999% 5 min 99.9999% 30 Seconds 99.99999% 3 Seconds
  • 16. Internet Routing... won’t.
  • 17. ;''-1(<"=/-)"3.1>0?-'"@'-': !"#$$%"&'(')*)"+,-.,-/01,( +/.01210*"345467"89: #
  • 18. #googlefail
  • 19. YOU
  • 20. Continuous Power... isn’t
  • 21. 365 Main SF
  • 22. 365 364.96 Main SF
  • 23. Failure happens A single datacenter is the problem • Since they all fail at some point Recovery procedures after failure • Power was gone ~45 minutes • Most services took hours to come back • Some unnamed ones more than 12 hours
  • 24. Truck 1, Rackspace 0
  • 25. Geography is a Single Point of Failure
  • 26. +2304,$5%67"#,-8$1 !"#$%#&'()(#*&+,&!"#$%&!'()* #%-#%*%,.&'(/,.#+%*&0+.1&-#%2+3&(/."4%*&(2&".&)%"*.&5678 !"#$%&''( +#,$-#$,%./-$0,1 )*
  • 27. Taser weilding robbers C I Hosts' Chicago facility robbed twice! (the other two times were merely "break-ins where things were stolen")
  • 28. Providers are baskets too.
  • 29. Failure Happens. Anyone promising otherwise is either foolish or lying (or both).
  • 30. Go Here! Jesse Robbins jesse@oreilly.com

×