Your SlideShare is downloading. ×
Failure Happens Interop Nyc
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Failure Happens Interop Nyc

894
views

Published on

Published in: Technology, Travel

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
894
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Failure Happens F***, the F***ing thing is F***king F***ed* *Official WebOps term from Artur Bergman Jesse Robbins jesse@oreilly.com
  • 2. This will be on the test: FAILURE HAPPENS!
  • 3. 25% 75%
  • 4. 25% 75% Paranoid
  • 5. 25% Pyromaniac 75% Paranoid
  • 6. Good Book!
  • 7. “multiple and unexpected interactions of failures are inevitable” -­‐Charles  Perrow
  • 8. Failure Happens
  • 9. define: Nines (roughly)
  • 10. define: Nines (roughly) 99% 5256 min (3.5 days)
  • 11. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours )
  • 12. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min
  • 13. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min 99.999% 5 min
  • 14. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min 99.999% 5 min 99.9999% 30 Seconds
  • 15. define: Nines (roughly) 99% 5256 min (3.5 days) 99.9% 528 min ( 8.8 hours ) 99.99% 53 min 99.999% 5 min 99.9999% 30 Seconds 99.99999% 3 Seconds
  • 16. Internet Routing... won’t.
  • 17. ;''-1(<"=/-)"3.1>0?-'"@'-': !"#$$%"&'(')*)"+,-.,-/01,( +/.01210*"345467"89: #
  • 18. #googlefail
  • 19. YOU
  • 20. Continuous Power... isn’t
  • 21. 365 Main SF
  • 22. 365 364.96 Main SF
  • 23. Failure happens A single datacenter is the problem • Since they all fail at some point Recovery procedures after failure • Power was gone ~45 minutes • Most services took hours to come back • Some unnamed ones more than 12 hours
  • 24. Truck 1, Rackspace 0
  • 25. Geography is a Single Point of Failure
  • 26. +2304,$5%67"#,-8$1 !"#$%#&'()(#*&+,&!"#$%&!'()* #%-#%*%,.&'(/,.#+%*&0+.1&-#%2+3&(/."4%*&(2&".&)%"*.&5678 !"#$%&''( +#,$-#$,%./-$0,1 )*
  • 27. Taser weilding robbers C I Hosts' Chicago facility robbed twice! (the other two times were merely "break-ins where things were stolen")
  • 28. Providers are baskets too.
  • 29. Failure Happens. Anyone promising otherwise is either foolish or lying (or both).
  • 30. Go Here! Jesse Robbins jesse@oreilly.com