Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Skeptics in the Church of Data Getting Evangelical

130 views

Published on

Presentation given at Zenoss GalaxZ'17 in Austin, TX.

As Technology Professionals we're used to monitoring our systems' health to make sure they're behaving properly, but is that really what's important to our businesses?

What can we change?
Who in our organization can we partner with to drive that change?
What tools can we use to make sure we serve the business properly?

Practicing Empathy & Creating a Safe, Blameless learning environment for feedback allows us to shift monitoring to our business's needs and start the trend towards rapid innovation.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Skeptics in the Church of Data Getting Evangelical

  1. 1. Skeptics in the Church of Data Getting Evangelical AaronAldrich–CageData/VictorOps @CrayZeigh#Galaxz17
  2. 2. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 2 Aaron Aldrich @CrayZeigh @cagedata @victorops
  3. 3. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 3
  4. 4. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 4 incidents happen and they suck
  5. 5. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 5 we monitor systems religiously
  6. 6. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 6 The Trinity of System Monitoring • Thou shalt monitor CPU Usage • Thou shalt track processes •Thou shalt monitor disk space •Thou shalt monitor I/Os • Thou shalt monitor memory availability • Thou shalt track activity Process Memory Disk
  7. 7. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 7 sacraments baptism confession repentance
  8. 8. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 8 100% uptime
  9. 9. Ein Minuten Bitte
  10. 10. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 10 monitoring resources makes sense when tracking physical system health
  11. 11. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 11 The New Data Center
  12. 12. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 12
  13. 13. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 13
  14. 14. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 14
  15. 15. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 15
  16. 16. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 16
  17. 17. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 17 if you’re deciding which alarms are important, you have too many
  18. 18. Empathetic Monitoring
  19. 19. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 19 start monitoring business metrics
  20. 20. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 20 revenue courtesey Leon Fayer of OmniTI (@papa_fire)
  21. 21. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 21 user latency courtesey Leon Fayer of OmniTI (@papa_fire)
  22. 22. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 22 courtesey Leon Fayer of OmniTI (@papa_fire) database performance
  23. 23. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 23 courtesey Leon Fayer of OmniTI (@papa_fire) decline rate (%)
  24. 24. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 24 how can I be a superhero?
  25. 25. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 25 “She doesn’t care whether or not [the data center is literally on fire] … just as long as his ship’s coming in…” -Cake, Italian Leather Sofa (lightly interpreted)
  26. 26. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 26 have a chat with your business
  27. 27. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 27 Spoiler Alert 90% of the time you’ll be listening
  28. 28. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 28 What happens on a normal day? What happens on a good day? What happens on a bad day?
  29. 29. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 29 If you could have insight into one piece of the organization, what would it be?
  30. 30. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 30 listen to your business
  31. 31. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 31 context is crucial
  32. 32. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 32 new allies become evangelists
  33. 33. New Partners
  34. 34. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 34
  35. 35. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 35 what about marketing?
  36. 36. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 36 (https://blogs.adobe.com/digitalmarketing/wp-content/uploads/2015/10/laxalt-fig1.jpg)
  37. 37. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 37
  38. 38. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 38
  39. 39. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 39
  40. 40. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 40 The Chasm (Moore – Crossing the Chasm 1991)
  41. 41. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 41
  42. 42. Reformation
  43. 43. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 43 change conducted poorly will break your organization
  44. 44. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 44 strict change enforcement creates unrest
  45. 45. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 45 …harder than you think …takes longer than you expect …self-initiated change is…
  46. 46. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 46 1.Flow 2.Feedback 3.Continuous Experimentation & Learning The Three Ways
  47. 47. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 47 1.Flow 2.Feedback 3.Continuous Experimentation & Learning The Three Ways
  48. 48. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 48 -enables continuous improvement Amplify Feedback Loops You Them
  49. 49. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 49 retrospectives
  50. 50. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 50 invite the whole business
  51. 51. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 51
  52. 52. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 52 Reframe the goal: we don’t want to find out what should have happened, we want to learn how to improve.
  53. 53. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 53
  54. 54. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 54 blame creates subject matter experts in information suppression
  55. 55. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 55 ritual is important
  56. 56. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 56 “Before we begin, I want to remind everyone that postmortems are blameless. We’re not here to discuss what should have or could have happened because we’re here to learn and gain new information for the future.”
  57. 57. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 57
  58. 58. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 58 • VictorOps Blameless Postmortem Guide 
 http://bit.ly/2nBAvq2
 (https://victorops.com/wp-content/uploads/2014/09/Blameless-Post-Mortems.pdf) • Chef Postmortem Template - http://bit.ly/2noY4S1
 (https://gist.github.com/btm/7cb421f5fe7d1003083a) • Etsy’s Debriefing Facilitation Guide 
 http://etsy.me/2iVP7Bj
 (https://extfiles.etsy.com/DebriefingFacilitationGuide.pdf) Retrospective Resources
  59. 59. The charge
  60. 60. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 60 stop thinking about your systems’ health and start thinking about your business’s health Be Skeptical of your Traditions
  61. 61. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 61 partner with data-driven departments in your org to proselytize the benefits of business monitoring Make new evangelists
  62. 62. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 62 build safe environments, amplify feedback and foster learning Safely Reform
  63. 63. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 63 Change the world
  64. 64. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 64 Change the world(Or at least your monitoring)
  65. 65. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 65 Thanks! @CrayZeigh Aaron Aldrich http://cageit.us/GalaxZ17 SlideShare:
  66. 66. © 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 66
  67. 67. 67 Boots

×