Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureStack16]

Rock Stars, Builders, and Janitors: You're Doing It Wrong

Speaker: Alice Goldfuss, Site Reliability Engineer, New Relic

  • Be the first to comment

Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureStack16]

  1. 1. Confidential ©2008-15 New Relic, Inc. All rights reserved. Rockstars, Builders and Janitors: You’re doing it wrong! Alice Goldfuss, Site Reliability Engineer, New Relic
  2. 2. Confidential ©2008-15 New Relic, Inc. All rights reserved. 2 Rockstars JanitorsBuilders @alicegoldfuss You’re doing it wrong
  3. 3. Confidential ©2008-15 New Relic, Inc. All rights reserved. This document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission. Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,” “expects” or words of similar import. Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings New Relic makes with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at ir.newrelic.com or the SEC’s website at www.sec.gov. New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.
  4. 4. Confidential ©2008-15 New Relic, Inc. All rights reserved. 4 • Built new features / tools / systems Scaled existing ones Cleaned up existing ones In the past 3 months, have you mainly:
  5. 5. Confidential ©2008-15 New Relic, Inc. All rights reserved. I’m Alice 5 SRE @
  6. 6. Confidential ©2008-15 New Relic, Inc. All rights reserved. 6
  7. 7. Confidential ©2008-15 New Relic, Inc. All rights reserved. 7 • Define the roles Examine the current environment Discuss a better way
  8. 8. Confidential ©2008-15 New Relic, Inc. All rights reserved. 8 Rockstar
  9. 9. Confidential ©2008-15 New Relic, Inc. All rights reserved. 9 Rockstar Strengths Curious and open-minded Can iterate fast Always looking to the next thing
  10. 10. Confidential ©2008-15 New Relic, Inc. All rights reserved. 10 Rockstar Weaknesses Get bored easily No patience for maintenance Not used to thinking about end user experience
  11. 11. Confidential ©2008-15 New Relic, Inc. All rights reserved. Builder 11
  12. 12. Confidential ©2008-15 New Relic, Inc. All rights reserved. 12 Builder Strengths Understand scale Value reliability Good at catching “what ifs” that others miss
  13. 13. Confidential ©2008-15 New Relic, Inc. All rights reserved. 13 Builder Weaknesses Can move slow while trying to build out Have hard time letting things go Can be resident doom-sayers
  14. 14. Confidential ©2008-15 New Relic, Inc. All rights reserved. Janitor 14
  15. 15. Confidential ©2008-15 New Relic, Inc. All rights reserved. 15 Janitor Strengths Understands the weaknesses in your systems Really good at bandaids Able to do a lot with a little
  16. 16. Confidential ©2008-15 New Relic, Inc. All rights reserved. 16 Janitor Weaknesses Can often resort to cleaning manually instead of automating Often gets stuck down in the weeds Resistant to change
  17. 17. Confidential ©2008-15 New Relic, Inc. All rights reserved. 17 Rockstars Janitors Builders
  18. 18. Confidential ©2008-15 New Relic, Inc. All rights reserved. 18 Rockstars Janitors Builders
  19. 19. Confidential ©2008-15 New Relic, Inc. All rights reserved. 19 Organic == Good?
  20. 20. Confidential ©2008-15 New Relic, Inc. All rights reserved. 20 GMO
  21. 21. Confidential ©2008-15 New Relic, Inc. All rights reserved. 21 GMO Greater Mobility, Okay?
  22. 22. Confidential ©2008-15 New Relic, Inc. All rights reserved. 22 • They get stuck
  23. 23. Confidential ©2008-15 New Relic, Inc. All rights reserved. 23 • They get stuck They get tunnel vision
  24. 24. Confidential ©2008-15 New Relic, Inc. All rights reserved. 24 Current State of Tech
  25. 25. Confidential ©2008-15 New Relic, Inc. All rights reserved. 25
  26. 26. Confidential ©2008-15 New Relic, Inc. All rights reserved. 26 117 responses
  27. 27. Confidential ©2008-15 New Relic, Inc. All rights reserved. 27 47.9 % Currently Rockstars
  28. 28. Confidential ©2008-15 New Relic, Inc. All rights reserved. 28 55.2 % Want to be Rockstars
  29. 29. Confidential ©2008-15 New Relic, Inc. All rights reserved. 29 19.7 % Currently Builders
  30. 30. Confidential ©2008-15 New Relic, Inc. All rights reserved. 30 35.3 % Want to be Builders
  31. 31. Confidential ©2008-15 New Relic, Inc. All rights reserved. 31 32.5 % Currently Janitors
  32. 32. Confidential ©2008-15 New Relic, Inc. All rights reserved. 32 9.5 % Want to be Janitors
  33. 33. Confidential ©2008-15 New Relic, Inc. All rights reserved. 33 47.9 % 19.7 % 32.5 % Current State Rockstars Builders Janitors
  34. 34. Confidential ©2008-15 New Relic, Inc. All rights reserved. 34 55.2 % 35.3 % 9.5 % Preferred State RockstarsBuilders Janitors
  35. 35. Confidential ©2008-15 New Relic, Inc. All rights reserved. 35 70.9 % 70.9% of Rockstars are Devs
  36. 36. Confidential ©2008-15 New Relic, Inc. All rights reserved. 36 58.3 % 58.3% of Janitors are Ops
  37. 37. Confidential ©2008-15 New Relic, Inc. All rights reserved. 37 54.4 % 54.4% of Builders are Devs
  38. 38. Confidential ©2008-15 New Relic, Inc. All rights reserved. 38 55.0 % 55% who want to be Builders are Ops
  39. 39. Confidential ©2008-15 New Relic, Inc. All rights reserved. 39 70. 9 % 58. 3 % 54. 4 % Dev OpsDev Rockstars Builders Janitors
  40. 40. Confidential ©2008-15 New Relic, Inc. All rights reserved. 40 26.3 % 26.3% think work distribution on team is unfair
  41. 41. Confidential ©2008-15 New Relic, Inc. All rights reserved. 41 49.1 % 49.1% think work distribution in company is unfair
  42. 42. Confidential ©2008-15 New Relic, Inc. All rights reserved. 42 people unhappy / not doing the work they want
  43. 43. Confidential ©2008-15 New Relic, Inc. All rights reserved. 43 can try to make something like reliability a first class citizen, but people confuse that with not changing anything, so it’s a tough sell Focus on Reliability
  44. 44. Confidential ©2008-15 New Relic, Inc. All rights reserved. 44 can try rotating responsibilities across teams, but some teams will be better at some tasks than others, and this will evolve back into an imbalance Rotate Teams
  45. 45. Confidential ©2008-15 New Relic, Inc. All rights reserved. 45 what to do? What to do?
  46. 46. Confidential ©2008-15 New Relic, Inc. All rights reserved. 46 Ursula Le Guin
  47. 47. Confidential ©2008-15 New Relic, Inc. All rights reserved. 47The Left Hand of Darkness
  48. 48. Confidential ©2008-15 New Relic, Inc. All rights reserved. 48 “No physiological habit is established, and the mother of several children may be the father of several more.”
  49. 49. Confidential ©2008-15 New Relic, Inc. All rights reserved. 49 “Burden and privilege are shared out pretty equally; everybody has the same risk to run or choice to make. ”
  50. 50. Confidential ©2008-15 New Relic, Inc. All rights reserved. 50 Have everyone do everything
  51. 51. Confidential ©2008-15 New Relic, Inc. All rights reserved. 51 what??
  52. 52. Confidential ©2008-15 New Relic, Inc. All rights reserved. 52
  53. 53. Confidential ©2008-15 New Relic, Inc. All rights reserved. 53 That’s not what this is
  54. 54. Confidential ©2008-15 New Relic, Inc. All rights reserved. 54
  55. 55. Confidential ©2008-15 New Relic, Inc. All rights reserved. 55 Remove the Blinders
  56. 56. Confidential ©2008-15 New Relic, Inc. All rights reserved. Build better 56
  57. 57. Confidential ©2008-15 New Relic, Inc. All rights reserved. Foster new skills 57
  58. 58. Confidential ©2008-15 New Relic, Inc. All rights reserved. 58 Rotate
  59. 59. Confidential ©2008-15 New Relic, Inc. All rights reserved. 59
  60. 60. Confidential ©2008-15 New Relic, Inc. All rights reserved. 60 4 engineers
  61. 61. Confidential ©2008-15 New Relic, Inc. All rights reserved. 61 1 week janitor 1 week builder 2 weeks rockstar
  62. 62. Confidential ©2008-15 New Relic, Inc. All rights reserved. 62 50.0 % 25.0 % 25.0 % Proposed State Rockstar Builder Janitor
  63. 63. Confidential ©2008-15 New Relic, Inc. All rights reserved. 63 55.2 % 35.3 % 9.5 % Preferred State RockstarsBuilders Janitors
  64. 64. Confidential ©2008-15 New Relic, Inc. All rights reserved. 64 Technical debt
  65. 65. Confidential ©2008-15 New Relic, Inc. All rights reserved. 65 Velocity!
  66. 66. Confidential ©2008-15 New Relic, Inc. All rights reserved. 66
  67. 67. Confidential ©2008-15 New Relic, Inc. All rights reserved. 67 Productivity = Size(TechDebt) Size(System) 1 - Griffith, C. Izurieta, H. Taffahi, and D. Claudio, “A simulation study of practical methods for technical debt m http://www.gregerwikstrand.com/technical-debt-reduction/
  68. 68. Confidential ©2008-15 New Relic, Inc. All rights reserved. 68 case study
  69. 69. Confidential ©2008-15 New Relic, Inc. All rights reserved. missioned 1,139 applications in 201 ced systems 7,000 to 4,200 in three 69 “The Digital Transformation Symphony: When IT and Business Play in Sync” http://www.slideshare.net/cap
  70. 70. Confidential ©2008-15 New Relic, Inc. All rights reserved. 70 Reduced debt by €14 billion “The Digital Transformation Symphony: When IT and Business Play in Sync” http://www.slideshare.net/cap
  71. 71. Confidential ©2008-15 New Relic, Inc. All rights reserved. 71 Where to start?
  72. 72. Confidential ©2008-15 New Relic, Inc. All rights reserved. 72 Ops team
  73. 73. Confidential ©2008-15 New Relic, Inc. All rights reserved. 73 firefighting
  74. 74. Confidential ©2008-15 New Relic, Inc. All rights reserved. 74 pile of sustaining work
  75. 75. Confidential ©2008-15 New Relic, Inc. All rights reserved. 75 pile of sustaining work Don’t punish your ops team for your dev team’s SHITTY CODE
  76. 76. Confidential ©2008-15 New Relic, Inc. All rights reserved. 76 • What are you worried about?
  77. 77. Confidential ©2008-15 New Relic, Inc. All rights reserved. 77 • What are you worried about? What could we do better?
  78. 78. Confidential ©2008-15 New Relic, Inc. All rights reserved. 78 • What are you worried about? What could we do better? What do you want to add?
  79. 79. Confidential ©2008-15 New Relic, Inc. All rights reserved. 79 devs overburdened
  80. 80. Confidential ©2008-15 New Relic, Inc. All rights reserved. 80 devs overburdened GOOD
  81. 81. Confidential ©2008-15 New Relic, Inc. All rights reserved. 81
  82. 82. Confidential ©2008-15 New Relic, Inc. All rights reserved. 82
  83. 83. Confidential ©2008-15 New Relic, Inc. All rights reserved. 83 Rockstar tasks New feature / tool / system Research new projects Demo mockups
  84. 84. Confidential ©2008-15 New Relic, Inc. All rights reserved. 84 Builder tasks Improve testing Improve service resiliency Understand greater impact
  85. 85. Confidential ©2008-15 New Relic, Inc. All rights reserved. 85 Janitor tasks Bug fixes Refactoring Config cleanup
  86. 86. Confidential ©2008-15 New Relic, Inc. All rights reserved. 86 • What are you worried about?
  87. 87. Confidential ©2008-15 New Relic, Inc. All rights reserved. 87 • What are you worried about? What could we do better?
  88. 88. Confidential ©2008-15 New Relic, Inc. All rights reserved. 88 • What are you worried about? What could we do better? What do you want to add?
  89. 89. Confidential ©2008-15 New Relic, Inc. All rights reserved. 89 47.9 % 19.7 % 32.5 % Current State Rockstars Builders Janitors
  90. 90. Confidential ©2008-15 New Relic, Inc. All rights reserved. 90 • Define the roles
  91. 91. Confidential ©2008-15 New Relic, Inc. All rights reserved. 91
  92. 92. Confidential ©2008-15 New Relic, Inc. All rights reserved. 92 • Define the roles Examine the current environment
  93. 93. Confidential ©2008-15 New Relic, Inc. All rights reserved. 93 47.9 % 19.7 % 32.5 % Current State Rockstars Builders Janitors
  94. 94. Confidential ©2008-15 New Relic, Inc. All rights reserved. 94 55.2 % 35.3 % 9.5 % Preferred State RockstarsBuilders Janitors
  95. 95. Confidential ©2008-15 New Relic, Inc. All rights reserved. 95 • Define the roles Examine the current environment Discuss a better way
  96. 96. Confidential ©2008-15 New Relic, Inc. All rights reserved. 96
  97. 97. Confidential ©2008-15 New Relic, Inc. All rights reserved. 97 50.0 % 25.0 % 25.0 % Future State Rockstar Builder Janitor
  98. 98. Confidential ©2008-15 New Relic, Inc. All rights reserved. Thanks! 98 @alicegoldfuss
  99. 99. Confidential ©2008-15 New Relic, Inc. All rights reserved. 99 This document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission. Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,” “expects” or words of similar import. Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at ir.newrelic.com or the SEC’s website at www.sec.gov. New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.
  100. 100. Confidential ©2008-15 New Relic, Inc. All rights reserved. 100 1 https://www.flickr.com/photos/lydur/22006675124/ 1 https://www.flickr.com/photos/qilin/491356901 16 https://commons.wikimedia.org/wiki/File:St_Anger_Album_Artwork.png 22 https://www.flickr.com/photos/tamakisono/14903068219 40 https://www.flickr.com/photos/46799485@N00/4470761409 43 https://www.flickr.com/photos/christinagallivan/8660375888/ 44 Photo by Jack Liu, 2014 45 https://queerscifi.com/for-readers-the-new-pronouns/ 49 https://www.flickr.com/photos/greencolander/3203922211 50 https://upload.wikimedia.org/wikipedia/commons/e/ee/Woodwards_building Image credits
  101. 101. Confidential ©2008-15 New Relic, Inc. All rights reserved. 101 53 https://www.flickr.com/photos/3059349393/8000156483/ 54 https://www.flickr.com/photos/dalbera/4923032712/ 56 https://www.flickr.com/photos/moonlightbulb/8025527585/ 57 https://www.flickr.com/photos/dafnecholet/5374200948 62 https://www.flickr.com/photos/alebonvini/4757651199 63 https://www.flickr.com/photos/dave_see/15132684184 64 https://www.flickr.com/photos/diversey/1623358150/ 70 https://www.flickr.com/photos/expertinfantry/ 71 https://www.flickr.com/photos/adambelles/5044281763/ 72 https://www.flickr.com/photos/cogdog/9090732482/ 77 https://www.flickr.com/photos/twalmsley/5545712341 79 https://www.flickr.com/photos/athomeinscottsdale/3279949186/ 80 https://www.flickr.com/photos/modofodo/14964870008/

    Be the first to comment

    Login to see the comments

  • KapilVirenAhuja

    Dec. 7, 2016

Rock Stars, Builders, and Janitors: You're Doing It Wrong Speaker: Alice Goldfuss, Site Reliability Engineer, New Relic

Views

Total views

621

On Slideshare

0

From embeds

0

Number of embeds

0

Actions

Downloads

10

Shares

0

Comments

0

Likes

1

×