Metrics gone bad

  • 251 views
Uploaded on

Situational awareness is vital in any situation. If you are unaware of an issue, then you are in a poor position to fix it. However, there is a natural human response to the publication of metrics, …

Situational awareness is vital in any situation. If you are unaware of an issue, then you are in a poor position to fix it. However, there is a natural human response to the publication of metrics, which is to optimise for what is measured. Here are some cautionary tales of how performance metrics inadvertently created incentives for behaviour that was bad for the system.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
251
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
4
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. This Summer, don't miss: Metrics Gone Bad Featuring: Dave Neary dneary@redhat.com
  • 2. How things go bad ● Metrics should result in action ● Metrics create incentives ● Sometimes, metrics create destructive incentives ● People are weird
  • 3. Setting the wrong incentives
  • 4. Measuring the wrong things
  • 5. Myopia
  • 6. Drawing the wrong conclusions
  • 7. Conclusion ● Be careful what you measure – metrics create incentives ● Focus on business and community success measurements ● Use qualitative and quantitative analysis to interpret metrics