Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Biases in Testing

550 views

Published on

Testing is a performance and people are at its center. Biases are part of human nature and thus, they will influence our work as testers.
In this session, I will talk about a series of biases that are present in our day to day work. My aim is to challenge the ways we do what we do, analyze the reasons behind our actions and attempt to come up with a few suggestions on how we can manage our biases.

Published in: Technology

Biases in Testing

  1. 1. http://www.satisfice.com http://jitariustudio.com https://twitter.com/LauraOniga
  2. 2. Biases are Like Default Config Settings ● Default browser ● Templates in MS word ● Default home page ● Default video recording mode By settings, I mean input that persists over time, regardless of the context.
  3. 3. https://bit.ly/2cLiSPO Buster Benson
  4. 4. To “see” something you often have to understand it, first. This is a meaningful icon that represents testable functionality. This is just pretty. Some people (incorrectly) assume this is a decoration and don’t think to test it. Almost all people (correctly) assume this is a decoration and don’t consider testing it.
  5. 5. Eyesight Bias What you see is more likely to be tested ● GUI focused vs. backend focused ● Recognizable objects ● In front of you ● Colours ● Animations ● Functional controls What you see is not all there is.
  6. 6. Eyesight Bias What you see is more likely to be tested ● Slow down ● Get experience with the product ● Use categories & checklists ● Look behind the scenes ● What’s different from what I already said?
  7. 7. User Persona Bias What user persona are you when testing? ● Previous experiences with similar products ● Freshness of the experiences ● We consider the users we understand ● Mood factor Not everyone uses technology as you do.
  8. 8. User Persona Bias What user persona are you when testing? ● Make a list of potential different users ● Watch real users interact with the product ● Interview tech support or customer service people ● Use guidewords to help yourself debias
  9. 9. ● Novice vs. Expert ● Admin vs. Ordinary User ● Focused vs. Distracted ● Fully Able vs. Disabled ● One User vs. Multi-User ● Fast vs. Slow Machine ● Friendly vs. Malicious ● Reliable vs. Unreliable Network ● Occasional vs. Routine vs. Intensive ● Touchscreen vs. Keyboard ● Single vs. Split Platform ● Big vs. Small Screen ● Enthusiast vs. Apathetic ASPECTS OF THE USER ASPECTS OF THE TECHNOLOGY ● Outside vs. Indoors Usage ● Private vs. Public Use ● Day vs. Night Usage ASPECTS OF THE ENVIRONMENT ASPECTS OF THE USAGE PATTERN
  10. 10. Low Hanging Fruit Bias What data are you using when testing? ● New data = time & energy ● Re-using the same old files ● Typing what’s easy to type ● Accepting defaults Don’t just get the low hanging fruit!
  11. 11. Low Hanging Fruit Bias What data are you using when testing? ● Explain it to yourself ● Invest energy ● Random data generator ● Data coverage maps ● Diversification test sessions ● Make a picture of the data
  12. 12. ...of what’s not there. Be more aware… Review Your Settings
  13. 13. https://twitter.com/LauraOniga https://www.linkedin.com/in/lauraoniga/

×