Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Testing is magic!

577 views

Published on

Доклад Olivier Denoo на конференции SQA Days-21
www.sqadays.com

Published in: Education
  • Be the first to comment

  • Be the first to like this

Testing is magic!

  1. 1. Me, myself and I…
  2. 2. The only real magic is what you see in the eyes of the audience…all the rest is illusion and neuropsychology Testing is magic
  3. 3. A (silly – but not that much when you think about it) Intro
  4. 4. From Game of Thrones to Fakirs… P = F / S = m*g / S One nail every 2 cm
  5. 5. One test is not enough (or barely) …not even talking about the pesticide effect
  6. 6. Stress & Saturation
  7. 7. Stress & Saturation • 98% of our brain is used all the time • 2% extra are enough to saturate our senses • We are not multitasks (sorry, not even you, ladies!) • This is why illusionists and pickpockets are constantly talking or distracting us
  8. 8. Video • Mat Franco – iPhone performance
  9. 9. Wow! How can he… • An attempt to explain! • He forced the choice (explained later) • Phone switched (or stolen beforehand) • Good story – no time to think • Probably some accomplices • There’s no seat 642 in this Hall!!! • Check! • Because there’s no 0 nor 1 in a card deck!
  10. 10. How about software now?
  11. 11. USS Vincennes Jul 3rd 1988 – Iran Air Flight 655 shot down - Helicopter chasing gun boats in the Gulf - Helicopter under fire - Intercept the gun boats (unaware they were into Iranian waters) - Air traffic became muddled - Identified Iran Air A320 as attacking F14 Tomcat - 2 radio guided missiles shot - 290 passengers killed
  12. 12. Stress, impact & testing • This damn padlock!!! • Cancel vs. Ignore Android phone = Mail APP Annuler = Cancel = do nothing Ignorer = Ignore = discard mail Enreg. = keep as draft
  13. 13. What does a good story mean? • Traditional = user / technical requirements • Agile = user stories • Development / BPMN = use cases • Security = hacking via phishing and social engineering • Industry = defined processes
  14. 14. Video • Let’s hack your account • Let’s lock you out in 2 minutes
  15. 15. What to do • Prioritize your information • Ex. Google has hundreds of (progressive) links • Make actions usable • Software wizards = step-by-step process • FAQs & Tutorials (games) • Keep users under control…give them control • Help • Feedback
  16. 16. Google…simple? Yeah, right! Google Scholar? – Google Docs?
  17. 17. It is a question of Level Quick change Guided tour Expert Mode
  18. 18. Selective blindness Sorry only 49 shades today!
  19. 19. I can read your mind
  20. 20. Tadaa!!! http://sprott.physics.wisc.edu/pickover
  21. 21. Attention blindness / Blindness to change • We are less good than we think we are • We can drive a car without thinking on the way or how to drive • Some of us are better in catching details (some forms of autism) • Some train and develop (air controlers) • We lack comprehensive view • We are naturally attracted by some details • Peripheral vision is better (danger) than front vision
  22. 22. Video • Smoothini’s performance explained
  23. 23. How about software now?
  24. 24. Well… • Loss of (developper) attention or capacity to see the whole picture • bugs introduced • Regression • Loss of (user) attention or capacity to see the whole picture • Invisible ads on the right side of the page • Focus on the sight (mimic, mirror neurones…) • Animated ads on web pages are seen as distracting / irritating
  25. 25. How we read web pages • 2,6 s. scan then focusing on a POI • 20% words read • 200 pixels = visual scan width • 50% tablet users want news = photo + title
  26. 26. F « pattern » 1 2 3
  27. 27. Look at me straight in the Eyes • We are naturally attracted by some…details • It is called joint attention • Product positionning is essential!
  28. 28. Just another one for pleasure At first we will just not care about what is written here because most of you will not even take the time to read it! I can even write damn insults or typpposs and be ignored This is already better! Now you see it!
  29. 29. And now in real!
  30. 30. Cognitive Biases
  31. 31. Levitation – let’s elevate the debate
  32. 32. How about software now?
  33. 33. Cognitive Bias • Only 5% of the population has « high » computer-related abilities (SOURCE: OECD study « Skills Matter » 2011-2015 based upon 215,942 people in 33 countries) • « High » means e.g. • schedule a meeting room in a scheduling application • using information contained in several email messages • Implicit problem statement involving multiple steps and multiple constraints • We are not our users!!! • DEVELOPERS are NOT USERS • We don’t know better, sorry!
  34. 34. For loosing weight Diet 1 No need to loose weight Not achievable That’s more Me I can reach that
  35. 35. It’s so brilliant!!! • Just tune up our home page a little bit + + = Would you use such a service?
  36. 36. Under Pressure
  37. 37. Tight Framing • You force a binary choice = simpler = more comfortable • You don’t think outside the box = there might be a third option but you don’t see it = your choices are reduced
  38. 38. The prediction always comes true • 1 = « PUSH » one card • If chosen STOP • If not chosen PUSH twice more • Discard or Keep = keep the Ace • From 17% to 33% • 2 = « TAKE » one card • If chosen STOP • If not chosen TAKE one more • Discard or Keep • 50% • 3 = « PUT ASIDE » one card • Discard or Keep • 100% 21 3 4 5
  39. 39. How about software now?
  40. 40. A/B testing Blah blah – blahhhhh Dddd dddddddd dddd dd ddddddddd dddd ddddd ddddd ddddd Dddddd dd ddddd dd d ddddddd ddd Ddddddddd dd dd ddddddd d dddddd dddd dddd dddd dddd dd ddd ddddd ddd dddd ddd dddddddddd dd ddddd d d ddd dd ddd dd dd d dddd ddd ddd Dddd ddddd dd ddd ddddd ddd dd Dddd dddd dddd dddd dd dddd ddddd Dddd dd dd ddddd dd d ddddddd ddd Ddddd dddd dd dd dddd ddd d dddddd TESTING TARGET Blah blah – blahhhhh Dddd dddddddd dddd dd ddddddddd dddd ddddd ddddd ddddd Dddddd dd ddddd dd d ddddddd ddd Ddddddddd dd dd ddddddd d dddddd dddd dddd dddd dddd dd ddd ddddd ddd dddd ddd dddddddddd dd ddddd d d ddd dd ddd dd dd d dddd ddd ddd Dddd ddddd dd ddd ddddd ddd dd Dddd dddd dddd dddd dd dddd ddddd Dddd dd dd ddddd dd d ddddddd ddd Ddddd dddd dd dd dddd ddd d dddddd TESTING TARGET A B50% 35 CONVERSIONS 55 CONVERSIONS 50%
  41. 41. A/B vs. Usability test HOW MUCH? • What is the best price? • What action generates more clicks? • What is the best design? • What layout makes more sales? • What is the most efficient campaign? WHY? • Why are people not using my application / product? • Why do they click on this link / page? • Where are people blocked? • Why don’t people buy? • What does work best and why? A B
  42. 42. Thank You!!!!
  43. 43. Some references Robert Pucher

×