Collaborative testingultimateoverview

1,275 views

Published on

Lanette Creamer used these slides to present a test collaboration overview at Mozilla on June 14, 2011.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,275
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Collaborative testingultimateoverview

  1. 1. Collaborative Testing:Catastic Version<br />Lanette Creamer<br />Spark Quality LLC<br />June 2011<br />Warning: Cat haters, those who are allergic to puns, clownery, and other silly antics which may or may not be fun based on personal taste and mood are advised to tune out while they still can as this version contains maximum cats per slide and is a stress test for the meme tolerance of Mozilla employees. Neither Mozilla nor Lanette will be held responsible for any cats in costumes, or anyone leaving the internet due to cat photo overdose.<br />
  2. 2. Agenda<br />Intro<br />Some ways to coordinate collaborative testing that work in practice<br />Why collaboration?<br />What does success look like?<br />Cat collaboration (a.k.a. herding cats)<br />Q & A<br />Fun and Games<br />
  3. 3. Well, How Did I Get Here?<br />
  4. 4. Well, How Did I Get Here?<br />
  5. 5. Purry-emptive Question<br />Who is this WE?<br />
  6. 6. Current Testing Frequently Performed<br /><ul><li>Unit testing (sometimes TDD and/or ATDD)
  7. 7. Code coverage
  8. 8. Reviews and inspections
  9. 9. Functional Automated Tests
  10. 10. Automated Regression Tests
  11. 11. Internationalization/Globalization Tests
  12. 12. Performance Benchmarks
  13. 13. Compatibility Tests (systems, browsers)
  14. 14. Preview Customers (renamed Beta programs)</li></ul>Got green bar! Cheezburgernaw!<br />
  15. 15. Current Testing Frequently Performed<br /><ul><li>Unit testing (sometimes TDD and/or ATDD)
  16. 16. Code coverage
  17. 17. Reviews and inspections
  18. 18. Functional Automated Tests
  19. 19. Automated Regression Tests
  20. 20. Internationalization/Globalization Tests
  21. 21. Performance Benchmarks
  22. 22. Compatibility Tests (systems, browsers)
  23. 23. Preview Customers (renamed Beta programs)</li></ul>Got green bar! Cheezburgernaw!<br />
  24. 24. Why This Picture?<br />
  25. 25. The Chaseof the Green Bar<br />Code Coverage != Product Coverage<br />
  26. 26. What are we missing?<br />
  27. 27. What are we missing?<br />The User!<br />
  28. 28. Cross Species?<br />Collaboration What?<br />Real life collaboration from small to large<br />
  29. 29. Conpurrency Test<br />What Testers Can Do<br />Many ideas for the whole org, but this is what can be done by any group with more than one tester or any single tester who can get cooperation from others.<br />
  30. 30. Multiple User Scenario<br />Load Test<br />File Throughput Test<br />
  31. 31. Whatever<br />Uncooperative cat is uncooperative.<br />
  32. 32. Volunteers!<br />Community is good, when you are stumped.<br />Or even when you want a different perspective.<br />
  33. 33. A Note on Volunteers<br />Volunteer testers deserve to be appreciated, respected, and helped to contribute effectively by an activity leader who helps them succeed.*<br />*More on this later<br />
  34. 34. Area Rotation<br />Areas of focus switch every # weeks or days.<br />
  35. 35. Tester Pairing<br />Two testers sit side by side and work together on the same testing challenges.<br />
  36. 36. Bug Hunts<br />Company wide directive to test some software.<br />
  37. 37. Bug Harvests/Bash<br />Planned time boxed focus on a feature after a major change or a late fix to get more coverage in a short time period.<br />
  38. 38. Team Exploratory Testing <br />Time based exploratory test charters are run by individuals, but may be planned by the entire team. Larger team can prioritize, create, review and improve over time.<br />
  39. 39. Workflow Testing<br />End to End testing across user workflow paths using known data to replicate real users when possible, and personas as a placeholder until more user data is available.<br />
  40. 40. Keeping it Real<br />End to End test are better when all of the data is as real as we possibly can make it.<br />
  41. 41. Food, Fun, Friends<br />Complex Teambuilding<br />Bring the Pizza*<br />*Exception<br />No Potlucks<br />Please.<br />U bring pizza.<br />I bring de CRAZIIE!<br />
  42. 42. Prizes<br />
  43. 43. Promote Projects<br />Useful, Hilarious, Memorable<br />Fun is still legal! Act now!<br />
  44. 44. User Data<br />
  45. 45. User Inclusion Checklist<br />Objective Data<br /><ul><li>Usage data
  46. 46. Studies
  47. 47. Opt In Tracking</li></ul>Marketing & Product Owners<br /><ul><li>User testimonials
  48. 48. Existing customer
  49. 49. Potential customers
  50. 50. Optimistic future facing strategy
  51. 51. Sales data</li></ul>Tech Support<br /><ul><li>Top Issues
  52. 52. Missed (or deferred) bugs
  53. 53. Dot releases
  54. 54. Usage</li></li></ul><li>Workflow Scorecard Example<br />
  55. 55. Objective User Data Example<br />
  56. 56. Output Examples<br />
  57. 57. Output Examples<br />
  58. 58. Output Examples<br />
  59. 59. Output Examples<br />
  60. 60. Output Examples<br />
  61. 61. Output Examples<br />
  62. 62. Output Examples<br />
  63. 63. Output Examples<br />
  64. 64. Output Examples<br />
  65. 65. Herding Cats<br />The best laid plans,…<br />
  66. 66. Stardusta.k.a. ChubChub, Chub-a-Love<br />Some have issues<br />
  67. 67. Tizzy<br />Some are sweet but shy<br />
  68. 68. Kitty Snuggle Time<br />With time*, they may grow to like it<br />* love, patience, band-aids, ice packs, ear plugs, prayer, medication<br />
  69. 69. But you can’t win them all<br />*Success does not look the same for every team<br />Ashley<br />
  70. 70. Tasklist Example<br />
  71. 71. Tasklist Example<br />
  72. 72. We can promote it, but how does this collaborative testing work anyhow? Where are the specifics?<br />Testing for the User Experience is a technical paper which was voted best paper of PNSQC 2008.<br />Read it for free at http://blog.testyredhead.com/files/90240-78758/TestingfortheUserExperienceFinal.pdf <br />
  73. 73. Q&A<br />Lanette.creamer@gmail.com<br />http://blog.testyredhead.com<br />Twitter @lanettecream<br />
  74. 74. Testing Gamehttp://mothereffingtextshadow.com/<br />Email Issues by 6/17/2011 to Lanette.creamer@gmail.com<br />Non-Harmful, Reproducible, Unique, Hilarious Issues Plz<br />

×