Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

How to run 100 user tests in two days

1,185 views

Published on

Over the past two years, the Puppet Labs UX team has run user tests en-masse at our annual conference in San Francisco. The first year, we ran almost 50 user tests, and made a lot of mistakes. This past year, we took those lessons, improved our testing process, and ran twice as many user tests, successfully. Additionally, we’ve recruited hundreds of users at these events for future user testing opportunities.

As the person responsible for making this happen, I’d like to talk about how other UX teams can avoid our mistakes and replicate our successes.

The latest version of this presentation is at http://slidesha.re/1qm8yj3

Published in: Design, Sports
  • If you want a girl to "chase" you, then you have to use the right "bait". We discovered 4 specific things that FORCE a girl to chase after you and try to win YOU over. copy and visiting... ➤➤ https://tinyurl.com/y52uv4vq
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

How to run 100 user tests in two days

  1. 1. How to Run 100 User Tests in Two Days Daniel Sauble, UX Designer at Puppet Labs
  2. 2. Hi
  3. 3. a suggestion as to a course of action idea (n): Julian Santacruz juliansantacruz.com
  4. 4. Why do this? Richard Winskill flickr.com/photos/richard_winskill
  5. 5. P
  6. 6. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
  7. 7. S
  8. 8. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P S
  9. 9. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P S × 20
  10. 10. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P 2012 P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P S × 6 2013 P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P S × ? 2014 S × 5
  11. 11. Why a conference?
  12. 12. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
  13. 13. V
  14. 14. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P V
  15. 15. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P V × 16
  16. 16. Find Recruit Schedule Test
  17. 17. mistake (n): here are some things to avoid Dean Michael Dorman flickr.com/photos/bestraft/
  18. 18. 1 Don’t write every study yourself
  19. 19. Time Complexity
  20. 20. “I didn’t have time to write a short letter, so I wrote a long one instead.” ! - Mark Twain
  21. 21. Trivial
  22. 22. Complex
  23. 23. Simple
  24. 24. QAWriting
  25. 25. QAWriting Training
  26. 26. This will take 4x longer than you think
  27. 27. 2 Don’t pick a booth in the busiest hallway Linda Tanner flickr.com/photos/goingslo/
  28. 28. Keynote room Hallway Conference rooms Stairs to sponsor booths Us
  29. 29. 12 feet
  30. 30. 3 Don’t skip on-the-spot analysis
  31. 31. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
  32. 32. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
  33. 33. P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P “ ”
  34. 34. 4 Don’t ignore your product roadmap David Clark dcclark.net
  35. 35. Research value Time
  36. 36. 6 months?
  37. 37. R
  38. 38. S R→
  39. 39. ←S R
  40. 40. S R
  41. 41. 6 mo
  42. 42. 6 mo Ship before research
  43. 43. 6 mo Ship after research expires
  44. 44. 6 mo Ship window
  45. 45. 5 Don’t leave your laptops unattended Radu flickr.com/photos/negora/
  46. 46. Record
  47. 47. Backup
  48. 48. Secure
  49. 49. success (n): here are some things to try Marina del Castell flickr.com/photos/marinadelcastell/
  50. 50. 1 Pick an event five months in advance Ivan Serra flickr.com/photos/ivanilluuu/
  51. 51. Where?
  52. 52. rocor flickr.com/photos/rocor/
  53. 53. What?
  54. 54. Who?
  55. 55. 2 Consider the legal ramifications
  56. 56. NDAs
  57. 57. Do you really need one?
  58. 58. E-signatures
  59. 59. 3 Recruit volunteers from different teams J. Ollas flickr.com/photos/jokke_kuvat/
  60. 60. Roles
  61. 61. Finding people
  62. 62. 4 Define your process (i.e. guardrails) Stew Dean flickr.com/photos/stewdean/
  63. 63. Our process the cliff-notes version
  64. 64. Crowd control
  65. 65. Entrance interview
  66. 66. Testing
  67. 67. Swag
  68. 68. Exit interview
  69. 69. 5 Train your volunteers Centrum/Jim Levitt flickr.com/photos/ptcentrum/
  70. 70. Schedule it
  71. 71. Share your documents
  72. 72. Repeat yourself
  73. 73. 6 Acquire equipment and materials Stealing-Beauty Photography flickr.com/photos/stealingbeauty/
  74. 74. Laptops
  75. 75. Microphones
  76. 76. Three-ring binders
  77. 77. Paper-based tests
  78. 78. 7 Do the thing Philip R Jones flickr.com/photos/pj_photos_/
  79. 79. Have fun
  80. 80. Talk to people
  81. 81. Don’t hover
  82. 82. What doesn’t kill you…
  83. 83. 8 Hold a retrospective Paul Downey flickr.com/photos/psd/
  84. 84. Stop
  85. 85. Keep
  86. 86. Try
  87. 87. conundrum (n): something that is puzzling or confusing Robert S. Donovan flickr.com/photos/booleansplit/
  88. 88. 1 Scheduling is hard
  89. 89. 2 Data tends to evaporate Jason Cross flickr.com/photos/jasoncross/
  90. 90. 3 Quantitative tests? Gavin Brogan flickr.com/photos/heavyweightgeek/
  91. 91. 4 Software misbehaves
  92. 92. 5 Groupthink
  93. 93. QA @djsauble
  94. 94. Resources • docusign.com • silverbackapp.com • nngroup.com/topic/user-testing/ • links.puppetlabs.com/puppet-labs-test-pilots/

×