Your SlideShare is downloading. ×
0
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Conducting Quick Check Testing to Get User Feedback
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Conducting Quick Check Testing to Get User Feedback

441

Published on

Given at Usability Professionals Association Conference June 6, 2012

Given at Usability Professionals Association Conference June 6, 2012

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
441
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Whole point: improve customer experience We also do remote faiclitation, observation and testinfg Picka site EVERY MONTH – consistency Recommended only problems fixed in 30 days Method is based on discount usability method of Rocket Surgery Made Easy (show book) – we use as textbook - $21! Conducting the tests is a collateral duty for staff in addition to their main job duties Involvement in the testing program provides great developmental opportunity to staff to learn the technology, collaborate across agencies, manage mtgs and represent the testing program at events such as this.
  • We post templates, best practices, roles and responsbilities, checklists and much more on our website
  • CRISIS!!! We got into quick testing because we had to Ncessity is the mother of invention – recovery.gov cancelled less than 2 weeks from test date. ur mandate to test one site EVERY month.
  • Fortunatley, saw Kate preso at Met UX Expert Kate Walser @ IVMG Conference  (Intelligence Community - We were able to throw one together in 2 weeks. In our office.
  • Turning a usability test inside out – putting everything out in the open and asking passersby their opinions, page by page Hallway test – more users, informal, public space. Very successful – army.mil test Low-fi prototype (not interactive) but high detail VIDEO: http://www.youtube.com/watch?v=pC0ODg2MpuE
  • http://www.youtube.com/watch?v=pC0ODg2MpuE
  • In nov. We chose publications.usa.gov – the new Pueblo site for government publications – Two types of tests
  • One thing we didn’t get is permission
  • Marketing from all directions
  • Lots of signage
  • In the end, having people there was all that mattered
  • RESULTS: Moderated – 21 interviews Unmoderated – 23 Post It comments
  • Consolidate data - take all sheets and tabulate answers
  • Results – data!!
  • Location, location, location Timing – people in – not telework or AWS day, not on same day as huige meetings Floor with adminstrator – not a bad idea
  • Heads up to PR and management
  • Code your answers
  • “ Help us fix a government website” (no test) Recruitment hook: “Hi. Do you have a minute to help us improve a government website? I work on the X floor (legitimacy). It’ll just take a few minutes.”
  • 1 st question = a general observation, easy
  • Two types of tests – undmoderated NOT worth it
  • Using google forms to collect data via laptops
  • New idea – all digital Interactive!! No printouts, no signup sheets Shorter debrief Army.mil – 3-4 tests simultaneusly
  • Can manually or automatically create forms to sort data
  • Transcript

    • 1. + Conducting Quick Check Testing to Get User Feedback
    • 2. + Schedule Introduction 3:00 – 3:02 Quick check tests 3:02 – 3:10 What are they? What problems do they solve? How do they compare to traditional testing? Planning & conducting a quick check test 3:10 – 3:15 Comparison 3:15 – 3:20 Group Exercise 3:20 – 3:30 Discussion 3:30 – 3:35 Case Study 3:35 – 3:45 Questions / Discussion 3:45 – 3:50 Tips & Takeways 3:50 – 3:55 Wrap-up, Final questions 3:55 – 4:00
    • 3. + Today’s Challenges (And yesterday’s and tomorrow’s)  Knowing whether a design will work  Time  Budget  Resources  Access to users
    • 4. + Quick Check Tests  Post your design and gather feedback and reactions  Quickly  Low or no cost  Validate design or ask specific questions  Gauge understanding of content  Check effectiveness, impact of design  Explore interactions  Can conduct online or post print-outs  Provide an alternative to more thorough usability testing
    • 5. Picture Source: Whitney Quesenbery
    • 6. + Planning a Quick Check Test 1. Decide what you want to check  Content, flow, design, colors, images, understanding, tone  Documents, screenshots, video  Tasks, questions 1. Consider context and bounds  What instructions and context will participants need to be helpful?  Number / label areas to help provide easy reference points  How can you convey that without biasing them? 1. Pick a good location, time  High-traffic areas or low-traffic, secured areas 1. Coordinate logistics and set it up 2. Check in and observe
    • 7. + Sample Questions  Where would you look to complete [task 1]?  Was there anything that helped you know that?  How clear is the content?  Are there any design elements that help you understand how to use this?  What would you suggest changing?  Are there any elements your friends, family, or colleagues would have trouble understanding?
    • 8. + Online Options Notable http://www.notableapp.com flickr http://www.flickr.com To give people “Add a note” option, go to You > Your Account > Privacy & Permissions
    • 9. + Group Exercise Plan a Quick Check Test You want to get reactions to your mobile app design. Think about how you’ll set up a quick check test. 1.Define your goals, what you want to learn. 2.Consider:  Participants & advertising (how will participants learn about this)  Where you can set up the test (online, in-person location; timing, duration)  Context, background participants might need  Questions you want answered  How you will collect results (email, suggestion box, post-it notes)  Format or Supplies you will need (online - website, file type, etc.; in-person - paper, post-it notes, pens) 1.Use the next slides to plan out your first quick check test.
    • 10. + Group Exercise Plan a Quick Check Test Goals Participants & Recruiting Location (online, in-person...) Duration Background / Context participants will need Materials needed Questions you want answered How you will collect results
    • 11. + Case Study
    • 12. +
    • 13. +Howto.gov/firstfridays
    • 14. +
    • 15. +
    • 16. +
    • 17. + Video  SAVE YouTube VIDEO LOCALLY JUST IN CASE WE DON’T HAVE ACCESS TO WEB FROM ROOM!
    • 18. + Moderated Unmoderate d 10th Floor 6th Floor
    • 19. + Permissions
    • 20. +
    • 21. +
    • 22. +
    • 23. +
    • 24. +
    • 25. +Publications Test: Success rate by task
    • 26. +
    • 27. +
    • 28. +
    • 29. +
    • 30. +
    • 31. +
    • 32. +
    • 33. +
    • 34. + Moderated Unmoderate d 10th Floor 6th Floor
    • 35. +
    • 36. +
    • 37. +
    • 38. +
    • 39. + Quick Test steps 1. Pick site / document to test 2. Develop tasks (even “First Clicks are OK) 3. Determine # testers needed to succeed (10) 4. Timed dry run of the test 5. Select location 6. Set up materials 45 min before test begins 7. Test people for 5-15 min max each 8. Record the successes / failures and feedback 9. Debrief problems and solutions
    • 40. + Wrap-up
    • 41. + To Learn More…  Kate Walser  kwalser@cxinsights.com  @kwalser  +1 (571) 281-2626  Jon Rubin  jonathan.rubin@gsa.gov  @govnewmedia  +1 (202) 501-0855
    • 42. + Photo Credits Quick Check Test Whitney Quesenbery, Open University open hallway usability test

    ×