Whole point: improve customer experience We also do remote faiclitation, observation and testinfg Picka site EVERY MONTH – consistency Recommended only problems fixed in 30 days Method is based on discount usability method of Rocket Surgery Made Easy (show book) – we use as textbook - $21! Conducting the tests is a collateral duty for staff in addition to their main job duties Involvement in the testing program provides great developmental opportunity to staff to learn the technology, collaborate across agencies, manage mtgs and represent the testing program at events such as this.
We post templates, best practices, roles and responsbilities, checklists and much more on our website
CRISIS!!! We got into quick testing because we had to Ncessity is the mother of invention – recovery.gov cancelled less than 2 weeks from test date. ur mandate to test one site EVERY month.
Fortunatley, saw Kate preso at Met UX Expert Kate Walser @ IVMG Conference (Intelligence Community - We were able to throw one together in 2 weeks. In our office.
Turning a usability test inside out – putting everything out in the open and asking passersby their opinions, page by page Hallway test – more users, informal, public space. Very successful – army.mil test Low-fi prototype (not interactive) but high detail VIDEO: http://www.youtube.com/watch?v=pC0ODg2MpuE
In nov. We chose publications.usa.gov – the new Pueblo site for government publications – Two types of tests
One thing we didn’t get is permission
Marketing from all directions
Lots of signage
In the end, having people there was all that mattered
RESULTS: Moderated – 21 interviews Unmoderated – 23 Post It comments
Consolidate data - take all sheets and tabulate answers
Results – data!!
Location, location, location Timing – people in – not telework or AWS day, not on same day as huige meetings Floor with adminstrator – not a bad idea
Heads up to PR and management
Code your answers
“ Help us fix a government website” (no test) Recruitment hook: “Hi. Do you have a minute to help us improve a government website? I work on the X floor (legitimacy). It’ll just take a few minutes.”
1 st question = a general observation, easy
Two types of tests – undmoderated NOT worth it
Using google forms to collect data via laptops
New idea – all digital Interactive!! No printouts, no signup sheets Shorter debrief Army.mil – 3-4 tests simultaneusly
Can manually or automatically create forms to sort data
1. + Conducting Quick Check Testing to Get User Feedback
2. + Schedule Introduction 3:00 – 3:02 Quick check tests 3:02 – 3:10 What are they? What problems do they solve? How do they compare to traditional testing? Planning & conducting a quick check test 3:10 – 3:15 Comparison 3:15 – 3:20 Group Exercise 3:20 – 3:30 Discussion 3:30 – 3:35 Case Study 3:35 – 3:45 Questions / Discussion 3:45 – 3:50 Tips & Takeways 3:50 – 3:55 Wrap-up, Final questions 3:55 – 4:00
3. + Today’s Challenges (And yesterday’s and tomorrow’s) Knowing whether a design will work Time Budget Resources Access to users
4. + Quick Check Tests Post your design and gather feedback and reactions Quickly Low or no cost Validate design or ask specific questions Gauge understanding of content Check effectiveness, impact of design Explore interactions Can conduct online or post print-outs Provide an alternative to more thorough usability testing
5. Picture Source: Whitney Quesenbery
6. + Planning a Quick Check Test 1. Decide what you want to check Content, flow, design, colors, images, understanding, tone Documents, screenshots, video Tasks, questions 1. Consider context and bounds What instructions and context will participants need to be helpful? Number / label areas to help provide easy reference points How can you convey that without biasing them? 1. Pick a good location, time High-traffic areas or low-traffic, secured areas 1. Coordinate logistics and set it up 2. Check in and observe
7. + Sample Questions Where would you look to complete [task 1]? Was there anything that helped you know that? How clear is the content? Are there any design elements that help you understand how to use this? What would you suggest changing? Are there any elements your friends, family, or colleagues would have trouble understanding?
8. + Online Options Notable http://www.notableapp.com flickr http://www.flickr.com To give people “Add a note” option, go to You > Your Account > Privacy & Permissions
9. + Group Exercise Plan a Quick Check Test You want to get reactions to your mobile app design. Think about how you’ll set up a quick check test. 1.Define your goals, what you want to learn. 2.Consider: Participants & advertising (how will participants learn about this) Where you can set up the test (online, in-person location; timing, duration) Context, background participants might need Questions you want answered How you will collect results (email, suggestion box, post-it notes) Format or Supplies you will need (online - website, file type, etc.; in-person - paper, post-it notes, pens) 1.Use the next slides to plan out your first quick check test.
10. + Group Exercise Plan a Quick Check Test Goals Participants & Recruiting Location (online, in-person...) Duration Background / Context participants will need Materials needed Questions you want answered How you will collect results
11. + Case Study
17. + Video SAVE YouTube VIDEO LOCALLY JUST IN CASE WE DON’T HAVE ACCESS TO WEB FROM ROOM!
18. + Moderated Unmoderate d 10th Floor 6th Floor
19. + Permissions
25. +Publications Test: Success rate by task
34. + Moderated Unmoderate d 10th Floor 6th Floor
39. + Quick Test steps 1. Pick site / document to test 2. Develop tasks (even “First Clicks are OK) 3. Determine # testers needed to succeed (10) 4. Timed dry run of the test 5. Select location 6. Set up materials 45 min before test begins 7. Test people for 5-15 min max each 8. Record the successes / failures and feedback 9. Debrief problems and solutions
40. + Wrap-up
41. + To Learn More… Kate Walser firstname.lastname@example.org @kwalser +1 (571) 281-2626 Jon Rubin email@example.com @govnewmedia +1 (202) 501-0855
42. + Photo Credits Quick Check Test Whitney Quesenbery, Open University open hallway usability test