Usability 2.0

  • 39,935 views
Uploaded on

Talk for the Vancouver User Experience group on October 16, 2007 about the user experience of usability projects and how we've re-designed our process.

Talk for the Vancouver User Experience group on October 16, 2007 about the user experience of usability projects and how we've re-designed our process.

More in: Technology , Design
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
39,935
On Slideshare
0
From Embeds
0
Number of Embeds
20

Actions

Shares
Downloads
3,079
Comments
10
Likes
231

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Usability 2.0 usability as a conversation
  • 2. Karyn Zuidinga Senior Information Architect office: 604 669 7655 mobile: 778 386 6982 karyn@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com Greg Bell User Experience Designer office: 604 669 7655 mobile: 778 995 1014 greg@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com
  • 3. Usability 2.0 usability as a conversation
  • 4. *disclaimer Work in progress.
  • 5. Ever done a usability test, gone to the trouble of writing that killer report and seen the results go nowhere?
  • 6. Ever have to read someone else’s usability test report and think you’ve found the cure for insomnia?
  • 7. Usability Reports vs Office Hours Slept 5 Number of Usability Reports to Read 4 3 2 1 0 0 1 2 3 4 5 Hours slept during office hours
  • 8. The user experience of usability.
  • 9. Mobile Device OOBE Testing
  • 10. Mobile Device OOBE Testing Out of Box Experience
  • 11. Post-test: - Getting Started Guide - Screen Clings - Other In-Box Materials - Device Changes
  • 12. The Situation (6 months ago)
  • 13. Limited client engagement.
  • 14. Results were not getting to who they needed to.
  • 15. Discussion ends after reporting.
  • 16. So, we did what we do best.
  • 17. User Experience Analysis of Usability Testing
  • 18. Project Completion Usability Project Project Kick Off
  • 19. Project Completion Usability Project Project Kick Off
  • 20. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 21. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 22. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 23. Problem: How do we engage clients and get them excited about testing? (and get more people to show up)
  • 24. Collaborative Planning with Client
  • 25. Wiki space for Task List & Test Plan
  • 26. Engage clients on a deeper level before beginning testing.
  • 27. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 28. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 29. Problem: Difficult to get a recruiting company to engage in finding the RIGHT people.
  • 30. Recruiting Screener
  • 31. Personas for recruiters.
  • 32. Recruiters engaged on a new level and the testing was more successful.
  • 33. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 34. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 35. Problem: Difficult to record easy to analyze data
  • 36. Problem: Difficult to get notes from the entire team who is attending testing.
  • 37. Problem: Difficult to create video clips after testing.
  • 38. 1. The People 2. The Notepad 3. The Video System
  • 39. The People 1. The Facilitator 2. The Observer 3. The Schmoozer
  • 40. Invite as many people from the client team as possible.
  • 41. 1. The People 2. The Notepad 3. The Video System
  • 42. The Notepad Study: _____________________________ Use GSG? Yes No 1 Make a Phone Call User ID: ___________ Notes By: ___________________________ Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 2 Set up Voicemail Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 3 Send a Text Message Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 4 Take a Photo & Send MMS Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 5 Make a Video Share Call Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 6 Set Up & Send an IM Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 7 Go to a Website Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 8 Set Up Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 9 Send & Receive Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 10 Sync Calendar & Contacts Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 11 Set Up TeleNav Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 12 Bluetooth Finished w/ Ease Completed w/ Difficulty Failed to Complete
  • 43. Study Use GSG? Yes No 1 Make a Phone Call User I Notes Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 2 Set up Voicemail Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 3 Send a Text Message Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 4 Take a Photo & Send MMS Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 5 Make a Video Share Call Finished w/ Ease Completed w/ Difficulty Failed to Complete
  • 44. Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 8 Set Up Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 9 Send & Receive Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 10 Sync Calendar & Contacts Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 11 Set Up TeleNav Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 12 Bluetooth Finished w/ Ease Completed w/ Difficulty Failed to Complete
  • 45. The Used Notepad
  • 46. Get clients to use sheets and record data.
  • 47. 1. The People 2. The Notepad 3. The Video System
  • 48. Our Setup
  • 49. Our Setup Participant
  • 50. Our Setup Participant Facilitator
  • 51. Our Setup Video Camera Participant Facilitator
  • 52. Our Setup Video Camera Participant WebCam Facilitator
  • 53. Our Setup Two Way Glass Video Camera Participant Observer WebCam Facilitator
  • 54. Our Setup Two Way Glass Video Camera Network / Router Participant Observer WebCam Facilitator
  • 55. Our Setup Two Way Glass Video Camera Network / Router Participant Observer WebCam Facilitator Client Team & Schmoozer
  • 56. Using these tools, we were able to create better data that was easier to analyze.
  • 57. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 58. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  • 59. “I recently asked 258 usability practitioners which methods they use to communicate findings from their studies” - Jakob Nielsen, 2005 http://www.useit.com/alertbox/20050425.html
  • 60. “I recently asked 258 usability practitioners which methods they use to communicate findings from their studies” - Jakob Nielsen, 2005 http://www.useit.com/alertbox/20050425.html http://www.happywebbies.com/download
  • 61. Formal Usability Reports vs. Quick Findings
  • 62. Formal Usability Reports vs. Quick Findings
  • 63. Formal Usability Reports vs. Quick Findings (2)
  • 64. Formal Usability Reports vs. Quick Findings (2)
  • 65. Formal Usability Reports vs. Quick Findings (2)
  • 66. The typical usability report life-cycle:
  • 67. http://www.flickr.com/photos/phooky/1390640732/
  • 68. http://www.flickr.com/photos/seanstayte/660772151/
  • 69. Do I really have to read all of this?
  • 70. Maybe, a DVD arrives in the mail a few weeks later with video.
  • 71. Problem: Usability reports are boring and nobody wants to read them.
  • 72. Problem: Usability reports are not shared among the people who need them most.
  • 73. Problem: There is a disconnect between video highlights and the findings in the report.
  • 74. Test Debrief Session
  • 75. http://www.flickr.com/photos/phooky/1390640732/
  • 76. Findings Module
  • 77. Easy to Parse Data
  • 78. Utility Functions
  • 79. Invite a Colleague via Email
  • 80. Montages
  • 81. Sortable Data
  • 82. Demo
  • 83. Clients engaged on report.
  • 84. Delivery method improved reporting
  • 85. While hours increased on creating reports, the value was well worth it for our clients.
  • 86. What’s Next?
  • 87. Discussion threads on findings
  • 88. Assignable action items on all recommendations.
  • 89. Web app to create reports
  • 90. Takeaways
  • 91. Get your reports online and interactive.
  • 92. Engage with client’s product team as much as possible.
  • 93. Re-design your process!
  • 94. Karyn Zuidinga Senior Information Architect office: 604 669 7655 mobile: 778 386 6982 karyn@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com Thank you. Greg Bell User Experience Designer office: 604 669 7655 mobile: 778 995 1014 greg@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com http://creativecommons.org/licenses/by-nc/2.5/ca/