Your SlideShare is downloading. ×
0
Usability 2.0
usability as a conversation
Karyn Zuidinga
        Senior Information Architect
        office: 604 669 7655
        mobile: 778 386 6982
        kary...
Usability 2.0
usability as a conversation
*disclaimer
Work in progress.
Ever done a usability test, gone to the
trouble of writing that killer report and
seen the results go nowhere?
Ever have to read someone else’s
usability test report and think you’ve
found the cure for insomnia?
Usability Reports vs Office Hours Slept
                                      5
Number of Usability Reports to Read




  ...
The user experience of usability.
Mobile Device OOBE Testing
Mobile Device OOBE Testing

            Out of Box Experience
Post-test:
- Getting Started Guide
- Screen Clings
- Other In-Box Materials
- Device Changes
The Situation (6 months ago)
Limited client engagement.
Results were not getting to who they
needed to.
Discussion ends after reporting.
So, we did what we do best.
User Experience Analysis
  of Usability Testing
Project Completion
Usability Project
                      Project Kick Off
Project Completion
Usability Project
                      Project Kick Off
Usability Project




                                                                                             Project...
Usability Project




                                                                                             Project...
Usability Project




                                                                                             Project...
Problem:
How do we engage clients and get them
excited about testing?
(and get more people to show up)
Collaborative Planning with Client
Wiki space for Task List & Test Plan
Engage clients on a deeper
level before beginning testing.
Usability Project




                                                                                             Project...
Usability Project




                                                                                             Project...
Problem:
Difficult to get a recruiting company to
engage in finding the RIGHT people.
Recruiting Screener
Personas for recruiters.
Recruiters engaged on a new level and
the testing was more successful.
Usability Project




                                                                                             Project...
Usability Project




                                                                                             Project...
Problem:
Difficult to record easy to analyze data
Problem:
Difficult to get notes from the entire team
who is attending testing.
Problem:
Difficult to create video clips after testing.
1. The People
2. The Notepad
3. The Video System
The People
1. The Facilitator
2. The Observer
3. The Schmoozer
Invite as many people from the
client team as possible.
1. The People
2. The Notepad
3. The Video System
The Notepad
                                                                       Study: _____________________________
  ...
Study
                                              Use GSG?    Yes    No
1 Make a Phone Call                             ...
Finished w/ Ease   Completed w/ Difficulty     Failed to Complete

                                              Use GSG?  ...
The Used Notepad
Get clients to use sheets and record data.
1. The People
2. The Notepad
3. The Video System
Our Setup
Our Setup




       Participant
Our Setup




       Participant




                     Facilitator
Our Setup
  Video Camera




             Participant




                           Facilitator
Our Setup
  Video Camera




             Participant




          WebCam


                           Facilitator
Our Setup
           Two Way Glass     Video Camera




                                        Participant

Observer



 ...
Our Setup
                   Two Way Glass     Video Camera



Network / Router




                                      ...
Our Setup
                    Two Way Glass     Video Camera



Network / Router




                                     ...
Using these tools, we were able to create
 better data that was easier to analyze.
Usability Project




                                                                                             Project...
Usability Project




                                                                                             Project...
“I recently asked 258
usability practitioners which
methods they use to
communicate findings from
their studies”
- Jakob N...
“I recently asked 258
                       usability practitioners which
                       methods they use to
    ...
Formal Usability Reports vs. Quick Findings
Formal Usability Reports vs. Quick Findings
Formal Usability Reports vs. Quick Findings (2)
Formal Usability Reports vs. Quick Findings (2)
Formal Usability Reports vs. Quick Findings (2)
The typical usability report life-cycle:
http://www.flickr.com/photos/phooky/1390640732/
http://www.flickr.com/photos/seanstayte/660772151/
Do I really have to read all of this?
Maybe, a DVD arrives in the mail
a few weeks later with video.
Problem:
Usability reports are boring and nobody
wants to read them.
Problem:
Usability reports are not shared among
the people who need them most.
Problem:
There is a disconnect between video
highlights and the findings in the report.
Test Debrief Session
http://www.flickr.com/photos/phooky/1390640732/
Findings Module
Easy to Parse Data
Utility Functions
Invite a Colleague via Email
Montages
Sortable Data
Demo
Clients engaged on report.
Delivery method improved reporting
While hours increased on creating
reports, the value was well worth it for
our clients.
What’s Next?
Discussion threads on findings
Assignable action items on all
     recommendations.
Web app to create reports
Takeaways
Get your reports online and interactive.
Engage with client’s product team as
        much as possible.
Re-design your process!
Karyn Zuidinga
                    Senior Information Architect
                    office: 604 669 7655
                 ...
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Usability 2.0
Upcoming SlideShare
Loading in...5
×

Usability 2.0

40,656

Published on

Talk for the Vancouver User Experience group on October 16, 2007 about the user experience of usability projects and how we've re-designed our process.

Published in: Technology, Design
10 Comments
231 Likes
Statistics
Notes
No Downloads
Views
Total Views
40,656
On Slideshare
0
From Embeds
0
Number of Embeds
21
Actions
Shares
0
Downloads
3,081
Comments
10
Likes
231
Embeds 0
No embeds

No notes for slide

Transcript of "Usability 2.0"

  1. 1. Usability 2.0 usability as a conversation
  2. 2. Karyn Zuidinga Senior Information Architect office: 604 669 7655 mobile: 778 386 6982 karyn@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com Greg Bell User Experience Designer office: 604 669 7655 mobile: 778 995 1014 greg@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com
  3. 3. Usability 2.0 usability as a conversation
  4. 4. *disclaimer Work in progress.
  5. 5. Ever done a usability test, gone to the trouble of writing that killer report and seen the results go nowhere?
  6. 6. Ever have to read someone else’s usability test report and think you’ve found the cure for insomnia?
  7. 7. Usability Reports vs Office Hours Slept 5 Number of Usability Reports to Read 4 3 2 1 0 0 1 2 3 4 5 Hours slept during office hours
  8. 8. The user experience of usability.
  9. 9. Mobile Device OOBE Testing
  10. 10. Mobile Device OOBE Testing Out of Box Experience
  11. 11. Post-test: - Getting Started Guide - Screen Clings - Other In-Box Materials - Device Changes
  12. 12. The Situation (6 months ago)
  13. 13. Limited client engagement.
  14. 14. Results were not getting to who they needed to.
  15. 15. Discussion ends after reporting.
  16. 16. So, we did what we do best.
  17. 17. User Experience Analysis of Usability Testing
  18. 18. Project Completion Usability Project Project Kick Off
  19. 19. Project Completion Usability Project Project Kick Off
  20. 20. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  21. 21. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  22. 22. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  23. 23. Problem: How do we engage clients and get them excited about testing? (and get more people to show up)
  24. 24. Collaborative Planning with Client
  25. 25. Wiki space for Task List & Test Plan
  26. 26. Engage clients on a deeper level before beginning testing.
  27. 27. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  28. 28. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  29. 29. Problem: Difficult to get a recruiting company to engage in finding the RIGHT people.
  30. 30. Recruiting Screener
  31. 31. Personas for recruiters.
  32. 32. Recruiters engaged on a new level and the testing was more successful.
  33. 33. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  34. 34. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  35. 35. Problem: Difficult to record easy to analyze data
  36. 36. Problem: Difficult to get notes from the entire team who is attending testing.
  37. 37. Problem: Difficult to create video clips after testing.
  38. 38. 1. The People 2. The Notepad 3. The Video System
  39. 39. The People 1. The Facilitator 2. The Observer 3. The Schmoozer
  40. 40. Invite as many people from the client team as possible.
  41. 41. 1. The People 2. The Notepad 3. The Video System
  42. 42. The Notepad Study: _____________________________ Use GSG? Yes No 1 Make a Phone Call User ID: ___________ Notes By: ___________________________ Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 2 Set up Voicemail Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 3 Send a Text Message Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 4 Take a Photo & Send MMS Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 5 Make a Video Share Call Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 6 Set Up & Send an IM Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 7 Go to a Website Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 8 Set Up Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 9 Send & Receive Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 10 Sync Calendar & Contacts Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 11 Set Up TeleNav Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 12 Bluetooth Finished w/ Ease Completed w/ Difficulty Failed to Complete
  43. 43. Study Use GSG? Yes No 1 Make a Phone Call User I Notes Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 2 Set up Voicemail Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 3 Send a Text Message Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 4 Take a Photo & Send MMS Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 5 Make a Video Share Call Finished w/ Ease Completed w/ Difficulty Failed to Complete
  44. 44. Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 8 Set Up Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 9 Send & Receive Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 10 Sync Calendar & Contacts Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 11 Set Up TeleNav Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 12 Bluetooth Finished w/ Ease Completed w/ Difficulty Failed to Complete
  45. 45. The Used Notepad
  46. 46. Get clients to use sheets and record data.
  47. 47. 1. The People 2. The Notepad 3. The Video System
  48. 48. Our Setup
  49. 49. Our Setup Participant
  50. 50. Our Setup Participant Facilitator
  51. 51. Our Setup Video Camera Participant Facilitator
  52. 52. Our Setup Video Camera Participant WebCam Facilitator
  53. 53. Our Setup Two Way Glass Video Camera Participant Observer WebCam Facilitator
  54. 54. Our Setup Two Way Glass Video Camera Network / Router Participant Observer WebCam Facilitator
  55. 55. Our Setup Two Way Glass Video Camera Network / Router Participant Observer WebCam Facilitator Client Team & Schmoozer
  56. 56. Using these tools, we were able to create better data that was easier to analyze.
  57. 57. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  58. 58. Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting
  59. 59. “I recently asked 258 usability practitioners which methods they use to communicate findings from their studies” - Jakob Nielsen, 2005 http://www.useit.com/alertbox/20050425.html
  60. 60. “I recently asked 258 usability practitioners which methods they use to communicate findings from their studies” - Jakob Nielsen, 2005 http://www.useit.com/alertbox/20050425.html http://www.happywebbies.com/download
  61. 61. Formal Usability Reports vs. Quick Findings
  62. 62. Formal Usability Reports vs. Quick Findings
  63. 63. Formal Usability Reports vs. Quick Findings (2)
  64. 64. Formal Usability Reports vs. Quick Findings (2)
  65. 65. Formal Usability Reports vs. Quick Findings (2)
  66. 66. The typical usability report life-cycle:
  67. 67. http://www.flickr.com/photos/phooky/1390640732/
  68. 68. http://www.flickr.com/photos/seanstayte/660772151/
  69. 69. Do I really have to read all of this?
  70. 70. Maybe, a DVD arrives in the mail a few weeks later with video.
  71. 71. Problem: Usability reports are boring and nobody wants to read them.
  72. 72. Problem: Usability reports are not shared among the people who need them most.
  73. 73. Problem: There is a disconnect between video highlights and the findings in the report.
  74. 74. Test Debrief Session
  75. 75. http://www.flickr.com/photos/phooky/1390640732/
  76. 76. Findings Module
  77. 77. Easy to Parse Data
  78. 78. Utility Functions
  79. 79. Invite a Colleague via Email
  80. 80. Montages
  81. 81. Sortable Data
  82. 82. Demo
  83. 83. Clients engaged on report.
  84. 84. Delivery method improved reporting
  85. 85. While hours increased on creating reports, the value was well worth it for our clients.
  86. 86. What’s Next?
  87. 87. Discussion threads on findings
  88. 88. Assignable action items on all recommendations.
  89. 89. Web app to create reports
  90. 90. Takeaways
  91. 91. Get your reports online and interactive.
  92. 92. Engage with client’s product team as much as possible.
  93. 93. Re-design your process!
  94. 94. Karyn Zuidinga Senior Information Architect office: 604 669 7655 mobile: 778 386 6982 karyn@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com Thank you. Greg Bell User Experience Designer office: 604 669 7655 mobile: 778 995 1014 greg@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com http://creativecommons.org/licenses/by-nc/2.5/ca/
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×