Usability 2.0

Usability 2.0 usability as a conversation

Karyn Zuidinga Senior Information Architect office: 604 669 7655 mobile: 778 386 6982 karyn@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com Greg Bell User Experience Designer office: 604 669 7655 mobile: 778 995 1014 greg@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com

Usability 2.0 usability as a conversation

*disclaimer Work in progress.

Ever done a usability test, gone to the trouble of writing that killer report and seen the results go nowhere?

Ever have to read someone else’s usability test report and think you’ve found the cure for insomnia?

Usability Reports vs Office Hours Slept 5 Number of Usability Reports to Read 4 3 2 1 0 0 1 2 3 4 5 Hours slept during office hours

The user experience of usability.

Mobile Device OOBE Testing

Mobile Device OOBE Testing Out of Box Experience

Post-test: - Getting Started Guide - Screen Clings - Other In-Box Materials - Device Changes

The Situation (6 months ago)

Limited client engagement.

Results were not getting to who they needed to.

Discussion ends after reporting.

So, we did what we do best.

User Experience Analysis of Usability Testing

Project Completion Usability Project Project Kick Off

Usability Project Project Completion Project Kick Off Planning Recruiting Usability Testing Data Analysis Reporting

Problem: How do we engage clients and get them excited about testing? (and get more people to show up)

Collaborative Planning with Client

Wiki space for Task List & Test Plan

Engage clients on a deeper level before beginning testing.

Problem: Difficult to get a recruiting company to engage in finding the RIGHT people.

Recruiting Screener

Personas for recruiters.

Recruiters engaged on a new level and the testing was more successful.

Problem: Difficult to record easy to analyze data

Problem: Difficult to get notes from the entire team who is attending testing.

Problem: Difficult to create video clips after testing.

1. The People 2. The Notepad 3. The Video System

The People 1. The Facilitator 2. The Observer 3. The Schmoozer

Invite as many people from the client team as possible.

The Notepad Study: _____________________________ Use GSG? Yes No 1 Make a Phone Call User ID: ___________ Notes By: ___________________________ Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 2 Set up Voicemail Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 3 Send a Text Message Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 4 Take a Photo & Send MMS Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 5 Make a Video Share Call Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 6 Set Up & Send an IM Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 7 Go to a Website Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 8 Set Up Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 9 Send & Receive Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 10 Sync Calendar & Contacts Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 11 Set Up TeleNav Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 12 Bluetooth Finished w/ Ease Completed w/ Difficulty Failed to Complete

Study Use GSG? Yes No 1 Make a Phone Call User I Notes Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 2 Set up Voicemail Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 3 Send a Text Message Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 4 Take a Photo & Send MMS Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 5 Make a Video Share Call Finished w/ Ease Completed w/ Difficulty Failed to Complete

Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 8 Set Up Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 9 Send & Receive Email Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 10 Sync Calendar & Contacts Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 11 Set Up TeleNav Finished w/ Ease Completed w/ Difficulty Failed to Complete Use GSG? Yes No 12 Bluetooth Finished w/ Ease Completed w/ Difficulty Failed to Complete

The Used Notepad

Get clients to use sheets and record data.

Our Setup

Our Setup Participant

Our Setup Participant Facilitator

Our Setup Video Camera Participant Facilitator

Our Setup Video Camera Participant WebCam Facilitator

Our Setup Two Way Glass Video Camera Participant Observer WebCam Facilitator

Our Setup Two Way Glass Video Camera Network / Router Participant Observer WebCam Facilitator

Our Setup Two Way Glass Video Camera Network / Router Participant Observer WebCam Facilitator Client Team & Schmoozer

Using these tools, we were able to create better data that was easier to analyze.

“I recently asked 258 usability practitioners which methods they use to communicate findings from their studies” - Jakob Nielsen, 2005 http://www.useit.com/alertbox/20050425.html

“I recently asked 258 usability practitioners which methods they use to communicate findings from their studies” - Jakob Nielsen, 2005 http://www.useit.com/alertbox/20050425.html http://www.happywebbies.com/download

Formal Usability Reports vs. Quick Findings

Formal Usability Reports vs. Quick Findings (2)

The typical usability report life-cycle:

http://www.flickr.com/photos/phooky/1390640732/

http://www.flickr.com/photos/seanstayte/660772151/

Do I really have to read all of this?

Maybe, a DVD arrives in the mail a few weeks later with video.

Problem: Usability reports are boring and nobody wants to read them.

Problem: Usability reports are not shared among the people who need them most.

Problem: There is a disconnect between video highlights and the findings in the report.

Test Debrief Session

http://www.flickr.com/photos/phooky/1390640732/

Findings Module

Easy to Parse Data

Utility Functions

Invite a Colleague via Email

Montages

Sortable Data

Demo

Clients engaged on report.

Delivery method improved reporting

While hours increased on creating reports, the value was well worth it for our clients.

What’s Next?

Discussion threads on findings

Assignable action items on all recommendations.

Web app to create reports

Takeaways

Get your reports online and interactive.

Engage with client’s product team as much as possible.

Re-design your process!

Karyn Zuidinga Senior Information Architect office: 604 669 7655 mobile: 778 386 6982 karyn@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com Thank you. Greg Bell User Experience Designer office: 604 669 7655 mobile: 778 995 1014 greg@analyticdesigngroup.com Analytic Design Group Suite 300 - 1300 Richards Vancouver British Columbia V6B 3G6 Canada www.analyticdesigngroup.com http://creativecommons.org/licenses/by-nc/2.5/ca/

Usability 2.0

8 comments

Notes on slide 1

152 Favorites & 6 Groups

Usability 2.0 - Presentation Transcript

More by user

More Info

Categories

Tags

Tags

Groups / Events

Usability 2.0

8 comments

Notes on slide 1

152 Favorites & 6 Groups

Usability 2.0 - Presentation Transcript

Related Presentations

More by user

More Info

Categories

Tags

Tags

Groups / Events