MSN Messenger 6.1 Whiteboard Usability Evaluation SI 622 Winter 2004 Yong Kim, Stan Drozdetski, Jonas Kong, Kathy Lee

Overview Product Description Methods & Tools Findings Recommendations Conclusion Overview

Product Description

Methods & Tools

Findings

Recommendations

Conclusion

MSN Messenger 6.1 Whiteboard Collaborative features ported from NetMeeting Real time shared graphical workspace To be integrated into Longhorn Product Description

Collaborative features ported from NetMeeting

Real time shared graphical workspace

To be integrated into Longhorn

MSN Messenger 6.1 Whiteboard Product Description Action Toolbar Color Selection Page Navigation

Methods & Tools (1) GTN Personas & scenarios (formal & informal use) Comparative evaluation (3 IM clients & 4 groupware applications) Online Survey (207 responses) Methods & Tools

GTN

Personas & scenarios (formal & informal use)

Comparative evaluation (3 IM clients & 4 groupware applications)

Online Survey (207 responses)

Methods & Tools (2) Cognitive walkthrough Heuristic evaluation (2 scenarios) Usability test (7 participants) Vocabulary analysis Methods & Tools

Cognitive walkthrough

Heuristic evaluation (2 scenarios)

Usability test (7 participants)

Vocabulary analysis

A few extensions… Literature review at each evaluation (e.g., task design) Card sorting to categorize findings through iterative clustering Real whiteboard in metaphor analysis Methods & Tools

Literature review at each evaluation (e.g., task design)

Card sorting to categorize findings through iterative clustering

Real whiteboard in metaphor analysis

What we learned Functionality is there But, not very usable Still, users liked it! Findings

Functionality is there

But, not very usable

Still, users liked it!

Functionality is there Compares favorably with competitors But, lack of support for image file types Findings

Compares favorably with competitors

But, lack of support for image file types

But, not very intuitive A whiteboard in namesake only Some positive aspects Some negative ones (demo: drawing & erasing) Findings

A whiteboard in namesake only

Some positive aspects

Some negative ones (demo: drawing & erasing)

But, not very intuitive (2) No correspondence in task flow A real whiteboard immediate & continuous feedback talk & draw at the same time only one drawing tool Findings

No correspondence in task flow

A real whiteboard

immediate & continuous feedback

talk & draw at the same time

only one drawing tool

Not very understandable Poor labeling and visual representation what does this do? Findings eraser?

Poor labeling and visual representation

Not very friendly Fatal errors uh oh hmm I think I crashed something… Findings

Fatal errors

Not very helpful Help? There is help…for NetMeeting! Help is not contextual Findings

Help? There is help…for NetMeeting!

Help is not contextual

Still, users liked it! ‘ Useful’ (3/7) ‘ Collaborative’ (2/7) ‘ Fun’ (2/7) ‘ Valuable’ (1/7) ‘ Empowering’ (1/7) Findings

‘ Useful’ (3/7)

‘ Collaborative’ (2/7)

‘ Fun’ (2/7)

‘ Valuable’ (1/7)

‘ Empowering’ (1/7)

Some ideas Short term Improve tools / icons Long term Simplify interaction Recommendations

Short term

Improve tools / icons

Long term

Simplify interaction

Get rid of Eraser Vector-based graphics prohibit partial erase Use ‘Del’ or ‘Backspace’ instead Recommendations

Vector-based graphics prohibit partial erase

Use ‘Del’ or ‘Backspace’ instead

More expressive cursor Reflect the tool and color selected Show to the remote participant Recommendations

Reflect the tool and color selected

Show to the remote participant

Drag n’ Drop A straightforward way to introduce outside content Recommendations

A straightforward way to introduce outside content

Survey Users Address vocabulary problem by surveying users for word choice, tools needed Recommendations

Address vocabulary problem by surveying users for word choice, tools needed

Yahoo! Doodle Integrated drawing surface, text and voice chat Only one drawing tool Recommendations

Integrated drawing surface, text and voice chat

Only one drawing tool

Final Remarks NetMeeting vs. MSN Messenger Make it useful AND usable Whiteboard will attract users to MSN Conclusion Conclusion

NetMeeting vs. MSN Messenger

Make it useful AND usable

Whiteboard will attract users to MSN

Thank you for listening! Any Questions? ?