No IM Please, Were Testing
•
8 likes•1,136 views
This paper discusses the use of instant messaging (IM) as a communication tool during usability studies � primarily between the interview and observation rooms. The benefits and challenges associated with providing an IM link are discussed, based on feedback from a survey of study moderators and observers. Observers were much more positive about the use of IM than the moderators. A key concern to moderators was the potential distraction to themselves, participants and observers. In contrast, observers greatly welcomed the opportunity to ask questions and help deal with buggy prototypes. Guidelines are outlined for the effective use of IM within a usability context, and contexts outlined when an IM link is most appropriate.
![Instant Messaging in Usability Studies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Recommended
More Related Content
Similar to No IM Please, Were Testing
Similar to No IM Please, Were Testing (20)
More from Rick Boardman
More from Rick Boardman (10)
Recently uploaded
Recently uploaded (20)
No IM Please, Were Testing
- 1. No IM Please, We’re Testing Richard Boardman CHI 2006, Montreal, April 24th 2006
- 3. Usability Lab Setup Interview Room Observation Room 1-way mirror
- 4. Usability Lab Setup Interview Room Observation Room Moderator User 1-way mirror
- 5. Usability Lab Setup Interview Room Observation Room Moderator User 1-way mirror Eng PM UI
- 6. Usability Lab Setup + Instant Messaging Eng PM Moderator User UI 1-way mirror Interview Room Observation Room
- 7. Personal Experiences with IM in Usability
- 8. The Usability Nightmare - **BUGS** UI Eng PM Moderator User ??? Oh no - I broke their computer. I hope they still pay me sorry, I just rebooted the server
- 9. Complex Multi-step Coordination UI Eng PM move on yet? keep her talking, We’re updating the database This is boring, I want my $$$ Moderator User
- 10. Questions from Team UI Eng PM Moderator User Any more questions on this page? does she like the colours? What should I spend my $$$ on?
- 11. The Chatterbox PM UI Eng PM Moderator User pls turn off the pm’s laptop VIA TESTED IM: Baseball … blah blah … VIA TESTED IM: Nice to meet another Giants fan … blah blah …
- 12. Survey
- 14. Negative Feedback - IM as a distraction
- 15. “ It distracts the moderator” UI Eng PM Moderator User Blah blah blah blah … Uh oh, what did the user do just then? **Amazing revelation**
- 16. “ It distracts the observers” UI Eng PM Moderator User What does “http” mean? 101101 … **Amazing revelation** Wow - I hope they fix that ! <html> …
- 17. Moderators: “Danger of back seat drivers …” UI Eng PM Moderator User Yeah right … I’m in charge here! Move onto page2. Prompt them to do Y. Ask if they love the tool
- 18. Moderators: “It distracts the user” UI Eng PM Moderator User Is he doing his email? blah … <html> …
- 19. Moderators: “Observers may not turn up” Moderator User This team really buys into Usability! Its great to have lots of observers its sooooo sunny in santa cruz. hows the test goin?
- 20. Positive Feedback - IM as a Tool
- 21. “ Handy for when the UI goes belly up” UI Eng PM Moderator User Sorry, I just rebooted the server Grrr … Grrrr … Grrr … I’m sorry, Did I break Your computer?
- 22. “ Handy for extra questions” UI Eng PM Moderator User any more q’s b4 we wrap up? Aggh, when is this going to finish??
- 23. Moderators: “Useful for training” Backup moderator Eng PM Moderator User Try saying this … << smooth diplomatic phrase>> Help!!! Rant! Rave! Gibber! $%&*! This makes me SO ANGRY!!!! Someone better call security
- 24. Observers: “So I can call in from the pool” Moderator User Its nice of UI to check in from the NY office … how’s it going? NY is really cold
- 25. Guidelines
- 26. Guideline: 1-way IM only UI Eng PM Moderator User Why won’t he reply??
- 27. Guideline: One to one IM UI Eng PM Moderator User pls ask about feature foo ask others for extra questions
- 28. Create a special, secure IM account UI Eng PM Moderator User **Hello Richard This is your mother** Why is he blushing?
- 29. End of Session only UI Eng PM Moderator User Oops, we used the old version, can we start again? any more q’s b4 we wrap up?
- 30. Don’t distract user UI Eng PM Moderator User That’s a nice chat alert! I wonder if I can get it as a ringtone for my phone?
- 32. CHI 2006, Montreal, April 24th 2006 No IM Please, We’re Testing Rick Boardman [email_address] PS: We’re recruiting Thank you to survey respondents!
- 33. Go back
- 34. Go back (really)
Editor's Notes
- Hello everyone I’m going to be talking I’ll throw in a few