No IM Please, Were Testing

4,309 views

Published on

This paper discusses the use of instant messaging (IM) as a communication tool during usability studies � primarily between the interview and observation rooms. The benefits and challenges associated with providing an IM link are discussed, based on feedback from a survey of study moderators and observers. Observers were much more positive about the use of IM than the moderators. A key concern to moderators was the potential distraction to themselves, participants and observers. In contrast, observers greatly welcomed the opportunity to ask questions and help deal with buggy prototypes. Guidelines are outlined for the effective use of IM within a usability context, and contexts outlined when an IM link is most appropriate.

Published in: Technology, Design
7 Comments
8 Likes
Statistics
Notes
  • not kool man
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Thanks on that...Anyway, this might be already off the topic but I’ve lifted an update from the net that might be of help..
    Here it goes…

    10 Filters for RSS feeds
    RSS feeds are great to collect whats going on with your favourite blogs, but a nightmare when you have to filter through 10s, 100s, 1000s of feeds. It is even more annoying when majority of those feeds just do not appeal to you. Here is a list of RSS filtering tools to water down those rss feeds, some these also allow keyword based searches to be sent to via email, IM or mobile phone:
    FeedRinse online service that will take your feeds and filter them for you based on keyword, tag, author, etc.
    FeedShake is a free service for customizing, filtering, converting and merging newsfeeds and podcasts. You can use keywords & tags to customize your feeds.
    ZapTXT lets you create custom keyword searches to track your favourite rss-enabled websites via email, IM or Mobile phone. / Alfa romeo catalytic converter - http://www.ecatalyticconverter.com/alfa_romeo-converter.html
    BayesNews is a RSS news aggregator that uses Bayes’ theorem to classify texts.It includes a number of features that help you aggregate, filter RSS feeds and sends you instant notification as soon as any result matching your criteria appear.
    AideRSS is an intelligent assistant that saves time and keeps you on top of the latest news. We research every story and filter out the noise, allowing you to focus on what matters most.
    Using Dapper, any web page becomes a LEGO block, which you can arrange and manipulate in any way you like.
    Sneeu is a simple rss filtering solution that filters out immediate published rss feeds by requesting a url and keyword:
    OnePipe is a browser bookmarklet created to filter any feed by topic. It’s simple to use: install the bookmarklet, navigate to any website whose feed you’d like to filter and click the
    OnePipe button. illumio is a new way to stay informed and connected in a web world that is exploding with social networks, blogs, news, and other content. illumio frees you from manually tracking everything you care about on the Web: instead, illumio monitors the feeds you choose and groups you join and delivers to you only what’s important to you.
    Source:[www.oscandy.com];
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • I love it. Need to adopt the comic style for some of my upcoming presentations. I should be offended... portraying the Product Managers as clueless ... So what is IM again ;-)
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Ha! That's what the tagline of slideshare should be:
    Enjoy the slideshow without the presenter!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Even better than I remembered it! (maybe the lack of presenter does the trick).
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
4,309
On SlideShare
0
From Embeds
0
Number of Embeds
111
Actions
Shares
0
Downloads
2
Comments
7
Likes
8
Embeds 0
No embeds

No notes for slide
  • Hello everyone I’m going to be talking I’ll throw in a few
  • No IM Please, Were Testing

    1. 1. No IM Please, We’re Testing Richard Boardman CHI 2006, Montreal, April 24th 2006
    2. 2. Instant Messaging in Usability Studies <ul><li>Personal Experiences </li></ul><ul><ul><ul><li>(including a few stories from the Google labs) </li></ul></ul></ul><ul><li>Survey </li></ul><ul><ul><ul><li>Problems </li></ul></ul></ul><ul><ul><ul><li>Opportunities </li></ul></ul></ul><ul><li>Guidelines </li></ul>
    3. 3. Usability Lab Setup Interview Room Observation Room  1-way mirror
    4. 4. Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror
    5. 5. Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror Eng PM UI
    6. 6. Usability Lab Setup + Instant Messaging Eng PM Moderator User UI  1-way mirror Interview Room Observation Room
    7. 7. Personal Experiences with IM in Usability
    8. 8. The Usability Nightmare - **BUGS** UI Eng PM Moderator User ??? Oh no - I broke their computer. I hope they still pay me sorry, I just rebooted the server
    9. 9. Complex Multi-step Coordination UI Eng PM move on yet? keep her talking, We’re updating the database This is boring, I want my $$$ Moderator User
    10. 10. Questions from Team UI Eng PM Moderator User Any more questions on this page? does she like the colours? What should I spend my $$$ on?
    11. 11. The Chatterbox PM UI Eng PM Moderator User pls turn off the pm’s laptop VIA TESTED IM: Baseball … blah blah … VIA TESTED IM: Nice to meet another Giants fan … blah blah …
    12. 12. Survey
    13. 13. What do others think of this technique? <ul><li>Email survey </li></ul><ul><ul><ul><li>11 moderators </li></ul></ul></ul><ul><ul><ul><li>15 observers (designers, product managers, engineers, tech writers, …) </li></ul></ul></ul><ul><li>Is IM a useful tool in usability? (1  5) </li></ul><ul><ul><ul><li>Moderators: 2.3 </li></ul></ul></ul><ul><ul><ul><li>Observers: 3.9 </li></ul></ul></ul>
    14. 14. Negative Feedback - IM as a distraction
    15. 15. “ It distracts the moderator” UI Eng PM Moderator User Blah blah blah blah … Uh oh, what did the user do just then? **Amazing revelation**
    16. 16. “ It distracts the observers” UI Eng PM Moderator User What does “http” mean? 101101 … **Amazing revelation** Wow - I hope they fix that ! <html> …
    17. 17. Moderators: “Danger of back seat drivers …” UI Eng PM Moderator User Yeah right … I’m in charge here! Move onto page2. Prompt them to do Y. Ask if they love the tool
    18. 18. Moderators: “It distracts the user” UI Eng PM Moderator User Is he doing his email? blah … <html> …
    19. 19. Moderators: “Observers may not turn up” Moderator User This team really buys into Usability! Its great to have lots of observers its sooooo sunny in santa cruz. hows the test goin?
    20. 20. Positive Feedback - IM as a Tool
    21. 21. “ Handy for when the UI goes belly up” UI Eng PM Moderator User Sorry, I just rebooted the server Grrr … Grrrr … Grrr … I’m sorry, Did I break Your computer?
    22. 22. “ Handy for extra questions” UI Eng PM Moderator User any more q’s b4 we wrap up? Aggh, when is this going to finish??
    23. 23. Moderators: “Useful for training” Backup moderator Eng PM Moderator User Try saying this … << smooth diplomatic phrase>> Help!!! Rant! Rave! Gibber! $%&*! This makes me SO ANGRY!!!! Someone better call security
    24. 24. Observers: “So I can call in from the pool” Moderator User Its nice of UI to check in from the NY office … how’s it going? NY is really cold
    25. 25. Guidelines
    26. 26. Guideline: 1-way IM only UI Eng PM Moderator User Why won’t he reply??
    27. 27. Guideline: One to one IM UI Eng PM Moderator User pls ask about feature foo ask others for extra questions
    28. 28. Create a special, secure IM account UI Eng PM Moderator User **Hello Richard This is your mother** Why is he blushing?
    29. 29. End of Session only UI Eng PM Moderator User Oops, we used the old version, can we start again? any more q’s b4 we wrap up?
    30. 30. Don’t distract user UI Eng PM Moderator User That’s a nice chat alert! I wonder if I can get it as a ringtone for my phone?
    31. 31. Conclusions <ul><li>Effective Usage </li></ul><ul><ul><ul><li>Follow guidelines </li></ul></ul></ul><ul><ul><ul><li>Buggy/experimental UI </li></ul></ul></ul><ul><ul><ul><li>Training new moderators </li></ul></ul></ul><ul><ul><ul><li>Remote observers </li></ul></ul></ul><ul><li>Towards Agile Usability </li></ul><ul><ul><ul><li>Engage observers  collaboration </li></ul></ul></ul><ul><ul><ul><li>Exploratory studies  Promote rapid iteration </li></ul></ul></ul>
    32. 32. CHI 2006, Montreal, April 24th 2006 No IM Please, We’re Testing Rick Boardman [email_address] PS: We’re recruiting Thank you to survey respondents!
    33. 33. Go back
    34. 34. Go back (really)

    ×