• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
No IM Please, Were Testing
 

No IM Please, Were Testing

on

  • 7,797 views

This paper discusses the use of instant messaging (IM) as a communication tool during usability studies � primarily between the interview and observation rooms. The benefits and challenges ...

This paper discusses the use of instant messaging (IM) as a communication tool during usability studies � primarily between the interview and observation rooms. The benefits and challenges associated with providing an IM link are discussed, based on feedback from a survey of study moderators and observers. Observers were much more positive about the use of IM than the moderators. A key concern to moderators was the potential distraction to themselves, participants and observers. In contrast, observers greatly welcomed the opportunity to ask questions and help deal with buggy prototypes. Guidelines are outlined for the effective use of IM within a usability context, and contexts outlined when an IM link is most appropriate.

Statistics

Views

Total Views
7,797
Views on SlideShare
7,743
Embed Views
54

Actions

Likes
8
Downloads
2
Comments
7

8 Embeds 54

http://www.techgig.com 18
http://www.linkedin.com 17
http://www.slideshare.net 7
http://pcadviceus.blogspot.com 5
http://www.ecipar.ra.it 3
http://10.150.200.102 2
http://ciclos.1real.li 1
https://www.linkedin.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

17 of 7 previous next Post a comment

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • not kool man
    Are you sure you want to
    Your message goes here
    Processing…
  • Thanks on that...Anyway, this might be already off the topic but I’ve lifted an update from the net that might be of help..
    Here it goes…

    10 Filters for RSS feeds
    RSS feeds are great to collect whats going on with your favourite blogs, but a nightmare when you have to filter through 10s, 100s, 1000s of feeds. It is even more annoying when majority of those feeds just do not appeal to you. Here is a list of RSS filtering tools to water down those rss feeds, some these also allow keyword based searches to be sent to via email, IM or mobile phone:
    FeedRinse online service that will take your feeds and filter them for you based on keyword, tag, author, etc.
    FeedShake is a free service for customizing, filtering, converting and merging newsfeeds and podcasts. You can use keywords & tags to customize your feeds.
    ZapTXT lets you create custom keyword searches to track your favourite rss-enabled websites via email, IM or Mobile phone. / Alfa romeo catalytic converter - http://www.ecatalyticconverter.com/alfa_romeo-converter.html
    BayesNews is a RSS news aggregator that uses Bayes’ theorem to classify texts.It includes a number of features that help you aggregate, filter RSS feeds and sends you instant notification as soon as any result matching your criteria appear.
    AideRSS is an intelligent assistant that saves time and keeps you on top of the latest news. We research every story and filter out the noise, allowing you to focus on what matters most.
    Using Dapper, any web page becomes a LEGO block, which you can arrange and manipulate in any way you like.
    Sneeu is a simple rss filtering solution that filters out immediate published rss feeds by requesting a url and keyword:
    OnePipe is a browser bookmarklet created to filter any feed by topic. It’s simple to use: install the bookmarklet, navigate to any website whose feed you’d like to filter and click the
    OnePipe button. illumio is a new way to stay informed and connected in a web world that is exploding with social networks, blogs, news, and other content. illumio frees you from manually tracking everything you care about on the Web: instead, illumio monitors the feeds you choose and groups you join and delivers to you only what’s important to you.
    Source:[www.oscandy.com];
    Are you sure you want to
    Your message goes here
    Processing…
  • I love it. Need to adopt the comic style for some of my upcoming presentations. I should be offended... portraying the Product Managers as clueless ... So what is IM again ;-)
    Are you sure you want to
    Your message goes here
    Processing…
  • Ha! That's what the tagline of slideshare should be:
    Enjoy the slideshow without the presenter!
    Are you sure you want to
    Your message goes here
    Processing…
  • Even better than I remembered it! (maybe the lack of presenter does the trick).
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Hello everyone I’m going to be talking I’ll throw in a few

No IM Please, Were Testing No IM Please, Were Testing Presentation Transcript

  • No IM Please, We’re Testing Richard Boardman CHI 2006, Montreal, April 24th 2006
  • Instant Messaging in Usability Studies
    • Personal Experiences
        • (including a few stories from the Google labs)
    • Survey
        • Problems
        • Opportunities
    • Guidelines
  • Usability Lab Setup Interview Room Observation Room  1-way mirror
  • Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror
  • Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror Eng PM UI
  • Usability Lab Setup + Instant Messaging Eng PM Moderator User UI  1-way mirror Interview Room Observation Room
  • Personal Experiences with IM in Usability
  • The Usability Nightmare - **BUGS** UI Eng PM Moderator User ??? Oh no - I broke their computer. I hope they still pay me sorry, I just rebooted the server
  • Complex Multi-step Coordination UI Eng PM move on yet? keep her talking, We’re updating the database This is boring, I want my $$$ Moderator User
  • Questions from Team UI Eng PM Moderator User Any more questions on this page? does she like the colours? What should I spend my $$$ on?
  • The Chatterbox PM UI Eng PM Moderator User pls turn off the pm’s laptop VIA TESTED IM: Baseball … blah blah … VIA TESTED IM: Nice to meet another Giants fan … blah blah …
  • Survey
  • What do others think of this technique?
    • Email survey
        • 11 moderators
        • 15 observers (designers, product managers, engineers, tech writers, …)
    • Is IM a useful tool in usability? (1  5)
        • Moderators: 2.3
        • Observers: 3.9
  • Negative Feedback - IM as a distraction
  • “ It distracts the moderator” UI Eng PM Moderator User Blah blah blah blah … Uh oh, what did the user do just then? **Amazing revelation**
  • “ It distracts the observers” UI Eng PM Moderator User What does “http” mean? 101101 … **Amazing revelation** Wow - I hope they fix that ! <html> …
  • Moderators: “Danger of back seat drivers …” UI Eng PM Moderator User Yeah right … I’m in charge here! Move onto page2. Prompt them to do Y. Ask if they love the tool
  • Moderators: “It distracts the user” UI Eng PM Moderator User Is he doing his email? blah … <html> …
  • Moderators: “Observers may not turn up” Moderator User This team really buys into Usability! Its great to have lots of observers its sooooo sunny in santa cruz. hows the test goin?
  • Positive Feedback - IM as a Tool
  • “ Handy for when the UI goes belly up” UI Eng PM Moderator User Sorry, I just rebooted the server Grrr … Grrrr … Grrr … I’m sorry, Did I break Your computer?
  • “ Handy for extra questions” UI Eng PM Moderator User any more q’s b4 we wrap up? Aggh, when is this going to finish??
  • Moderators: “Useful for training” Backup moderator Eng PM Moderator User Try saying this … << smooth diplomatic phrase>> Help!!! Rant! Rave! Gibber! $%&*! This makes me SO ANGRY!!!! Someone better call security
  • Observers: “So I can call in from the pool” Moderator User Its nice of UI to check in from the NY office … how’s it going? NY is really cold
  • Guidelines
  • Guideline: 1-way IM only UI Eng PM Moderator User Why won’t he reply??
  • Guideline: One to one IM UI Eng PM Moderator User pls ask about feature foo ask others for extra questions
  • Create a special, secure IM account UI Eng PM Moderator User **Hello Richard This is your mother** Why is he blushing?
  • End of Session only UI Eng PM Moderator User Oops, we used the old version, can we start again? any more q’s b4 we wrap up?
  • Don’t distract user UI Eng PM Moderator User That’s a nice chat alert! I wonder if I can get it as a ringtone for my phone?
  • Conclusions
    • Effective Usage
        • Follow guidelines
        • Buggy/experimental UI
        • Training new moderators
        • Remote observers
    • Towards Agile Usability
        • Engage observers  collaboration
        • Exploratory studies  Promote rapid iteration
  • CHI 2006, Montreal, April 24th 2006 No IM Please, We’re Testing Rick Boardman [email_address] PS: We’re recruiting Thank you to survey respondents!
  • Go back
  • Go back (really)