cjohansenuseful links to european research1 year ago
Are you sure you want to
XSEO at XSEOhttp://XSEO.CO - You have a business and you are not familiar? Why not develop on the Internet? Want a website for your business? Want an online store? Want a presentation website for your company? WE HAVE THE SAME PRICE FOR ALL! id messenger: xseoco icq:4239667042 years ago
DIY mobile usability testing - IA Summit 2011Presentation Transcript
we are ...
Bernard, packet core engineer at NSN
Belén, interaction designer at Intel
usability testinga process that employs people as testingparticipants who are representative of thetarget audience to evaluate the degree towhich a product meets specific usabilitycriteria.Handbook of usability testing 2nd Ed., J. Rubin and D. Chisnell
please, stand up everyone
sit down if you don’thave a US cellphone with a data plan
sit down if you don’t like beer
sit down if you areabsolutely terrified bythe idea of being our test subject
why recording? memory aid powerful communication tool
actions reactions
dut = mut
dut = mut + afecwhere:dut = desktop usability testingmut = mobile usability testingafec = a few extra challenges
which phone?which context?which connection?
which phone?which context?which connection?
web task success rates feature phones 38% smartphones 55% touch phones 75%Mobile usability, J. Nielsen’s Alertbox 20 Jul 2009http://www.useit.com/alertbox/mobile-usability.html
web task success rates feature phones 38% smartphones 55% touch phones 75%Mobile usability, J. Nielsen’s Alertbox 20 Jul 2009http://www.useit.com/alertbox/mobile-usability.html
web task success rates feature phones 38% smartphones 55% touch phones 75%Mobile usability, J. Nielsen’s Alertbox 20 Jul 2009http://www.useit.com/alertbox/mobile-usability.html
web task success rates feature phones 38% smartphones 55% touch phones 75%Mobile usability, J. Nielsen’s Alertbox 20 Jul 2009http://www.useit.com/alertbox/mobile-usability.html
handset usabilityaffects test results
remember ... test with participants’ own phones if not possible, include training and warm-up tasks
which phone?which context?which connection?
field vs. labIt’s Worth the Hassle! The Added Value of Evaluating the Usability of Mobile Systems in the FieldC.M. Nielsen, M. Overgaard, M.B. Pedersen, J. Stage, S. Stenild - NordiCHI 2006
experts disagreeaccording to our study there was nodifference in the number of problems thatoccurred in the two test settings. Ourhypothesis that more problems would befound in the field was not supportedUsability Testing of Mobile Applications: A Comparison between Laboratory and Field TestingA. Kaikkonen, T. Kallio, A. Kekäläinen, A. Kankainen, M. Cankar - Journal of Usability Studies, 2005
experts disagreeevaluations conducted in field settings canreveal problems not otherwise identifiedin laboratory evaluationsIt’s Worth the Hassle! The Added Value of Evaluating the Usability of Mobile Systems in the FieldC.M. Nielsen, M. Overgaard, M.B. Pedersen, J. Stage, S. Stenild - NordiCHI 2006
but they all agreeevaluations in the field (are) morecomplex and time-consumingIt’s Worth the Hassle! The Added Value of Evaluating the Usability of Mobile Systems in the FieldC.M. Nielsen, M. Overgaard, M.B. Pedersen, J. Stage, S. Stenild - NordiCHI 2006 testing in the field requires double the time in comparison to the laboratory Usability Testing of Mobile Applications: A Comparison between Laboratory and Field Testing A. Kaikkonen, T. Kallio, A. Kekäläinen, A. Kankainen, M. Cankar - Journal of Usability Studies, 2005
testing in the lab isbetter than no testing
remember ... for most software, lab testing is fine if you must do field testing do it late plan and run pilot tests be prepared (like the Scouts)
which phone?which context?which connection?
!"#$%& &()"*+,-*.//$0,1*")(2US Mobile Data Market Update Q4 2010 and 2010, Chetan Sharma Technology & Strategy Consultinghttp://www.chetansharma.com/usmarketupdate2010.htm "$$89::;;;<="#$%&,"%)*%<=+* 67 !"!"#$%&("%)*%!+&,-.$/&01 2..3/0"$,3#,#)4#5 #$%&"())
remember ... do not test over wi-fi cover participants’ data costs
tsdohoeaygtrtwtdut = (mut + afec)where:dut = desktop usability testingmut = mobile usability testingafec = a few extra challengestsdohoeaygtrtwt = the smalldetail of how on earth are yougoing to record the whole thing
why recording? memory aid powerful communication tool
4 approaches to thesmall detail of how on earth are you going to record the whole thing
1. wearable equipment . Methods and techniques for field-based usability testing of mobile geo-applications, I. Delikostidis (2007) International Institute for Geo-Information Science and Earth Observation (Enschede, The Netherlands)
allows testing in the field
but ... difficult and time-consuming to set up intrusive, uncomfortable and heavy
2. screen-capture applications UsabilityExpo by Digia for S60 3rd and 5th ed, WinMo 6.1+ and Maemo 5 http://www.digia.com/C2256FEF0043E9C1/0/405001348
provides high quality screen recording
but no application willsupport all platformshttp://www.digia.com/C2256FEF0043E9C1/0/405001348
it’s not cheaphttps://shop.digia.com
and participants won’t appreciateyou installing stuff on their phones
3. document camerasHandheld Usability, S. Weiss (page 174)
Google Towards the Perfect Infrastructure for Usability Testing on Mobile Devices R. Schusteritsch, C.Y. Wei, M. LaRosa - Google (CHI 2007)
Nielsen Norman Elmo TT-02RX Teachers Tool document camera with autofocus controlled remotely from a laptop records screen and fingers webcam records both video streams participant’s face fed onto a laptop and recorded with Morae Photo from Nielsen Norman Mobile Usability workshop handout (London, 22 May 2009)
popular and well documented
it’s not cheaphttp://www.bhphotovideo.com/c/product/644591-REG/Elmo_1304.html
participants mustkeep within thecamera range
phone must lay on a desk or be hold at a flat anglehttp://www.flickr.com/photos/zabriskiepoint/2806511301/sizes/m/in/photostream/
4. mounted devices
4a. ready-made mounted devices Mobile Device Camera by Tracksys http://www.tracksys.co.uk/product- details.php?id=9 Mobile Device Camera by Noldus http://www.noldus.com/human-behavior- research/accessories/mobile-device-camera- mdc#
4b. DIY mounted devices Little Springs Design http://www.littlespringsdesign.com/blog/2008/Jun/usability- testing-for-mobile-devices-2/
4b. DIY mounted devices Little Springs Design Nick Bowmast http://www.bowmast.com/mob-device-cam/ http://www.littlespringsdesign.com/blog/2008/Jun/usability- testing-for-mobile-devices-2/
4b. DIY mounted devices Little Springs Design Nick Bowmast http://www.bowmast.com/mob-device-cam/ http://www.littlespringsdesign.com/blog/2008/Jun/usability- testing-for-mobile-devices-2/ Usability Sciences http://www.usabilitysciences.com/services/lab- based-usability-testing/mobile-usability-testing
4b. DIY mounted devices Little Springs Design Nick Bowmast http://www.bowmast.com/mob-device-cam/ http://www.littlespringsdesign.com/blog/2008/Jun/usability- testing-for-mobile-devices-2/ Google Towards the Perfect Infrastructure for Usability Testing on Mobile Usability Sciences Devices, R. Schusteritsch, C.Y. Wei, http://www.usabilitysciences.com/services/lab- M. LaRosa - Google (CHI 2007) based-usability-testing/mobile-usability-testing
natural interaction with the phone
but it’s not cheaphttp://www.90percentofeverything.com/2010/05/07/quick-tip-make-your-own-iphone-usability-testing-sled-for-5/
messy to buildhttp://www.littlespringsdesign.com/blog/2008/Jun/usability-testing-for-mobile-devices-2/
and ... if bulky they can prevent single-hand use if heavy they can become tiring during long tests
easy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
easy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face & fingersgives enough video quality
easy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face & fingersgives enough video quality
the spirithttp://www.wired.com/gadgetlab/2010/07/the-pencil-ipad-stand-smart-enough-to-impress-a-new-yorker/
theingredients
two meccano trunions (part no. A126)
two 5 and 6-hole meccano strips (part nos. 5 & 4)
one 11-hole meccano strip (part no. 2)
six meccano screws & nuts (part nos. 69 & 37h)
one 13-20mm jubilee clip
one HUE HD webcam
a second USB webcam
a USB male to female extension cable
blu tack
an allen key
a meccano wrench
a screwdriver
a Windows computer
screen recording software
a taskYou are planning a visit to the DenverZoo after this (great) session.Go to www.denverzoo.org and find outwhich bus number will bring you to thezoo from the Colorado ConventionCentre.
how was that?
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
15-model meccano set 18.33Hue HD webcam 28.94Philips webcam 52.08additional meccano parts 4.90blu tack 0.98jubilee clips (x2) 1.55USB cable 8.99screwdriver 5.99CamStudio 0.00 total (in GBP) 121.76
in USD: 196.40
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
weight: 125 grams an iPhone weighs 137 grams an iPad weighs 680 grams I weigh 55,000 grams a blue whale weighs 136,400,000 grams
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
Nokia E66slider with 12-keynumeric keypad
Nokia E71 BB Bold candybar with qwerty keyboard
iPhone 3Gtouchscreencandybar
Nokia N900 slider touchscreen with qwerty keyboard
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
b&b’seasy to put togethercheaprepeatableallows holding the deviceallows one-handed usesupports all form factorsruns tests with participants’ phonescaptures screen, face and fingersgives enough video quality
we expect much of our buildings: theyneed to have firm foundations, solidstructures, pleasing aesthetics. We shouldexpect the same of emerging mobilesystems.Mobile Interaction Design, M. Jones and G. Marsden (2005)
id messenger: xseoco
icq:423966704 2 years ago