Usability Testing of Mobile Devices

1,729 views

Published on

Learn how the usability testing for Kobo e-book reader platform was completed.

Published in: Technology
1 Comment
2 Likes
Statistics
Notes
No Downloads
Views
Total views
1,729
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
1
Likes
2
Embeds 0
No embeds

No notes for slide
  • - Some users used both the dpad and front facing buttons; one person left it on the table
  • - Only universally failed task was power on
  • - Only universally failed task was power on
  • Usability Testing of Mobile Devices

    1. 1. Usability Testing of Mobile Devices Dave Lougheed VP User Experience Klick
    2. 2. How to conduct usability testing on a mobile device
    3. 4. Agenda <ul><li>About Me </li></ul><ul><li>The Challenge </li></ul><ul><li>The Solution </li></ul><ul><li>The Results </li></ul><ul><li>Lessons Learned </li></ul><ul><li>Q & A </li></ul>
    4. 5. Dave Lougheed <ul><li>VP User Experience at Klick </li></ul><ul><li>Over 15 years of user experience design and leadership </li></ul><ul><li>Many fortune 500 clients including AOL, Nike, Starbucks, BMW </li></ul><ul><li>Specialty in UI design </li></ul>
    5. 7. Challenge <ul><li>In late 2009, Klick was asked to conduct usability testing on a prototype e-reader platform </li></ul><ul><li>We had did not have an out-of-the-box usability testing solution for mobile devices and timeline was tight </li></ul><ul><li>Client was very tech savvy and had high expectations for the testing </li></ul>
    6. 8. Challenge <ul><li>Competitive research showed others having built custom “sleds” to house and record mobile devices </li></ul><ul><li>None of these solutions felt right for the scale and form factor of the e-reader </li></ul><ul><li>We would not have time to construct and optimize custom hardware in the short timelines </li></ul>
    7. 10. Challenge <ul><li>Other factors included: </li></ul><ul><ul><li>quality of observation experience </li></ul></ul><ul><ul><li>audio recording </li></ul></ul><ul><ul><li>glare from lighting </li></ul></ul><ul><ul><li>screen legibility on camera </li></ul></ul><ul><ul><li>keeping the device “in the shot” </li></ul></ul><ul><ul><li>assembling the camera rigs </li></ul></ul>
    8. 13. Solution - Software <ul><li>After extensive research, Morae 3.1 was selected as our testing platform software </li></ul><ul><li>Morae 3.1 allows the use of two camera inputs to be recorded (one on the prototype, one on the user’s face) </li></ul>
    9. 16. Solution - Hardware <ul><li>We realized our traditional usability lab wasn’t ideal </li></ul><ul><li>Knew early on that we would likely use a desk lamp as our rig </li></ul><ul><li>Researched and purchased a desktop lamp which would be sturdy enough to mount a web cam </li></ul>
    10. 17. Solution - Hardware solid base adjustable tension joints built-in wire loop long reach
    11. 18. Logitech WebCam Pro 9000 QuickCam Orbit AF
    12. 19. Ye olde stack of paper
    13. 22. Findings & Recommendations
    14. 23. Homepage Issues & Recommendations <ul><li>Selected item not immediately apparent Severity:   Recommendation: Increase salience of selected item </li></ul><ul><li>“ Your Books” placement inconsistent Severity:   Recommendation: Swap left and right columns </li></ul><ul><li>Often, “Chapters” is cut off Severity:   Recommendation: Better truncate author name with ellipsis (eg. by Cory Doctoro…) or shorten Chapter character spacing. Also applies to Library pages. </li></ul><ul><li>Side-clicking on the D-Pad does nothing when “Currently Reading” book is selected Severity:   Recommendation: Allow left-click to go to first entry under “News & Magazines” and right-click to select the first entry under “Your Books” </li></ul><ul><li>“ Browse Library…” wording is unique to this location Severity:   Recommendation: Change to “Browse Books…” </li></ul>5 1 2 3 4
    15. 24. Reading Experience Findings <ul><li>All users had positive comments about their reading experience </li></ul>“ Feels better on my eyes than a book.” “ I’d be comfortable with this, even with more lines on the page.” “ It’s pretty comfortable to hold, and you can use (the FFBs) both ways.” “ It was great… very comfortable… very clear.” “ The line spacing is even better than a book, in fact.”
    16. 25. Reading Postures Were Varied
    17. 26. Even Better Than a Book <ul><li>Several users remarked that reading on the device was better than a book </li></ul>
    18. 27. Issue Matrix   Recommendation: Remove this feature Library (Covers Only) Covers-only view is not helpful because book name and author are not displayed. As well, some book cover images are not available preventing identification of that book.   Recommendation: Sort by author last name Library (by Author) Author sort by first name is unexpected and inefficient when browsing library   Improve the prominence of letter displays within the book list Library Some users missed letter headings   Enable a Display option to toggle progress indicator to be pages or chapters Library Some users preferred reading progress indication in pages rather than chapters   Only display titles that start with on letter at a time, or create on-state for multiple letters in navigation Library Navigation on-state of letters caused confusion; paging seemed to skip letters   Change to “Browse Books…” Homepage “ Browse Library…” wording is unique to this location   Allow left-click to go to first entry under “News & Magazines” and right-click to select the first entry under “Your Books” Homepage Side-clicking on the D-Pad does nothing when “Currently Reading” book is selected   Better truncate author name with ellipsis (eg. by Cory Doctoro…) or shorten Chapter character spacing Homepage, Library Often, “Chapters” is cut off   Swap left and right columns Homepage “ Your Books” placement inconsistent   Increase salience of selected item Homepage, Library Selected item not immediately apparent Severity Recommendation Page/Section Issue
    19. 28. Issue Matrix   Include “device tips” during loading screens Reading Affordance of D-Pad font control is low   Enable right-click of D-Pad or FFB to start reading this book if on last page of synopsis Overview Page (Unread Book) Placement, size of instructional text causes it to be ignored   Title the page “About this Book” Overview Page (Unread Book) Title of page is “Overview”, however, the Menu refers to it as “About this Book”   Enable left-click of D-Pad to return to Your Books, or offer on-screen “Read this Book” and “Back to Your Books” selection options Overview Page (Unread Book) No easy way to return to Library   Speed up homepage loading or provide loading indicator Other Software Device boot-up time is slow   Improve hardware-software latency Hardware / Other Software Delayed response time to actuate buttons Severity Recommendation Page/Section Issue
    20. 29. Lessons Learned <ul><li>Morae is a mature, well-supported, “industrial strength” usability testing platform. Use it and don’t be afraid to call tech support. </li></ul><ul><li>Use a powerful machine as your Recorder. </li></ul><ul><li>Use low-compression rate for most fluid video. </li></ul><ul><li>Expect technical issues. </li></ul><ul><li>Practice, practice, practice. </li></ul>
    21. 31. Kobo eReader on The Office This Thursday!
    22. 32. @DLoTO @UXToronto
    23. 33. Q & A
    24. 34. Thanks!

    ×