The  Writing  Studio A Usability Analysis Report Andrea L. Beaudin ▪ Jeremy F. Huston ▪ Michael R. Trice Texas Tech Univer...
Report Overview <ul><li>Study Purpose and Goals </li></ul><ul><li>Methodology </li></ul><ul><li>Results and Analysis </li>...
Study Purpose and Goals
Client Purpose and Goals <ul><li>Client Purpose </li></ul><ul><ul><li>Determine usability of profile page navigation of th...
Study Purpose and Goals <ul><li>Study Purpose </li></ul><ul><ul><li>Determine what areas of the profile page are the most/...
User Profiles <ul><li>Multiple Users </li></ul><ul><ul><li>Students </li></ul></ul><ul><ul><ul><li>17-21 year-old first-ye...
Methodology <ul><li>MEELS  ▪ Procedures   ▪ Participants ▪ Tasks </li></ul>
MEELS <ul><li>M emorability </li></ul><ul><ul><li>If a user has used the system before, can he or she remember enough to u...
Procedures <ul><li>Testing Environment: </li></ul><ul><ul><li>TTU Usability Lab  </li></ul></ul><ul><ul><li>Morae </li></u...
Participants <ul><ul><li>Solicited via email and class invitation </li></ul></ul><ul><ul><li>5 first-year full-time FYC st...
Tasks Task Purpose 1 Create user account Establish user in system Determine usability of account creation process 2 Create...
Results and Analysis <ul><li>Navigation  ▪ Functionality ▪ Design </li></ul>
Navigation <ul><li>60% of users resulted to using the back button to return to the main page during at least one task. </l...
<ul><li>Eye tracking suggests that although users initially followed the standard “F” pattern for scanning the page (Task ...
Design 4 links 10 drop down menus 5 graphic icons 9 graphic icons 8 tabs 2 links 2 buttons search box icon link 2 breadcru...
Design: Clicks per Task
Design — User 3
Recommendations <ul><li>Navigation  ▪ Functionality ▪ Design </li></ul>
Navigation <ul><li>Simplify navigation with context sensitive menus </li></ul><ul><li>Or  conceptually group navigational ...
Functionality <ul><li>Option to hide elements: </li></ul><ul><ul><li>Add a reset button  </li></ul></ul><ul><ul><li>Or  “r...
Design 5 graphic icons 9 graphic icons 8 tabs 2 links 2 buttons icon Users looking for a more “Facebook” type navigation
Design
Conclusion <ul><li>Navigation  ▪ Functionality ▪ Design </li></ul>
Conclusions <ul><li>Writing Studio offers a full suite of options to writers and provides a “bottom up” model for writing ...
Addendum <ul><li>Following Up </li></ul>
Following Up <ul><li>After the initial presentation, Mike Palmquist instituted major changes to site, including security u...
Following Up <ul><li>“ Some of the most visible changes to the site include a major upgrade to the Personal Pages as well ...
Following Up: Redesigned Page <ul><li>New page is considerably streamlined </li></ul><ul><li>Personal Page menu options ha...
Thank You <ul><li>Usability testing can identify situations and potential problems; the key is what to do with the informa...
Upcoming SlideShare
Loading in …5
×

Writing Studio

433 views

Published on

Presentation outlining recommendations from a usability study conducted for the Writing Studio (http://writing.colostate.edu). By Andrea L. Beaudin, Jeremy F. Huston, and Michael R. Trice

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
433
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Live Video Track Performance Task Surveys Record User Reflection Eye-tracking Trace Focus Input Tracking Calculate Steps Taken Error Tracking Calculate Task Difficulty User Comments Track Impromptu Thoughts Retrospective Recall Gather Overall Reflections
  • Participants were 4 male 1 female first-year comp students at Tech between 17-21. No experience with WS, but experience with Blackboard. They self-reported their comfort with Blackboard between 3 and 4 on a scale of 1 (not confident) to 5 (highly confident). They write online at least weekly; all use facebook and email.
  • 46 navigation elements on page Graphic icons, tabs, drop down menus, buttons, text links, search box, breadcrumbs
  • Blog navigation usability and accessibility issue
  • Increase white space!
  • Writing Studio

    1. 1. The Writing Studio A Usability Analysis Report Andrea L. Beaudin ▪ Jeremy F. Huston ▪ Michael R. Trice Texas Tech University
    2. 2. Report Overview <ul><li>Study Purpose and Goals </li></ul><ul><li>Methodology </li></ul><ul><li>Results and Analysis </li></ul><ul><li>Recommendations </li></ul>
    3. 3. Study Purpose and Goals
    4. 4. Client Purpose and Goals <ul><li>Client Purpose </li></ul><ul><ul><li>Determine usability of profile page navigation of the Writing Studio </li></ul></ul><ul><ul><li>Identify areas where usability could be improved </li></ul></ul><ul><li>Client Goals </li></ul><ul><ul><li>Increase effectiveness of site navigational elements for users </li></ul></ul><ul><ul><li>Increase comprehension of individual navigational elements on website </li></ul></ul><ul><ul><li>Make the interface familiar and usable for users of popular social media </li></ul></ul>
    5. 5. Study Purpose and Goals <ul><li>Study Purpose </li></ul><ul><ul><li>Determine what areas of the profile page are the most/least memorable, error-prone, efficient, and learnable </li></ul></ul><ul><li>Study Goals </li></ul><ul><ul><li>Determine whether the navigation on the profile page is intuitive </li></ul></ul><ul><ul><li>Investigate what navigational components may be leading to and increasing the frequency of errors, and determining recoverability of those errors </li></ul></ul><ul><ul><li>Determine the learnability of specific functions (creating blogs and e-portfolios) performed from the profile page </li></ul></ul><ul><ul><li>Evaluate comparative cognitive load across tasks </li></ul></ul>
    6. 6. User Profiles <ul><li>Multiple Users </li></ul><ul><ul><li>Students </li></ul></ul><ul><ul><ul><li>17-21 year-old first-year students (first-time users) </li></ul></ul></ul><ul><ul><ul><li>22+ year-old first-year students (first-time users) </li></ul></ul></ul><ul><ul><ul><li>High school students (first-time users) </li></ul></ul></ul><ul><ul><ul><li>Intermediate users (1 year experience) </li></ul></ul></ul><ul><ul><ul><li>Expert users (2+ years experience) </li></ul></ul></ul><ul><ul><li>Instructors </li></ul></ul><ul><ul><ul><li>Novice/Beginner </li></ul></ul></ul><ul><ul><ul><li>Intermediate </li></ul></ul></ul><ul><ul><ul><li>Expert </li></ul></ul></ul><ul><ul><li>Writers not affiliated with classes </li></ul></ul>
    7. 7. Methodology <ul><li>MEELS ▪ Procedures ▪ Participants ▪ Tasks </li></ul>
    8. 8. MEELS <ul><li>M emorability </li></ul><ul><ul><li>If a user has used the system before, can he or she remember enough to use it effectively the next time or does the user have to start over again learning everything? </li></ul></ul><ul><li>E fficiency </li></ul><ul><ul><li>Once an experienced user has learned to use the system, how fast can he or she accomplish tasks? </li></ul></ul><ul><li>E rrors </li></ul><ul><ul><li>How often do users make errors while using the system, how serious are these errors, and how do users recover from these errors? </li></ul></ul><ul><li>L earnability </li></ul><ul><ul><li>How fast can a user who has never seen the user interface before learn it sufficiently well to accomplish basic tasks? </li></ul></ul><ul><li>S atisfaction </li></ul><ul><ul><li>How much does the user like using the system? </li></ul></ul>
    9. 9. Procedures <ul><li>Testing Environment: </li></ul><ul><ul><li>TTU Usability Lab </li></ul></ul><ul><ul><li>Morae </li></ul></ul><ul><ul><ul><li>Mouse tracking </li></ul></ul></ul><ul><ul><ul><li>Click measurement </li></ul></ul></ul><ul><ul><ul><li>Task time </li></ul></ul></ul><ul><ul><ul><li>Screen capture </li></ul></ul></ul><ul><ul><ul><li>Video </li></ul></ul></ul><ul><ul><ul><li>Survey administration </li></ul></ul></ul><ul><ul><li>Eye tracking </li></ul></ul><ul><ul><li>Retrospective Recall </li></ul></ul><ul><li>System Software: </li></ul><ul><ul><li>Windows XP </li></ul></ul><ul><ul><li>Firefox </li></ul></ul><ul><li>Research Roles: </li></ul><ul><ul><li>Facilitator </li></ul></ul><ul><ul><li>Observer </li></ul></ul><ul><ul><li>Note Taker </li></ul></ul><ul><li>Measures for Optimal Use </li></ul><ul><ul><li>Mouse clicks </li></ul></ul><ul><ul><li>Task time </li></ul></ul>
    10. 10. Participants <ul><ul><li>Solicited via email and class invitation </li></ul></ul><ul><ul><li>5 first-year full-time FYC students at Texas Tech </li></ul></ul><ul><ul><li>4 males, 1 female </li></ul></ul><ul><ul><li>17-21 years old </li></ul></ul><ul><ul><li>No experience with Writing Studio </li></ul></ul><ul><ul><li>All Blackboard CMS users </li></ul></ul><ul><ul><ul><li>On a scale of 5 (highly confident) to 1 (not confident at all) rated CMS confidence between 4 (40%) and 3 (60%) self-reported comfort level with CMS </li></ul></ul></ul><ul><ul><li>Online Writing Frequency </li></ul></ul><ul><ul><ul><li>Weekly (60%) </li></ul></ul></ul><ul><ul><ul><li>Daily (40%) </li></ul></ul></ul><ul><ul><li>Online Writing Spaces </li></ul></ul><ul><ul><ul><li>All used Facebook and Email </li></ul></ul></ul><ul><ul><ul><li>One indicated blogs; another listed Comment Fields </li></ul></ul></ul>
    11. 11. Tasks Task Purpose 1 Create user account Establish user in system Determine usability of account creation process 2 Create profile with image Introduce user to My Page interface Measure navigation and functionality 3 Create blog Navigation Evaluate comparative cognitive load 4 Create blog entry Navigation Measure memorability and learnability Evaluate comparative cognitive load 5 Check/Change Password (repetitive task) Navigation Measure memorability and learnability Evaluate comparative cognitive load 6 Create ePortfolio (repetitive task) Navigation Measure memorability and learnability
    12. 12. Results and Analysis <ul><li>Navigation ▪ Functionality ▪ Design </li></ul>
    13. 13. Navigation <ul><li>60% of users resulted to using the back button to return to the main page during at least one task. </li></ul><ul><li>40% of users closed the profile setting options before creating a profile. </li></ul><ul><li>On average, changing a password took 3 extra steps and a full minute longer than expected. </li></ul><ul><li>Eye-tracking data and quotes suggest users were confused by lack of conventional navigation structure along left sidebar and horizontal headings. </li></ul>
    14. 14. <ul><li>Eye tracking suggests that although users initially followed the standard “F” pattern for scanning the page (Task 1 and the beginning of Task 2), by the end of the test, there was no discernible focus area. Users were looking everywhere on the screen to complete tasks. </li></ul><ul><li>Users performed best at creating blogs and ePortfolios. Task times were within 30 seconds and 20 seconds of optimal range for each, respectively. </li></ul><ul><li>No users made use of the search box </li></ul><ul><li>60% of users rated profile creation either “difficult” or “very difficult” </li></ul>User Quote: Functionality — User 6 “ The hardest part was finding where to go to create the profile.” — User 3
    15. 15. Design 4 links 10 drop down menus 5 graphic icons 9 graphic icons 8 tabs 2 links 2 buttons search box icon link 2 breadcrumbs
    16. 16. Design: Clicks per Task
    17. 17. Design — User 3
    18. 18. Recommendations <ul><li>Navigation ▪ Functionality ▪ Design </li></ul>
    19. 19. Navigation <ul><li>Simplify navigation with context sensitive menus </li></ul><ul><li>Or conceptually group navigational elements </li></ul><ul><li>Cluster navigational elements on left of page </li></ul><ul><li>Offer direct navigation to profile page and class page from blogs </li></ul>
    20. 20. Functionality <ul><li>Option to hide elements: </li></ul><ul><ul><li>Add a reset button </li></ul></ul><ul><ul><li>Or “return to default” </li></ul></ul><ul><li>Make link styles more uniform </li></ul><ul><li>Correct upload issues with user photos (fixed?) </li></ul><ul><li>Add webcam option for photo upload </li></ul><ul><li>Rename “Password” to “New Password”; move “Current Password” field above “New Password” </li></ul>
    21. 21. Design 5 graphic icons 9 graphic icons 8 tabs 2 links 2 buttons icon Users looking for a more “Facebook” type navigation
    22. 22. Design
    23. 23. Conclusion <ul><li>Navigation ▪ Functionality ▪ Design </li></ul>
    24. 24. Conclusions <ul><li>Writing Studio offers a full suite of options to writers and provides a “bottom up” model for writing instruction. </li></ul><ul><li>The platform provides a great deal of control for users / students </li></ul><ul><li>Based on user testing, minor design/ navigation tweaks could increase the usability of the site </li></ul>
    25. 25. Addendum <ul><li>Following Up </li></ul>
    26. 26. Following Up <ul><li>After the initial presentation, Mike Palmquist instituted major changes to site, including security updates, feature redesigns, and a server upgrade. Most notable, however, was the site redesign, particularly of the Personal Page. </li></ul>
    27. 27. Following Up <ul><li>“ Some of the most visible changes to the site include a major upgrade to the Personal Pages as well as to the management pages for our classes, wikis, and writing tools. We've dropped the tabbed interface on our pages and replaced it with a simpler and (we hope) easier to use set of links. We've also worked to eliminate the drop-down menus that we used so extensively in the past.” </li></ul><ul><li>— Mike Palmquist, “Writing Studio News and Updates” </li></ul>
    28. 28. Following Up: Redesigned Page <ul><li>New page is considerably streamlined </li></ul><ul><li>Personal Page menu options have been moved to right </li></ul><ul><li>Content (dependent upon menu choice) appears below profile </li></ul>
    29. 29. Thank You <ul><li>Usability testing can identify situations and potential problems; the key is what to do with the information once the testing is done. Mike Palmquist worked with our recommendations to implement a redesign that was not altogether radical (so that more experienced users would not be disoriented), but is clearly more streamlined and user-friendly. The changes are subtle, yet effective. </li></ul><ul><li>We wish to thank Mike Palmquist and all those involved with the Writing Studio for their support and receptiveness. </li></ul>

    ×