0
usability testing of the Drupal administrative interface   University of Baltimore May 2008
we are : graduate students in the Interaction Design and Information Architecture program at the University of Baltimore  ...
who’d we bring in? career or hobbyist web developers experienced in various content management systems (RedDot, SiteExecut...
and we asked them to get a website started for a small non-profit by:  creating content creating navigation (i.e., primary...
we used a pre- and post-test questionnaire to get participant opinions before and after using Drupal, collected gaze data ...
afterwards we analyzed the tapes for usability patterns across participants
so, why go through the trouble?
the Drupal mission statement:   By building on relevant standards and open source technologies, Drupal supports and enhanc...
who are these people, and does playing with Drupal encourage them to become a Drupal user? diverse and geographically-sepa...
who wants to read a manual?   “ I’m not sure what nodes are at this point because I didn’t read the manual, obviously, as ...
no one. people want to  produce, discuss, and share information and ideas
and Drupal has user experience goals to try and achieve this developers:  well-tooled  with a system of hooks that provide...
Drupal enables people around the globe to create powerful websites
and has some successes in the admin interface, like:   participants liked the welcome page (despite some inconsistencies b...
but we did find some problems
everyone expected a WYSIWYG and searched for formatting options
(modules were not considered by any participants)
participants didn’t get page and story, and spent a lot of time thinking about it
the parent item was not what they expected
and more, such as: <ul><li>confusion over the term primary link, </li></ul><ul><li>locating content after creating it, </l...
to meet Drupal user experience goals, creative solutions to these problems must be found
but wait… overall, the major challenge for all participants was that they didn't  get  that the administrative menu overla...
where's my home page?
how do I preview pages?
… and see the structure of the site?
how do I see the difference between the CMS and the website I'm making?
this misunderstanding was the root of a lot of the problems, confusion and frustration “ Nope, can't do it.” P3 “ I have n...
3 of our suggestions:   <ul><li>find ways in which to visually distinguish the administrative menu and pages, and incorpor...
Becca Scollan, Abby Byrnes, Malia Nagle, Paul Coyle, Cynthia York, Maleka Ingram   Interaction Design & Information Archit...
Upcoming SlideShare
Loading in...5
×

Drupal UB Usability Testing

418

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
418
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Drupal UB Usability Testing"

  1. 1. usability testing of the Drupal administrative interface University of Baltimore May 2008
  2. 2. we are : graduate students in the Interaction Design and Information Architecture program at the University of Baltimore and we : performed the second round of testing of the Drupal administrative interface testing took place at UB’s User Research Lab
  3. 3. who’d we bring in? career or hobbyist web developers experienced in various content management systems (RedDot, SiteExecutive, WordPress, Joomla and others) but with no Drupal experience
  4. 4. and we asked them to get a website started for a small non-profit by: creating content creating navigation (i.e., primary links) and setting up a user account for board members
  5. 5. we used a pre- and post-test questionnaire to get participant opinions before and after using Drupal, collected gaze data with the Tobii eyetracker, and asked lots of questions
  6. 6. afterwards we analyzed the tapes for usability patterns across participants
  7. 7. so, why go through the trouble?
  8. 8. the Drupal mission statement: By building on relevant standards and open source technologies, Drupal supports and enhances the potential of the Internet as a medium where diverse and geographically-separated individuals and groups can collectively produce, discuss, and share information and ideas . With a central interest in and focus on communities and collaboration, Drupal's flexibility allows the collaborative production of online information systems and communities .
  9. 9. who are these people, and does playing with Drupal encourage them to become a Drupal user? diverse and geographically-separated individuals and groups can collectively produce, discuss, and share information and ideas
  10. 10. who wants to read a manual? “ I’m not sure what nodes are at this point because I didn’t read the manual, obviously, as I never do, I just install it out of the box and pretend that everything is going to be fine.” - - Participant 1
  11. 11. no one. people want to produce, discuss, and share information and ideas
  12. 12. and Drupal has user experience goals to try and achieve this developers: well-tooled with a system of hooks that provide ready means to accomplish most foreseeable coding aims that involve interaction with core elements administrators: easy to install and set up so that there is a minimum requirement for specific technical expertise, intuitive and self-explanatory so that administrators can easily find the configuration options they need and highly configurable so that site administrators can present just the interface they wish users: intuitive and self-explanatory so that users with minimal prior experience can easily discover, navigate, and use functionality, uncluttered so that users are not faced with a difficult task of sorting the essential from the non-essential
  13. 13. Drupal enables people around the globe to create powerful websites
  14. 14. and has some successes in the admin interface, like: participants liked the welcome page (despite some inconsistencies between the contextual links and the admin menu) and all easily located and used the Create content link
  15. 15. but we did find some problems
  16. 16. everyone expected a WYSIWYG and searched for formatting options
  17. 17. (modules were not considered by any participants)
  18. 18. participants didn’t get page and story, and spent a lot of time thinking about it
  19. 19. the parent item was not what they expected
  20. 20. and more, such as: <ul><li>confusion over the term primary link, </li></ul><ul><li>locating content after creating it, </li></ul><ul><li>finding the link they need on the Administer page, and </li></ul><ul><li>not noticing Garland default theme primary links most often until they moved on to the next task </li></ul>
  21. 21. to meet Drupal user experience goals, creative solutions to these problems must be found
  22. 22. but wait… overall, the major challenge for all participants was that they didn't get that the administrative menu overlays the website itself – leading to questions like:
  23. 23. where's my home page?
  24. 24. how do I preview pages?
  25. 25. … and see the structure of the site?
  26. 26. how do I see the difference between the CMS and the website I'm making?
  27. 27. this misunderstanding was the root of a lot of the problems, confusion and frustration “ Nope, can't do it.” P3 “ I have no hope that I am anywhere close.” P3 “ I don't understand what this does at all...” P1 “ Huh. That's crazy.” P2
  28. 28. 3 of our suggestions: <ul><li>find ways in which to visually distinguish the administrative menu and pages, and incorporate the style into the default Drupal theme </li></ul><ul><li>surface more of the content hidden under drop-downs within node forms and in the primary navigation menu (for example, add a “manage content” link) </li></ul><ul><li>use more consistent, intuitive labeling for basic tasks </li></ul>
  29. 29. Becca Scollan, Abby Byrnes, Malia Nagle, Paul Coyle, Cynthia York, Maleka Ingram   Interaction Design & Information Architecture, University of Baltimore May, 2008
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×