Acquia product usability , I&#x2019;ve been in the community for just over three years, involved with Drupal.org projects, as well as a bit of work on Drupal 7 help text, and more recently we did Views usability study and a Drupal 8 information architecture usability study\n
LR\nHow many call themselves Developer/ Designer / Business Person, None of the above?)\nHow many of you have conducted usability testing before? \nHow many of you have asked for budget for usability studies?\n\n
LR - odon&#x2019;t read this. we want to ensure you can run a usability study by the end of this session. overview of tools and process\n
The way we design is not always the way things are used. Find out the delta betwenen them.\nThings we could uncover: \n Visual problems (like contrast)\n Error messaging and UI text\n Content\n Navigation and findability problems\n Workflow problems\n\n
&#x201C;Usability testing is the second most used evaluation method and the method that has the most impact on making products better&#x201D; \nAdvantages of unmoderated over moderated. \nUnmoderated is faster, asynchronous, less steps to cover but doesn&#x2019;t offer probe and not suitable for studies that require a lot of in-time probing. \n\n
DM start\nPreparation is the longest phase of the process \n
business goals translate to UX goals \n
Usability specialists believe it is not cost effective to run more because it only uncovers more minor \nproblems\n\n\n\n&#x201C;Virtually all of the problems judged high in severity were discovered after running 5 subjects, whereas only 55% of the problems judged low in severity were found.&#x201D;\n
GENERAL CONSTRUCTION1. Goals2. Prepare- Recruit (Moderated)- Conduct (Moderated)- Set up (Unmoderated)3. Watch the videos & analyze4. Report ﬁndings
PREP STEP 1: GOALSTalk to stakeholders:“What are the business goals of the study?”“What do we need to learn?”“What are our primary tasks & personas?”“When do we need it?”“What’s our budget for usability testing and ﬁxingproblems?”
PREP STEP 2: WHAT TO TEST? Information architecture Prototype Staging site Production siteYou can test at any point during the projectlifecycle
PREP STEP 3: PARTICIPANTSWho to test?New users vs. current usersPrimary roles & personasHow many to test?5 participants per study is ideal for uncoveringthe major usability problems while remainingquick and cost effective.15+ participants for a card sort / IA study
PREP STEP 4: CHOOSING THE METHOD Variety of webappsUsertesting.com, Verifyapp, Treejack, etc
PREP STEP 5: STUDY OUTLINE Starting URL Scenario Tasks (include login details) Post-session questions Choose your participants http://bit.ly/views-study
PREP STEP 5a: WRITING TASKS Do not use words that are in the UI Phrase things in the way people think Write in plain languagePut tasks in order; dependencies between the tasks? Include assists Ask them to rate their experience
PREP STEP 5: TEST SITE ENVIRONMENT How will they access the site? Content and user account setup is needed? Do you need to set up separate sites for each? Or re-set between sessions? Tip: Use can use Drush to disable and uninstall modules! Or, if you have a dev, stage and prod environment, overwrite the database on the testing environment
Starting URL: drupal.org Scenario: You have built sites in otherCMS, have heard of Drupal, and would like to know more. You work for a non-proﬁt that is looking to replace it’s site with an open source solution.
Task 1: Explore for a couple minutes and tell me what you have learned about Drupal.Task 2: You want to ﬁnd Drupal experts for hire. Show me how you would do this.Task 3: If you didn’t ﬁnd it already, Marketplacelists Drupal companies. Now, you want to learnmore about the Drupal community. What would you do? Task 4: Let’s say you want to post a supportquestion in the forums. Tell me what steps you would take.
PREP STEP 8: OBSERVATION FORMPriority/SeverityIssue summaryLink to screenshotTask nameParticipants who had the issue (frequency)
STEP 5: WATCH THE VIDEOSWhat to note?Things that went wellThings that did not go wellCapture quotes and annotate screenshots or getvideo clips
STEP 5: ANALYSIS, cont.Categorize things that did not go well into bugsand usability issues Severity: Low/Medium/ High (or 1-5) Frequency: Number of occurrences Scope: Local/ Global
STEP 6: THE EXECUTIVE SUMMARYOverall: There were no Critical problemsuncovered. Overall, the response was positiveand participants could ﬁnd their way towardsachieving the tasks quickly.High severity ﬁndings• Bulleted listMedium severity ﬁndings• Bulleted listThe detailed ﬁndings can be found at [URL].
Tools for testing livesites- Usertesting.com- Userlytics.com- Loop11Tools for testingscreenshots- Five Second Test- Invision app- VerifyappOther- Treejack (IA studies)- Webform.com (Diary studies)