Don’t Make Them ThinkUser observation testing to create easy-to-use sitesLibrary Technology Conference - Macalester Colleg...
Are YOU responsible for this?
Session Overview• What is User Experience?• Why User Observation?• How Can I Execute User Observation Testing?
What’s Your First Impression1. Find a partner.2. Quickly take turns bringing up a site.3. Get your partner’s first impress...
What is Usability? "[Usability refers to] the extent to which a product an be used by specified users to achieve specified...
Usability Methods Ethnographic User Research    Focus Groups    Heuristic Evaluations     Log File Analysis          Surve...
Q: Why User Observation?A: Reliable Data“To design an easy-to-use interface, pay attention to what users do, not what they...
Q: Why User Observation?A: Dispels AssumptionsDon’t assume that people think      the way that you do.• Grounding is a nat...
What is User Observation?
User Observation Testing Process• Consider your stakeholders• Set your goals• Decide which users to involve• Choose a type...
Consider your StakeholdersStakeholders    • Who cares?Goals                • What do they care about?Users                ...
Set Your GoalsStakeholders     • What do you want toGoals              prove, disprove orUsers                   investiga...
Decide which Users to Involve Stakeholders Goals Users Testing types Tasks Recruitment Moderation Analysis Change
Types of TestingStakeholders       • Measure or benchmarkGoals                the usability of a productUsers             ...
Live or Remote
Remote testing technologies• WebEx• GoToMeeting• UserVue• LiveLook• Adobe Connect• Silverback• Many more!                 ...
Define TasksStakeholders    • Tie tasks to goalsGoals                • User defined tasksUsers                • Scripted s...
Recruit Users to ObserveStakeholdersGoalsUsersTesting typesTasksRecruitmentModerationAnalysisChange
Moderate sessionsStakeholders  • Put users at easeGoals           • Let participant speakUsers                • Lead with ...
Exercise: Practice User Observation1. Find the same partner you worked with earlier.2. You will each have 10 minutes to pr...
Analyze Your DataStakeholders    • WAIT! until testing is doneGoals                • WAIT! before making yourUsers        ...
Recommendations for ChangeStakeholders    • Partner with the rightGoals             peopleUsers           • Pick the low-h...
Value of Any User Observation Test                              Excerpted from Remote Usability Testing by Kyle           ...
Questions? Kat Jayne, MLIS Manager, User Experience Thomson Reuters katherine.jayne@thomsonreuters.com Margaret Ostrander,...
Upcoming SlideShare
Loading in …5
×

Don t make them think: create an easy-to-use website and catalog through user experience observation

973 views

Published on

Published in: Technology, Design
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
973
On SlideShare
0
From Embeds
0
Number of Embeds
11
Actions
Shares
0
Downloads
8
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Don t make them think: create an easy-to-use website and catalog through user experience observation

  1. 1. Don’t Make Them ThinkUser observation testing to create easy-to-use sitesLibrary Technology Conference - Macalester College, St. Paul, MN, USA16 March 2011Kat Jayne, MLIS – Manager, User ExperienceMargaret Ostrander, MLIS – Manager, Search
  2. 2. Are YOU responsible for this?
  3. 3. Session Overview• What is User Experience?• Why User Observation?• How Can I Execute User Observation Testing?
  4. 4. What’s Your First Impression1. Find a partner.2. Quickly take turns bringing up a site.3. Get your partner’s first impression of the site.4. Jot down a few notes.
  5. 5. What is Usability? "[Usability refers to] the extent to which a product an be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of user." - ISO 9241-11
  6. 6. Usability Methods Ethnographic User Research Focus Groups Heuristic Evaluations Log File Analysis Surveys Eye Tracking Card Sorting User Observation
  7. 7. Q: Why User Observation?A: Reliable Data“To design an easy-to-use interface, pay attention to what users do, not what they say. Self-reported claims are unreliable, as are user speculations about future behavior.” - Jakob Nielsen’s Alertbox, Aug 5 2001
  8. 8. Q: Why User Observation?A: Dispels AssumptionsDon’t assume that people think the way that you do.• Grounding is a natural assumption that others have similar information needs, behaviors and preferences as you do• Grounding is dangerous for librarians. We think differently from our users!
  9. 9. What is User Observation?
  10. 10. User Observation Testing Process• Consider your stakeholders• Set your goals• Decide which users to involve• Choose a type of testing• Define your testing tasks• Recruit users to observe• Moderate sessions• Conduct analysis• Make change!
  11. 11. Consider your StakeholdersStakeholders • Who cares?Goals • What do they care about?Users • Is there any appetite forTesting types change?Tasks • What data would be mostRecruitment likely to secure buy-in?ModerationAnalysisChange
  12. 12. Set Your GoalsStakeholders • What do you want toGoals prove, disprove orUsers investigate?Testing types • What site or part of a siteTasks is the focus?Recruitment • Base the “problem” onModeration real user dataAnalysis • Be open to theChange unexpected
  13. 13. Decide which Users to Involve Stakeholders Goals Users Testing types Tasks Recruitment Moderation Analysis Change
  14. 14. Types of TestingStakeholders • Measure or benchmarkGoals the usability of a productUsers • Compare the usability ofTesting types two or more productsTasks • Diagnose to uncoverRecruitment design issuesModeration • Live versus Remote?AnalysisChange
  15. 15. Live or Remote
  16. 16. Remote testing technologies• WebEx• GoToMeeting• UserVue• LiveLook• Adobe Connect• Silverback• Many more! Excerpted from Remote Usability Testing by Kyle Soucy, Intranet Benchmarking Forum, 2010
  17. 17. Define TasksStakeholders • Tie tasks to goalsGoals • User defined tasksUsers • Scripted scenariosTesting typesTasks • 3-5 tasks for a 30 minute sessionRecruitmentModerationAnalysisChange
  18. 18. Recruit Users to ObserveStakeholdersGoalsUsersTesting typesTasksRecruitmentModerationAnalysisChange
  19. 19. Moderate sessionsStakeholders • Put users at easeGoals • Let participant speakUsers • Lead with graceTesting types • Ask unbiased questionsTasksRecruitment • Assist only as a last resortModeration • Take detailed notesAnalysisChange
  20. 20. Exercise: Practice User Observation1. Find the same partner you worked with earlier.2. You will each have 10 minutes to practice user observation techniques. – Practice the whole thing OR – Pick the parts where you want the most practice • Read from script • Tasks • Redirection • Warm up questions & follow up questions3. Raise your hand if you need help!
  21. 21. Analyze Your DataStakeholders • WAIT! until testing is doneGoals • WAIT! before making yourUsers recommendationsTesting types • QuantitativeTasks • Time to task completionRecruitment • Level of difficultyModeration • QuantitativeAnalysis • Trend spottingChange • Classification analysis
  22. 22. Recommendations for ChangeStakeholders • Partner with the rightGoals peopleUsers • Pick the low-hanging fruitTesting types • Even small changes canTasks have large returnsRecruitment • How to sell it…Moderation • Create a findingsAnalysis presentation (sometimes)Change
  23. 23. Value of Any User Observation Test Excerpted from Remote Usability Testing by Kyle Soucy, Intranet Benchmarking Forum, 2010
  24. 24. Questions? Kat Jayne, MLIS Manager, User Experience Thomson Reuters katherine.jayne@thomsonreuters.com Margaret Ostrander, MLIS Manager, Search Thomson Reuters margaret.ostrander@thomsonreuters.com http://www.linkedin.com/in/margaretostrander

×