1) The document describes a user experience workshop that aims to evaluate how users experience online media players through usability testing and heuristic evaluation. 2) The workshop involves usability testing using a think-aloud protocol and task completion rates, as well as an exploration test from both the user and designer perspective. 3) Participants are given 5-10 tasks to complete within a usability test session while thinking aloud, and success rates are calculated to measure effectiveness.

1. User eXperience
Workshop 1
Sónia Sousa & Mati Mottus, TLU, 2014

2. General aim…
• Develop one's own conceptual
understanding of
–how to apply
• the methods;
• the tools; and
• Metrics
–based on a defined criteria.
Sónia Sousa & Mati Mottus, TLU, 2014

3. Workshop 1
• It aims is to
– evaluate how real users experience from
• using online media players (web service)
• It include 2 main procedures
– One uses
• Think-out-loud protocol; and
• Task Completion Rates
– Another uses
• Exploration test
– Heuristic Evaluation
Sónia Sousa & Mati Mottus, TLU, 2014

4. Workshop 1
• Measuring the user experience
– Effectiveness and efficiency and user behaviors
• From two perspective
• User perspective (pragmatic aspects)
– Perceiving information
– Interpreting information
– Decision making
• Designer perspective (pragmatic aspects)
– Providing information
– Storing information
– Information architecture
Sónia Sousa & Mati Mottus, TLU, 2014

5. UX workshop 1
• How to?
– Identify the target audience
– Creating Usability Test Tasks
• set of 5 to 10 tasks within a 90-minute session
– Do the test
• Read to the participant one task at a time, and give
time to complete the task
– Do the exploration test
– Data Analysis
Sónia Sousa & Mati Mottus, TLU, 2014

6. Category of UX methods
• Study types
–
–
–
–
• Development phase
Field studies
Lab studies
Online studies
Questionnaires / Scales
• Studied period of
experience
–
–
–
–
Concepts
Early prototypes
Functional prototypes
Products on market
• Evaluator / Information
provider
– Before usage
– Snapshots
– An episode (of a task or
activity)
– Long-term UX
–
–
–
–
UX experts
One user at a time
Groups of users
Pairs of users
Sónia Sousa & Mati Mottus, TLU, 2014

7. What you need to do
• First
– Read the material available in drop box
– Start with script-procedure
• And try to follow the procedure
• Tools to be use
– (get familiar with them)
• Scripts forms
• Evaluation and observation sheets
• Recording tools (QuickTime player)
Sónia Sousa & Mati Mottus, TLU, 2014

8. Exploration test
• Designer perspective
– Using Heuristic Evaluation
• What is it
– is an evaluation of an interface performed by one or
more HCI experts
• What you need to do
– Executer same tasks procedure asked to users
• File (task-scrips-for-user.pdf)
– Fill the file about heuristic evaluation analysis
• File (Heuristic_Evaluation.pdf)
Sónia Sousa & Mati Mottus, TLU, 2014

9. Things to know
• About the procedure
– A moderator shows a design to gain perceptions
of people.
– The user is encouraged to freely explore the
design; and
– The moderator asks questions when something
interesting happens.
– A moderator provides a user with tasks to perform
during testing that reflect their different usage
patterns.
Sónia Sousa & Mati Mottus, TLU, 2014

10. Things to know
• About the procedure
– Users should not be directed in any specific way.
– Exploration test are conducted as one session.
– Participants will perform a set of 5 to 10 tasks
within a 90-minute session.
– Tasks should represent the most common user
goals
– It is crucial to establish very clear success criteria
for each task.
Sónia Sousa & Mati Mottus, TLU, 2014

11. Data analysis
• Success Rate: Task completion success
– We define success rate by the percentage of
progress users made in completion the task
– measure the percentage of tasks that users
complete correctly
• See http://www.measuringusability.com/
• Look for the most suitable calculator
Sónia Sousa & Mati Mottus, TLU, 2014