2.
This document is a continuation of the process of planning for and
conducting user research. The following aspects of analysis will be
covered for both Task scenarios and the SUS Survey.
● Data Types
● Specific variables
● Expected numbers of observations
● How data will be analysed
● How findings will be represented (e.g. tables, graphical representations, or other visualizations)
● Collection instruments (e.g. data collection spreadsheets, interview guides, etc.)
Task Scenarios
This method focuses on observing users behaviors and better understanding their decisions by asking a
series of follow up questions. Usability testing has been carried out with five users to gather feedback on
the path to purchase for Amazon.com shoppers. Study participants will be asked to carry out typical tasks
at Amazon.com. Participants will be recorded including their gestures and facial expressions using the site
to shop for an item. Video is then transcribed and any comments made by the participant converted to text.
Data Types:
● Screen recordings of the participants session
● Video recordings of the participant sessions
● Observations of the researcher
Variables:
● Duration of usability test
● Task completion
Number of participants (Observations)
● Three
3. How data will be analysed
Affinity diagramming will be used to categorize insights drawn from the analysis of participant interviews.
● Start playing back the recordings, one user at a time
● Begin noting down insights (one insight per post-it, one color per participant)
● Do the same for notes taken during interviews
● Begin sorting insights into categories and adding the category labels to post its
4.
● Begin grouping similar insights
* For example, an insight that a user could not find a customer support phone number to call and
another that couldn’t find an email address should be grouped together, summarising that all
contact details were difficult to find.
● Adjust for perceived impact if solved
With insights written on post-its, categorised into practical headings and prioritised based on
number of occurrences. The last step is to adjust the priority of insights based on the potential
impact if solved. Feedback collected during testing sessions is used to adjust the priority of
grouped insights and reorder them accordingly.
How findings will be represented
Findings will be represented as a research report document that will include both charts and spreadsheets.
.
6. Computer-operating model
Seven Stages of action
The computer operating model and seven stages of action can be used to analyse the issues
identified based on fundamental categories of interaction.
7. System Usability Survey
This method focuses on observing users behaviors and better understanding their decisions by asking a
series of follow up questions. Usability testing has been carried out with five users to gather feedback on
the path to purchase for Amazon.com shoppers. Study participants will be asked to carry out typical tasks
at Amazon.com. Participants will be recorded including their gestures and facial expressions using the site
to shop for an item. Video is then transcribed and any comments made by the participant converted to text.
Data Types:
● Survey results
Variables:
● Total numbers of corresponding answers given by participants to survey questions
Number of participants (Observations)
● Three
How data will be analysed
Data from surveys will be analysed by considering the correlation between usability test results and survey
results.
How findings will be represented
Findings will be represented as apart of the research report document in the form of pie charts.
.
8. Collection instruments
Google Forms
Follow Up Interview
Questions
1. Overall, how satisfied are you with the ease of completing the tasks in this scenario?
2. Overall, how satisfied are you with the amount of time it took to complete the tasks in this
scenario?
3. Overall, how satisfied are you with searching or browsing for products with Amaon.com?
Data Types:
● Video recordings of the participant sessions
● Observations of the researcher
Variables:
● None
Number of participants (Observations)
● Three
How data will be analysed
● All transcribed discussion will be analysed as part of the Affinity diagramming analysis.
