The document discusses a collaborative usability testing technique to involve stakeholders in user research. It recommends bringing together stakeholders to observe usability tests, prioritize usability issues observed, and agree on solutions. Participants watch 3 short test sessions, take notes on issues, then consolidate lists of top issues to agree on actions. Being involved makes stakeholders more invested in addressing usability problems. The presenter provides tips for effective collaborative testing and resources for prioritization methods.

1. Collaborative usability
Making user research &
prioritisation a shared experience
Neil Allison @usabilityed
UX Manager, University of Edinburgh
#IWMW16 #B1

2. Hands up…
• If you’ve ever conducted a usability test
• If you’ve ever watched a usability test
• If all this is totally new to you
@usabilityed #IWMW16 #B1

3. Usability testing
It’s easy, right?
@usabilityed #IWMW16 #B1

4. What’s challenging
• Getting the go ahead to use
your time on usability testing
• Getting colleagues to take on board
what you uncover
• Getting fixes to problems implemented
(Why usability problems go unfixed: http://bit.ly/LvrGoq)
@usabilityed #IWMW16 #B1

5. Why are we here?
• An easy-to-execute technique to get your
stakeholders closer to your users
• A process that objectively prioritises
the issues that you all see
• A showcase for the new
Usability Testing Service
@usabilityed #IWMW16 #B1

6. Usability testing service
• Pilot service in operation til August 2016
– Help you plan research
– Recruit participants
– Run testing sessions & report
– Run stakeholder events for maximum impact
• Mobile, tablet & desktop recording
@usabilityed #IWMW16 #B1

7. UX & usability consultancy services
• Digital strategy: Work out what you’re trying to do
collaboratively & establish metrics
• Personas & experience mapping: Express your goals in
a user-centred way that everyone understands
• Requirements checking & prototyping: Make sure
you’re on the right path before investing heavily
• Training & mentoring: Empower your team to embed
UX techniques into every project
@usabilityed #IWMW16 #B1

8. So what do we do?
1. Get the right people in a room
2. Watch a small number of short sessions
with users doing something
3. Prioritise the issues they see
4. Collaboratively consolidate their priority lists
5. Agree actions for usability issues
6. Repeat every few weeks
@usabilityed #IWMW16 #B1

9. Who are the right people?
• Everyone with a stake in
the product
– No exceptions
http://bit.ly/1I1lZfQ
“Have you had your
recommended dose
of research?”
@usabilityed #IWMW16 #B1

10. What do we watch?
• Real users
doing real tasks
• Facilitated usability
testing sessions
• Agree the focus of
testing within the
team
“Research shows that teams
make better services when
everyone on a project team
observes users first hand.”
http://bit.ly/1I1rlYI
@usabilityed #IWMW16 #B1

11. How many do we watch?
“The most striking truth of the curve is that
zero users give zero insights.”
• As many as you can fit into the time you have
(so probably not very many)
http://bit.ly/1vQ7eHD
@usabilityed #IWMW16 #B1

12. How do we prioritise?
“Running a usability test has been compared
with taking a drink from a fire hydrant…”
• Rocket Surgery template:
1. Individual notes while observing
2. Distil to 3 issues after each participant
@usabilityed #IWMW16 #B1

14. How do we consolidate?
“If you prioritise usability problems using
'gut feel' or intuition, you run the risk
of being exposed as a fraud…”
http://bit.ly/1I1mCWW
@usabilityed #IWMW16 #B1

16. Now let’s try it together…
• 3 participants
– 5-10 minute break between each to review notes and
prioritise top 3 issues
• On your table consolidate your issues into a
master list
• Once round the room to feed issues back to the
IWMW team
– Using the flowchart to propose severity
@usabilityed #IWMW16 #B1

17. Then what?
• Usability issues prioritised, not solutions
• Agree actions based on:
– Is the solution “obvious”?
– Is there an easy development solution?
– Is there an alternative to development?
@usabilityed #IWMW16 #B1

18. Minor
issue for
users
Major
issue for
users
Easy
solution
available
No easy
solution
available
Prioritisation matrix
@usabilityed #IWMW16 #B1

19. Top tips
• Participants
– A pool of volunteers really helps recruitment
– Krug – “Recruit loosely, grade on a curve”
– Reminders the day before
– Have an emergency stand-in prepared
• Do whatever it takes to get observers in the room
– Start over lunch break
– Supply refreshments
– Bribery, favours, threats…
• Be well organised so you don’t waste anyone’s time
– Test everything before hand
• Stick to the process and schedule (particularly in the final recap)
– It’s easy to digress when you’ve all seen so much
• Encourage collective reflection on the session
– Admitting usefulness is first step to getting observers to turn up next time
– Have the next one scheduled ASAP
@usabilityed #IWMW16 #B1

20. Everything you need
• Steve Krug’s Rocket Surgery resources
http://bit.ly/1I1muXo
• David Travis’ prioritisation flowchart
http://bit.ly/1I1mCWW
• Full write up of this process
http://bit.ly/uoe-agile-usability
@usabilityed #IWMW16 #B1

21. Usability testing service
• Pilot service in operation til August 2016
– Help you plan research
– Recruit participants
– Run testing sessions & report
– Run stakeholder events for maximum impact
• Mobile, tablet & desktop recording
• Get in touch to discuss requirements
– usability@ed.ac.uk
@usabilityed #IWMW16 #B1

22. Thank you
Questions?
Neil.Allison@ed.ac.uk
UX Manager
Twitter: @usabilityed
@usabilityed #IWMW16 #B1