Collaborative 
User Research 
REVATHI NATHANIEL, @REVNATHANIEL 
USABILITY ENGINEER, RED GATE SOFTWARE LTD.
A confession… 
@REVNATHANIEL | #UXCAM
The lone researcher who 
observes interesting things and 
reports them back to the world… 
@REVNATHANIEL | #UXCAM
@REVNATHANIEL | #UXCAM
@REVNATHANIEL | #UXCAM https://userresearch.blog.gov.uk/2014/08/06/have-you-had-your-recommended-dose- 
of-research/
Collaboration is an act of shared 
creation and/or share discovery 
(Schrage89, p.4) 
Sir Ken Robinson's “Changing Education Paradigms" RSA animated talk @REVNATHANIEL | #UXCAM
Collaboration is active-it requires 
active participation with an intent to 
add value- 
James A. Highsmith III 
Illustration by Kevin Cornel, A List Apart, Issue 381 @REVNATHANIEL | #UXCAM
Communication is passive- it transfers 
information, with an intent to inform- 
James A. Highsmith III 
Illustration by Kevin Cornel, A List Apart
The entire process of user research can 
be collaborative 
@REVNATHANIEL | #UXCAM
Collaboration during the phases of 
research 
@REVNATHANIEL | #UXCAM
Plan 
Analyse Execute 
@REVNATHANIEL | #UXCAM 
Research Phases 
• Understand Project requirements 
• Plan scope of research & 
• research activities 
• Create research material 
• Carry out planned activities 
• Capture data 
• Re-evaluate research plan 
• Categorize data 
• Analyse data 
• Document analysis process 
• Share findings
Plan 
Analyse Execute 
Task Collaboration friendly? 
Yes Sometimes/ 
depends 
No 
Understand Project 
requirements 
Project kick-off 
meetings 
Plan scope of 
research & 
research activities 
Meetings, 
Documents on 
Google Drive 
Create research 
material e.g.: 
Surveys, interview 
questionnaires, 
screeners, etc. 
Emails to the team 
Documents on 
Google Drive 
Post work on walls, 
Collaboration 
games 
@REVNATHANIEL | #UXCAM
Survey 
@REVNATHANIEL | #UXCAM
@REVNATHANIEL | #UXCAM
What worked 
• Quality of research 
• Rigorous process 
• Widen scope of research 
• Reduce bias 
• Sense of ownership 
@REVNATHANIEL | #UXCAM
What didn’t work 
• Survey Length 
• Too wide scope 
• Lengthy analysis 
Recommendations 
• Have a clear and documented research plan 
• Don’t be afraid to put your foot down as the researcher 
Plan 
Analyse Execute 
@REVNATHANIEL | #UXCAM 
Research Phases 
• Carry out planned activities 
• Capture data 
• Re-evaluate research plan
@REVNATHANIEL | #UXCAM 
Data Techniques 
Preference 
Preferences, opinions, desires 
Surveys 
Focus groups 
Preference interviews 
Card sorting 
Ability 
What is understood or accomplished with a 
tool 
Prototypes 
Usability testing 
Log Analysis 
Customer feedback 
Card sorting 
Conceptual 
How things get done 
Interviews 
Contextual inquiry 
Surveys 
Classes of research 
Slide taken from Indi Young’ s Introduction to Task Based Models
Plan 
Analyse Execute 
Task Collaboration friendly? 
Yes Sometimes/ 
depends 
@REVNATHANIEL | #UXCAM 
Carry out planned activities 
Site visits, 
Formative usability tests 
Persona creation, Heuristic 
evaluations 
Capture observations/data 
Google docs 
Capturing data on post its 
Re-evaluate research plan 
Discuss with project team Collaboration games
Remote Usability Testing 
@REVNATHANIEL | #UXCAM
What worked 
Reduce bias in note taking 
Variety of observations 
Discuss observations together 
Discuss facilitation technique 
Participation in the study
Testimonials 
‘They provide a point of reference for discussions…’- James G, Tester 
‘We can pick up the language they use to describe things and incorporate it into the product’- 
Chris M, Developer 
‘Listening to customers’ experiences…has exposed me to the technologies that I should 
familiarise myself …Without UX providing such opportunities to get involved with the initial 
research this may not have happened until much later in the process’- Chris M, Developer 
@REVNATHANIEL | #UXCAM
What didn’t work 
• Busy calendars- team members unable to attend 
• Team sometimes loses faith in the project 
• Over enthusiastic and vocal observers 
• Post study banter 
Recommendations 
• Email notes from the session to the team 
• Share video/audio recordings 
• Give instructions before the session 
• Own the role of a facilitator
Personas 
@REVNATHANIEL | #UXCAM
What worked 
• Sharing what we learn as a team 
• Getting buy in 
• Shared understanding 
• More communication less document heavy 
@REVNATHANIEL | #UXCAM
What didn’t work 
• Space 
• Falling post-it notes 
Recommendations 
• Analyse and capture/document data as soon as you can 
• Use super sticky post its
Plan 
Analyse Execute 
Task Collaboration friendly? 
Yes Sometimes/ 
@REVNATHANIEL | #UXCAM 
depends 
No 
Categorise & Analyse 
data 
Post up data 
Document analysis 
process 
Share findings 
Presenting findings 
with a colleague
There are times when you just 
need to work alone! 
@REVNATHANIEL | #UXCAM
What didn’t work 
• Analysing data together with another person 
@REVNATHANIEL | #UXCAM
What worked 
• Work with a colleague but separately 
• Discuss your own interpretations of the data 
• Don’t be afraid to ask why 
@REVNATHANIEL | #UXCAM
Issues with Collaboration 
@REVNATHANIEL | #UXCAM
• Dominant team members 
• Organization and time management skills 
• Facilitation skills/people management 
• Familiarity with collaboration techniques 
• Enthusiasm 
• Company culture 
• Immediacy 
@REVNATHANIEL | #UXCAM
Summary 
• The entire user research process can be very collaborative 
• Collaboration is active 
• Some research phases are more collaboration friendly than others 
• Some techniques are more collaboration friendly than others 
• There are a couple of pitfalls with collaboration 
@REVNATHANIEL | #UXCAM
My top tips 
#1 Change your mind set and try collaboration 
#2 Continually look for opportunities to collaborate 
#3 Learn when not to collaborate 
@REVNATHANIEL | #UXCAM
Revathi Nathaniel 
Usability Engineer 
Red Gate Software Ltd 
Twitter: @revnathaniel 
Email: revathinathaniel@red-gate.com
References 
Adaptive software development: a collaborative approach to managing complex systems- 
James A Highsmith III 
Gov. Uk- User research blog 
‘Have you had your recommended dose of research?’- Dipa Shah 
https://userresearch.blog.gov.uk/2014/08/06/have-you-had-your-recommended-dose-of-research/ 
Introduction to Task Based Models- Indi Young 
http://www.slideshare.net/indi/a-brief-very-brief-introduction-to-task-based-models

Collaborative user research experience report ux cam 2014 r_nathaniel

  • 1.
    Collaborative User Research REVATHI NATHANIEL, @REVNATHANIEL USABILITY ENGINEER, RED GATE SOFTWARE LTD.
  • 2.
  • 3.
    The lone researcherwho observes interesting things and reports them back to the world… @REVNATHANIEL | #UXCAM
  • 4.
  • 5.
    @REVNATHANIEL | #UXCAMhttps://userresearch.blog.gov.uk/2014/08/06/have-you-had-your-recommended-dose- of-research/
  • 6.
    Collaboration is anact of shared creation and/or share discovery (Schrage89, p.4) Sir Ken Robinson's “Changing Education Paradigms" RSA animated talk @REVNATHANIEL | #UXCAM
  • 7.
    Collaboration is active-itrequires active participation with an intent to add value- James A. Highsmith III Illustration by Kevin Cornel, A List Apart, Issue 381 @REVNATHANIEL | #UXCAM
  • 8.
    Communication is passive-it transfers information, with an intent to inform- James A. Highsmith III Illustration by Kevin Cornel, A List Apart
  • 9.
    The entire processof user research can be collaborative @REVNATHANIEL | #UXCAM
  • 10.
    Collaboration during thephases of research @REVNATHANIEL | #UXCAM
  • 11.
    Plan Analyse Execute @REVNATHANIEL | #UXCAM Research Phases • Understand Project requirements • Plan scope of research & • research activities • Create research material • Carry out planned activities • Capture data • Re-evaluate research plan • Categorize data • Analyse data • Document analysis process • Share findings
  • 12.
    Plan Analyse Execute Task Collaboration friendly? Yes Sometimes/ depends No Understand Project requirements Project kick-off meetings Plan scope of research & research activities Meetings, Documents on Google Drive Create research material e.g.: Surveys, interview questionnaires, screeners, etc. Emails to the team Documents on Google Drive Post work on walls, Collaboration games @REVNATHANIEL | #UXCAM
  • 13.
  • 14.
  • 15.
    What worked •Quality of research • Rigorous process • Widen scope of research • Reduce bias • Sense of ownership @REVNATHANIEL | #UXCAM
  • 16.
    What didn’t work • Survey Length • Too wide scope • Lengthy analysis Recommendations • Have a clear and documented research plan • Don’t be afraid to put your foot down as the researcher 
  • 17.
    Plan Analyse Execute @REVNATHANIEL | #UXCAM Research Phases • Carry out planned activities • Capture data • Re-evaluate research plan
  • 18.
    @REVNATHANIEL | #UXCAM Data Techniques Preference Preferences, opinions, desires Surveys Focus groups Preference interviews Card sorting Ability What is understood or accomplished with a tool Prototypes Usability testing Log Analysis Customer feedback Card sorting Conceptual How things get done Interviews Contextual inquiry Surveys Classes of research Slide taken from Indi Young’ s Introduction to Task Based Models
  • 19.
    Plan Analyse Execute Task Collaboration friendly? Yes Sometimes/ depends @REVNATHANIEL | #UXCAM Carry out planned activities Site visits, Formative usability tests Persona creation, Heuristic evaluations Capture observations/data Google docs Capturing data on post its Re-evaluate research plan Discuss with project team Collaboration games
  • 20.
    Remote Usability Testing @REVNATHANIEL | #UXCAM
  • 22.
    What worked Reducebias in note taking Variety of observations Discuss observations together Discuss facilitation technique Participation in the study
  • 23.
    Testimonials ‘They providea point of reference for discussions…’- James G, Tester ‘We can pick up the language they use to describe things and incorporate it into the product’- Chris M, Developer ‘Listening to customers’ experiences…has exposed me to the technologies that I should familiarise myself …Without UX providing such opportunities to get involved with the initial research this may not have happened until much later in the process’- Chris M, Developer @REVNATHANIEL | #UXCAM
  • 24.
    What didn’t work • Busy calendars- team members unable to attend • Team sometimes loses faith in the project • Over enthusiastic and vocal observers • Post study banter Recommendations • Email notes from the session to the team • Share video/audio recordings • Give instructions before the session • Own the role of a facilitator
  • 25.
  • 27.
    What worked •Sharing what we learn as a team • Getting buy in • Shared understanding • More communication less document heavy @REVNATHANIEL | #UXCAM
  • 28.
    What didn’t work • Space • Falling post-it notes Recommendations • Analyse and capture/document data as soon as you can • Use super sticky post its
  • 29.
    Plan Analyse Execute Task Collaboration friendly? Yes Sometimes/ @REVNATHANIEL | #UXCAM depends No Categorise & Analyse data Post up data Document analysis process Share findings Presenting findings with a colleague
  • 30.
    There are timeswhen you just need to work alone! @REVNATHANIEL | #UXCAM
  • 31.
    What didn’t work • Analysing data together with another person @REVNATHANIEL | #UXCAM
  • 32.
    What worked •Work with a colleague but separately • Discuss your own interpretations of the data • Don’t be afraid to ask why @REVNATHANIEL | #UXCAM
  • 33.
    Issues with Collaboration @REVNATHANIEL | #UXCAM
  • 34.
    • Dominant teammembers • Organization and time management skills • Facilitation skills/people management • Familiarity with collaboration techniques • Enthusiasm • Company culture • Immediacy @REVNATHANIEL | #UXCAM
  • 35.
    Summary • Theentire user research process can be very collaborative • Collaboration is active • Some research phases are more collaboration friendly than others • Some techniques are more collaboration friendly than others • There are a couple of pitfalls with collaboration @REVNATHANIEL | #UXCAM
  • 36.
    My top tips #1 Change your mind set and try collaboration #2 Continually look for opportunities to collaborate #3 Learn when not to collaborate @REVNATHANIEL | #UXCAM
  • 37.
    Revathi Nathaniel UsabilityEngineer Red Gate Software Ltd Twitter: @revnathaniel Email: revathinathaniel@red-gate.com
  • 38.
    References Adaptive softwaredevelopment: a collaborative approach to managing complex systems- James A Highsmith III Gov. Uk- User research blog ‘Have you had your recommended dose of research?’- Dipa Shah https://userresearch.blog.gov.uk/2014/08/06/have-you-had-your-recommended-dose-of-research/ Introduction to Task Based Models- Indi Young http://www.slideshare.net/indi/a-brief-very-brief-introduction-to-task-based-models

Editor's Notes

  • #5 Swim lanes in UX
  • #6  This is a poster by the UX team at Government Digital service where they are exploring how User research is a more like a team sport where they involve everyone in user research User research is not only the user researcher’s job but now everyone is involved in research. https://userresearch.blog.gov.uk/2014/08/06/have-you-had-your-recommended-dose-of-research/
  • #7 And great learning happens in groups as Sir Ken Robinson described in his very popular TED talk about how education needs to change to prepare children better. https://www.youtube.com/watch?v=zDZFcDGpL4U
  • #8 Taken from Adaptive Software Development- A collaborative approach to managing complex systems- James A. Highsmith III
  • #9 Taken from Adaptive Software Development- A collaborative approach to managing complex systems- James A. Highsmith III
  • #10 Collaboration does not need to be limited to only to the user facing aspects of user research. The entire process should be opened up.
  • #15 The process of collating, categorizing and culling questions while creating a survey
  • #19 This is taken from Indi Young’s categorization of the classes of research data.
  • #27 A living, evolving persona built by the team Post its on any wall that is available to generate interest in user research
  • #31 Taken from ‘Office Space’ (Twentieth Century Fox, 1999)