This document discusses alternative methods for taking notes during user research and analyzing the findings. It notes several drawbacks of traditional affinity diagramming for analyzing large amounts of notes from multiple observers, such as it being an overwhelming and inefficient task. Alternative structured note-taking methods are proposed, such as using a grid in Excel or Trello. The document also discusses debriefing themes in a round-robin style without using post-its, focusing on implications rather than just findings, and using other tools like "rainbow spreadsheets." The key takeaways are to ditch using post-its for note-taking and to question traditional methods.

1. @KyleSoucy | UsableInterface.com | #ias17
I’m Sorry. I Can’t. Don’t Hate Me.
the post-it breakup

3. “There is a good way to
break up with someone,
and it doesn’t involve a post-it!”
- Carrie Bradshaw
observe
Kyle Soucy

4. I don’t have an issue with
the method.
I have an
issue with
when
it’s used.
_____

5. Affinity Diagraming
1. Put ideas/observations on post-its
2. Put post-its on the wall
3. Group similar items
4. Name each group
5. Vote on most important groups

6. UX
RESEARCH

7. incomplete data

8. Rashomon
effect:
Contradictory
interpretations of
the same event by
different people.

9. observer debrief Goals
1.Share observations
2.Understand themes
3.Prioritize issues

10. We all agree this
doesn’t work...

11. So... can you
believe that last
person couldn’t
find the ‘submit’
link.
Informal Discussion

12. understanding
the problem

14. Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

15. “You should average
about one
observation per
minute...”
- David Travis
Source: http://www.userfocus.co.uk/articles/datalogging.html
60

16. Let’s assume half as many
for this scenario...

17. x 6
(observers)
(per interview)
x 7(interviews)
= 1,260 (Total notes!)
= 180 notes30

18. Which can look like...

19. Source: http://www.dia2.org/images/2_data%20analysis_large.JPG

20. Source: https://i.ytimg.com/vi/UynxDyr0lAo/maxresdefault.jpg

21. drawbacks

22. Source: https://pbs.twimg.com/media/BMGV8zECMAI23AC.jpg
It’s an overwhelming task

23. Source: http://www.vibe-ing.com/affinity-diagram-merged-from-different-sources-and-conceptual-design/
talking is not allowed

24. SILENCE! I Kill YOU!SILENCE! I Kill YOU!

25. Source: http://www.vibe-ing.com/affinity-diagram-merged-from-different-sources-and-conceptual-design/
fatigue

26. Have you seen me?
missing data...

27. illegible notes

29. Source: https://static1.squarespace.com/static/50c01780e4b0d4272576e000/t/570c838ff8baf32904ee3368/1460437908289/
Miscategorized notes

30. wrongly discarded notes

31. vague notes

32. Lost notes

34. Transcribing

35. Source: https://www.google.com/imgres?imgurl=http%3A%2F%2Fwww.clifschaller.com%2Fassets%2Fpivit_3.jpg&imgrefurl=http%3A%2F%2Fwww.clifschaller.com
%2F&docid=dJACv0T5wTDy5M&tbnid=0rAeMCTTYNaJhM%3A&vet=10ahUKEwifurmHnObSAhXF7YMKHeDoALA4ZBAzCAUoAzAD..i&w=694&h=462&bih=635&biw=1268&q=large%20affinity%20diagram
%20mess&ved=0ahUKEwifurmHnObSAhXF7YMKHeDoALA4ZBAzCAUoAzAD&iact=mrc&uact=8#h=462&imgrc=0rAeMCTTYNaJhM:&vet=10ahUKEwifurmHnObSAhXF7YMKHeDoALA4ZBAzCAUoAzAD.
.i&w=694
requires A dedicated room

36. wasteful

37. Alternative
Ways to Take Notes
Everyone should
use the same tool
&/or method.

38. "Usability testing
is like getting a drink
from a fire hydrant…"
- Carolyn Snyder

39. Notes Grid Using Excel
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

40. Participant name
P1 P2 P3User Group
P1 P2 P3Date/Time
P1 P2 P3
Questions
Task 1...
Task 2...
Task 3...
Task 4...
Task 5...
Task 6..

41. Why? Because this doesn’t work...
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

42. Notes Grid Using Trello

43. Theme Analysis grid
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpg

44. Or, rainbow spreadsheet
Image source: https://benmelbourne.files.wordpress.com/2013/04/pop-up-mobile-usability-testing-lab-5.jpgImage source: http://www.smashingmagazine.com/2013/04/11/rainbow-spreadsheet-collaborative-ux-research-tool/

45. Need help keeping
observers engaged?

46. give assignments

47. Alternative
Ways to debrief
Themes can be teased
out without a diagram.

48. when to debrief?
After every 3-6 sessions.
Don’t wait ‘til the end.

49. Prepare Consolidate
your own notes first!

50. round-robin
or lead + additions Source: https://upload.wikimedia.org/wikipedia/
commons/0/03/Staff_meeting.jpg

51. It’s not just about the findings...
implications matter

52. Wish for, how to, what if
H2 make these box entry areas clearer; H2
make it obvious they’re exclusive; Wif we only
allowed one way to search for repair info?

53. Observation: The user didn’t realize they were not
logged in and couldn’t access documents they wanted.
Implications:
- “W4 a way the user can access documents without
logging in.”
- “H2 make the log in link more visible.”
- “Wif we didn’t force the user to log in?”
Example

54. Blue sky
thinking

55. Other Tools

59. Takeaways...

60. Ditch the post-its!
(for note-taking)

61. Use affinity diagramming when
you have a focus question.
Not to analyze
research notes!

62. Always question your methods.

64. www.UsableInterface.com
@kylesoucy
/usableinterface