SlideShare a Scribd company logo
WQusability.com
Whitney Quesenbery
whitneyq@wqusability.co
Note-taking Like a Pro
A deep dive into a common practice
Whitney Quesenbery
University of Baltimore
September 2013
2
Working faster
Working better
3
In describing a usability test, no one
talks much about how to take notes
Activities in a usability test
1. Determine basics
2. Plan process
3. Create test situation
4. Conduct test
5. Interpret data
Jeff Rubin
Handbook of Usability Testing (1st Ed.)
4
Or about how the setting (and goals) for
user research can change the process
5
But note-taking is part of the research
process
What you take notes on
and
How you take notes
determine
What data you have for analysis
and
How fast you can report robust results
6
Inspiration from theatre
“Tomorrow and Tomorrow” by Timothy Sullivan Center for Contemporary Opera, 1987
Directed by Stephen Jarrett, Scenery by Robert Edmonds, Lighting by Whitney
Quesenbery. With Suzan Hanson
7
Backed up by the ability to take great
notes in real time
8
Asking the right
question makes it
easier to get a useful
answer.
9
Identifying the questions is the first step in
planning note-taking
 How is this new audience the same or different from our current
audience?
 What do they already know about our products? What questions
do they have about our products?
 Can they find answers to their questions on the current web site?
If you are working on expanding a product offering
to a new audience, you might want to know...
10
What kinds of questions have
you asked in a usability project
recently?
11
Three broad goals
Understand users
 Learn people's background, motivation or decision-making
 Uncover requirements for functionality or usability
Uncover patterns of use
 Discover how people approach an activity
 Observe how they use the product for their own goals
 Find aspects of the interface or interaction that are confusing
Measure performance or success
 Learn how well the product supports users in completing tasks
 Learn how accurately or efficiently they use the product
12
What information do we need for each
of these goals?
Understanding users
Understanding patterns of use
Measuring success
Brainstorm
questions and what
types of data you
might collect or
observations to
take notes on.
Write them on
stickies and group
them by goals.
?? Something else ??
13
There are many ways
to take notes:
What story are you
trying to tell?
14
Note-taking practices cover a broad range
of techniques and approaches
Narrative Structured
Session
notes
(written or
typed)
Notes
form
organized
by type of
data
Logging tools
(task markers,
time-stamps,
integrated in
video)
Lightly
structured
spreadsheet
15
Session Notes Spreadsheets Logging Tools Custom Form
Unstructured
narrative
Blend of
structured data
and freeform
notes
Time-stamped
Consistent format
for all notes
Notes organized
by topic
Captures flow of
session
Capture flow
with some
topic/metadata
Capture
context/metadata
by instrumentation
& video
Captures notes for
specific research
questions
Can often focus
on talk
Hard to pick out
details from the
flow
Metadata and
formatting can be
limited
Individual notes
do not have much
context, except
the connection to
video
Can lose narrative
context of the
session
They all have strengths and weaknesses
16
Ways to structure notes
Narrative
 Capture the flow of the session and help you recall details
 Focus on each participant's perspective and story
By task or activity, wihtin participants
 Capture process and what participants do (in what order)
 Note pages or task steps and success
Across participants
 Compile comparisons as you capture the data
 Note differences or catagorization on the fly
17How have you taken notes?
What kinds of structure do they have?
Narrative
Task or activity focused
Structured data form
Look at your own
note-taking.
What has it focused
on?
???
18
Freeform: Typical hand-written notes
Order of notes matches the
order in which information is
heard.
Act of writing helps put the
information in memory.
Thank you, Tiffany Aiken!
19
Minimal: Freeform notes, typed up, with
headings to identify tasks or activities
20
Minimal structure: separating
observations, quotes, and inferences
21
Taking notes in the session guide
22
Session guide as notes sheets
23Notes sheet loosely matching the session
plan and questions to be covered
24
Loosely structured notes sheets
 xx
25
Using a spreadsheet to insert standard
codes easily
26
What about sketchnotes??
27
Involving observers to
invite them into the
process
Photo: Before It's News
28
Give them a clue about what to look for
29
Minimal: Top three problems
30
Notes pages with tasks and screens
31
Collaborative: Shared spreadsheet
32
Visible: The big wall of notes
33
Sharing information.. when a team works
together
If the team works together on projects:
 Each team member can focus on a different aspect of the
participants’ experience. This gives the project a richer mix of notes
than if everyone took the same notes.
If team members work on different projects
 Having different aspects of the observations separated makes it
easier to share insights on specific aspects of user behavior or
product usability
If the team works over a long period of time
 It’s easier to track trends on use of functionality, attitudes or other
usability issues
34
Let's design a way to take notes
1. What questions are you
trying to answer
2. What data do you want
to collect?
3. What else do you want to be
able to easily take notes on
Think about a
project you are
working on (or have
worked on recently)
4. Design the note-taking form
35
Putting it together:
Notes are the first step
in analysis
36
Participant
summary
37
Path analysis
38
"Personas"
39
Notes and problems by location in site
40
Notes and problems by location in site
41
Storytelling for User Experience
with Kevin Brooks
Global UX
with Daniel Szuc
A Web for Everyone
with Sarah Horton
A Web for
Everyone
Whitney Quesenbery
WQusability.com
whitney@wqusability.com
usabilityinciviclife.org
Twitter @whitneyq

More Related Content

Viewers also liked

Usability in Civic Life
Usability in Civic Life Usability in Civic Life
Usability in Civic Life
Whitney Quesenbery
 
Design in Elections
Design in ElectionsDesign in Elections
Design in Elections
Whitney Quesenbery
 
A Better Ballot for New York State in 2012
A Better Ballot for New York State in 2012A Better Ballot for New York State in 2012
A Better Ballot for New York State in 2012
Whitney Quesenbery
 
Usability meets accessibility
Usability meets accessibilityUsability meets accessibility
Usability meets accessibility
Whitney Quesenbery
 
Plain language (accessibility for content)
Plain language (accessibility for content)Plain language (accessibility for content)
Plain language (accessibility for content)
Whitney Quesenbery
 
Plain language is accessibility for content
Plain language is accessibility for contentPlain language is accessibility for content
Plain language is accessibility for content
Whitney Quesenbery
 
The Power of Story (updated 2013)
The Power of Story (updated 2013)The Power of Story (updated 2013)
The Power of Story (updated 2013)
Whitney Quesenbery
 
Usability testing for accessible UX
Usability testing for accessible UXUsability testing for accessible UX
Usability testing for accessible UX
Whitney Quesenbery
 
The power of stories: creating empathy and connection
The power of stories: creating empathy and connectionThe power of stories: creating empathy and connection
The power of stories: creating empathy and connection
Whitney Quesenbery
 
A Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challengeA Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challenge
Whitney Quesenbery
 
Personas for Accessible UX
Personas for Accessible UXPersonas for Accessible UX
Personas for Accessible UX
Whitney Quesenbery
 

Viewers also liked (11)

Usability in Civic Life
Usability in Civic Life Usability in Civic Life
Usability in Civic Life
 
Design in Elections
Design in ElectionsDesign in Elections
Design in Elections
 
A Better Ballot for New York State in 2012
A Better Ballot for New York State in 2012A Better Ballot for New York State in 2012
A Better Ballot for New York State in 2012
 
Usability meets accessibility
Usability meets accessibilityUsability meets accessibility
Usability meets accessibility
 
Plain language (accessibility for content)
Plain language (accessibility for content)Plain language (accessibility for content)
Plain language (accessibility for content)
 
Plain language is accessibility for content
Plain language is accessibility for contentPlain language is accessibility for content
Plain language is accessibility for content
 
The Power of Story (updated 2013)
The Power of Story (updated 2013)The Power of Story (updated 2013)
The Power of Story (updated 2013)
 
Usability testing for accessible UX
Usability testing for accessible UXUsability testing for accessible UX
Usability testing for accessible UX
 
The power of stories: creating empathy and connection
The power of stories: creating empathy and connectionThe power of stories: creating empathy and connection
The power of stories: creating empathy and connection
 
A Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challengeA Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challenge
 
Personas for Accessible UX
Personas for Accessible UXPersonas for Accessible UX
Personas for Accessible UX
 

Similar to Notetaking workshop

UXPA International 2013 The Note-Taker's Perspective
UXPA International 2013 The Note-Taker's Perspective UXPA International 2013 The Note-Taker's Perspective
UXPA International 2013 The Note-Taker's Perspective
UserWorks
 
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
UXPA International
 
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinExperience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Mad*Pow
 
Experience Research Best Practices
Experience Research Best PracticesExperience Research Best Practices
Experience Research Best Practices
Dan Berlin
 
Session 2 into to qualitative research intro
Session 2   into to qualitative research introSession 2   into to qualitative research intro
Session 2 into to qualitative research intro
Angela Ferrara
 
Using Retrospective Think Aloud With Eye Tracking Usability Testing
Using Retrospective Think Aloud With Eye Tracking Usability TestingUsing Retrospective Think Aloud With Eye Tracking Usability Testing
Using Retrospective Think Aloud With Eye Tracking Usability Testing
Acuity ETS Limited
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008
guest63c15b
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
Patañjali Chary
 
Requirements Elicitation
Requirements ElicitationRequirements Elicitation
Requirements Elicitation
Sheldon McCarthy
 
Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...
Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...
Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...
Viewpoints, University of Ulster
 
OLDSMOOC Week5 part 2: Testing the prototypes. Diana Laurillard
OLDSMOOC Week5 part 2: Testing the prototypes. Diana LaurillardOLDSMOOC Week5 part 2: Testing the prototypes. Diana Laurillard
OLDSMOOC Week5 part 2: Testing the prototypes. Diana Laurillard
OLDSMOOC
 
UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University
Dr.Mohammed Alhusban
 
classmar2.ppt
classmar2.pptclassmar2.ppt
classmar2.ppt
RangothriSreenivasaS
 
Using Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User ResearchUsing Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User Research
UserZoom
 
An Efficient And Scalable Meeting Minutes Generation And Presentation Technique
An Efficient And Scalable Meeting Minutes Generation And Presentation TechniqueAn Efficient And Scalable Meeting Minutes Generation And Presentation Technique
An Efficient And Scalable Meeting Minutes Generation And Presentation Technique
Daniel Wachtel
 
Seda Conference 5 May 2011
Seda Conference 5 May 2011Seda Conference 5 May 2011
Seda Conference 5 May 2011
Viewpoints, University of Ulster
 
Data collection for field studies
Data collection for field studiesData collection for field studies
Data collection for field studies
Will Shen
 
Dlt workshop 1
Dlt workshop 1Dlt workshop 1
Dlt workshop 1
ezzaw8
 
25 march introducing design methods
25 march introducing design methods25 march introducing design methods
25 march introducing design methods
Abhishek Sagar
 
25 march introducing design methods
25 march introducing design methods25 march introducing design methods
25 march introducing design methods
Abhishek Sagar
 

Similar to Notetaking workshop (20)

UXPA International 2013 The Note-Taker's Perspective
UXPA International 2013 The Note-Taker's Perspective UXPA International 2013 The Note-Taker's Perspective
UXPA International 2013 The Note-Taker's Perspective
 
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
 
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinExperience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
 
Experience Research Best Practices
Experience Research Best PracticesExperience Research Best Practices
Experience Research Best Practices
 
Session 2 into to qualitative research intro
Session 2   into to qualitative research introSession 2   into to qualitative research intro
Session 2 into to qualitative research intro
 
Using Retrospective Think Aloud With Eye Tracking Usability Testing
Using Retrospective Think Aloud With Eye Tracking Usability TestingUsing Retrospective Think Aloud With Eye Tracking Usability Testing
Using Retrospective Think Aloud With Eye Tracking Usability Testing
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
 
Requirements Elicitation
Requirements ElicitationRequirements Elicitation
Requirements Elicitation
 
Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...
Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...
Course Level Revalidation workshop, School of Computing and Mathematics, 20/0...
 
OLDSMOOC Week5 part 2: Testing the prototypes. Diana Laurillard
OLDSMOOC Week5 part 2: Testing the prototypes. Diana LaurillardOLDSMOOC Week5 part 2: Testing the prototypes. Diana Laurillard
OLDSMOOC Week5 part 2: Testing the prototypes. Diana Laurillard
 
UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University
 
classmar2.ppt
classmar2.pptclassmar2.ppt
classmar2.ppt
 
Using Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User ResearchUsing Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User Research
 
An Efficient And Scalable Meeting Minutes Generation And Presentation Technique
An Efficient And Scalable Meeting Minutes Generation And Presentation TechniqueAn Efficient And Scalable Meeting Minutes Generation And Presentation Technique
An Efficient And Scalable Meeting Minutes Generation And Presentation Technique
 
Seda Conference 5 May 2011
Seda Conference 5 May 2011Seda Conference 5 May 2011
Seda Conference 5 May 2011
 
Data collection for field studies
Data collection for field studiesData collection for field studies
Data collection for field studies
 
Dlt workshop 1
Dlt workshop 1Dlt workshop 1
Dlt workshop 1
 
25 march introducing design methods
25 march introducing design methods25 march introducing design methods
25 march introducing design methods
 
25 march introducing design methods
25 march introducing design methods25 march introducing design methods
25 march introducing design methods
 

More from Whitney Quesenbery

Designing for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challengeDesigning for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challenge
Whitney Quesenbery
 
Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data
Whitney Quesenbery
 
Storytelling makes research data come to life
Storytelling makes research data come to lifeStorytelling makes research data come to life
Storytelling makes research data come to life
Whitney Quesenbery
 
From barrier-free to delightful
From barrier-free to delightfulFrom barrier-free to delightful
From barrier-free to delightful
Whitney Quesenbery
 
Accessibility Basics
Accessibility BasicsAccessibility Basics
Accessibility Basics
Whitney Quesenbery
 
Writing Great Alt Text
Writing Great Alt TextWriting Great Alt Text
Writing Great Alt Text
Whitney Quesenbery
 
From barrier-free to delightful
From barrier-free to delightfulFrom barrier-free to delightful
From barrier-free to delightful
Whitney Quesenbery
 
Usability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheapUsability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheap
Whitney Quesenbery
 
Writing Great Alt Text
Writing Great Alt TextWriting Great Alt Text
Writing Great Alt Text
Whitney Quesenbery
 
Don't Make Me Read
Don't Make Me ReadDon't Make Me Read
Don't Make Me Read
Whitney Quesenbery
 
What you can learn from usability testing
What you can learn from usability testingWhat you can learn from usability testing
What you can learn from usability testing
Whitney Quesenbery
 
Accessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiencesAccessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiences
Whitney Quesenbery
 
Using Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPAUsing Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPA
Whitney Quesenbery
 
Persona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picturePersona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picture
Whitney Quesenbery
 
A Place at the Table
A Place at the TableA Place at the Table
A Place at the Table
Whitney Quesenbery
 
6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone
Whitney Quesenbery
 
Content for Everyone
Content for EveryoneContent for Everyone
Content for Everyone
Whitney Quesenbery
 

More from Whitney Quesenbery (17)

Designing for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challengeDesigning for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challenge
 
Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data
 
Storytelling makes research data come to life
Storytelling makes research data come to lifeStorytelling makes research data come to life
Storytelling makes research data come to life
 
From barrier-free to delightful
From barrier-free to delightfulFrom barrier-free to delightful
From barrier-free to delightful
 
Accessibility Basics
Accessibility BasicsAccessibility Basics
Accessibility Basics
 
Writing Great Alt Text
Writing Great Alt TextWriting Great Alt Text
Writing Great Alt Text
 
From barrier-free to delightful
From barrier-free to delightfulFrom barrier-free to delightful
From barrier-free to delightful
 
Usability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheapUsability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheap
 
Writing Great Alt Text
Writing Great Alt TextWriting Great Alt Text
Writing Great Alt Text
 
Don't Make Me Read
Don't Make Me ReadDon't Make Me Read
Don't Make Me Read
 
What you can learn from usability testing
What you can learn from usability testingWhat you can learn from usability testing
What you can learn from usability testing
 
Accessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiencesAccessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiences
 
Using Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPAUsing Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPA
 
Persona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picturePersona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picture
 
A Place at the Table
A Place at the TableA Place at the Table
A Place at the Table
 
6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone
 
Content for Everyone
Content for EveryoneContent for Everyone
Content for Everyone
 

Recently uploaded

Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
Alex Pruden
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 

Recently uploaded (20)

Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 

Notetaking workshop

  • 1. WQusability.com Whitney Quesenbery whitneyq@wqusability.co Note-taking Like a Pro A deep dive into a common practice Whitney Quesenbery University of Baltimore September 2013
  • 3. 3 In describing a usability test, no one talks much about how to take notes Activities in a usability test 1. Determine basics 2. Plan process 3. Create test situation 4. Conduct test 5. Interpret data Jeff Rubin Handbook of Usability Testing (1st Ed.)
  • 4. 4 Or about how the setting (and goals) for user research can change the process
  • 5. 5 But note-taking is part of the research process What you take notes on and How you take notes determine What data you have for analysis and How fast you can report robust results
  • 6. 6 Inspiration from theatre “Tomorrow and Tomorrow” by Timothy Sullivan Center for Contemporary Opera, 1987 Directed by Stephen Jarrett, Scenery by Robert Edmonds, Lighting by Whitney Quesenbery. With Suzan Hanson
  • 7. 7 Backed up by the ability to take great notes in real time
  • 8. 8 Asking the right question makes it easier to get a useful answer.
  • 9. 9 Identifying the questions is the first step in planning note-taking  How is this new audience the same or different from our current audience?  What do they already know about our products? What questions do they have about our products?  Can they find answers to their questions on the current web site? If you are working on expanding a product offering to a new audience, you might want to know...
  • 10. 10 What kinds of questions have you asked in a usability project recently?
  • 11. 11 Three broad goals Understand users  Learn people's background, motivation or decision-making  Uncover requirements for functionality or usability Uncover patterns of use  Discover how people approach an activity  Observe how they use the product for their own goals  Find aspects of the interface or interaction that are confusing Measure performance or success  Learn how well the product supports users in completing tasks  Learn how accurately or efficiently they use the product
  • 12. 12 What information do we need for each of these goals? Understanding users Understanding patterns of use Measuring success Brainstorm questions and what types of data you might collect or observations to take notes on. Write them on stickies and group them by goals. ?? Something else ??
  • 13. 13 There are many ways to take notes: What story are you trying to tell?
  • 14. 14 Note-taking practices cover a broad range of techniques and approaches Narrative Structured Session notes (written or typed) Notes form organized by type of data Logging tools (task markers, time-stamps, integrated in video) Lightly structured spreadsheet
  • 15. 15 Session Notes Spreadsheets Logging Tools Custom Form Unstructured narrative Blend of structured data and freeform notes Time-stamped Consistent format for all notes Notes organized by topic Captures flow of session Capture flow with some topic/metadata Capture context/metadata by instrumentation & video Captures notes for specific research questions Can often focus on talk Hard to pick out details from the flow Metadata and formatting can be limited Individual notes do not have much context, except the connection to video Can lose narrative context of the session They all have strengths and weaknesses
  • 16. 16 Ways to structure notes Narrative  Capture the flow of the session and help you recall details  Focus on each participant's perspective and story By task or activity, wihtin participants  Capture process and what participants do (in what order)  Note pages or task steps and success Across participants  Compile comparisons as you capture the data  Note differences or catagorization on the fly
  • 17. 17How have you taken notes? What kinds of structure do they have? Narrative Task or activity focused Structured data form Look at your own note-taking. What has it focused on? ???
  • 18. 18 Freeform: Typical hand-written notes Order of notes matches the order in which information is heard. Act of writing helps put the information in memory. Thank you, Tiffany Aiken!
  • 19. 19 Minimal: Freeform notes, typed up, with headings to identify tasks or activities
  • 21. 21 Taking notes in the session guide
  • 22. 22 Session guide as notes sheets
  • 23. 23Notes sheet loosely matching the session plan and questions to be covered
  • 25. 25 Using a spreadsheet to insert standard codes easily
  • 27. 27 Involving observers to invite them into the process Photo: Before It's News
  • 28. 28 Give them a clue about what to look for
  • 30. 30 Notes pages with tasks and screens
  • 32. 32 Visible: The big wall of notes
  • 33. 33 Sharing information.. when a team works together If the team works together on projects:  Each team member can focus on a different aspect of the participants’ experience. This gives the project a richer mix of notes than if everyone took the same notes. If team members work on different projects  Having different aspects of the observations separated makes it easier to share insights on specific aspects of user behavior or product usability If the team works over a long period of time  It’s easier to track trends on use of functionality, attitudes or other usability issues
  • 34. 34 Let's design a way to take notes 1. What questions are you trying to answer 2. What data do you want to collect? 3. What else do you want to be able to easily take notes on Think about a project you are working on (or have worked on recently) 4. Design the note-taking form
  • 35. 35 Putting it together: Notes are the first step in analysis
  • 39. 39 Notes and problems by location in site
  • 40. 40 Notes and problems by location in site
  • 41. 41 Storytelling for User Experience with Kevin Brooks Global UX with Daniel Szuc A Web for Everyone with Sarah Horton A Web for Everyone

Editor's Notes

  1. and all the different goals
  2. 15 minutes for exercise.. back into their groups and look at their own note-taking practices. Which do they fit into. Goal: think about what we are trying to learn, not just about staging the session.Debrief. Any additional goals? Patterns? What have we learned.
  3. EXAMPLE 2-Notes Pages By TaskThis makes it possible to jump around in small tasks. These boxes are pretty small because I wanted the observers watching, not looking down to take notes.The whole thing was two pages (front and back of one paper)The official note-taker typed.boxes expand as neededCan format text- better than a spreadsheet because it's easy to do free form typing, and see what you are typing. Also spell check
  4. A form of data reduction. Saves the view of the person, even as you aggregate
  5. his identified both the page where each note occurred, but also the number of participants who had a similar note.We also captured successes or positive comments with the stars.