Making sense of the dataCollaborative techniques foranalyzing observationsDana Chisnell@danachis#makingsense 1
What I’m talking about In-time reporting, collaboratively Shortcut to persona attributes Ending the opinion wars through team analysis Democratic, fast prioritizing 2
Rolling issueslistsObservations in real timeObserver participation = buy-inLow-ﬁ reporting
Observations in real time Large whiteboard Colored markers Don’t worry about order Be clear enough to remember what was meant
Angela CoulterRolling issues
Observer participation After 1-3 participants, longer break You start Invite observers to add and track items
Weighting Number of incidents Who’s who
Big ideas, so farConsensus: Observers buy in observers contribute to identifying issues you learn constraints instant reporting
MatthewAttorneyHouse in Tel AvivMarriedLoves his BlackberryHates emailReads NYTimes on iPadAddicted to Words With Friends
!Buying tickets on awebsite for for theMaccabiah
EdithFollows American sports, especiallybaseballHates ESPN.comLoves face-to-face online
DennisBuilding contractorCell phone is for calling homeVery tuned in to current eventsSees no usefulness in FacebookRecently more absent-mindedDifﬁculty doing standard calculations
Jane1,000-acre farmTweets soil chemical readingsTablet instrumented to aggregate data
Personas: Archetypal users‣ Composites of real users‣ Function or task-based
You: designer & developer How do you design for these people based on what you know? Think about each of the people as you answer these questions:
What can we say about how persistent the person is?
How pro-active will this person be in solving problems?
How easily will this person become frustrated?
How tech savvy is this person?
How literate is this person in the domain?
Little data, lots of assumptions
How old are they? 54 83 28 60Matthew Edith Dennis JaneBlackberry-loving ESPN.com-hating Facebookwhat? Farmer nerdattorney Hangouts fan
How old are they? How educated are they?How much money do they make?
These don’t matter.
If demographics don’t matter,what do you do?
Ask the right questions• persistence with tech• tolerance for risk & experimentation• how patient, how easily frustrated• tech savviness, expertise• strength of tech vocabulary• physical or cognitive abilities
• Attitude motivation, emotion, risk tolerance, persistence, optimism or pessimism• Aptitude current knowledge, ability to make inferences, expertise• Ability physical and cognitive attributes
Technique‣ Focus on the attributes that matter‣ Accounting for what the user brings to the design‣ Adjustable to context, relationships, domain
Tool‣ Framework to think about provisional or proto- personas (little or no data)‣ Schema to evaluate existing personas’ strength of coverage
Collaboration tool‣ Do our personas cover all the right attributes?‣ Have we heard from all the users we need to hear from?
Task +functionality!Buying tickets on awebsite for theMaccabiahVIP?Suites?Close to participants?Event?
Ask the right questions• Who is the most persistent when it comes to working with technology?• Who is the most likely to experiment and create workarounds when something doesn’t work the way they expect?• Who do you think will give up when they encounter frustrations out of impatience?
Ask the right questions• Which one has the most tech expertise? Which one strikes you as the least tech savvy?• Which one is the most likely to call tech support to help them get out of some tech pickle?• Who will have the most advanced tech vocabulary when they do call for support?
MatthewAttorneyHouse in Tel Aviv, marriedAssistant books reservationsLoves his BlackberryHates emailReads NYTimes on iPadAddicted to Words With FriendsDoesn’t spend a lot of time on the WebAvid hiker and birderBad kneesNeeds Rx eyepiece for scope
M M M! Where does Matthew ﬁt?
EdithAvid sports fanFollows Detroit TigersHates ESPN.comLoves face-to-face onlinePicked up Skype early, quicklyPrefers Google HangoutsDropped FaceTime - gestures were frustrating
E E E! Where does Edith ﬁt?
DennisBuilding contractorMarried to a nurseThey have 2 kids8-year-old cell phoneGets current events on the WebSees no usefulness in FacebookTrouble sleeping, easily distractedServed in the military: Blunt Force Brain Trauma
D D D! Where does Dennis ﬁt?
Jane1,000-acre farm12 different systems every dayTweets soil chemical readingsSmartphone alerts from exchangesTablet instrumented to aggregate dataMinimized manual inputArthritic thumbsNeeds stronger progressive lenses
J J J! Where does Jane ﬁt?
D M E J DM E J MJ D E! A3 Persona modeling
How dodesigndecisionschange withtheseattributes?
Subtlety ofaffordancesSize of targetsDirectness of thehappy pathFeedback modalitiesLabeling & triggerwordsAmount of copyWording ofinstructions &messages
If you had this tool, what would you donext?What would be different for yourdesign?
A3 Persona modeler• Designing for attitude, aptitude, & ability• Accounting for what the user brings to the design• Checking that personas cover the right things
Big ideasPersona modeler: fast way to visualize users byasking important questions framework for talking about who users are can tell which users might be missing works with any amount of data middle ground between demographics and research-based personas
What obstacles do teams facein delivering the best possibleuser experiences?
Participants typed in the top chat area ratherthan the bottom area.Observations
Observations Sources: What you saw usability testing What you heard user research sales feedback support calls and emails training
- Participants are drawn to open areas when they are trying to communicate with other attendees - Participants are drawn to the ﬁrst open area they seeInferences
Inferences Judgements Conclusions Guesses Intuition + Weight of evidence
Inferences Review the inferences What are the causes? How likely is this inference to be the cause? How often did the observation happen? Are there any patterns in what kinds of users had issues?
- Make the response area smaller until it has content Direction
Direction What’s the evidence for a design change? What does the strength of the cause suggest about a solution? Test theories
Big ideas: Making sense of the data Observation Inference Direction What happened Why there’s a A theory about gap between what to do behavior & UI
ReviewHow’d that go?What might be differentfor your situation?
Priorities, democraticallyreach consensus fromsubjective datasimilar to afﬁnitydiagramminginvented by Jiro Kawakitaobjective, quick8 simple steps
1. FocusquestionWhat needs to be ﬁxed inProduct X to improve the userexperience?(observations, data)What obstacles do teams face inimplementing UX practices?(opinion)
2. Organizethe groupCall together everyoneconcernedFor user research, only thosewho observedTypically takes an hour
3. Put opinionsor data onFor a usability test, ask forobservations(not inferences, not opinion)No discussion
4. Put noteson a wallRandomRead others’Add itemsNo discussion
5. Groupsimilar itemsIn another part of the roomStart with 2 items that seem likethey belong togetherPlace them together, one belowthe otherMove all stickiesReview and move among groupsEvery item in a groupNo discussion
6. Name eachgroupUse a different colorEach person gives each group anameNames must be noun clustersSplit groupsJoin groupsEveryone must give every groupa nameNo discussion
7. Vote for themost importantDemocratic sharing of opinionsIndependent of inﬂuence orcoercionEach person writes their top 3Rank the choices from most toleast importantRecord votes on the group stickyNo discussion
8. Rank thegroupsPull notes with votesOrder by the number of votesRead off the groupsDiscuss combining groupsAgreement must be unanimousAdd combined groups’ votestogetherStop at 3-5 clear top priorities
Big ideas, so farGoal: share the most important observationsFocus: identify priorities democratic quick
Big idea: Collaborative analysis build consensus in real time: rolling issues observers contribute to identifying issues you learn constraints instant reporting model users: A3 persona modeler attitude aptitude ability make sense of the data, together observation: what you heard, saw inference: why the gap between the UI and the behavior direction: a theory about what to do about it
No reports. :)
Where to learn moreDana’s blog: http://usabilitytesting.wordpress.comDownload templates, examples, andlinks to other resources fromwww.wiley.com/go/usabilitytesting