“ Informal Guerilla User Study” How to get quick and useful feedback on your app   ID for Devz at Hacker Dojo Nilo Sarraf ...
We see what we want to see!
<ul><li>Assumptions </li></ul><ul><ul><li>In research do NOT assume! </li></ul></ul><ul><ul><li>Researcher bias: “I know t...
Get Divorced! <ul><li>Divorce your app </li></ul><ul><li>Be objective </li></ul><ul><li>Get stupid when doing research on ...
Know Thy User Even when they look totally alien to you <ul><li>Body language/body gestures </li></ul><ul><li>Tone of voice...
The Observer Effect <ul><li>Physics </li></ul><ul><ul><li>Changes that the act of observation will make on the phenomenon ...
How to Observe Users  <ul><li>Observational techniques  </li></ul><ul><ul><ul><li>Behavioral </li></ul></ul></ul><ul><ul><...
 
Source: Elsevier 2010 http://comminfo.rutgers.edu/~tefko/Courses/Zadar/Doctoral%20studies/Lopatovska%20emotions%20in%20LIS...
Voice and Choice of Words “Know Thy User” <ul><li>High or low pitch </li></ul><ul><li>Energetic or tired  </li></ul><ul><l...
Personality Types (Psychology) <ul><li>Openness to Experience : the tendency to be imaginative, independent, and intereste...
Personality Types  “Know Thy User” <ul><li>Type &quot;A” </li></ul><ul><ul><li>Is a highly independent and driven personal...
Type A <ul><li>Independent </li></ul><ul><li>Go-getters  </li></ul><ul><li>Aggressive  </li></ul><ul><li>Driven personalit...
Type B <ul><li>Highly extroverted </li></ul><ul><li>Gregarious  </li></ul><ul><li>Love the spotlight </li></ul><ul><li>Att...
Type C <ul><li>The antithesis of Type &quot;B” </li></ul><ul><ul><li>Don’t like the spot light </li></ul></ul><ul><li>Intr...
Type D <ul><li>Resist any form of change </li></ul><ul><li>Prefer the tedium of routine </li></ul><ul><li>Clerical assignm...
 
Environment “Know Thy User” <ul><li>Familiar or unfamiliar location </li></ul><ul><li>At the Café next door or at a usabil...
Mood Swings “Know Thy User” <ul><li>Weather </li></ul><ul><ul><li>Sunny or rainy </li></ul></ul><ul><li>Time of the day </...
Let’s Get Practical <ul><li>Informal User Study </li></ul><ul><ul><li>aka Guerilla testing, Dry run, and Hallway testing <...
Before User Study <ul><li>Roughly speaking…  </li></ul><ul><ul><li>What is your objective? </li></ul></ul><ul><ul><li>What...
During User Study <ul><li>It’s not you. It’s me! </li></ul><ul><ul><li>We are not testing the users but the app </li></ul>...
During User Study <ul><li>Listen - needs self-training </li></ul><ul><li>Observe - needs self-training </li></ul><ul><li>H...
Take Notes <ul><li>Tape recording </li></ul><ul><li>Take notes  </li></ul>
Your  Own  Body Language <ul><li>Users can tell if you are very attached to your app </li></ul><ul><li>Be curious </li></u...
‘Safe’ Questions <ul><li>“ What do you think/believe this button means/does?” </li></ul><ul><li>“ Is this what you expecte...
‘Safe’ Questions <ul><li>“ Taking a quick look, what do you think this app is about? What do you think it does?” </li></ul...
Pause <ul><li>Don’t be afraid to interrupt the user </li></ul><ul><li>Sometimes users go fast and all over the place </li>...
After User Study <ul><li>Talk about your findings with </li></ul><ul><ul><li>People in your industry </li></ul></ul><ul><u...
One Last Thing <ul><li>User study is NOT about testing a hypothesis </li></ul><ul><li>User study is about uncovering new t...
 
Upcoming SlideShare
Loading in...5
×

Informal Guerilla User Study

4,142

Published on

Informal Guerilla User Study: How to get quick and useful feedback on your app.
ID for Devz at Hacker Dojo

Published in: Design, Technology
1 Comment
2 Likes
Statistics
Notes
No Downloads
Views
Total Views
4,142
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
41
Comments
1
Likes
2
Embeds 0
No embeds

No notes for slide

Informal Guerilla User Study

  1. 1. “ Informal Guerilla User Study” How to get quick and useful feedback on your app ID for Devz at Hacker Dojo Nilo Sarraf January 2011
  2. 2. We see what we want to see!
  3. 3. <ul><li>Assumptions </li></ul><ul><ul><li>In research do NOT assume! </li></ul></ul><ul><ul><li>Researcher bias: “I know the results before I even go into the lab!” </li></ul></ul><ul><li>Even top researchers are biased </li></ul><ul><li>Humans are complex machines </li></ul>
  4. 4. Get Divorced! <ul><li>Divorce your app </li></ul><ul><li>Be objective </li></ul><ul><li>Get stupid when doing research on your app! </li></ul>
  5. 5. Know Thy User Even when they look totally alien to you <ul><li>Body language/body gestures </li></ul><ul><li>Tone of voice </li></ul><ul><li>Personality types </li></ul><ul><li>Context/Environment </li></ul><ul><li>Mood swings </li></ul>
  6. 6. The Observer Effect <ul><li>Physics </li></ul><ul><ul><li>Changes that the act of observation will make on the phenomenon being observed </li></ul></ul><ul><li>Information Technology </li></ul><ul><ul><li>The potential impact of the act of observing a process output while the process is running </li></ul></ul><ul><li>Psychology </li></ul><ul><ul><li>A form of reactivity, in which a researcher's cognitive bias causes them to subconsciously influence the participants of an experiment </li></ul></ul>
  7. 7. How to Observe Users <ul><li>Observational techniques </li></ul><ul><ul><ul><li>Behavioral </li></ul></ul></ul><ul><ul><ul><li>Facial muscles </li></ul></ul></ul><ul><ul><ul><li>Body gestures </li></ul></ul></ul><ul><ul><ul><li>Voice pitch </li></ul></ul></ul><ul><ul><ul><li>Choice of words </li></ul></ul></ul>
  8. 9. Source: Elsevier 2010 http://comminfo.rutgers.edu/~tefko/Courses/Zadar/Doctoral%20studies/Lopatovska%20emotions%20in%20LIS%20IPM%202011%20artcle%20in%20press.pdf
  9. 10. Voice and Choice of Words “Know Thy User” <ul><li>High or low pitch </li></ul><ul><li>Energetic or tired </li></ul><ul><li>Fast or slow </li></ul><ul><li>Pauses between words </li></ul><ul><li>Choice of words </li></ul>
  10. 11. Personality Types (Psychology) <ul><li>Openness to Experience : the tendency to be imaginative, independent, and interested in variety vs. practical, conforming, and interested in routine </li></ul><ul><li>Conscientiousness : the tendency to be organized, careful, and disciplined vs. disorganized, careless, and impulsive </li></ul><ul><li>Extraversion : the tendency to be sociable, fun-loving, and affectionate vs. retiring, somber, and reserved </li></ul><ul><li>Agreeableness : the tendency to be softhearted, trusting, and helpful vs. ruthless, suspicious, and uncooperative </li></ul><ul><li>Neuroticism : the tendency to be calm, secure, and self-satisfied vs. anxious, insecure, and self-pitying </li></ul>
  11. 12. Personality Types “Know Thy User” <ul><li>Type &quot;A” </li></ul><ul><ul><li>Is a highly independent and driven personality, typically representing the leaders in business </li></ul></ul><ul><li>Type &quot;B&quot; </li></ul><ul><ul><li>Represents highly extroverted people who love the spotlight </li></ul></ul><ul><li>Type &quot;C&quot; </li></ul><ul><ul><li>The antithesis of Type &quot;B&quot;; they are introverted detailists as represented by such people as accountants, programmers, and engineers </li></ul></ul><ul><li>Type &quot;D&quot; Personality </li></ul><ul><ul><li>Is best characterized as those people who resist any form of change and prefer the tedium of routine, such as in clerical assignments </li></ul></ul>
  12. 13. Type A <ul><li>Independent </li></ul><ul><li>Go-getters </li></ul><ul><li>Aggressive </li></ul><ul><li>Driven personality </li></ul><ul><li>Leaders in business </li></ul>
  13. 14. Type B <ul><li>Highly extroverted </li></ul><ul><li>Gregarious </li></ul><ul><li>Love the spotlight </li></ul><ul><li>Attractive </li></ul>
  14. 15. Type C <ul><li>The antithesis of Type &quot;B” </li></ul><ul><ul><li>Don’t like the spot light </li></ul></ul><ul><li>Introverted detailists </li></ul><ul><li>Accountants, </li></ul><ul><li>Programmers </li></ul><ul><li>Engineers </li></ul>
  15. 16. Type D <ul><li>Resist any form of change </li></ul><ul><li>Prefer the tedium of routine </li></ul><ul><li>Clerical assignments </li></ul>
  16. 18. Environment “Know Thy User” <ul><li>Familiar or unfamiliar location </li></ul><ul><li>At the Café next door or at a usability lab </li></ul><ul><li>Do you know the user personally? </li></ul>
  17. 19. Mood Swings “Know Thy User” <ul><li>Weather </li></ul><ul><ul><li>Sunny or rainy </li></ul></ul><ul><li>Time of the day </li></ul><ul><ul><li>Morning or evening </li></ul></ul><ul><li>Time of the week </li></ul><ul><ul><li>Monday or Friday </li></ul></ul>
  18. 20. Let’s Get Practical <ul><li>Informal User Study </li></ul><ul><ul><li>aka Guerilla testing, Dry run, and Hallway testing </li></ul></ul><ul><li>A quick and easy test </li></ul><ul><li>Should take no more than 15 min </li></ul>
  19. 21. Before User Study <ul><li>Roughly speaking… </li></ul><ul><ul><li>What is your objective? </li></ul></ul><ul><ul><li>What do you want to find out? </li></ul></ul><ul><ul><li>Who is your target audience? </li></ul></ul><ul><ul><li>Do you have paper or full-fledge prototype? </li></ul></ul>
  20. 22. During User Study <ul><li>It’s not you. It’s me! </li></ul><ul><ul><li>We are not testing the users but the app </li></ul></ul><ul><ul><li>We are here to create a better app. So, we need you! </li></ul></ul><ul><li>Reassuring the user </li></ul><ul><li>Make them feel ‘at ease’ </li></ul><ul><ul><li>‘ At ease’ does not mean comfortable but just relaxed enough to give good insights </li></ul></ul>
  21. 23. During User Study <ul><li>Listen - needs self-training </li></ul><ul><li>Observe - needs self-training </li></ul><ul><li>Have users talk aloud </li></ul><ul><li>Do NOT prompt users </li></ul><ul><li>Do NOT ask for design advise </li></ul><ul><li>Have fixed questions/objectives that you want to find answers to </li></ul>
  22. 24. Take Notes <ul><li>Tape recording </li></ul><ul><li>Take notes </li></ul>
  23. 25. Your Own Body Language <ul><li>Users can tell if you are very attached to your app </li></ul><ul><li>Be curious </li></ul><ul><ul><li>Show: I’m here to learn from you! </li></ul></ul><ul><li>Friendly ‘poker face’ </li></ul><ul><li>Show openness </li></ul>
  24. 26. ‘Safe’ Questions <ul><li>“ What do you think/believe this button means/does?” </li></ul><ul><li>“ Is this what you expected to see?” </li></ul><ul><li>“ If you were to click on this tab, what would you expect to happen? What would you expect to see?” </li></ul><ul><li>“ What do you think the app is trying to do/accomplish?” </li></ul><ul><li>“ Who do you think may find this app useful/beneficial/interesting/handy…?” </li></ul><ul><li>“ What is your overall feeling/understanding of this app?” </li></ul><ul><li>“ Where do you think this app would be used?” </li></ul><ul><li>“ At this point, what would you do?” </li></ul>
  25. 27. ‘Safe’ Questions <ul><li>“ Taking a quick look, what do you think this app is about? What do you think it does?” </li></ul><ul><li>“ What would be the first you’d do?” </li></ul><ul><li>“ Where would you go about exploring?” </li></ul><ul><li>“ What peeks your interest at this point?” </li></ul><ul><li>“ What is your overall feeling/understanding of this app?” </li></ul><ul><li>“ Any final comments you’d like to add?” </li></ul>
  26. 28. Pause <ul><li>Don’t be afraid to interrupt the user </li></ul><ul><li>Sometimes users go fast and all over the place </li></ul><ul><ul><li>Stop the user </li></ul></ul><ul><ul><li>So, let’s pause for a moment here </li></ul></ul><ul><ul><ul><li>What are you thinking? </li></ul></ul></ul><ul><ul><ul><li>How are you deciding your next steps? </li></ul></ul></ul><ul><ul><ul><li>What are you seeing? </li></ul></ul></ul>
  27. 29. After User Study <ul><li>Talk about your findings with </li></ul><ul><ul><li>People in your industry </li></ul></ul><ul><ul><li>People in other industries </li></ul></ul><ul><ul><li>Researchers, if you know any </li></ul></ul><ul><li>Draw possible conclusions </li></ul><ul><li>Work on your app </li></ul><ul><li>Decide if you need any follow-up refined studies </li></ul>
  28. 30. One Last Thing <ul><li>User study is NOT about testing a hypothesis </li></ul><ul><li>User study is about uncovering new things that you did not know before </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×