Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Practical User Research - UA Conference 08


Published on

my slides for the recent User Assistance conference in Edinburgh

Published in: Technology, Business
  • i blocked you
    Are you sure you want to  Yes  No
    Your message goes here
  • Like the way you put qualitative at the heart of user research.
    Are you sure you want to  Yes  No
    Your message goes here
  • good
    Are you sure you want to  Yes  No
    Your message goes here

Practical User Research - UA Conference 08

  1. 1. practical user research how to do it. what to do with it. leisa reichelt | ua conference europe 2008
  2. 2. practical user research how to do it. what to do with it. leisa reichelt | ua conference europe 2008
  3. 3.
  4. 4. How to talk like a pirate: Startin' Rules • Double up on all your adjectives and you'll be bountifully bombastic with your phrasing. Pirates never speak of quot;a big shipquot;, they call it a quot;great, grand ship!quot; They never say never, they say quot;No nay ne'er!quot; • Drop all your quot;gquot;'s when you speak and you'll get words like quot;rowin'quot;, quot;sailin'quot; and quot;fightin'quot;. Dropping all of your quot;vquot;'s will get you words like quot;ne'erquot;, quot;e'erquot; and quot;o'erquot;. • Instead of saying quot;I amquot;, sailors say, quot;I bequot;. Instead of saying quot;You arequot;, sailors say, quot;You bequot;. Instead of saying, quot;They arequot;, sailors say, quot;They bequot;. Ne'er speak in anythin' but the present tense!
  5. 5. Hints & Tips • If it be helpin', start yer sentence wi' a quot;Arr, me hearty,quot; in a deep, throaty voice — ye'll find that the rest be comin' much easier.
  6. 6. Pirate Vocabulary • Ahoy: Hey! , Avast: Stop! Aye: Yes Aye, Aye!: I’ll get right on that • Grog: A pirate's favorite drink. • Lily-livered: faint o' heart • Loaded to the Gunwales (pron. gunnels): drunk • Matey: A shipmate or a friend. • Me hearty: a friend or shipmate. • Scallywag: A bad person. A scoundrel. • Scurvy dog!: a fine insult! • Shiver me timbers!: an exclamation of surprise, to be shouted most loud. • Squiffy: a buffoon • Swashbucklin': fightin' and carousin' on the high seas! • Thar: The opposite of quot;here.quot; • Walk the plank: this one be bloody obvious. • Yo-ho-ho: Pirate laughter
  7. 7. yo-ho-ho! shiver me timbers
  8. 8. i love this hotel :)
  9. 9. i love this hotel :) - six pillows! - an ironing board - a kettle for making tea ...
  10. 10. i love this hotel :) - the door card <insert picture!>
  11. 11. good user experience doesn’t have to be flashy
  12. 12. motorola razr
  13. 13. let them have user research!
  14. 14.
  15. 15. UA & UX UX = User Experience
  16. 16. why do user research?
  17. 17. supposing is good. finding out is better. - mark twain
  18. 18. 100x After Launch Cost of making changes 6x 1x During During Development Design r.s pressman, ‘software engineering, a practitioners approach’ mcgraw-hill
  19. 19. we tend to project our own rationalisations and beliefs onto the actions and beliefs of others - don norman, the design of everyday things
  20. 20. to design an easy-to-use interface, pay attention to what users do, not what they say. self reported claims are unreliable, as are user speculations about future behaviour - jakob nielsen
  21. 21.
  22. 22. user research helps you uncover, understand and design for real user requirements
  23. 23. do I really need to do it?
  24. 24. do I really need to do it? if: a) your end users are just like you and/or b) you’ve designed for these users before and know them well
  25. 25. do I really need to do it? if: you find yourself resorting to stereotypes and cliches (esp. involving your mother or grandmother), you need to research.
  26. 26. when in a project to do user research?
  27. 27. generative research prototype evaluative research
  28. 28. ways to do it
  29. 29. quantitative vs qualitative
  30. 30. quantitative vs qualitative Quantitative research is the systematic scientific investigation of quantitative properties and phenomena and their relationships. The objective of quantitative research is to develop and employ mathematical models, theories and/or hypotheses pertaining to natural phenomena. The process of measurement is central to quantitative research because it provides the fundamental connection between empirical observation and mathematical expression of quantitative relationships.
  31. 31. quantitative vs qualitative Qualitative research ...aim(s) to gather an in-depth understanding of human behavior and the reasons that govern human behavior. Qualitative research relies on reasons behind various aspects of behavior. Simply put, it investigates the why and how of decision making, not just what, where, and when.
  32. 32. quantitative vs qualitative mathematics and natural sciences statistically sound, scientific large random samples questionnaires, surveys, tests
  33. 33. quantitative vs qualitative social sciences insight gathering, exploratory small sample sizes participatory, observational, interviews, analysis of documents and materials.
  34. 34. quantitative & qualitative
  35. 35. qualitative for insight
  36. 36. speaking of ‘scientific’
  37. 37. speaking of ‘scientific’ don’t defend qualitative research ‘scientifically’ avoid using statistical terms or approaches actually... just stay away from numbers altogether!
  38. 38. In earlier research, Tom Landauer and I [Jakob Nielsen] showed that the number of usability problems found in a usability test with n users is: N(1-(1-L)n) where N is the total number of usability problems in the design and L is the proportion of usability problems discovered while testing a single user. The typical value of L is 31%, averaged across a large number of projects we studied. Plotting the curve for L=31% gives the following result:
  39. 39. The most striking truth of the curve is that zero users give zero insights.
  40. 40. ‘formal’ qual
  41. 41. lab based research
  42. 42. focus groups - care!
  43. 43. field research (ethnography)
  44. 44. ‘guerrilla’ qual
  45. 45.
  46. 46. new research tools
  47. 47.
  48. 48. (groups)
  49. 49. project opensource research & design
  50. 50. recruitment - aim for six participants per key user groups - BUT remember that one is better than none! - you can outsource this to qualitative research recruitment companies - or use your networks (I use Facebook, LinkedIn and Twitter a lot!)
  51. 51. test materials / prototypes
  52. 52. interview technique
  53. 53. interview technique > introduce the session (esp. inform and ask permission re: recording) > good rapport = good research (take time to make it clear you care about their opinion) > don’t tell them you’re the designer (they’ll not want to hurt your feelings, they want to please) > it’s not a test (if anything is being tested, it’s the design - NOT the participant) > only *their* opinion counts (we don’t care about what other people might think or do) > define your research questions > plan & practice the ‘script’
  54. 54. interview technique > start as wide as possible, narrow slowly > keep it contextual, not speculative > show, don’t tell (observation = good) (show me how you do that?) > uncover mental models (if you clicked there, what do you think would happen?) > ask OPEN questions (ask questions to get them talking NOT yes/no answers) > take care not to lead (you can have leading questions AND leading structures) > never leave them hanging (if they’re struggling, save them)
  55. 55. analysing research
  56. 56. research analysis (affinity sort)
  57. 57. solo analysis vs group analysis
  58. 58. presenting research
  59. 59. reports research reports
  60. 60. workshop findings
  61. 61. personas personas
  62. 62. Appearance - what it looks like and how it is arranged Usability Interaction - how the user interacts with the product components Information - the information required by the user at different stages User Structure Experience - the right elements in the right order Concept - the model for how the value is delivered Proposition - the value to the customer
  63. 63. just because nobody complains doesn’t mean all the parachutes are perfect - benny hill Library of Congress, Prints and Photographs Division,Washington, D.C. 20540 USA
  64. 64. thank you :) leisa reichelt |