Quantifying UX The lab versus the real world
How did I end up here?
2003-2010         Tilburg UniversityDesign of Business Communication
2000-2010Design, communication, research, and consulting
2009-now           cc adactio
!"#$%&#"$!()%#*+,+!-
‘Plus-minus method for text evaluation’
+ -
</commercial>
eighties
Observing users.
Pen & paper
Stopwatch.
Nothing changed?
How do we observe behavior?
1995 Web ‘analytics’
2005 Google Analytics
2007 Clicktale, CrazyEgg, Kampyle
2009 Remote Usability Year
2009 UserTesting
2009 FeedbackArmy
2009 UserZoom
2009 OpenHallway
2009 Userfly
2009 OptimalSort
2009 ChalkMark
2009 Treejack
2009 Userlytics
2009 Loop11
2009 Websort
2009 Ethnio
2009 TrymyUI
2009 Usabilla
More?Great overview: http://remoteusability.com
Qualitative                          ConceptualConcrete           Quantitative
Qualitative             UserTesting               TryMyUI              Userlytics            OpenHallway                  ...
Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com
Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com
Behavior vs Attitude
Behavior vs Attitude
Behavior vs AttitudeSource: the narrow minded usability consultant.
Usabilityeffectiveness   efficiency
Usabilityeffectiveness     efficiency   satisfaction
behavior = objectiveeffectiveness          efficiency   satisfaction
behavior = objective        attitude = subjectiveeffectiveness          efficiency        satisfaction
User ExperienceFindable     Desirable          Accessible      Valuable            Credible                 Usable
User ExperienceFindable     Desirable          Accessible      Valuable            Credible                 Usable
‘self reported data’ hoaxSome background: http://www.creative-wisdom.com/teaching/WBI/memory.shtml
Soft data
Hard data
Behavior:             Conversion rates, task             performance, time onHardcore    task, bounce rate, error         ...
Attitude:          Satisfaction, ratings,          credibility, sentiment        analysis, feedback, trust,Shell       lik...
So, what’s next?
Booming.
Build your toolbox.
Mobile?
Commercial breakThe most touch friendly survey                                 !"#$%&#"$!()%#*+,+!-
Data.
Data.
Data.
Dashboards
Thanks for your attention!                 E-mail: paul@usabilla.com                 Twitter: @pveugen                 Web...
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Quantifying User Experience (UX)
Upcoming SlideShare
Loading in …5
×

Quantifying User Experience (UX)

3,470 views

Published on

Presentation about measuring the user experience and remote usability testing at UX Israel, December 21th 2010.

Published in: Design

Quantifying User Experience (UX)

  1. 1. Quantifying UX The lab versus the real world
  2. 2. How did I end up here?
  3. 3. 2003-2010 Tilburg UniversityDesign of Business Communication
  4. 4. 2000-2010Design, communication, research, and consulting
  5. 5. 2009-now cc adactio
  6. 6. !"#$%&#"$!()%#*+,+!-
  7. 7. ‘Plus-minus method for text evaluation’
  8. 8. + -
  9. 9. </commercial>
  10. 10. eighties
  11. 11. Observing users.
  12. 12. Pen & paper
  13. 13. Stopwatch.
  14. 14. Nothing changed?
  15. 15. How do we observe behavior?
  16. 16. 1995 Web ‘analytics’
  17. 17. 2005 Google Analytics
  18. 18. 2007 Clicktale, CrazyEgg, Kampyle
  19. 19. 2009 Remote Usability Year
  20. 20. 2009 UserTesting
  21. 21. 2009 FeedbackArmy
  22. 22. 2009 UserZoom
  23. 23. 2009 OpenHallway
  24. 24. 2009 Userfly
  25. 25. 2009 OptimalSort
  26. 26. 2009 ChalkMark
  27. 27. 2009 Treejack
  28. 28. 2009 Userlytics
  29. 29. 2009 Loop11
  30. 30. 2009 Websort
  31. 31. 2009 Ethnio
  32. 32. 2009 TrymyUI
  33. 33. 2009 Usabilla
  34. 34. More?Great overview: http://remoteusability.com
  35. 35. Qualitative ConceptualConcrete Quantitative
  36. 36. Qualitative UserTesting TryMyUI Userlytics OpenHallway ConceptualConcrete Kampyle Usabilla Loop11 Websort Userfly Treejack Optimalsort Chalkmark Clicktale CrazyEgg Google Analytics Quantitative
  37. 37. Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com
  38. 38. Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com
  39. 39. Behavior vs Attitude
  40. 40. Behavior vs Attitude
  41. 41. Behavior vs AttitudeSource: the narrow minded usability consultant.
  42. 42. Usabilityeffectiveness efficiency
  43. 43. Usabilityeffectiveness efficiency satisfaction
  44. 44. behavior = objectiveeffectiveness efficiency satisfaction
  45. 45. behavior = objective attitude = subjectiveeffectiveness efficiency satisfaction
  46. 46. User ExperienceFindable Desirable Accessible Valuable Credible Usable
  47. 47. User ExperienceFindable Desirable Accessible Valuable Credible Usable
  48. 48. ‘self reported data’ hoaxSome background: http://www.creative-wisdom.com/teaching/WBI/memory.shtml
  49. 49. Soft data
  50. 50. Hard data
  51. 51. Behavior: Conversion rates, task performance, time onHardcore task, bounce rate, error rates, click-through rate, shares, bookmarks, etc
  52. 52. Attitude: Satisfaction, ratings, credibility, sentiment analysis, feedback, trust,Shell like / dislike, etcSoft
  53. 53. So, what’s next?
  54. 54. Booming.
  55. 55. Build your toolbox.
  56. 56. Mobile?
  57. 57. Commercial breakThe most touch friendly survey !"#$%&#"$!()%#*+,+!-
  58. 58. Data.
  59. 59. Data.
  60. 60. Data.
  61. 61. Dashboards
  62. 62. Thanks for your attention! E-mail: paul@usabilla.com Twitter: @pveugen Website: usabilla.comPaul VeugenUsabilla.com !"#$%&#"$!()%#*+,+!-

×