Quantifying UX
 The lab versus the real world
How did I end up here?
2003-2010
         Tilburg University
Design of Business Communication
2000-2010
Design, communication, research, and consulting
2009-now




           cc adactio
!"#$%&#"'$!()%#*+,+!-
‘Plus-minus method for text evaluation’
+ -
</commercial>
eighties
Observing users.
Pen & paper
Stopwatch.
Nothing changed?
How do we observe behavior?
1995 Web ‘analytics’
2005 Google Analytics
2007 Clicktale, CrazyEgg, Kampyle
2009 Remote Usability Year
2009 UserTesting
2009 FeedbackArmy
2009 UserZoom
2009 OpenHallway
2009 Userfly
2009 OptimalSort
2009 ChalkMark
2009 Treejack
2009 Userlytics
2009 Loop11
2009 Websort
2009 Ethnio
2009 TrymyUI
2009 Usabilla
More?


Great overview: http://remoteusability.com
Qualitative




                          Conceptual
Concrete




           Quantitative
Qualitative
             UserTesting
               TryMyUI
              Userlytics
            OpenHallway




                                                                     Conceptual
Concrete




              Kampyle         Usabilla




               Loop11
                                                        Websort

               Userfly                                   Treejack

                                                       Optimalsort
                                          Chalkmark
              Clicktale
              CrazyEgg
           Google Analytics

                                     Quantitative
Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com
Source: Nate Bolt, Bolt | Peters / Ethnio - http://boltpeters.com
Behavior vs Attitude
Behavior vs Attitude
Behavior vs Attitude




Source: the narrow minded usability consultant.
Usability



effectiveness   efficiency
Usability



effectiveness     efficiency   satisfaction
behavior = objective




effectiveness          efficiency   satisfaction
behavior = objective        attitude = subjective




effectiveness          efficiency        satisfaction
User Experience

Findable     Desirable          Accessible




      Valuable            Credible




                 Usable
User Experience

Findable     Desirable          Accessible




      Valuable            Credible




                 Usable
‘self reported data’ hoax



Some background: http://www.creative-wisdom.com/teaching/WBI/memory.shtml
Soft data
Hard data
Behavior:
             Conversion rates, task
             performance, time on
Hardcore    task, bounce rate, error
           rates, click-through rate,
            shares, bookmarks, etc
Attitude:
          Satisfaction, ratings,
          credibility, sentiment
        analysis, feedback, trust,
Shell       like / dislike, etc




Soft
So, what’s next?
Booming.
Build your toolbox.
Mobile?
Commercial break




The most touch friendly survey
                                 !"#$%&#"'$!()%#*+,+!-
Data.
Data.
Data.
Dashboards
Thanks for your attention!

                 E-mail: paul@usabilla.com
                 Twitter: @pveugen
                 Website: usabilla.com
Paul Veugen
Usabilla.com




               !"#$%&#"'$!()%#*+,+!-

Quantifying User Experience (UX)