User Testing: Losing Weight (UX Cocktail Hour)


Published on

My presentation for the UX Cocktail Hour in Amsterdam, May 31th. A short introduction about Usabilla and how you can embed user testing in your design process without slowing down.

Published in: Design, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

  • I'm not going to bore you only with a product pitch for Usabilla. Why not? Because I don't only try to sell you one of our big paid plans, but also at least a dozen of my competitors as well.
  • In the past 2 years quite some usability services popped up. Usabilla is one of those services. These services are quite different and all take their own approach, but on one point they are the same. They claim to make usability easier.

    Let me start off with a short introduction and definitions, to ensure that we all talk about the same thing.
  • In most cases when we're talking about usability we don't really mean usability. We’re talking about User Experience instead. And that's probably the smartest way to present usability .... or user experience.
  • Because when we would start about user experience or UX most of the people around us, especially in Holland, who just got used to this buzz usability thing, probably wouldn't have a clue what we're talking about.
    So while we stick to the word ‘usability’, we often broaden our scope to UX.

  • So what’s User Experience?
    A very bright mind, mister Peter Morville, created a smart diagram for UX, containing 7 elements of user experience.

    In a creative mood, a few years ago, I adapted Peter Morville’s UX Honeycomb a bit and put my own (and of course Peter's name under it).

  • User Experience consists of 6 elements. At least my diagram does ... ;)
  • Three intrinsic values and three extrinsic values.
  • Three intrinsic values and three extrinsic values. The intrinsic values - valuable, credible, and desirable - are about attitude or feelings. It's about how a user perceives, or thinks & feels about your website... or concept.
  • The extrinsic values in this user experience diagram are technical. Or in other words, more focused on your product.

    Findability, Accessibility, and of course Usability, are all three about how well your user performs while interacting with your product. Let's turn that around: how well your product performs in relation to your user. 
  • These definitions are not that important.
    Basically we're just interested in one thing. And that’s how our products fit our users. And how we can improve this by involving users.
  • User Centered Design, Human Centered Design, Participatory Design, Contextual Design or whatever belief you preach is definitely not new.  
  •  Since 1970 a variety of different movements labelled their newly designed design processes as 'user centric' in some way and underlined the importance of the involvement of the end user in the design process. 
  • If you'd like, you could probably spent the rest of the year reading scientific publications on the topic of "User Centered Design" alone. 

  • Back to the real world. 
    Let’s meet Mister X.
  • Mister X is just an ordinary marketing, design or business development super hero.
    Mister X also knows about User Centered Design, and as he states himself: "usability saved his life... more than once". Mister X really cares about his user, that’s why he convinced his team, and his self, to make a true master plan for user testing. Next year. A full week of lab tests to listen to their users. For just once....
  • Right. 
  • Let's paraphrase this a bit and then read it again.
  • Mister X might have some budget at the end of their well planned full redesign. If it might run on schedule. They could run some usability studies when their new redesign has been launched or, if he's lucky, in the last week just before they launch their final product. 
    But at the end, it doesn't really matter. Because they already know this must the best they ever built because they did everything different than in their previous version.

  • So. Let forgive Mr X. We can't really be mad about this nonsense, can we. Because this is our fault.
  • We made usability testing this incredibly important. 
  • We not only made it very important.
    But time consuming as well. 
  • Not to forget expensive. 
  • Not just a bit expensive. Let’s say just really expensive.
  • And difficult too. Because that’s why they need us.
  • We made usability testing a really *big* fat basterd. 

    So how can we make this little big man a bit smaller? And more attractive... at least, according Western standard.
    That’s where our diet kicks in.

  • I promise this is the only slide containing these kind of pictures. Sorry.
  • Diet user testing just about the same as a healthy food diet. Which is about changing habits and making these changes as simple and fun as possible. 
  • A healthy food diet is about eating the right food, regularity, and some mental support from the people around you. 
  • Your healthy user centered design diet is just about the same. Using the right tools, focus on some sort of regularity in your tests, and gain mental support from the people around you.
  • So what about the right tools. Eating the right food is for many people probably the most difficult part of dieting. Picking the right tools for testing is probably less complex. Just dive in and try.
  • The right tools are fresh, diverse, and we only take small bites. 
  • So what about variation in your diet....
  • Create your own toolbox. Some tools or data sources might be already available, others need some trial and error. Don't search for the holy grail of usability testing, the master corporate suite that fits all your needs. It simply doesn't exist. Not now, and not in the future. Focus on interesting specific tools that fit your needs. There's no such thing as THE usability tool. Yup, *even* Usabilla isn't the holy grail. 

  • I could speak the rest of this evening and night about awesome tools that can help you to involve users, test findability, set up user experience tests, test mockups, or anything else your want to know about your users. Take a look at for more inspiration.
    Feel free to ask me later this evening, I'd love to share my personal favorites.
  • Keep your portions small.
  • This big big cake might be nice to look at, but don't try to eat the entire cake at once. It probably will not make you feel any better.
  • Focus on small steps instead. Test small scenario's and just a few tasks at once.
  • Zoom in on specific tasks and specific parts of the user experience. Don't forget to zoom out every now and then. 
  • Test data has a very limited expiration date. Not only because we try to develop at a high pace, but we also tend to forget extremely quick.
  • Big written reports of 50 pages probably only matter really matter if they're part of your business model and hype machine and if trying to sell your reports, books... and consultancy services.
    For the rest of us it's probably more effective to focus on fresh and interesting small data sets. 

  • What happened the past week? 
  • How can we get from data to new release as quickly as possible? The easier we make data collecting and interpreting results, the faster we can iterate and start all over again. Keep it fresh and simple. 
  • So let's get back to our diet. Our next step in a schematic approach to a healthier lifestyle focuses on regularity. 
  • Try to create habits. It might be interesting to take a look at agile or scrum approaches to development. These methods could be inspiring to get more regularity in your testing practices. And you might even make some new friends with development.
    I don't ask everyone to spent just half an hour a week testing, because especially the consultants won’t make a full month salary in just 2 hours a month.
    But cutting up projects in smaller steps and trying the embed a certain repeat might be interesting for all of you. Smaller steps make it easier to make web optimizing a recurring business. 
  • One final thing before we take lot’s of small bites and regular drinks is 'support'.
    Try to involve the people around you and gain their support.
  • If your client, development team, designers, employer, secretary, or mom can act as cheerleaders it way easier and definitely more fun to slim down and kickstart a more healthier lifestyle.
  • Thanks a lot for your attention.
    Follow me on Twitter (@pveugen) or mail me if you got any questions.
  • User Testing: Losing Weight (UX Cocktail Hour)

    1. 1. !"#$%&#"'$!()%#*+,+!-
    2. 2. user testing on a diet.
    3. 3. user testing on a diet. it’s all about losing weight.
    4. 4. usabilla?
    5. 5. Past Now Future Traffic analysis Google Analytics, Omniture, Nedstat, etc What do visitors do?
    6. 6. Past Now Future Traffic User analysis analysis Google Analytics, Usabilla Omniture, Nedstat, etc Why do users what they do?
    7. 7. Set up a usability test in 2 minutes
    8. 8. Participants share their opinion with points & notes
    9. 9. Visual results from 25 - 1000 participants
    10. 10. !"#$$%&'% -(%!#(%( ()*%+#, ,#,%31,3.*.*6,% 4)3%53#+% +.!/-, !$)!/#0$%12%+. ,3.2-!* Test in any stage of the design process
    11. 11. Recent Buzz
    12. 12. Recent Buzz
    13. 13. 4700 users May 2010
    14. 14. Some of our clients
    15. 15. Traffic
    16. 16. </commercial>
    17. 17. user testing on a diet. it’s all about losing weight.
    18. 18. usability
    19. 19. user experience
    20. 20. Peter Morville’s UX Honeycomb
    21. 21. 6 elements of ux.
    22. 22. user experience Findable Desirable Accessible Valuable Credible Usable Based on Peter Morville’s UX Honeycomb
    23. 23. user experience Desirable Valuable Credible Based on Peter Morville’s UX Honeycomb
    24. 24. user experience Findable Accessible Usable Based on Peter Morville’s UX Honeycomb
    25. 25. Involving users.
    26. 26. Analysis Design Evaluation Implementation 1 2 3 4
    27. 27. “We’re going to test our website. We planned a full week of lab tests to find all usability issues of our new redesign.” Mr. X
    28. 28. Sure...
    29. 29. “We’re going to test our website. We planned a full week of lab tests to find all usability issues of our new redesign.” Mr. X
    30. 30. “We might be able to find some time (and budget) next year to test our recently launched website. Probably not. ” “And if we do, we already spent way too much on our new redesign (which is, by the way, the best thing we ever built)” Mr. X
    31. 31. ...
    32. 32. CC: Original picture by alancleaver
    33. 33. Important.
    34. 34. Time consuming. CC: Original picture by 96dpi
    35. 35. $ Expensive.
    36. 36. $ Expensive.
    37. 37. And difficult too. CC: Original picture by kamleshmehta
    38. 38. CC: Original picture by MrFink
    39. 39. diet testing.
    40. 40. right foods, regularity, & support.
    41. 41. right tools, regularity, & support.
    42. 42. right tools, regularity, & support.
    43. 43. variation, small bites, fresh
    44. 44. variation, small bites, fresh
    45. 45. Variation in tools
    46. 46. Variation in tools
    47. 47. variation, small bites, fresh
    48. 48. CC: Original picture by bunchofpants
    49. 49. variation, small bites, fresh
    50. 50. Fresh data
    51. 51. Fresh data
    52. 52. right tools, regularity, & support.
    53. 53. CC: Original picture by kristin-and-adam
    54. 54. right tools, regularity, & support.
    55. 55. CC: Original picture by nathaninsandiego
    56. 56. Check out and Follow us on Twitter @usabilla