Advertisement

User Experience Basics for Product Management

Product Manager at Royal Society of Chemistry
Jun. 22, 2017
Advertisement

More Related Content

Similar to User Experience Basics for Product Management(20)

Advertisement

User Experience Basics for Product Management

  1. Cambridge Product Management Network UX for product management – a basic intro Roger Hart (@RMH40) Thanks to our sponsors
  2. • Background • Why we should care • What UX is and isn't • User testing techniques • A few tips I’ve picked up I’ll try to cover: twitter.com/JoeNockles/status/874312073748107268
  3. We know it when we see it UX - WTF? https://www.reddit.com/r/ProgrammerHumor/comments/6f8ory/launch_a_90db_volume_slider_over_300_metres
  4. and we can’t unsee it
  5. (I met this guy) UX at Redgate
  6. We joked about building the “Do What I Mean” button
  7. (I read this book) http://amzn.to/2rUoPEn
  8. DOI: 10.1111/j.1467-9280.2008.02062.x
  9. Link all 9 dots using four straight lines or fewer, without lifting the pen and without tracing the same line more than once
  10. Easier?
  11. See also: Thinking, Fast and Slow: http://amzn.to/2st8dCa
  12. Product management http://www.mindtheproduct.com
  13. Using the affordances at your disposal to promote the outcomes you desire. UX for PdM:
  14. Dark Patterns Using your UX powers for evil WTF, Ryanair?
  15. “Onboarding” Initial user journey Removes barriers Makes things sticky Delights users
  16. Feels easy Intuitive Word of mouth
  17. Does all the things: • Usability • Workflow / interaction • Visual design • Service design • Information architecture • Business models? User EXperience
  18. “It's important to distinguish the total user experience from the user interface (UI), even though the UI is obviously an extremely important part of the design. As an example, consider a website with movie reviews. Even if the UI for finding a film is perfect, the UX will be poor for a user who wants information about a small independent release if the underlying database only contains movies from the major studios.” UX ≠ UI Jakob Nielsen & Don Norman (famous tech grown-ups)
  19. But UI is an enormous part of the story UX ≠ UI
  20. But usability gives you the biggest bang for your buck. UX ≠ Usability
  21. It’s not clean. It’s not tidy. It’s not sexy. It’s one of the most successful businesses on the planet.
  22. Learnability: How easy is it for users to accomplish basic tasks the first time they encounter the design? Efficiency: Once users have learned the design, how quickly can they perform tasks? Memorability: When users return to the design after a period of not using it, how easily can they reestablish proficiency? Errors: How many errors do users make, how severe are these errors, and how easily can they recover from the errors? Satisfaction: How pleasant is it to use the design? Usability (Again, from Jakob Nielsen)
  23. Can you understand it quickly the first time you see it, and use it do what you need to do? Or…
  24. Some UX is obvious Some requires research
  25. Or: “Expert review” …or “Ssshh. We know best” Apply your own expertise. Score on agreed set of heuristics. Use with early. Use with caution. Technique: “Heuristic evaluation” Nielsen’s 10 heuristics (from 1995, the world might’ve changed a bit)
  26. Which has better UX? (Example shamelessly nicked from David Travis @ UserFocus)
  27. Personas vs Jobs To Be Done Persona • Humanizes • Takes time • Useful for marketing • Captures emotional element • Not super actionable • Easy to be really superficial JTBD • Closer to functionality • Tempting to assert without research • Easy to prioritise • Can reveal surprising things about value (see: https://jtbd.info/get-started/home)
  28. Research techniques Quantitative: • Web analytics • Surveys & polls • Heatmaps • NPS • A/B testing Qualitative: • User tests • Interviews • Focus groups • Contextual / task analysis • Card sorting • Search queries / AdWords • Forums & feedback • (heuristic evaluation)
  29. What to do when? Quantitative: • Later • Validation (some discovery) • Answer specific questions • Ongoing checks • Effects of small changes Qualitative: • Early • Discover broad problems • Understand users • Redesigns & large changes
  30. Problems Quantitative: • Ambiguity & clarity • Sample size • (tech dependencies) Qualitative: • Everybody lies • Selection bias • (can be expensive)
  31. Beware pure quantitative
  32. Needs, not wants. something something faster horses something something.
  33. A simple overview User testing
  34. You don’t need a fancy-ass lab: • Skype and a screen recorder (Morae, Camtasia, Chrome plugins, Win10 ‘Game Bar’) • In a café, filmed on a phone • Paper prototypes • Use colleagues (esp. new starters) User testing – making it easy
  35. 1) Plan realistic scenarios 2) Recruit representative participants 3) Run tests: • Set user expectations • Give an intro and guide • Ask for ongoing feedback • Keep them talking but be willing to let them fail User testing – how-to Actually the hardest part
  36. Interpreting user tests Simple / cheap: • Take loads of notes • Time on task • Quick survey • Retrospective sessions Complex / expensive: • Eye tracking • System Usability Scale (SUS) Feels appealingly sciencey
  37. How many? About 7
  38. Cheap, quick, quite easy. False positives, unrealistic. Paper prototyping?
  39. What type of test: • Exploratory Use early. Gauge understanding. Open. High interaction. • Assessment / validation Use later. Test specific designs and paths. More tightly scoped. May have benchmarks. • Comparison Use any time. Evaluate two options. Run multiple tests. Could even test competitors. User testing: test design
  40. Basically, be kind. But don’t always help them if they’re stuck. And maybe team up. User testing: moderation
  41. Good feedback, thanks. Mmm. Hm. What did you expect to see? What do you think will happen? Is that what you expected? I see you’re hesitating a bit… User testing: weasel words Try not to say “yes” or answer questions. Don’t talk over them. In fact, don’t talk much. www.userfocus.co.uk/articles/listening.html
  42. We’re going to book some teacher training! (and I need a volunteer) Exercise: running a user test
  43. You are a teacher who has heard that the RSC offers some training and professional development resources. You have a little bit of time available for online training, and want to improve your knowledge of organic chemistry for a forthcoming class. Using the web as you would at home, find out what the RSC has to offer and whether it would help you. Scenario #1 – finding out
  44. On a scale of 1 – 5 how confident are you that you completed that task successfully? On a scale of 1 – 5 how easy did you find that task? Quick survey
  45. What did we learn? Themes? Main problems? Any scoring? Feedback
  46. JTBD interviews A bit weird – emotion, history, specificity Where were you when… ? How did you feel about…? What were you doing, or trying to do when this happened? Did you have any anxiety about the purchase? Did you hear something about the product that made you nervous? What was it? Why did it make you nervous? Getting to a very specific (sometimes emotional) story
  47. • Qualitative keeps you honest • Don’t fold my iPad • Nobody wants to read, everybody has to read, Google reads everything • Your underpants go on the outside • Your brain wants to be lazy A few simple things I’ve learned
  48. Getting some help Local(ish) folks I’ve worked with. Others are available
  49. @RMH40 HartR@rsc.org
  50. The Design of Everyday Things – Don Norman Don’t Make Me Think – Steve Krug The Inmates are Running the Asylum – Alan Cooper The Mom Test – Rob Fitzpatrick Dealing with Darwin – Geoffrey Moore The Innovator’s Dilemma – Clayton Christensen UserFocus blog – David Travis Building the Minimum Badass User (video) – Kathy Sierra Intro to the Kano Model – PWC blog Building a Princess Saving App (pdf) – Daniel Cook www.uxmyths.com - List of common misconceptions Design for Real Life - Eric Meyer & Sara Wachter-Boettcher www.useronboard.com – Onboarding journey blog Further reading If you don’t have much time

Editor's Notes

  1. Steve jones at infinite monkey thing Confidence of a mediocre white man Gauge awareness. Ask who’s done what?
  2. Bit of career history & background.
  3. 1950s. Henry Dreyfuss, “Designing for People” Ergonomics. HCI in the 1970s (Xerox, Apple, IBM) Maturity in 1990s, via IT, as Don Norman leads the charge I like to point at 1998 – first Ajax support from MS OWA team (XMLHTTPRequest API), the avalanche pebble of rich web apps. No more full-page refresh. Design responds to its landscape. The browser explosion helped. 1999 – Google’s minimalist homepage. Step change in 2007 with the iPhone? Maturity of web apps. Frustration. Warning. If you don’t already know about UX, it will ruin you forever.
  4. If you would prefer not to spend the entire rest of your life angry at door handles, try to forget everything you have ever heard about UX.
  5. It’s all around us. Once you notice, you never stop. Makes people cross, adds friction. Often inconsiderate. Hanlon’s razor. Bad UX is often well intentioned. Comes from “Nerdview” – inability to see the world in a user or novice’s terms. Curse of knowledge. Constructing a world for you and your knowledge. Not far off privilege? You see it with text so very often. UI writing. Intro to UX at Redgate…
  6. Dom, are you here? UX embedded in dev teams. Ambient user testing. Whole team involved. UX drove early product decisions. Collaborative fight with product managers. UX fighting for he user, humanizing.
  7. RG took complex things and tried to make them “ingeniously simple” Next, next, done for your business problems. That depends on smart tech and usable UI But for complex products and problem spaces, that means delivering and *simplifying* complex information.
  8. Starting as graduate tech author, I looked for a theoretical core to my discipline. Found it in HCI, and how reading/understanding work. Took an interest in the underpinning cognitive neuroscience. Quite old now. Originally 1996 How reading works. Mental schema. What it means for something to be easy or hard to do. Human factors for Technical Communicators, Marlana Coe - http://amzn.to/2rUoPEn
  9. Explain the Daniel Khaneman idea of two mental systems (Thinking, fast and Slow: http://amzn.to/2st8dCa ) Effort engages System2. System 2 is aversive and critical. If you want someone to do something, avoid S2 If you want someone to engage with something, engage S2 without aversive feelings Small design changes. Caveat: if all other things are equal. Psych reproducibility crisis. Subway distance experiments.
  10. Give a minute to think about it. Going to make a short change. Don’t worry if you didn’t get it (of course some things are hard. That’s fun. King example. Princess saving)
  11. What we did there, was make some design changes to suggest a path. It’s a terrible example. We designed some UI to help people use the product.
  12. Product mgmt, also the 90s (CEO of product quote, Ben Horrowitz 1997) Some, but not loads. Why does it matter? Pragmatic marketing grid. PdM  PMM. UX is similar.
  13. The way I like to think about it. …But there are caveats. This sounds a bit like manipulation? Nudging people, sending them down the happy paths to unlocking product value. Can you use your powers for evil.
  14. Well, sometimes it’s evil. Can be deliberate. Can also be hella lucrative. That’s between you and your conscience, I guess.
  15. Can be delightful. Ask for examples. What made it delightful?
  16. Feels a bit intangible. You know it when you see it So what is it?
  17. …and they call economics the imperial science You can’t do it all. It takes a village to UX a product… I’m going to concentrate on a few bits. Starting with some misconceptions and confusions.
  18. Not photoshop. Not UI design. Not that bloody story about Google optimising a shade of blue. But UI is very important. It is how your UX is delivered. The $300M button (check out without creating an account)
  19. Where the delighters can live. Think: Apple, Slack, Deliveroo, New Relic Kano model Reaction to types of product functionality Industrial design 1984 (Toyota?) 1-D – linear, simple performance features Basics never enough. Usability as table stakes. Delighters become normalised (iPhone) progressive. Might recognise this from the category model, product becomes category, etc.
  20. I am not a designer. Usability was a huge thing at my last place. Usability is where it all started. Differentiator for years, until the market caught up It’s commodity now. Simple UX is table stake for web apps. But usability is still my go to focus. The low hanging fruit.
  21. It’s usable. Ish. Learnable, mostly. And so good at happy paths. Ask why it works.
  22. Similar to the Daniel Pink stuff around what motivates people? Enabling autonomy, mastery, purpose? Kathy Sierra? Good products make you better.
  23. Usability is the soul of onboarding Onboarding is phenomenally important for uptake (King example – perversely weeding out users who wouldn't get value, and maximising value for those who would. Sometimes this shit surprises you)
  24. Fancy way of saying that we find the low hanging fruit. We’re going to try one. Most of us drink hot drinks. Most of us have used software. Most of us understand basic UX. FROM NIELSEN Visibility of system status The system should always keep users informed about what is going on, through appropriate feedback within reasonable time. Match between system and the real world The system should speak the users' language, with words, phrases and concepts familiar to the user, rather than system-oriented terms. Follow real-world conventions, making information appear in a natural and logical order. User control and freedom Users often choose system functions by mistake and will need a clearly marked "emergency exit" to leave the unwanted state without having to go through an extended dialogue. Support undo and redo. Consistency and standards Users should not have to wonder whether different words, situations, or actions mean the same thing. Follow platform conventions. Error prevention Even better than good error messages is a careful design which prevents a problem from occurring in the first place. Either eliminate error-prone conditions or check for them and present users with a confirmation option before they commit to the action. (Read full article on preventing user errors.) Recognition rather than recall Minimize the user's memory load by making objects, actions, and options visible. The user should not have to remember information from one part of the dialogue to another. Instructions for use of the system should be visible or easily retrievable whenever appropriate. (Read full article on recognition vs. recall in UX.) Flexibility and efficiency of use Accelerators -- unseen by the novice user -- may often speed up the interaction for the expert user such that the system can cater to both inexperienced and experienced users. Allow users to tailor frequent actions. Aesthetic and minimalist design Dialogues should not contain information which is irrelevant or rarely needed. Every extra unit of information in a dialogue competes with the relevant units of information and diminishes their relative visibility. Help users recognize, diagnose, and recover from errors Error messages should be expressed in plain language (no codes), precisely indicate the problem, and constructively suggest a solution. Help and documentation Even though it is better if the system can be used without documentation, it may be necessary to provide help and documentation. Any such information should be easy to search, focused on the user's task, list concrete steps to be carried out, and not be too large.
  25. Consider visual design, ease of understanding, error recognition, user control, etc. Which is better? Now let’s flip the context. A small café? A larger one? Camping? An older user? A grudging parasitic student landlord? A 15 year old doing D of E… and trying to look cool. Brings us to personas vs JTBD
  26. Personas humanize, JTBD get to the core of use cases. I’ve usually found you start with lots of both, and for non-huge products, end up with a few core JTBD and a couple of core personas.
  27. Who’s run each of these? Don’t do heuristic, it’s basically “daddy knows best” I’ve always skewed qualitative. VERY SIMILAR TO PdM Explain each. What’s hard about each one. Tips. We’re going to focus on user testing. Interview methodologies if there’s time.
  28. Suck eggs…
  29. Mom Test. Being nice, finding things to say. Spurious correlations. One think to keep in mind. Needs, not wants.
  30. Vince Darley, talking at BoS2017 Ocado – 3 employees, way off the chart with crate damage. Supervisors. Late crates only. Scanned in. “Gravity conveyor”. Contextual enquiry found this. At king. Made early game harder. Test cohort. 2nd day retention tanked after days. Recovered in 7 days. 14 days 10% lead, for those remaining. Lifetime value Harder start. 419 – filter fast. Loss rate over time. Keep on hook. Quant data shows patterns. Qual data gives context. But beware direct questions.
  31. …unless it tests well in the market. NB – problem with faster horses bullshit and not talking to customers. We don’t just listen to what people say. We watch what they do. How they react. We care about how they feel. The turkey twizlers story. So we enquire. We do user testing.
  32. Win+G, dumps to screenshot folder if hardware supports. UX is hokey because it’s designed for YouTube kids.
  33. https://measuringu.com/sus/
  34. Bulllshit graph Study after study suggests small-N qualitative hits the spot. Jared Spool got different numbers, there’s a variance. 5-10 should work.
  35. Fun though. Google design sprints. Load sof alternatives.
  36. Why are we testing? What do we want to know?
  37. Not testing you. Someone to take notes. Consent. Comfort. Tips: How would you expect… Give an example.
  38. Super awkward. Active listening. http://www.userfocus.co.uk/articles/listening.html
  39. Volunteers? Start at Google.com
  40. This is what’s called an exploratory test. It’s very open, and could go off track. Has a defined end, but many paths. Very qualitative.
  41. What to do if people get stuck? Have a fail back position.
  42. UserFocus (David Travis) UX Doctor (Dom Reed) Modern Human (Paul)
  43. http://uxmyths.com/ 
Advertisement