Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Pre-Conference Course: UX and Agile: Making a Great Experience -

1,117 views

Published on

In this tutorial for experienced practitioners you will learn how to manage work and make great experiences one sprint at a time. We'll look at common Agile methodologies such as Scrum and Kanban and what opportunities and risks are inherent for UX teams. We will look at team makeup, balancing longer-term research with production needs and strategies for making the most of design spikes. We'll also go through the pros and cons of a Sprint Zero and alternatives. Participants will come away with the tools they need to be successful in their Agile environment

Published in: Design
  • Be the first to comment

Pre-Conference Course: UX and Agile: Making a Great Experience -

  1. 1. UX and Agile: Making a Great Experience UXPA, June 22, 2015, Coronado, California
  2. 2. Introductions • Thyra • John • Carol
  3. 3. Review of Agile and Language Used
  4. 4. Agile History • February 2001:The Agile Manifesto written at Snowbird Ski Resort in Utah • Authors:14 male software engineers • Agile, as originally conceived, understood nothing of UCD or UX processes
  5. 5. Agile Manifesto (abbreviated) • Uncovering better ways of developing software… • Through this work we have come to value: • Individuals and interactions over processes and tools • Working software over comprehensive documentation • Customer collaboration over contract negotiation • Responding to change over following a plan There is value in the items on the right, we value the items on the left more. http://agilemanifesto.org/
  6. 6. Agile Qualities • Iterative • Incremental • Continuous • Collaborative • Transparent
  7. 7. Agile Frustrations Scaling Agile at Spotify via Slideshare of Vlad Mysla http://www.slideshare.net/vmysla/scrum-at-spotify?qid=2345c3ad-7e68-4383-9673-9e715ff47a75&v=default&b=&from_search=14
  8. 8. Agile • Agile is a philosophy, not a specific set of tools • Scrum, Kanban, XP, etc. are software development methods that meet the criteria for Agile – “Waterfall” does not. • 12 Principles are not mandates UX is not deliberately excluded Can work to make a good fit
  9. 9. We Come from Different Places By Jeff Patton as interpreted by Jim Laing – Source: http://www.agileproductdesign.com/blog/user_experience_relevance.html
  10. 10. Agile vs.Waterfall
  11. 11. mountaingoatsoftware.com
  12. 12. Agile UX:The Good • Contextual inquiry & usability testing on actual product • User data has effect on current release • Satisfying to see designs in real use • Enables requirements iteration • Issues get fixed • “Done” includes design • Most important features are done first
  13. 13. Agile UX:The Good (continued) • Less “design drift” • Less wasted design • Working together (face-to-face) is better than “over the wall” • Keep up with technology and environmental changes
  14. 14. UX Must Adapt or Risk Exclusion • Don’t be selfish • Distribute the work • Agile is reactive – no time for predictive work • Prepare to react • Falling short of end goals is a constant • Empower teams to meet user’s primary needs • Constant Improvement is key Jim Laing at UX Pittsburgh, May 2014
  15. 15. “Story”
  16. 16. Story Myths • Story = feature • Story = specification • Story must fit in one iteration • Stories are time limited • All stories have firm estimates and specs in Iteration Zero (or even Iteration One) • These are NOT true.
  17. 17. “Story” = User Problem with acceptance criteria
  18. 18. Story Examples Advantages of the “As a user, I want” user story template. By Mike Cohn http://www.mountaingoatsoftware.com/blog/a dvantages-of-the-as-a-user-i-want-user- story-template
  19. 19. “Customer”
  20. 20. Customer Feedback – in Traditional Agile • “Customers” give feedback at the end of each iteration/sprint, after seeing a demo by a product owner or engineer (“User AcceptanceTesting”) • Not typically a member of the Agile team (good!) • Rarely the users the system is being designed for (ugh!)
  21. 21. Customer Feedback – in Traditional Agile • Fails to find most learnability and usability issues • Misses opportunity to inform future design • Misses opportunity to gain better user insight through observation
  22. 22. Bring Users into Agile • UX brings the end-user into Agile and expands the meaning of “Customer” to extend to the end-user
  23. 23. Getting Agile Teams to Care About Usability Your Place at theTable
  24. 24. So Now What? • If Agile doesn’t care about UX, why should my Agile team care about what I do?
  25. 25. Getting Developers to Care • UX Fail strategies: • “I’m just going to keep doing my job the way I always have and telling the team what they need to do.” • “I’m just going to let them go ahead and fail. Then they’ll come to me begging and let me do my job.”
  26. 26. Be Part of theTeam • They’re not going to “stop the train” for you • Make UX processes Agile • Build trust by providing tangible proof of the value of your work • Attend daily standups/scrums
  27. 27. Get Ahead of theTrain • Always design one iteration ahead, so you have designs ready to go when they are needed • Regular usability testing (iteration-aligned) • Test whatever is ready that day • Plus your look-ahead designs • Plus user research for existing issues and potential future work • Test designs before developers build them – saves arguments
  28. 28. Welcome the Team to yourWorld • Invite developers to observe tests of features they wrote • Seeing someone struggle is strongly motivating to them • Even more so for product managers • Engage developers in helping you to figure out solutions • Their knowledge of code and systems provides ability to come up with innovative solutions • Credit developers when features they wrote work well (even if you designed it)
  29. 29. BringYourWorld toThem • No time or inclination to watch your testing? • Record the tests • Bring key clips to the next meeting(s) • Provide easy access to sessions (always consider ethics) • Share information – information radiators • Put it on the walls • Use online tools • Get it in the backlog
  30. 30. Fit into the Process • Time your testing so that results are in when it will be most useful to your team • Track usability metrics on the team dashboard • Ensure they are reported upwards • Help prioritize usability problems to simplify backlog grooming • Have preemptive cards added to the schedule for “problems we will find while testing”
  31. 31. Participate in Retrospectives • Encourage retrospectives if they aren’t happening • Great learning experience for all • Was what you provided the team enough/too much? • What questions still open? • Still confusing/frustrating? • More effectively communicate user needs in a just-in-time situation? Image: http://intland.com/blog/project-management-en/tips-and-tricks-to-make-the- most-of-your-retrospectives/
  32. 32. Let’s Get to Know Each Other • Who has had agile training? • Reading, no formal training • Other team members trained • No training • Some training • How long have you been doing Agile?
  33. 33. Who’s Here? • Roles? • UX practitioner, UX manager -- is this who we all are? • Resources? • Single UX resource on a single Agile team/project • Single UX resource on 2+ Agile teams/projects • Part of a UX team on a single Agile team/project • Part of a UX team on 2+ Agile teams/projects
  34. 34. What’sYourTeam Like? • Distributed/remote? • Large/small? • Who else is on the team? • How long have you been together?
  35. 35. BalancingTeamWork • Within UX team • Research • Wires/clickable prototypes • Usability testing preparation • Usability test facilitation • UX Issue wrangling • Visual design • What else? • Split team up on different items or attack together
  36. 36. Marketing, Sales and Business Analysts • Have customer access • Knowledge • Business rules • Usage patterns, what other tools customer has • Can support • Research (users/stakeholders) • Wires • Demos/Clickable prototypes
  37. 37. Developers and UX • Trust is key • FED (front end developers) and UI Developers • Can provide • Clickable prototypes • Coded “prototypes”
  38. 38. product owner = product manager + dev lead + interaction designer
  39. 39. Scaling Agile at Spotify via Slideshare of Vlad Mysla http://www.slideshare.net/vmysla/scrum-at-spotify?qid=2345c3ad-7e68-4383-9673-9e715ff47a75&v=default&b=&from_search=14 Squads,Tribes, Chapters and Guilds
  40. 40. Break 30 Minutes (back at 11 am)
  41. 41. Parallel-TrackWorkflow a.k.a. Staggered Sprints
  42. 42. Agile Design Timing: ParallelTracks • Developer track: Focus is on production code • Interaction designers track: Focus is on user contact
  43. 43. Iteration 1: DeveloperTrack • Underlying architecture work • Critical features with little user interface design required
  44. 44. Iteration 1: Interaction Designers • Design, create prototypes, usability test (UTest), and iterate (RITE method) • Field studies to understand user needs (contextual inquiry)
  45. 45. Iteration 2: Developers • Take the verified designs and start making them a reality
  46. 46. Iteration 2: Interaction Designers • UTest completed code for integration and implementation issues
  47. 47. Iteration 2: Interaction Designers • UTest completed code for integration and implementation issues • Use data gathered in the last iteration to create designs for next iteration
  48. 48. Iteration 2: Interaction Designers • UTest completed code for integration and implementation issues • Use data gathered in the last iteration to create designs for next iteration • Field studies for detailed information needed for upcoming iterations
  49. 49. And so on… • Constant communication between the two tracks is essential for success • These are not just hand-offs
  50. 50. During Each Iteration • Be Present • Face to face with developers • Are they building what you expect?
  51. 51. During Each Iteration Look back • Validate the work done in previous iteration
  52. 52. During Each Iteration Look ahead •Design for next iteration (n+1) •Research for future iterations (n+2, n+3…)
  53. 53. CombineYour Investigations Maximize your time with users • Test completed code • Test paper prototypes of upcoming design • Elicit data for future design
  54. 54. Agile Roles and ParallelTracks UXTakesTime • Having multiple roles (e.g. UX + product owner, UX + scrummaster) leads to overload • Working on multiple teams is a bad idea
  55. 55. Kanban and Just-In-Time • All work is a collaboration with engineering/development • Share information on walls – information radiators • Lean UX • Less time to conduct research and think through problems • Handled as a “spike” if needed • Rely more on early research early and usability testing (learn as you go)
  56. 56. Story Points and ParallelTracks Should UX activities be estimated as part of team velocity? •A hotly debated topic •Our positions: • No. They should be tracked separately, in parallel • Yes. Especially when part of active work. •“Working software is the primary measure of progress”
  57. 57. Spikes - Parking Lots • Used to get to a firm estimate (where applicable) • Able to respond Go/No Go • Parking lot – simpler problems to solve in a single conversation • Spike – not enough information • Intense focus on issue with multiple resources • While other work continues
  58. 58. Design Spikes • Multiple resources (not just design) • Must continue to support ongoing development
  59. 59. Incremental Implementation Getting to complete workflows, one DONE at a time
  60. 60. • Iterative • Incremental • Continuous • Collaborative • Transparent Agile Qualities
  61. 61. What if your story is too big? • If work can’t be completed in one iteration • Need to break it down • Where are the break lines? • How do you prioritize the feature cards?
  62. 62. Big Design - Waterfall • One big design document contains everything • Everyone signs off before Dev begins • Dev builds it until they run out of time • QA doesn’t test until Dev has run out of time • Result: • whatever they built first is completed • details are left out, quality issues identified too late • holes are left in the design • Much of your design effort is wasted
  63. 63. Big Design - Agile • Break the story into small pieces, where each piece confers incremental value to the user. • Story mapping (discussed later) • Determine the minimum first step • Schedule the pieces in order of importance • Design incrementally, as if the each piece were the final one • Change your future plans between iterations if you have learned new things
  64. 64. Via Spotify (original presentation not available). More at: http://www.slideshare.net/vmysla/scrum-at-spotify?qid=2345c3ad-7e68- 4383-9673-9e715ff47a75&v=default&b=&from_search=14 and https://labs.spotify.com/
  65. 65. Benefits of being incremental • When development runs out of time/resources, the shipped solution • Delivers maximum value • Has a complete design without holes • Has much higher quality • Has no wasted design work
  66. 66. Mistakes to avoid • Designing all the detail up front • Not thinking about the full design up front • Not breaking things down far enough • Not delivering a complete (sub) story each iteration – “now the user can…”
  67. 67. Activity Story Breakdown
  68. 68. Example: Doorway • User story: The user can get in and out of her house easily. • Completion Criteria: - Secure - Insulated - Lets light in - Allows large furniture items to pass - Fits with house décor - Works even without keys
  69. 69. Example: Doorway • Initial Rough Design: - Beautiful Colonial Door - Unbreakable translucent window - Programmable digital lock - Steel deadbolt - Metal-clad on the outside - High R-Value
  70. 70. Example: Doorway • What is the minimum work that will give the user incremental value towards their goal? • What needs to be designed for that? • What is the next smallest item that will give the user an added capability? • What needs to be designed for that?
  71. 71. Activity: Early Story Selection • Select the first 10 stories that should be done. • How many do you have to complete before you would be willing to try it with real customers? • See handout
  72. 72. FittingThis toYour Process • The purpose of incremental implementation is to get feedback early and often. • After each iteration, gather feedback. • These questions can affect your breakdown: • Who evaluates your product? • Is it always the same people? • Are your target users internal or external?
  73. 73. FittingThis toYour Process • You may get feedback from: • Internal ‘expert users’ • Beta/Usability testers under NDA • The general public (after release or open beta) • Internal users in a protected ‘sandbox’ • Internal users after general deployment
  74. 74. FittingThis toYour Process • Before releasing, consider: • Are you getting the feedback you need? • Is there enough completed for an external user to evaluate? • Sometimes you may want to hold back certain work until more is done.
  75. 75. Make it Easier for theTeam • Write staged specifications -- a best guess at breaking the design into 1-iteration Story increments • “Break” the Stories with developers intoTasks. Remember: they own the Tasks. But you need to know how to map those back to Stories & Capabilities. (See story mapping)
  76. 76. Ways to Break a Story Down • Workflows • Stories with many “mini-workflows” • e.g., Channel changer • Allowed inputs • Story that applies across different data types • e.g., Image file reader • Capacity • Completion criteria involve extreme size or speed • e.g., File transfer of large files
  77. 77. Example: OrderingYour Sub-Stories • Big Story: User can move, duplicate, or remove selected text in a document. © Copyright 2014 Desirée Sy & John Schrag.All rights reserved.
  78. 78. Example: Story Breakdown • Big Story: User can move, duplicate, or remove selected text in a document. • Note: there are many possible designs that achieve this user capability © Copyright 2014 Desirée Sy & John Schrag.All rights reserved.
  79. 79. Example: Story Breakdown • Big Story: User can move, duplicate, or remove selected text in a document. • The selected design is to provide 4 menu items with hotkeys: Cut, Copy, Paste, and Delete. © Copyright 2014 Desirée Sy & John Schrag.All rights reserved.
  80. 80. Example: Story Breakdown • Written out as proper stories: • The user can move selected text out of the document and into an off-screen clipboard. • The user can copy selected text into the off-screen clipboard. • The user can replace selected text with the contents of the off-screen clipboard. • The user can delete selected text. © Copyright 2014 Desirée Sy & John Schrag.All rights reserved.
  81. 81. Example: Story Breakdown • Stories: Cut, Copy, Paste, Delete • How engineering breaks it down: • Sprint one: create memory buffer system • Sprint two: add menu items, tooltips, etc • Sprint three: Copy • Spring four: Cut, Paste, Delete • What is wrong with this? © Copyright 2014 Desirée Sy & John Schrag.All rights reserved.
  82. 82. Example: Story Breakdown • Stories: Cut, Copy, Paste, Delete • How do you order these four stories? • Which one comes first?Why? • Which one comes second? Why? • Which one comes third?Why? © Copyright 2014 Desirée Sy & John Schrag.All rights reserved.
  83. 83. Activity: Story Breakdown • Chandra needs all the application functions available to him in his native language or another language he understands well. • Which of these breakdowns is/are Agile? Why? • What factors would determine which breakdown you should choose? • See handout
  84. 84. What if no breakdown is possible? • You can have a story with one single capability that takes more than a sprint to build. • For example, a calculation with a difficult algorithm. • This is an engineering problem, not a UX problem. • If possible, see if the work-in-progress can be validated using partial results.
  85. 85. Discussion • What are your story breakdown problems?
  86. 86. Lunch 12:30 pm – 1:45 pm
  87. 87. User Story Mapping
  88. 88. Shared Documents Aren’t Shared Understanding Cartoon by Luke Barrett © Jeff Patton, all rights reserved, www.AgileProductDesign.com
  89. 89. User Story Mapping • Organizing user stories into a map that communicates experience Book: User Story Mapping, Discover the whole story, build the right product. By Jeff Patton (with Peter Economy)
  90. 90. Visible Depiction of Available User Stories • Frame questions such as • What is needed? • When is it needed? • Where is there value? • What is really important?
  91. 91. Depth and Breadth of Entire System © Jeff Patton, all rights reserved, www.AgileProductDesign.com time Below each activity, or large story are the child stories that make it up Arrange spatially to tell bigger stories
  92. 92. Represents Complexity and Size of Work time Refine the map and test for completeness with the entire team - developers, designers, BA’s etc.
  93. 93. Conversations to Understand • Relationships between stories • Structure and hierarchy of related stories • Functionality that is being built • Conversations to share knowledge and clarify assumptions
  94. 94. Clarity ofWhat is to be Built • Organizes stories • Context of use for product • Clear understanding of use makes prioritization easier • Backlog completeness can be verified • Can be overwhelming to see entire product • Important to know information now rather than later
  95. 95. Enables Better Releases • Select relevant, high priority stories in releases • Valuable functionality • Complete sets of functionality • Plan, at a high level • What would come next • What is for “later”
  96. 96. © Jeff Patton, all rights reserved, www.AgileProductDesign.com Activity: Story Mapping • What were all the things you did to get ready to be here today? • Starting from the moment you woke up until you arrived here • Write one item per sticky note
  97. 97. Activity: Story Mapping • In a small group (3 to 5) merge stickies into a single model • Arrange left to right in order that makes sense to group • Eliminate duplicates • Cluster items that seem similar and create labels for the clusters if items that seem to go together © Jeff Patton, all rights reserved, www.AgileProductDesign.com
  98. 98. * from Cockburn’s Writing Effective Use Cases Story Detail – Level of Fidelity © Jeff Patton, all rights reserved, www.AgileProductDesign.com Functional or “Sea level” I’d reasonably expect to complete this in a single sitting Sub-Functional or “Fish level” Small tasks that by themselves don’t mean much. I’ll do several of these before I reach a functional level goal Activity or “Kite level” Longer term goals often with no precise ending. I’ll perform several functional tasks in the context of an activity Too abstract Too detailed Think about user experience at this level Be sensitive to your user task’s “altitude”
  99. 99. Discover as Much as Possible, as Quickly as Possible • Prototype early • Learn from prototypes and iterate
  100. 100. Documentation
  101. 101. Tell the Story • Strive for “Caterpillar to Butterfly” • Show progressions of key sections of the interactions • Use more screenshots – less words • Explain what changes were made and why 101
  102. 102. Capture the Evolution • Helps avoid making same mistakes later • Helpful to capture first, middle and end screenshots: • primary pages • primary features • contentious issues • Don’t sweat the small stuff • Use final prototypes as a base for recommendations (vs. written documentation and/or comps) 102
  103. 103. Provide Details as Appropriate • Archive prototypes and other deliverables • Regulatory environment or complex interactions • Test plans and guides • Detailed changes • Participant information as needed, but avoid sharing with wider team 103
  104. 104. Don’t Overwhelm Audience or You • Document in Wiki or similar (avoid PPT) • Just enough to understand the “why” • Always challenging due to: • Limited time • Multiple changes over time • Findings building upon one another 104
  105. 105. Agile UX Prioritization Knowing what’s important
  106. 106. Timing for Prioritization • When grooming the backlog • During formative usability testing
  107. 107. Prioritizing Problems • It’s better to fix the few most important issues than to find every issue because: • Big problems can mask other problems • Every fix changes user behavior
  108. 108. Prioritizing Problems High Value Low Cost High Value High Cost Low Value Low Cost Low Value High Cost UX/Product Management determines “Value”
  109. 109. Prioritizing Problems High Value Low Cost High Value High Cost Low Value Low Cost Low Value High Cost Development determines “Cost”
  110. 110. Prioritizing Problems High Value Low Cost High Value High Cost Low Value Low Cost Low Value High Cost A B C Seriously?
  111. 111. “If a user can’t find or use feature, it’s the same as if the feature is broken.” VS. “It’s more important to fix things that really don’t work. The user can learn the hard stuff.” Prioritizing UX vs “real” bugs
  112. 112. Prioritizing UX vs “real” bugs • You cannot win this argument on a case-by-case basis • Instead, adopt a strategy for getting required investment in UX work
  113. 113. Strategies for Getting Investment in UX • Political strategy: Create a formal equivalence of UX versus bug priorities. • Investment strategy 1: Block out fixed time • Investment strategy 2: Block out people • End-run strategy: get your own engineer • Fix UX problems early, if possible.
  114. 114. Detail Matters • Users are usually more delighted by low-cost annoyance fixes than by big flashy new features
  115. 115. Focus and Negotiation • Keep an intense focus on fixing the most important things • Negotiate on behalf of users • Represent their needs as best you can
  116. 116. Break Return at 3:00 pm
  117. 117. Research and Requirements
  118. 118. Research Balancing Act  Understand users, context, etc.  Create personas, mental models, etc.  Prepare for story mapping and other sessions thoroughly Strive for UX Best Practices  Engineers need designs to develop - will move on without UX involvement  Research cannot continue forever Meet Production Needs Agile requires leaner methods
  119. 119. How much is good enough? • What is being developed? • What do you know? • What questions are still open? • Meet goal when users starting to talk about colors and icons (not functionality)
  120. 120. Light Design - Lean UX • Familiar UX methods made lean: • Iterative (flexible, change as needed) • Repeatable (easy to do, expected next steps) • Incremental (lead into next, small changes over time)
  121. 121. Tips for Lean • UsabilityTesting • Insert questions to find out more for open issues • Schedule regular testing to reduce preparation time • Reach users quickly for meaningful information (panels, remote testing, surveys etc.) • Incentives as needed • Put all data together quickly – no big reports
  122. 122. Lean Reporting • Put all data together quickly • No big reports • Information as needed • Get it to the team – quickly (Evernote, Mural.ly,Trello, Story/Bug tracker, etc.) • Tell the story – pertinent information – who, why? • Provide solutions (wireframes, etc.)
  123. 123. Activity: Make it Lean (45 minutes)
  124. 124. Activity: Determine User Expectations • Early stages of a project - defining scope. • Stakeholders:“Users will never sign a catering contract on their phone!” Doesn’t need to work on the phone. • UX team: Not likely to be their primary access choice, but will be desired to be done on their phone. • You have 2 days: Determine if common/critical use case • Teams of 3 people • Make a plan for what to do (10 minutes) • Share your plan
  125. 125. Guidelines • What do you need to know? • What resources do you have? • How much effort/time do you have?
  126. 126. Activity: Part 2 • Take roles and act them out • Discuss ramifications of findings • What's in and what's out? • Make tradeoffs – conversations • Vote within teams • See handout
  127. 127. Sprint Zero for ScrumTeams • Time to do initial research, setup usability testing, etc. • When technical teams are setting up environments • Back end that doesn’t hit front end • Getting alignment on business goals –WHY?? • All bought in across board • Do just enough work to get development started
  128. 128. Alternatives to Sprint Zero • Can be in parallel sprints while other teams are wrapping up previous work • Do work in Sprint 1 • Planning, story mapping, etc. (or already done) • Story creation (or not done yet, or will do later) • Create initial wires and prototypes (or in Sprint 1) • Goal is to have initial questions answered – doesn't matter what you call it.
  129. 129. Pros and Cons - Sprint Zero • Pros • Gives UX a head start • Lot of backend work needs to be done anyway • Establish common vision • Who for? • Common “elevator statement” • Cons • Can be a trap leading to Waterfall • Big Design Up Front (BDUF) • Time box to avoid this
  130. 130. Requirements • Change in presence of the artifact • Questions change as you learn more • Pointless to do ALL requirements gathering up front • Works better iteratively – unless have it in hands of those that will use it • Don't know what we don't know
  131. 131. Make it Quick! • Proxies as needed • Quick enough analysis • Get to 80% confidence • Continued learning with additional contacts • Usability testing • Customer visits (enterprise software)
  132. 132. Setting Expectations • Developers • Only get a little bit of information at a time • Need to fit work in • May need to rework as we learn • Repeat it as we go
  133. 133. Arguments About UX • Not done (what is “done?”) • Indecisive (make up your mind!) • Never right (“more feedback already?”)
  134. 134. Agile UsabilityTesting
  135. 135. Eric Ries @ericries via @MelBugai on Twitter at LeanStartupMI in 2011 "The biggest waste of all is building something no one wants“ - Eric Ries @ericries
  136. 136. UX Made “Agile” • Any UX method can be adapted • Don’t have to give up our favorite methods • Don’t have to learn new ones • Doesn’t take much effort to adapt our methods to fit the Agile process • Think about “lean” and “iterative” methods • RITE is a good place to start
  137. 137. RITE Overview • Qualitative user feedback • actions + comments • Series of small usability tests • 3 participants each day • Minimum of 3 days of testing • Iteration between testing days • Total of 5 days
  138. 138. RITE Process Test Update Test 1 2 3 High Medium Low Priority & Level of Effort
  139. 139. WhatWorks for RITE • Best used early in project lifecycle • Early concepts • Need to be vetted with users • Can assist in quickly shaping designs • Doesn’t this sound “agile”? 139
  140. 140. Evaluation + Testing • Think evaluation → testing throughout the product development lifecycle • Start with design evaluations and move onto testing the deliverables for each Sprint/Iteration • Start with the big questions and narrow down quickly (what would be the top 3 things to fix/improve? would you use it? Would it be a “wow”? which of 3 approaches do you prefer?)
  141. 141. Number of Participants • Think fast and iterative • For example ~5 participants for each, and iterate if needed • Key is to get the needed feedback, iterate, and move on • Do you really need 10 participants to tell you it’s something they would never use? • Know when enough is enough • If 3 participants so far have “failed”, do you need to test the other 2? • Note: personas can be agile too: top 1, confirm, test
  142. 142. Testing Cycles • Set a schedule and expectations with the team early • User testing days (e.g., every Friday, we’ll have 3 hours set aside for testing) • Schedule set to Sprints/Iterations (e.g., at end of every Sprint, schedule a round of testing to cover what has been completed) • Also consider combining sessions for multiple goals (e.g., test what was done last Sprint, get early feedback on what you are working on now)
  143. 143. Testing Materials • Use the lowest fidelity method possible to get the needed information (the time spent in developing the materials is time you won’t have for iterating and testing) • Use sketches and wireframes to work on basic concepts and keep attention focused away from details • Use higher fidelity when you are testing the details and interactions
  144. 144. Test Only Until “Done” • Stop testing when you know enough to move forward • Test for the big stuff first: when you start hearing about icons and colors, not function or layout, you know it’s “enough”
  145. 145. Light Reporting • Don’t write a report • Focus on most important changes • Record change decisions and reasons why (for future reference, and for onboarding new designers) • Explain changes to the team face-to-face • Tell the story
  146. 146. Discussion • Additional topics • Bringing work in – how do you select the right thing(s)? • Backlog grooming and where UX fits in • Types of prototypes • Other frameworks for Agile • Working with PM’s, and leadership • What are your experiences?
  147. 147. Additional Reference
  148. 148. • Adapting Usability Investigations for Agile User- Centered Design by Desirée Sy • Journal of Usability Studies,Volume 2, Issue 3 (the most-cited paper in JUS) • http://www.uxpajournal.org/
  149. 149. Principles behind the Agile Manifesto • Customer satisfaction by rapid delivery of useful software • Welcome changing requirements, even late in development • Working software is delivered frequently (weeks rather than months) • Close, daily cooperation between business people and developers • Projects are built around motivated individuals, who should be trusted • Face-to-face conversation is the best form of communication (co-location) • Working software is the principal measure of progress • Sustainable development, able to maintain a constant pace • Continuous attention to technical excellence and good design • Simplicity—the art of maximizing the amount of work not done—is essential • Self-organizing teams • Regular adaptation to changing circumstance http://www.agilemanifesto.org/principles.html

×