RITE  Testing and aBusiness Driver             Jim Kalbach             Carola Weller
TEST: Are you enjoying Euro IA in          Rome so far?        YES       NO
1. Do you consider yourself to be a      good IA or UX designer?        YES         NO
2. Do you think the web provides a    good UX most of the time?        YES        NO
So...why are there so many bad     experiences out there?
We feel boxed in...http://www.mimenta.com/Mimenta/DigitalArts/Wallpapers.html
...and we cry about it.http://starwars.wikia.com/wiki/File:Luke_whining.jpg
GreatUX Design   ≠            =   Great UX
Great(   UX Design   + X) =   Great UX
3. Do you complain about stakeholder    decisions regarding UX design?         YES        NO
4. Do you know the main cause of poor stakeholder decisions regarding UX?          YES        NO
“They don’t get                                  it!”http://www.thepoke.co.uk/2011/09/19/billionaire-lost-track-of-exact-f...
We’re focused on productshttp://mook23.files.wordpress.com/2011/06/scientist_in_lab.jpg
Needed: Engagementhttps://picasaweb.google.com/lh/photo/ug22ef6HQ7HxdPGGZnWWOQ
(     Great    UX Design   +   Stakeholder                     engagement   )= Great UX
5. Do you know how to consistently       get that engagement?         YES        NO
RITERapid Iterative Testing and Evaluation
Quick History of User TestingPre 1980s       No established user testing Since 1980s            Getting some feedback from...
Standard Usability Test                              Product development                                      LaunchConcep...
Standard Usability Test vs. RITE Testing:»A typical usability test focuses on the problems identified.»The RITE methodolog...
UXWho’s Who                    Team Strategy                         USER RESEARCH     MARKETING                          ...
Debriefings                            DESIGNER                               STAKEHOLDERUSER RESEARCHER
What has gone wrong…•   No RITE Testing in the beginning•   No prioritization of errors with colour coded post-its•   We a...
Tips for engagement•   Round-Robin to get to know everyone•   Go out for Lunch•   Active analysis with post-its•   Systema...
(     Great    UX Design   +   Stakeholder                     engagement   )= Great UX
But Wait – There’s More!
Mutual Benefits1. Avoid blind veteos and misunderstanding2. Improve collaboration and efficiency3. Hierarchy and expertise...
( Great        +UX Design             )=(            Stakeholder             engagement                          Great UX ...
Once you’ve gone RITE,it’s hard to go back!              http://www.globetrotter-select.de/images/FallschirmSkyDive.jpg
6. Will you use RITE on   your next projects?  YES        NO
7. Do you think there are other methods     for stakeholder engagement?          YES        NO
By pushing for a collaborative,cross-functional process UXdesigners are becominggrassroots strategic players ...          ...
DANKE SCHÖN              Jim.Kalbach@gmail.com                  Weller@Sirvaluse.de
Upcoming SlideShare
Loading in...5
×

RITE: Testing and Business Driver

7,004

Published on

Presentation at Euro 2012, Rome, by Jim Kalbach and Carola Weller

Topics such as “Agile Design“ and “Lean UX“ are all the rage these days. With these approaches, designers seek to prototype, test and revise their designs quickly and with little documentation. Rapid Iterative Testing and Evaluation, or RITE for short, is a specific method that fits into this canon.

The key, we believe, is design collaboration—bringing stakeholders together. This does not just mean “design-by-committee,” where designers can easily get out-voted. On the contrary: putting designers, product managers and business stakeholders in the same room with the same stimuli gives designers a stronger voice in shaping the solution.

Of course, there were also challenges to our approach. For instance, not all stakeholders from the various departments saw the need to attend or didn’t know what to expect at first. (But after several rounds of RITE, they didn’t want to be left out.) In this presentation, we shared the difficulties we encountered and how to overcome them. We also talked about our modifications to the methodology, which allowed us to move faster and cover more ground quickly.

Published in: Design

RITE: Testing and Business Driver

  1. 1. RITE Testing and aBusiness Driver Jim Kalbach Carola Weller
  2. 2. TEST: Are you enjoying Euro IA in Rome so far? YES NO
  3. 3. 1. Do you consider yourself to be a good IA or UX designer? YES NO
  4. 4. 2. Do you think the web provides a good UX most of the time? YES NO
  5. 5. So...why are there so many bad experiences out there?
  6. 6. We feel boxed in...http://www.mimenta.com/Mimenta/DigitalArts/Wallpapers.html
  7. 7. ...and we cry about it.http://starwars.wikia.com/wiki/File:Luke_whining.jpg
  8. 8. GreatUX Design ≠ = Great UX
  9. 9. Great( UX Design + X) = Great UX
  10. 10. 3. Do you complain about stakeholder decisions regarding UX design? YES NO
  11. 11. 4. Do you know the main cause of poor stakeholder decisions regarding UX? YES NO
  12. 12. “They don’t get it!”http://www.thepoke.co.uk/2011/09/19/billionaire-lost-track-of-exact-fortune-some-time-ago/
  13. 13. We’re focused on productshttp://mook23.files.wordpress.com/2011/06/scientist_in_lab.jpg
  14. 14. Needed: Engagementhttps://picasaweb.google.com/lh/photo/ug22ef6HQ7HxdPGGZnWWOQ
  15. 15. ( Great UX Design + Stakeholder engagement )= Great UX
  16. 16. 5. Do you know how to consistently get that engagement? YES NO
  17. 17. RITERapid Iterative Testing and Evaluation
  18. 18. Quick History of User TestingPre 1980s No established user testing Since 1980s Getting some feedback from users Since 1990s Standard Usabilit yTesting Product development Launch Standard Usability Testing Design Run all Analysis and Changes Test interviews Report
  19. 19. Standard Usability Test Product development LaunchConcept Designs Approval RITE Rapid Iterative Testing Evaluation Design Run all Make changes Analysis and Make Make changes Test interviews Sessions Test Report Test Sessions changes Test Sessions Observation Observation Observation Improved De-Briefing De-Briefing De-Briefing product with Day 1 Day 2 Day 3 Day 4 Day 5 stakeholder input Day 6
  20. 20. Standard Usability Test vs. RITE Testing:»A typical usability test focuses on the problems identified.»The RITE methodology is inherently about the problems solved.
  21. 21. UXWho’s Who Team Strategy USER RESEARCH MARKETING DESIGN HEAD OF CX BUSINESS LEAD CONTENT STRATEGYPRODUCT MANAGEMENT + SENIOR MANAGEMENT
  22. 22. Debriefings DESIGNER STAKEHOLDERUSER RESEARCHER
  23. 23. What has gone wrong…• No RITE Testing in the beginning• No prioritization of errors with colour coded post-its• We assumed stakeholders would know who to invite/approach• Resource planning with designers and updates between sessions• Room too small and not enough room for workshoping the solution
  24. 24. Tips for engagement• Round-Robin to get to know everyone• Go out for Lunch• Active analysis with post-its• Systematic and recurring schedule• Simultaneous interpreter in the observation room• Regular debriefings• No long report two weeks later
  25. 25. ( Great UX Design + Stakeholder engagement )= Great UX
  26. 26. But Wait – There’s More!
  27. 27. Mutual Benefits1. Avoid blind veteos and misunderstanding2. Improve collaboration and efficiency3. Hierarchy and expertise leveling4. Influence policy and business attitude
  28. 28. ( Great +UX Design )=( Stakeholder engagement Great UX + ) Impact on Business
  29. 29. Once you’ve gone RITE,it’s hard to go back! http://www.globetrotter-select.de/images/FallschirmSkyDive.jpg
  30. 30. 6. Will you use RITE on your next projects? YES NO
  31. 31. 7. Do you think there are other methods for stakeholder engagement? YES NO
  32. 32. By pushing for a collaborative,cross-functional process UXdesigners are becominggrassroots strategic players ... JEFF GOTHELFThe organizational perception ofthe UX designer becomes more ofa design facilitator, a UX leaderand ultimately a company leader. “Lean UX is Nothing New,” Johnny Holland: http://johnnyholland.org/2012/09/lean-ux-is-nothing-new/”
  33. 33. DANKE SCHÖN Jim.Kalbach@gmail.com Weller@Sirvaluse.de
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×