C(ollab) RITE
How to run impactful iterative studies in a fast paced environment
Helena Roeber
Jhilmil Jain
Google
#uxpa20...
C-RITE Impact
• User research insights are adopted quickly
• Product team has clear sense of progress
• Researchers and de...
C-RITE
• Iterative UX research method suitable for agile
environments
• From research to new design solution in 1 day
• 7 ...
User Research Stages
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
#uxpa2013 #crit...
The
Players
The Players and Their Roles
The
Researcher
#uxpa2013 #crite #androidux
Traditional Researcher Role
Research Analysis Design Prototyping
Reporting
&
Prioritization
Planning
& Recruiting
Research...
The
Designer
#uxpa2013 #crite #androidux
Reporting
&
Prioritization
Planning
& Recruiting
Engineers
Traditional Designer Role
Engineer
Research Analysis Design Pro...
The
Product
Manager
#uxpa2013 #crite #androidux
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
Traditional PM Role
Reporting
&
Prio...
The
Engineer
#uxpa2013 #crite #androidux
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
Traditional Engineering Role
Reporti...
Collaboration in C-RITE
Research Analysis Design Prototyping
Reporting
&
Prioritization
Planning
& Recruiting
Designer
PM
...
Time Line - Traditional Usability
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
1-...
Time Line - Traditional Usability
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
1-...
Time Line - RITE
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
1 - 2 weeks 1 - 2 w...
Time Line - C-RITE
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
1-2 weeks 2.5 day...
Time Line - Cyclic C-RITE
Research Analysis
Reporting
&
Prioritization
Design Prototyping
Planning
& Recruiting
1 week 2.5...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
Example: TV Voice Search
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
1st TV Voice Search Design
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Research Timing
10:00 am 11:0...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Collaborative Analysis
10:00 ...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
Observation Board Example
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
User Goals Example
Observation Examp...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Collaborative Observation
#uxpa20...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Analysis
10:00 am 11:00 am...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
From Observation to Insight
Obser...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Prioritizing Insights
Goal exampl...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
3:00 pm
Da...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Design Workshop
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Design Workshop Actions
Observati...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Action Item Owners & Due Dates
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
#uxpa2013 ...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
#uxpa2013 ...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
#uxpa2013 ...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
#uxpa2013 ...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
#uxpa2013 ...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
C-RITE Design Workshop
#uxpa2013 ...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Before & After
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Reporting
Day 1
Send action i...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Prototyping
3:00 pm10:00 11:0...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Cycles
Week1 Week 2 Week 3
#u...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Recruiting
• Create a panel o...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Room Design
• Comfortable sea...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Preparations
• Set expectatio...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
C-RITE Summary
#uxpa2013 #crite #and...
Research
Observation
& Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
Thank you
#uxpa2013 #c...
Appendix
Agile Methods: RITE
• Changes are made as soon as a problem is
identified, sometimes after 1 session
• 1-2 sessions a day. ...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
Agile Methods: KRUG + RITE
• 4 parti...
Research Analysis
Reporting &
Prioritization
Design Prototyping
Planning
& Recruiting
Agile Methods: PULSE
• 3 participant...
Research Analysis
Reporting &
Prioritization
Design Implementation
Planning
& Recruiting
Variations We’ve Tried
• C-RITE R...
Upcoming SlideShare
Loading in …5
×

C(ollab) RITE: How to run impactful iterative studies in a fast paced environment

2,835 views

Published on

This talk describes C-RITE , a method that maximizes impact through cross-disciplinary collaboration on research observation, analysis, and design exploration within an agile, user-centered development framework. We showcase real-world tested techniques that Google’s Android and TV teams have developed and share tactics for reducing logistical overhead in a lean, iterative user-centered design process.

Published in: Technology, Business
0 Comments
18 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,835
On SlideShare
0
From Embeds
0
Number of Embeds
87
Actions
Shares
0
Downloads
1
Comments
0
Likes
18
Embeds 0
No embeds

No notes for slide

C(ollab) RITE: How to run impactful iterative studies in a fast paced environment

  1. 1. C(ollab) RITE How to run impactful iterative studies in a fast paced environment Helena Roeber Jhilmil Jain Google #uxpa2013 #crite @jhilmiljain @helenaroeber #androidux
  2. 2. C-RITE Impact • User research insights are adopted quickly • Product team has clear sense of progress • Researchers and designers earn understanding and respect for their work • Advocates for the user centered design process are born #uxpa2013 #crite #androidux
  3. 3. C-RITE • Iterative UX research method suitable for agile environments • From research to new design solution in 1 day • 7 research sessions in 2 days • Collaborative design workshop each day • Prototype changes between day 1 and 2 • Can be repeated weekly • Stakeholders collaborate in all UX phases #uxpa2013 #crite #androidux
  4. 4. User Research Stages Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting #uxpa2013 #crite #androidux
  5. 5. The Players The Players and Their Roles
  6. 6. The Researcher #uxpa2013 #crite #androidux
  7. 7. Traditional Researcher Role Research Analysis Design Prototyping Reporting & Prioritization Planning & Recruiting Researcher
  8. 8. The Designer #uxpa2013 #crite #androidux
  9. 9. Reporting & Prioritization Planning & Recruiting Engineers Traditional Designer Role Engineer Research Analysis Design Prototyping Reporting & Prioritization Planning & Recruiting Designer Designer Researcher
  10. 10. The Product Manager #uxpa2013 #crite #androidux
  11. 11. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Traditional PM Role Reporting & Prioritization Planning & Recruiting Research Analysis Design Prototyping Reporting & Prioritization Planning & Recruiting Designer Designer Researcher PM PM
  12. 12. The Engineer #uxpa2013 #crite #androidux
  13. 13. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Traditional Engineering Role Reporting & Prioritization Planning & Recruiting Research Analysis Design Prototyping Reporting & Prioritization Planning & Recruiting Designer Designer Researcher PM PM Engineer
  14. 14. Collaboration in C-RITE Research Analysis Design Prototyping Reporting & Prioritization Planning & Recruiting Designer PM Engineer Researcher
  15. 15. Time Line - Traditional Usability Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting 1-2 weeks 1-2 weeks 1/2 - 1week 1/2 -1week 3 - 6 weeks #uxpa2013 #crite #androidux
  16. 16. Time Line - Traditional Usability Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting 1- 2 weeks 1- 2 weeks 1/2 - 1week 1/2 -1week 4 - 8 weeks #uxpa2013 #crite #androidux 1/2 - 1 week1/2 -1 week
  17. 17. Time Line - RITE Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting 1 - 2 weeks 1 - 2 weeks 2 - 4 weeks #uxpa2013 #crite #androidux
  18. 18. Time Line - C-RITE Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting 1-2 weeks 2.5 days 1.5 - 2.5 weeks #uxpa2013 #crite #androidux
  19. 19. Time Line - Cyclic C-RITE Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting 1 week 2.5 days 1.5 weeks #uxpa2013 #crite #androidux
  20. 20. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Example: TV Voice Search
  21. 21. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting 1st TV Voice Search Design
  22. 22. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Research Timing 10:00 am 11:00 am 1:00 pm 2:00 pm10:00 am 11:00 am 1:00 pm Day 1 Day 2 #uxpa2013 #crite #androidux
  23. 23. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Collaborative Analysis 10:00 am 11:00 am 1:00 pm 2:00 pm10:00 am 11:00 am 1:00 pm Day 1 Day 2 #uxpa2013 #crite #androidux
  24. 24. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Observation Board Example
  25. 25. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting User Goals Example Observation Example Goal example P1P1 P2P2 Bob Lin Ali Nur Bob Lin Ali Nur User knows what to say 2 1 2 2 The system understood user’s intent 5 3 1 1 The system doesn’t slow down user w unnecessary confirmations 4 4 2 2 User can easily tell where speech will work 2 2 2 2 User comfortable using their voice 4 4 4 4 Rating on a scale from 1- 5 1 = poor 5 = good
  26. 26. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Collaborative Observation #uxpa2013 #crite #androidux • Re-call to count observations, analysis step reduced • Disagreements about observations are resolved immediately • Research protocol can be adjusted based on stakeholder feedback • Researcher can explain what observations mean • Small sample size discussion is obsolete
  27. 27. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Analysis 10:00 am 11:00 am 1:00 pm 2:00 pm10:00 am 11:00 am 1:00 pm Day 1 Day 2 2:00 pm 3:00 pm #uxpa2013 #crite #androidux
  28. 28. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting From Observation to Insight Observation Example Goal example
  29. 29. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Prioritizing Insights Goal example Insights
  30. 30. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop 3:00 pm Day 1 10:00 am 11:00 am 1:00 pm 2:00 pm 10:00 am 11:00 am 1:00 pm 2:00 pm Day 2 6:30 pm5:30 pm #uxpa2013 #crite #androidux
  31. 31. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Design Workshop
  32. 32. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Design Workshop Actions Observation Example Goal example
  33. 33. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Action Item Owners & Due Dates
  34. 34. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop #uxpa2013 #crite #androidux • Turn panic into confidence
  35. 35. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop #uxpa2013 #crite #androidux • Turn panic into confidence • Designers demonstrate problem solving skills
  36. 36. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop #uxpa2013 #crite #androidux • Turn panic into confidence • Designers demonstrate problem solving skills • Engineers solve technical constraints
  37. 37. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop #uxpa2013 #crite #androidux • Turn panic into confidence • Designers demonstrate problem solving skills • Engineers solve technical constraints • Researchers guide insight interpretation
  38. 38. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop #uxpa2013 #crite #androidux • Turn panic into confidence • Designers demonstrate problem solving skills • Engineers solve technical constraints • Researchers guide insight interpretation • PM gives business and scheduling input
  39. 39. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting C-RITE Design Workshop #uxpa2013 #crite #androidux • Turn panic into confidence • Designers demonstrate problem solving skills • Engineers solve technical constraints • Researchers guide insight interpretation • PM gives business and scheduling input • Everyone participates in creative process
  40. 40. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Before & After
  41. 41. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Reporting Day 1 Send action items to team Day 2 Send action items to team Short report Day 3 #uxpa2013 #crite #androidux
  42. 42. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Prototyping 3:00 pm10:00 11:00 1:00 2:00 Day 2 6:30 pm Day 1 10:00 11:00 1:00 2:00 5:30 pm #uxpa2013 #crite #androidux
  43. 43. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Cycles Week1 Week 2 Week 3 #uxpa2013 #crite #androidux
  44. 44. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Recruiting • Create a panel of users that meet general recruitment criteria • Panel members commit to availability at short notice on research days • Each week, schedule panel members • Recruit for specific criteria when needed #uxpa2013 #crite #androidux
  45. 45. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Room Design • Comfortable seating for all to observe sessions • Whiteboard to record observations, and drawing during design workshop • Sunlight and windows is good for creativity #uxpa2013 #crite #androidux
  46. 46. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Preparations • Set expectations with all stakeholders beforehand about time commitment, collaboration and workshop format • Decision makers need to participate in C-RITE studies and workshops #uxpa2013 #crite #androidux
  47. 47. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting C-RITE Summary #uxpa2013 #crite #androidux • Iterative UX research method suitable for agile environments • From research to new design solution in 1 day • 7 research sessions in 2 days • Collaborative design workshop each day • Prototype changes between day 1 and 2 • Can be applied weekly • Stakeholders collaborate in all UX phases
  48. 48. Research Observation & Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Thank you #uxpa2013 #crite #androidux jhilmil.jain@gmail.com @jhilmiljain @helenaroeberhelena.roeber@gmail.com
  49. 49. Appendix
  50. 50. Agile Methods: RITE • Changes are made as soon as a problem is identified, sometimes after 1 session • 1-2 sessions a day. Breaks between sessions long enough to make changes • 1-2 weeks of sessions • Requires stakeholder attendance and participation Medlock, Wixon, Fulton, Terrano and Romero, UPA, 2002 #uxpa2013 #crite #androidux
  51. 51. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Agile Methods: KRUG + RITE • 4 participants over 2 days, at least 1 hour between sessions to make changes • Researcher sends out observations and recommendations 30 min after last session • Team debrief of observations and action items on day 2, 1 hour after last session • No collaborative design workshop McGinn, Chen, Journal of Usability Studies, 2013
  52. 52. Research Analysis Reporting & Prioritization Design Prototyping Planning & Recruiting Agile Methods: PULSE • 3 participants, 1 day every week • Analysis and write-up of results by researcher within 2 days • No collaborative analysis and design workshop Konno, Agile 2012
  53. 53. Research Analysis Reporting & Prioritization Design Implementation Planning & Recruiting Variations We’ve Tried • C-RITE Remote • If time zones allow, stakeholders participate through ‘Hangouts’ • Sessions are recorded and watched with time delay • Next day debriefs and design workshops for incompatible time zones • C-RITE Diary Studies • In-lab diary kick-offs and debriefs are run in C-RITE format • Researcher analyzes and summarizes diary data for debrief and design workshop

×