SlideShare a Scribd company logo
1 of 46
Download to read offline
the research & design feedback loop

virtuous cycles
Julie Stanford, Sliced Bread Design, Stanford University
You’ve sat through a lot or
presentations about how we
should all do more user research
and if you do everything will be
perfect.
User	Research	 Design
reactive, fast solutions
interstitials
 clutter
pop-ups
 text
fixing just one
thing often
breaks
something else…
Result is a patchwork quilt with
holes in it (some parts will keep
you warm but not others and it is
fugly as all hell)
Dean Bokhari http://www.meaningfulhq.com/mediagarbage.html
reactive design loop vs.
thoughtful design loop
You’ve sat through a lot or
presentations about how we
should all do more user research
and if you do everything will be
perfect.
Cautionary Tale #1
poor communication between
research and design
researcher…
tests wrong use cases
asks wrong questions
needs more questions 
overlays assumptions
Breakdown	of	trust	-	>	Lack	of	
impact	on	design	

designer doesn’t…
communicate well
engage with research
believe results
breakdown of trust
even worse: "
wrong prototype or wrong test
user research with no distinct goal
illusion of progress
Dean Bokhari http://www.meaningfulhq.com/mediagarbage.html
vanilla research loop vs.
thoughtful research loop
how do you create a virtuous cycle?
https://www.labwater.com/images/simple-water-cycle.jpg
option 1 (simple yet hard): "
research & design = same person
•  difficult to find
•  some people really awesome at one
•  some companies have it siloed
•  potentially expensive
option 2: "
follow a process
prerequisite: leave the building

start with base user research* 
do 80/20 organization of use cases 
(Pareto Principle)


*can be called needfinding, customer development, ethnographic
research, etc. depending on the methodology.
the virtuous loop formula
1. question
2. mind meld
3. attend
4. evaluate findings
5. brainstorm
6. evaluate solutions
1. question
•  list all the questions that
you have about the
design right now
•  prioritize the questions
based on the sorted use
cases AND impact on
your business
•  craft a study to answer
the most burning 1-2
question (see Leah
Buley’s session)
2. mind meld
•  researcher and designer should go over "
each section/page of the prototype
together and list what to cover"

•  pro tip: run a pilot together "
(with lots of pauses)
• people responsible for product decisions
should attend the research sessions
• I’m too busy is not an excuse
• set up a system in advance for attendees "
to ask questions
3. attend & participate
4. evaluate findings
give each issue a severity rating
evaluation questions to ask
•  What percent of my users will be affected by this issue?
•  Is this on the 80/20 path of use cases?
•  If people can’t find X, what’s the impact?
•  If people do X the wrong way, how easily can they recover?
•  How easily can this be learned?
•  What happens if we don’t fix it?
•  What is the most important issue that came up that is
preventing us from making money?
big picture check
a larger issue to address?do smaller issues together suggest…
5. brainstorm
•  create multiple solutions starting with critical problems
•  brainstorm small and large fixes
•  if stuck, try Crazy 8s
Crazy 8s: Folder a paper into 8 spaces, set a timer, and go!
6. evaluate solutions
•  What impact does this solution have on the overall page? "
(i.e busy, patchworky, increase the cognitive load?)
•  How does this impact navigation to/from this area? 
•  Will this work on subsequent use or is it only useful once? 
•  How consistent is this change with the rest of the design?
•  Does this fix impede one of the 80/20 use cases?
•  Are there multiple fixes better solved by one big fix? "
(i.e. is there a systemic issue here?) 
•  How does this effect the overall experience?
can’t decide? take a sketch break
stop talking
sketch quickly
discuss

this will save you "
A LOT of time
the virtuous loop formula
1. question
2. mind meld
3. attend
4. evaluate findings
5. brainstorm
6. evaluate solutions
•  decide on the design changes
•  do the #1 QUESTION step 2x
1.  BEFORE you prototype to
make sure you prototype
the right thing
2.  again AFTER you
prototype
the virtuous loop formula
1. question
2. mind meld
3. attend
4. evaluate findings
5. brainstorm
6. evaluate solutions
thoughtful research"

virtuous cycle
thoughtful design
Cheat Sheet
http://bit.ly/2dp8goK
Cautionary Tale #1
julie@slicedbreaddesign.com

More Related Content

What's hot

Active Testing: Real time Collaborative Analysis - July event on 'Turning the...
Active Testing: Real time Collaborative Analysis - July event on 'Turning the...Active Testing: Real time Collaborative Analysis - July event on 'Turning the...
Active Testing: Real time Collaborative Analysis - July event on 'Turning the...The Research Thing
 
10 tips for a better survey at UX Bristol
10 tips for a better survey at UX Bristol10 tips for a better survey at UX Bristol
10 tips for a better survey at UX BristolCaroline Jarrett
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtcGerieOwen
 
Garnering positive engagement from stakeholders who don’t understand UX
Garnering positive engagement from stakeholders who don’t understand UXGarnering positive engagement from stakeholders who don’t understand UX
Garnering positive engagement from stakeholders who don’t understand UXNexer Digital
 
Easy and affordable user testing - Front Trends 2017
Easy and affordable user testing - Front Trends 2017Easy and affordable user testing - Front Trends 2017
Easy and affordable user testing - Front Trends 2017Ida Aalen
 
User Centered Design Presentation
User Centered Design PresentationUser Centered Design Presentation
User Centered Design PresentationMikeDawsonUH
 
Coaching teams in creative problem solving
Coaching teams in creative problem solvingCoaching teams in creative problem solving
Coaching teams in creative problem solvingFlowa Oy
 
5 why’s technique and cause and effect analysis
5 why’s technique and cause and effect analysis5 why’s technique and cause and effect analysis
5 why’s technique and cause and effect analysisBhagya Silva
 
Stanford Peace Innovation Lab: ITBA Argentina workshop day 2
Stanford Peace Innovation Lab: ITBA Argentina workshop day 2Stanford Peace Innovation Lab: ITBA Argentina workshop day 2
Stanford Peace Innovation Lab: ITBA Argentina workshop day 2Margarita Quihuis
 
Katerina clark ppt123
Katerina clark ppt123Katerina clark ppt123
Katerina clark ppt123clarkkm
 
IDp Lab 2010 1 Assignment
IDp Lab 2010 1 AssignmentIDp Lab 2010 1 Assignment
IDp Lab 2010 1 Assignmentpriek825
 
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...Christina York
 
Delight 2012 | Nordstrom Innovation Lab
Delight 2012 | Nordstrom Innovation Lab Delight 2012 | Nordstrom Innovation Lab
Delight 2012 | Nordstrom Innovation Lab Delight Summit
 
Design thinking for dummies (data scientists)
Design thinking for dummies (data scientists)Design thinking for dummies (data scientists)
Design thinking for dummies (data scientists)Dean Malmgren
 
The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?Mike Rother
 

What's hot (19)

Active Testing: Real time Collaborative Analysis - July event on 'Turning the...
Active Testing: Real time Collaborative Analysis - July event on 'Turning the...Active Testing: Real time Collaborative Analysis - July event on 'Turning the...
Active Testing: Real time Collaborative Analysis - July event on 'Turning the...
 
10 tips for a better survey at UX Bristol
10 tips for a better survey at UX Bristol10 tips for a better survey at UX Bristol
10 tips for a better survey at UX Bristol
 
Root causes by 5 whys
Root causes by 5 whysRoot causes by 5 whys
Root causes by 5 whys
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtc
 
Garnering positive engagement from stakeholders who don’t understand UX
Garnering positive engagement from stakeholders who don’t understand UXGarnering positive engagement from stakeholders who don’t understand UX
Garnering positive engagement from stakeholders who don’t understand UX
 
Easy and affordable user testing - Front Trends 2017
Easy and affordable user testing - Front Trends 2017Easy and affordable user testing - Front Trends 2017
Easy and affordable user testing - Front Trends 2017
 
User Centered Design Presentation
User Centered Design PresentationUser Centered Design Presentation
User Centered Design Presentation
 
Coaching teams in creative problem solving
Coaching teams in creative problem solvingCoaching teams in creative problem solving
Coaching teams in creative problem solving
 
Why why analysis
Why why analysisWhy why analysis
Why why analysis
 
5 why’s technique and cause and effect analysis
5 why’s technique and cause and effect analysis5 why’s technique and cause and effect analysis
5 why’s technique and cause and effect analysis
 
Stanford Peace Innovation Lab: ITBA Argentina workshop day 2
Stanford Peace Innovation Lab: ITBA Argentina workshop day 2Stanford Peace Innovation Lab: ITBA Argentina workshop day 2
Stanford Peace Innovation Lab: ITBA Argentina workshop day 2
 
Katerina clark ppt123
Katerina clark ppt123Katerina clark ppt123
Katerina clark ppt123
 
IDp Lab 2010 1 Assignment
IDp Lab 2010 1 AssignmentIDp Lab 2010 1 Assignment
IDp Lab 2010 1 Assignment
 
User Testing Whirlwind Tour
User Testing Whirlwind TourUser Testing Whirlwind Tour
User Testing Whirlwind Tour
 
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
 
Delight 2012 | Nordstrom Innovation Lab
Delight 2012 | Nordstrom Innovation Lab Delight 2012 | Nordstrom Innovation Lab
Delight 2012 | Nordstrom Innovation Lab
 
Design thinking for dummies (data scientists)
Design thinking for dummies (data scientists)Design thinking for dummies (data scientists)
Design thinking for dummies (data scientists)
 
The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?
 
5 why analysis
5 why analysis5 why analysis
5 why analysis
 

Viewers also liked

Grafico diario del dax perfomance index para el 12 06-2013
Grafico diario del dax perfomance index para el 12 06-2013Grafico diario del dax perfomance index para el 12 06-2013
Grafico diario del dax perfomance index para el 12 06-2013Experiencia Trading
 
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014Jennifer Romano Bergstrom
 
Bibliometrics presentation, Window on Research June 2010
Bibliometrics presentation, Window on Research June 2010Bibliometrics presentation, Window on Research June 2010
Bibliometrics presentation, Window on Research June 2010Jenny Delasalle
 
MUSIC-RESUME-TAMARI-WITKIN.PDF
MUSIC-RESUME-TAMARI-WITKIN.PDFMUSIC-RESUME-TAMARI-WITKIN.PDF
MUSIC-RESUME-TAMARI-WITKIN.PDFTamari Witkin
 
Scrum in Practice: A Developer’s view
Scrum in Practice: A Developer’s viewScrum in Practice: A Developer’s view
Scrum in Practice: A Developer’s viewBosnia Agile
 
Enterprise search in 2013 (update)
Enterprise search in 2013 (update)Enterprise search in 2013 (update)
Enterprise search in 2013 (update)Alex Manchester
 
The £100 million gamble that paid off
The £100 million gamble that paid offThe £100 million gamble that paid off
The £100 million gamble that paid offNewsworks
 
Internet y las Tecnlogías de la Información
Internet y las Tecnlogías de la InformaciónInternet y las Tecnlogías de la Información
Internet y las Tecnlogías de la InformaciónWANDIANN CONSULTORES SAC
 
Сторінками стародавньої Греції
Сторінками стародавньої ГреціїСторінками стародавньої Греції
Сторінками стародавньої ГреціїIrinaKusch
 
Online marketing and data analytics
Online marketing and data analyticsOnline marketing and data analytics
Online marketing and data analyticsMHourigan
 
Использование Google Analytics в интернет магазин
Использование Google Analytics в интернет магазинИспользование Google Analytics в интернет магазин
Использование Google Analytics в интернет магазинRezonans
 
Health Insurance Brochure-The Universal Insurance Company Ltd.
Health Insurance Brochure-The Universal Insurance Company Ltd.Health Insurance Brochure-The Universal Insurance Company Ltd.
Health Insurance Brochure-The Universal Insurance Company Ltd.Muhammad Sameer
 
Graduates: How to build your personal brand (and score a job!) on LinkedIn
Graduates: How to build your personal brand (and score a job!) on LinkedInGraduates: How to build your personal brand (and score a job!) on LinkedIn
Graduates: How to build your personal brand (and score a job!) on LinkedInLauren Gilbert
 
Why culture is the life force of a great (international) business
Why culture is the life force of a great (international) businessWhy culture is the life force of a great (international) business
Why culture is the life force of a great (international) businessMark Ralphs
 

Viewers also liked (17)

Grafico diario del dax perfomance index para el 12 06-2013
Grafico diario del dax perfomance index para el 12 06-2013Grafico diario del dax perfomance index para el 12 06-2013
Grafico diario del dax perfomance index para el 12 06-2013
 
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014User-Centered Research on the Paying for College Website and Tools - EDUI 2014
User-Centered Research on the Paying for College Website and Tools - EDUI 2014
 
Bibliometrics presentation, Window on Research June 2010
Bibliometrics presentation, Window on Research June 2010Bibliometrics presentation, Window on Research June 2010
Bibliometrics presentation, Window on Research June 2010
 
MUSIC-RESUME-TAMARI-WITKIN.PDF
MUSIC-RESUME-TAMARI-WITKIN.PDFMUSIC-RESUME-TAMARI-WITKIN.PDF
MUSIC-RESUME-TAMARI-WITKIN.PDF
 
Scrum in Practice: A Developer’s view
Scrum in Practice: A Developer’s viewScrum in Practice: A Developer’s view
Scrum in Practice: A Developer’s view
 
Enterprise search in 2013 (update)
Enterprise search in 2013 (update)Enterprise search in 2013 (update)
Enterprise search in 2013 (update)
 
The £100 million gamble that paid off
The £100 million gamble that paid offThe £100 million gamble that paid off
The £100 million gamble that paid off
 
Internet y las Tecnlogías de la Información
Internet y las Tecnlogías de la InformaciónInternet y las Tecnlogías de la Información
Internet y las Tecnlogías de la Información
 
Homeless Shelter Webinar 2010
Homeless Shelter Webinar 2010Homeless Shelter Webinar 2010
Homeless Shelter Webinar 2010
 
Сторінками стародавньої Греції
Сторінками стародавньої ГреціїСторінками стародавньої Греції
Сторінками стародавньої Греції
 
Online marketing and data analytics
Online marketing and data analyticsOnline marketing and data analytics
Online marketing and data analytics
 
Использование Google Analytics в интернет магазин
Использование Google Analytics в интернет магазинИспользование Google Analytics в интернет магазин
Использование Google Analytics в интернет магазин
 
Health Insurance Brochure-The Universal Insurance Company Ltd.
Health Insurance Brochure-The Universal Insurance Company Ltd.Health Insurance Brochure-The Universal Insurance Company Ltd.
Health Insurance Brochure-The Universal Insurance Company Ltd.
 
Graduates: How to build your personal brand (and score a job!) on LinkedIn
Graduates: How to build your personal brand (and score a job!) on LinkedInGraduates: How to build your personal brand (and score a job!) on LinkedIn
Graduates: How to build your personal brand (and score a job!) on LinkedIn
 
Business model innovation
Business model innovationBusiness model innovation
Business model innovation
 
What Teachers Hate in Moodle
What Teachers Hate in MoodleWhat Teachers Hate in Moodle
What Teachers Hate in Moodle
 
Why culture is the life force of a great (international) business
Why culture is the life force of a great (international) businessWhy culture is the life force of a great (international) business
Why culture is the life force of a great (international) business
 

Similar to Creating a Virtuous Cycle - The Research and Design Feedback Loop

Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype TestingDave Hora
 
Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Erika Hall
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital ProductKyle Soucy
 
Getting Started with UX Research OCUX Camp CRossi Aug 2017
Getting Started with UX Research OCUX Camp CRossi Aug 2017Getting Started with UX Research OCUX Camp CRossi Aug 2017
Getting Started with UX Research OCUX Camp CRossi Aug 2017Carol Rossi
 
Validating Ideas with Users
Validating Ideas with UsersValidating Ideas with Users
Validating Ideas with UsersSheen Yap
 
Testing Paper Prototypes (IxDworks)
Testing Paper Prototypes (IxDworks)Testing Paper Prototypes (IxDworks)
Testing Paper Prototypes (IxDworks)InteractionDesign
 
How To Ask The Right Questions
How To Ask The Right QuestionsHow To Ask The Right Questions
How To Ask The Right QuestionsHannah Fiechtner
 
Digital Art History: From Practice to Publication
Digital Art History: From Practice to PublicationDigital Art History: From Practice to Publication
Digital Art History: From Practice to PublicationSusan Edwards
 
Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01
Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01
Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01Md Jawed Akbar
 
Getting started with UX research October 2017.pptx
Getting started with UX research October 2017.pptxGetting started with UX research October 2017.pptx
Getting started with UX research October 2017.pptxCarol Rossi
 
Collaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution MalmöCollaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution MalmöErika Hall
 
Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...
Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...
Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...Jonathan Steingiesser
 
Resource and technology design process
Resource and technology  design processResource and technology  design process
Resource and technology design processRobby Jackson
 
IxDworks mini-workshop: Testing Paper Prototyping
IxDworks mini-workshop: Testing Paper PrototypingIxDworks mini-workshop: Testing Paper Prototyping
IxDworks mini-workshop: Testing Paper PrototypingInteractionDesign
 
Writing surveys that work
Writing surveys that workWriting surveys that work
Writing surveys that workrebeccaweiss
 
Principles of interaction design and user testing
Principles of interaction design and user testingPrinciples of interaction design and user testing
Principles of interaction design and user testingJulie Stanford
 

Similar to Creating a Virtuous Cycle - The Research and Design Feedback Loop (20)

Level up your customer research
Level up your customer researchLevel up your customer research
Level up your customer research
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 
Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 
Getting Started with UX Research OCUX Camp CRossi Aug 2017
Getting Started with UX Research OCUX Camp CRossi Aug 2017Getting Started with UX Research OCUX Camp CRossi Aug 2017
Getting Started with UX Research OCUX Camp CRossi Aug 2017
 
Validating Ideas with Users
Validating Ideas with UsersValidating Ideas with Users
Validating Ideas with Users
 
Testing Paper Prototypes (IxDworks)
Testing Paper Prototypes (IxDworks)Testing Paper Prototypes (IxDworks)
Testing Paper Prototypes (IxDworks)
 
How To Ask The Right Questions
How To Ask The Right QuestionsHow To Ask The Right Questions
How To Ask The Right Questions
 
Digital Art History: From Practice to Publication
Digital Art History: From Practice to PublicationDigital Art History: From Practice to Publication
Digital Art History: From Practice to Publication
 
Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01
Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01
Basicqualitytoolspresentationleanjourneyvjen 110917194351-phpapp01
 
7 qc tools
7 qc tools7 qc tools
7 qc tools
 
Getting started with UX research October 2017.pptx
Getting started with UX research October 2017.pptxGetting started with UX research October 2017.pptx
Getting started with UX research October 2017.pptx
 
EXPERIMENT mixtape
EXPERIMENT mixtapeEXPERIMENT mixtape
EXPERIMENT mixtape
 
Collaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution MalmöCollaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution Malmö
 
Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...
Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...
Highlights from Just Enough Research by Erika Hall - User Experience Abu Dhab...
 
Resource and technology design process
Resource and technology  design processResource and technology  design process
Resource and technology design process
 
IxDworks mini-workshop: Testing Paper Prototyping
IxDworks mini-workshop: Testing Paper PrototypingIxDworks mini-workshop: Testing Paper Prototyping
IxDworks mini-workshop: Testing Paper Prototyping
 
Writing surveys that work
Writing surveys that workWriting surveys that work
Writing surveys that work
 
Principles of interaction design and user testing
Principles of interaction design and user testingPrinciples of interaction design and user testing
Principles of interaction design and user testing
 

Creating a Virtuous Cycle - The Research and Design Feedback Loop