SlideShare a Scribd company logo
1 of 47
Market Research Why it’s broken, how you can fix it Complicating marketing
“  research is  bad  ” innovation creativity distinctiveness
“  research is  good  ”   innovation creativity distinctiveness
let’s complicate this…
(creative development) (confirmatory research) (exploratory research)
(exploratory research)
“ exploratory research is what you do  when you don’t know what to do”
Exploratory research  today
[ “If I‘d asked my customers what they wanted, they’d have said  a faster horse.” H. Ford ] People don’t know what they’ll want in the future
[ “Consumers’ ability to discriminate and  make consistent preferences is low,  and lower that they believe it is.” P. Raghubir ] People don’t know what they want today
[ According to a survey we run when working on a toiletries brand,  consumers replaced their  toothbrush once a month. If that were true, we could have all retired and moved to Florida ] People lie (consciously and unconsciously)
we’re asking consumers  to look at our life and make it easier,  while we should be looking at their life  and make it better.
 
#1 WE GOTTA GET OUT OF THIS PLACE! [  The Animals   ]
#2 LISTEN TO  EVERYONE [ Early adopters, late adopters,  recent quitters,  designers, distributors,  influencers… ]
#3 HEAR THE SILENCES [ Just like jazz, research is about the silences and the notes not played. What is not said can be as important as what is said.  Look for omissions and facial expressions ]
 
#5 LOOK FOR UNEXPECTED ANALOGIES [ People don’t know how they will react  to the change  that you’re about  to bring in your industry,  but they  might have experienced  something similar in a different environment ]
  #6 BE   INVISIBLE [ People don’t behave naturally when questioned by a stranger in an alien environment. Try to disapper ]
#7 BE TRUE [ Don’t tell if you simulate Don’t simulate if you can make real ]
#8 BE CLEVER [ “The ability to ask the right question is more than half  the battle of finding the answer” – T M Disch ]
(exploratory research) d i v e r s i t y
(creative development) (confirmatory research) (exploratory research) d i v e r s i t y
(confirmatory research)
“ confirmatory research is what you do  when you think you know what to do”
Confirmatory research  today
People still don’t know and lie
We don’t ask the right questions [ We tend to rely on a standard set  of universally accepted KPIs, instead of  taking time to ask ourselves what is really important ]
We make it harder for them to answer [ Showing storyboards for a campaign is like miming The Lord of The Rings  and then asking who’d go watch it ]
we don’t know what we’re asking people  that wouldn’t know what to tell us  about something that we’re not giving them.
 
#1 REFINE YOUR AUDIENCE [ “Joe Public” are the toughest audience to make sense of, because they’re defined by the lack of any meaningful attribute ]
#2 IMPROVE YOUR STORYTELLING [ Make them “feel” what your product is like, rather than describing the details or sharing a poor mock-up that is nothing like the finished product ]
#3 FOCUS ON WHAT REALLY MATTERS [ Not everything that is important can be measured,  and not everything that can be measured  is important – A. Einstein ]
#4 RE-EVALUATE YOUR KPIs [ Over time every performance indicator becomes insignificant, as actions are going to be designed to address the formal indicator, rather than the substantial goal that it is meant to represent.  Make sure that the metric serve the work, and not the other way around ]
#5 LOOK FOR  STANDARD DEVIATION [ Average is often misleading. Distribution tells the real story ]
#6 YOU DON’T HAVE TO BE EVERYONE’S BEST FRIEND [ That’d be spooky.  And in most markets,  being loved by 20% of people is  more profitable than being  considered by 80% ]
#7 DON’T ASK CONSUMERS TO FIX IT [ Or if you do, take their feedback as insights, not as amends. Marketing is not a democracy.  If you think that superficial thoughts from random consumers  are more reliable than your creative agency or your staff, there’s only one thing you should do:  fire them ]
#8 BE CLEVER [ Even when we all watch the same data, it doesn’t mean that we’re all going to see the same insights ]
(confirmatory research) PRECISENESS
(creative development) (confirmatory research) PRECISENESS (exploratory research) d i v e r s i t y
bad   researchers make research  bad
good   researchers make research  good
what are  you  doing to make research  good ?
tell me at  itscomplic8ed.wordpress.com
Thanks to  Marc van der Chijs, Jill Greenberg, Mksavage, Katerha, 92YRTribeca  and  Mishelle Lane for allowing use of their beautiful pictures under    license
itscomplic8ed.wordpress.com @stefanoaugello

More Related Content

Similar to Market research: why it's broken, how you can fix it.

How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...
How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...
How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...
Centerline Digital
 

Similar to Market research: why it's broken, how you can fix it. (20)

The credibility problem
The credibility problemThe credibility problem
The credibility problem
 
Reflections from Planningness 2014
Reflections from Planningness 2014Reflections from Planningness 2014
Reflections from Planningness 2014
 
Hacking Direct
Hacking DirectHacking Direct
Hacking Direct
 
Lean Customer Discovery Needs Deep Empathy
Lean Customer Discovery Needs Deep Empathy Lean Customer Discovery Needs Deep Empathy
Lean Customer Discovery Needs Deep Empathy
 
Defineanaudience1
Defineanaudience1Defineanaudience1
Defineanaudience1
 
Collaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution MalmöCollaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution Malmö
 
Promote like a Trump
Promote like a TrumpPromote like a Trump
Promote like a Trump
 
Behavioral economics
Behavioral economicsBehavioral economics
Behavioral economics
 
How to Lie with Design Research
How to Lie with Design ResearchHow to Lie with Design Research
How to Lie with Design Research
 
Task 1
Task 1Task 1
Task 1
 
Spot opportunities for strategy
Spot opportunities for strategySpot opportunities for strategy
Spot opportunities for strategy
 
Creating Demand
Creating DemandCreating Demand
Creating Demand
 
Advocacy-vs-Inquiry-2015.pptx
Advocacy-vs-Inquiry-2015.pptxAdvocacy-vs-Inquiry-2015.pptx
Advocacy-vs-Inquiry-2015.pptx
 
Task 1
Task 1 Task 1
Task 1
 
The Sound's Approach to Creative Development Research
The Sound's Approach to Creative Development ResearchThe Sound's Approach to Creative Development Research
The Sound's Approach to Creative Development Research
 
How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...
How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...
How Humans Think - UX and Content Marketing - Cait Vlastakis Smith - Centerli...
 
BAS meets InSites Consulting
BAS meets InSites ConsultingBAS meets InSites Consulting
BAS meets InSites Consulting
 
Product Anonymous: After Research - Creating Useful & Well Executed Research ...
Product Anonymous: After Research - Creating Useful & Well Executed Research ...Product Anonymous: After Research - Creating Useful & Well Executed Research ...
Product Anonymous: After Research - Creating Useful & Well Executed Research ...
 
Mindera Handbook.pdf
Mindera Handbook.pdfMindera Handbook.pdf
Mindera Handbook.pdf
 
Jon Dodd - How to spot good from bad research for any customer interaction |...
Jon Dodd - How to spot good from bad research for any customer interaction  |...Jon Dodd - How to spot good from bad research for any customer interaction  |...
Jon Dodd - How to spot good from bad research for any customer interaction |...
 

Recently uploaded

Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
lizamodels9
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
dollysharma2066
 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Dipal Arora
 
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pillsMifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Abortion pills in Kuwait Cytotec pills in Kuwait
 

Recently uploaded (20)

Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Service
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
 
How to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityHow to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League City
 
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.
 
HONOR Veterans Event Keynote by Michael Hawkins
HONOR Veterans Event Keynote by Michael HawkinsHONOR Veterans Event Keynote by Michael Hawkins
HONOR Veterans Event Keynote by Michael Hawkins
 
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...
 
Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...
Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...
Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...
 
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdfDr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 
Boost the utilization of your HCL environment by reevaluating use cases and f...
Boost the utilization of your HCL environment by reevaluating use cases and f...Boost the utilization of your HCL environment by reevaluating use cases and f...
Boost the utilization of your HCL environment by reevaluating use cases and f...
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
 
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A  SALESMAN / WOMANA DAY IN THE LIFE OF A  SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMAN
 
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pillsMifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
 
Monte Carlo simulation : Simulation using MCSM
Monte Carlo simulation : Simulation using MCSMMonte Carlo simulation : Simulation using MCSM
Monte Carlo simulation : Simulation using MCSM
 
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
👉Chandigarh Call Girls 👉9878799926👉Just Call👉Chandigarh Call Girl In Chandiga...
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Service
 
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
 

Market research: why it's broken, how you can fix it.

  • 1. Market Research Why it’s broken, how you can fix it Complicating marketing
  • 2. “ research is bad ” innovation creativity distinctiveness
  • 3. “ research is good ” innovation creativity distinctiveness
  • 5. (creative development) (confirmatory research) (exploratory research)
  • 7. “ exploratory research is what you do when you don’t know what to do”
  • 9. [ “If I‘d asked my customers what they wanted, they’d have said a faster horse.” H. Ford ] People don’t know what they’ll want in the future
  • 10. [ “Consumers’ ability to discriminate and make consistent preferences is low, and lower that they believe it is.” P. Raghubir ] People don’t know what they want today
  • 11. [ According to a survey we run when working on a toiletries brand, consumers replaced their toothbrush once a month. If that were true, we could have all retired and moved to Florida ] People lie (consciously and unconsciously)
  • 12. we’re asking consumers to look at our life and make it easier, while we should be looking at their life and make it better.
  • 13.  
  • 14. #1 WE GOTTA GET OUT OF THIS PLACE! [ The Animals ]
  • 15. #2 LISTEN TO EVERYONE [ Early adopters, late adopters, recent quitters, designers, distributors, influencers… ]
  • 16. #3 HEAR THE SILENCES [ Just like jazz, research is about the silences and the notes not played. What is not said can be as important as what is said. Look for omissions and facial expressions ]
  • 17.  
  • 18. #5 LOOK FOR UNEXPECTED ANALOGIES [ People don’t know how they will react to the change that you’re about to bring in your industry, but they might have experienced something similar in a different environment ]
  • 19. #6 BE INVISIBLE [ People don’t behave naturally when questioned by a stranger in an alien environment. Try to disapper ]
  • 20. #7 BE TRUE [ Don’t tell if you simulate Don’t simulate if you can make real ]
  • 21. #8 BE CLEVER [ “The ability to ask the right question is more than half the battle of finding the answer” – T M Disch ]
  • 22. (exploratory research) d i v e r s i t y
  • 23. (creative development) (confirmatory research) (exploratory research) d i v e r s i t y
  • 25. “ confirmatory research is what you do when you think you know what to do”
  • 27. People still don’t know and lie
  • 28. We don’t ask the right questions [ We tend to rely on a standard set of universally accepted KPIs, instead of taking time to ask ourselves what is really important ]
  • 29. We make it harder for them to answer [ Showing storyboards for a campaign is like miming The Lord of The Rings and then asking who’d go watch it ]
  • 30. we don’t know what we’re asking people that wouldn’t know what to tell us about something that we’re not giving them.
  • 31.  
  • 32. #1 REFINE YOUR AUDIENCE [ “Joe Public” are the toughest audience to make sense of, because they’re defined by the lack of any meaningful attribute ]
  • 33. #2 IMPROVE YOUR STORYTELLING [ Make them “feel” what your product is like, rather than describing the details or sharing a poor mock-up that is nothing like the finished product ]
  • 34. #3 FOCUS ON WHAT REALLY MATTERS [ Not everything that is important can be measured, and not everything that can be measured is important – A. Einstein ]
  • 35. #4 RE-EVALUATE YOUR KPIs [ Over time every performance indicator becomes insignificant, as actions are going to be designed to address the formal indicator, rather than the substantial goal that it is meant to represent. Make sure that the metric serve the work, and not the other way around ]
  • 36. #5 LOOK FOR STANDARD DEVIATION [ Average is often misleading. Distribution tells the real story ]
  • 37. #6 YOU DON’T HAVE TO BE EVERYONE’S BEST FRIEND [ That’d be spooky. And in most markets, being loved by 20% of people is more profitable than being considered by 80% ]
  • 38. #7 DON’T ASK CONSUMERS TO FIX IT [ Or if you do, take their feedback as insights, not as amends. Marketing is not a democracy. If you think that superficial thoughts from random consumers are more reliable than your creative agency or your staff, there’s only one thing you should do: fire them ]
  • 39. #8 BE CLEVER [ Even when we all watch the same data, it doesn’t mean that we’re all going to see the same insights ]
  • 41. (creative development) (confirmatory research) PRECISENESS (exploratory research) d i v e r s i t y
  • 42. bad researchers make research bad
  • 43. good researchers make research good
  • 44. what are you doing to make research good ?
  • 45. tell me at itscomplic8ed.wordpress.com
  • 46. Thanks to Marc van der Chijs, Jill Greenberg, Mksavage, Katerha, 92YRTribeca and Mishelle Lane for allowing use of their beautiful pictures under license

Editor's Notes

  1. Marc van der Chijs: http://www.flickr.com/photos/chijs/35531919/
  2. Mksavage: http://www.flickr.com/photos/30898003@N08/4395164014/
  3. Katerha: http://www.flickr.com/photos/katerha/4592429363/sizes/l/in/photostream/
  4. PSDFan.com
  5. 92YRTribeca: http://www.flickr.com/photos/92ytribeca/4876571952/sizes/l/in/photostream/
  6. Mishelle Lane: http://www.flickr.com/photos/secretagentmama/4365563084/sizes/o/in/photostream/