SlideShare a Scribd company logo
Creating Better
Research Reports
Less Is More: Delivering Value
(Not Just Reams of Data)
From Your Research
Mike Sherman & Neil Gains
NewMR 2019 Sponsors
Communication
Gold
Silver
Creating Better
Research Reports
Less Is More: Delivering
Value (Not Just Reams of
Data) From Your Research
1. Clients are not happy!
2. Reports are too long and lack a
solution focus.
3. Concise, synthesized reports will
improve client satisfaction.
5
Very
43210
Not
Very
Market
Research
Human
Resources
Information
Services
Marketing
Finance and Accounting
How useful is the information?
In The 1990s CEOs Didn’t Value
Market Research
In 2019 The Problem Persists
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?”
Report Receivers /
Users
Report Creators /
Writers
n=384n=112
In 2019 The Problem Persists
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?”
Report Receivers /
Users
Report Creators /
Writers
n=384n=112
• In what ways was the report good?
“Accurate data, thorough reporting of
results, use of charts and graphs to
help visualize data”
• In what ways was the report poor?
“Writing was overly wordy and
conclusions were not insightful”
Users Want More Than
Visual Appeal*
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
*Note: all paired quotes in this presentation are from the same person
• In what ways was the report good?
“Readability”
• In what ways was the report poor?
“Actionability”
Writers Know That
Actionability Is Lacking
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
Less is More
1. Clients are not happy!
2. Reports are too long and lack a solution
focus.
3. Concise, synthesized reports will improve
client satisfaction.
3 Bad (But Common) Examples
1. The “War and Peace Report”
2. The Data Drop Report
3. The Agatha Christie Report
• In what ways was the report good?
“Good summaries … Very actionable
insights”
• In what ways was the report poor?
“Too long”
Reports Are “Too Long” …
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
CREATOR / WRITER
• In what ways was the report good?
“Met the clients’ stated needs”
• In what ways was the report poor?
“Boring, paint by numbers, way too
long, not actionable”
… Boring…
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
CREATOR / WRITER
• In what ways was the report good?
“Contained the key survey results”
• In what ways was the report poor?
“Tried to cram in too much info,
which made it very confusing to pull
out the insights and actions”
… “Hide” Their Insights …
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
RECEIVER / USER (SUPPLIER)
• In what ways was the report good?
“Comprehensive”
• In what ways was the report poor?
“Lack of insightful analysis”
… And Lack Insights.
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
RECEIVER / USER
“Many researchers are
still uncomfortable with
providing clear, concise
recommendations.”
Marjolein Van Nieuwkasteele,
former Head of Insights, Philips
These Are Long Standing
Problems
Source: Research World, April 2005, pages 13-14
LESS IS MORE
1. Clients are not happy!
2. Reports are too long and lack a solution
focus.
3. Concise, synthesized reports will improve
client satisfaction.
Solution Oriented And
Concise
• End result focused, synthesized
output
• Concise reporting
1. Elevator speech
2. One page executive summary
3. 15-25 page document
4. Extensive appendices
Everybody Agrees What Is
Important
Report Receivers / Users
0% 20% 40% 60% 80% 100%
Detailed
Rigorous
Objective
Practical
Concise
Insightful
Report Creators / Writers
0% 20% 40% 60% 80% 100%
Detailed
Rigorous
Objective
Practical
Concise
Insightful
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “Which of the following do you think are most important for an ‘Excellent’ report?”
• In what ways was the report good?
“Report was visually appealing”
• In what ways was the report poor?
“Lacked clear recommendations
related to the business objectives,
although it met the research
objectives”
Users Want Concise Answers
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
• In what ways was the report good?
“Charting was really well done. Great
infographics work”
• In what ways was the report poor?
“Too much detail … not enough
insights and recommendations”
Writers Know This
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
"People don't want to buy a
quarter-inch drill. They want a
quarter-inch hole!”
Ted Levitt
Harvard Business School
Focus On Outputs, Not Inputs
Synthesis, Not Summary
SYNTHESIS
I’ve been living
dangerously
FACTS
I broke my knee
A burglar knocked in my
car window
I got a speeding ticket
SUMMARY
My knee, car and wallet
were all damaged
recently
The Elevator Speech
• Would your audience know your core
message from sharing a lift with you for less
than a minute…
• What issue you are addressing?
• What is your current hypothesis (answer)?
• What your next steps are?
• What do you want your audience to say when
they have to tell someone who hasn’t read the
report?
Elevator Speech
Best Case Example
New Product Test
Answer: Launch!
Executive Summary
1. One page!
2. Starts with
elevator speech
3. Gives 2-5 key
reasons why
[Elevator Speech...........
.......................................
...............................] This is the
answer because:
1. _______________
2. _______________
3. _______________
POINT A
•1
•2
•3
POINT B
•4
•5
•6
POINT C
•7
•8
•9
OTHER FINDINGS
10.
11.
12.
BACKGROUNDCOVER PAGE
EXECUTIVE SUMMARY
A.
B.
C.
CHART 2 CHART 3CHART 1
CHART 5 CHART 6CHART 4
CHART 8 CHART 9CHART 7
CHART 11 CHART 12CHART 10
NEXT STEPS APPENDIX
20 Pages!
1 2
3 4 5 6
10
14
987
131211
15 16 17 18
19 20
Concise Report
The Pyramid Principle
• Barbara Minto’s Pyramid
Principle: Logic in Writing,
Thinking and Problem
Solving
• Used extensively in
professional service firms
• “The technique is most
useful for those people in
an organization who must
write long analytical
documents, on the basis
of which other people
must make decisions.”
Things Are Better, But More
Improvement Is Needed
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Much worse Worse About the same Better Much better
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “Compared to two years ago, do you think the quality of reports now is …?”
Report Receivers /
Users
Report Creators /
Writers
LESS IS MORE
1. Clients are not happy!
2. Reports are too long and lack a solution
focus.
3. Concise, synthesized reports will improve
client satisfaction.
Q & A
Creating Better
Research Reports
Neil Gains
neil@tapestry.works
Mike Sherman
Mike@MikeSherman.net
Ray Poynter
NewMR 2019 Sponsors
Communication
Gold
Silver
Creating Better
Research Reports

More Related Content

What's hot

[Webinar] Survey and Net Promoter Score Best Practices
[Webinar] Survey and Net Promoter Score Best Practices[Webinar] Survey and Net Promoter Score Best Practices
[Webinar] Survey and Net Promoter Score Best Practices
Gainsight
 
NPS Sample Presentation
NPS Sample PresentationNPS Sample Presentation
NPS Sample Presentation
Marshall Anderson
 
Consumer Time Survey: Unwinding Think-Time
Consumer Time Survey: Unwinding Think-Time Consumer Time Survey: Unwinding Think-Time
Consumer Time Survey: Unwinding Think-Time
ZappiStore
 
Speech analytics solution overview
Speech analytics solution overviewSpeech analytics solution overview
Speech analytics solution overview
Rajkumar Subramanian
 
30 Must Read Resources to Improve your NPS
30 Must Read Resources to Improve your NPS30 Must Read Resources to Improve your NPS
30 Must Read Resources to Improve your NPS
Katarína Kasalová
 
BoSUSA20 Online | Matt Lerner | Metrics that Matter
BoSUSA20 Online | Matt Lerner | Metrics that Matter BoSUSA20 Online | Matt Lerner | Metrics that Matter
BoSUSA20 Online | Matt Lerner | Metrics that Matter
Business of Software Conference
 
User Insights, Data Driven Design, and Stakeholder Buy In
User Insights, Data Driven Design, and Stakeholder Buy InUser Insights, Data Driven Design, and Stakeholder Buy In
User Insights, Data Driven Design, and Stakeholder Buy In
Matt Martin
 
A bridge between two worlds – where qual and quant meet: Slides from UX Austr...
A bridge between two worlds – where qual and quant meet: Slides from UX Austr...A bridge between two worlds – where qual and quant meet: Slides from UX Austr...
A bridge between two worlds – where qual and quant meet: Slides from UX Austr...
U1 Group
 
InfoQuest Intro PowerPoint
InfoQuest Intro PowerPointInfoQuest Intro PowerPoint
InfoQuest Intro PowerPoint
John Coldwell
 
Nps building guest loyalty
Nps   building guest loyaltyNps   building guest loyalty
Nps building guest loyalty
Snigdha Majumder
 
Net Promoter Score
Net Promoter ScoreNet Promoter Score
Net Promoter Score
Chen Zunqiu
 
10 Things to Know about Net Promoter ScoresPRES
10 Things to Know about Net Promoter ScoresPRES10 Things to Know about Net Promoter ScoresPRES
10 Things to Know about Net Promoter ScoresPRES
Ed Smith
 
Sourcing rubric
Sourcing rubricSourcing rubric
Sourcing rubric
EricaFoxx
 
Asmi San Diego
Asmi San DiegoAsmi San Diego
Asmi San Diego
donhendricks
 

What's hot (14)

[Webinar] Survey and Net Promoter Score Best Practices
[Webinar] Survey and Net Promoter Score Best Practices[Webinar] Survey and Net Promoter Score Best Practices
[Webinar] Survey and Net Promoter Score Best Practices
 
NPS Sample Presentation
NPS Sample PresentationNPS Sample Presentation
NPS Sample Presentation
 
Consumer Time Survey: Unwinding Think-Time
Consumer Time Survey: Unwinding Think-Time Consumer Time Survey: Unwinding Think-Time
Consumer Time Survey: Unwinding Think-Time
 
Speech analytics solution overview
Speech analytics solution overviewSpeech analytics solution overview
Speech analytics solution overview
 
30 Must Read Resources to Improve your NPS
30 Must Read Resources to Improve your NPS30 Must Read Resources to Improve your NPS
30 Must Read Resources to Improve your NPS
 
BoSUSA20 Online | Matt Lerner | Metrics that Matter
BoSUSA20 Online | Matt Lerner | Metrics that Matter BoSUSA20 Online | Matt Lerner | Metrics that Matter
BoSUSA20 Online | Matt Lerner | Metrics that Matter
 
User Insights, Data Driven Design, and Stakeholder Buy In
User Insights, Data Driven Design, and Stakeholder Buy InUser Insights, Data Driven Design, and Stakeholder Buy In
User Insights, Data Driven Design, and Stakeholder Buy In
 
A bridge between two worlds – where qual and quant meet: Slides from UX Austr...
A bridge between two worlds – where qual and quant meet: Slides from UX Austr...A bridge between two worlds – where qual and quant meet: Slides from UX Austr...
A bridge between two worlds – where qual and quant meet: Slides from UX Austr...
 
InfoQuest Intro PowerPoint
InfoQuest Intro PowerPointInfoQuest Intro PowerPoint
InfoQuest Intro PowerPoint
 
Nps building guest loyalty
Nps   building guest loyaltyNps   building guest loyalty
Nps building guest loyalty
 
Net Promoter Score
Net Promoter ScoreNet Promoter Score
Net Promoter Score
 
10 Things to Know about Net Promoter ScoresPRES
10 Things to Know about Net Promoter ScoresPRES10 Things to Know about Net Promoter ScoresPRES
10 Things to Know about Net Promoter ScoresPRES
 
Sourcing rubric
Sourcing rubricSourcing rubric
Sourcing rubric
 
Asmi San Diego
Asmi San DiegoAsmi San Diego
Asmi San Diego
 

Similar to Less is More: Delivering Value (Not Just Reams of Data From Your Research)

The Hole, Not The Drill. Why reporting should focus on the solution (and not ...
The Hole, Not The Drill. Why reporting should focus on the solution (and not ...The Hole, Not The Drill. Why reporting should focus on the solution (and not ...
The Hole, Not The Drill. Why reporting should focus on the solution (and not ...
Ray Poynter
 
Methodology dimension voice of customer
Methodology   dimension voice of customerMethodology   dimension voice of customer
Methodology dimension voice of customer
Jean-François Nguyen
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
Robin Norton
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
Robin Norton
 
Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010
AgileCoach.net
 
Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...
AGILEMinds
 
Ten Steps for Conducting a Communications Audit By Katlin Sm.docx
Ten Steps for Conducting a Communications Audit By Katlin Sm.docxTen Steps for Conducting a Communications Audit By Katlin Sm.docx
Ten Steps for Conducting a Communications Audit By Katlin Sm.docx
mehek4
 
Yale infobook 2013 Full.pdf
Yale infobook 2013 Full.pdfYale infobook 2013 Full.pdf
Yale infobook 2013 Full.pdf
ArushSinhal1
 
Using research to generate positive media coverage - improve your approach in...
Using research to generate positive media coverage - improve your approach in...Using research to generate positive media coverage - improve your approach in...
Using research to generate positive media coverage - improve your approach in...
CharityComms
 
Elite Paint Internship Report (EPCIL)
Elite Paint Internship Report (EPCIL)Elite Paint Internship Report (EPCIL)
Elite Paint Internship Report (EPCIL)
Jannatul Nayeem
 
PQF Overview
PQF OverviewPQF Overview
PQF Overview
Martin Hutchings
 
Client proposition toolkit liberty
Client proposition toolkit libertyClient proposition toolkit liberty
Client proposition toolkit liberty
Senate Group Financial Advisors
 
The Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsThe Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data Analytics
ConvertML. ai
 
Getting at the goals of the customer
Getting at the goals of the customerGetting at the goals of the customer
Getting at the goals of the customer
Voluntas_Insights
 
User needs & Covid-19: How to tune into your customer needs during rapidly ch...
User needs & Covid-19: How to tune into your customer needs during rapidly ch...User needs & Covid-19: How to tune into your customer needs during rapidly ch...
User needs & Covid-19: How to tune into your customer needs during rapidly ch...
AJ Davis
 
Why your analytics land with a thud
Why your analytics land with a thudWhy your analytics land with a thud
Why your analytics land with a thud
One North
 
The Value of Developing Relationships in Selling
The Value of Developing Relationships in SellingThe Value of Developing Relationships in Selling
The Value of Developing Relationships in Selling
James Muir
 
From data to business intelligence
From data to business intelligenceFrom data to business intelligence
From data to business intelligence
njaffe
 
Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.
mResearcher
 
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
Frank Strong
 

Similar to Less is More: Delivering Value (Not Just Reams of Data From Your Research) (20)

The Hole, Not The Drill. Why reporting should focus on the solution (and not ...
The Hole, Not The Drill. Why reporting should focus on the solution (and not ...The Hole, Not The Drill. Why reporting should focus on the solution (and not ...
The Hole, Not The Drill. Why reporting should focus on the solution (and not ...
 
Methodology dimension voice of customer
Methodology   dimension voice of customerMethodology   dimension voice of customer
Methodology dimension voice of customer
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
 
Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010
 
Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...
 
Ten Steps for Conducting a Communications Audit By Katlin Sm.docx
Ten Steps for Conducting a Communications Audit By Katlin Sm.docxTen Steps for Conducting a Communications Audit By Katlin Sm.docx
Ten Steps for Conducting a Communications Audit By Katlin Sm.docx
 
Yale infobook 2013 Full.pdf
Yale infobook 2013 Full.pdfYale infobook 2013 Full.pdf
Yale infobook 2013 Full.pdf
 
Using research to generate positive media coverage - improve your approach in...
Using research to generate positive media coverage - improve your approach in...Using research to generate positive media coverage - improve your approach in...
Using research to generate positive media coverage - improve your approach in...
 
Elite Paint Internship Report (EPCIL)
Elite Paint Internship Report (EPCIL)Elite Paint Internship Report (EPCIL)
Elite Paint Internship Report (EPCIL)
 
PQF Overview
PQF OverviewPQF Overview
PQF Overview
 
Client proposition toolkit liberty
Client proposition toolkit libertyClient proposition toolkit liberty
Client proposition toolkit liberty
 
The Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsThe Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data Analytics
 
Getting at the goals of the customer
Getting at the goals of the customerGetting at the goals of the customer
Getting at the goals of the customer
 
User needs & Covid-19: How to tune into your customer needs during rapidly ch...
User needs & Covid-19: How to tune into your customer needs during rapidly ch...User needs & Covid-19: How to tune into your customer needs during rapidly ch...
User needs & Covid-19: How to tune into your customer needs during rapidly ch...
 
Why your analytics land with a thud
Why your analytics land with a thudWhy your analytics land with a thud
Why your analytics land with a thud
 
The Value of Developing Relationships in Selling
The Value of Developing Relationships in SellingThe Value of Developing Relationships in Selling
The Value of Developing Relationships in Selling
 
From data to business intelligence
From data to business intelligenceFrom data to business intelligence
From data to business intelligence
 
Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.
 
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
 

More from Ray Poynter

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and Findings
Ray Poynter
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis tool
Ray Poynter
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from Yasna
Ray Poynter
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So Far
Ray Poynter
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMR
Ray Poynter
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of Beliefs
Ray Poynter
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden Narratives
Ray Poynter
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at Mondelēz
Ray Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
Ray Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
Ray Poynter
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023
Ray Poynter
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AI
Ray Poynter
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?
Ray Poynter
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
Ray Poynter
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
Ray Poynter
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Ray Poynter
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPT
Ray Poynter
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Ray Poynter
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business Growth
Ray Poynter
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Ray Poynter
 

More from Ray Poynter (20)

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and Findings
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis tool
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from Yasna
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So Far
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMR
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of Beliefs
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden Narratives
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at Mondelēz
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AI
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPT
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business Growth
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer research
 

Recently uploaded

Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...
PsychoTech Services
 
A Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two HeartsA Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two Hearts
Steve Thomason
 
Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10
nitinpv4ai
 
REASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdf
REASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdfREASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdf
REASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdf
giancarloi8888
 
Nutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour TrainingNutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour Training
melliereed
 
Pharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brubPharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brub
danielkiash986
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
GeorgeMilliken2
 
Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)
nitinpv4ai
 
skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)
Mohammad Al-Dhahabi
 
HYPERTENSION - SLIDE SHARE PRESENTATION.
HYPERTENSION - SLIDE SHARE PRESENTATION.HYPERTENSION - SLIDE SHARE PRESENTATION.
HYPERTENSION - SLIDE SHARE PRESENTATION.
deepaannamalai16
 
CIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdfCIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdf
blueshagoo1
 
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxBeyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
EduSkills OECD
 
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptxBIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
RidwanHassanYusuf
 
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
Nguyen Thanh Tu Collection
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
HajraNaeem15
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 
MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025
khuleseema60
 
Juneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School DistrictJuneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School District
David Douglas School District
 
Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"
National Information Standards Organization (NISO)
 
How Barcodes Can Be Leveraged Within Odoo 17
How Barcodes Can Be Leveraged Within Odoo 17How Barcodes Can Be Leveraged Within Odoo 17
How Barcodes Can Be Leveraged Within Odoo 17
Celine George
 

Recently uploaded (20)

Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...
 
A Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two HeartsA Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two Hearts
 
Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10
 
REASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdf
REASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdfREASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdf
REASIGNACION 2024 UGEL CHUPACA 2024 UGEL CHUPACA.pdf
 
Nutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour TrainingNutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour Training
 
Pharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brubPharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brub
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
 
Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)
 
skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)
 
HYPERTENSION - SLIDE SHARE PRESENTATION.
HYPERTENSION - SLIDE SHARE PRESENTATION.HYPERTENSION - SLIDE SHARE PRESENTATION.
HYPERTENSION - SLIDE SHARE PRESENTATION.
 
CIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdfCIS 4200-02 Group 1 Final Project Report (1).pdf
CIS 4200-02 Group 1 Final Project Report (1).pdf
 
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxBeyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx
 
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptxBIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
 
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
BÀI TẬP BỔ TRỢ TIẾNG ANH LỚP 9 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2024-2025 - ...
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 
MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025
 
Juneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School DistrictJuneteenth Freedom Day 2024 David Douglas School District
Juneteenth Freedom Day 2024 David Douglas School District
 
Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"
 
How Barcodes Can Be Leveraged Within Odoo 17
How Barcodes Can Be Leveraged Within Odoo 17How Barcodes Can Be Leveraged Within Odoo 17
How Barcodes Can Be Leveraged Within Odoo 17
 

Less is More: Delivering Value (Not Just Reams of Data From Your Research)

  • 1. Creating Better Research Reports Less Is More: Delivering Value (Not Just Reams of Data) From Your Research Mike Sherman & Neil Gains
  • 3. Less Is More: Delivering Value (Not Just Reams of Data) From Your Research 1. Clients are not happy! 2. Reports are too long and lack a solution focus. 3. Concise, synthesized reports will improve client satisfaction.
  • 4. 5 Very 43210 Not Very Market Research Human Resources Information Services Marketing Finance and Accounting How useful is the information? In The 1990s CEOs Didn’t Value Market Research
  • 5. In 2019 The Problem Persists 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?” Report Receivers / Users Report Creators / Writers n=384n=112
  • 6. In 2019 The Problem Persists 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?” Report Receivers / Users Report Creators / Writers n=384n=112
  • 7. • In what ways was the report good? “Accurate data, thorough reporting of results, use of charts and graphs to help visualize data” • In what ways was the report poor? “Writing was overly wordy and conclusions were not insightful” Users Want More Than Visual Appeal* Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” *Note: all paired quotes in this presentation are from the same person
  • 8. • In what ways was the report good? “Readability” • In what ways was the report poor? “Actionability” Writers Know That Actionability Is Lacking Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
  • 9. Less is More 1. Clients are not happy! 2. Reports are too long and lack a solution focus. 3. Concise, synthesized reports will improve client satisfaction.
  • 10. 3 Bad (But Common) Examples 1. The “War and Peace Report” 2. The Data Drop Report 3. The Agatha Christie Report
  • 11. • In what ways was the report good? “Good summaries … Very actionable insights” • In what ways was the report poor? “Too long” Reports Are “Too Long” … Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” CREATOR / WRITER
  • 12. • In what ways was the report good? “Met the clients’ stated needs” • In what ways was the report poor? “Boring, paint by numbers, way too long, not actionable” … Boring… Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” CREATOR / WRITER
  • 13. • In what ways was the report good? “Contained the key survey results” • In what ways was the report poor? “Tried to cram in too much info, which made it very confusing to pull out the insights and actions” … “Hide” Their Insights … Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” RECEIVER / USER (SUPPLIER)
  • 14. • In what ways was the report good? “Comprehensive” • In what ways was the report poor? “Lack of insightful analysis” … And Lack Insights. Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” RECEIVER / USER
  • 15. “Many researchers are still uncomfortable with providing clear, concise recommendations.” Marjolein Van Nieuwkasteele, former Head of Insights, Philips These Are Long Standing Problems Source: Research World, April 2005, pages 13-14
  • 16. LESS IS MORE 1. Clients are not happy! 2. Reports are too long and lack a solution focus. 3. Concise, synthesized reports will improve client satisfaction.
  • 17. Solution Oriented And Concise • End result focused, synthesized output • Concise reporting 1. Elevator speech 2. One page executive summary 3. 15-25 page document 4. Extensive appendices
  • 18. Everybody Agrees What Is Important Report Receivers / Users 0% 20% 40% 60% 80% 100% Detailed Rigorous Objective Practical Concise Insightful Report Creators / Writers 0% 20% 40% 60% 80% 100% Detailed Rigorous Objective Practical Concise Insightful Source: NewMR “Quality of Market Research Reports” survey, March 2019, “Which of the following do you think are most important for an ‘Excellent’ report?”
  • 19. • In what ways was the report good? “Report was visually appealing” • In what ways was the report poor? “Lacked clear recommendations related to the business objectives, although it met the research objectives” Users Want Concise Answers Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
  • 20. • In what ways was the report good? “Charting was really well done. Great infographics work” • In what ways was the report poor? “Too much detail … not enough insights and recommendations” Writers Know This Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
  • 21. "People don't want to buy a quarter-inch drill. They want a quarter-inch hole!” Ted Levitt Harvard Business School Focus On Outputs, Not Inputs
  • 22. Synthesis, Not Summary SYNTHESIS I’ve been living dangerously FACTS I broke my knee A burglar knocked in my car window I got a speeding ticket SUMMARY My knee, car and wallet were all damaged recently
  • 23. The Elevator Speech • Would your audience know your core message from sharing a lift with you for less than a minute… • What issue you are addressing? • What is your current hypothesis (answer)? • What your next steps are? • What do you want your audience to say when they have to tell someone who hasn’t read the report?
  • 24.
  • 25. Elevator Speech Best Case Example New Product Test Answer: Launch!
  • 26. Executive Summary 1. One page! 2. Starts with elevator speech 3. Gives 2-5 key reasons why [Elevator Speech........... ....................................... ...............................] This is the answer because: 1. _______________ 2. _______________ 3. _______________
  • 27. POINT A •1 •2 •3 POINT B •4 •5 •6 POINT C •7 •8 •9 OTHER FINDINGS 10. 11. 12. BACKGROUNDCOVER PAGE EXECUTIVE SUMMARY A. B. C. CHART 2 CHART 3CHART 1 CHART 5 CHART 6CHART 4 CHART 8 CHART 9CHART 7 CHART 11 CHART 12CHART 10 NEXT STEPS APPENDIX 20 Pages! 1 2 3 4 5 6 10 14 987 131211 15 16 17 18 19 20 Concise Report
  • 28. The Pyramid Principle • Barbara Minto’s Pyramid Principle: Logic in Writing, Thinking and Problem Solving • Used extensively in professional service firms • “The technique is most useful for those people in an organization who must write long analytical documents, on the basis of which other people must make decisions.”
  • 29. Things Are Better, But More Improvement Is Needed 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Much worse Worse About the same Better Much better Source: NewMR “Quality of Market Research Reports” survey, March 2019, “Compared to two years ago, do you think the quality of reports now is …?” Report Receivers / Users Report Creators / Writers
  • 30. LESS IS MORE 1. Clients are not happy! 2. Reports are too long and lack a solution focus. 3. Concise, synthesized reports will improve client satisfaction.
  • 31. Q & A Creating Better Research Reports Neil Gains neil@tapestry.works Mike Sherman Mike@MikeSherman.net Ray Poynter