SlideShare a Scribd company logo
1 of 29
Download to read offline
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
52	Things	We	Wish	
Someone	Had	Told	
Us	About	Customer	
Analytics	
	
Mike	Sherman	
March	6,	2019
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Use	Of	Analytics	to	Drive	Decisions		
Not	Good	and	Getting	Worse
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Selected	Ideas	(from	the	52)	
Copyright 2018 Alex and Mike Sherman
1.  The Hole, Not The Drill
2.  Saint Jerry McGuire
3.  BS Matters
4.  Beware of Meaningless Numbers and Calculations
5.  Correlation Is Not Causality
6.  Challenge Your Metrics
7.  Seeing But Not Understanding
8.  Ask Questions
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
1.	Focus	On	Outputs,	Not	Tools	
Copyright 2018 Alex and Mike Sherman
"People don't want to buy a
quarter-inch drill. They want
a quarter-inch hole!”
Ted Levitt
Harvard Business School
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
2.	Saint	Jerry	McGuire	
Copyright 2018 Alex and Mike Sherman
Show Me
the Money!
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Leverage
Analysis
Use
Judgement
Uncertainty
High
Low
Low High
Value at Risk
?
Copyright 2018 Alex and Mike Sherman
Are we
doing too
much work
here?
3.	BS	(Business	Significance)	Matters	
Are we doing
enough analysis
here?
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
4.	Beware	Of	Meaningless	Numbers…	
Copyright 2018 Alex and Mike Sherman
On Average I
Hit Straight
Down The
Fairway …
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
…	And	Meaningless	Calculations!	
Copyright 2018 Alex and Mike Sherman
GH (General Hospital) CL (Clinic) Area
Total GH Clinic
Cardio-
logy
Respira-
tory
Psychi-
atry
Internal
Pedia-
trics
Psychi-
atry
Area 1 Area 2 Area 3 Area 4 Area 5
Sample
Size
Preferred
Brand
500 290 210 58 58 58 110 50 50 240 80 60 60 60
30 33 26 40 43 31 30 28 14 31 35 37 18 27
GH (General Hospital) CL (Clinic) Area
Total GH Clinic
Cardio-
logy
Respira-
tory
Psychi-
atry
Internal
Pedia-
trics
Psychi-
atry
Area 1 Area 2 Area 3 Area 4 Area 5
Sample
Size
Preferred
Brand
500 290 210 58 58 58 110 50 50 240 80 60 60 60
30 33 26 40 43 31 30 28 14 31 35 37 18 27
Meaningless
average
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
5.	Correlation	Is	Not	Causality
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Correlation	Is	Not	Causality:		
Getting	It	Backwards	
Does	Shelf	Space	Drive	Sales?		
Or	Does	Sales	Drive	Shelf	Space?
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
0
10
20
30
40
50
60
0
20
40
60
80
100
Time 1 Time 2 Time 3 Time 4 Time 5 Time 6
SM $ Sales $
Summer
Winter
Winter
Ice Cream Sales
Correlation	Is	Not	Causality:	
Missing	The	Real	Driver	
	
Source: Ray Poynter, The Problems With Observational Data, 2018
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Correlation	Is	Not	Causality:	
Underlying	Bias	
When HRT was 1st assessed (Nurses Health
Study – large observational study in the USA),
seemed to protect the heart.
Doctors were recommended to prescribe it
more widely.
Women’s Health Initiative (gold standard
controlled experiment) – suggested it was
slightly bad for the heart.
Why?
Women receiving HRT were systematically
healthier and wealthier.
Source: Ray Poynter, The Problems With Observational Data, 2018
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
So	Test	(And	Learn)!	
Copyright 2018 Alex and Mike Sherman
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
..	And	Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
..	And	Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
...	And	Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
...	And	Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
…	And	Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	 Copyright 2018 Alex and Mike Sherman
…	And	Test	….
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Success rate of offer
Percent
...	And	Then	Learn	
Refinement	Of	Offers	Critical	
Copyright 2018 Alex and Mike Sherman
Impact of iterative refinement
Week0
20
40
60
80
0
 1
 2
 3
 4
 5
 6
 7
 8
Improved
targeting,
redefine sample
Improved
script
Added
a new choice
of promotions
Launched program
Improved custo
mer service rep
performance,
rewrote script
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
6.	Challenge	Your	Metrics
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
7.	Seeing	But	Not	Understanding
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
8.	Ask	Questions	
Copyright 2018 Alex and Mike Sherman
CHURN MODELING
•  Do you want to predict to which
carrier they will churn ?
•  Do you want to predict who will
respond to a churn offer?
•  What will you use the output to do?
•  Do you want to predict who will churn?
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Selected	Ideas	(from	the	52)	
Copyright 2018 Alex and Mike Sherman
1.  The Hole, Not The Drill
2.  Saint Jerry McGuire
3.  BS Matters
4.  Beware of Meaningless Numbers and Calculations
5.  Correlation Is Not Causality
6.  Challenge Your Metrics
7.  Seeing But Not Understanding
8.  Ask Questions
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Want	More?	
”52	Things….”	now	
available	on		
Amazon.com	
	
More	at		
www.MikeSherman.net
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
Q	&	A	
Mike	
Sherman
Sue York
NewMR
Presentation copyright, the presenters and NewMR.
Intellectual Property Rights, the presenters. Please credit when using.
Festival of #NewMR
2019
	
	
NewMR	2019	Sponsors	
Communication	
Gold	
Silver

More Related Content

Similar to 52 Things We Wish Someone Had Told Us About Customer Analytics

How to Create a Sales Cadence to Drive Top-of-Funnel Growth
How to Create a Sales Cadence to Drive Top-of-Funnel GrowthHow to Create a Sales Cadence to Drive Top-of-Funnel Growth
How to Create a Sales Cadence to Drive Top-of-Funnel GrowthValueSelling Associates, Inc.
 
The Future of Customer Relationships
The Future of Customer RelationshipsThe Future of Customer Relationships
The Future of Customer RelationshipsRay Poynter
 
Lead with Insights, Break Stereotypes
Lead with Insights, Break StereotypesLead with Insights, Break Stereotypes
Lead with Insights, Break StereotypesRay Poynter
 
5 Tips For Teaching Essay Writing To ESL Students -
5 Tips For Teaching Essay Writing To ESL Students -5 Tips For Teaching Essay Writing To ESL Students -
5 Tips For Teaching Essay Writing To ESL Students -Valerie Felton
 
State of the Nation Review of Market Research and Insights
State of the Nation Review of Market Research and InsightsState of the Nation Review of Market Research and Insights
State of the Nation Review of Market Research and InsightsRay Poynter
 
How To Write Paper Presentation In International Conference 2023
How To Write Paper Presentation In International Conference 2023How To Write Paper Presentation In International Conference 2023
How To Write Paper Presentation In International Conference 2023Amanda Detwiler
 
Jfk Essay Outline. Online assignment writing service.
Jfk Essay Outline. Online assignment writing service.Jfk Essay Outline. Online assignment writing service.
Jfk Essay Outline. Online assignment writing service.Alexandra Romero
 
Career Options and Opportunities in Networking
Career Options and Opportunities in NetworkingCareer Options and Opportunities in Networking
Career Options and Opportunities in NetworkingSarath Chandra
 
Advertising is Dead
Advertising is DeadAdvertising is Dead
Advertising is DeadStefan Kolle
 
Quotes For College Essays. QuotesGram. Online assignment writing service.
Quotes For College Essays. QuotesGram. Online assignment writing service.Quotes For College Essays. QuotesGram. Online assignment writing service.
Quotes For College Essays. QuotesGram. Online assignment writing service.Lori Gilbert
 
MBA Career Event idEC Barcelona
MBA Career Event idEC BarcelonaMBA Career Event idEC Barcelona
MBA Career Event idEC BarcelonaSantiago Garcia
 
Seven Things
Seven ThingsSeven Things
Seven ThingsBrock Ray
 
In-n-out-RESEARCH REPORT-final
In-n-out-RESEARCH REPORT-finalIn-n-out-RESEARCH REPORT-final
In-n-out-RESEARCH REPORT-finalHarluvleen Boparai
 
Insights from Nonconscious: Marketing That Talks Implicitly
Insights from Nonconscious: Marketing That Talks ImplicitlyInsights from Nonconscious: Marketing That Talks Implicitly
Insights from Nonconscious: Marketing That Talks ImplicitlyRay Poynter
 
Diversity in Conference Speakers in 2018 reviewed
Diversity in Conference Speakers in 2018 reviewedDiversity in Conference Speakers in 2018 reviewed
Diversity in Conference Speakers in 2018 reviewedRay Poynter
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023Ray Poynter
 
Digit Leaders 2023
Digit Leaders 2023 Digit Leaders 2023
Digit Leaders 2023 Ray Bugg
 
How to respond to a creative brief? A survival kit
How to respond to a creative brief? A survival kitHow to respond to a creative brief? A survival kit
How to respond to a creative brief? A survival kitLaurent François
 
German Unification Essay Questions. Online assignment writing service.
German Unification Essay Questions. Online assignment writing service.German Unification Essay Questions. Online assignment writing service.
German Unification Essay Questions. Online assignment writing service.Carolyn Bush
 
Integrated Text of the Business Plan
Integrated Text of the Business PlanIntegrated Text of the Business Plan
Integrated Text of the Business PlanMishal Iyer
 

Similar to 52 Things We Wish Someone Had Told Us About Customer Analytics (20)

How to Create a Sales Cadence to Drive Top-of-Funnel Growth
How to Create a Sales Cadence to Drive Top-of-Funnel GrowthHow to Create a Sales Cadence to Drive Top-of-Funnel Growth
How to Create a Sales Cadence to Drive Top-of-Funnel Growth
 
The Future of Customer Relationships
The Future of Customer RelationshipsThe Future of Customer Relationships
The Future of Customer Relationships
 
Lead with Insights, Break Stereotypes
Lead with Insights, Break StereotypesLead with Insights, Break Stereotypes
Lead with Insights, Break Stereotypes
 
5 Tips For Teaching Essay Writing To ESL Students -
5 Tips For Teaching Essay Writing To ESL Students -5 Tips For Teaching Essay Writing To ESL Students -
5 Tips For Teaching Essay Writing To ESL Students -
 
State of the Nation Review of Market Research and Insights
State of the Nation Review of Market Research and InsightsState of the Nation Review of Market Research and Insights
State of the Nation Review of Market Research and Insights
 
How To Write Paper Presentation In International Conference 2023
How To Write Paper Presentation In International Conference 2023How To Write Paper Presentation In International Conference 2023
How To Write Paper Presentation In International Conference 2023
 
Jfk Essay Outline. Online assignment writing service.
Jfk Essay Outline. Online assignment writing service.Jfk Essay Outline. Online assignment writing service.
Jfk Essay Outline. Online assignment writing service.
 
Career Options and Opportunities in Networking
Career Options and Opportunities in NetworkingCareer Options and Opportunities in Networking
Career Options and Opportunities in Networking
 
Advertising is Dead
Advertising is DeadAdvertising is Dead
Advertising is Dead
 
Quotes For College Essays. QuotesGram. Online assignment writing service.
Quotes For College Essays. QuotesGram. Online assignment writing service.Quotes For College Essays. QuotesGram. Online assignment writing service.
Quotes For College Essays. QuotesGram. Online assignment writing service.
 
MBA Career Event idEC Barcelona
MBA Career Event idEC BarcelonaMBA Career Event idEC Barcelona
MBA Career Event idEC Barcelona
 
Seven Things
Seven ThingsSeven Things
Seven Things
 
In-n-out-RESEARCH REPORT-final
In-n-out-RESEARCH REPORT-finalIn-n-out-RESEARCH REPORT-final
In-n-out-RESEARCH REPORT-final
 
Insights from Nonconscious: Marketing That Talks Implicitly
Insights from Nonconscious: Marketing That Talks ImplicitlyInsights from Nonconscious: Marketing That Talks Implicitly
Insights from Nonconscious: Marketing That Talks Implicitly
 
Diversity in Conference Speakers in 2018 reviewed
Diversity in Conference Speakers in 2018 reviewedDiversity in Conference Speakers in 2018 reviewed
Diversity in Conference Speakers in 2018 reviewed
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023
 
Digit Leaders 2023
Digit Leaders 2023 Digit Leaders 2023
Digit Leaders 2023
 
How to respond to a creative brief? A survival kit
How to respond to a creative brief? A survival kitHow to respond to a creative brief? A survival kit
How to respond to a creative brief? A survival kit
 
German Unification Essay Questions. Online assignment writing service.
German Unification Essay Questions. Online assignment writing service.German Unification Essay Questions. Online assignment writing service.
German Unification Essay Questions. Online assignment writing service.
 
Integrated Text of the Business Plan
Integrated Text of the Business PlanIntegrated Text of the Business Plan
Integrated Text of the Business Plan
 

More from Ray Poynter

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsRay Poynter
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolRay Poynter
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaRay Poynter
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarRay Poynter
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRRay Poynter
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of BeliefsRay Poynter
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesRay Poynter
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AIRay Poynter
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?Ray Poynter
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...Ray Poynter
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...Ray Poynter
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysRay Poynter
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTRay Poynter
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysRay Poynter
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthRay Poynter
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchRay Poynter
 
Using Word Cloud Plus to Code Open Ended Text
Using Word Cloud Plus to Code Open Ended TextUsing Word Cloud Plus to Code Open Ended Text
Using Word Cloud Plus to Code Open Ended TextRay Poynter
 

More from Ray Poynter (20)

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and Findings
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis tool
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from Yasna
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So Far
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMR
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of Beliefs
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden Narratives
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at Mondelēz
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AI
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPT
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business Growth
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer research
 
Using Word Cloud Plus to Code Open Ended Text
Using Word Cloud Plus to Code Open Ended TextUsing Word Cloud Plus to Code Open Ended Text
Using Word Cloud Plus to Code Open Ended Text
 

Recently uploaded

Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Biting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdfBiting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdfadityarao40181
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
internship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerinternship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerunnathinaik
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Class 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdfClass 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdfakmcokerachita
 
Science lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lessonScience lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lessonJericReyAuditor
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptxENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptxAnaBeatriceAblay2
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfMahmoud M. Sallam
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 

Recently uploaded (20)

Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Biting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdfBiting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdf
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
internship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerinternship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developer
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Class 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdfClass 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdf
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Science lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lessonScience lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lesson
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptxENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdf
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 

52 Things We Wish Someone Had Told Us About Customer Analytics

  • 1. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 52 Things We Wish Someone Had Told Us About Customer Analytics Mike Sherman March 6, 2019
  • 2. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman
  • 3. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Use Of Analytics to Drive Decisions Not Good and Getting Worse
  • 4. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Selected Ideas (from the 52) Copyright 2018 Alex and Mike Sherman 1.  The Hole, Not The Drill 2.  Saint Jerry McGuire 3.  BS Matters 4.  Beware of Meaningless Numbers and Calculations 5.  Correlation Is Not Causality 6.  Challenge Your Metrics 7.  Seeing But Not Understanding 8.  Ask Questions
  • 5. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 1. Focus On Outputs, Not Tools Copyright 2018 Alex and Mike Sherman "People don't want to buy a quarter-inch drill. They want a quarter-inch hole!” Ted Levitt Harvard Business School
  • 6. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 2. Saint Jerry McGuire Copyright 2018 Alex and Mike Sherman Show Me the Money!
  • 7. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Leverage Analysis Use Judgement Uncertainty High Low Low High Value at Risk ? Copyright 2018 Alex and Mike Sherman Are we doing too much work here? 3. BS (Business Significance) Matters Are we doing enough analysis here?
  • 8. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 4. Beware Of Meaningless Numbers… Copyright 2018 Alex and Mike Sherman On Average I Hit Straight Down The Fairway …
  • 9. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 … And Meaningless Calculations! Copyright 2018 Alex and Mike Sherman GH (General Hospital) CL (Clinic) Area Total GH Clinic Cardio- logy Respira- tory Psychi- atry Internal Pedia- trics Psychi- atry Area 1 Area 2 Area 3 Area 4 Area 5 Sample Size Preferred Brand 500 290 210 58 58 58 110 50 50 240 80 60 60 60 30 33 26 40 43 31 30 28 14 31 35 37 18 27 GH (General Hospital) CL (Clinic) Area Total GH Clinic Cardio- logy Respira- tory Psychi- atry Internal Pedia- trics Psychi- atry Area 1 Area 2 Area 3 Area 4 Area 5 Sample Size Preferred Brand 500 290 210 58 58 58 110 50 50 240 80 60 60 60 30 33 26 40 43 31 30 28 14 31 35 37 18 27 Meaningless average
  • 10. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 5. Correlation Is Not Causality
  • 11. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Correlation Is Not Causality: Getting It Backwards Does Shelf Space Drive Sales? Or Does Sales Drive Shelf Space?
  • 12. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 0 10 20 30 40 50 60 0 20 40 60 80 100 Time 1 Time 2 Time 3 Time 4 Time 5 Time 6 SM $ Sales $ Summer Winter Winter Ice Cream Sales Correlation Is Not Causality: Missing The Real Driver Source: Ray Poynter, The Problems With Observational Data, 2018
  • 13. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Correlation Is Not Causality: Underlying Bias When HRT was 1st assessed (Nurses Health Study – large observational study in the USA), seemed to protect the heart. Doctors were recommended to prescribe it more widely. Women’s Health Initiative (gold standard controlled experiment) – suggested it was slightly bad for the heart. Why? Women receiving HRT were systematically healthier and wealthier. Source: Ray Poynter, The Problems With Observational Data, 2018
  • 14. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 So Test (And Learn)! Copyright 2018 Alex and Mike Sherman
  • 15. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman Test ….
  • 16. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman .. And Test ….
  • 17. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman .. And Test ….
  • 18. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman ... And Test ….
  • 19. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman ... And Test ….
  • 20. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman … And Test ….
  • 21. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Copyright 2018 Alex and Mike Sherman … And Test ….
  • 22. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Success rate of offer Percent ... And Then Learn Refinement Of Offers Critical Copyright 2018 Alex and Mike Sherman Impact of iterative refinement Week0 20 40 60 80 0 1 2 3 4 5 6 7 8 Improved targeting, redefine sample Improved script Added a new choice of promotions Launched program Improved custo mer service rep performance, rewrote script
  • 23. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 6. Challenge Your Metrics
  • 24. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 7. Seeing But Not Understanding
  • 25. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 8. Ask Questions Copyright 2018 Alex and Mike Sherman CHURN MODELING •  Do you want to predict to which carrier they will churn ? •  Do you want to predict who will respond to a churn offer? •  What will you use the output to do? •  Do you want to predict who will churn?
  • 26. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Selected Ideas (from the 52) Copyright 2018 Alex and Mike Sherman 1.  The Hole, Not The Drill 2.  Saint Jerry McGuire 3.  BS Matters 4.  Beware of Meaningless Numbers and Calculations 5.  Correlation Is Not Causality 6.  Challenge Your Metrics 7.  Seeing But Not Understanding 8.  Ask Questions
  • 27. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Want More? ”52 Things….” now available on Amazon.com More at www.MikeSherman.net
  • 28. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 Q & A Mike Sherman Sue York NewMR
  • 29. Presentation copyright, the presenters and NewMR. Intellectual Property Rights, the presenters. Please credit when using. Festival of #NewMR 2019 NewMR 2019 Sponsors Communication Gold Silver