The document discusses a festival of new market research techniques in 2014. It thanks various sponsors who supported the festival, including a platinum sponsor. A keynote speaker from Researchscape International then discusses how the Net Promoter Score technique, while initially popular, has significant limitations and flaws. He argues it masks the true signal in the data and is not truly predictive. The speaker suggests market researchers should embrace, extend, and eventually replace the NPS with better techniques that provide more accurate insights into customer loyalty and satisfaction.
Bologna toc 2013 changing world of children's books finalDominique Raccah
The Changing World of Children's Books 2013 was a keynote given by Dominique Raccah at the Tools of Change Bologna 2013 Conference which took place at the Bologna Children's Book Fair #BCBF13
Through the Looking Glass: The Past, Present and Future of Children's Publish...Dominique Raccah
At Digital Book World 2016, as part of the Launch Kids pre-conference day, I spoke about what we've seen in children's publishing in the last 5 years and where we could be headed. The evolution of digital, content as a driver, and the development of Put Me In The Story, which is adding significant revenue to author and book brands.
In this presentation at Launch Kids, Jonathan Nowell of Nielsen Book will examine the data his company has developed about the habits and preferences of younger readers and children's book buyers. He will offer insight about the consumption habits of younger readers with some thoughtful speculation about how children's book buying is changing over time (across formats and channels) and why young people today continue to remain attached to the printed book.
3 BIG Ideas to Improve Your Email and Digital Marketing - Jennings 2015-06JeanneJennings.com, Inc.
Email marketing is the most effective channel in terms of ROI according to the Direct Marketing Association. But even so, few organizations are making the most of their email marketing efforts.
If you’re looking to make REAL improvements in performance here’s where to start. Join Jeanne Jennings for this fast-paced Webinar with practical advice you can start leveraging as soon as the Webinar is over. Join us and you’ll learn about:
>>> Data
o The 4 ways you should be gathering it
o A multitude of ways you can use it to boost response
>>> Technology
o The 1 feature that will improve your team’s productivity as well as your bottom-line results
o The biggest reason that technology doesn’t deliver as anticipated – and how to address it
>>> Testing
o The 15 types of marketing tests you should be doing
o A simple way to ‘bake’ testing into your regular marketing program
You will leave the Webinar with an increased enthusiasm for email marketing – and with enough ideas to become an email marketing rock star in your organization.
Bologna toc 2013 changing world of children's books finalDominique Raccah
The Changing World of Children's Books 2013 was a keynote given by Dominique Raccah at the Tools of Change Bologna 2013 Conference which took place at the Bologna Children's Book Fair #BCBF13
Through the Looking Glass: The Past, Present and Future of Children's Publish...Dominique Raccah
At Digital Book World 2016, as part of the Launch Kids pre-conference day, I spoke about what we've seen in children's publishing in the last 5 years and where we could be headed. The evolution of digital, content as a driver, and the development of Put Me In The Story, which is adding significant revenue to author and book brands.
In this presentation at Launch Kids, Jonathan Nowell of Nielsen Book will examine the data his company has developed about the habits and preferences of younger readers and children's book buyers. He will offer insight about the consumption habits of younger readers with some thoughtful speculation about how children's book buying is changing over time (across formats and channels) and why young people today continue to remain attached to the printed book.
3 BIG Ideas to Improve Your Email and Digital Marketing - Jennings 2015-06JeanneJennings.com, Inc.
Email marketing is the most effective channel in terms of ROI according to the Direct Marketing Association. But even so, few organizations are making the most of their email marketing efforts.
If you’re looking to make REAL improvements in performance here’s where to start. Join Jeanne Jennings for this fast-paced Webinar with practical advice you can start leveraging as soon as the Webinar is over. Join us and you’ll learn about:
>>> Data
o The 4 ways you should be gathering it
o A multitude of ways you can use it to boost response
>>> Technology
o The 1 feature that will improve your team’s productivity as well as your bottom-line results
o The biggest reason that technology doesn’t deliver as anticipated – and how to address it
>>> Testing
o The 15 types of marketing tests you should be doing
o A simple way to ‘bake’ testing into your regular marketing program
You will leave the Webinar with an increased enthusiasm for email marketing – and with enough ideas to become an email marketing rock star in your organization.
Why Surveys Need To Become ConversationalRay Poynter
Let’s face it, most surveys are boring. And the online survey experience hasn’t changed much in 20 years. Conversations are everything that surveys aren’t – engaging, two-way, emotional, often surprising and, dare I say it, insightful!
So let’s make our surveys conversational – join us to learn how to create more engaging experiences for participants that lead to better data and stronger insight.
This is a talk I gave to students of the Manukau Institute of Technology, focusing on key usability heuristics, and giving them tips on how to run their own user research or usability testing.
This is an update of a talk I gave while Macklemore was still a thing. I use him, Dickens and a host of other examples to show where we as content creators need to use data to tell better stories about the work we do, and how it's valuable to both our audience and business.
We'll walk through a common story framework, and then map those points to specific features and metrics you would use Google Analytics and YouTube Analytics for. That said, the concept would apply to any analytics solution you have on hand.
Todd Carpenter's Presentation during the Library Assessment Conference 2014 in Seattle, WA on August 2014 at University of Washington. During this presentation, Todd covered the output of Phase One of NISO's alternative metrics assessment initiative.
This presentation reviews the different approaches to research and outlines how you can bring the personas out of static documents and into the on-going conversation about your customers within your organization with something called Listening Sessions.
Qualitative Research Questions and MethodologyLevelwing
Big Data isn't just about numbers and charts; qualitative research provides rich insight to help with any business question you may have. This presentation provides an overview of qualitative research methodology and the importance and process of developing scalable research questions. Learn more about Levelwing's research capabilities: http://ow.ly/gcSXU
The Top 4 Ways On How Neuro-Marketing Influences The Online Dating ArenaStoic Advantage, LLC.
I enjoyed working with Dustin Bearden on a breakthrough project where neuromarketing meets dating sites, such as POF, Badoo and Bumble.
We had participants in our experiment utilize eye trackers in order to gauge initial reaction on regions of their brain. This gave us "heat map” based on what the participants saw upon the initial impression of images on these sites in order to see how a person makes snap-judgment decision on whether to swipe right or left.
The 4 criteria we tested throughout this project were: social proof, text & visuals, innovative design, and consistency. We theorized dating sites that incorporated all four of these criterion tended to perform better than others.
Research
1
Research
Student’s Name
University Affiliation
This is what my professor sent us yesterday through e-mail.
“Your response should look like this:
1. Introduction: Brief description of the study including the purpose and importance of the research question being asked.
Include your response in paragraph form here.
2. What is the null hypothesis? What is the research hypothesis?
Include your response in paragraph form here.
etc.
This format should help you to address EVERY question asked and it helps me in grading.
You should also be defining the statistical test, its requirements, etc and providing an intext citation for this summary. For example: What is a t test? When should it be used? What are the requirements? Why is the particular test appropriate to answer your research hypothesis? “
Research Hypothesis
Students who take breakfast perform better in class that those who don’t (FRAGMENT SENTENCE)
Research question
Does talking breakfast improve the class performance of a student?
Introduction
This research is meant to bring out the relationship between two variables and state how one affects the other. It has a dependent variable as well as independent variables. It should determine whether or not taking breakfast affects the class performance of a student.
Null hypothesis
Talking breakfast does not improve class performance of a student (SPELLING AND PUNCTUATION)
Sampling method
The method used to come up with the sample was the random sampling method. It is because it is unbiased and each unit of the population has an equal chance to be selected and used for the study. There is the assurance that the population will be equally sampled. (REWORD BECAUSE IT IS AWKAWARD)
Sample size
Determination of the right sample size is important because it makes the result of the research more true and reliable. 100 students were selected randomly for the purpose of the research.
Population of interest
The population that was targeted by this research is the entire student body. But since it is not practical to study every unit of the population, the sample was selected to represent the whole population. (YOU CANNOT START THE SENTENCE WITH “BUT” SINCE IT’S A RESEARCH PAPER) The sample size is big enough to represent the real picture depicted by the population under study.
Data analysis
The data was randomly collected from the students in order to create a sample to be used for the study. The data that was collected was analyzed so that to determine if there exists (REWORD) any relationship between breakfast and class performance.
Statistical analysis
This research is to determine the relationship between variables. Correlation refers to how strong two variables are related (Ashley Crossman). (NEEDS TO BE IN PROPER APA FORMAT) Correlation analysis was the most relevant in this case given the fact that the study is to determine the relation between variables. You need to answer this question: Depending on if you are using corr ...
The Gambling Counselor’s Client Education Toolbox: Choosing the Right Tool fo...Emily Sheepy
Poster presentation prepared for the Alberta Gambling Research Institute Conference (2013), Banff, AB.
In the past decade, problem gambling (PG) has become a prominent public health issue (Peller, LaPlante, & Shaffer, 2007). Organizations such as the Centre for Addiction & Mental Health (CAMH) have invested in educational materials for use in gambling counseling. Though many resources are available to treatment professionals, little is known about how they access, evaluate, and use these materials.
In an exploratory study, semi-structured interviews with 6 gambling counseling specialists and participant-submitted artifacts were used to describe the process of the selection of problem gambling-related client education materials from the treatment provider’s perspective, identifying perceived barriers and facilitators impacting how this sample of treatment professionals integrates materials in practice. Elements of Strauss and Corbin's grounded theory methodology were applied to describe and group factors that may affect the perceived usefulness and efficacy of PG educational materials among treatment providers.
This poster presentation highlights educational resource design factors including readability, interactivity, and alignment between instructional strategy and educational goals concerning the development of psychosocial skills. The counselors’ experiences with the use of various materials are discussed from an instructional design perspective, and may inform future research into best practices for the development of client education materials for PG treatment.
The State of AI in Insights and Research 2024: Results and FindingsRay Poynter
This presentation from Ray Poynter of NewMR shares the findings from the latest NewMR study.
The study looks at the use of Artificial Intelligence in insights and research, including a deeper dive into the topic of Synthetic Data.
Find out how many people are using AI, how many are testing it, what they are doing, and what people think about Synthetic Data.
And, hear about where AI and research might be in two year’s time.
Listen to the recording of this presentation via NewMR.org/Play-Again, and also access other presentations from NewMR on all things market research, insight, and AI.
ResearchWiseAI - an artificial intelligence driven research data analysis toolRay Poynter
This presentation was delivered as part of the NewMR 'State of AI and Insights 2024' webinar event, April 2024.
This presentation highlights the expanded range of tools available from ResearchWiseAI – an AI tool that summarises research findings from surveys.
Questions for the team? Email us at support@researchwiseai.com or visit our website: https://researchwiseai.com/
Visit NewMR.org/Play-Again to listen to this presentation recording , and access the other presentation in this webinar event.
More Related Content
Similar to Jeffrey Henning - Festival of New MR - 2014
Why Surveys Need To Become ConversationalRay Poynter
Let’s face it, most surveys are boring. And the online survey experience hasn’t changed much in 20 years. Conversations are everything that surveys aren’t – engaging, two-way, emotional, often surprising and, dare I say it, insightful!
So let’s make our surveys conversational – join us to learn how to create more engaging experiences for participants that lead to better data and stronger insight.
This is a talk I gave to students of the Manukau Institute of Technology, focusing on key usability heuristics, and giving them tips on how to run their own user research or usability testing.
This is an update of a talk I gave while Macklemore was still a thing. I use him, Dickens and a host of other examples to show where we as content creators need to use data to tell better stories about the work we do, and how it's valuable to both our audience and business.
We'll walk through a common story framework, and then map those points to specific features and metrics you would use Google Analytics and YouTube Analytics for. That said, the concept would apply to any analytics solution you have on hand.
Todd Carpenter's Presentation during the Library Assessment Conference 2014 in Seattle, WA on August 2014 at University of Washington. During this presentation, Todd covered the output of Phase One of NISO's alternative metrics assessment initiative.
This presentation reviews the different approaches to research and outlines how you can bring the personas out of static documents and into the on-going conversation about your customers within your organization with something called Listening Sessions.
Qualitative Research Questions and MethodologyLevelwing
Big Data isn't just about numbers and charts; qualitative research provides rich insight to help with any business question you may have. This presentation provides an overview of qualitative research methodology and the importance and process of developing scalable research questions. Learn more about Levelwing's research capabilities: http://ow.ly/gcSXU
The Top 4 Ways On How Neuro-Marketing Influences The Online Dating ArenaStoic Advantage, LLC.
I enjoyed working with Dustin Bearden on a breakthrough project where neuromarketing meets dating sites, such as POF, Badoo and Bumble.
We had participants in our experiment utilize eye trackers in order to gauge initial reaction on regions of their brain. This gave us "heat map” based on what the participants saw upon the initial impression of images on these sites in order to see how a person makes snap-judgment decision on whether to swipe right or left.
The 4 criteria we tested throughout this project were: social proof, text & visuals, innovative design, and consistency. We theorized dating sites that incorporated all four of these criterion tended to perform better than others.
Research
1
Research
Student’s Name
University Affiliation
This is what my professor sent us yesterday through e-mail.
“Your response should look like this:
1. Introduction: Brief description of the study including the purpose and importance of the research question being asked.
Include your response in paragraph form here.
2. What is the null hypothesis? What is the research hypothesis?
Include your response in paragraph form here.
etc.
This format should help you to address EVERY question asked and it helps me in grading.
You should also be defining the statistical test, its requirements, etc and providing an intext citation for this summary. For example: What is a t test? When should it be used? What are the requirements? Why is the particular test appropriate to answer your research hypothesis? “
Research Hypothesis
Students who take breakfast perform better in class that those who don’t (FRAGMENT SENTENCE)
Research question
Does talking breakfast improve the class performance of a student?
Introduction
This research is meant to bring out the relationship between two variables and state how one affects the other. It has a dependent variable as well as independent variables. It should determine whether or not taking breakfast affects the class performance of a student.
Null hypothesis
Talking breakfast does not improve class performance of a student (SPELLING AND PUNCTUATION)
Sampling method
The method used to come up with the sample was the random sampling method. It is because it is unbiased and each unit of the population has an equal chance to be selected and used for the study. There is the assurance that the population will be equally sampled. (REWORD BECAUSE IT IS AWKAWARD)
Sample size
Determination of the right sample size is important because it makes the result of the research more true and reliable. 100 students were selected randomly for the purpose of the research.
Population of interest
The population that was targeted by this research is the entire student body. But since it is not practical to study every unit of the population, the sample was selected to represent the whole population. (YOU CANNOT START THE SENTENCE WITH “BUT” SINCE IT’S A RESEARCH PAPER) The sample size is big enough to represent the real picture depicted by the population under study.
Data analysis
The data was randomly collected from the students in order to create a sample to be used for the study. The data that was collected was analyzed so that to determine if there exists (REWORD) any relationship between breakfast and class performance.
Statistical analysis
This research is to determine the relationship between variables. Correlation refers to how strong two variables are related (Ashley Crossman). (NEEDS TO BE IN PROPER APA FORMAT) Correlation analysis was the most relevant in this case given the fact that the study is to determine the relation between variables. You need to answer this question: Depending on if you are using corr ...
The Gambling Counselor’s Client Education Toolbox: Choosing the Right Tool fo...Emily Sheepy
Poster presentation prepared for the Alberta Gambling Research Institute Conference (2013), Banff, AB.
In the past decade, problem gambling (PG) has become a prominent public health issue (Peller, LaPlante, & Shaffer, 2007). Organizations such as the Centre for Addiction & Mental Health (CAMH) have invested in educational materials for use in gambling counseling. Though many resources are available to treatment professionals, little is known about how they access, evaluate, and use these materials.
In an exploratory study, semi-structured interviews with 6 gambling counseling specialists and participant-submitted artifacts were used to describe the process of the selection of problem gambling-related client education materials from the treatment provider’s perspective, identifying perceived barriers and facilitators impacting how this sample of treatment professionals integrates materials in practice. Elements of Strauss and Corbin's grounded theory methodology were applied to describe and group factors that may affect the perceived usefulness and efficacy of PG educational materials among treatment providers.
This poster presentation highlights educational resource design factors including readability, interactivity, and alignment between instructional strategy and educational goals concerning the development of psychosocial skills. The counselors’ experiences with the use of various materials are discussed from an instructional design perspective, and may inform future research into best practices for the development of client education materials for PG treatment.
The State of AI in Insights and Research 2024: Results and FindingsRay Poynter
This presentation from Ray Poynter of NewMR shares the findings from the latest NewMR study.
The study looks at the use of Artificial Intelligence in insights and research, including a deeper dive into the topic of Synthetic Data.
Find out how many people are using AI, how many are testing it, what they are doing, and what people think about Synthetic Data.
And, hear about where AI and research might be in two year’s time.
Listen to the recording of this presentation via NewMR.org/Play-Again, and also access other presentations from NewMR on all things market research, insight, and AI.
ResearchWiseAI - an artificial intelligence driven research data analysis toolRay Poynter
This presentation was delivered as part of the NewMR 'State of AI and Insights 2024' webinar event, April 2024.
This presentation highlights the expanded range of tools available from ResearchWiseAI – an AI tool that summarises research findings from surveys.
Questions for the team? Email us at support@researchwiseai.com or visit our website: https://researchwiseai.com/
Visit NewMR.org/Play-Again to listen to this presentation recording , and access the other presentation in this webinar event.
AI-powered interviewing: Best practices from YasnaRay Poynter
This presentation is Part 2 of 2.
Join us as we explore how AI can be used to supercharge your qualitative research.
Enjoy two presentations, the first presentation is shared by Ray Poynter from NewMR, who is looking at AI and Qual: The Story So Far.
The second presentation, this presentation, is Part 2 of 2 from Fastuna and Yasna, and shows how Yasna can be used to create AI-powered interviewing. Their presentation is called 'AI-powered interviewing: Best practices from Yasna'.
To listen to the recordings for both presentations in this webinar, visit NewMR.org/Play-Again.
Artificial Intelligence and Qual: The Story So FarRay Poynter
This presentation is Part 1 of 2.
Join us as we explore how Artificial Intelligence can be used to supercharge your qualitative research.
Enjoy two presentations, the first (this presentation) is shared by Ray Poynter from NewMR, who is looking at AI and Qual: The Story So Far.
The second presentation, Part 2 of 2 is from Fastuna and Yasna, and shows how Yasna can be used to create AI-powered interviewing. Their presentation is called 'AI-powered interviewing: Best practices from Yasna'.
To listen to the recordings for both presentations in this webinar, visit NewMR.org/Play-Again.
State of Research Insights in Q1, 2024 from NewMRRay Poynter
Join us as Ray Poynter of NewMR presents the latest updates from NewMR’s study into the state of insights. This is the third wave in an ongoing series, where NewMR checks on topics such as:
- How optimistic are insight professionals?
- What are they most positive about?
- What are their main worries?
Ray will present the latest findings in the context of the two waves from 2023.
Ray will also present information about the skills people are seeking to learn and their preferences for face-to-face events.
We will also share a link for you to download the NewMR report into Optimism in the insights and research ecosystem.
In the final section of the webinar, Ray will illustrate how he used the AI-powered ResearchWiseAI tool to kick start his analysis.
Access the event recording via NewMR.org/Play-Again
Presented by Daniel Fazekas, Bakomo Social.
Social intelligence research possesses the capability to capture, analyze, and interpret the myriad factors influencing how consumers align themselves with product categories and brands, with special focus on their underlying dynamics.
By capturing unfiltered opinions across social media, this type of research unveils the process with which consumers can shift their perspectives, influenced by the opinions of others, influencers, news, and even misinformation. The talk by Daniel Fazekas shares examples of the volatile nature of consumer mindset across consumer categories and geographies.
This presentation is part of the Story Time: Narrative Research forum event, hosted and produced by the Irrational Agency and NewMR, bringing together leading proponents of commercial narrative research across disciplines, to share how organisations can use story to generate unique and impactful insights.
To listen to the presentation, and access the recording, visit NewMR.org/Play-Again
While nearly every participant is willing to answer our questions in market research, very few actually share what’s really happening inside their minds. By leveraging insights from the field of narrative psychology, Kristian A. Alomá, PhD, an academic and practitioner in the field, will demonstrate how consumers really think about brands and the role narratives play in that thought process. He’ll break down what that means for businesses and market researchers and how we can move past surface-level answers and get to the rich stories driving consumer behavior.
This presentation is part of the Story Time: Narrative Research forum event, hosted and produced by the Irrational Agency and NewMR, bringing together leading proponents of commercial narrative research across disciplines, to share how organisations can use story to generate unique and impactful insights.
To listen to the presentation and access the recording, visit NewMR.org/Play-Again.
Narrative Exploration of New Categories at MondelēzRay Poynter
As part of the Story Time: The Narrative Research Forum event, Steph Shaarwi (Irrational Agency) and Maura Collins-Titone (Mondelēz) discuss and share how Mondelēz used narrative research to identify emerging category trends and leverage that information to shape new propositions.
This presention is part of the Story Time: Narrative Research forum event, hosted and produced by the Irrational Agency and NewMR, bringing together leading proponents of commercial narrative research across disciplines, to share how organisations can use story to generate unique and impactful insights.
To listen to the presentation and access the recording, visit NewMR.org/Play-Again
Join Ray Poynter, Alexandra Kuzmina, and Lisa Wilding-Brown as we investigate key topics for insights and research, including:
- Blending Conversation AI and Behavioural Science; Experiments in future oriented concept testing
- Quality & Fraud Trends; What is happening and what are the implications
- Automating Research; What can we automate and what are the implications
The recordings from this presentation can be found via NewMR.org/Play-Again
Join our panel of experts on NewMR as we explore:
- Synthetic Data, what is it, and what are the issues and opportunities, what should we do next?
- How should client insight teams be more efficient, more effective, and impactful in the rooms where the decisions are made?
- What do experiments with avatars tell us about data collection, how should we conduct and interpret experiments, and what are the next steps?
Access the recording to this webinar via NewMR.org/Play-Again
Presented by Ray Poynter
In this webinar, Ray Poynter provides a summary of the key trends that are shaping the world of insights. Addressing questions such as:
- What is really happening in insights with AI?
- What is happening in the field of Synthetic Data?
- What is happening with data quality?
- What forces outside market research are shaping insights?
- What are the key skills that people should be developing?
- What plans should you be making for 2024?
To access the presentation recording, visit NewMR.org/Play-Again
Learn how we can embrace Research Thinking to build skills, develop research capabilities and capacity, and demonstrate the power and value of human research professionals.
Research Thinking can serve as a unifying concept that describes the strengths and capabilities that researchers have and how researchers add value, or what we can think of as a researcher’s superpowers.
The recording of this presentation can be access via NewMR.org/Play-Again.
How might AI impact Research and Insights over the next two years?Ray Poynter
In this presentation, Ray focuses on the short-term picture for research and insights;
what will change, what will stay the same, and what are the big issues when it comes to the impact of Artificial Intelligence.
The recording of this presentation can be access via NewMR.org/Play-Again.
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...Ray Poynter
Presenter: Paul Watts, Director, Product Management at Forsta
With the rapid adoption of AI technologies like ChatGPT into insight platforms, companies face the challenge of finding the right balance between harnessing the power of generative AI and navigating the well-documented pitfalls associated with a technology that is still in its infancy.
In this session, Paul provides valuable insights on the potential benefits and downsides of this technology, and he will explore how a hybrid model can effectively leverage the strengths of both humans and technology.
By embracing a human-centered approach, we showcase a compelling use case from the Forsta labs, demonstrating how insight professionals can effortlessly explore their datasets using natural-language questioning.
Furthermore, we discuss the future implications of this technology and the exciting possibilities it holds for data exploration.
To access the recording of this presentation, visit NewMR.org/Play-Again
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...Ray Poynter
A few months ago, YouScan released Insights Copilot (https://youscan.io/insights-copilot/), the first on the market ChatGPT-powered tool for social media listening that allows you to ask any questions about the data and get answers supported by relevant examples.
Alex Orap, YouScan’s Founder & Chief Growth Officer, shares practical examples of how Insights Copilot can be used for quick qualitative insights; what are some of the best practices, as well as current limitations, of using this new generative AI tool for the market and consumer research.
The recording of this presentation can be access via NewMR.org/Play-Again.
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysRay Poynter
Presented by Karine Pepin.
An enormous amount of time and resources are devoted to improving data quality in survey research.
The quality of open-ended responses has become a critical factor for researchers in evaluating the validity of each participant. Reading through open-ended responses is a time-consuming task that has been difficult to automate.
While most tools are capable of identifying obviously inappropriate responses such as gibberish and profanity, they generally lack the ability to effectively assess the quality of the content.
With its ability to understand context and user-friendliness, Generative AI opens up opportunities for researchers to automate this laborious cleaning process.
During this session, you will be presented with a practical use case demonstrating how GPT was utilized to efficiently clean open-ended responses on a large scale.
Access the presentation recording via NewMR.org/Play-Again
Exploring the future of verbatim coding with ChatGPTRay Poynter
Presented by Tim Brandwood and Damien Gouriet.
Codeit have been involved in Verbatim Coding and Machine Learning for the last 7 years.
In this presentation, they share their research on the use of Generative AI for coding market research verbatim responses, and their experiments using Generative AI to automate the coding process.
They also discuss the strengths and limitations of this as a coding tool, the role of human oversight in the process, and the potential for customized machine learning models working alongside it.
The highlights the importance of human expertise and the use of GPT as a labour-saving tool rather than a complete replacement for humans in the market research process.
Access the presentation recording via NewMR.org/Play-Again.
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysRay Poynter
Presented by Phil Sutcliffe from Next Intelligence.
Open-ended answers in surveys can be disappointing, failing to deliver the insight that researchers hope for.
Often the answers given are descriptive at best and uninformative or complete gibberish at worst.
The advent of large language models (LLM's) and generative AI has brought great opportunity to change this.
We now have the capability to use AI to probe within quantitative surveys.
With the correct training of the generative AI models, probes can be returned that are relevant to what the participant has just said and the context of the original open-ended question.
Further enhancements allow the researcher to probe on specific aspects of the participant’s response, in a similar way to how a moderator would in a depth discussion.
No longer do researchers need to be frustrated that quant surveys only provide the ‘what’, with AI probing, you can now understand the ‘why’ as well and do this at scale and speed.
Access the presentation recording via NewMR.org/Play-Again
How AI / ChatGPT Drives Business GrowthRay Poynter
Hao, the Founder of HaoLifeLab, is an entrepreneur with over 10 years of experience specializing in integrating Digital, AI & Insight.
In this presentation, he discusses how to embrace the AI/ChatGPT revolution. This session will cover the following topics, which have been presented to international companies such as L’Oreal, Alibaba, Bytedance, and Mars:
– Hindsight: Learn to use established AI tools effectively
– Insight: Understand AI’s impact on the insight industry
– Foresight: Learn how to transform yourself and your company with AI
Listen to the full presentation at NewMR.org/Play-Again
Tech for tech’s sake? Learnings from experiments with AI in consumer researchRay Poynter
MMR’s in-house tech innovation team NOVA, has been exploring, interpreting, and experimenting with emerging technology with a sole focus to uncover the kind of tech that will make a tangible difference to the quality and depth of insight.
The presentation outlines the latest experimentations with practical application of AI and LLM’s: conversing with consumers at scale with chatbots, in-the-moment data capture with voice technology, unstructured data analysis, increasing survey engagement and improving data quality with AI avatars.
Insights from case studies conducted alongside leading FMCG brands will highlight the advantages and limitations of these technologies, with a particular focus on product and packaging development and testing.
Listen to the full presentation at NewMR.org/Play-Again.
Top 3 Ways to Align Sales and Marketing Teams for Rapid GrowthDemandbase
In this session, Demandbase’s Stephanie Quinn, Sr. Director of Integrated and Digital Marketing, Devin Rosenberg, Director of Sales, and Kevin Rooney, Senior Director of Sales Development will share how sales and marketing shapes their day-to-day and what key areas are needed for true alignment.
Search Engine Marketing - Competitor and Keyword researchETMARK ACADEMY
Over 2 Trillion searches are made per day in Google search, which means there are more than 2 Trillion visits happening across the websites of the world wide web.
People search various questions, phrases or words. But some words and phrases are searched
more often than others.
For example, the words, ‘running shoes’ are searched more often than ‘best road running
shoes for men’
These words or phrases which people use to search on Google are called Keywords.
Some keywords are searched more often than others. Number of times a keyword is searched
for in a month is called keyword volume.
Some keywords have more relevant results than others. For the phrase “running shoes” we
get more than 80M relevant results, whereas for “best road running shoes for men” we get
only 8.
The former keyword ‘running shoes’ has way more competition from popular websites to
new and small blogs, whereas the latter keyword doesn’t have that much competition. This
search competition for a keyword is called search difficulty of a keyword or keyword
difficulty.
In other words, if the keyword difficulty is ‘low’ or ‘easy’, there won’t be any competition
and if you target such keywords on your site, you can easily rank on the front page of Google.
Some keywords are searched for, just to know or to learn some information about something,
that’s their search intention. For example, “What shoe size should I choose?” or “How to pick
the right shoe size?”
These keywords which are searched just to know about stuff are called informational
keywords. Typically people who are searching this type of keywords are top of a Conversion
funnel.
Conversion funnel is the journey that search visitors go through on their way to an email
subscription or a premium subscription to the services you offer or a purchase of products
you sell or recommend using your referral link.
For some buyers, research is the most important part when they have to buy a product.
Depending on that, their journey either widens or narrows down. These types of buyers are
Researchers and they spend more time with informational keywords.
Conversion is the action you want from your search visitors. Number of conversions that you
get for every 100 search visitors is called Conversion rate.
People who are at different stages of a conversion funnel use different types of keywords.
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...Valters Lauzums
E-commerce in 2024 is characterized by a dynamic blend of opportunities and significant challenges. Supply chain disruptions and inventory shortages are critical issues, leading to increased shipping delays and rising costs, which impact timely delivery and squeeze profit margins. Efficient logistics management is essential, yet it is often hampered by these external factors. Payment processing, while needing to ensure security and user convenience, grapples with preventing fraud and integrating diverse payment methods, adding another layer of complexity. Furthermore, fulfillment operations require a streamlined approach to handle volume spikes and maintain accuracy in order picking, packing, and shipping, all while meeting customers' heightened expectations for faster delivery times.
Amid these operational challenges, customer data has emerged as an important strategy. By focusing on personalization and enhancing customer experience from historical behavior, businesses can deliver improved website and brand experienced, better product recommendations, optimal promotions, and content to meet individual preferences. Better data analytics can also help in effectively creating marketing campaigns, improving customer retention, and driving product development and inventory management.
Innovative formats such as social commerce and live shopping are beginning to impact the digital commerce landscape, offering new ways to engage with customers and drive sales, and may provide opportunity for brands that have been priced out or seen a downturn with post-pandemic shopping behavior. Social commerce integrates shopping experiences directly into social media platforms, tapping into the massive user bases of these networks to increase reach and engagement. Live shopping, on the other hand, combines entertainment and real-time interaction, providing a dynamic platform for showcasing products and encouraging immediate purchases. These innovations not only enhance customer engagement but also provide valuable data for businesses to refine their strategies and deliver superior shopping experiences.
The e-commerce sector is evolving rapidly, and businesses that effectively manage operational challenges and implement innovative strategies are best positioned for long-term success.
When most people in the industry talk about online or digital reputation management, what they're really saying is Google search and PPC. And it's usually reactive, left dealing with the aftermath of negative information published somewhere online. That's outdated. It leaves executives, organizations and other high-profile individuals at a high risk of a digital reputation attack that spans channels and tactics. But the tools needed to safeguard against an attack are more cybersecurity-oriented than most marketing and communications professionals can manage. Business leaders Leaders grasp the importance; 83% of executives place reputation in their top five areas of risk, yet only 23% are confident in their ability to address it. To succeed in 2024 and beyond, you need to turn online reputation on its axis and think like an attacker.\
Key Takeaways:
- New framework for examining and safeguarding an online reputation
- Tools and techniques to keep you a step ahead
- Practical examples that demonstrate when to act, how to act and how to recover
For too many years marketing and sales have operated in silos...while in some forward thinking companies, the two organizations work together to drive new opportunity development and revenue. This session will explore the lessons learned in that beautiful dance that can occur when marketing and sales work together...to drive new opportunity development, account expansion and customer satisfaction.
No, this is not a conversation about MQLs and SQLs. Instead we will focus on a framework that allows the two organizations to drive company success together.
Most small businesses struggle to see marketing results. In this session, we will eliminate any confusion about what to do next, solving your marketing problems so your business can thrive. You’ll learn how to create a foundational marketing OS (operating system) based on neuroscience and backed by real-world results. You’ll be taught how to develop deep customer connections, and how to have your CRM dynamically segment and sell at any stage in the customer’s journey. By the end of the session, you’ll remove confusion and chaos and replace it with clarity and confidence for long-term marketing success.
Key Takeaways:
• Uncover the power of a foundational marketing system that dynamically communicates with prospects and customers on autopilot.
• Harness neuroscience and Tribal Alignment to transform your communication strategies, turning potential clients into fans and those fans into loyal customers.
• Discover the art of automated segmentation, pinpointing your most lucrative customers and identifying the optimal moments for successful conversions.
• Streamline your business with a content production plan that eliminates guesswork, wasted time, and money.
When most people in the industry talk about online or digital reputation management, what they're really saying is Google search and PPC. And it's usually reactive, left dealing with the aftermath of negative information published somewhere online. That's outdated. It leaves executives, organizations and other high-profile individuals at a high risk of a digital reputation attack that spans channels and tactics. But the tools needed to safeguard against an attack are more cybersecurity-oriented than most marketing and communications professionals can manage. Business leaders Leaders grasp the importance; 83% of executives place reputation in their top five areas of risk, yet only 23% are confident in their ability to address it. To succeed in 2024 and beyond, you need to turn online reputation on its axis and think like an attacker.
Key Takeaways:
- New framework for examining and safeguarding an online reputation
- Tools and techniques to keep you a step ahead
- Practical examples that demonstrate when to act, how to act and how to recover
A.I. (artificial intelligence) platforms are popping up all the time, and many of them can and should be used to help grow your brand, increase your sales and decrease your marketing costs.In this presentation:We will review some of the best AI platforms that are available for you to use.We will interact with some of the platforms in real-time, so attendees can see how they work.We will also look at some current brands that are using AI to help them create marketing messages, saving them time and money in the process. Lastly, we will discuss the pros and cons of using AI in marketing & branding and have a lively conversation that includes comments from the audience.
Key Takeaways:
Attendees will learn about LLM platforms, like ChatGPT, and how they work, with preset examples and real time interactions with the platform. Attendees will learn about other AI platforms that are creating graphic design elements at the push of a button...pre-set examples and real-time interactions.Attendees will discuss the pros & cons of AI in marketing + branding and share their perspectives with one another. Attendees will learn about the cost savings and the time savings associated with using AI, should they choose to.
Mastering Local SEO for Service Businesses in the AI Era is tailored specifically for local service providers like plumbers, dentists, and others seeking to dominate their local search landscape. This session delves into leveraging AI advancements to enhance your online visibility and search rankings through the Content Factory model, designed for creating high-impact, SEO-driven content. Discover the Dollar-a-Day advertising strategy, a cost-effective approach to boost your local SEO efforts and attract more customers with minimal investment. Gain practical insights on optimizing your online presence to meet the specific needs of local service seekers, ensuring your business not only appears but stands out in local searches. This concise, action-oriented workshop is your roadmap to navigating the complexities of digital marketing in the AI age, driving more leads, conversions, and ultimately, success for your local service business.
Key Takeaways:
Embrace AI for Local SEO: Learn to harness the power of AI technologies to optimize your website and content for local search. Understand the pivotal role AI plays in analyzing search trends and consumer behavior, enabling you to tailor your SEO strategies to meet the specific demands of your target local audience. Leverage the Content Factory Model: Discover the step-by-step process of creating SEO-optimized content at scale. This approach ensures a steady stream of high-quality content that engages local customers and boosts your search rankings. Get an action guide on implementing this model, complete with templates and scheduling strategies to maintain a consistent online presence. Maximize ROI with Dollar-a-Day Advertising: Dive into the cost-effective Dollar-a-Day advertising strategy that amplifies your visibility in local searches without breaking the bank. Learn how to strategically allocate your budget across platforms to target potential local customers effectively. The session includes an action guide on setting up, monitoring, and optimizing your ad campaigns to ensure maximum impact with minimal investment.
The digital marketing industry is changing faster than ever and those who don’t adapt with the times are losing market share. Where should marketers be focusing their efforts? What strategies are the experts seeing get the best results? Get up-to-speed with the latest industry insights, trends and predictions for the future in this panel discussion with some leading digital marketing experts.
Most small businesses struggle to see marketing results. In this session, we will eliminate any confusion about what to do next, solving your marketing problems so your business can thrive. You’ll learn how to create a foundational marketing OS (operating system) based on neuroscience and backed by real-world results. You’ll be taught how to develop deep customer connections, and how to have your CRM dynamically segment and sell at any stage in the customer’s journey. By the end of the session, you’ll remove confusion and chaos and replace it with clarity and confidence for long-term marketing success.
Key Takeaways:
• Uncover the power of a foundational marketing system that dynamically communicates with prospects and customers on autopilot.
• Harness neuroscience and Tribal Alignment to transform your communication strategies, turning potential clients into fans and those fans into loyal customers.
• Discover the art of automated segmentation, pinpointing your most lucrative customers and identifying the optimal moments for successful conversions.
• Streamline your business with a content production plan that eliminates guesswork, wasted time, and money.
Videos are more engaging, more memorable, and more popular than any other type of content out there. That’s why it’s estimated that 82% of consumer traffic will come from videos by 2025.
And with videos evolving from landscape to portrait and experts promoting shorter clips, one thing remains constant – our brains LOVE videos.
So is there science behind what makes people absolutely irresistible on camera?
The answer: definitely yes.
In this jam-packed session with Stephanie Garcia, you’ll get your hands on a steal-worthy guide that uncovers the art and science to being irresistible on camera. From body language to words that convert, she’ll show you how to captivate on command so that viewers are excited and ready to take action.
1. The
Fes'val
of
NewMR
2014
would
not
be
possible
without
our
sponsors.
Thanks
to:
Our
Pla'num
Sponsor
for
2014
Silver
Sponsors
Session
Sponsors
Media
Partner
Fes'val
Supporters
• Schlesinger
Associates
• GMI
• krea
The
Fes'val
of
2014
2. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Embrace,
Extend,
Ex'nguish
NPS
Driving
Revenue
with
BeKer
Loyalty
Measures
2014
Pla9num
Sponsor
Jeffrey
Henning
President,
Researchscape
Interna'onal
USA
4. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Embrace?!
My
love
affair
with
NPS:
• Very
easy
to
implement
• Simple
to
explain
• Nega9ve
scores
can
be
improved
5. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
How
likely
is
it
that
you
would
recommend
[brand]
to
a
friend
or
colleague?
Not
Likely
at
All
Neutral
Extremely
Likely
Image
credit:
hGp://blogs.sas.com/content/customeranaly9cs/files/2013/06/B-‐Solis-‐Net-‐Promoters.jpg
6. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Follow-‐up
Ques'on:
“Why?!”
Ra'ng
Segment
Why?
0
Detractor
“Because
I
don't
give
out
recommenda9on
unless
under
great
or
poor
service
instances.”
6
Passive
“I
have
had
good
experiences
with
them
in
the
past
and
my
friends
probably
will
too.”
8
Passive
“They
have
the
best
cell
coverage
of
all
the
networks
by
far.
I
get
service
in
many
areas
that
I
did
not
before.”
8
Passive
“Absolutely!
I’ve
shown
my
new
phone
off
to
a
bunch
of
friends.”
10
Promoter
“I
don't
have
any
problem
with
the
service.”
7. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Dear Net Promoter Score,
It’s not you. It’s me. I
mistook infatuation for love,
and I am sorry if I hurt
you.
Wait a minute – it is you...
8. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Noise
Masks
the
Signal
• 11-‐point
scale
has
the
lowest
predic've
value
of
any
scale
tested
(Schneider,
Berent,
Thomas,
Krosnick;
2008)
• “Sa'sfac'on”
and
“liking”
are
more
predic've
of
recommenda'ons
(diGo)
• Not
predic've
of
loyalty
(Keiningham,
Cooil,
Aksoy,
Andreassen,
Weiner;
2007)
• Segments
are
counter
to
how
ques'on
is
asked
and
not
differen'ated
sta's'cally
(Roberts;
2007)
• Less
accurate
than
mul'ple
ques'ons
(Hill,
Roche,
Allen;
2007)
• Less
accurate
than
ACSI
(Keiningham,
Cooil,
Andreassen,
Aksoy,
Weiner;
2007)
hGp://bit.ly/NPSsucks
9. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Noise
Masks
the
Signal
• 11-‐point
scale
has
the
lowest
predic've
value
of
any
scale
tested
(Schneider,
Berent,
Thomas,
Krosnick;
2008)
• “Sa'sfac'on”
and
“liking”
are
more
predic've
of
recommenda'ons
(diGo)
• Not
predic've
of
loyalty
(Keiningham,
Cooil,
Aksoy,
Andreassen,
Weiner;
2007)
• Segments
are
counter
to
how
ques'on
is
asked
and
not
differen'ated
sta's'cally
(Roberts;
2007)
• Less
accurate
than
mul'ple
ques'ons
(Hill,
Roche,
Allen;
2007)
• Less
accurate
than
ACSI
(Keiningham,
Cooil,
Andreassen,
Aksoy,
Weiner;
2007)
hGp://bit.ly/NPSsucks
12. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Backfire
• “A
natural
defense
mechanism
to
avoid
cogni9ve
dissonance”
–
Brendan
Nyhan,
University
of
Michigan
• Confidence
in
knowledge
inversely
correlated
to
actual
knowledge
–
James
Kuklinksi,
University
of
Illinois
• “Facts
don’t
have
the
power
to
change
our
minds...
• “Like
an
underpowered
an9bio9c,
facts
make
misinforma9on
stronger...
• “The
more
the
par9cipant
cared
about
the
topic,
the
stronger
the
backfire.”
–
Joe
Keohane
hGp://bit.ly/FactsBackfire
13. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Given
that
NPS
Has
Its
Promoters,
Too...
What
Should
YOU
Do?
14. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Steal
a
Page
From
Microsob...
Embrace
Extend
Ex9nguish
“Embrace,
extend
and
ex9nguish.”
–
Paul
Maritz,
Microsoj
vice
president,
describing
in
1995
Microsoj’s
strategy
towards
Netscape,
Java,
and
the
Internet
15. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Steal
a
Page
From
Microsob...
Embrace
Extend
Ex9nguish
16. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Steal
a
Page
From
Microsob...
Embrace
Extend
Ex9nguish
• <marquee>
• Ac9veX
• VBScript
• Java
incompa9bili9es
• Display
Office
documents
17. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Steal
a
Page
From
Microsob...
Embrace
Extend
Ex9nguish
0%
20%
40%
60%
80%
100%
1995
1996
1997
1998
1999
2000
2001
2002
Internet
Explorer
Netscape
Others
18. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Applying
to
NPS
Embrace
Extend
Ex9nguish
• “Absolutely
we’ll
include
NPS
in
this
survey!”
19. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Applying
to
NPS
Embrace
Extend
Ex9nguish
• “And
so
that
we
can
put
the
NPS
results
in
context,
we’ll
ask
other
ques9ons
about
sa9sfac9on,
loyalty,
and
customer
experience.”
20. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
But
Let’s
Not
Be
Just
Like
Microsob
Embrace
Extend
Ex9nguish
Let’s
look
at
proprietary
measures
for
inspira9on
but
modernize
them
and
make
them
open:
Ÿ
ACSI
Ÿ
Forrester
Cxi
Ÿ BOB
Ÿ
ECSI
Ÿ
Temkin
Ÿ Apostle
Ÿ
NCSB
Ÿ
TNS
Ÿ Vovici
21. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Survey
Authors
Ignore
Research
Into
Scales
• Fully
labeled
scales
have
greater
reliability
and
validity
and
are
preferred
by
respondents
• 5-‐point
scales
are
best
for
unipolar
measurement
(e.g.,
0-‐100%)
• 7-‐point
scales
are
best
for
bipolar
measurement
(e.g.,
end
points
are
opposites)
• Avoid
numeric
values,
which
alter
the
meaning
of
labels
and
confuse
respondents
• List
nega9ve
choices
first
for
a
slight
bias
against
the
most
posi9ve
choice
• Where
possible
use
standard
scales
rather
than
write
your
own
Source:
Krosnick,
J.
A.,
&
Fabrigar,
L.
R.
(1997).
“Designing
ra9ng
scales
for
effec9ve
measurement
in
surveys.”
22. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Survey
Authors
Ignore
Research
Into
Scales
• Fully
labeled
scales
have
greater
reliability
and
validity
and
are
preferred
by
respondents
• 5-‐point
scales
are
best
for
unipolar
measurement
(e.g.,
0-‐100%)
• 7-‐point
scales
are
best
for
bipolar
measurement
(e.g.,
end
points
are
opposites)
• Avoid
numeric
values,
which
alter
the
meaning
of
labels
and
confuse
respondents
• List
nega9ve
choices
first
for
a
slight
bias
against
the
most
posi9ve
choice
• Where
possible
use
standard
scales
rather
than
write
your
own
Source:
Krosnick,
J.
A.,
&
Fabrigar,
L.
R.
(1997).
“Designing
ra9ng
scales
for
effec9ve
measurement
in
surveys.”
For
purposes
of
external
benchmarking,
use
the
benchmark’s
scale,
even
if
subop'mal
23. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Applying
to
NPS
Embrace
Extend
Ex9nguish
(When
we’re
done,
you’ll
see
that
these
other
methods
provide
more
informa9on.)
24. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
The
ACSI
Score
CUSTOMER
SATISFACTION
(ACSI)
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
25. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
85
Personal
Care
&
Cleaning
84
Credit
Unions
Pet
Food
83
Breweries
Electronics
(TV/VCR/
DVD)
Food
Manufacturing
Sob
Drinks
82
Automobiles
Express
Delivery
Internet
Retail
81
Ambulatory
Care
Property
&
Casualty
Insur.
80
Apparel
Full
Service
Restaurants
Search
Engines
Major
Appliances
79
Athle'c
Shoes
78
CigareKes
Health
Stores
Life
Insurance
Limited
Service
Restaurants
76
Specialty
Retail
Stores
Supermarkets
75
Banks
Hospitals
Hotels
Internet
News
74
Dept.
&
Discount
Stores
Energy
U'li'es
Gasoline
Sta'ons
Personal
Computers
73
Fixed
Line
Telephone
Health
Insurance
71
Cellular
Telephones
Computer
Sobware
70
Mo'on
Pictures
69
Network/Cable
TV
News
68
Wireless
Telephone
67
Broadcas'ng
TV
News
64
Cable
&
Satellite
TV
Newspapers
62
Airlines
ACSI
Score
Source:
TheACSI.org
26. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
One
Method
of
Calcula'ng
Score
• Actual
formula
is
proprietary
• Weights
vary
by
industry
and
even
by
company
• Real
world
validity
– Macroeconomically,
ACSI
has
been
shown
to
correlate
to
growth
in
GDP
and
PCE
(Personal
Consump9on
Expenditure)
– Microeconomically,
ASCI
predicts
stock
market
performance
for
indices
as
well
as
individual
stocks,
and
even
correlates
to
CEO
bonuses!
– Source:
"The
Effect
of
Compe99on
on
the
Contrac9ng
Use
of
Customer
Sa9sfac9on:
Evidence
from
the
American
Customer
Sa9sfac9on
Index
(ACSI)",
Clara
Xiaoling
Chen,
Ella
Mae
Matsumura,
Jae
Yong
Shin,
2008
27. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
The
ACSI
Model
–
15
Key
Ques'ons
CUSTOMER
EXPECTATIONS
Reliability
Overall
Customiza'on
PERCEIVED
OVERALL
QUALITY
Reliability
Overall
Customiza'on
PERCEIVED
VALUE
Price
Given
Quality
Quality
Given
Price
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
(ACSI)
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
CUSTOMER
COMPLAINTS
Complaints
Behavior
28. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
But
The
ACSI
Model
Is
Showing
Its
Age
Embrace
Extend
Ex9nguish
• 20
years
old
• Research
shows
many
aspects
are
redundant
or
have
liGle
impact
• Doesn’t
follow
ra9ng
scale
best
prac9ces
• Doesn’t
incorporate
new
measures
of
loyalty
or
customer
experience
29. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Customer
Expecta'ons
Diminish
In
Importance
Over
Time*
*Source:
"The
evolu9on
and
future
of
na9onal
customer
sa9sfac9on
index
models”;
Johnson,
Gustafsson,
Andreassen,
Cha;
2000.
CUSTOMER
EXPECTATIONS
Reliability
Overall
Customiza'on
PERCEIVED
OVERALL
QUALITY
Reliability
Overall
Customiza'on
PERCEIVED
VALUE
Price
Given
Quality
Quality
Given
Price
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
CUSTOMER
COMPLAINTS
Complaints
Behavior
30. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Complaint
Response
Drives
Sa'sfac'on
Not
a
Consequence
of
Dissa'sfac'on*
*Source:
"The
evolu9on
and
future
of
na9onal
customer
sa9sfac9on
index
models”;
Johnson,
Gustafsson,
Andreassen,
Cha;
2000.
PERCEIVED
OVERALL
QUALITY
Reliability
Overall
Customiza'on
PERCEIVED
VALUE
Price
Given
Quality
Quality
Given
Price
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
CUSTOMER
COMPLAINTS
Complaints
Behavior
31. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Quality
and
Value
Overlap*
*Source:
"The
evolu9on
and
future
of
na9onal
customer
sa9sfac9on
index
models”;
Johnson,
Gustafsson,
Andreassen,
Cha;
2000.
PERCEIVED
OVERALL
QUALITY
Reliability
Overall
Customiza'on
PERCEIVED
VALUE
Price
Given
Quality
Quality
Given
Price
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
32. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
NCSB
Adds
Price
Comparisons
+
Quality
Drivers
That
Vary
by
Industry*
*Source:
"The
evolu9on
and
future
of
na9onal
customer
sa9sfac9on
index
models”;
Johnson,
Gustafsson,
Andreassen,
Cha;
2000.
INDUSTRY-‐
SPECIFIC
QUALITY
DRIVERS
X
Z
Y
PRICE
COMPARISONS
To
Expecta'ons
To
Quality
To
Compe'tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
33. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
NCSB’s
SERVQUAL/RATER
Quality
Drivers
Had
LiKle
Effect*
INDUSTRY-‐
SPECIFIC
QUALITY
DRIVERS
X
Z
Y
PRICE
COMPARISONS
To
Expecta'ons
To
Quality
To
Compe'tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
*Source:
"The
evolu9on
and
future
of
na9onal
customer
sa9sfac9on
index
models”;
Johnson,
Gustafsson,
Andreassen,
Cha;
2000.
34. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
What
Can
We
Replace
The
Quality
Drivers
With?
PRICE
COMPARISONS
To
Expecta'ons
To
Quality
To
Compe'tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
35. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Evolu'on
of
Customer
Research
Customer
Sa9sfac9on
(1980s)
Customer
Loyalty
(1990s)
Customer
Experience
(2000s)
36. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Forrester
CXi
(Customer
Experience
Index)
Forrester
CXi
components
1. Usefulness
2. Ease
of
Use
3. Enjoyability
• Although
only
launched
in
2007,
Forrester’s
CXi
(previously
CxPi)
has
emerged
as
an
important
new
index
• CxPi
=
(%
of
customers
with
a
good
experience)-‐(%
with
bad
experience)
for
each
ques9on
• CXi
=
(average()-‐1)/4*100
• Public
results
for
113
organiza9ons
in
12
industries
• Watermark
Consul9ng
correlates
it
to
stock
market
performance:
• Stock
of
CXi
leaders
appreciated
23%
from
2007
to
2011
• Stock
of
CXi
laggards
fell
46%
37. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
CXi
Correlates
To
Loyalty
Source:
Bruce
Temkin,
Experience
Ma5ers
blog
38. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
CUSTOMER
EXPERIENCE
Effec'veness
Enjoyability
Ease
CX
Ques'on
Wording
Forrester
CXi
Temkin
Experience
Ra'ngs
Generic
Wording
Usefulness/
Func9onal
Thinking
about
your
recent
interac9ons
with
these
firms,
how
effec9ve
were
they
at
mee9ng
your
needs?
Thinking
of
your
most
recent
interac9ons
with
each
of
these
companies,
to
what
degree
were
you
able
to
accomplish
what
you
wanted
to
do?
How
effec9vely
did
our
organiza9on
meet
your
needs?
Ease/
Accessible
Thinking
about
your
recent
interac9ons
with
these
firms,
how
easy
was
it
to
work
with
these
firms?
Thinking
of
your
most
recent
interac9ons
with
each
of
these
companies,
how
easy
was
it
interact
with
the
company?
How
easy
was
it
to
work
with
our
organiza9on?
Enjoyability/
Emo9onal
Thinking
about
your
recent
interac9ons
with
these
firms,
how
enjoyable
were
the
interac9ons?
Thinking
of
your
most
recent
interac9ons
with
each
of
these
companies,
how
did
you
feel
about
those
interac9ons?
How
enjoyable
were
your
interac9ons
with
our
organiza9on?
39. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Integra'ng
Customer
Experience
Measurement
into
Our
Model
CUSTOMER
EXPERIENCE
Effec'veness
Enjoyability
Ease
PRICE
COMPARISONS
To
Expecta'ons
To
Quality
To
Compe'tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
Source:
Researchscape
Interna9onal
40. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
ACSI
Loyalty
• “The
next
9me
you
are
going
to
purchase
a
[category],
how
likely
is
it
that
it
will
be
a
[brand]
again?”
• “Let
us
imagine
that
[brand]
raises
its
prices.
If
other
companies
remain
at
the
same
prices,
how
much
can
[brand]
raise
its
price
before
you
definitely
would
not
choose
it
the
next
9me
you
purchase
a
[category]?”
[0%
to
25%]
• “Let
us
now
imagine
that
[brand]
lowers
its
prices.
If
other
companies
remain
at
the
same
prices,
how
much
must
[brand]
lower
its
price
before
you
would
definitely
choose
it
the
next
9me
you
purchase
a
[category]?”
[0%
to
25%]
CUSTOMER
LOYALTY
Repurchase
Likelihood
Price
Decrease
Price
Increase
41. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
CUSTOMER
LOYALTY
Repurchase
Likelihood
Reluctance
to
Switch
Recommend
Likelihood
Common
Loyalty
Indices
ACSI
ECSI
NCSB
Forr-‐
ester
TNS
B2B
BOB
Adv.
BOB
Prch.
Price
increase
tolerance
X
Price
decrease
recep9vity
X
Reluctance
to
switch
X
Likelihood
to
choose
again
for
the
first
9me
X
Likelihood
to
repurchase
X
X
X
X
X
X
Likelihood
to
increase
purchase
size
X
X
Likelihood
to
increase
purchase
frequency
X
Likelihood
to
purchase
different
products
X
Likelihood
to
recommend
X
X
X
X
X
Likelihood
to
speak
favorably
X
Compe99ve
advantage
X
Overall
sa9sfac9on
X
X
42. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
CESL
Model
(Customer
Experience/Sa'sfac'on/Loyalty)
CUSTOMER
EXPERIENCE
Effec'veness
Enjoyability
Ease
PRICE
COMPARISONS
To
Expecta'ons
To
Quality
To
Compe'tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Reluctance
to
Switch
Recommend
Likelihood
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
Source:
Researchscape
Interna9onal
43. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
CESL’s
12+
Ques'ons
1. How
likely
is
it
that
you
would
recommend
Acme
to
a
friend
or
colleague?
2. Why?
3. Thinking
about
your
recent
interac9ons
with
Acme...
How
effec9ve
was
Acme
at
mee9ng
your
needs?
4. How
easy
was
it
work
with
Acme?
5. How
enjoyable
were
your
interac9ons
with
Acme?
6. What
is
your
overall
sa9sfac9on
with
Acme?
7. To
what
extent
has
Acme
met
your
expecta9ons?
8. How
well
did
Acme
services
compare
with
the
ideal?
9. Given
your
ini9al
expecta9ons,
how
you
would
rate
the
price
that
you
pay
for
Acme
services?
10. Given
the
quality
of
our
services,
how
would
you
rate
the
price
that
you
pay
for
them?
11. Given
compe9tors'
prices,
how
would
you
rate
the
price
that
you
pay
for
Acme
services?
12. How
reluctant
are
you
to
switch
your
business
from
Acme?
13. How
likely
are
you
to
repurchase
from
Acme?
44. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
1.
How
likely
is
it
that
you
would
recommend
Acme
to
a
friend
or
colleague?
>
0
-‐
Not
likely
at
all
>
1
>
2
>
3
>
4
>
5
-‐
Neutral
>
6
>
7
>
8
>
9
>
10
-‐
Extremely
likely
2.
Why?
>>
...
12.
How
reluctant
are
you
to
switch
your
business
from
Acme?
>
Not
at
all
reluctant
>
Slightly
reluctant
>
Moderately
reluctant
>
Very
reluctant
>
Completely
reluctant
13.
How
likely
are
you
to
repurchase
from
Acme?
>
Not
at
all
likely
>
Slightly
likely
>
Moderately
likely
>
Very
likely
>
Completely
likely
CUSTOMER
LOYALTY
Repurchase
Likelihood
Reluctance
to
Switch
Recommend
Likelihood
45. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
3.
Thinking
about
your
recent
interac9ons
with
Acme...How
effec9ve
was
Acme
at
mee9ng
your
needs?
>
Not
at
all
effec9ve
>
Slightly
effec9ve
>
Moderately
effec9ve
>
Very
effec9ve
>
Extremely
effec9ve
4.
How
easy
was
it
work
with
Acme?
>
Not
at
all
easy
>
Slightly
easy
>
Moderately
easy
>
Very
easy
>
Extremely
easy
5.
How
enjoyable
were
your
interac9ons
with
Acme?
>
Not
at
all
enjoyable
>
Slightly
enjoyable
>
Moderately
enjoyable
>
Very
enjoyable
>
Extremely
enjoyable
CUSTOMER
EXPERIENCE
Effec'veness
Enjoyability
Ease
46. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
6.
What
is
your
overall
sa9sfac9on
with
Acme?
>
Not
at
all
sa9sfied
>
Slightly
sa9sfied
>
Moderately
sa9sfied
>
Very
sa9sfied
>
Completely
sa9sfied
7.
To
what
extent
has
Acme
met
your
expecta9ons?
>
Not
at
all
>
Slightly
>
Moderately
>
Very
much
>
Completely
8.
How
well
did
Acme
services
compare
with
the
ideal?
>
Not
at
all
close
to
the
ideal
>
Slightly
close
>
Moderately
close
>
Very
close
>
Extremely
close
to
the
ideal
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
47. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
9.
Given
your
ini9al
expecta9ons,
how
you
would
rate
the
price
that
you
pay
for
Acme
services?
>
Very
poor
given
your
expecta9ons
>
Poor
given
your
expecta9ons
>
Average
given
your
expecta9ons
>
Good
given
your
expecta9ons
>
Excellent
given
your
expecta9ons
10.
Given
the
quality
of
our
services,
how
would
you
rate
the
price
that
you
pay
for
them?
>
Very
poor
given
the
quality
>
Poor
given
the
quality
>
Average
given
the
quality
>
Good
given
the
quality
>
Excellent
given
the
quality
11.
Given
compe9tors'
prices,
how
would
you
rate
the
price
that
you
pay
for
Acme
services?
>
Very
poor
given
compe9tors'
prices
>
Poor
given
compe9tors'
prices
>
Average
given
compe9tors'
prices
>
Good
given
compe9tors'
prices
>
Excellent
given
compe9tors'
prices
PRICE
COMPARISONS
To
Expecta'ons
To
Compe'tors
To
Quality
48. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
The
Apostle
Model
Apostle
Hostage
Detractor
Mercenary
Low
Medium
High
Customer
Sa'sfac'on
High
Medium
Low
Customer
Loyalty
• Jones
and
Sasser
pioneered
their
own
loyalty
segmenta9on
• For
sa9sfac9on
scale,
use
CSAT
ques9on
or
ACSI’s
3
ques9ons
• For
loyalty,
use
likelihood
to
repurchase
or
a
loyalty
index
• “Apostle
Model”
a
misnomer:
top
quadrant
are
really
“Loyalists”
49. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
TNS
Loyalty
Model
Champion
Cap've
Rebel
Moral
Supporter
Low
Medium
High
Customer
Advocacy
High
Medium
Low
Customer
Loyalty
• Can
be
used
in
addi9on
to
the
Apostle
Model
• Again,
for
loyalty,
use
a
single
ques9on
or
an
index
• TNS
segments
into
equal
quadrants;
best
results
by
keeping
Apostle
Model’s
smaller
top
quadrant
50. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Vovici
Champion
Model
None
Completely
Customer
Advocacy
Completely
None
Customer
Loyalty
• Inspired
by
the
TNS
CLI
model
• Goal:
Turn
the
Bench
into
Starters,
Players
into
All-‐
Stars
and
All-‐Stars
into
Champions
Champions
All-‐Stars
Starters
The
Bench
51. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Correlate
Results
Across
22
CESL
Measures
To
Real-‐World
Behavior*
• 12
closed-‐ended
ques9ons
• 4
main
indexes
• 1
index
of
indexes
(all
12
closed
ques9ons)
• 1
custom
index
(CSAT/repurchase/recommend)
• 4
segmenta9on
models
(NPS,
Apostle
Model,
TNS
Loyalty
Model,
Vovici
Champion
Model)
*Renewal,
repurchase,
upsell...
52. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Case
Study
• Wireless
service
provider
• NPS
of
-‐8%
• Seeking
to
improve
reten9on
• Correlated
loyalty
metrics
against
subsequent
renewal
(next
30
to
60
days)
53. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Case
Study
Rank
Metric
Correl
a'on
1
Customer
Loyalty
Index
0.762
2
CSAT/Loyalty
Index
0.751
3
Vovici
Champion
Model
0.749
4
Likelihood
to
Repurchase
0.730
5
Likelihood
to
Recommend
0.728
6
Index
of
Indices
0.685
7
CSAT
0.639
8
Apostle
Model
0.604
9
TNS
Loyalty
Model
0.590
10
Reluctance
to
Switch
0.585
18
NPS
0.502
22
Ease
0.402
• Wireless
service
provider
• NPS
of
-‐8%
• Seeking
to
improve
reten9on
• Correlated
loyalty
metrics
against
subsequent
renewal
(next
30
to
60
days)
54. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Correla'on
of
CESL
Indices
to
Renewal
CUSTOMER
EXPERIENCE
Effec'veness
Enjoyability
Ease
PRICE
COMPARISONS
To
Expecta'ons
To
Quality
To
Compe'tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Reluctance
to
Switch
Recommend
Likelihood
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta'ons
Comparison
with
Ideal
.762
.549
.534
.624
Source:
Researchscape
Interna9onal
.685
55. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Simplify
CESL
for
Subsequent
Fielding
CUSTOMER
EXPERIENCE
Effec'veness
Enjoyability
Ease
PRICE
COMPARISONS
To
Expecta9ons
To
Quality
To
Compe9tors
CUSTOMER
LOYALTY
Repurchase
Likelihood
Reluctance
to
Switch
Recommend
Likelihood
CUSTOMER
SATISFACTION
Sa'sfac'on
Expecta9ons
Comparison
with
Ideal
.762
.566
.528
.639
Source:
Researchscape
Interna9onal
.738
56. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Embrace,
Extend,
Ex'nguish
Embrace
Extend
Ex9nguish
Streamlined
instrument
Champion
Model
segmenta9on
for
driver
analysis
57. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
CESL
Pros
&
Cons
Strengths
• Synthesis
of
best
prac9ces
from
many
vendors
• 4
possible
segmenta9ons
• 22
different
measures
to
test
• ACSI
and
CXi
correlate
to
stock
market
performance
• Free,
and
public
domain
Weaknesses
• 12+
ques9ons
• Not
independently,
academically
validated
• Benchmarks
to
ACSI
and
CXi
aren’t
pure
comparisons
58. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Different
Results
for
Different
Cases
Measure
Different
Real-‐World
Behaviors
• Small
installed
base,
looking
to
win
lots
of
new
customers
• Medium
installed
base
with
low
spend,
looking
to
increase
amount
spent
by
customers
• Large,
stable
market
share,
looking
to
maintain
customer
base
Different
Measures
Win
for
Different
Companies
• Customer
Loyalty
Index
• CSAT/Loyalty
• Likelihood
to
Recommend
Winning
Segmenta9on:
• TNS
Loyalty
Model
• Apostle
Model
• Vovici
Champion
Model
59. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Special
Thanks
• Bain
&
Company
(NPS)
• Business
Over
Broadway
(ALI,
PLI)
• CFI
Group
(ACSI)
• Forrester
Research
(CXI,
CLI)
• Rela9on
Monitor
(ECSI)
• Temkin
Group
(Experience
Ra9ngs)
• TNS
(CLI,
Loyalty
Model)
• University
of
Michigan
(ACSI,
NCSB)
• Verint
(Vovici
Champion
Model)
60. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
THANK
YOU
2014
Pla9num
Sponsor
Jeffrey
Henning
President,
Researchscape
Interna'onal
USA
61. The
Fes'val
of
NewMR
2014
would
not
be
possible
without
our
sponsors.
Thanks
to:
Our
Pla'num
Sponsor
for
2014
Silver
Sponsors
Session
Sponsors
Media
Partner
Fes'val
Supporters
• Schlesinger
Associates
• GMI
• krea
The
Fes'val
of
2014
62. Jeffrey Henning, Researchscape International, USA
Festival of NewMR, December 2014
Embrace,
Extend,
Ex'nguish
NPS
Driving
Revenue
with
BeKer
Loyalty
Measures
Jeffrey
Henning
President
Researchscape
Interna9onal
jhenning@researchscape.com
@jhenning
Work:
888-‐983-‐1675
Mobile:
617-‐620-‐6142