SlideShare a Scribd company logo
Please tweet! @ESRAsurvey @LoveStats
Please tweet! @LoveStats #ESRAsurvey
Call Me Maybe:
Effects of asking for
telephone numbers
on survey honesty
Presented by Annie Pettit
Chief Research Officer at Peanut Labs
Please tweet! @ESRAsurvey @LoveStats
Research Questions
Should you ask at
the beginning or the
end of the survey?
When To Ask
Will people endorse
more socially
desirable, charitable
behaviours?
Will people endorse
fewer illegal,
unethical, and
embarrassing
behaviours?
Social Desirability Illegal BehavioursCBA
Please tweet! @ESRAsurvey @LoveStats
Method
Group 1
• Beginning
• Phone
number
request
was first
question
• N=500
Group 2
• End
• Phone
number
request was
last question
• N=500
Non-probability, incentivized research panel
Sampled and weighted to US census targets
Please tweet! @ESRAsurvey @LoveStats
Question Categories
Compliment
employee
Bought
someone
coffee
Kind Charitable
Pee in
shower
Embarrassing
Called in
sick
Unethical
Listen to
music
Neutral
Impaired
driving
Illegal
Please tweet! @ESRAsurvey @LoveStats
RESULTS
BEGINNING VS END
Please tweet! @ESRAsurvey @LoveStats
Neutral
% of People Endorsing Neutral Behaviours
Please tweet! @ESRAsurvey @LoveStats
Neutral
It doesn’t matter if you were asked at the beginning or the end,
endorsement rates for neutral behaviours were the same.
Average
Endorsement
Standard Deviation
Please tweet! @ESRAsurvey @LoveStats
Charitable
Endorsement of charitable behaviours didn’t change if you were asked
at the beginning or the end.
Please tweet! @ESRAsurvey @LoveStats
Embarrassing
Endorsement of embarrassing behaviours didn’t change if you were
asked at the beginning or the end.
Please tweet! @ESRAsurvey @LoveStats
Illegal
Though there was more variability, endorsement of illegal behaviours
didn’t change if you were asked at the beginning or the end.
Please tweet! @ESRAsurvey @LoveStats
or
makes
no
Beginning
difference
end
CONCLUSION
Please tweet! @ESRAsurvey @LoveStats
RESULTS
AGREE VS DECLINE
Please tweet! @ESRAsurvey @LoveStats
Method
Group 1
•Yes, here’s
my phone
number
•555-5555
Group 2
•No! You
can’t have
my phone
number
•BUG-OFFF
Please tweet! @ESRAsurvey @LoveStats
Illegal
People who agree endorse more illegal behaviours
Please tweet! @ESRAsurvey @LoveStats
Embarrassing
People who agree endorse more embarrassing behaviours
Please tweet! @ESRAsurvey @LoveStats
Charitable
People who agree endorse more charitable behaviours
Please tweet! @ESRAsurvey @LoveStats
Neutral
People who agree endorse more neutral behaviours
Please tweet! @ESRAsurvey @LoveStats
or
makes a
Agreeing
difference
disagreeing
CONCLUSION
Please tweet! @ESRAsurvey @LoveStats
RESULTS
INTERACTIONS
Please tweet! @ESRAsurvey @LoveStats
Method
Group 1
Beginning
Decline
Group 2
End
Decline
Group 3
Beginning
Agree
Group 4
End
Agree
Please tweet! @ESRAsurvey @LoveStats
Neutral Questions
Endorsement Rates Not Affected
Please tweet! @ESRAsurvey @LoveStats
Agreers Are Confessors
Illegal Unethical Embarrass Kind Charitable Neutral Average
Please tweet! @ESRAsurvey @LoveStats
the
and listen
If
agreers
beginning
you
want
honesty
ask
at
to
CONCLUSION
Please tweet! @ESRAsurvey @LoveStats
Many new questions
• Type of PII: What if we asked for email or physical address
instead?
• Position of Ask: What if we ask half-way through? After an
embarrassing question?
• Survey Style: What if the entire survey is embarrassing?
• Screen Outs: What if everyone was told there would be
no screen-outs?
Please tweet! @ESRAsurvey @LoveStats
Thank you!
Annie Pettit
Chief Research Officer
annie@peanutlabs.com
ca.linkedin.com/in/AnniePettit/
facebook.com/AnniePettit
twitter.com/LoveStats
Jonathan Cheriff
Director of Sales & Marketing
jonathan.cheriff@peanutlabs.com
Find PeanutLabs on
LinkedIn Facebook Twitter YouTube
DIY SURVEY PROGRAMMING DIY POLLINGDIY SAMPLE

More Related Content

Viewers also liked

Angels and Demons: Is your survey penalizing the right people?
Angels and Demons: Is your survey penalizing the right people?Angels and Demons: Is your survey penalizing the right people?
Angels and Demons: Is your survey penalizing the right people?
Annie Pettit, Research Methodologist
 
Atlanta Copywriter Portfolio/Georgia Dzurica
Atlanta Copywriter Portfolio/Georgia DzuricaAtlanta Copywriter Portfolio/Georgia Dzurica
Atlanta Copywriter Portfolio/Georgia Dzurica
GDzurica
 
Effects of splitting long surveys into two
Effects of splitting long surveys into twoEffects of splitting long surveys into two
Effects of splitting long surveys into two
Annie Pettit, Research Methodologist
 
VUE-JAN-FEB-2015
VUE-JAN-FEB-2015VUE-JAN-FEB-2015
VUE-MAY-2013
VUE-MAY-2013VUE-MAY-2013
Men are from Mars: Gender differences in word choices in social media
Men are from Mars: Gender differences in word choices in social mediaMen are from Mars: Gender differences in word choices in social media
Men are from Mars: Gender differences in word choices in social media
Annie Pettit, Research Methodologist
 
The Rise and Fall and Rise of Social Media Research #IIEXap14
The Rise and Fall and Rise of Social Media Research #IIEXap14The Rise and Fall and Rise of Social Media Research #IIEXap14
The Rise and Fall and Rise of Social Media Research #IIEXap14
Annie Pettit, Research Methodologist
 
How to Turn Big Data into Actionable Data IIeX Europe 2016
How to Turn Big Data into Actionable Data IIeX Europe 2016How to Turn Big Data into Actionable Data IIeX Europe 2016
How to Turn Big Data into Actionable Data IIeX Europe 2016
Annie Pettit, Research Methodologist
 
Casro 2013: Battle of the Scales
Casro 2013: Battle of the ScalesCasro 2013: Battle of the Scales
Casro 2013: Battle of the Scales
Annie Pettit, Research Methodologist
 
Survey analysis in a nutshell with Jeffrey Henning
Survey analysis in a nutshell with Jeffrey HenningSurvey analysis in a nutshell with Jeffrey Henning
Survey analysis in a nutshell with Jeffrey Henning
Annie Pettit, Research Methodologist
 
How to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaireHow to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaire
Annie Pettit, Research Methodologist
 
Customer Experience: From Bits and Bytes to Flesh and Blood
Customer Experience: From Bits and Bytes to Flesh and BloodCustomer Experience: From Bits and Bytes to Flesh and Blood
Customer Experience: From Bits and Bytes to Flesh and Blood
Annie Pettit, Research Methodologist
 
Multimode Global Scale Usage
Multimode Global Scale UsageMultimode Global Scale Usage
Multimode Global Scale Usage
Annie Pettit, Research Methodologist
 
How people talk about us behind our backs
How people talk about us behind our backsHow people talk about us behind our backs
How people talk about us behind our backs
Annie Pettit, Research Methodologist
 
Wor dzportfolio rev13 2
Wor dzportfolio rev13 2Wor dzportfolio rev13 2
Wor dzportfolio rev13 2
GDzurica
 
How to Create Census Sampling Targets for Free Using Data Ferret
How to Create Census Sampling Targets for Free Using Data FerretHow to Create Census Sampling Targets for Free Using Data Ferret
How to Create Census Sampling Targets for Free Using Data Ferret
Annie Pettit, Research Methodologist
 
VUE-JUNE-2015
VUE-JUNE-2015VUE-JUNE-2015

Viewers also liked (17)

Angels and Demons: Is your survey penalizing the right people?
Angels and Demons: Is your survey penalizing the right people?Angels and Demons: Is your survey penalizing the right people?
Angels and Demons: Is your survey penalizing the right people?
 
Atlanta Copywriter Portfolio/Georgia Dzurica
Atlanta Copywriter Portfolio/Georgia DzuricaAtlanta Copywriter Portfolio/Georgia Dzurica
Atlanta Copywriter Portfolio/Georgia Dzurica
 
Effects of splitting long surveys into two
Effects of splitting long surveys into twoEffects of splitting long surveys into two
Effects of splitting long surveys into two
 
VUE-JAN-FEB-2015
VUE-JAN-FEB-2015VUE-JAN-FEB-2015
VUE-JAN-FEB-2015
 
VUE-MAY-2013
VUE-MAY-2013VUE-MAY-2013
VUE-MAY-2013
 
Men are from Mars: Gender differences in word choices in social media
Men are from Mars: Gender differences in word choices in social mediaMen are from Mars: Gender differences in word choices in social media
Men are from Mars: Gender differences in word choices in social media
 
The Rise and Fall and Rise of Social Media Research #IIEXap14
The Rise and Fall and Rise of Social Media Research #IIEXap14The Rise and Fall and Rise of Social Media Research #IIEXap14
The Rise and Fall and Rise of Social Media Research #IIEXap14
 
How to Turn Big Data into Actionable Data IIeX Europe 2016
How to Turn Big Data into Actionable Data IIeX Europe 2016How to Turn Big Data into Actionable Data IIeX Europe 2016
How to Turn Big Data into Actionable Data IIeX Europe 2016
 
Casro 2013: Battle of the Scales
Casro 2013: Battle of the ScalesCasro 2013: Battle of the Scales
Casro 2013: Battle of the Scales
 
Survey analysis in a nutshell with Jeffrey Henning
Survey analysis in a nutshell with Jeffrey HenningSurvey analysis in a nutshell with Jeffrey Henning
Survey analysis in a nutshell with Jeffrey Henning
 
How to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaireHow to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaire
 
Customer Experience: From Bits and Bytes to Flesh and Blood
Customer Experience: From Bits and Bytes to Flesh and BloodCustomer Experience: From Bits and Bytes to Flesh and Blood
Customer Experience: From Bits and Bytes to Flesh and Blood
 
Multimode Global Scale Usage
Multimode Global Scale UsageMultimode Global Scale Usage
Multimode Global Scale Usage
 
How people talk about us behind our backs
How people talk about us behind our backsHow people talk about us behind our backs
How people talk about us behind our backs
 
Wor dzportfolio rev13 2
Wor dzportfolio rev13 2Wor dzportfolio rev13 2
Wor dzportfolio rev13 2
 
How to Create Census Sampling Targets for Free Using Data Ferret
How to Create Census Sampling Targets for Free Using Data FerretHow to Create Census Sampling Targets for Free Using Data Ferret
How to Create Census Sampling Targets for Free Using Data Ferret
 
VUE-JUNE-2015
VUE-JUNE-2015VUE-JUNE-2015
VUE-JUNE-2015
 

Similar to Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders

Effects of Asking for Telephone Numbers on Survey Honesty
Effects of Asking for Telephone Numbers on Survey HonestyEffects of Asking for Telephone Numbers on Survey Honesty
Effects of Asking for Telephone Numbers on Survey Honesty
Peanut Labs
 
How Non-native English Speakers Respond to English Surveys
How Non-native English Speakers Respond to English SurveysHow Non-native English Speakers Respond to English Surveys
How Non-native English Speakers Respond to English Surveys
Peanut Labs
 
Men are from mars - Word choices in social media - Peanut Labs
Men are from mars - Word choices in social media - Peanut LabsMen are from mars - Word choices in social media - Peanut Labs
Men are from mars - Word choices in social media - Peanut Labs
Merlien Institute
 
Social Listening in the Travel Category
Social Listening in the Travel CategorySocial Listening in the Travel Category
Social Listening in the Travel Category
Annie Pettit, Research Methodologist
 
Peanut Labs Webinar - Survey Analysis In A Nutshell
Peanut Labs Webinar - Survey Analysis In A NutshellPeanut Labs Webinar - Survey Analysis In A Nutshell
Peanut Labs Webinar - Survey Analysis In A Nutshell
Peanut Labs
 
MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...
MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...
MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...
Mass. SHRAB
 
Effects of Splitting Long Surveys Into Two
Effects of Splitting  Long Surveys Into TwoEffects of Splitting  Long Surveys Into Two
Effects of Splitting Long Surveys Into Two
Peanut Labs
 
OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...
OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...
OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...
#PAY Symposium & Exposition | August 20 - 21, 2019 | Caesars Palace, Las Vegas
 
Effective Communication Skills
Effective Communication SkillsEffective Communication Skills
Effective Communication Skills
Hj Mohamad Idrakisyah
 
Roadmap to Building a Powerful Brand
Roadmap to Building a Powerful BrandRoadmap to Building a Powerful Brand
Roadmap to Building a Powerful Brand
Seth Price
 
Ask Outrageously - How to Negotiate What You Really Want
Ask Outrageously - How to Negotiate What You Really WantAsk Outrageously - How to Negotiate What You Really Want
Ask Outrageously - How to Negotiate What You Really Want
LindsayPathable
 
Asking Questions in English.pptx
Asking Questions in English.pptxAsking Questions in English.pptx
Asking Questions in English.pptx
JanetteLaquio
 
How to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaireHow to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaire
Peanut Labs
 
Embrace our-differences-powerpoint
Embrace our-differences-powerpointEmbrace our-differences-powerpoint
Embrace our-differences-powerpoint
Year4teachers
 
John Haydon- Valley GivesTelling better stories with facebook and instagram
John Haydon- Valley GivesTelling better stories with facebook and instagramJohn Haydon- Valley GivesTelling better stories with facebook and instagram
John Haydon- Valley GivesTelling better stories with facebook and instagram
mdechiara
 
Chapter 1 social psychology
Chapter 1 social psychologyChapter 1 social psychology
Chapter 1 social psychology
BilalAhmed717
 
How to Create a Twitter-Driven School Culture
How to Create a Twitter-Driven School CultureHow to Create a Twitter-Driven School Culture
How to Create a Twitter-Driven School Culture
Edutopia
 
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Natalie Warnert
 
Twitter Talk: Using Twitter for Learning and Professional Development in Res ...
Twitter Talk: Using Twitter for Learning and Professional Development in Res ...Twitter Talk: Using Twitter for Learning and Professional Development in Res ...
Twitter Talk: Using Twitter for Learning and Professional Development in Res ...
Melissa Robertson
 
Science of giving
Science of givingScience of giving
Science of giving
Mindwize
 

Similar to Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders (20)

Effects of Asking for Telephone Numbers on Survey Honesty
Effects of Asking for Telephone Numbers on Survey HonestyEffects of Asking for Telephone Numbers on Survey Honesty
Effects of Asking for Telephone Numbers on Survey Honesty
 
How Non-native English Speakers Respond to English Surveys
How Non-native English Speakers Respond to English SurveysHow Non-native English Speakers Respond to English Surveys
How Non-native English Speakers Respond to English Surveys
 
Men are from mars - Word choices in social media - Peanut Labs
Men are from mars - Word choices in social media - Peanut LabsMen are from mars - Word choices in social media - Peanut Labs
Men are from mars - Word choices in social media - Peanut Labs
 
Social Listening in the Travel Category
Social Listening in the Travel CategorySocial Listening in the Travel Category
Social Listening in the Travel Category
 
Peanut Labs Webinar - Survey Analysis In A Nutshell
Peanut Labs Webinar - Survey Analysis In A NutshellPeanut Labs Webinar - Survey Analysis In A Nutshell
Peanut Labs Webinar - Survey Analysis In A Nutshell
 
MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...
MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...
MA SHRAB Conference Social Media Introduction: Using Facebook and Twitter Mic...
 
Effects of Splitting Long Surveys Into Two
Effects of Splitting  Long Surveys Into TwoEffects of Splitting  Long Surveys Into Two
Effects of Splitting Long Surveys Into Two
 
OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...
OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...
OboPay Influencers Report: Top 20 Mobile Commerce, Mobile Banking, Mobile Pay...
 
Effective Communication Skills
Effective Communication SkillsEffective Communication Skills
Effective Communication Skills
 
Roadmap to Building a Powerful Brand
Roadmap to Building a Powerful BrandRoadmap to Building a Powerful Brand
Roadmap to Building a Powerful Brand
 
Ask Outrageously - How to Negotiate What You Really Want
Ask Outrageously - How to Negotiate What You Really WantAsk Outrageously - How to Negotiate What You Really Want
Ask Outrageously - How to Negotiate What You Really Want
 
Asking Questions in English.pptx
Asking Questions in English.pptxAsking Questions in English.pptx
Asking Questions in English.pptx
 
How to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaireHow to seamlessly integrate data quality measures into your questionnaire
How to seamlessly integrate data quality measures into your questionnaire
 
Embrace our-differences-powerpoint
Embrace our-differences-powerpointEmbrace our-differences-powerpoint
Embrace our-differences-powerpoint
 
John Haydon- Valley GivesTelling better stories with facebook and instagram
John Haydon- Valley GivesTelling better stories with facebook and instagramJohn Haydon- Valley GivesTelling better stories with facebook and instagram
John Haydon- Valley GivesTelling better stories with facebook and instagram
 
Chapter 1 social psychology
Chapter 1 social psychologyChapter 1 social psychology
Chapter 1 social psychology
 
How to Create a Twitter-Driven School Culture
How to Create a Twitter-Driven School CultureHow to Create a Twitter-Driven School Culture
How to Create a Twitter-Driven School Culture
 
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
Objectivity or Subjectivity - Owning your bias and interactions - Natalie War...
 
Twitter Talk: Using Twitter for Learning and Professional Development in Res ...
Twitter Talk: Using Twitter for Learning and Professional Development in Res ...Twitter Talk: Using Twitter for Learning and Professional Development in Res ...
Twitter Talk: Using Twitter for Learning and Professional Development in Res ...
 
Science of giving
Science of givingScience of giving
Science of giving
 

More from Annie Pettit, Research Methodologist

AI and Voice Search and Chatbots, oh my!
AI and Voice Search and Chatbots, oh my!AI and Voice Search and Chatbots, oh my!
AI and Voice Search and Chatbots, oh my!
Annie Pettit, Research Methodologist
 
Cognitive Biases for Marketers
Cognitive Biases for MarketersCognitive Biases for Marketers
Cognitive Biases for Marketers
Annie Pettit, Research Methodologist
 
Scientific rigour is worth melting for MRS Annual Conference 2016
Scientific rigour is worth melting for MRS Annual Conference 2016Scientific rigour is worth melting for MRS Annual Conference 2016
Scientific rigour is worth melting for MRS Annual Conference 2016
Annie Pettit, Research Methodologist
 
NewMR 2016 presents: 9 Big Applications of Big Data
NewMR 2016 presents: 9 Big Applications of Big DataNewMR 2016 presents: 9 Big Applications of Big Data
NewMR 2016 presents: 9 Big Applications of Big Data
Annie Pettit, Research Methodologist
 
Blasting 10 Big Data Myths with 10 Panel Data Examples
Blasting 10 Big Data Myths with 10 Panel Data ExamplesBlasting 10 Big Data Myths with 10 Panel Data Examples
Blasting 10 Big Data Myths with 10 Panel Data Examples
Annie Pettit, Research Methodologist
 
9 Tips For Creating a Great Numeric Question
9 Tips For Creating a Great Numeric Question9 Tips For Creating a Great Numeric Question
9 Tips For Creating a Great Numeric Question
Annie Pettit, Research Methodologist
 
A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...
A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...
A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...
Annie Pettit, Research Methodologist
 
Using social media data for new product development
Using social media data for new product developmentUsing social media data for new product development
Using social media data for new product development
Annie Pettit, Research Methodologist
 
Social Media Data from Research to Customers - Casro Digital in San Antonio, ...
Social Media Data from Research to Customers - Casro Digital in San Antonio, ...Social Media Data from Research to Customers - Casro Digital in San Antonio, ...
Social Media Data from Research to Customers - Casro Digital in San Antonio, ...
Annie Pettit, Research Methodologist
 
Behavioural Economics: New or Not?
Behavioural Economics: New or Not?Behavioural Economics: New or Not?
Behavioural Economics: New or Not?
Annie Pettit, Research Methodologist
 
20 ways to use social media research
20 ways to use social media research20 ways to use social media research
20 ways to use social media research
Annie Pettit, Research Methodologist
 
Advanced Analytics with Social Media Data
Advanced Analytics with Social Media DataAdvanced Analytics with Social Media Data
Advanced Analytics with Social Media Data
Annie Pettit, Research Methodologist
 
AMA MRA Social Media Research Myths
AMA MRA Social Media Research MythsAMA MRA Social Media Research Myths
AMA MRA Social Media Research Myths
Annie Pettit, Research Methodologist
 

More from Annie Pettit, Research Methodologist (13)

AI and Voice Search and Chatbots, oh my!
AI and Voice Search and Chatbots, oh my!AI and Voice Search and Chatbots, oh my!
AI and Voice Search and Chatbots, oh my!
 
Cognitive Biases for Marketers
Cognitive Biases for MarketersCognitive Biases for Marketers
Cognitive Biases for Marketers
 
Scientific rigour is worth melting for MRS Annual Conference 2016
Scientific rigour is worth melting for MRS Annual Conference 2016Scientific rigour is worth melting for MRS Annual Conference 2016
Scientific rigour is worth melting for MRS Annual Conference 2016
 
NewMR 2016 presents: 9 Big Applications of Big Data
NewMR 2016 presents: 9 Big Applications of Big DataNewMR 2016 presents: 9 Big Applications of Big Data
NewMR 2016 presents: 9 Big Applications of Big Data
 
Blasting 10 Big Data Myths with 10 Panel Data Examples
Blasting 10 Big Data Myths with 10 Panel Data ExamplesBlasting 10 Big Data Myths with 10 Panel Data Examples
Blasting 10 Big Data Myths with 10 Panel Data Examples
 
9 Tips For Creating a Great Numeric Question
9 Tips For Creating a Great Numeric Question9 Tips For Creating a Great Numeric Question
9 Tips For Creating a Great Numeric Question
 
A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...
A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...
A Tale of Two Surveys: How using real words instead of mumbo jumbo affects su...
 
Using social media data for new product development
Using social media data for new product developmentUsing social media data for new product development
Using social media data for new product development
 
Social Media Data from Research to Customers - Casro Digital in San Antonio, ...
Social Media Data from Research to Customers - Casro Digital in San Antonio, ...Social Media Data from Research to Customers - Casro Digital in San Antonio, ...
Social Media Data from Research to Customers - Casro Digital in San Antonio, ...
 
Behavioural Economics: New or Not?
Behavioural Economics: New or Not?Behavioural Economics: New or Not?
Behavioural Economics: New or Not?
 
20 ways to use social media research
20 ways to use social media research20 ways to use social media research
20 ways to use social media research
 
Advanced Analytics with Social Media Data
Advanced Analytics with Social Media DataAdvanced Analytics with Social Media Data
Advanced Analytics with Social Media Data
 
AMA MRA Social Media Research Myths
AMA MRA Social Media Research MythsAMA MRA Social Media Research Myths
AMA MRA Social Media Research Myths
 

Recently uploaded

Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
Márton Kodok
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Kiwi Creative
 
"Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens"
"Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens""Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens"
"Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens"
sameer shah
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
wyddcwye1
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
AndrzejJarynowski
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
Bill641377
 
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
hyfjgavov
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
v7oacc3l
 
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
ihavuls
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
bopyb
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
jitskeb
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
VyNguyen709676
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Timothy Spann
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
nyfuhyz
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
SaffaIbrahim1
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
y3i0qsdzb
 
Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......
Sachin Paul
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
taqyea
 
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performanceAnalysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
roli9797
 

Recently uploaded (20)

Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
 
"Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens"
"Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens""Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens"
"Financial Odyssey: Navigating Past Performance Through Diverse Analytical Lens"
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
 
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
 
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
 
Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
 
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performanceAnalysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
 

Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders

  • 1. Please tweet! @ESRAsurvey @LoveStats Please tweet! @LoveStats #ESRAsurvey Call Me Maybe: Effects of asking for telephone numbers on survey honesty Presented by Annie Pettit Chief Research Officer at Peanut Labs
  • 2. Please tweet! @ESRAsurvey @LoveStats Research Questions Should you ask at the beginning or the end of the survey? When To Ask Will people endorse more socially desirable, charitable behaviours? Will people endorse fewer illegal, unethical, and embarrassing behaviours? Social Desirability Illegal BehavioursCBA
  • 3. Please tweet! @ESRAsurvey @LoveStats Method Group 1 • Beginning • Phone number request was first question • N=500 Group 2 • End • Phone number request was last question • N=500 Non-probability, incentivized research panel Sampled and weighted to US census targets
  • 4. Please tweet! @ESRAsurvey @LoveStats Question Categories Compliment employee Bought someone coffee Kind Charitable Pee in shower Embarrassing Called in sick Unethical Listen to music Neutral Impaired driving Illegal
  • 5. Please tweet! @ESRAsurvey @LoveStats RESULTS BEGINNING VS END
  • 6. Please tweet! @ESRAsurvey @LoveStats Neutral % of People Endorsing Neutral Behaviours
  • 7. Please tweet! @ESRAsurvey @LoveStats Neutral It doesn’t matter if you were asked at the beginning or the end, endorsement rates for neutral behaviours were the same. Average Endorsement Standard Deviation
  • 8. Please tweet! @ESRAsurvey @LoveStats Charitable Endorsement of charitable behaviours didn’t change if you were asked at the beginning or the end.
  • 9. Please tweet! @ESRAsurvey @LoveStats Embarrassing Endorsement of embarrassing behaviours didn’t change if you were asked at the beginning or the end.
  • 10. Please tweet! @ESRAsurvey @LoveStats Illegal Though there was more variability, endorsement of illegal behaviours didn’t change if you were asked at the beginning or the end.
  • 11. Please tweet! @ESRAsurvey @LoveStats or makes no Beginning difference end CONCLUSION
  • 12. Please tweet! @ESRAsurvey @LoveStats RESULTS AGREE VS DECLINE
  • 13. Please tweet! @ESRAsurvey @LoveStats Method Group 1 •Yes, here’s my phone number •555-5555 Group 2 •No! You can’t have my phone number •BUG-OFFF
  • 14. Please tweet! @ESRAsurvey @LoveStats Illegal People who agree endorse more illegal behaviours
  • 15. Please tweet! @ESRAsurvey @LoveStats Embarrassing People who agree endorse more embarrassing behaviours
  • 16. Please tweet! @ESRAsurvey @LoveStats Charitable People who agree endorse more charitable behaviours
  • 17. Please tweet! @ESRAsurvey @LoveStats Neutral People who agree endorse more neutral behaviours
  • 18. Please tweet! @ESRAsurvey @LoveStats or makes a Agreeing difference disagreeing CONCLUSION
  • 19. Please tweet! @ESRAsurvey @LoveStats RESULTS INTERACTIONS
  • 20. Please tweet! @ESRAsurvey @LoveStats Method Group 1 Beginning Decline Group 2 End Decline Group 3 Beginning Agree Group 4 End Agree
  • 21. Please tweet! @ESRAsurvey @LoveStats Neutral Questions Endorsement Rates Not Affected
  • 22. Please tweet! @ESRAsurvey @LoveStats Agreers Are Confessors Illegal Unethical Embarrass Kind Charitable Neutral Average
  • 23. Please tweet! @ESRAsurvey @LoveStats the and listen If agreers beginning you want honesty ask at to CONCLUSION
  • 24. Please tweet! @ESRAsurvey @LoveStats Many new questions • Type of PII: What if we asked for email or physical address instead? • Position of Ask: What if we ask half-way through? After an embarrassing question? • Survey Style: What if the entire survey is embarrassing? • Screen Outs: What if everyone was told there would be no screen-outs?
  • 25. Please tweet! @ESRAsurvey @LoveStats Thank you! Annie Pettit Chief Research Officer annie@peanutlabs.com ca.linkedin.com/in/AnniePettit/ facebook.com/AnniePettit twitter.com/LoveStats Jonathan Cheriff Director of Sales & Marketing jonathan.cheriff@peanutlabs.com Find PeanutLabs on LinkedIn Facebook Twitter YouTube DIY SURVEY PROGRAMMING DIY POLLINGDIY SAMPLE