General Online Research ConferenceGOR 11, March 14-16, 2011, Heinrich Heine University, Düsseldorf,                       ...
Agenda1.   GESIS – Online Access Panel Pilot2.   CATI – Recruitment Interview3.   The income question4.   Research questio...
GESIS - Online Access Panel Pilot• Probability-based online access panel for the  social sciences• Sample frame: general p...
The CATI recruitment interviewGoal: Maximizing panel recruitmentInterview should    be short and entertaining    contain n...
Questionnaire OverviewTopic: Life and Internet usage in Germany 1. Attitudinal and behavioral questions 2. Demographic que...
The importance of the income question• Standard demographic information  in the social sciences• Sample quality, e.g. nonr...
Reasons for not asking about income• Sensitive question   high item nonresponse     e.g. up to 20 percent in the ALLBUS• S...
Indications for the existence of a    problem with income questionParticipation rates in an online follow-up (ALLBUS 2008)...
Research questions1. Is there a negative effect of the income   question on recruitment success?2. Is there a difference b...
The experimental groupsIncome Group                 Non-Income GroupAttitudinal and behavioral   Attitudional and behavior...
Results: Income Question• Non-income group n=148• Income group n=178  – 84% answered (n=150)  – 16% refused (n=28)        ...
Results: Research Question 1non-income group                                     73%                27%     (n=148)    inc...
Results: Research Question 2     non-income group                                         73%                     27%     ...
Results – summed upResearch question 1:• Descriptive tendency of lower willingness to participate  when income was asked b...
But this is not the end of the story…What about actual panel participation?                                         15
Actual online participation• 226 CATI respondents provided their  email address• 62% completed the first online questionna...
Actual online participation   of those willing to participatenon-income group                                      68%    ...
Concluding RemarksAsking the income question does make a difference• Short term effect on participation willingness for  t...
Thank you for your attention! Contact: ines.schaurer@gesis.org
Upcoming SlideShare
Loading in …5
×

Schaurer asking sensitive-questions_in_a_recruitment_interview-167

203 views
163 views

Published on

A GOR presentation

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
203
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Schaurer asking sensitive-questions_in_a_recruitment_interview-167

  1. 1. General Online Research ConferenceGOR 11, March 14-16, 2011, Heinrich Heine University, Düsseldorf, Germany Asking sensitive questions in a recruitment interview for an online panel: The income question Ines Schaurer, Bella Struminskaya, Lars Kaczmirek, Wolfgang Bandilla GESIS – Leibniz Institute for the Social Sciences Contact: ines.schaurer@gesis.org
  2. 2. Agenda1. GESIS – Online Access Panel Pilot2. CATI – Recruitment Interview3. The income question4. Research question5. The experimental design6. Results7. Conclusions 2
  3. 3. GESIS - Online Access Panel Pilot• Probability-based online access panel for the social sciences• Sample frame: general population of German- speaking Internet users (18+)• Two step sampling approach: - RDD sample (“Gabler-Häder-Design”) of landline and mobile phones - CATI recruitment interview - Request to join the online access panel 3
  4. 4. The CATI recruitment interviewGoal: Maximizing panel recruitmentInterview should be short and entertaining contain no bothering questions establish trust in the survey organization 4
  5. 5. Questionnaire OverviewTopic: Life and Internet usage in Germany 1. Attitudinal and behavioral questions 2. Demographic questions 3. Income question 4. Request to join the online access panel 5
  6. 6. The importance of the income question• Standard demographic information in the social sciences• Sample quality, e.g. nonresponse bias 6
  7. 7. Reasons for not asking about income• Sensitive question high item nonresponse e.g. up to 20 percent in the ALLBUS• Sensitivity as invasion of privacy 7
  8. 8. Indications for the existence of a problem with income questionParticipation rates in an online follow-up (ALLBUS 2008) - 22% of those who refused to provide income information - 47% of those who answered the income question Problem: No experimental setting 8
  9. 9. Research questions1. Is there a negative effect of the income question on recruitment success?2. Is there a difference between respondents who provide the income information and those who refuse to answer? 9
  10. 10. The experimental groupsIncome Group Non-Income GroupAttitudinal and behavioral Attitudional and behavioralquestions questionsDemographic questions Demographic questionsIncome question -categorizedRequest to join the online Request to join the onlineaccess panel access panel 10
  11. 11. Results: Income Question• Non-income group n=148• Income group n=178 – 84% answered (n=150) – 16% refused (n=28) 11
  12. 12. Results: Research Question 1non-income group 73% 27% (n=148) income group 66% 34% (n=178) 0% 20% 40% 60% 80% 100% recruited not recruited 12
  13. 13. Results: Research Question 2 non-income group 73% 27% (n=148)income group, answered 71% 29% (n=150) income group, refused 39% 61% (n=28) 0% 20% 40% 60% 80% 100% recruited not recruited 13
  14. 14. Results – summed upResearch question 1:• Descriptive tendency of lower willingness to participate when income was asked beforehandResearch question 2:• Asking about income has no negative effect on online participation for those who are willing to answer• Those who refuse to provide income information do have a far lower probability to participate• Controlling for age, education and sex there are no differences between income refusers and those who answered 14
  15. 15. But this is not the end of the story…What about actual panel participation? 15
  16. 16. Actual online participation• 226 CATI respondents provided their email address• 62% completed the first online questionnaire 16
  17. 17. Actual online participation of those willing to participatenon-income group 68% 32% (n=108) income group 57% 43% (n=118) 0% 20% 40% 60% 80% 100% participant non participant 17
  18. 18. Concluding RemarksAsking the income question does make a difference• Short term effect on participation willingness for those who refuse income question• Long term negative effect on actual participation If it is not absolutely necessary to get the information in the first interview, wait until the second contact when trust is established! 18
  19. 19. Thank you for your attention! Contact: ines.schaurer@gesis.org

×