The effect of monetary prepaid incentives on completion rate and data quality in internet surveys A comparison of 5 differ...
2GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Overview        • Theory        • Descri...
3GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Theories       1. RCT       2. Exchange/...
4GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Sample        • 1740 students of a fairl...
5GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Dependend variables        1.      Respo...
6GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Completion rate (in %)      30          ...
7GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives    Logit-models for response and completion  ...
8GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Item non-response – all responders      ...
9GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentivesItem non-response – completition only(mean: nu...
10GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Negative binominal regression models   ...
11GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Straight-lining (%)         4          ...
12GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Straight-lining (%)                    ...
13GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives  Repetitious straight-lining                ...
14GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Anonymity: Willingness to self-      re...
15GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Bottom line        • Use of monetary pr...
16GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives      Thank you for your attention!      Cont...
Upcoming SlideShare
Loading in …5
×

Van veen the-effect_of_monetary_prepaid_incentives_on_completion_rate_and_data_quality-124

257 views

Published on

A GOR presentation

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
257
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Van veen the-effect_of_monetary_prepaid_incentives_on_completion_rate_and_data_quality-124

  1. 1. The effect of monetary prepaid incentives on completion rate and data quality in internet surveys A comparison of 5 different incentive modesFloris van Veenδ, Sebastian Sattlerδ & Anja Göritz‡δ Bielefeld University - Faculty of Sociology‡ Würzburg University - Department of Psychology
  2. 2. 2GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Overview • Theory • Description of the Sample • Results • Discussion
  3. 3. 3GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Theories 1. RCT 2. Exchange/Equity-Theory 3. Reciprocity-norm 4. Leverage Salience Theory
  4. 4. 4GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Sample • 1740 students of a fairly large university in germany • 746 male (43%) , 994 female (57%) • 5 groups ▫ Prepaid voucher & prenotification ▫ Postpaid voucher & prenotification ▫ Prepaid cash & prenotification ▫ Prenotification only ▫ Control group
  5. 5. 5GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Dependend variables 1. Response rate 2. Completion rate 3. Item non-response 4. Straight-lining 5. Anonymity
  6. 6. 6GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Completion rate (in %) 30 25,5 25 20 Voucher Prepaid Voucher Postpaid 15 12,93 Monetary 12,86 11,78 Letter 10 Control 6,38 5 0
  7. 7. 7GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Logit-models for response and completion Response Completion Intercept 0,210*** 0,107*** Voucher Prepaid 1,366 1,931* Voucher Postpaid 1,386 2,127* Monetary 3,115*** 4,976*** Letter 1,530 2,117* (base=Control) Age 0,889** 0,886* Nagelkerkes R² 0,044 0,062 N 317 242 Chi-Square LR-Test 47,668*** 60,363*** *** p<0,001; ** p<0,01; * p<0,05
  8. 8. 8GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Item non-response – all responders (mean: number of missings) 70 60,88 60 50 Voucher Prepaid 40 Voucher Postpaid 34,81 33,77 Monetary 30 25,75 Letter 19,21 Control 20 10 0
  9. 9. 9GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentivesItem non-response – completition only(mean: number of missings) 8 7,36 7 6 5,47 Voucher Prepaid 5 4,17 Voucher Postpaid 4 3,75 Monetary 3,09 Letter 3 Control 2 1 0
  10. 10. 10GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Negative binominal regression models of item non-response Response Completion Voucher Prepaid 0,526 0,519 Voucher Postpaid 0,402 * 0,375 ** Monetary 0,249 *** 0,514 * Letter 0,487 0,787 (base=Control) Age 1,209 ** Male (=yes) 0,501 *** n 317 242 Log likelihood -1198 -593 Pseudo R² 0,010 *** 0,013 ** LR of alpha=0 19000 *** 1479 *** *** p<0,001; ** p<0,01; * p<0,05
  11. 11. 11GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Straight-lining (%) 4 3,59 3,5 3,05 3 2,77 2,65 2,49 Voucher Prepaid 2,5 Voucher Postpaid 2 Monetary Letter 1,5 Control 1 0,5 0
  12. 12. 12GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Straight-lining (%) Voucher Voucher Prepaid Postpaid Monetary Letter Control Total N Lecturers 2,63 4,35 1,12 2,04 0 2,03 250 Study conditions 0 2,38 0 0 0 0,48 239 Competencies 0 2,17 2,27 2,13 0 1,31 250 Competencies II 2,44 4,17 4,55 6,12 3,85 4,22 252 Motivation 5,13 2,17 3,41 4,55 5 4,05 229 Procrastination 5 2,17 10 4,55 10 6,34 237 Brain-Doping 0 0 0 0 0 0 240 Brain-Doping II 3,33 0 0 0 6,25 1,92 221 Straight-lining (%) 2,65 2,49 3,05 2,77 3,59 2,91
  13. 13. 13GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Repetitious straight-lining Voucher Voucher Prepaid Postpaid Monetary Letter Control Total Straight-lining (%) 2,65 2,49 3,05 2,77 3,59 2,91 Straight-lining (once) 3 4 13 6 3 29 Straight-lining (twice) 2 0 0 0 1 3 Straight-lining (thrice) 0 0 2 1 0 3 Straight-lining (4 times) 0 1 0 0 0 1
  14. 14. 14GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Anonymity: Willingness to self- report sensitive information • Item-battery ‚intention of student fraud‘ • 9 different items (e.g. plagiarism, bribery, using unapproved materials on exams) • Tested groups against each other by performing Mann-Whitney U-tests • No significant outcomes -> all differences in answering behavior are likely to be random
  15. 15. 15GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Bottom line • Use of monetary prepaid incentives where applicable ▫ Increase of response and completion rates ▫ Increased data quality
  16. 16. 16GOR11 ■ van Veen/Sattler/Göritz ■ The effect of monetary prepaid incentives Thank you for your attention! Contact: floris.van_veen@uni-bielefeld.de

×