Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

7. McCauley Presentation

1,911 views

Published on

Presentation for Pew Research Center's Methodological Workshop on Public Opinion Research in Sub-Saharan Africa

Published in: Data & Analytics
  • Hi there! Get Your Professional Job-Winning Resume Here - Check our website! http://bit.ly/resumpro
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

7. McCauley Presentation

  1. 1. Strategies for Developing High-Quality Survey Instruments John F. McCauley Associate Professor, University of Maryland Pew Research Center November 30, 2017
  2. 2. Focus: Innovations in Survey Experimental Questionnaires
  3. 3. Overt Measures; Stated Support for VE: 1. “Violence against civilians to defend religion can be justified.” (2. Violence in the name of Islam can be justified) (3. Violence can be justified to solve problems)
  4. 4. Covert Measures; True Support for VE: “The government is considering a national polio vaccination. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer “The government is considering a national polio vaccination, which Al Qaeda IM’s leaders likely oppose. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer Control Treatment
  5. 5. Advantages: 1. Causal Inference
  6. 6. Support for Vaccination Plan
  7. 7. Advantages: 1. Causal Inference 2. Exposes Social Desirability Bias
  8. 8. Advantages: 1. Causal Inference 2. Exposes Social Desirability Bias 3. Respondent Engagement
  9. 9. Challenges: 1. Basic Comprehension Levels 2. Multiple Local Languages 3. Consistency bias, order effects 4. Assuming the General from the Specific 5. Enumerator Fallibility
  10. 10. Strategies: 1. Short, simple questions
  11. 11. Covert Measures; True Support for VE: “The government is considering a national polio vaccination. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer “The government is considering a national polio vaccination, which Al Qaeda IM’s leaders likely oppose. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer Control Treatment
  12. 12. Alternative: “The government is considering shutting down schools in some areas of the North. Would you say that you are in favor or against this plan?” In favor Against Don’t know/no answer “The government is considering shutting down schools in some areas of the North, which Al Qaeda IM’s leaders likely support. Would you say that you are in favor or against this plan?” In favor Against Don’t know/no answer Control Treatment
  13. 13. Alternative: “The government is considering shutting down schools in some areas of the North. Would you say that you are in favor or against this plan?” In favor Against Don’t know/no answer “The government is considering shutting down schools in some areas of the North, which Al Qaeda IM’s leaders likely support. Would you say that you are in favor or against this plan?” In favor Against Don’t know/no answer Control Treatment In favor of policy = In favor of terrorist group
  14. 14. Strategies: 1. Short, simple questions 2. Include overt and experimental measures
  15. 15. Strategies: 1. Short, simple questions 2. Include overt and experimental measures 3. Include multiple measures and vary placement
  16. 16. Strategies: 1. Short, simple questions 2. Include overt and experimental measures 3. Include multiple measures and vary placement 4. Vary treatment (endorsement)
  17. 17. Covert Measures; True Support for VE: “The government is considering a national polio vaccination. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer “The government is considering a national polio vaccination, which Al Qaeda IM’s leaders likely oppose. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer Control Treatment
  18. 18. Alternative 2: “The government is considering a national polio vaccination. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer “The government is considering a national polio vaccination, which Boko Haram’s leaders likely oppose. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer Control Treatment
  19. 19. “The government is considering a national polio vaccination. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer “The government is considering a national polio vaccination, which Boko Haram’s leaders likely oppose. Would you say that you are in favor or against this initiative?” In favor Against Don’t know/no answer Control Treatment Controls for specific endorser effect Alternative 2:

×