SlideShare a Scribd company logo
Causes of mode effects
on survey measurement
One day symposium at the Royal Statistical Society, London
11 October 2011
Background
Background

• Increasing use of mixed modes
   • Falling response rates
   • Rising costs of data collection
• Risk of reduced data comparability
   • Coverage error
   • Non-response error
   • Measurement error
• Need for practical advice to inform decisions
  about when to mix modes and how
Mixing Modes and Measurement Error

• Funded under the ESRC Survey Design and
  Measurement Initiative
• 3-year contract starting 1 Oct 2007
• Collaboration between NatCen, ISER and
  independent survey methods consultant
Core research team

• National Centre for Social Research (NatCen)
   •   Gerry Nicolaas
   •   Steven Hope (now UCL)
   •   Margaret Blake
   •   Michelle Gray
• Institute for Social & Economic Research (ISER)
   • Peter Lynn
   • Annette Jäckle
• The Survey Coach (Independent Survey Methods Consultant)
   • Pamela Campanelli
Main objective

• Practical advice on how to improve portability of
  questions across modes
   • Which mode combinations are likely to produce
     comparable responses?
   • Which types of questions are more susceptible to
     mode effects?
Research design

• A literature review & framework of mixed modes
   • develop a conceptual framework
   • identify gaps in evidence base and formulate
     hypotheses to address gaps
• Quantitative data analysis
   • test hypotheses using existing datasets and new
     experimental data
• Cognitive interviewing
   • explore how respondents process questions in different
     modes
Presentations & Discussion

1. How and when does the mode of data collection
   affect survey measurement?
2. The use of cognitive interviewing methods to evaluate
   mode effects
3. The role of visual and aural stimuli in producing mode
   effects
4. The role of the interviewer in producing mode effects
5. Is it a good idea to optimise question format for mode
   of data collection?
6. Designing questions for mixed mode surveys
7. Discussant (Patten Smith)
8. Open discussion

More Related Content

What's hot

Wendi Chen
Wendi ChenWendi Chen
Wendi Chen
iadit
 
LIBR 285 presentation
LIBR 285 presentationLIBR 285 presentation
LIBR 285 presentation
tiholub
 
2017 ProSPER.Net Young Researchers' School ‘Water Security For Sustainable D...
2017 ProSPER.Net Young Researchers' School  ‘Water Security For Sustainable D...2017 ProSPER.Net Young Researchers' School  ‘Water Security For Sustainable D...
2017 ProSPER.Net Young Researchers' School ‘Water Security For Sustainable D...
Hanna Stahlberg
 
Meta-study results of participatory processes
Meta-study results of participatory processesMeta-study results of participatory processes
Meta-study results of participatory processes
Water, Land and Ecosystems (WLE)
 
DORA and the reinvention of research assessment
DORA and the reinvention of research assessmentDORA and the reinvention of research assessment
DORA and the reinvention of research assessment
Mark Patterson
 
Lessons Learned from Moodle VLE/LMS Data in the Field
Lessons Learned from Moodle VLE/LMS Data in the FieldLessons Learned from Moodle VLE/LMS Data in the Field
Lessons Learned from Moodle VLE/LMS Data in the Field
John Whitmer, Ed.D.
 
Usability of Online Instruction
Usability of Online InstructionUsability of Online Instruction
Usability of Online Instruction
Michael Wilder
 
Data Collection and Analysis Tools
Data Collection and Analysis ToolsData Collection and Analysis Tools
Data Collection and Analysis Tools
Caren Gamboa
 
Types of Research
Types of ResearchTypes of Research
Types of Research
Gayathri Baiju
 
Considerations and Methods for Usability Testing with School Children
Considerations and Methods for Usability Testing with School ChildrenConsiderations and Methods for Usability Testing with School Children
Considerations and Methods for Usability Testing with School Children
Khalid Md Saifuddin
 
Why is Test Driven Development so hard to implement in an analytics platform?
Why is Test Driven Development so hard to implement in an analytics platform?Why is Test Driven Development so hard to implement in an analytics platform?
Why is Test Driven Development so hard to implement in an analytics platform?
Phil Watt
 
Direct observation and feedback
Direct observation and feedbackDirect observation and feedback
Direct observation and feedback
myknowledgemap
 
Evaluation study[1]
Evaluation study[1]Evaluation study[1]
Evaluation study[1]
Amira Squ
 
Tracking Use of Campaign Evaluation Findings of Two International Organisations
Tracking Use of Campaign Evaluation Findings of Two International OrganisationsTracking Use of Campaign Evaluation Findings of Two International Organisations
Tracking Use of Campaign Evaluation Findings of Two International Organisations
Glenn O'Neil
 
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
BELIV Workshop
 
Multiple Response Questions - Allowing for chance in authentic assessments
Multiple Response Questions - Allowing for chance in authentic assessmentsMultiple Response Questions - Allowing for chance in authentic assessments
Multiple Response Questions - Allowing for chance in authentic assessments
Mhairi Mcalpine
 
Quantitative ppt
Quantitative pptQuantitative ppt
Quantitative ppt
Deepti M
 
Survey methods and practice
Survey methods and practiceSurvey methods and practice
Survey methods and practice
Hina Honey
 
The use of models and decision support tools: UK perspective (N. Gibbens)
The use of models and decision support tools: UK perspective (N. Gibbens)The use of models and decision support tools: UK perspective (N. Gibbens)
The use of models and decision support tools: UK perspective (N. Gibbens)
EuFMD
 
Margot Mc Neill et al 2008
Margot Mc Neill et al 2008Margot Mc Neill et al 2008
Margot Mc Neill et al 2008
Diana Quinn
 

What's hot (20)

Wendi Chen
Wendi ChenWendi Chen
Wendi Chen
 
LIBR 285 presentation
LIBR 285 presentationLIBR 285 presentation
LIBR 285 presentation
 
2017 ProSPER.Net Young Researchers' School ‘Water Security For Sustainable D...
2017 ProSPER.Net Young Researchers' School  ‘Water Security For Sustainable D...2017 ProSPER.Net Young Researchers' School  ‘Water Security For Sustainable D...
2017 ProSPER.Net Young Researchers' School ‘Water Security For Sustainable D...
 
Meta-study results of participatory processes
Meta-study results of participatory processesMeta-study results of participatory processes
Meta-study results of participatory processes
 
DORA and the reinvention of research assessment
DORA and the reinvention of research assessmentDORA and the reinvention of research assessment
DORA and the reinvention of research assessment
 
Lessons Learned from Moodle VLE/LMS Data in the Field
Lessons Learned from Moodle VLE/LMS Data in the FieldLessons Learned from Moodle VLE/LMS Data in the Field
Lessons Learned from Moodle VLE/LMS Data in the Field
 
Usability of Online Instruction
Usability of Online InstructionUsability of Online Instruction
Usability of Online Instruction
 
Data Collection and Analysis Tools
Data Collection and Analysis ToolsData Collection and Analysis Tools
Data Collection and Analysis Tools
 
Types of Research
Types of ResearchTypes of Research
Types of Research
 
Considerations and Methods for Usability Testing with School Children
Considerations and Methods for Usability Testing with School ChildrenConsiderations and Methods for Usability Testing with School Children
Considerations and Methods for Usability Testing with School Children
 
Why is Test Driven Development so hard to implement in an analytics platform?
Why is Test Driven Development so hard to implement in an analytics platform?Why is Test Driven Development so hard to implement in an analytics platform?
Why is Test Driven Development so hard to implement in an analytics platform?
 
Direct observation and feedback
Direct observation and feedbackDirect observation and feedback
Direct observation and feedback
 
Evaluation study[1]
Evaluation study[1]Evaluation study[1]
Evaluation study[1]
 
Tracking Use of Campaign Evaluation Findings of Two International Organisations
Tracking Use of Campaign Evaluation Findings of Two International OrganisationsTracking Use of Campaign Evaluation Findings of Two International Organisations
Tracking Use of Campaign Evaluation Findings of Two International Organisations
 
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
 
Multiple Response Questions - Allowing for chance in authentic assessments
Multiple Response Questions - Allowing for chance in authentic assessmentsMultiple Response Questions - Allowing for chance in authentic assessments
Multiple Response Questions - Allowing for chance in authentic assessments
 
Quantitative ppt
Quantitative pptQuantitative ppt
Quantitative ppt
 
Survey methods and practice
Survey methods and practiceSurvey methods and practice
Survey methods and practice
 
The use of models and decision support tools: UK perspective (N. Gibbens)
The use of models and decision support tools: UK perspective (N. Gibbens)The use of models and decision support tools: UK perspective (N. Gibbens)
The use of models and decision support tools: UK perspective (N. Gibbens)
 
Margot Mc Neill et al 2008
Margot Mc Neill et al 2008Margot Mc Neill et al 2008
Margot Mc Neill et al 2008
 

Viewers also liked

Desarrolloojoyoido 100411235717-phpapp01
Desarrolloojoyoido 100411235717-phpapp01Desarrolloojoyoido 100411235717-phpapp01
Desarrolloojoyoido 100411235717-phpapp01
Taty Perez
 
A real story of fake antiques
A real story of fake antiquesA real story of fake antiques
A real story of fake antiques
Ravi Jha
 
Dominio y hosting
Dominio y hostingDominio y hosting
Dominio y hosting
garcia_19_elvira
 
Collective film script writing experiences in using mobile creative writing ...
Collective film script writing  experiences in using mobile creative writing ...Collective film script writing  experiences in using mobile creative writing ...
Collective film script writing experiences in using mobile creative writing ...
Pekka Ollikainen
 
Inf final
Inf finalInf final
Modelo pedagógico
Modelo pedagógicoModelo pedagógico
Modelo pedagógico
Galaxia Mercury
 
Imagine
ImagineImagine
Imagine
agnetha
 
14.04.13 het belang van gemeente
14.04.13 het belang van gemeente14.04.13 het belang van gemeente
14.04.13 het belang van gemeenteTiko Aloian
 
Introduction to 3rd sequencing
Introduction to 3rd sequencing Introduction to 3rd sequencing
Introduction to 3rd sequencing
Eric Lee
 
Alt c 11-09-08-a pike-nonotes
Alt c 11-09-08-a pike-nonotesAlt c 11-09-08-a pike-nonotes
Alt c 11-09-08-a pike-nonotes
Anne Pike
 
2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store
2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store
2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store
webwinkelvakdag
 
Why Use the Cloud
Why Use the CloudWhy Use the Cloud
Why Use the Cloud
Cirrus Insight
 
Creatividad de enseñar a aprender ERIKA
Creatividad de enseñar a aprender ERIKACreatividad de enseñar a aprender ERIKA
Creatividad de enseñar a aprender ERIKA
erikavallejos12
 
Maternity Health.org
Maternity Health.orgMaternity Health.org
Maternity Health.org
Maternity Health
 
Benefit Solutions That Count
Benefit Solutions That CountBenefit Solutions That Count
Benefit Solutions That Count
LouCroce
 
Job ppt1
Job ppt1Job ppt1
Job ppt1
aumkarpraja
 
Content marketing
Content marketingContent marketing
Content marketing
Alison Jobson
 
You Are Worthy Of My Praise
You Are Worthy Of My PraiseYou Are Worthy Of My Praise
You Are Worthy Of My Praise
guest439050
 
Trade union recognition
Trade union recognitionTrade union recognition
Trade union recognition
Michelle O'Sullivan
 

Viewers also liked (20)

Desarrolloojoyoido 100411235717-phpapp01
Desarrolloojoyoido 100411235717-phpapp01Desarrolloojoyoido 100411235717-phpapp01
Desarrolloojoyoido 100411235717-phpapp01
 
A real story of fake antiques
A real story of fake antiquesA real story of fake antiques
A real story of fake antiques
 
Dominio y hosting
Dominio y hostingDominio y hosting
Dominio y hosting
 
20070913 Stierman Van Hee
20070913 Stierman Van Hee20070913 Stierman Van Hee
20070913 Stierman Van Hee
 
Collective film script writing experiences in using mobile creative writing ...
Collective film script writing  experiences in using mobile creative writing ...Collective film script writing  experiences in using mobile creative writing ...
Collective film script writing experiences in using mobile creative writing ...
 
Inf final
Inf finalInf final
Inf final
 
Modelo pedagógico
Modelo pedagógicoModelo pedagógico
Modelo pedagógico
 
Imagine
ImagineImagine
Imagine
 
14.04.13 het belang van gemeente
14.04.13 het belang van gemeente14.04.13 het belang van gemeente
14.04.13 het belang van gemeente
 
Introduction to 3rd sequencing
Introduction to 3rd sequencing Introduction to 3rd sequencing
Introduction to 3rd sequencing
 
Alt c 11-09-08-a pike-nonotes
Alt c 11-09-08-a pike-nonotesAlt c 11-09-08-a pike-nonotes
Alt c 11-09-08-a pike-nonotes
 
2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store
2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store
2 perspectieven op de woonbranche: resultaat Jan des Bouvrie store
 
Why Use the Cloud
Why Use the CloudWhy Use the Cloud
Why Use the Cloud
 
Creatividad de enseñar a aprender ERIKA
Creatividad de enseñar a aprender ERIKACreatividad de enseñar a aprender ERIKA
Creatividad de enseñar a aprender ERIKA
 
Maternity Health.org
Maternity Health.orgMaternity Health.org
Maternity Health.org
 
Benefit Solutions That Count
Benefit Solutions That CountBenefit Solutions That Count
Benefit Solutions That Count
 
Job ppt1
Job ppt1Job ppt1
Job ppt1
 
Content marketing
Content marketingContent marketing
Content marketing
 
You Are Worthy Of My Praise
You Are Worthy Of My PraiseYou Are Worthy Of My Praise
You Are Worthy Of My Praise
 
Trade union recognition
Trade union recognitionTrade union recognition
Trade union recognition
 

Similar to Causes of mode effect on survey management 2011

Survey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni ConnawaySurvey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni Connaway
Lynn Connaway
 
RecSysTEL2012 slides
RecSysTEL2012 slidesRecSysTEL2012 slides
RecSysTEL2012 slides
Soudé Fazeli
 
Lecture 2: Research Proposal Development
Lecture 2: Research Proposal DevelopmentLecture 2: Research Proposal Development
Lecture 2: Research Proposal Development
ESD UNU-IAS
 
Qrm 210 unit 1
Qrm 210 unit 1Qrm 210 unit 1
Qrm 210 unit 1
Anil Sharma
 
Chapter Five: Reserach Design
Chapter Five: Reserach DesignChapter Five: Reserach Design
Chapter Five: Reserach Design
DemelashAsege
 
Chapter 3
Chapter 3Chapter 3
Chapter 3
Mandy Vasek
 
Gedu 6170 Mixed Methods Research
Gedu 6170 Mixed Methods Research Gedu 6170 Mixed Methods Research
Gedu 6170 Mixed Methods Research
Saad Chahine
 
Research design andmethods
Research design andmethodsResearch design andmethods
Research design andmethods
Ashok Pandey
 
Day 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant Divide
Day 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant DivideDay 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant Divide
Day 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant Divide
Ag4HealthNutrition
 
Educ 210-research-design
Educ 210-research-designEduc 210-research-design
Educ 210-research-design
BernadetteSLomeda
 
Bolouri qualitative method
Bolouri qualitative methodBolouri qualitative method
Bolouri qualitative method
Allame Tabatabaei
 
Social science research methods for libraries
Social science research methods for librariesSocial science research methods for libraries
Social science research methods for libraries
CILIPScotland
 
qualitative research.pptx
qualitative research.pptxqualitative research.pptx
qualitative research.pptx
Mahbubur3
 
Okraku_Research Prospectus Outline_042016
Okraku_Research Prospectus Outline_042016Okraku_Research Prospectus Outline_042016
Okraku_Research Prospectus Outline_042016
Therese Kennelly Okraku
 
Research Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and QualitativeResearch Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and Qualitative
Hanna Stahlberg
 
3-5-04.ppt
3-5-04.ppt3-5-04.ppt
3-5-04.ppt
almasilva17
 
Research methodology
Research methodologyResearch methodology
Research methodology
Md Saifullah Khalid
 
ResearchDesignppt.pptx
ResearchDesignppt.pptxResearchDesignppt.pptx
ResearchDesignppt.pptx
Santhosh Krishna
 
Designing Qualitative Research
Designing Qualitative ResearchDesigning Qualitative Research
Designing Qualitative Research
Mike Crabb
 
Mixed methods research combined
Mixed methods research combinedMixed methods research combined
Mixed methods research combined
abnaking
 

Similar to Causes of mode effect on survey management 2011 (20)

Survey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni ConnawaySurvey Research Methods with Lynn Silipigni Connaway
Survey Research Methods with Lynn Silipigni Connaway
 
RecSysTEL2012 slides
RecSysTEL2012 slidesRecSysTEL2012 slides
RecSysTEL2012 slides
 
Lecture 2: Research Proposal Development
Lecture 2: Research Proposal DevelopmentLecture 2: Research Proposal Development
Lecture 2: Research Proposal Development
 
Qrm 210 unit 1
Qrm 210 unit 1Qrm 210 unit 1
Qrm 210 unit 1
 
Chapter Five: Reserach Design
Chapter Five: Reserach DesignChapter Five: Reserach Design
Chapter Five: Reserach Design
 
Chapter 3
Chapter 3Chapter 3
Chapter 3
 
Gedu 6170 Mixed Methods Research
Gedu 6170 Mixed Methods Research Gedu 6170 Mixed Methods Research
Gedu 6170 Mixed Methods Research
 
Research design andmethods
Research design andmethodsResearch design andmethods
Research design andmethods
 
Day 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant Divide
Day 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant DivideDay 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant Divide
Day 1 - Quisumbing and Davis - Moving Beyond the Qual-Quant Divide
 
Educ 210-research-design
Educ 210-research-designEduc 210-research-design
Educ 210-research-design
 
Bolouri qualitative method
Bolouri qualitative methodBolouri qualitative method
Bolouri qualitative method
 
Social science research methods for libraries
Social science research methods for librariesSocial science research methods for libraries
Social science research methods for libraries
 
qualitative research.pptx
qualitative research.pptxqualitative research.pptx
qualitative research.pptx
 
Okraku_Research Prospectus Outline_042016
Okraku_Research Prospectus Outline_042016Okraku_Research Prospectus Outline_042016
Okraku_Research Prospectus Outline_042016
 
Research Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and QualitativeResearch Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and Qualitative
 
3-5-04.ppt
3-5-04.ppt3-5-04.ppt
3-5-04.ppt
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
ResearchDesignppt.pptx
ResearchDesignppt.pptxResearchDesignppt.pptx
ResearchDesignppt.pptx
 
Designing Qualitative Research
Designing Qualitative ResearchDesigning Qualitative Research
Designing Qualitative Research
 
Mixed methods research combined
Mixed methods research combinedMixed methods research combined
Mixed methods research combined
 

Recently uploaded

Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 

Recently uploaded (20)

Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 

Causes of mode effect on survey management 2011

  • 1. Causes of mode effects on survey measurement One day symposium at the Royal Statistical Society, London 11 October 2011
  • 2. Background Background • Increasing use of mixed modes • Falling response rates • Rising costs of data collection • Risk of reduced data comparability • Coverage error • Non-response error • Measurement error • Need for practical advice to inform decisions about when to mix modes and how
  • 3. Mixing Modes and Measurement Error • Funded under the ESRC Survey Design and Measurement Initiative • 3-year contract starting 1 Oct 2007 • Collaboration between NatCen, ISER and independent survey methods consultant
  • 4. Core research team • National Centre for Social Research (NatCen) • Gerry Nicolaas • Steven Hope (now UCL) • Margaret Blake • Michelle Gray • Institute for Social & Economic Research (ISER) • Peter Lynn • Annette Jäckle • The Survey Coach (Independent Survey Methods Consultant) • Pamela Campanelli
  • 5. Main objective • Practical advice on how to improve portability of questions across modes • Which mode combinations are likely to produce comparable responses? • Which types of questions are more susceptible to mode effects?
  • 6. Research design • A literature review & framework of mixed modes • develop a conceptual framework • identify gaps in evidence base and formulate hypotheses to address gaps • Quantitative data analysis • test hypotheses using existing datasets and new experimental data • Cognitive interviewing • explore how respondents process questions in different modes
  • 7. Presentations & Discussion 1. How and when does the mode of data collection affect survey measurement? 2. The use of cognitive interviewing methods to evaluate mode effects 3. The role of visual and aural stimuli in producing mode effects 4. The role of the interviewer in producing mode effects 5. Is it a good idea to optimise question format for mode of data collection? 6. Designing questions for mixed mode surveys 7. Discussant (Patten Smith) 8. Open discussion