This document summarizes the MIMOD project, which aims to help national statistical institutes in Europe address challenges of multi-mode and multi-device data collection. The project involves testing different data collection modes and tools across surveys in several European countries. Key findings include that questionnaires should be designed for possible mixed-mode collection from the start, and that common surveys like the Labour Force Survey are increasingly using mixed modes. The document also proposes establishing an online platform for Nordic countries to share experiences and results related to addressing mixed-mode challenges.

1. Mode-Mixers of the North, Unite?
Trends in Nordic and European data collection for social surveys
10/17/2019
Dag F. Gravem, Statistics Norway, dfg@ssb.no
1

2. MIMOD: A 2017-2019 grants project
• MIxed MOde Data collection
• Support national statistical institutes (NSIs) in the European
statistical system (ESS) with regard to multi-mode and -device
data collection challenges
• Using different tools can impact net sample composition and/or
measurements – positively and/or negatively
• (And possibly save time and money)
10/17/2019 2

3. MIMOD: A 2017-2019 grants project
10/17/2019 3
• Consortium: Italy, Netherlands, Austria, Germany and Norway
• Support group: Finland, Sweden, Poland, Czech republic,
France
• Work packages:
1. Mode organization
2. Assessment and adjustment of mode effects
3. Case management systems
4. Designing mixed-mode questionnaires
5. Phone and tablet challenges
https://www.istat.it/en/archivio/226140

4. Key takeaway point #1
10/17/2019 4
“If there is even a small
chance of mixing modes in
the project, design the
questionnaire for the
possibility of mixed-mode
data collection.”
Guideline 11.7 in Internet, Phone, Mail and Mixed-Mode Surveys – The Tailored Design
Method by Don A. Dillman (pictured), Jolene D. Smyth and Leah Melani Christian (2009)

5. 10/17/2019 5
The chance
of mixed
mode is BIG!
LFS: Labour force survey
EU-SILC: European Standards of
Income and Living Conditions
EHIS: European Health Interview
Survey
AES: Adult Education Survey
ICT: Information and Communication
Technology survey
CAPI: Computer-assisted personal
interview
CATI: Computer-assisted telephone
interview
PAPI: Paper and pencil interview
CAWI: Computer-assisted web
interview

6. 10/17/2019 6
MIMOD: The Nordic situation

7. 10/17/2019 7
MIMOD: WP4 in a nutshell
1) Review of ESS model questionnaires, variable descriptions and
relevant documentation
• Poorly adapted to mixed mode
• In conflict with literature and practice (haven’t read Dillman?!?)
2) Analysis of key and typical questions vulnerable to mode effects
• Classification system developed by Campanelli et al. (2013)
3) (Re)design and pretesting of selected questions
• Unimode: making it as similar as possible across modes
• Mode-specific: designing for each mode
• Cognitive and usability test-retest design

8. 10/17/2019 8
An example: Hours worked in reference week from
Labour Force Survey
• Using the strengths of visual
presentation and automatic
calculation to enhance data
quality
• Positive results by Statistics
Finland in 2013 pilot
• Negative findings by ONS
(UK) in 2018 prestesting
• What about Norway..?

9. 10/17/2019 9
An example: Hours worked in reference week from
Labour Force Survey
• Subjected to cognitive and
usability lab testing
• Regrettably, in line with ONS
findings
• Test persons annoyed by
response burden
• Satisficing by rounding to
nearest hour

10. 10/17/2019 10
Key Takeaway Point #2:
• We (The Nordic countries ++?) could use a platform
for exchanging …
• question and questionnaire documentation,
• good and bad ideas,
• test and pilot results,
• screenshots,
• discussions
• … and other stuff related to our common mixed
mode challenges
• Something in the form of a moderated wiki for
invitees

11. Any volunteers?!?
10/17/2019 11

12. Thank you!
10/17/2019 12