Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Anna Lethborg - Research Director (Social Research Centre)
A system (including the structure) to manage daily work, including
• Customer demand
• Best Practices and Standards
• Equipment & the workplace
• Improvement • People
Lean Quick Changeover (SMED) Training ModuleFrank-G. Adler
The Lean Quick Changeover (SMED) Training Module v2.0 includes:
1. MS PowerPoint Presentation including 65 slides covering an Introduction to Lean Management, The Seven Lean Wastes, Lean Kaizen Events, and a Step-by-Step Changeover Time Reduction (SMED) Process.
2. MS Excel Changeover Time Analysis Worksheet Template
Helping you to embrace lean by doing 5S in your office or work-space. A good way for a busy executive to clean up his office, work effectively and learn 5S by experiencing it first hand
A system (including the structure) to manage daily work, including
• Customer demand
• Best Practices and Standards
• Equipment & the workplace
• Improvement • People
Lean Quick Changeover (SMED) Training ModuleFrank-G. Adler
The Lean Quick Changeover (SMED) Training Module v2.0 includes:
1. MS PowerPoint Presentation including 65 slides covering an Introduction to Lean Management, The Seven Lean Wastes, Lean Kaizen Events, and a Step-by-Step Changeover Time Reduction (SMED) Process.
2. MS Excel Changeover Time Analysis Worksheet Template
Helping you to embrace lean by doing 5S in your office or work-space. A good way for a busy executive to clean up his office, work effectively and learn 5S by experiencing it first hand
Stratechi HR & Org Strategy Presentation Template by McKinsey Alum.pdfStratechi.com
Visit https://www.stratechi.com/hr-strategy-template/ to download the 186-page HR & Org Strategy PowerPoint template created by an Ex-McKinsey consultant. The deck has HR & organizational strategy storylines, ideas for initiatives, ready-to-go slides, professional graphics, charts, and icons. Includes important HR & org slides such as org design, org charts, employee journey, headcount charts and maps, SHCM initiatives, culture, job career ladders, headcount reduction, org consolidation, total compensation, medical & fringe benefits, HR budget, goals, KPIs, talent acquisition funnel, HCM platform, HRIS, stock options, team initiatives, values, mission, scorecards, employee engagement, core competencies, change management, and many charts, worksheets, and other templates.
Presentation on Decision Making & Critical Thinking with the inclusion of concepts like : 6 thinking hats & 5 whys approach. Be the master of your actions with powerful decision making skills. Its decision making skills which differentiate between an employee and leader. Be a leader, lead your team, lead your life.
Correct protocol is the cornerstone of successful gemba walks. Follow these 12 steps to ensure that your gemba walks produce the desired result.
http://traccsolution.com/resources/successful-gemba-walks/
The First 100 Days: A Road Map for A Successful Transition into a New Leadership Role
They say that first impressions count. Well, when you’re the new CEO or ED how long does a first impression last and who do you need to make a good impression on? In this session, we’ll look at various milestones for a successful transition into leadership—what are those markers and when can you expect to achieve them? Good leadership needs to make a great first impression and this workshop will help show you how to put your best foot forward
Metrics-Based Process Mapping: Part 1 of 3TKMG, Inc.
Recorded webinar: http://slidesha.re/1eYtbZM
Part 2 - http://slidesha.re/17pgwcS
Part 3 - http://slidesha.re/139L8Sb (Excel tool product demo)
Subscribe: http://www.ksmartin.com/subscribe
To purchase the book: http://bit.ly/MBPMbk
Metrics-Based Process Mapping (MBPM) is a methodology that was developed to support the adoption of lean practices in office, service, and knowledge work environments.
Designed and developed by Karen Martin & Mike Osterling, this technique integrates the functional orientation of conventional swim-lane process maps with the time and quality metrics used in value stream mapping.
Learn how to create a metrics-based process map to identify and eliminate waste in an office/service process. Part 1 of 3.
This presentation answers few points nd simple questions:
What is an A3 Report?
How to create one?
What applications it is used for - not just Solving Problems.
What makes a "Good" A3 Report.
A good guide to the science of coaching and developing your employees as well as the basic skills needed as a supervisor. New supervisors will find this training helpful in making the transition from a position where they were technically proficient to one where they rely on their subordinates for that proficiancy.
When faced with an opportunity to take on a stretch assignment, new role, or promotion, what’s your reaction? Be Leaderly surveyed more than 1,500 professionals to find out what it takes to say “yes” with confidence. In this webinar, learn what we discovered—and how you can prepare to step up to your next big career opportunity.
Guest speakers:
Shuchi Sharma, Global Vice President and Leader of Gender Intelligence at SAP and Robert F. Solomon Jr., Director of Culture and Engagement, Lowe’s Companies, Inc.
How to Run a Value Stream Mapping (VSM) WorkshopAbraic, Inc.
Learn how—and why—to conduct a VSM workshop. This tutorial caters to an IT audience but is applicable to any department within an organization. With its origins in manufacturing, Value Stream Mapping (VSM) has been successfully adopted by other industries to improve business processes.
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Darren Pennay - Founder and Executive Director, Research, Methods & Strategy (Social Research Centre)
Workshop session 5 - the effectiveness of standard methods to improve general...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Darren Pennay - Founder and Executive Director, Research, Methods & Strategy and Ben Phillips - Senior Research Director, Survey Methodology (Social Research Centre)
Stratechi HR & Org Strategy Presentation Template by McKinsey Alum.pdfStratechi.com
Visit https://www.stratechi.com/hr-strategy-template/ to download the 186-page HR & Org Strategy PowerPoint template created by an Ex-McKinsey consultant. The deck has HR & organizational strategy storylines, ideas for initiatives, ready-to-go slides, professional graphics, charts, and icons. Includes important HR & org slides such as org design, org charts, employee journey, headcount charts and maps, SHCM initiatives, culture, job career ladders, headcount reduction, org consolidation, total compensation, medical & fringe benefits, HR budget, goals, KPIs, talent acquisition funnel, HCM platform, HRIS, stock options, team initiatives, values, mission, scorecards, employee engagement, core competencies, change management, and many charts, worksheets, and other templates.
Presentation on Decision Making & Critical Thinking with the inclusion of concepts like : 6 thinking hats & 5 whys approach. Be the master of your actions with powerful decision making skills. Its decision making skills which differentiate between an employee and leader. Be a leader, lead your team, lead your life.
Correct protocol is the cornerstone of successful gemba walks. Follow these 12 steps to ensure that your gemba walks produce the desired result.
http://traccsolution.com/resources/successful-gemba-walks/
The First 100 Days: A Road Map for A Successful Transition into a New Leadership Role
They say that first impressions count. Well, when you’re the new CEO or ED how long does a first impression last and who do you need to make a good impression on? In this session, we’ll look at various milestones for a successful transition into leadership—what are those markers and when can you expect to achieve them? Good leadership needs to make a great first impression and this workshop will help show you how to put your best foot forward
Metrics-Based Process Mapping: Part 1 of 3TKMG, Inc.
Recorded webinar: http://slidesha.re/1eYtbZM
Part 2 - http://slidesha.re/17pgwcS
Part 3 - http://slidesha.re/139L8Sb (Excel tool product demo)
Subscribe: http://www.ksmartin.com/subscribe
To purchase the book: http://bit.ly/MBPMbk
Metrics-Based Process Mapping (MBPM) is a methodology that was developed to support the adoption of lean practices in office, service, and knowledge work environments.
Designed and developed by Karen Martin & Mike Osterling, this technique integrates the functional orientation of conventional swim-lane process maps with the time and quality metrics used in value stream mapping.
Learn how to create a metrics-based process map to identify and eliminate waste in an office/service process. Part 1 of 3.
This presentation answers few points nd simple questions:
What is an A3 Report?
How to create one?
What applications it is used for - not just Solving Problems.
What makes a "Good" A3 Report.
A good guide to the science of coaching and developing your employees as well as the basic skills needed as a supervisor. New supervisors will find this training helpful in making the transition from a position where they were technically proficient to one where they rely on their subordinates for that proficiancy.
When faced with an opportunity to take on a stretch assignment, new role, or promotion, what’s your reaction? Be Leaderly surveyed more than 1,500 professionals to find out what it takes to say “yes” with confidence. In this webinar, learn what we discovered—and how you can prepare to step up to your next big career opportunity.
Guest speakers:
Shuchi Sharma, Global Vice President and Leader of Gender Intelligence at SAP and Robert F. Solomon Jr., Director of Culture and Engagement, Lowe’s Companies, Inc.
How to Run a Value Stream Mapping (VSM) WorkshopAbraic, Inc.
Learn how—and why—to conduct a VSM workshop. This tutorial caters to an IT audience but is applicable to any department within an organization. With its origins in manufacturing, Value Stream Mapping (VSM) has been successfully adopted by other industries to improve business processes.
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Darren Pennay - Founder and Executive Director, Research, Methods & Strategy (Social Research Centre)
Workshop session 5 - the effectiveness of standard methods to improve general...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Darren Pennay - Founder and Executive Director, Research, Methods & Strategy and Ben Phillips - Senior Research Director, Survey Methodology (Social Research Centre)
A solutions-based approach, illustrated by case studies, which show how inferences can be improved from surveys administered to biased, low response rate and non-probability samples.
It addresses how to improve the accuracy of the survey estimates we generate from poorer quality and non-probability samples.
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Darren Pennay - Founder and Executive Director, Research, Methods & Strategy (Social Research Centre)
Workshop session 4 - Optimal sample designs for general community telephone s...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Dina Neiger - Chief Statistician (Social Research Centre)
Data Analysis week 8 presentation - Survey and Quantitative Observation Techn...Ellie Hendrick
Our final power point presentation on survey and quantitative observation techniques. For week 8 Data Analysis Lecture. By Ellie, Lizzie, Ed, Stephen and Jessica
Nicolaas smith nat cen-city seminar oct 2017_v4_241017 Gerry Nicolaas
Push-to-web’ surveys use offline contact methods to encourage people to go online and complete a web questionnaire. This design may or may not offer alternative modes of data collection but, if so, only in subsequent contact attempts among web non-respondents. In this presentation, Gerry Nicolaas & Patten Smith review the development of this methodology in the UK and elsewhere, concluding with the challenges that still need to be addressed and require further research.
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Ben Phillips, Senior Research Director, Survey Methodology (Social Research Centre)
Running head THE ADVANTAGES AND DISADVANTAGES OF SURVEYS.docxtoltonkendal
Running head: THE ADVANTAGES AND DISADVANTAGES OF SURVEYS
Unit Six Assignment Essay
Nicholas George Christakis
California Intercontinental University
MKT 645 -2016 CT4
June 20, 2016
To: Dr. Debra McCoskey-Reisert
MARKETING RESEARCH
Market research is a systematic way to gather, evaluate and present it in a form that explains various facts and figures to the business. Collected information acts as a vital tool to have increments in business activities, qualitative work done and improved profits. Any company, whether small scale or large scale, can perform market research before marketing its products or services. It can also be useful when launching a new product or diversifying the business. It is useful as well when a company has to expand its business globally. It avails numerous benefits to the businesses.
Among the different methods of data gathering for research purposes, many researchers due to its various advantages, strengths and benefits prefer the survey method. However, surveys also have their disadvantages and weak points that must be considered.
Advantages of Marketing Surveys
Market research is a scheduled method to collect, analyze and correlate beneficial data for the benefit of business to make strategic decisions. Collected information acts as a vital tool to have increments in business activities, qualitative work done and improved profits. Any company, whether small scale or large scale, can perform market research before selling its products or services. It can also be useful when launching a new product or diversifying the business. It is useful as well when a company has to expand its business globally. It avails numerous benefits to the companies.
Among the different methods of data gathering for research purposes, many researchers due to its various advantages, strengths and benefits prefer the survey method. However, surveys also have their disadvantages and weak points that must be considered.
Online surveys and mobile surveys tend to be the most cost-effective modes of survey research, yet they may not reach those respondents that can only respond using alternate modes. Results of online surveys and mobile surveys may suffer and differ greatly if important respondents are left out of the research. Hard-to-reach respondents may be easier to reach using more traditional methods such as paper surveys or face-to-face interviews. The self-completed postal or mail survey is a recognized form of data collection in marketing research (Dillman 1978). There are well- documented practical problems with this form of data collection: poor response rates, slow response, and manual transcription of data from a hard copy questionnaire to an appropriate statistical analysis tool. Non- response and data entry errors may result. Consequently, research into online data collection methods increased significantly during the late 1990s. This was preceded by (1) a growing number of Internet and email users, which started ...
httpfmx.sagepub.comField Methods DOI 10.117715258.docxpooleavelina
http://fmx.sagepub.com
Field Methods
DOI: 10.1177/1525822X04269550
2005; 17; 30 Field Methods
Don A. Dillman and Leah Melani Christian
Survey Mode as a Source of Instability in Responses across Surveys
http://fmx.sagepub.com/cgi/content/abstract/17/1/30
The online version of this article can be found at:
Published by:
http://www.sagepublications.com
can be found at:Field Methods Additional services and information for
http://fmx.sagepub.com/cgi/alerts Email Alerts:
http://fmx.sagepub.com/subscriptions Subscriptions:
http://www.sagepub.com/journalsReprints.navReprints:
http://www.sagepub.com/journalsPermissions.navPermissions:
http://fmx.sagepub.com/cgi/content/refs/17/1/30 Citations
at SAGE Publications on September 9, 2009 http://fmx.sagepub.comDownloaded from
http://fmx.sagepub.com/cgi/alerts
http://fmx.sagepub.com/subscriptions
http://www.sagepub.com/journalsReprints.nav
http://www.sagepub.com/journalsPermissions.nav
http://fmx.sagepub.com/cgi/content/refs/17/1/30
http://fmx.sagepub.com
10.1177/1525822X04269550FIELD METHODSDillman, Christian / SURVEY MODE AS SOURCE OF INSTABILITY
Survey Mode as a Source of Instability
in Responses across Surveys
DON A. DILLMAN
LEAH MELANI CHRISTIAN
Washington State University
Changes in survey mode for conducting panel surveys may contribute significantly to
survey error. This article explores the causes and consequences of such changes in
survey mode. The authors describe how and why the choice of survey mode often
causes changes to be made to the wording of questions, as well as the reasons that
identically worded questions often produce different answers when administered
through different modes. The authors provide evidence that answers may change as a
result of different visual layouts for otherwise identical questions and suggest ways
to keep measurement the same despite changes in survey mode.
Keywords: survey mode; questionnaire; panel survey; measurement; survey error
Most panel studies require measurement of the same variables at different
times. Often, participants are asked questions, several days, weeks, months,
or years apart to measure change in some characteristics of interest to the
investigation. These characteristics might include political attitudes, satis-
faction with a health care provider, frequency of a behavior, ownership of
financial resources, or level of educational attainment. Whatever the charac-
teristic of interest, it is important that the question used to ascertain it perform
the same across multiple data collections.
In addition, declining survey response rates, particularly for telephone
surveys, have encouraged researchers to use multiple modes of data collec-
tion during the administration of a single cross-sectional survey. Encouraged
by the availability of more survey modes than in the past and evidence that a
change in modes produces higher response rates (Dillman 2002), surveyors
This is a revision of a paper presented at t ...
IFD&TC 2019: Technical Challenges and Solutions in Center ManagementLew Berman
This panel will discuss two sets of challenges and solutions in center management. Telephone based surveys typically use supervisory staff to live-monitor interviewers or manually review recordings for effective speech rate, properly reading a question, and accurately recording a response. General industry practice is to review 5-10% of all calls. However, these practices are labor intensive, subjective, and the evidence for this range of review is anecdotal. This panel will discuss current call center practices and new technical solutions for improving these practices. Spam blockers are having an increasing impact on our ability to contact respondents by phone. Panelists will share research about spam blockers, how they affect centers with different telephone systems, and possible solutions to ensure your calls get through to study participants.
This material caters the descriptions and different techniques of Internet-based researches. This material also caters helpful web sites and search engines.
Similar to Workshop session 10 - Alternatives to CATI (3) address-based sampling and push-to-web (20)
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Darren Pennay - Founder and Executive Director, Research, Methods & Strategy (Social Research Centre)
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Presentation by Paul J. Lavrakas, PhD - Senior Methodological Adviser (Social Research Centre)
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Dina Neiger - Chief Statistician (Social Research Centre)
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Kane Chapman - General Manager (SamplePages)
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Ben Phillips, Senior Research Director, Survey Methodology (Social Research Centre)
Increasing cooperation in telephone surveys with the progressive engagement t...The Social Research Centre
Paul Myers, Paul J Lavrakas, Darren Pennay and Natasha Vickers
American Association For Public Opinion Research 71st Annual Conference 2016, Austin, Texas
Sharpen existing tools or get a new toolbox? Contemporary cluster initiatives...Orkestra
UIIN Conference, Madrid, 27-29 May 2024
James Wilson, Orkestra and Deusto Business School
Emily Wise, Lund University
Madeline Smith, The Glasgow School of Art
This presentation, created by Syed Faiz ul Hassan, explores the profound influence of media on public perception and behavior. It delves into the evolution of media from oral traditions to modern digital and social media platforms. Key topics include the role of media in information propagation, socialization, crisis awareness, globalization, and education. The presentation also examines media influence through agenda setting, propaganda, and manipulative techniques used by advertisers and marketers. Furthermore, it highlights the impact of surveillance enabled by media technologies on personal behavior and preferences. Through this comprehensive overview, the presentation aims to shed light on how media shapes collective consciousness and public opinion.
This presentation by Morris Kleiner (University of Minnesota), was made during the discussion “Competition and Regulation in Professions and Occupations” held at the Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found out at oe.cd/crps.
This presentation was uploaded with the author’s consent.
Acorn Recovery: Restore IT infra within minutesIP ServerOne
Introducing Acorn Recovery as a Service, a simple, fast, and secure managed disaster recovery (DRaaS) by IP ServerOne. A DR solution that helps restore your IT infra within minutes.
0x01 - Newton's Third Law: Static vs. Dynamic AbusersOWASP Beja
f you offer a service on the web, odds are that someone will abuse it. Be it an API, a SaaS, a PaaS, or even a static website, someone somewhere will try to figure out a way to use it to their own needs. In this talk we'll compare measures that are effective against static attackers and how to battle a dynamic attacker who adapts to your counter-measures.
About the Speaker
===============
Diogo Sousa, Engineering Manager @ Canonical
An opinionated individual with an interest in cryptography and its intersection with secure software development.
Have you ever wondered how search works while visiting an e-commerce site, internal website, or searching through other types of online resources? Look no further than this informative session on the ways that taxonomies help end-users navigate the internet! Hear from taxonomists and other information professionals who have first-hand experience creating and working with taxonomies that aid in navigation, search, and discovery across a range of disciplines.
Supercharge your AI - SSP Industry Breakout Session 2024-v2_1.pdf
Workshop session 10 - Alternatives to CATI (3) address-based sampling and push-to-web
1. A subsidiary of:
Alternatives: address-based sampling
(A-BS) and sequential mixed-mode
Telephone Interviewing in the Post-Modern Era Conference
Melbourne
10 October, 2019
4. www.srcentre.com.au
Three core design features
Address-based
sampling (A-BS)
Mail and phone
recruitment
Sequential
mixed-mode
data collection
4
1 2 3
5. www.srcentre.com.au
Address-based sampling
A-BS is not new but is being
increasingly used for large-
scale social surveys
internationally
Dates to mid-2000s in the U.S.
Landline RDD coverage was
beginning to be recognised as
a problem
Telephone response rates
were decreasing
5
• Near universal coverage
of physical addresses
• Geocoded data allows for
accurate sub-national
sampling
• Able to append auxiliary
data
• Still a work in progress
Rationale
1
6. www.srcentre.com.au
Sample frame
6
Source: PSMA Australia (2018)
1
Geo-coded National Address File (G-NAF)
Maintained by PSMA Australia
(jointly owned by Commonwealth
and State / Territory govts
Over 13,000,000 addresses
Updated quarterly
Three reliable sources of address
information
Incl. validated addresses with
Postal Address Flag (PAF)
State and Territory
Governments
Australian Election
Commission
National Mailing
Contributor
9%
7%
66%
3%
2%10%
3%
86%
9.2% unuseable
58.3%
unuseable
AES (2016)
7. www.srcentre.com.au
Dual-modes of recruitment
Primary recruitment mode is mail
Invitation and reminder letters
Reminder postcards
Questionnaire
8
• Mail is an authoritative
contact method
• Inclusion of non-contingent
incentives
• Can send additional
informational materials
• Phone reminders may be
more persuasive
Rationale
2
Ability to match addresses to
phone numbers (56.4%) also
allows for telephone
recruitment
Reminder calls
8. www.srcentre.com.au
Sequential mixed-mode
Data collection method developed
from late 2000s, publications from
early 2010s
Staggered approach
1. Push-to-web phase
2. Hard copy questionnaire sent
9
• Maximise online
completions before
introducing hard copy
• Data quality
• Reduced cost
• High response rates
Rationale
3
Non-responders sent 2-3
reminders before second
mode introduced
14. www.srcentre.com.au
How did we get here?
15
2019
Australian
Election
Study
2016 Australian Election Study
2018 World
Values Survey
2015 Online Panels
Benchmarking Study
2018 Australian
Barometer
Study
15. www.srcentre.com.au
Evolving design
16
Length 45 mins / 24 pg 51 mins / 28 pg 48 mins / 28 pg 45 mins / 24 pg
Incentives $10,000 prize draw $5 / $10 $5 / $10 $5 / $20
Pre-notification letter - - - 1
Reminder postcards 1 2 2 2
Reminder calls 1 2 2 2
Hard copy mailings 1 2 2 2
Reminder letters 3 2 2 2
Branding - Full Full Full
Timeline Short push-2-web Extended Condensed Extended
AES 2016 WVS 2018 Barometer 2018 AES 2019
17. www.srcentre.com.au
Respondent profile
19
Respondent characteristics
Push-to-
web
Mixed-
mode
Total
Aust.
adults*
Gender
Male 42.3 42.1 42.2 49.2
Female 56.3 55.7 56.1 50.9
Age
18 to 24 3.6 2.4 3.1 12.2
25 to 34 11.2 8.9 10.2 19.3
35 to 44 13.3 14.2 13.7 17.1
45 to 54 17.5 13.8 15.9 16.7
55 to 64 20.8 20.0 20.5 14.9
65 to 74 21.6 20.0 20.9 11.3
75 and over 8.3 15.1 11.4 8.6
*Source: Australian Bureau of Statistics, Estimated Residential Population, December 2017
Available from http://www.abs.gov.au/ausstats/abs@.nsf/mf/3101.0
18. www.srcentre.com.au
Respondent profile
20
Respondent characteristics
Push-to-
web
Mixed-
mode
Total
Aust.
adults*
Education
University 43.7 35.2 39.8 25.6
Non-university 52.7 60.1 56.1 74.4
SEIFA
Quintile 1 – Lowest 11.9 13.5 12.6 20.0
Quintile 2 20.4 21.5 20.9 20.0
Quintile 3 22.7 23.1 22.9 20.0
Quintile 4 21.8 20.6 21.2 20.0
Quintile 5 – Highest 23.3 21.3 22.4 20.0
*Source: Australian Bureau of Statistics, Estimated Residential Population, December 2017
Available from http://www.abs.gov.au/ausstats/abs@.nsf/mf/3101.0
Available in sample
Possible to
oversample lower
quintiles
Means lower RR
20. www.srcentre.com.au
Operational considerations
Field period is extensive (3-4 months) due to sequential design and need to
cover multiple contact attempts
Limited ability to change specifications once data collection started
No ability to respond to deviations from production assumptions
Hard copy questionnaire not changeable
Pilot testing desirable
Compared to dual-frame RDD, respondent profile is older, more female and
better educated
Postage contributes considerably to cost
22
21. www.srcentre.com.au
Operational considerations
For long questionnaires, consider two-phase approach:
1. Short screener to identify characteristics of interest (e.g. presence of
children, health issues), collect household roster, alternate contact
information (email, phone)
2. Recontact selected households: allows offline selection of individual
from household roster, sampling of sub-populations, transition to
alternative modes
Considerations:
Even longer data collection period
Lower response rate than one phase
Higher cost for incentives
23
22. www.srcentre.com.au
Operational considerations
Within-household
selection not used since
2016 AES
Believed to
negatively impact
response rate
Respondents known
to not follow sampling
instructions
Currently experimenting
with next / last birthday
24
Male 48.9 42.9 49.1
Female 51.1 57.1 50.9
*Source: Australian Bureau of Statistics, Estimated Residential Population, December 2017
Available from http://www.abs.gov.au/ausstats/abs@.nsf/mf/3101.0
AES 2016 AES 2019 Aust adults*
18 to 34 years 10.9 13.2 31.5
35 to 44 years 11.2 13.7 17.1
45 to 54 years 15.7 15.9 16.7
55 years and over 62.2 57.2 34.8
Gender
Age
23. www.srcentre.com.au
Questionnaire considerations
Limited complexity due to need for paper mode
Limit skips, open-ended questions, etc.
Certain question types will need a fundamental redesign
Move to online / hard copy from phone likely to lead to mode effects
Phone: response recency (more likely to select options read out last),
response acquiescence and social desirability
Online / hard copy: response primacy (more likely to select options
appearing earlier), straight-lining and other response non-differentiation
Efforts to understand mode effects will assist in transitioning
25
25. www.srcentre.com.au
For us…
27
Unpack influences
on response rate
Non-response analysis
Apply within-household
selection routines
Continued
experimentation
(e.g. registered post)
Consider two-phase
data collection
NEXT
STEPS
Making sample-based
corrections to improve
representativeness
26. www.srcentre.com.au
For you…
If so, consider the following design
elements:
28
Is A-BS sequential mixed-mode
appropriate for your study?
How important is response
rate?
Do you need to be able to sub-
sample based on location?
How long can you allow for data
collection?
What profile are you seeking?
Is self-completion desirable?
Is sequential mixed-mode
required or is push-to-web
sufficient for your needs?
Have you prepared for the
transition?
Rotating phone response
frames
Consider bridging waves or
fielding waves simultaneously
27. PO Box 13328
Law Courts Victoria 8010
03 9236 8500
A subsidiary of:
29
Thank you
28. www.srcentre.com.au
References
Battaglia, M, Link, MW, Frankel, MR, Osborn, L, and Mokdad, AH, 2008, ‘An evaluation of
respondent selection methods for household mail surveys’, Public Opinion Quarterly, vol.
72, no. 3, pp. 459-469.
Dillman, DA, 2017, ‘The promise and challenge of pushing respondents to the web in
mixed-mode surveys’, Survey Methodology, vol. 43, no. 1, pp. 3-30.
Dillman, DA, 2009, Internet, Mail, and Mixed-mode Surveys: The Tailored Design Method,
3rd Edition, pp. 234-299.
Dykema, J, Jacques, K, Cyffka, K, Assad, N, Ganci Hammers, R, Elver, K, Malecki, KC and
Stevenson, J, 2015, ‘Effects of sequential prepaid incentives and envelope messaging in
mail surveys’, Public Opinion Quarterly, vol. 79, no. 4, pp. 906-931.
Edwards, P, Roberts, I, DiGuiseppi, C, Wentz, R, Kwan, I, Cooper R, Felix LM and Pratap,
S, 2009, ‘Methods to increase response to postal and electronic questionnaires (review)’,
Cochrane Database of Systematic Reviews, issue 3, art. MR000008.
30
29. www.srcentre.com.au
References
Fan, W. & Yan, Z., 2010, ‘Factors affecting response rates of the web survey: A systemic
review’, Computers in Human Behaviour, vol. 26, pp.132-139.
Groves, RM, Cialdini, RB and Couper, MP, 1992, ‘Understanding the decision to participate
in a survey’, Public Opinion Quarterly, vol. 56, no. 4, pp. 475-495.
Iannacchione VG, Staab JM, & Redden DT (2003). Evaluating the use of residential mailing
addresses in a metropolitan household survey. Public Opinion Quarterly 67(2):202–210.
Link MW, Battaglia MP, Frankel MR, Osborn L, & Mokdad AH (2006). Address-based versus
random-digit-dial surveys: comparison of key health and risk indicators. American Journal of
Epidemiology 164(10):1019–1025.
Tourangeau, R, 2017, ‘Mixing modes: tradeoffs among coverage, nonresponse, and
measurement error’, in PP Biemer, E de Leeuw, S Eckman, B Edwards, F Kreuter, LE
Lyberg, N Clyde Tucker and BT West (eds.), Total Survey Error in Practice, Hoboken, NJ,
USA: Wiley, pp. 115-132.
31
Editor's Notes
Welcome – thank you all for staying awake
The next alternative for discussion is address-based sampling for sequential mixed-mode studies
Apologies in advance to everyone from the ABS for my use of the abbreviation A-BS
I’d like to thank Ben for his input into the slide development
Another alternative to CATI is using address-based sampling to administer a sequential mixed-mode study, or what we call “A-BS sequential mixed-mode”.
Before sharing some of our learnings since we first used this mode in 2015, I’ll introduce the key features of the design and tell you the rationale behind each
There are actually three core elements to the A-BS sequential mixed-mode design
Firstly we are using an address-based approach to sampling. For CATI studies we use landline or mobile telephone numbers, we’re talking about a list of postal addresses.
Primary mode of contact is mail, we are also able to match phone numbers to the frame so you can do reminder calls
And instead of telephone as the default mode for data collection, we use a two staged (sequential) approach to data collection. First, there is a push-to-web phase where respondents are invited to complete online and, following a period of time, a hard copy questionnaire is sent to provide an opportunity for the offline population to participate.
Address-based sampling (A-BS) was developed in the mid-2000s in the U.S. (Iannacchione, Staab & Redden 2003; Link et al. 2006) as a response to the declining coverage of the landline random digit dialling (RDD) frame and declining telephone survey response rates.
PSMA Australia (formerly Public Sector Mapping Authority)
G-NAF sample frames select addresses from a database with near universal coverage (all physical addresses in Australia) of residential homes as distinct from the traditional block-listing approach. The G‑NAF was supplied by Mastersoft Group.
Previous experience shows that very few completed questionnaires are obtained from non-validated addresses and that attempts to enumerate this sample also results in high rates of sample loss (58.3% unusable sample compared to 9.2% amongst the validated sample) and greatly reduced sample efficiency.
Edwards 2009 cites evidence for sending a pre-notification letter
Works with any sample with addresses; not limited to address based samples
Sequential mixed mode design with paper not offered to begin with (Tourangeau, 2017)
Questionnaire offered at 3rd or 4th contact (Dillman, 2017)
135 days of collection
(4.5 months)!
Match rate from AES 2019
Approach envelopes sponsored by an official / authoritative academic or government body (Dillman, 2017; Fan et al., 2010; Groves et al., 1992).
Do not include graphics or external messaging on envelopes (Dykema et al., 2015) or brightly coloured envelopes as these can be mistaken for marketing materials (Dillman, 2009).
Letters:
Be brief and emphasise the importance / significance of the study (Dillman, 2009)
Mention being part of a small selected group (Groves et al., 1992; Fan et al., 2010)
Use different messages / tone / look used at different contact points (Dillman, 2009)
Personally address survey invitations (Dillman, 2009; Fan & Yan, 2010).
Use of an illustrated questionnaire booklet cover page (Edwards, et al., 2009)
Include a token of appreciation (non-contingent incentive) with the survey request (Dillman, 2009)
Push-to web (n=662)
Mixed-mode (n=549)
Total (n=1,211)
Push-to web (n=662)
Mixed-mode (n=549)
Total (n=1,211)
Possible selection methods for address-based studies include a next / last birthday approach (Battaglia et al., 2008 and Olson, Stange & Smyth, 2014)
AES 2016 n=1,398
AES 2019 n=1,211
Prior to moving, rotate phone options to identify items affected by response recency (if you don’t already)
Consider bridging wave or waves fielded simultaneously across both modes to determine effect of measurement on individual items