Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Ben Phillips, Senior Research Director, Survey Methodology (Social Research Centre)
3. www.srcentre.com.au
Acknowledgements
Australian Bureau of Statistics
Findings based on use of ABS microdata: Australian Bureau of Statistics.
2017-18 National Health Survey. Microdata type: Detailed Microdata.
Method of Access: DataLab.
Jack Barton
Analyst, Social Research Centre
3
6. www.srcentre.com.au
Coverage error
Coverage error:
𝑌𝐶 − 𝑌 =
𝑈
𝑁
× 𝑌𝐶 − 𝑌𝑈
where
𝑌𝐶 = Mean of covered population
𝑌𝑈 = Mean of population not covered
𝑌 = Mean of entire target population
𝑈 = Size of population not covered
𝑁 = Size of target population
6
Rate of under-coverage
Difference between
covered and uncovered
units
8. www.srcentre.com.au
National Health Survey 2017-18
Questions on telephone access and whether phone number was listed
Face-to-face survey with area-probability sample
16,384 households interviewed
Excludes
Very Remote Australia (0.8% of adults)
Non-private dwellings (hotels, hospitals, nursing homes, short-stay
caravan parks)
Response rate 76.1%
8
9. www.srcentre.com.au
Cross-check with ACMA data
Percentage of adults with landline access
58.0% ACMA
57.4% NHS
Percentage of adults using mobile phone
(excluding non-telephone households)
96.0% ACMA
95.3% NHS
Mobile only
41.0% ACMA
40.6% NHS
9
13. www.srcentre.com.au
False positive rate
To improve efficiency, SamplePages pre-screens for non-working numbers
(sometimes called ‘pulsing’ or ‘pinging’):
Signalling System 7 (SS7) for landlines
Home Location Register (HLR) lookup + some dialling for mobile phones
False negative rate = 1% (working number incorrectly tagged as non-
working)
13
15. www.srcentre.com.au
Landline
RDD coverage
57.4% 99.0% 56.8%
Mobile
RDD coverage
93.4% 99.0% 92.5%
15
Single frame RDD coverage
Phone
coverage
True
positive
rate
Landline
RDD
coverage
Phone
coverage
True
positive
rate
Mobile
RDD
coverage
Mobile RDD suitable as a stand-alone frame for national general population surveys
24. www.srcentre.com.au
Questions asked
Is [your/his/her] landline number listed in the white pages?
1 Yes
2 No
6 Don’t know
[Is that mobile number/Are any of these mobile numbers] listed in the white
pages?
1 Yes
2 No
6 Don’t know
24
28. www.srcentre.com.au
Phone status by Indigenous status
59%
40%
31%
53%
5%
5%6%
2%
0%
20%
40%
60%
80%
100%
Indigenous Not Indigenous
Mobile only Dual-user Landline only No phone
*
28
* RSE > 25%
*
29. www.srcentre.com.au
Phone status by year of arrival
60%
29%
41%
37%
62%
53%
1% 7% 5%
3% 2% 2%
0%
20%
40%
60%
80%
100%
2006-18 Pre-2006 Born in Australia
Mobile only Dual-user Landline only No phone
29
*
* RSE > 25%
30. www.srcentre.com.au
Phone status by education
32%
39% 42% 46%
52%
55% 53% 51%
12%
4% 3%
2%
3%
2% 2% 2%
0%
20%
40%
60%
80%
100%
Less than Year 12 Year 12 Cert III/IV, Dip, Adv Dip Bachelor's and above
Mobile only Dual-user Landline only No phone
30
31. www.srcentre.com.au
Socio-economic indexes for areas (index of relative socio-
economic advantage)
43% 42% 43% 40%
35%
47% 50% 50% 56%
61%
7% 5% 5% 3% 4%
3% 2% 2% 1% 1%
0%
20%
40%
60%
80%
100%
1st (most
disadvantaged)
2nd 3rd 4th 5th (least
disadvantaged)
Mobile only Dual-user Landline only No phone
31
33. www.srcentre.com.au
Phone status by smoking
51%
37% 40%
43%
56% 54%
4% 5% 5%
3% 2% 2%
0%
20%
40%
60%
80%
100%
Current smoker Ex-smoker Never smoked
Mobile only Dual-user Landline only No phone
33
34. www.srcentre.com.au
Phone status by lifetime risk from alcohol
46%
40% 40% 37%
49%
56% 52%
50%
2% 3% 6%
10%
2% 2% 2% 3%
0%
20%
40%
60%
80%
100%
Exceeded
guidelines
Did not exceed
guidelines
Last consumed alcohol
1+ week ago
Never consumed
alcohol
Mobile only Dual-user Landline only No phone
34
35. www.srcentre.com.au
Phone status by short-term risk from alcohol
49%
33% 36% 37%
48%
60% 50% 50%
1% 5%
10% 10%
2% 2% 3% 3%
0%
20%
40%
60%
80%
100%
Exceeded
guidelines
Did not exceed
guidelines
Last consumed alcohol
12+ months ago
Never consumed
alcohol
Mobile only Dual-user Landline only No phone
35
37. www.srcentre.com.au
Summary
Dual-frame RDD has excellent population coverage (97.0%)
Single-frame mobile RDD has good population coverage (92.5%); only falls
below 90% for age 65 and above
Single-frame mobile RDD now viable for national general population
Landline RDD coverage is low overall (56.8%); below 50% for age 44 and
under; NT especially low (32.1%)
White Pages coverage is very low (31.2% known listed + 9.3% with
unknown listing status)
37
38. PO Box 13328
Law Courts Victoria 8010
03 9236 8500
A subsidiary of:
38
Thank you
benjamin.phillips@srcentre.com.au
Editor's Notes
Excludes Very Remote areas. 19.9% of the NT population lives in Very Remote areas.
Implications for efforts to target recent migrants; ethnic names frame issues
Implications for efforts to target recent migrants; ethnic names frame issues