The document summarizes research and testing conducted on the ethnic group question for the 2021 UK Census. It discusses: 1) The need to review the ethnic group question design and response options based on feedback from data users and testing. 2) Qualitative and quantitative testing conducted in 2016-2017 on the existing 2011 question and alternative designs. The 2011 two-stage question performed better. 3) Requests for additional ethnic group response options were evaluated based on user need, data quality criteria. Seven options were identified as having the strongest need but the question will maintain the 2011 response options due to space and harmonization considerations.

1. Ethnic group
1

2. Aim of presentation
• To up-date you on ethnic group question research
and testing carried out since the Topic
Consultation
• To give our current assessment of the 2021
question design
• To inform you of our next steps
2

3. 3
2021 Census Topic Consultation – ethnic group
• Strong user need for information on ethnic group
• Information is used in a variety of ways by different data
users
• These include resource allocation and service planning
decisions and meeting obligations under the Equality Act
2010
Our next steps included:
• Review of the ethnic group response options alongside
the national identity and religion response options
• Review of the presentation of the 2011 ethnic group
question online

4. 4
Purpose of ethnic group research and testing
• Seeking to collect the same concept (not a complete
refresh of the question)
• Review the way we collect and maximise opportunity of
online questionnaire - target is 75% returns online
• Aim to balance requests for new information with:
 the need for information to be comparable across time
 the need for information to be comparable to other data
collection operations across government
 space and respondent burden considerations

5. Ethnic group question development for 2021
Census
Two strands of work:
Review of
the question
design
Evaluate
requests for
additional
response
options
5

6. Ethnic group question development for 2021
Census
Two strands of work:
Review of
the question
design
Evaluate
requests for
additional
response
options
6

7. • Increasing use of online completion
• The Topic Consultation and focus groups
showed interest from data users for additional
response options in the ethnic group question
However:
• There is not room on the census questionnaire
to enable tick-boxes to be included for all
groups
Reasons to review question design
7

8. Testing phases
Census questionnaire testing
• 2016 census research (qualitative)
• 2017 Census Test (quantitative)
Dedicated ethnic group question testing
• 2016 ethnic group question test (qualitative)
• 2017 ethnic group question test (quantitative)
8

9. Testing: 2016 census
research
9
• Qualitative testing 2011 Census
online questionnaire on mobile
devices
• Response options displayed in
one column
• The amount of scrolling needed
negatively impacted on usability
Outcome: develop 2011 two stage
version of the question

10. 10
2011 two stage question – first stage

11. 11
2011 two stage question – second stage
Used in further testing:
• 2016 ethnic group
question test
(qualitative)
• 2017 ethnic group
question test
(quantitative)
• 2017 Census Test

12. Testing: 2016 ethnic group question test
Method: Qualitative interviews with 35 respondents
Sample: Range of ethnic groups covering various life stages
Questions explored:
• 2011 style two stage question
• alternative question – design one
• alternative question – design two
12

13. Alternative question - design one
13
Findings:
• difficult to answer
• varying data collected
• loss of information on high level ethnic group
Outcome: stop development

14. 14
Alternative question - design two

15. 15
Alternative question - design two

16. Alternative question - design two
16
Findings:
• ease of completion using tick-box at first stage
• self-expression at second stage preferred by
some respondents
• most able to self-identify
• some unsure how to answer at second stage
Outcome: carry out further testing of
alternative question design two

17. 17
Testing: 2017 ethnic group question test
Method: Quantitative parallel test, postal mail out with
access code for online survey completion
Sample: Random selection from two ethnically diverse
local authority areas, 40,000 survey invites sent out in
total
Questions tested:
Test 1 – 2011 two stage question
Test 2 – alternative question design 2
Test 3 – 2011 two stage question with additional response
option (‘Sikh’)

18. 18
Hounslow Wolverhampton
Test 1
(2011
two stage
question)
Test 2
(alternative
two stage
question)
Test 1
(2011 two
stage
question)
Test 2
(alternative two
stage question)
Total responses 1080 1053 740 741
% of respondents
answering the first stage of
the question
100% 100% 100% 100%
Second stage of question
% of respondents
answering the ‘White’
follow up question
100% 90% 100% 93%
% of respondents
answering the ‘Mixed’
follow up question
100% 94% 100% 91%
% of respondents
answering the ‘Asian’
follow up question
100% 96% 100% 93%
% of respondents
answering the ‘Black’ follow
up question
100% 93% 100% 100%
% of respondents
answering the ‘Other’
follow up question
100% 98% 100% 92%
Response rates
First stage:
both question designs
completed by 100% of
respondents
Second stage:
statistically significant
difference in item non-
response between
question designs
Findings: 2017 ethnic group question test
Response rates to question designs

19. 19
Findings: 2017 ethnic group question test
Completion time

20. • Use of alternative question design had significant
negative impact on response to the second stage
of the question
• Length of time to complete alternative design
found to be longer than the other designs
Outcome: stop development of the alternative
question and focus on the 2011 two stage
question
20
Overall findings: 2017 ethnic group question
test

21. Ethnic group question development for 2021
Census
Two strands of work:
Review of
the question
design
Evaluate
requests for
additional
response
options
21

22. Evaluate requests for additional response options
• Requests for additional response options
received in Topic Consultation
• Carried out ethnic group stakeholder follow-
up survey
• Requests evaluated using similar approach to
requests made for 2011 Census
22

23. Evaluation themes and principles
23
Evaluation Criteria Source
Strength of user need
Equality monitoring and policy development
Resource allocation and service delivery
• 2021 Census Topic Consultation
(summer 2015)
• Ethnic group stakeholder survey
(winter 2016)
Lack of alternative sources
Write in answers are not adequate for measuring this
group
Other census information can meet the need (for
example country of birth or religion)
• Ethnic group stakeholder survey
(winter 2016)
• 2011 Census data
• 2017 ethnic group question test
Data Quality • 2011 Census results
• 2017 ethnic group question test
Comparability • Ethnic group stakeholder survey
(winter 2016)
• 2011 Census results
• 2017 ethnic group question test

24. Requests for additional response options
• 44 organisations and 84 individuals responded to ethnic group
stakeholder follow-up survey
• 55 additional ethnic group response options were requested
• 7 requests with the strongest need against ‘strength of user need’
criteria are:
• Gypsy
• Irish Traveller
• Jewish
• Korean
• Roma
• Sikh
• Somali
• Overall scores are being finalised and will be reported in Autumn/
Winter 2017
24

25. Requests for additional response options –
current assessment
Based on our early considerations of:
• evaluation of requests (strength of used need, lack of
alternative sources, data quality and comparability)
• space considerations and strength of user need for new
topics
• impact on harmonisation
current assessment is to maintain the response options used
in the 2011 question in the 2021 Census

26. Summary
• Maintain the 2011 question design for the
2021 Census:
 2011 question design on paper
 2011 two stage question for online
• Maintain the response options used in the
2011 question
26

27. Next steps
• Finalise analysis of evidence and publish findings ahead of
question recommendation in 2018 White Paper
• Refine online question – including possible search-as-you-
type list for write-in response options
• Work with other government departments to improve
harmonisation of ethnic group and religion questions
• Work with partners to encourage participation and maximise
response in the 2021 Census
• Work with stakeholders to develop output products that best
meet needs and maximise benefit

28. Questions?
28