Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Ethnic group

631 views

Published on

Slides from 2017 Census Roadshow

Published in: Government & Nonprofit
  • Be the first to comment

  • Be the first to like this

Ethnic group

  1. 1. Ethnic group 1
  2. 2. Aim of presentation • To up-date you on ethnic group question research and testing carried out since the Topic Consultation • To give our current assessment of the 2021 question design • To inform you of our next steps 2
  3. 3. 3 2021 Census Topic Consultation – ethnic group • Strong user need for information on ethnic group • Information is used in a variety of ways by different data users • These include resource allocation and service planning decisions and meeting obligations under the Equality Act 2010 Our next steps included: • Review of the ethnic group response options alongside the national identity and religion response options • Review of the presentation of the 2011 ethnic group question online
  4. 4. 4 Purpose of ethnic group research and testing • Seeking to collect the same concept (not a complete refresh of the question) • Review the way we collect and maximise opportunity of online questionnaire - target is 75% returns online • Aim to balance requests for new information with:  the need for information to be comparable across time  the need for information to be comparable to other data collection operations across government  space and respondent burden considerations
  5. 5. Ethnic group question development for 2021 Census Two strands of work: Review of the question design Evaluate requests for additional response options 5
  6. 6. Ethnic group question development for 2021 Census Two strands of work: Review of the question design Evaluate requests for additional response options 6
  7. 7. • Increasing use of online completion • The Topic Consultation and focus groups showed interest from data users for additional response options in the ethnic group question However: • There is not room on the census questionnaire to enable tick-boxes to be included for all groups Reasons to review question design 7
  8. 8. Testing phases Census questionnaire testing • 2016 census research (qualitative) • 2017 Census Test (quantitative) Dedicated ethnic group question testing • 2016 ethnic group question test (qualitative) • 2017 ethnic group question test (quantitative) 8
  9. 9. Testing: 2016 census research 9 • Qualitative testing 2011 Census online questionnaire on mobile devices • Response options displayed in one column • The amount of scrolling needed negatively impacted on usability Outcome: develop 2011 two stage version of the question
  10. 10. 10 2011 two stage question – first stage
  11. 11. 11 2011 two stage question – second stage Used in further testing: • 2016 ethnic group question test (qualitative) • 2017 ethnic group question test (quantitative) • 2017 Census Test
  12. 12. Testing: 2016 ethnic group question test Method: Qualitative interviews with 35 respondents Sample: Range of ethnic groups covering various life stages Questions explored: • 2011 style two stage question • alternative question – design one • alternative question – design two 12
  13. 13. Alternative question - design one 13 Findings: • difficult to answer • varying data collected • loss of information on high level ethnic group Outcome: stop development
  14. 14. 14 Alternative question - design two
  15. 15. 15 Alternative question - design two
  16. 16. Alternative question - design two 16 Findings: • ease of completion using tick-box at first stage • self-expression at second stage preferred by some respondents • most able to self-identify • some unsure how to answer at second stage Outcome: carry out further testing of alternative question design two
  17. 17. 17 Testing: 2017 ethnic group question test Method: Quantitative parallel test, postal mail out with access code for online survey completion Sample: Random selection from two ethnically diverse local authority areas, 40,000 survey invites sent out in total Questions tested: Test 1 – 2011 two stage question Test 2 – alternative question design 2 Test 3 – 2011 two stage question with additional response option (‘Sikh’)
  18. 18. 18 Hounslow Wolverhampton Test 1 (2011 two stage question) Test 2 (alternative two stage question) Test 1 (2011 two stage question) Test 2 (alternative two stage question) Total responses 1080 1053 740 741 % of respondents answering the first stage of the question 100% 100% 100% 100% Second stage of question % of respondents answering the ‘White’ follow up question 100% 90% 100% 93% % of respondents answering the ‘Mixed’ follow up question 100% 94% 100% 91% % of respondents answering the ‘Asian’ follow up question 100% 96% 100% 93% % of respondents answering the ‘Black’ follow up question 100% 93% 100% 100% % of respondents answering the ‘Other’ follow up question 100% 98% 100% 92% Response rates First stage: both question designs completed by 100% of respondents Second stage: statistically significant difference in item non- response between question designs Findings: 2017 ethnic group question test Response rates to question designs
  19. 19. 19 Findings: 2017 ethnic group question test Completion time
  20. 20. • Use of alternative question design had significant negative impact on response to the second stage of the question • Length of time to complete alternative design found to be longer than the other designs Outcome: stop development of the alternative question and focus on the 2011 two stage question 20 Overall findings: 2017 ethnic group question test
  21. 21. Ethnic group question development for 2021 Census Two strands of work: Review of the question design Evaluate requests for additional response options 21
  22. 22. Evaluate requests for additional response options • Requests for additional response options received in Topic Consultation • Carried out ethnic group stakeholder follow- up survey • Requests evaluated using similar approach to requests made for 2011 Census 22
  23. 23. Evaluation themes and principles 23 Evaluation Criteria Source Strength of user need Equality monitoring and policy development Resource allocation and service delivery • 2021 Census Topic Consultation (summer 2015) • Ethnic group stakeholder survey (winter 2016) Lack of alternative sources Write in answers are not adequate for measuring this group Other census information can meet the need (for example country of birth or religion) • Ethnic group stakeholder survey (winter 2016) • 2011 Census data • 2017 ethnic group question test Data Quality • 2011 Census results • 2017 ethnic group question test Comparability • Ethnic group stakeholder survey (winter 2016) • 2011 Census results • 2017 ethnic group question test
  24. 24. Requests for additional response options • 44 organisations and 84 individuals responded to ethnic group stakeholder follow-up survey • 55 additional ethnic group response options were requested • 7 requests with the strongest need against ‘strength of user need’ criteria are: • Gypsy • Irish Traveller • Jewish • Korean • Roma • Sikh • Somali • Overall scores are being finalised and will be reported in Autumn/ Winter 2017 24
  25. 25. Requests for additional response options – current assessment Based on our early considerations of: • evaluation of requests (strength of used need, lack of alternative sources, data quality and comparability) • space considerations and strength of user need for new topics • impact on harmonisation current assessment is to maintain the response options used in the 2011 question in the 2021 Census
  26. 26. Summary • Maintain the 2011 question design for the 2021 Census:  2011 question design on paper  2011 two stage question for online • Maintain the response options used in the 2011 question 26
  27. 27. Next steps • Finalise analysis of evidence and publish findings ahead of question recommendation in 2018 White Paper • Refine online question – including possible search-as-you- type list for write-in response options • Work with other government departments to improve harmonisation of ethnic group and religion questions • Work with partners to encourage participation and maximise response in the 2021 Census • Work with stakeholders to develop output products that best meet needs and maximise benefit
  28. 28. Questions? 28

×