IAOS 2018 - Measuring subjective well-being in national statistics: taking stock of recent OECD activities, V. Siegerink

1. Measuring subjective well-being in national statistics: taking stock of recent OECD activities Vincent Siegerink, OECD Statistics Directorate 16th Conference of IAOS 19 September, 2018

2. • Essential that official measures are collected in a consistent way to enable comparisons, both between surveys and over time • Aim to improve the quality and availability of measures of subjective well-being • Key audiences: National Statistical Offices, other data producers, and data users OECD Guidelines

3. Guidelines conceptual framework “Good mental states, including the various evaluations that people make of their lives, and the affective reactions of people to their experiences” • Life evaluations (e.g., life satisfaction) • Affect: positive (happy, content) negative (sad, anxious) • Eudaimonia (positive mental functioning; meaning and purpose in life; personal growth)  We often say “happiness” but usually mean much more

4. Core module – recommended headline measures of SWB One measure of positive affect Two measures of negative affect Life satisfaction Eudaimonia

5. Taking stock of OECD country experiences in measuring subjective well-being • Survey conducted among NSOs in 2016, with complete responses from all OECD countries + Bulgaria, Colombia, Costa Rica, Indonesia, Kazakhstan, Malaysia, Peru, Romania and the Russian Federation • Degree of heterogeneity in comprehensiveness of responses • Stocktake should be considered an illustration of existing NSO work rather than a complete and comprehensive account of all surveys that include SWB questions • Forthcoming working paper (Exton, Siegerink and Smith)

6. Stocktake methodology Key interests of the SWB stocktake: • Data availability (Data availability for Life evaluation, Eudaimonia, Affect and domain-specific evaluations) • Survey methods (Question wording, survey mode, survey timing, question order, sampling) •Data reporting (Production of statistical releases and other publications) • Methodological work conducted (Cognitive testing, split sample trials, other methodological research)

7. NSO data collections (OECD countries) One data point Recurring data collection Countries with available data points Life satisfaction 18 countries 1 country 11 countries 5 countries 29 countries 6 countries Affect 23 countries 1 country 10 countries 1 country 33 countries Eudaimonia 24 countries 6 countries 2 countries 30 countries 2 countries Data availability > Survey methods and harmonisation > Methodological work and future research *Where green refers to instances where question wording is in line with the OECD Guidelines and orange indicates that question wording deviates from the Guidelines

11. Significant consensus exists for Life Evaluation Overall, (on a scale of 0 to 10 (where 0 means not at all satisfied and 10 means completely satisfied) how satisfied are you with life as a whole these days? (OECD Recommended) Australia (2014), Austria (2014), Chile*, Denmark (2015), EU-SILC Well-Being Module (2013), France (since 2011), Hungary (2015), Italy, Mexico (2014), Netherlands* (2016), Poland (2015), Slovenia (since 2012), Switzerland (since 2007), Korea (Korea Social Integration Survey**), United Kingdom (since 2011) Using a scale of 0 to 10 where 0 means "Very dissatisfied" and 10 means "Very satisfied", how do you feel about your life as a whole right now? Canada (since 2011) Overall, how satisfied are you with your life? 1. Very satisfied; 2. Satisfied; 3. Not so satisfied; 4. Not satisfied at all Israel (since 2002) How happy do you feel at this time on a scale from 0 to 10? Zero means you feel “not at all happy” and 10 means “completely happy”. Japan (since 2007)** Looking at showcard 16, where zero is completely dissatisfied, and ten is completely satisfied, how do you feel about your life as a whole? New Zealand (since 2008) Please imagine a ladder with steps numbered from zero at the bottom to ten at the top. The top of the ladder represents the best possible life for you and the bottom of the ladder represents the worst possible life for you. If the top step is 10 and the bottom step is 0, on which step of the ladder do you feel you personally stand at the present time? United States (American Time Use Survey, 2012 and 2013) Taken all together, how would you say things are these days - would you say that you are very happy, pretty happy, or not too happy? United States** (General Social Survey, since 1972) *Chile and the Netherlands employ a 10-point response scale, ** Agency other than National Statistical Office Data availability > Survey methods and harmonisation > Methodological work and future research

15. Where do approaches differ? Affect questions The following questions ask about how you felt yesterday on a scale from 0 to 10. Zero means you did not experience the feeling “at all” yesterday while 10 means you experienced the feeling “all of the time” yesterday. I will now read out a list of ways you might have felt yesterday. -How about happy? -How about worried? -How about depressed? OECD Guidelines Overall, how happy did you feel yesterday? Overall, how anxious did you feel yesterday? (Respondents use a scale of 0 to 10, where 0 is “not at all” and 10 is “completely”) UK Annual Population Survey How often during the past four weeks have you felt one of the following? …Have been very nervous …Have felt so down in the dumps that nothing could cheer you up …Have felt calm and peaceful …Have felt down-hearted and depressed …Have been happy (1. none of the days; 2. some of the days; 3. more than half of the days; 4. all of the days) EU-SILC 2013 Well Being Module The next few questions are about how you feel and how things have been with you during the past four weeks. As I read each question, please give me the one answer that comes closest to the way you have been feeling. During the past four weeks: -how much of the time have you felt calm and peaceful? -how much of the time did you have a lot of energy? -how much of the time have you felt downhearted and depressed? (1. all of the time 2. most of the time 3. some of the time 4. a little of the time 5. none of the time) New Zealand General Social Survey 2014 Data availability > Survey methods and harmonisation > Methodological work and future research

19. Lack of consensus: Affect reference period and response scales Reference period used in affect questions Response scales used in affect questions *figures show number of surveys mentioned in the stocktake that use the specified methodological characteristics Data availability > Survey methods and harmonisation > Methodological work and future research

20. Where do approaches differ? Eudaimonia questions To what extent do you feel the things you do in your life are worthwhile? 0. Not at all worthwhile; 10. Completely worthwhile (OECD Recommended) Austria* (2013) Denmark (2015) EU-SILC Well-Being Module (2013); Hungary (2015); Japan** (2014); Netherlands* (2016); New Zealand (2014); UK ONS (since 2011) I generally feel that what I do in my life is worthwhile. Most days I get a sense of accomplishment from what I do. 0. Completely disagree; 10. Completely agree Canada General Social Survey (2014) So far, I have achieved the goals that are important to me in life. 1. Completely disagree; 2. Disagree; 3. Slightly disagree; 4. Neither agree nor disagree; 5. Slightly agree; 5. Agree; 6. Completely agree Mexico (2014) My life has a clear sense of purpose. 1. Strongly Disagree; 2. Disagree; 3. Neither agree nor disagree; 4. Agree; 5. Strongly Agree Most days I feel a sense of accomplishment from what I do. 1. Strongly Disagree; 2. Disagree; 3. Neither agree nor disagree; 4. Agree; 5. Strongly Agree In most ways my life is close to my ideal. 1. Strongly Disagree; 2. Disagree; 3. Neither agree nor disagree; 4. Agree; 5. Strongly Agree So far I have gotten the important things I want in life. 1. Strongly Disagree; 2. Disagree; 3. Neither agree nor disagree; 4. Agree; 5. Strongly Agree United States**, CDC (2012) *Austria and the Netherlands employed a different scale in these surveys **Agency other than National Statistical Office Data availability > Survey methods and harmonisation > Methodological work and future research

24. Country Survey Preceding question Belgium EU SILC For which reason did you not have a medical exam? Bulgaria EU SILC Do you use regular (daily) public transport? Canada General Social Survey As a whole, how would you describe your experience in Canada so far? (Block of domain questions) Canada General Social Survey 2012 In the past week, how many times did you participate in moderate or vigorous physical activity for leisure, work, housework or transportation? Canada Canadian Community Health Survey 2015 In general, how would you say your health is…? France Statistiques sur les Ressources et les Conditions de Vie (2013) Do you possess an internet connection at your house? (Personal finance block) France Time Use Survey (2009) How satisfied are you with your personal relationships? (This follows other domain satisfaction questions, which is preceded by a time use block) Israel Social Survey 2014 During the last twelve months, how much did you donate to charity? Italy Multipurpose survey: aspects of daily life Did you, in the last year, pay for the services of an astrologer, fortune teller, healer, or similar? Italy Time Use Survey What is your satisfaction with the balance between your work and family life? (Block of domain satisfaction questions) Latvia EU SILC Why you don’t have an access to Internet for personal use at home? (Material deprivation block) Mexico BIARE ampliado (2014) No preceding question: life evaluation question is the first question in the questionnaire Netherlands Social Cohesion and Well-being Survey (2016) To what extent do you consider yourself a fulfilled and happy person? New Zealand General Social Survey 2014 What was your total income, before tax or anything else was taken out? Poland EU SILC Do you have access to internet for personal use in your home? Portugal National Health Survey (2014) In the past 12 months, how many times did you consume more than 6 alcoholic drinks in a single night or event? UK Annual Population Survey (2015 Labour Force Survey) I will now read out a list of terms people sometimes use to describe how they think of themselves. 1. Heterosexual or Straight, 2. Gay or Lesbian, 3. Bisexual, 4. Other? UK Crime Survey for England and Wales Which of these types of vegetables do you like? 1. Carrots; 2. Peas; 3. Cabbage; 4. Broccoli; 5. Cauliflower; 6. Parsnips; 7. Swede; 8. Courgette; 9. None of these; 10. Don’t know; 11. Don’t want to answer UK Wealth and Assets Survey What is your religion? Where do approaches differ? Question order *This table shows the question preceding subjective well-being questions in a selection of surveys mentioned in the stocktake survey Data availability > Survey methods and harmonisation > Methodological work and future research

25. Where do approaches differ? Survey mode Data availability > Survey methods and harmonisation > Methodological work and future research All surveys mentioned in stocktake EU-SILC surveys only *figures show number of surveys mentioned in the stocktake that use the specified methodological characteristics

26. Key NSO methodological work since the Guidelines • Australia: overall life satisfaction question was tested for the 2014-2015 National Aboriginal and Torres Strait Islander Social Survey. • Austria: research on methodological effects, including question order, stability and sensitivity of measurement. • Denmark: cognitive testing for comprehension of 2015/2016 Quality of Life Survey • Finland: cognitive testing in preparation for the implementation of EU-SILC. A split sample was used to test answer modalities of affect variables. • Netherlands: comparative analysis of different response scales found meaningful differences between 5- and 11-point response scales but few differences between 10- and 11- point scales • UK: substantial body of methodological work partially informed Guidelines Data availability > Survey methods and harmonisation > Methodological work and future research

27. Future data needs: next steps in SWB data collection • Subjective well-being questions have proven to be successfully integrated in Household Surveys, General Social Surveys, Income/Economic Surveys as well as topical surveys on Health, Victimisation, etc. • There remains a need for panel data that includes subjective well-being questions in order to shed more light on the covariates of SWB, the direction of causality and issues of adaptation and changes in individuals over time • Measures of experienced well-being from time use surveys that allow decomposing affect scores by activity-type may prove to be a very policy- relevant use of SWB data • Big Data is a promising area to collect more data at potentially lower cost, but there are also methodological issues that demand rigorous inquiry

28. Future data needs: next steps in SWB data collection • Subjective well-being questions have proven to be successfully integrated in Household Surveys, General Social Surveys, Income/Economic Surveys as well as topical surveys on Health, Victimisation, etc. • There remains a need for panel data that includes subjective well-being questions in order to shed more light on the covariates of SWB, the direction of causality and issues of adaptation and changes in individuals over time • Measures of experienced well-being from time use surveys that allow decomposing affect scores by activity-type may prove to be a very policy- relevant use of SWB data • Big Data is a promising area to collect more data at potentially lower cost, but there are also methodological issues that demand rigorous inquiry

29. Ongoing data needs: next steps in SWB data collection • Subjective well-being questions have proven to be successfully integrated in Household Surveys, General Social Surveys, Income/Economic Surveys as well as topical surveys on Health, Victimisation, etc. • There remains a need for panel data that includes subjective well-being questions in order to shed more light on the covariates of SWB, the direction of causality and issues of adaptation and changes in individuals over time • Measures of experienced well-being from time use surveys that allow decomposing affect scores by activity-type may prove to be a very policy- relevant use of SWB data • Big Data is a promising area to collect more data at potentially lower cost, but there are also methodological issues that demand rigorous inquiry

30. Most important take-aways: What’s next!?  A lot of progress has been made and most NSOs have official data on life evaluation. A continued effort to collect this data is necessary in order to build time series and leverage policy applications  The stocktake suggests that more countries are including subjective well-being questions not just in one-off, but in regular survey vehicles  There remains a need for collecting data on all three components of subjective well- being: more data on Affect and particularly Eudaimonia is needed to complement life evaluation measures  There are unresolved issues that impede harmonisation of Affect and Eudaimonia measures: • No consensus on affect items, response scale and reference period • No consensus on the construct(s) of Eudaimonia to be measured • The OECD stands by the recommended questions suggested in the Guidelines  Other methodological differences remain (e.g. question order and survey mode)  More research requires investment in panel surveys and embedded questions in time use surveys

31. Thanks for listening! vincent.siegerink@oecd.org Link to OECD Guidelines on SWB: http://www.oecd.org/statistics/guidelines-on-measuring-subjective-well-being.htm

IAOS 2018 - Measuring subjective well-being in national statistics: taking stock of recent OECD activities, V. Siegerink

Recommended

Recommended

More Related Content

Similar to IAOS 2018 - Measuring subjective well-being in national statistics: taking stock of recent OECD activities, V. Siegerink

Similar to IAOS 2018 - Measuring subjective well-being in national statistics: taking stock of recent OECD activities, V. Siegerink (20)

More from StatsCommunications

More from StatsCommunications (20)

Recently uploaded

Recently uploaded (20)

IAOS 2018 - Measuring subjective well-being in national statistics: taking stock of recent OECD activities, V. Siegerink