3 talip kilic-gap-webinar1-4oct2016
•
0 likes•215 views
Presentation #3 of GAP Webinar held on 4 October 2016 on the topic of Closing the gender data gap for agricultural policy and investment Title: "Improving the Availability & Quality of Individual-Level, Household Survey Data on Employment, Entrepreneurship & Asset Ownership: Way Forward" Presenter: Talip Kilic, Senior Economist & Head of Survey Methods, Survey Unit, Development Data Group, The World Bank
Recommended
More Related Content
What's hot
What's hot (20)
Similar to 3 talip kilic-gap-webinar1-4oct2016
Similar to 3 talip kilic-gap-webinar1-4oct2016 (20)
More from Global Forum on Agricultural Research (GFAR)
More from Global Forum on Agricultural Research (GFAR) (14)
Recently uploaded
Recently uploaded (20)
3 talip kilic-gap-webinar1-4oct2016
- 1. Improving the Availability & Quality of Individual- Level, Household Survey Data on Employment, Entrepreneurship & Asset Ownership: Way Forward TALIP KILIC Senior Economist & Head of Survey Methods Survey Unit Development Data Group The World Bank GAP Webinar: Closing the Gender Data Gap for Agricultural Policy & Investment 04/10/2016
- 2. Background • SDG Data Agenda: Aspirations vs. reality • Acute gaps in individual data & survey methods in three dimensions of economic opportunity: Employment, Entrepreneurship, Asset Ownership • World Bank IDA18 Data Commitments under Gender & Development Theme – Support 6 countries in producing intra-household, individual-level survey data on the above priority topics, in-support of SDG Monitoring • Disconnect between current commitments & available (methodological, human & financial) resources for countries & technical assistance providers • Requirements for improving availability & quality of individual-level data – Resources for data production & technical assistance to implement recommended methods – Resources for methodological research & setting of statistical standards – Partnerships among international development partners, & between countries & technical assistance providers
- 3. • Partnership with the ILO, the FAO & Data2x initiative on the operationalization of the new employment definitions of the 19th ICLS – Radical implications for classification of women in farming – On-going methodological experiments in Ghana and Malawi overseen by the World Bank, complimenting pilots overseen by the ILO • (Today’s Focus) Partnership with the UN Evidence and Data for Gender Equality (EDGE) initiative to advance household survey methods for collecting individual-level data on asset ownership & control – Design, implementation & analysis of MEXA: Methodological Experiment on Measuring Asset Ownership from a Gender Perspective, in collaboration with Uganda Bureau of Statistics in 2014 – UN EDGE guidelines on measurement of individual ownership of & rights to assets (& entrepreneurship) to be submitted to the UN Statistical Commission in 2017 Key World Bank External Partnerships
- 4. MEXA Research Questions • How much can we improve our understanding of intra-household asset ownership/control by interviewing more than 1 household member? • Do partners provide different information about personal & each other’s asset ownership when interviewed separately vs. together? • Do individuals provide different information about personal asset ownership when asked to report only on assets they own vs. assets owned by any household member, including themselves? • Are household members hiding assets from one another that would be missed by not interviewing them in private?
- 5. Overview of MEXA Treatment Arms Arm Who? How? What? 1 “Most Knowledgeable” Household Member Alone Assets Owned Exclusively/ Jointly by Household Members 2 Randomly Selected Member of Principal Couple Alone Assets Owned Exclusively/ Jointly by Household Members 3 Principal Couple Together Assets Owned Exclusively/ Jointly by Household Members 4 Adult (18+) Household Members Alone, Simultaneous Assets Owned Exclusively/ Jointly by Household Members 5 Adult (18+) Household Members Alone, Simultaneous Assets Owned Exclusively/ Jointly by Respondent
- 6. Structure of MEXA Data Collection • Household Questionnaire: Socio-Economic Information • Individual Questionnaire: Asset-Level Information – Dwelling & Residential Land – Agricultural Land – Non-Agricultural Land & Other Real Estate – Livestock – Non-Agricultural Businesses – Agricultural Equipment – Consumer Durables – Financial Assets & Liabilities – Valuables
- 7. Scope of MEXA Asset Data Collection Type of Ownership/Rights Individual Disaggregation Reported Ownership Within-Household Identification of Individuals Outside-Household Identification of Individuals Capacity to Exercise Right Independently? Identification of Provider of Consent/Permission Economic Ownership Documented Ownership Bundle of Rights - Bequeath - Sell - Rent Out - Use as Collateral - Make Improvements/Invest
- 8. Headline MEXA Findings • #1: Both female & male adults more inclusive in their reporting on reported/economic/documented asset ownership among adults of the opposite sex in Arm 4 vis-à-vis Arm 1 – #2: Headline finding #1 is anchored in two discoveries • Positive, large & significant Arm 4 effects in priority asset classes only present in the pooled data, vanish in the analysis of the respondent data • Non-ignorable share female & male respondents in Arm 4 identified as owners/right holders by others in the same household when they report themselves without ownership/specific rights
- 9. Headline MEXA Findings (Cont’d) – #3: Questionnaire design has a bearing on respondents’ reporting regarding personal ownership of & rights to assets • Neither male nor female respondents in Arm 4 are more likely to tag themselves as owners/right holders compared to Arms 1–3 • Large gains in ownership indicators for female respondents (& to a lesser extent male respondents) in Arm 5 compared to Arms 1–4 • #4: Share of self-reported male owners with each right is substantially higher than share of self-reported female owners with that right • #5: No statistically significant effects of Arm 2, irrespective of pooled vs. respondent data analysis, priority asset class or outcome variable • #6: Arm 3 exerts statistically significant positive effects only in pooled data, on overall & joint dwelling & livestock reported ownership
- 10. Interim MEXA Recommendations • For collecting intra-household information on individuals ownership of & rights to assets: Implement Arm 5! – Reduce the reliance on a single respondent, notably the so-called most knowledgeable household member – Interview multiple age-eligible individuals per household – Probe directly & solely regarding respondents’ personal ownership of & rights to assets • Minimize distortionary proxy respondent effects & intra-household discrepancies in reporting • Reveal hidden assets • Individual interviews would alleviate distortionary proxy respondent effects more broadly: education, health, employment, food insecurity,…
- 11. How to Operationalize? • Operationalization of recommendations not out of reach given constraints shared by MEXA & other HH surveys • Key requirements: – Careful questionnaire design & piloting – Sensitization of field staff & communities – Agile, gender-balanced, mobile teams – Re-thinking fieldwork management, scheduling interviews – Enabling asset: CAPI (Survey Solutions) • Arm 5 implementation unit cost per household is 31 percent higher than the comparable figure in Arm 1, but cost cutting measures exist
- 12. Looking Forward • Malawi Fourth Integrated Household Survey (IHS4) 2016/17 is operationalizing interim MEXA recommendations – IHS4: First full-fledged LSMS Survey on CAPI (Survey Solutions) – Sample: 12,480 cross-sectional households + 2,000 panel households previously interviewed for IHPS in 2013 & 2010 – Fieldwork period: April 2016-March 2017 • April – October 2016 for the panel subcomponent – Interview max. 4 adults per household in the panel subcomponent • Modules on education, health, employment, food insecurity • Augmented MEXA Arm 5 modules on dwelling, agricultural land (following the creation of a household inventory) & financial assets – Comparative analysis of data from cross-sectional vs. panel sample
- 13. Looking Forward (Cont’d) • Progress under the EDGE Project – Pilots in Georgia, Mexico, Mongolia, Philippines, Maldives, South Africa – On-going analysis of data from 6 surveys & IHS4 – Guidelines on measurement of individual ownership of & rights to assets • Draft version to be circulated in December 2016 • Final version expected to be adopted by UNSC in March 2017 • Coming back to the… Requirements for improving availability & quality of individual-level survey data on employment, entrepreneurship & asset ownership – Resources for data production & technical assistance to implement recommended methods – Resources for methodological research & setting of statistical standards – Partnerships among international development partners, & between countries & technical assistance providers
- 14. Improving the Availability & Quality of Individual- Level, Household Survey Data on Employment, Entrepreneurship & Asset Ownership: Way Forward TALIP KILIC Senior Economist & Head of Survey Methods Survey Unit Development Data Group The World Bank GAP Webinar: Closing the Gender Data Gap for Agricultural Policy & Investment 04/10/2016
- 15. MEXA Technical Report Available on LSMS Website • MEXA Technical Report • Appendix A, Appendix B, Appendix C
Editor's Notes
- Background on EDGE: The Evidence and Data for Gender Equality (EDGE) Initiative seeks to accelerate existing efforts to generate comparable gender indicators on health, education, employment, entrepreneurship and asset ownership. This is a three-year initiative jointly executed by the United Nations Statistics Division and UN Women, in collaboration with the Asian Development Bank, the African Development Bank, the Food and Agriculture Organisation of the United Nations, the Organisation for Economic Co-operation and Development and the World Bank. The activities of the project include: (i) development of a platform for international data and metadata compilation covering basic health, education and employment indicators, (ii) development of standards and guidelines for measuring assets and entrepreneurship indicators, and (iii) piloting data collection on assets and entrepreneurship in several countries.
- The review of the survey instruments and protocols linked to the Gender Asset Gap Project, Women’s Empowerment in Agriculture Index (WEAI), Demographic and Health Surveys, and Living Standards Measurement Study – Integrated Surveys on Agriculture (LSMS-ISA) initiative was important for distilling the prominent approaches to respondent selection in household surveys across the developing world.
- Remind the audience about the definition of reported, economic and documented ownership. Note that the rights indicators are defined irrespective of permission or consent.
- Findings 1 & 2 hold true for priority asset classes of dwelling, agricultural land, livestock and financial accounts.
- #3: Remind the questionnaire design difference between Arm 1-4 versus Arm 5. #4: Note that the finding holds true for both exclusive and joint reported and economic ownership, & does not exhibit variation by priority asset class or treatment arm.
- The strength of the relative cost calculations is not only anchored in the detailed budget and paradata that are available to us but also feeds off of the MEXA design in the sense that there was a sample of households in each EA that was subject to each of the five survey treatments, and that the field teams were instructed to cover all households in a given EA within a rather inflexible timeline. The latter practice mirrors the approach to other multi-topic household surveys in Uganda that would be candidates for the operationalization of the recommendations. Critical to the calculations of implementation unit costs is the calculation of the augmented total burden for each treatment arm, which takes into account (1) the sum of all household and individual interview durations in each treatment arm, (2) the average within-EA day spread between the start and end of all interviews associated with the households sampled for a specific treatment arm, and (3) the treatment arm specific percentage shortfall in the number of households with respect to the non-response adjusted expectations prior to the start of the fieldwork. The second adjustment is meant to capture the within-EA, across-arm heterogeneity in the effort exerted by the enumerators to schedule the necessary household and individual interviews within the more or less fixed timeline that each team was given to cover each EA in order to complete the MEXA fieldwork in time for the 2014 National Population and Housing Census. The third adjustment recognizes the across-arm heterogeneity in the “sunk costs” associated with the time spent with the non-responding households during the enumerators’ unsuccessful attempts to sensitize them and secure their participation in the survey. Cost cutting measures: 1 - Creation of a household inventory of assets, as opposed to independent inventories that are created by each interviewee. 2- Limiting the focus of the work to the priority assets that are covered as part of the MEXA analysis (i.e. shortening the questionnaire.