This document describes two randomized controlled trial experiments being conducted by the Centre for Insurance and Risk Management (CIRM) in India to evaluate the impact of health microinsurance and related interventions.
The first examines an intervention by Calcutta Kids providing outpatient counseling services along with inpatient health insurance to increase renewal rates. The second examines an intervention by CARE Foundation providing outpatient counseling services to improve health outcomes. Both studies use RCT methodology to rigorously evaluate the impact of the interventions on key indicators like renewal rates, health expenditures, and client value. The results will help inform product design and policy to strengthen health microinsurance.
In de presentatie word kort uitgelegd hoe je aan de hand van enkele simpele tips tijdens de ontwikkeling van een nieuwe website rekening kan houden met toegankelijkheid.
In deze presentatie leggen Tom Claus en Stijn Janssen uit hoe dat je jezelf transformeert van luie nerd tot actieve runner. We vertellen ons verhaal hoe we trainen voor een marathon en hoe wij (en jij dus ook!) ons motiveren om elke keer opnieuw te gaan lopen met behulp van onze smartphone.
Supporting Collaboration and Harnessing of OER Within the Policy Framework of...Saide OER Africa
Supporting Collaboration and Harnessing of OER Within the Policy Framework of KNUST: Report Prepared by OER Africa on Behalf of the Kwame Nkrumah University of Science and Technology (KNUST). As part of a broader process of stimulating collaboration amongst distance education providers taking place under the auspices of the African Council on Distance Education’s Technical Committee on Collaboration, OER Africa and the Kwame Nkrumah University of Science and Technology (KNUST) signed a Memorandum of Understanding that has established a framework for a joint programme of action. Accordingly, OER Africa is providing support to KNUST in review of its current policies to assess the extent to which they facilitate collaboration and alternative, open licences for its educational materials.
Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...Saide OER Africa
The review was to be based on a study of relevant documents, interviews with academic staff involved in institutional policy making and OER production, interviews with students who had experienced OERs (in cases where this was possible). The evaluation approach was not intended to be judgemental, but rather to explore experiences (on progress, achievements and blockages) thus far. Respondents were to be invited to look back in a way that provided experiences as a basis for identifying issues relevant to further project development. Broad approval of the Evaluation Brief was received together with valuable guidance in respect of the conduct of the review, particularly in relation to institution-specific circumstances.
In de presentatie word kort uitgelegd hoe je aan de hand van enkele simpele tips tijdens de ontwikkeling van een nieuwe website rekening kan houden met toegankelijkheid.
In deze presentatie leggen Tom Claus en Stijn Janssen uit hoe dat je jezelf transformeert van luie nerd tot actieve runner. We vertellen ons verhaal hoe we trainen voor een marathon en hoe wij (en jij dus ook!) ons motiveren om elke keer opnieuw te gaan lopen met behulp van onze smartphone.
Supporting Collaboration and Harnessing of OER Within the Policy Framework of...Saide OER Africa
Supporting Collaboration and Harnessing of OER Within the Policy Framework of KNUST: Report Prepared by OER Africa on Behalf of the Kwame Nkrumah University of Science and Technology (KNUST). As part of a broader process of stimulating collaboration amongst distance education providers taking place under the auspices of the African Council on Distance Education’s Technical Committee on Collaboration, OER Africa and the Kwame Nkrumah University of Science and Technology (KNUST) signed a Memorandum of Understanding that has established a framework for a joint programme of action. Accordingly, OER Africa is providing support to KNUST in review of its current policies to assess the extent to which they facilitate collaboration and alternative, open licences for its educational materials.
Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...Saide OER Africa
The review was to be based on a study of relevant documents, interviews with academic staff involved in institutional policy making and OER production, interviews with students who had experienced OERs (in cases where this was possible). The evaluation approach was not intended to be judgemental, but rather to explore experiences (on progress, achievements and blockages) thus far. Respondents were to be invited to look back in a way that provided experiences as a basis for identifying issues relevant to further project development. Broad approval of the Evaluation Brief was received together with valuable guidance in respect of the conduct of the review, particularly in relation to institution-specific circumstances.
SCALING UP PRIMARY CARE TO IMPROVE HEALTH IN LOW AND MIDDLE INCOME COUNTRIES- ICSF & University of Toronto
Listed Programs are using technology to connect patients (especially those in rural areas) with physicians located elsewhere. World Health Partners connects patients at their franchised providers in rural India with doctors at the Central Medical Facility in larger cities like Delhi and Patna using a video link supported by mobile phone, computer and Internet technology, and remote diagnostic tools designed by Neurosynaptic. Health hotlines are also being
used to connect patients and providers efficiently and affordably, facilitating teletriage, where hotline doctors can let patients know if further investigation is needed and connect them with a static clinic, local labs and pharmacies, if necessary. Mediphone is a health
hotline in India that allows clients to speak to doctors from a private hospital chain who can provide health information and prescriptions via SMS or email.
WHO reports recommend lifestyle changes to prevent millions of cancer deathsΔρ. Γιώργος K. Κασάπης
a new WHO report outline steps to avert a rise in cancer deaths in low- and middle-income countries. If current trends continue, these countries could see an 80% increase in the number of cancer cases over 20 years, the agency says. The majority of cancer deaths are now due to lifestyle factors such as tobacco use - which is responsible for about a quarter of all cancer deaths. As such, the WHO’s recommendations focus on scaling up programs for tobacco cessation, alcohol prevention, wider access to healthy foods, and physical activity.
Health Coaching Motivational Interviewing Proficiency Assessmentmkgreco
Overview and validation study of the Health Coaching Performance (HCPA) assessment and reporting tool and system for benchmarking the proficiency of health care professionals in motivational interviewing and evidence-based health coaching.
Comprehensive Multi-year Plan - Universal Immunization Program -
In India Universal Immunization Program - (UIP) is bring forward by the Government, UIP ( Universal Immunization Program) in India is among the most successful vaccination program and cost-effective public health interventions.
Routine Immunization Program in India, Immunization Technical Support, routine immunization services in India, Ministry of Health and Family Welfare, Adverse Event Following Immunization Secretariat, Vaccine logistics and supply chain,Universal Immunization Program in India
Fill-us-in: Information Asymmetry, Signals and The Role of Updates in Crowdfu...CamWebby
In this empirical study, I examine the role of updates for projects listed on crowdfunding platform (CFP), Kickstarter.com. Using a novel dataset and fixed-effects (FE) regression, I corroborate existing research that updates do encourage future project support. Extant research uses this stylised fact to help support the hypothesis that funders are responding to signals of quality (Mollick, 2014). However, results from this study suggest that funders discriminate negatively on the objectivity of updates - a measure of update quality. Further analysis also reveals that updates mask a day-of-the-week effect that has been previously demonstrated (Vismara, 2018). This paper finds evidence that updates may mitigate reduced support experienced by projects on weekends. Limitations and implications to CFPs and fundraisers are also discussed.
Rashtriya Swasthya Bima Yojana – Performance Trends and Policy RecommendationsCIRM
India is characterized by modest health indicators, a paucity of medical financing schemes that have reached scale, high per capita out-of-pocket health expenditure, and very low public health spending on low-income citizens. The lack of financing options especially when the population is facing a double burden of disease (frequent communicable and catastrophic lifestyle diseases) leads to poor health outcomes and to poverty traps. Hence, optimal public health financing is important for improving national health outcomes and reducing vulnerability.
Promoting adaptation through information: Flood insurance and weather insuranceCIRM
Mr Arindom Baidya, Agricultural Analyst at the Centre for Insurance and Risk Management presented on Promoting adaptation through information; flood insurance and weather insurance at the Financial Instruments for Climate Change Adaptation seminar on May 16th 2011.
Delivering micro health insurance through national rural health missionCIRM
The Indian health scenario is fairly complex and challenging with successful reductions in fertility and mortality offset by a significant and growing communicable as well noncommunicable disease burden, persistently high levels of child under-nutrition, increasing polarisation in the health status of the rich and the poor and inadequate primary health care coexisting with burgeoning medical tourism. This situation is further complicated by the presence and practice of multiple systems of medicine and medical practitioners (several of whom are not formally certified and recognised) and very limited regulation.
In this context, this paper highlights the challenges in financing health in India and examines the role of health insurance in addressing these. It proposes a workable model for developing sustainable health insurance models under the National Rural Health Mission, responding to the contextual needs of different states.
Kagad kach patra kashtkari panchayat health insurance schemeCIRM
The case study highlights the scheme Kagad Kach Patra Kashtkari Panchayat (Waste Pickers. Union) health insurance scheme which proved to be a step in the right direction to a social security measure by the State for the workers of the unorganized sector in the country who are exposed to health risks due to their occupation. The study was documented by Centre for Insurance and Risk Management on behalf of the International Labour Organisation (ILO) as an example of a 'best practice' in the sector for micro health insurance in India . The study involved informal meetings, formal interviews and other form of interactions with all the stakeholders involved with the insurance programme. The case study tries to bring out the uniqueness of the scheme, the rationale behind its genesis, the practical constraints faced by each stakeholder and also the needs of the beneficiaries. The case study has also tried to capture the overarching vision of the trade union of the waste pickers in making their views heard to the Government and civic authorities in their constant endeavour to lead their lives in dignity and self respect.
Health microinsurance experience of grameen kootaCIRM
Grameen Koota (GK) operates as a division of the Grameen Financial Sevices. Pvt. Ltd. (GFSPL), a Non Banking Financial Company (NBFC) based out of Bangalore, India, offering microfinance services to the poor using the Grameen model. Over the years, Grameen Koota (GK) has moved beyond microcredit lending to offer insurance services to its clients. This paper documents its journey in health microinsurance and draws learnings from its experience.
Health ecosystem achieving impact in community health through public private ...CIRM
This paper discusses how the failure of the public and the private healthcare systems has affected the poor. It also tries to explore the possibility of a financial mechanism like insurance and how it can bring about (from experiences drawn from other countries) the much needed health systems reform. This overall theme is known as the Health ecosystem Concept. This concept visualizes public health system beyond the realm of preventive/promotive care and explores newer avenues for Public-Private Partnership for curative care. In this document, insurance is visualized as not only paying for the curative care of the community but also tries to overcome the systemic errors in the current set up by improving infrastructure, providing incentives for man power and bringing about overall accountability into the system. It also suggests the use of technology to integrate and bring about efficiency in the entire health system and generate essential data in the process for evidence based action.
Government run crop yield insurance scheme, procurement at minimum support prices and calamity relief funds are the major instruments being used to protect the Indian farmer from agricultural variability. However, crop insurance covers only about 10% of sown area and suffers from an adverse claims to premium. There are problems with both the design and delivery of crop insurance schemes. These problems could be overcome with rainfall insurance with a well developed rainfall measurement infrastructure. Private and public insurers are currently experimenting with rainfall insurance products. Given the current levels of yield and rainfall variability the actuarially fair premium rates are likely to be high and in many cases unattractive or unaffordable. Instead of adopting the easy and unsustainable route of large subsidies, in the long term the government should consider risk mitigation through improvements in the irrigation and water management infrastructure.
This chapter therefore analyses the role of weather derivatives in mitigating the weather risks the Indian economy is exposed to. Potential prominent players and market projections are also estimated. With the Indian regulators on the verge of authorising weather derivative trading in the exchanges at the time of writing, the country is on the way to developing, deepening and strengthening its weather risk management framework.
Review of the current state of world capture fisheries insuranceCIRM
The FAO Fisheries and Aquaculture Department decided to carry out this world review in recognition of the opportunities fisheries insurance services can offer to the sustainable development of capture fisheries in the developing countries. The review covers the following regions and countries: Asia (China, Japan, India), Africa (Mauritania, Morocco, Namibia, South Africa, ), Europe, the Russian Federation, the United States of America, South America (Peru, Chile) and Oceania (New Zealand, Australia).
Livestock insurance lessons from the indian experienceCIRM
The study began with an objective to develop a deeper understanding of livestock insurance sector challenges and to identify potential solutions to enable the growth and proliferation of livestock insurance in developing countries. As India is one of the largest markets for livestock insurance, and one where livestock insurance products have been in existence for the past many years, it was worth understanding the Indian livestock insurance market and learn from it about the various challenges faced, so that those challenges could be addressed efficiently in future in India and other developing markets. The study includes multiple dimensions, such as: understanding the Indian livestock insurance industry, challenges faced by insurers in massification of livestock insurance and various delivery channels presently in vogue in India. It also includes understanding the performance of livestock insurance products and the impact of various policy efforts by the Indian insurance regulator. The idea is to suggest possible catalysts necessary to ensure higher uptake of livestock insurance space. The study is targeted to benefit national and international livestock insurers, brokers, academia and aggregators like cattle cooperatives, MFIs, NGOs and dairies.
Climate based agricultural insurance experiences from India
impact_evaluation_of_hmi_through_rct
1. Impact Evaluation of Health Micro Insurance
Through Randomized Controlled Trials
Two interventions targeting renewal rates & health outcomes
Tilak Mukhopahyay1 and Akhil S. Behl2
Centre for Insurance & Risk Management, IFMR
Key words: Health micro insurance, Randomized Controlled Trial Experi-
ment, impact evaluation, Out-patient counselling service, Instrumental vari-
able, voucher based randomization, out-of-pocket health expenditure, commu-
nity health worker, low income households, health financing, risk transfer mech-
anism and renewal rate.
JEL Codes: C52, G22, I10
1 Consultant Researcher, Centre for Insurance & Risk Managementat IFMR, Chennai, In-
dia.
2 Analyst, Centre for Insurance & Risk Managementat IFMR, Chennai, India.
2. Abstract
Use of Randomized Controlled Trial methodology for assessing the
impact of health micro insurance on low income households is not com-
mon in the space of health micro insurance research. This paper details
the research methodology of using RCTs which the Centre for Insurance
and Risk Management (CIRM, India) has adopted, as the action research
partner, in two health micro insurance projects in two states of India.
The paper discusses the rationale and the need for randomized controlled
trials to assess the impact of the health micro insurance and allied ser-
vices on chosen indicators in the subject population. This paper explores
the theoretical nuances of the research methodology, and lists the out-
comes expected from the interventions based on the current status of the
projects.
3. Acknowledgements
The authors are extremely grateful to Dr. David Canning & Dr. Ajay Mahal
(Harvard School of Public Health) and to Dr. Clara Delavallade (University of
Cape Town, South Africa) for their invaluable suggestions and comments on the
CARE project, and for designing the research plan for the Calcutta Kids project
respectively. The authors express sincere gratitude to Ms. Rupalee Ruchismita
(Executive director, CIRM) and colleagues at CIRM for their encouragement
and support. Also, the authors extend their best wishes to the implementation
partners - CARE Foundation and Calcutta Kids.
Above all, the authors are indebted to, and wish well the inhabitants of the
command area of the CARE project in Yavatmal, and that of the Calcutta Kids
project in Fakir Bagan, Kolkata.
4. List of Abbreviations
BPL Below Poverty Line
CARE CArdiac Research and Education
CHW Community Health Worker
CK Calcutta Kids
FGD Focussed Group Discussions
HMI Health micro insurance
MIS Management Information System
MYCHI Mother and Young Child Health Initiatives
NGO Non-Governmental Organization
OOP Out Of Pocket (payment)
OPCS Out-Patient Counselling Service
RCT Randomized Controlled Trial
VHC Village Health Champions
6. 1 Introduction
Health micro insurance (HMI) is a comparatively new phenomenon compared
to micro finance, in India as well as the rest of the world. The literature on
micro insurance, therefore, comprises of a variety of case studies, process eval-
uations and theoretical expositions on clients’ behaviour, but not rigorously
obtained experimental results. While the use of randomized controlled trials to
evaluate impact is quite common in the space of micro finance, there are not
enough attempts to study the impact of micro insurance on behavioural and
other outcomes through RCT experiments. Also, eclipsing other experimental
techniques, RCTs have lately become a de facto ‘gold standard’ in evaluating
the impact of policies and in generating more informed advocacy in decision
making at the policy level.
As a part of its broader mandate, ‘safety nets for all’, CIRM believes in innovat-
ing and exploring novel methods and interventions to develop sustainable risk-
transfer mechanisms for low income households. The health research team at
CIRM is currently engaged in various innovative health micro insurance projects
in different parts of India. These projects aim to address pertinent sector level
questions in the global micro insurance space, and try to find solutions for var-
ious bottlenecks in both the demand and supply side of the industry.
In the two projects, research methodologies of which are being detailed in this
paper, CIRM has brought in the practice of rigorous impact evaluation through
RCTs. The evaluations are aimed at validating the hypotheses based on which
the interventions were designed. The results from these experiments will be used
to inform advocacy and reforms in product design, innovation, policy making
and regulation in the sector.
2 Literature on the RCT methodology
Randomized controlled trial technique is now extremely popular among re-
searchers all over the world for evaluating the impact of an intervention. Re-
searchers like Dr. Abhijit Banerjee, Dr. Esther Duflo, Dr. Rachel Glennerster
and others at the Jameel Poverty Action Lab at MIT have played a major
role in popularizing this technique. Previous papers on impact evaluations by
Duflo, Glennerster & Kremer [2006], evaluation of education policy (Balasakhi
programme, India) by Banerjee, Cole, Duflo & Linden [2005], and impact evalu-
ation of treatment externalities on health and education by Miguel and Kremer
[2004] paved the way for a robust understanding of the process of evaluation of
any kind of intervention targeting the improvement of public health or education
7. systems. Randomized controlled trial methodology has also been successfully
used to assess behavioural changes in employees when they are exposed to an
intervention like financial education as reported by Bayer, Bernheim & Scholz,
[1996]. Another interesting work on the effects of education, financial literacy
and cognitive ability on financial market participation uses RCT as a tool to
assess the impact of the interventions on the behaviour of human subjects (Cole
and Shastry, [2009]). The use of RCT methodology to assess the behavioural
changes of human subjects is now recognized as a successful technique in re-
search on development economics.
However, there have been few attempts, and none in India, to assess the impact
of HMI and related add on services on the behaviour of the target population.
Since India is considered an incubator for micro insurance initiatives, the im-
pact assessment of health micro insurance programs become important from the
perspective of various stakeholders in the HMI sector across the world.
Part I
Calcutta Kids
Enhancing and sustaining HMI through
out-patient counselling
3 Brief Description of the Project
Calcutta Kids (CK) is a Non-Governmental Organization (NGO) with the man-
date of making quality health care affordable and accessible to all through use
of well trained Community Health Workers (CHW) trained by CK.
3.1 Hypothesis & Rationale of the Project
Hypothesis: Creation of demand and value for HMI among clients
It has been observed that one of the major challenges for health micro insurance
programmes is the low renewal/retention rate. The wisdom in the sector is that
one of the prime causes driving this behaviour is the lack of understanding
of the nature and importance of insurance. It is surmised that non-claimants
do not see much value in a health insurance product due to not receiving any
service against the payment of premiums. Therefore it is assumed, that giving
8. an add-on service such as outpatient counselling along with the inpatient health
insurance will change the behaviour of the clients, as it may create more value
for the health micro insurance product from the client’s perspective.
3.2 Description of the Command Area
Fakir Bagan in Salkia, Howrah, is one of the largest slums in the East In-
dian state of West Bengal. Calcutta Kids started its intervention in Fakir
Bagan through their Maternal and Young Child Health Initiatives (MYCHI)
programme in 2005. The programme had a significant impact in reducing
malnutrition and maternal mortality, through counselling and monitoring the
progress and health parameters of a mother during pre and post natal phases.
These community level interventions are carried out by the Community Health
Workers (CHWs) trained by CK.
3.3 The Intervention
Calcutta Kids started a HMI scheme providing in-patient healthcare in its catch-
ment area in March 2009. The scheme also provided Out-Patient Counselling
Services [OPCS] to increase renewal rates for the HMI scheme. Through this
service, insurance clients that access outpatient care at a network facility will
be visited in their home by a health worker of Calcutta Kids two days after
consultation. The health worker will:
› Ensure that the client is following the doctor’s prescription.
› Provide simple behavioural advice to the client regarding treatment.
› Record the client’s health status, and present this information to a doctor
who will advise on follow-up options.
4 Learning agenda & Research Methodology
4.1 Learning Agenda
The project has received an innovation grant from the micro insurance Inno-
vation Facility (MIF) of the International Labour Organization (ILO). The re-
search questions, therefore, have been framed by aligning the learning objectives
of the multiple partners with the need for research in the sector. The research
questions are as follows:
9. 1. What is the effect of the OPCS on client retention (renewal rate)?
2. What is the effect of the OPCS on the claims expense?
3. Why, and how much do clients value the OPCS?
4. Why, and how much do clients value the insurance product as a whole?
5. Is the OPCS self-financing? Can it cross-subsidise the insurance premium,
either in this scheme or elsewhere?
4.2 Research Methodology
4.2.1 Rationale for RCT Methodology
As the key question of this project is to evaluate the impact of an add-on ser-
vice (OPCS) for an inpatient scheme on client behaviour, it becomes imperative
to use randomized controlled trial methodology. This is because other avail-
able techniques like before-after differencing, multivariate regression, etc fail to
capture the effect of ‘behavioural change’ in the subject population due to the
introduction of the intervention. Since ‘behaviour’ is an essential, yet inevitably
immeasurable variable in decision-making, these techniques suffer from the prob-
lem of ‘omitted variable bias’. Moreover, the bias is not easily estimable. In this
case, since the counterfactual is difficult to observe or construct, it is appropriate
to use the randomization technique. This is because a control and a treatment
group, randomly selected and therefore statistically identical in behaviour, when
subjected to differential treatment, allow us to measure the differential outcome
in the variables of interest as a direct result of the differential treatment, without
the effect of behaviour, that being a confounding variable, biases the estimation.
These variables of interest may be the subjects’ ‘understanding of the risk’,
‘risk mitigating behaviour’, ‘value of insurance’, etc. However, for the sake of
observation, we condense these outcomes and/or behavioural aspects into an ob-
jectively observable and easily measurable variable, viz., ‘higher renewal rate’
for the insurance scheme.
10. 4.2.2 Description of Research Methodology
Learning Agenda Data Source & Methodology
Client Retention Data on client retention through CK’s MIS
Claims Expenses Data on number of claims and payout made
based on CK’s MIS and data from insurance
company.
Client Value FGDs and semi structured and structured in-
terviews of the clients at predefined intervals.
Behavioural study cases through PRAs.
OPCS/OPD Financing Operational cost data, revenue data from in-
ternal audit reports of CK and investment-
premium data from insurance company. Also
check for possibility of cross subsidization in the
portfolio.
Table 1: CK Research. Expected data sets and research techniques.
4.2.3 Randomization Design3
Since the research is focussed on the change in demand for insurance, and the
renewal of insurance which is mostly determined by conditions at the level of
a family, or of the insurance policy, the level of randomization must also be
the same. However, the randomization needs to be stratified to control for the
different levels of past interventions by CK in the command area.
This is necessary due to a number of reasons. As discussed earlier, CK has been
conducting the MYCHI programme in some parts of the command area, though
not throughout. Therefore, we can anticipate the population of the command
area to be of two different types; those that have been exposed to MYCHI, and
those that have not. This distinction is important to consider in the randomiza-
tion design since being exposed to MYCHI policies in the past can be expected
to have changed certain behavioural attributes like understanding of health risk,
health-seeking behaviour etc. Since these behavioural differences of the two cat-
egories of the population can not be filtered away through randomization, the
randomization needs to be stratified to account for these differences. Moreover,
since the community health workers of CK provide counselling for the MYCHI
scheme in the command area, there is a possibility that it may have an influence
on the decision of insurance renewal as the clients may be influenced by this
3 We are obliged to Dr. Clara Delavallade [J-PAL] for her feedback on planning of random-
ization
11. service.
In addition to this, there is a need to further stratify the population. This is
explained thus.
CK was initially operating in one segment of the slum (Fakir Bagan), but they
have now expanded their work to a new area in the slum. While CK has provided
counselling under the MYCHI project only in the old area, there are families
in the old area without the presence of any MYCHI beneficiaries. In the new
area, since CK started its interventions only with the health insurance scheme,
the clientÃĺle only comprises of insured families, and no MYCHI beneficiaries.
Because CK has been operating in the old area for almost 3 years, one may
anticipate peer influence and a high level of trust among people in the old area
when compared to those in the new area. As this level of trust and peer influence
is not to be expected in the new area, one can expect behavioural differences
among the beneficiaries across the two areas.
Therefore, to control for these effects, we designed a ‘two stage stratified ran-
domized controlled trial’ to create control and treatment groups among the
insured clients. The families/households in the treatment group will receive
OPCS, and households in the ‘control’ group will not receive OPCS.
The plan for the randomized controlled trial experiment is represented below
where:
› MYCHI family: An insured family and any one member of the family
is current MYCHI beneficiary as well.
› Non-MYCHI family: Pure health insurance clients with no MYCHI
beneficiary in the family.
› CK’s old operation area: Area of the slum where CK was initially
operating with their OPCS scheme and micro health insurance scheme
afterwards.
› CK’S new operation area: Newly penetrated area in the slum and
CK is offering micro health insurance to the families in this area and no
MYCHI.
12. Figure 1: Randomization Design for the CK experiment
In this stratification scheme with MYCHI/non-MYCHI and Old area/New area,
the control groups will be C1,C2 and C3 (randomly selected), and the treatment
group will be T1, T2 and T3 (randomly selected). The randomization will be
carried out after each enrolment phase when the policy number/Calcutta Kids id
(unique identification number) will be available for each insured household. Six
sub-groups (C1, C2, C3 and T1, T2, T3) were created to observe the influence
of other activities of CK on the policy renewal decision. If it is found that
behaviour of the groups is not significantly different, then we could bundle the
results together by having only C (C1+C2+C3) and T (T1+T2+T3).
5 Way Forward
5.1 Current Status of the Research programme
CK started their insurance operations in March 2009, and the enrolment for
the insurance programme takes place three times in a year. Therefore in April
2010 the phase 1 of renewal and fresh enrolment took place. The total number
of families enrolled (both renewals and fresh enrolment) constituted the sample
for the first baseline survey. The baseline data collection for the families who
enrolled in April 2010 has been completed and CIRM has done the previously
stated randomization on the complete list of enrolled families in phase 1. There
were a total of 225 families enrolled in phase 1, and CK has started providing
OPCS following the list of treatment and control households given by CIRM
(generated through a randomization programme in STATA). The collected data
13. of phase 1 is now under analysis and a complete baseline report will be generated
once the data collection for phase 3 will be over by December 2010. After one
year, CIRM will do a follow up survey of the treatment and control households
who were selected in successive phases at the baseline in 2010.
5.2 Challenges
Though RCT as a research tool theoretically seems to be quite appealing in
nature, its implementation has remained a challenge for live projects in our
experience. As the slum is very closely nested, there is a serious possibility of
‘contamination’ of the treatment and control. Therefore there is a possibility of
upward bias or over estimation of the treatment effect.
As the enrolment for the insurance scheme is not high till now, there is a pos-
sibility of ending up with a lower sample size for this experiment. As provision
of OPCS is contingent on people in the treatment group falling sick and going
to the empanelled doctor, the actual treatment group will be the households (in
the treatment group) with at least one member who received OPCS during the
study period. Therefore by the virtue of the effect of ‘treatment on treated’,
the sample size will be lower than the initial sample of treatment households.
This means that if the enrolment for the insurance scheme is not high, then
the probability of observing more cases of OPCS also goes down as OPCS is
an add-on service exclusively for insured clients. CK is trying its level best to
boost the enrolment numbers through various innovative marketing strategies,
thereby trying to ensure the minimum sample size for the research.
5.3 Expected Outcome
The OPCS module now consists of audio-visual counselling tools along with
the routine follow up on medicine, hygiene and health conditions. Therefore it
should possess more value from the perceptive of a client. As CK and CIRM are
closely monitoring the OPCS operation and making sure that the treatment and
control groups are properly maintained, CIRM expects that at the end of the
study period in December 2011, there is a possibility of observing differential
renewal rates among the insured beneficiaries. It may establish that giving an
additional service along with the micro health insurance scheme incentivizes the
non-claimants to remain in the scheme and hence result in a better renewal rate.
If this study shows that the effect of the OPCS is positive on the renewal rate,
then it will create a rationale for the insurance companies as well to invest more
on add on services so that the overall scheme becomes economically sustainable
in the long run.
14. Part II
CARE Foundation
Insuring Primary Care - Sustainable
Financing for Rural Primary Health
6 Brief Description of the Project
CARE Hospitals was established in 1997 and currently has a network of 11
hospitals with more than 2000 beds across five states in India, viz., Maharash-
tra, Andhra Pradesh, Gujarat, Orissa and Chhattisgarh. CARE Foundation
has been actively involved in research, education and technology for making
healthcare affordable and accessible for low income households.
6.1 Hypothesis & Rationale of the Project
Hypothesis 1: Providing outpatient insurance schemes to rural low income
households has been a great challenge due to high probability of adverse selec-
tion, lack of proper gate keeping mechanisms, and high transaction costs. It
is possible to use a technology driven health care delivery model to solve these
problems in a cost effective and sustainable way.
Hypothesis 2: Referral mechanism: Interventions in primary care through pri-
mary health financing mechanisms (Out-patient insurance), and preventive and
promotive interventions will reduce out-of-pocket health expenditure on regular
illnesses (fever, cold, diarrhoea, etc.), and will reduce incidence of hospitaliza-
tion.
Hypothesis 3: Providing quality health care services at the door step at the
village level will change the perception of people about the quality of health
care. This will lead to a behavioural change, and enhance the health seeking
behaviour of people in rural areas. This change in perception will also help fight
against spurious drugs and quacks in villages.
6.2 Description of the Command Area
This project was piloted in Yavatmal district of Maharashtra. The district is
prone to drought, and the bulk of the rural population live below the poverty
15. line (BPL). The delivery model of this pilot resembles a ‘hub and spoke’ struc-
ture. The CARE foundation has established an out-patient clinic at Yavatmal
town and health care will be delivered through the Village Health Champions
(Community health workers of CARE) in 30 villages surrounding the town.
6.3 The Intervention
› Out-Patient services (consulting, diagnostics and drugs) through a hub
and spoke model with the clinic at the backend, and Village Health Cham-
pions (VHC) (Community health worker of CARE) with hand-held devices
at the frontend in the villages.
› Technology leveraged delivery of primary healthcare, financed
through health micro insurance, and delivered at the village level through
the VHC. The VHC at the village level provides:
» Consulting services through a diagnostic tree
» Generic drugs at the village, and other drug subsidies at the clinic
» Diagnostics at the village level, and follow up care at the clinic
› Preventive and promotive services at the village level for OP insured
clients.
7 Learning Agenda & Research Methodology
7.1 Learning Agenda
This project has received an innovation grant from the micro insurance Innova-
tion Facility of the International Labour Organization. The research questions
were framed in accordance with the learning objectives of the implementation
partner, and considering other sector level questions. The research questions
are as follows:
1. Is the technological intervention of introducing a hand held device cost-
beneficial for the sustainability of the scheme?
2. Does purchasing the insurance package increase access to health care, en-
hance health outcomes, and mitigate the financial risk of the insured par-
ticipants?
16. 3. What is the likely impact of public health interventions (preventive and
promotive interventions) on health outcomes, and expenditures in the pop-
ulation of interest?
4. Does the CARE intervention improve the quality of health services to its
users?
7.2 Research Methodology
7.2.1 Rationale for RCT methodology
If our goal is to assess the impact of the insurance plan on subscribers, it is nec-
essary to know what the outcomes (say in terms out-of-pocket (OOP) spending,
proportion of illnesses for which treatment was sought, etc.) for subscribers
would be, in the absence of such a plan. This ‘counterfactual’ is difficult to
observe/construct.
However, unlike the CK project, vanilla randomization does not provide us suf-
ficient controls to create the counterfactual. It must be noted that the objective
of this experiment is to evaluate the impact of insurance on various behavioural,
financial and health attributes of the family buying the policy. However, one
must remain aware that buying insurance is a voluntary decision, and therefore
any sampling technique used in this case would be subject to self-selection
bias. This is because one expects that people who buy insurance are those
who know themselves to be of high-risk or of being highly risk-averse. There-
fore, this category of people who choose to buy insurance can not be considered
behaviourally identical to the parent population.
We will now discuss this problem in more detail.
Consider that we want to evaluate the impact of insurance on the incidence
rate of common illnesses in the community. Suppose we consider setting up a
multivariate regression model to estimate this effect as thus:
incidence = β0 + β1 ∗ insurance + ... + behaviour4
Here we need to be aware that the problem above is prone to omitted variable
bias (due to the same reason that the sample is prone to self-selection bias).
Since the regression equation can not include the unobservable behaviour, the
4 ‘behaviour’ in the equation above replaces the error term . This is because assuming that
there are no other important unobserved variables in the equation, and that all observables
have been explicitly included in the regression, the residual term should primarily be comprised
of ‘behaviour’.
17. unobserved heterogeneity leads to a biased estimation of the regression co-
efficients since the same omitted variable is also correlated with the decision
to buy insurance. There are two standard ways to deal with the problem of
unobserved heterogeneity or omitted variable bias. These are, to find a proxy
variable for the unobserved, which in this case is very difficult, or to assume that
the omitted variable does not change over time, and use the first-differencing
or fixed-effects method. The second method also does not work in our case
because we know that introducing insurance is going to affect the behaviour of
the clientÃĺle, which is indeed a subset of the changes that we desire to measure
through this intervention.
Therefore we find that both the standard techniques in this case fail. However
one technique that can be used to solve this problem is the use of an Instrumen-
tal Variable or in our case, discount-vouchers. This is the pivotal attribute
of the randomization design in this case.
7.2.2 Research Methodology - Voucher Based Randomization
Suppose we can find (or create) a variable with the following properties:
Cov(insurance, variable) = 0, &
Cov(behaviour, variable) = 0
If this can be done, we would know that this variable is an instrumental variable
that can be used to find unbiased estimates in the above regression equation.
Note here that the second property is easily achievable through randomization.
One may create a variable through randomization of the sample of possible
families (units of decision-making) that is completely uncorrelated to the be-
havioural aspects of these decision-making units. On the other hand, to ensure
compliance with the first property, one may create this variable in such a way
that the state of this variable is correlated with the uptake of insurance. One
can easily see that a discount-voucher can be used to induce buying of insurance
and create correlation between the voucher and insurance.
A voucher is essentially an entitlement that provides an 80%5 discount on the
premium that a household would ordinarily pay to get CARE insurance cover
5 The choice of 80% is not trivial. When using an Instrumental variable, one would generally
desire a high level of correlation b/w the endogenous variable and the instrumental variable.
Therefore one would want to give heavy subsidy to ensure that take up with vouchers is high
creating high correlation. One may as well argue then, that the voucher be given free of cost.
However, there is literature that documents that the behavioural impact of receiving a ‘free
gift’ is different from the behavioural impact of buying a heavily subsidized product.
18. for the first year of the programme. A sample of 30 households per village is
chosen for the baseline survey. Our aim is to provide vouchers to 20 of these
survey households. The remaining 10 households will be provided with a slip
that entitles the recipient to one free visit to the village health champion. Let us
term the households in each village that get the voucher ‘treatment households’
and the 10 households that get the slip for one free visit to the village health
champion as ‘control households’. Note that anybody outside this group of 30
in each village is irrelevant for the sake of our research whether or not they
choose to buy insurance.
As the voucher is randomly assigned, on ‘average’ or in a ‘statistical sense’ the
treatment and control households are basically the same. Thus, differences in the
behaviour/outcomes of the treatment and control households can be assumed
to be an effect of the voucher.
Recall that we are interested in the impact of the ‘insurance/CARE scheme’.
(Impact can be measured in several ways: increased use of services by household
members, financial risk protection, quality of care, etc). The question here is: to
what extent can the impact of the voucher programme be considered the same
as the impact of the insurance programme? We can expect that not all voucher
recipients may purchase insurance, and some non-recipients may also purchase
insurance. Thus one could also refer to the effect of the voucher programme as
the effect of ‘intent to insure6 .’
The key take-away from the discussion above is that we have essentially solved
the problem of self-selection bias. This is because, it is due to our intent to
insure (the heavy discount) that people choose to buy insurance and not due to
their behavioural affinities (although not true in all cases). However, once the
insurance product has already been bought, one can argue that, on an average,
the differences observed between an insured person (from the treatment group)
and a non-insured person (from the control group) from the point of intervention
onwards are because of the insurance/CARE scheme.
Replicating the same discussion as above, one can also randomize to evaluate
the impact of the preventive promotive package on health and other outcomes.
We do this by dividing the sample of 30 households into 10 who get only the
one-time free visit (the control group), 10 households who receive the discount
voucher on the premium of the insurance cover (the first treatment group), and
10 households who receive the discount voucher on the premium and another
80% discount voucher on the preventive-promotive package.
In this study the impact will be observed through three difference effects:
6 Note that this is analogous to ‘intent to treat’ in standard RCT literature
19. 1. C - T2 : Impact of OP insurance on insured people vs. uninsured people.
2. C - T1: Impact of combined intervention (OP insurance + preventive
and promotive package) on insured people vs. uninsured people
3. T1 - T2: Impact of combined intervention (OP insurance + preventive
and promotive package) on insured people vs. people with only OP insur-
ance.
8 Way Forward
8.1 Current Status of the Research programme
The baseline survey before launching the technology leveraged insurance scheme
is now complete. The data is currently under preliminary analysis by the data
collection agency. At the end of the data cleaning and data entry process, CIRM
will produce a baseline survey report which will provide more insight on the
clientÃĺle. As the survey has been conducted using the list of households that
were assigned specific discount vouchers, (the list is generated through a ran-
domization programme in STATA) the randomization is now implemented in the
field. CARE is about to start the enrolment for the out-patient insurance pro-
gramme of which CIRM will closely monitor the process to rule out any chance
of mixing between control and treatment households. The discount vouchers
are designed in such a manner that the treatment and control households can
be easily identified from a unique code assigned to each type of voucher. CARE
and CIRM will try to ensure that the recipients of the discount vouchers ac-
tually use it to buy the insurance product. In that case it will create a true
control and treatment group with differential rate of discount on the insurance
premium and on the preventive package. As a result it would successfully serve
the purpose of an ‘instrumental variable’, and the vouchers will show the ‘intent
to insure’ effect.
8.2 Challenges
Village to city migration is a very common phenomenon in the command area
of this project. Therefore there is always a risk of losing control and treatment
households. If this happens, the results have to be adjusted accordingly. As the
recipients of the vouchers are low income households in the villages, they lack
awareness about the benefits of having insurance, and there is a possibility that
people may not use the vouchers to buy the out-patient health insurance scheme.
20. CIRM has tried to deal with this risk by providing a lump sum discount of 80%
through the discount vouchers to incentivize the recipient to buy the insurance
scheme.
8.3 Expected Outcome
The households which buy the insurance scheme using the discount vouchers
after the baseline survey will constitute the true treatment group. As the insur-
ance product is bundled with a preventive package and a technology leveraged
health delivery model, the scheme ensures quality health services at the vil-
lage level, and therefore we may observe the positive impact of CARE’s scheme
on the target households. It may establish that an intervention targeting out-
patients with an out-patient insurance scheme eventually reduces the burden of
in-patient cases, and therefore reduces the health expenditure of the household.
In that case it would be a win-win situation as the out-patient health financing
solution would prove beneficial for the households as well as for the insurer,
as the insurer has to spend less on inpatient claims. Out-patient health risks
are typically ‘high frequency and low volume’ risk, and therefore not commonly
covered under insurance. If this out-patient health financing solution shows a
positive result in terms of reduction in in-patient claims and sustainability of an
out-patient cover, then the insurers will be interested in covering primary level
healthcare. If this research establishes that there is a positive impact of the
insurance scheme on the disease burden of the household and its health seeking
behaviour, it may also successfully confirm the ‘referral chain’7 hypothesis.
7 Referralchain hypothesis: Intervention in primary and secondary level health care delivery
may reduce the burden of tertiary level of health provision. In that case the patient will get
treated at the out-patient level and hence it may reduce the probability of hospitalization.
21. 9 Conclusion
There have been very few attempts to measure the impact of micro health insur-
ance on the health outcomes of low income households of a developing country.
Randomized controlled trial technique to assess the impact of an intervention
has been quite successful in various development projects. Though there are
a few criticisms of the RCT method, it is recognized as one of the most pow-
erful techniques for impact evaluation in development economics research. In
this paper we have discussed a methodology of assessing the impact of the mi-
cro health insurance programme. In both the innovation pilots, the research
methodology is now successfully implemented. However since only the baseline
survey has been completed in both projects, we have to wait another year to
see the final results. The primary objective of this paper was not to present the
final quantitative results, but to describe plausible techniques to measure and
design the randomization plan to assess the impact of health micro insurance
programs. As this paper elaborates on various challenges and the risks of imple-
menting a randomization plan in a live project, these designs and experiences
will be extremely relevant for several other impact evaluation projects in other
countries.
22. 10 References
› Duflo Esther, Glennerster Rachel, Kremer Michael [2006], ‘Using
Randomization in Development Economics Research: A Toolkit’, NBER
technical working paper, 333
http://www.nber.org/papers/t0333
› Banerjee Abhijit, Cole Shawn, Duflo Esther, Linden Leigh [2005],
‘Remedying Education: Evidence from two randomized experiments in In-
dia’, NBER working paper, 11904,
http://www.nber.org/papers/w11904
› Miguel Edward, Kremer Michael [2004], ‘Identifying Impacts on
Education and Health in the Presence of Treatment Externalities’, Econo-
metrica, Vol. 72, No. 1, (Jan., 2004), pp. 159-217
› Bayer J. Patrick, Bernheim B. Douglas, Scholz Karl John [1996],
‘The Effects of Financial Education in the work place: Evidence from a
survey of employers’, NBER Working paper, 5655
http://www.nber.org/papers/w5655
› Cole Shawn, Shastry Kartini Gauri [2009], ‘If you are so smart,
why aren’t you rich? The Effects of Education, Financial Literacy and
Cognitive Ability on Financial Market Participation’ , Working Paper 09-
071, Harvard Business School