SlideShare a Scribd company logo
5/12/2015
1
Introduction: what is the SW-CRT?
Defining features, common variations, and some salient
examples
Karla Hemming
12/05/2015
Why do we need another method of
evaluation?
5/12/2015
2
Evaluation of policy and service delivery
interventions
• The Matching Michigan Study
– Secular trend
– Intervention effect
• The Oregon Experiment
– Randomised
– No primary outcome
• Mexican universal health
insurance
– 74 matched clusters
– Staggered implementation
Evidence based policy interventions
Working constraints
• Stakeholder’s desires
• Pragmatic limitations
• A priori beliefs
How the SW-CRT can help
• All clusters ultimately get
intervention
• Sequential roll out
• Robust evaluation
5/12/2015
3
What is the SW-CRT?
The Stepped Wedge Cluster Randomised Trial
5/12/2015
4
Example 1: A cross-sectional SW-CRT
The EPOCH study – a cross sectional
SW-CRT
• Evidence based integrated care
pathway (ICP)
• Emergency laparotomy
• Setting:
– 90 hospitals
• Outcome:
– 90 day mortality
• Sample size:
– 27,500 patients
– 90% power to detect a change
from 25% to 22%
• Routinely collected outcome
– No consent
Pearse R, Pedan C, Bion J, Faiz O, Holt P, Girling A, et al. HS&DR - 12/5005/10. Enhanced Peri-Operative Care for High-risk patients (EPOCH) trial: a stepped
wedge cluster randomised trial of a quality improvement intervention for patients undergoing emergency laparotomy [protocol]. 2013.
www.nets.nihr.ac.uk/projects/hsdr/12500510.
5/12/2015
5
Example 2: A cohort SW-CRT
Depression management– a cohort
SW-CRT
• Structural multidisciplinary approach
to depression management
• Participants
– Residents who provided informed consent
• Setting:
– 33 units within nursing homes (Dementia /
Somatic)
• Outcome:
– Depression prevalence
• Sample size:
– 793 patients
– 80% power to detect a 30 to 40% reduction
in prevalence (circa 20-30%)
• Outcome
– Questionnaire (Cornell scale for
depression)
Leontjevas R, Gerritsen DL, Smalbrugge M, Teerenstra S, Vernooij-Dassen MJ, Koopmans RT. A structural multidisciplinary approach to depression
management in nursing-home residents: a multicentre, stepped-wedge cluster-randomised trial. Lancet. 2013 Jun 9;381(9885):2255-64. doi:
10.1016/S0140-6736(13)60590-5. Epub 2013 May 2. PubMed PMID: 23643110.
5/12/2015
6
Example 3 – the Gambia hepatitis
study
The Gambia hepatitis study
• Step lengths 10 to 12 weeks
• National coverage after 4 years
• Geographically defined areas
• Study started 1980s
– 30 year follow-up
• Vaccine
– efficacy against hep B
• Main outcome
– liver disease
• Vaccine rolled out
– national infant
vaccination schedule
5/12/2015
7
Is the SW-CRT the right design for my
trial?
• Pragmatic considerations
– Does it allow a randomised evaluation which otherwise would
not be possible?
• Logistical considerations
– Allows sequential role out
• Efficiency
– Minimise number clusters / participants / observations
• Duration
– Will it necessarily extend the trial?
– Time between exposure and follow-up
Word of caution …
• Lack of concealment
of allocation
– Risk of selection bias
• Avoid individual
patient recruitment
– Routinely collected
outcome data
Chalmers:
“Although one of the reasons that the streptomycin trial has become iconic is …
random number tables …. it was because successful concealment of allocation”
5/12/2015
8
Example of a CRT with lack of
concealment of allocation
• Results in baseline
imbalance
• Due to recruitment of
individuals after
allocation known
• Will it be better or
worse in SW-CRT?
Variations to the common design
• More than two treatment comparisons
• Hybrid designs – mixtures of parallel designs and stepped studies
• Transition periods
• Multiple levels (i.e. clustering within clustering)
• Repeated measures (cohort designs)
5/12/2015
9
To follow….
• What sample size do I need?
• What is the most efficient design?
• How to extend the design to all for more than two treatments?
• How do I analyse a SW-CRT?
Summary
• SW-CRT a pragmatic study design which reconciles the need for
robust evaluations with political or logistical constraints.
• Unbiased design when:
– No individual patient recruitment (routinely collected outcome)
• Efficient design when:
– Higher the ICC (process outcomes)
– Limited number of clusters
• Design and analysis
– Appropriate consideration of time effects in power and analysis
5/12/2015
10
References 1 (methodology)
• Mdege ND, Man MS, Brown CATN, Torgerson DJ. Systematic review of stepped wedge cluster
randomized trials shows that design is particularly used to evaluate interventions during routine
implementation. Journal of Clinical Epidemiology 2011; 64:936–948.
• Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised
trial: rationale, design, analysis, and reporting. BMJ. 2015 Feb 6;350:h391. doi: 10.1136/bmj.h391.
PubMed PMID: 25662947.
• Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials.
Contemp Clin Trials. 2007;28(2):182-91.
References 2 (motivating examples)
• Bion J, Richardson A, Hibbert P, Beer J, Abrusci T, McCutcheon M, et al. ‘Matching Michigan’: a
2-year stepped interventional programme to minimise central venous catheter-blood stream
infections in intensive care units in England. BMJ Qual Saf2013;22:110-23
• Baicker K, Taubman SL, Allen HL, Bernstein M, Gruber JH, Newhouse JP, Schneider EC, Wright
BJ, Zaslavsky AM, Finkelstein AN; Oregon Health Study Group, Carlson M, Edlund T, Gallia C,
Smith J. The Oregon experiment--effects of Medicaid on clinical outcomes. N Engl J Med. 2013
May 2;368(18):1713-22. doi: 10.1056/NEJMsa1212321. PubMed PMID: 23635051; PubMed
Central PMCID: PMC3701298.
• King G, Gakidou E, Imai K, Lakin J, Moore RT, Nall C, Ravishankar N, Vargas M, Téllez-Rojo
MM, Avila JE, Avila MH, Llamas HH. Public policy for the poor? A randomised assessment of the
Mexican universal health insurance programme. Lancet. 2009 Apr 25;373(9673):1447-54. doi:
10.1016/S0140-6736(09)60239-7. Epub 2009 Apr 7. PubMed PMID: 19359034.
5/12/2015
11

More Related Content

What's hot

Critical appraisal 2012 updated
Critical appraisal 2012 updatedCritical appraisal 2012 updated
Critical appraisal 2012 updated
sanghagirl
 
Critical appraisal of a journal article
Critical appraisal of a journal articleCritical appraisal of a journal article
Critical appraisal of a journal article
DrSahilKumar
 
Introduction to critical appraisal
Introduction to critical appraisalIntroduction to critical appraisal
Introduction to critical appraisal
Omar Taibah
 
Critical appraisal
Critical appraisalCritical appraisal
Critical appraisal
LPDTasTAFE
 
Quick introduction to critical appraisal of quantitative research
Quick introduction to critical appraisal of quantitative researchQuick introduction to critical appraisal of quantitative research
Quick introduction to critical appraisal of quantitative research
Alan Fricker
 
Deciding on a medical research topic: your first challenge
Deciding on a medical research topic: your first challengeDeciding on a medical research topic: your first challenge
Deciding on a medical research topic: your first challenge
Azmi Mohd Tamil
 
Choosing your study design
Choosing your study designChoosing your study design
Choosing your study design
Azmi Mohd Tamil
 
Critical Appraisal Overview
Critical Appraisal OverviewCritical Appraisal Overview
Critical Appraisal Overview
Fastbleep
 
The Elusive Promise of Neuroprotection - What have we learned, Where do we go...
The Elusive Promise of Neuroprotection - What have we learned, Where do we go...The Elusive Promise of Neuroprotection - What have we learned, Where do we go...
The Elusive Promise of Neuroprotection - What have we learned, Where do we go...
University of Michigan Department of Emergency Medicine
 
Evidence Aid: who and why
Evidence Aid: who and whyEvidence Aid: who and why
Evidence Aid: who and why
ALNAP
 
Systematic reviews and trials (Claire Allen, Evidence Aid)
Systematic reviews and trials (Claire Allen, Evidence Aid)Systematic reviews and trials (Claire Allen, Evidence Aid)
Systematic reviews and trials (Claire Allen, Evidence Aid)
ALNAP
 
Alternative experimental designs
Alternative experimental designsAlternative experimental designs
Alternative experimental designs
Roger Watson
 
Introduction to critical appraisal
Introduction to critical appraisal   Introduction to critical appraisal
Introduction to critical appraisal
LYPFTlibrary
 
Critical appraisal of research evidence: The CASP resources
Critical appraisal of research evidence: The CASP resourcesCritical appraisal of research evidence: The CASP resources
Critical appraisal of research evidence: The CASP resources
Yasser Sami Abdel Dayem Amer
 
NES Pharmacy, Critical Appraisal 2011
NES Pharmacy, Critical Appraisal 2011NES Pharmacy, Critical Appraisal 2011
NES Pharmacy, Critical Appraisal 2011
NES
 
evidence based medicine ( dr.moaweyah)
evidence based medicine ( dr.moaweyah)evidence based medicine ( dr.moaweyah)
evidence based medicine ( dr.moaweyah)
Moauia Qasim
 
Critical appraisal of published medical research (2)
Critical appraisal of published medical research (2)Critical appraisal of published medical research (2)
Critical appraisal of published medical research (2)
Tarek Tawfik Amin
 
Ebdm n concept of critical appraisal
Ebdm n concept of critical appraisalEbdm n concept of critical appraisal
Ebdm n concept of critical appraisal
Monali2011
 
Research Methods 2 Critical Appraisal Of Literature
Research Methods 2   Critical Appraisal Of LiteratureResearch Methods 2   Critical Appraisal Of Literature
Research Methods 2 Critical Appraisal Of Literature
guest0aeecb
 
Publication bias in service delivery research: a critique - John Ovretveit
Publication bias in service delivery research: a critique - John OvretveitPublication bias in service delivery research: a critique - John Ovretveit
Publication bias in service delivery research: a critique - John Ovretveit
NIHR CLAHRC West Midlands
 

What's hot (20)

Critical appraisal 2012 updated
Critical appraisal 2012 updatedCritical appraisal 2012 updated
Critical appraisal 2012 updated
 
Critical appraisal of a journal article
Critical appraisal of a journal articleCritical appraisal of a journal article
Critical appraisal of a journal article
 
Introduction to critical appraisal
Introduction to critical appraisalIntroduction to critical appraisal
Introduction to critical appraisal
 
Critical appraisal
Critical appraisalCritical appraisal
Critical appraisal
 
Quick introduction to critical appraisal of quantitative research
Quick introduction to critical appraisal of quantitative researchQuick introduction to critical appraisal of quantitative research
Quick introduction to critical appraisal of quantitative research
 
Deciding on a medical research topic: your first challenge
Deciding on a medical research topic: your first challengeDeciding on a medical research topic: your first challenge
Deciding on a medical research topic: your first challenge
 
Choosing your study design
Choosing your study designChoosing your study design
Choosing your study design
 
Critical Appraisal Overview
Critical Appraisal OverviewCritical Appraisal Overview
Critical Appraisal Overview
 
The Elusive Promise of Neuroprotection - What have we learned, Where do we go...
The Elusive Promise of Neuroprotection - What have we learned, Where do we go...The Elusive Promise of Neuroprotection - What have we learned, Where do we go...
The Elusive Promise of Neuroprotection - What have we learned, Where do we go...
 
Evidence Aid: who and why
Evidence Aid: who and whyEvidence Aid: who and why
Evidence Aid: who and why
 
Systematic reviews and trials (Claire Allen, Evidence Aid)
Systematic reviews and trials (Claire Allen, Evidence Aid)Systematic reviews and trials (Claire Allen, Evidence Aid)
Systematic reviews and trials (Claire Allen, Evidence Aid)
 
Alternative experimental designs
Alternative experimental designsAlternative experimental designs
Alternative experimental designs
 
Introduction to critical appraisal
Introduction to critical appraisal   Introduction to critical appraisal
Introduction to critical appraisal
 
Critical appraisal of research evidence: The CASP resources
Critical appraisal of research evidence: The CASP resourcesCritical appraisal of research evidence: The CASP resources
Critical appraisal of research evidence: The CASP resources
 
NES Pharmacy, Critical Appraisal 2011
NES Pharmacy, Critical Appraisal 2011NES Pharmacy, Critical Appraisal 2011
NES Pharmacy, Critical Appraisal 2011
 
evidence based medicine ( dr.moaweyah)
evidence based medicine ( dr.moaweyah)evidence based medicine ( dr.moaweyah)
evidence based medicine ( dr.moaweyah)
 
Critical appraisal of published medical research (2)
Critical appraisal of published medical research (2)Critical appraisal of published medical research (2)
Critical appraisal of published medical research (2)
 
Ebdm n concept of critical appraisal
Ebdm n concept of critical appraisalEbdm n concept of critical appraisal
Ebdm n concept of critical appraisal
 
Research Methods 2 Critical Appraisal Of Literature
Research Methods 2   Critical Appraisal Of LiteratureResearch Methods 2   Critical Appraisal Of Literature
Research Methods 2 Critical Appraisal Of Literature
 
Publication bias in service delivery research: a critique - John Ovretveit
Publication bias in service delivery research: a critique - John OvretveitPublication bias in service delivery research: a critique - John Ovretveit
Publication bias in service delivery research: a critique - John Ovretveit
 

Similar to Theme6 hemming what_is_sw-crt_virginia_conference_may2015

The stepped wedge cluster randomised trial workshop: Session 2
The stepped wedge cluster randomised trial workshop: Session 2 The stepped wedge cluster randomised trial workshop: Session 2
The stepped wedge cluster randomised trial workshop: Session 2
Karla hemming
 
Knowledge transfer research examples
Knowledge transfer research examplesKnowledge transfer research examples
Knowledge transfer research examples
taem
 
Shing Lee MedicReS World Congress 2015
Shing Lee MedicReS World Congress 2015Shing Lee MedicReS World Congress 2015
Shing Lee MedicReS World Congress 2015
MedicReS
 
randomized clinical trials I
randomized clinical trials Irandomized clinical trials I
randomized clinical trials I
IAU Dent
 
Core Outcome Measures in Effectiveness Trials
Core Outcome Measures in Effectiveness TrialsCore Outcome Measures in Effectiveness Trials
Core Outcome Measures in Effectiveness Trials
HTAi Bilbao 2012
 
6. Randomised controlled trial
6. Randomised controlled trial6. Randomised controlled trial
6. Randomised controlled trial
Razif Shahril
 
systematic review : why & How
systematic review : why & Howsystematic review : why & How
systematic review : why & How
Hesham Al-Inany
 
Randomized control trial
Randomized control trialRandomized control trial
Randomized control trial
BPKIHS
 
Types of rct concepts and application
Types of rct concepts and applicationTypes of rct concepts and application
Types of rct concepts and application
shibabmc
 
IRB Challenges QI vs Research
IRB Challenges   QI vs ResearchIRB Challenges   QI vs Research
IRB Challenges QI vs Research
msschreiner
 
PUBLISHING
PUBLISHINGPUBLISHING
PUBLISHING
Dr Ramesh R
 
Therapeutic Study 7-10-2020.pdf
Therapeutic Study 7-10-2020.pdfTherapeutic Study 7-10-2020.pdf
Therapeutic Study 7-10-2020.pdf
llewKhwangmuang
 
U of T Department of Family & Community Medicine PEARLS 2014
U of T Department of Family & Community Medicine PEARLS 2014U of T Department of Family & Community Medicine PEARLS 2014
U of T Department of Family & Community Medicine PEARLS 2014
Health Quality Ontario (HQO)
 
Psychologists and Quality Improvement 3.pdf
Psychologists and Quality Improvement 3.pdfPsychologists and Quality Improvement 3.pdf
Francesca Martinelli MedicReS World Congress 2013
Francesca Martinelli MedicReS World Congress 2013Francesca Martinelli MedicReS World Congress 2013
Francesca Martinelli MedicReS World Congress 2013
MedicReS
 
Random control trial RCT community medicine .pptx
Random control trial RCT community medicine  .pptxRandom control trial RCT community medicine  .pptx
Random control trial RCT community medicine .pptx
AkshayRaj781072
 
The Stepped Wedge study - Karla Hemming
The Stepped Wedge study - Karla HemmingThe Stepped Wedge study - Karla Hemming
The Stepped Wedge study - Karla Hemming
NIHR CLAHRC West Midlands
 
Adaptive Study Designs
Adaptive Study DesignsAdaptive Study Designs
Adaptive Study Designs
Anirudha Potey
 
methods of randomization.pptx
methods of randomization.pptxmethods of randomization.pptx
methods of randomization.pptx
Nehagurbani
 
# 5th lect clinical trial process
# 5th lect clinical trial process# 5th lect clinical trial process
# 5th lect clinical trial process
Dr. Eman M. Mortada
 

Similar to Theme6 hemming what_is_sw-crt_virginia_conference_may2015 (20)

The stepped wedge cluster randomised trial workshop: Session 2
The stepped wedge cluster randomised trial workshop: Session 2 The stepped wedge cluster randomised trial workshop: Session 2
The stepped wedge cluster randomised trial workshop: Session 2
 
Knowledge transfer research examples
Knowledge transfer research examplesKnowledge transfer research examples
Knowledge transfer research examples
 
Shing Lee MedicReS World Congress 2015
Shing Lee MedicReS World Congress 2015Shing Lee MedicReS World Congress 2015
Shing Lee MedicReS World Congress 2015
 
randomized clinical trials I
randomized clinical trials Irandomized clinical trials I
randomized clinical trials I
 
Core Outcome Measures in Effectiveness Trials
Core Outcome Measures in Effectiveness TrialsCore Outcome Measures in Effectiveness Trials
Core Outcome Measures in Effectiveness Trials
 
6. Randomised controlled trial
6. Randomised controlled trial6. Randomised controlled trial
6. Randomised controlled trial
 
systematic review : why & How
systematic review : why & Howsystematic review : why & How
systematic review : why & How
 
Randomized control trial
Randomized control trialRandomized control trial
Randomized control trial
 
Types of rct concepts and application
Types of rct concepts and applicationTypes of rct concepts and application
Types of rct concepts and application
 
IRB Challenges QI vs Research
IRB Challenges   QI vs ResearchIRB Challenges   QI vs Research
IRB Challenges QI vs Research
 
PUBLISHING
PUBLISHINGPUBLISHING
PUBLISHING
 
Therapeutic Study 7-10-2020.pdf
Therapeutic Study 7-10-2020.pdfTherapeutic Study 7-10-2020.pdf
Therapeutic Study 7-10-2020.pdf
 
U of T Department of Family & Community Medicine PEARLS 2014
U of T Department of Family & Community Medicine PEARLS 2014U of T Department of Family & Community Medicine PEARLS 2014
U of T Department of Family & Community Medicine PEARLS 2014
 
Psychologists and Quality Improvement 3.pdf
Psychologists and Quality Improvement 3.pdfPsychologists and Quality Improvement 3.pdf
Psychologists and Quality Improvement 3.pdf
 
Francesca Martinelli MedicReS World Congress 2013
Francesca Martinelli MedicReS World Congress 2013Francesca Martinelli MedicReS World Congress 2013
Francesca Martinelli MedicReS World Congress 2013
 
Random control trial RCT community medicine .pptx
Random control trial RCT community medicine  .pptxRandom control trial RCT community medicine  .pptx
Random control trial RCT community medicine .pptx
 
The Stepped Wedge study - Karla Hemming
The Stepped Wedge study - Karla HemmingThe Stepped Wedge study - Karla Hemming
The Stepped Wedge study - Karla Hemming
 
Adaptive Study Designs
Adaptive Study DesignsAdaptive Study Designs
Adaptive Study Designs
 
methods of randomization.pptx
methods of randomization.pptxmethods of randomization.pptx
methods of randomization.pptx
 
# 5th lect clinical trial process
# 5th lect clinical trial process# 5th lect clinical trial process
# 5th lect clinical trial process
 

More from NIHR CLAHRC West Midlands

Emma Healey presentation on ENHANCE Project
Emma Healey presentation on ENHANCE ProjectEmma Healey presentation on ENHANCE Project
Emma Healey presentation on ENHANCE Project
NIHR CLAHRC West Midlands
 
Alison Hipwell presentation at PPI Supervisory Committee meeting
Alison Hipwell presentation at PPI Supervisory Committee meetingAlison Hipwell presentation at PPI Supervisory Committee meeting
Alison Hipwell presentation at PPI Supervisory Committee meeting
NIHR CLAHRC West Midlands
 
Rapid qualitative analysis: does it deliver? - Beck Taylor
Rapid qualitative analysis: does it deliver? - Beck TaylorRapid qualitative analysis: does it deliver? - Beck Taylor
Rapid qualitative analysis: does it deliver? - Beck Taylor
NIHR CLAHRC West Midlands
 
Shout Out for Youth Mental Health feedback - John Ovretveit
Shout Out for Youth Mental Health feedback - John OvretveitShout Out for Youth Mental Health feedback - John Ovretveit
Shout Out for Youth Mental Health feedback - John Ovretveit
NIHR CLAHRC West Midlands
 
Towards a National Learning Health System - Aziz Sheikh
Towards a National Learning Health System - Aziz SheikhTowards a National Learning Health System - Aziz Sheikh
Towards a National Learning Health System - Aziz Sheikh
NIHR CLAHRC West Midlands
 
A century of health services development in Birmingham - Tim Jones
A century of health services development in Birmingham - Tim JonesA century of health services development in Birmingham - Tim Jones
A century of health services development in Birmingham - Tim Jones
NIHR CLAHRC West Midlands
 
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla HemmingDog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
NIHR CLAHRC West Midlands
 
4 - Further info - Setting up research in the NHS: practical and ethical cons...
4 - Further info - Setting up research in the NHS: practical and ethical cons...4 - Further info - Setting up research in the NHS: practical and ethical cons...
4 - Further info - Setting up research in the NHS: practical and ethical cons...
NIHR CLAHRC West Midlands
 
3 - UoB - Setting up research in the NHS: practical and ethical considerations
3 - UoB - Setting up research in the NHS: practical and ethical considerations3 - UoB - Setting up research in the NHS: practical and ethical considerations
3 - UoB - Setting up research in the NHS: practical and ethical considerations
NIHR CLAHRC West Midlands
 
2 CRN - Setting up research in the NHS: practical and ethical considerations
2 CRN - Setting up research in the NHS: practical and ethical considerations2 CRN - Setting up research in the NHS: practical and ethical considerations
2 CRN - Setting up research in the NHS: practical and ethical considerations
NIHR CLAHRC West Midlands
 
1 - HRA - Setting up research in the NHS: practical and ethical considerations
1 - HRA - Setting up research in the NHS: practical and ethical considerations1 - HRA - Setting up research in the NHS: practical and ethical considerations
1 - HRA - Setting up research in the NHS: practical and ethical considerations
NIHR CLAHRC West Midlands
 
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom MarshallCLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
NIHR CLAHRC West Midlands
 
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
NIHR CLAHRC West Midlands
 
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
NIHR CLAHRC West Midlands
 
Prof Tom Marshall - Introduction to the opportunties and support available to...
Prof Tom Marshall - Introduction to the opportunties and support available to...Prof Tom Marshall - Introduction to the opportunties and support available to...
Prof Tom Marshall - Introduction to the opportunties and support available to...
NIHR CLAHRC West Midlands
 
The last fellowship... the next fellowship application
The last fellowship... the next fellowship applicationThe last fellowship... the next fellowship application
The last fellowship... the next fellowship application
NIHR CLAHRC West Midlands
 
Rapid qualitative analysis vs the 'traditional approach': early findings and ...
Rapid qualitative analysis vs the 'traditional approach': early findings and ...Rapid qualitative analysis vs the 'traditional approach': early findings and ...
Rapid qualitative analysis vs the 'traditional approach': early findings and ...
NIHR CLAHRC West Midlands
 
Clahrc ps cmeeting_21st_sept2015_spacer_project_kp
Clahrc ps cmeeting_21st_sept2015_spacer_project_kpClahrc ps cmeeting_21st_sept2015_spacer_project_kp
Clahrc ps cmeeting_21st_sept2015_spacer_project_kp
NIHR CLAHRC West Midlands
 
Clahrc ps cmeeting_21st_sept2015_spacer_project_dt
Clahrc ps cmeeting_21st_sept2015_spacer_project_dtClahrc ps cmeeting_21st_sept2015_spacer_project_dt
Clahrc ps cmeeting_21st_sept2015_spacer_project_dt
NIHR CLAHRC West Midlands
 
Clahrc ps cmeeting_21st_sept2015_spacer_project_cc
Clahrc ps cmeeting_21st_sept2015_spacer_project_ccClahrc ps cmeeting_21st_sept2015_spacer_project_cc
Clahrc ps cmeeting_21st_sept2015_spacer_project_cc
NIHR CLAHRC West Midlands
 

More from NIHR CLAHRC West Midlands (20)

Emma Healey presentation on ENHANCE Project
Emma Healey presentation on ENHANCE ProjectEmma Healey presentation on ENHANCE Project
Emma Healey presentation on ENHANCE Project
 
Alison Hipwell presentation at PPI Supervisory Committee meeting
Alison Hipwell presentation at PPI Supervisory Committee meetingAlison Hipwell presentation at PPI Supervisory Committee meeting
Alison Hipwell presentation at PPI Supervisory Committee meeting
 
Rapid qualitative analysis: does it deliver? - Beck Taylor
Rapid qualitative analysis: does it deliver? - Beck TaylorRapid qualitative analysis: does it deliver? - Beck Taylor
Rapid qualitative analysis: does it deliver? - Beck Taylor
 
Shout Out for Youth Mental Health feedback - John Ovretveit
Shout Out for Youth Mental Health feedback - John OvretveitShout Out for Youth Mental Health feedback - John Ovretveit
Shout Out for Youth Mental Health feedback - John Ovretveit
 
Towards a National Learning Health System - Aziz Sheikh
Towards a National Learning Health System - Aziz SheikhTowards a National Learning Health System - Aziz Sheikh
Towards a National Learning Health System - Aziz Sheikh
 
A century of health services development in Birmingham - Tim Jones
A century of health services development in Birmingham - Tim JonesA century of health services development in Birmingham - Tim Jones
A century of health services development in Birmingham - Tim Jones
 
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla HemmingDog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
 
4 - Further info - Setting up research in the NHS: practical and ethical cons...
4 - Further info - Setting up research in the NHS: practical and ethical cons...4 - Further info - Setting up research in the NHS: practical and ethical cons...
4 - Further info - Setting up research in the NHS: practical and ethical cons...
 
3 - UoB - Setting up research in the NHS: practical and ethical considerations
3 - UoB - Setting up research in the NHS: practical and ethical considerations3 - UoB - Setting up research in the NHS: practical and ethical considerations
3 - UoB - Setting up research in the NHS: practical and ethical considerations
 
2 CRN - Setting up research in the NHS: practical and ethical considerations
2 CRN - Setting up research in the NHS: practical and ethical considerations2 CRN - Setting up research in the NHS: practical and ethical considerations
2 CRN - Setting up research in the NHS: practical and ethical considerations
 
1 - HRA - Setting up research in the NHS: practical and ethical considerations
1 - HRA - Setting up research in the NHS: practical and ethical considerations1 - HRA - Setting up research in the NHS: practical and ethical considerations
1 - HRA - Setting up research in the NHS: practical and ethical considerations
 
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom MarshallCLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
 
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
 
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
 
Prof Tom Marshall - Introduction to the opportunties and support available to...
Prof Tom Marshall - Introduction to the opportunties and support available to...Prof Tom Marshall - Introduction to the opportunties and support available to...
Prof Tom Marshall - Introduction to the opportunties and support available to...
 
The last fellowship... the next fellowship application
The last fellowship... the next fellowship applicationThe last fellowship... the next fellowship application
The last fellowship... the next fellowship application
 
Rapid qualitative analysis vs the 'traditional approach': early findings and ...
Rapid qualitative analysis vs the 'traditional approach': early findings and ...Rapid qualitative analysis vs the 'traditional approach': early findings and ...
Rapid qualitative analysis vs the 'traditional approach': early findings and ...
 
Clahrc ps cmeeting_21st_sept2015_spacer_project_kp
Clahrc ps cmeeting_21st_sept2015_spacer_project_kpClahrc ps cmeeting_21st_sept2015_spacer_project_kp
Clahrc ps cmeeting_21st_sept2015_spacer_project_kp
 
Clahrc ps cmeeting_21st_sept2015_spacer_project_dt
Clahrc ps cmeeting_21st_sept2015_spacer_project_dtClahrc ps cmeeting_21st_sept2015_spacer_project_dt
Clahrc ps cmeeting_21st_sept2015_spacer_project_dt
 
Clahrc ps cmeeting_21st_sept2015_spacer_project_cc
Clahrc ps cmeeting_21st_sept2015_spacer_project_ccClahrc ps cmeeting_21st_sept2015_spacer_project_cc
Clahrc ps cmeeting_21st_sept2015_spacer_project_cc
 

Recently uploaded

Chapter 11 Nutrition and Chronic Diseases.pptx
Chapter 11 Nutrition and Chronic Diseases.pptxChapter 11 Nutrition and Chronic Diseases.pptx
Chapter 11 Nutrition and Chronic Diseases.pptx
Earlene McNair
 
CHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdfCHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdf
rishi2789
 
CHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdf
CHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdfCHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdf
CHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdf
rishi2789
 
CHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdf
CHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdfCHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdf
CHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdf
rishi2789
 
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
bkling
 
OCT Training Course for clinical practice Part 1
OCT Training Course for clinical practice Part 1OCT Training Course for clinical practice Part 1
OCT Training Course for clinical practice Part 1
KafrELShiekh University
 
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptxPost-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
FFragrant
 
Aortic Association CBL Pilot April 19 – 20 Bern
Aortic Association CBL Pilot April 19 – 20 BernAortic Association CBL Pilot April 19 – 20 Bern
Aortic Association CBL Pilot April 19 – 20 Bern
suvadeepdas911
 
Ketone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistryKetone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistry
Dhayanithi C
 
The Nervous and Chemical Regulation of Respiration
The Nervous and Chemical Regulation of RespirationThe Nervous and Chemical Regulation of Respiration
The Nervous and Chemical Regulation of Respiration
MedicoseAcademics
 
Identifying Major Symptoms of Slip Disc.
 Identifying Major Symptoms of Slip Disc. Identifying Major Symptoms of Slip Disc.
Identifying Major Symptoms of Slip Disc.
Gokuldas Hospital
 
LOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loop
LOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loopLOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loop
LOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loop
debosmitaasanyal1
 
TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...
TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...
TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...
Donc Test
 
Vestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptx
Vestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptxVestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptx
Vestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptx
Dr. Rabia Inam Gandapore
 
Clinic ^%[+27633867063*Abortion Pills For Sale In Tembisa Central
Clinic ^%[+27633867063*Abortion Pills For Sale In Tembisa CentralClinic ^%[+27633867063*Abortion Pills For Sale In Tembisa Central
Clinic ^%[+27633867063*Abortion Pills For Sale In Tembisa Central
19various
 
CHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdfCHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdf
rishi2789
 
Netter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdfNetter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdf
BrissaOrtiz3
 
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptxREGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
LaniyaNasrink
 
Top Effective Soaps for Fungal Skin Infections in India
Top Effective Soaps for Fungal Skin Infections in IndiaTop Effective Soaps for Fungal Skin Infections in India
Top Effective Soaps for Fungal Skin Infections in India
SwisschemDerma
 
Artificial Intelligence Symposium (THAIS)
Artificial Intelligence Symposium (THAIS)Artificial Intelligence Symposium (THAIS)
Artificial Intelligence Symposium (THAIS)
Josep Vidal-Alaball
 

Recently uploaded (20)

Chapter 11 Nutrition and Chronic Diseases.pptx
Chapter 11 Nutrition and Chronic Diseases.pptxChapter 11 Nutrition and Chronic Diseases.pptx
Chapter 11 Nutrition and Chronic Diseases.pptx
 
CHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdfCHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 1_ANTI TB DRUGS.pdf
 
CHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdf
CHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdfCHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdf
CHEMOTHERAPY_RDP_CHAPTER 6_Anti Malarial Drugs.pdf
 
CHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdf
CHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdfCHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdf
CHEMOTHERAPY_RDP_CHAPTER 3_ANTIFUNGAL AGENT.pdf
 
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
Part II - Body Grief: Losing parts of ourselves and our identity before, duri...
 
OCT Training Course for clinical practice Part 1
OCT Training Course for clinical practice Part 1OCT Training Course for clinical practice Part 1
OCT Training Course for clinical practice Part 1
 
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptxPost-Menstrual Smell- When to Suspect Vaginitis.pptx
Post-Menstrual Smell- When to Suspect Vaginitis.pptx
 
Aortic Association CBL Pilot April 19 – 20 Bern
Aortic Association CBL Pilot April 19 – 20 BernAortic Association CBL Pilot April 19 – 20 Bern
Aortic Association CBL Pilot April 19 – 20 Bern
 
Ketone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistryKetone bodies and metabolism-biochemistry
Ketone bodies and metabolism-biochemistry
 
The Nervous and Chemical Regulation of Respiration
The Nervous and Chemical Regulation of RespirationThe Nervous and Chemical Regulation of Respiration
The Nervous and Chemical Regulation of Respiration
 
Identifying Major Symptoms of Slip Disc.
 Identifying Major Symptoms of Slip Disc. Identifying Major Symptoms of Slip Disc.
Identifying Major Symptoms of Slip Disc.
 
LOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loop
LOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loopLOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loop
LOOPS in orthodontics t loop bull loop vertical loop mushroom loop stop loop
 
TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...
TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...
TEST BANK For Community and Public Health Nursing: Evidence for Practice, 3rd...
 
Vestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptx
Vestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptxVestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptx
Vestibulocochlear Nerve by Dr. Rabia Inam Gandapore.pptx
 
Clinic ^%[+27633867063*Abortion Pills For Sale In Tembisa Central
Clinic ^%[+27633867063*Abortion Pills For Sale In Tembisa CentralClinic ^%[+27633867063*Abortion Pills For Sale In Tembisa Central
Clinic ^%[+27633867063*Abortion Pills For Sale In Tembisa Central
 
CHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdfCHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdf
CHEMOTHERAPY_RDP_CHAPTER 4_ANTI VIRAL DRUGS.pdf
 
Netter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdfNetter's Atlas of Human Anatomy 7.ed.pdf
Netter's Atlas of Human Anatomy 7.ed.pdf
 
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptxREGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
REGULATION FOR COMBINATION PRODUCTS AND MEDICAL DEVICES.pptx
 
Top Effective Soaps for Fungal Skin Infections in India
Top Effective Soaps for Fungal Skin Infections in IndiaTop Effective Soaps for Fungal Skin Infections in India
Top Effective Soaps for Fungal Skin Infections in India
 
Artificial Intelligence Symposium (THAIS)
Artificial Intelligence Symposium (THAIS)Artificial Intelligence Symposium (THAIS)
Artificial Intelligence Symposium (THAIS)
 

Theme6 hemming what_is_sw-crt_virginia_conference_may2015

  • 1. 5/12/2015 1 Introduction: what is the SW-CRT? Defining features, common variations, and some salient examples Karla Hemming 12/05/2015 Why do we need another method of evaluation?
  • 2. 5/12/2015 2 Evaluation of policy and service delivery interventions • The Matching Michigan Study – Secular trend – Intervention effect • The Oregon Experiment – Randomised – No primary outcome • Mexican universal health insurance – 74 matched clusters – Staggered implementation Evidence based policy interventions Working constraints • Stakeholder’s desires • Pragmatic limitations • A priori beliefs How the SW-CRT can help • All clusters ultimately get intervention • Sequential roll out • Robust evaluation
  • 3. 5/12/2015 3 What is the SW-CRT? The Stepped Wedge Cluster Randomised Trial
  • 4. 5/12/2015 4 Example 1: A cross-sectional SW-CRT The EPOCH study – a cross sectional SW-CRT • Evidence based integrated care pathway (ICP) • Emergency laparotomy • Setting: – 90 hospitals • Outcome: – 90 day mortality • Sample size: – 27,500 patients – 90% power to detect a change from 25% to 22% • Routinely collected outcome – No consent Pearse R, Pedan C, Bion J, Faiz O, Holt P, Girling A, et al. HS&DR - 12/5005/10. Enhanced Peri-Operative Care for High-risk patients (EPOCH) trial: a stepped wedge cluster randomised trial of a quality improvement intervention for patients undergoing emergency laparotomy [protocol]. 2013. www.nets.nihr.ac.uk/projects/hsdr/12500510.
  • 5. 5/12/2015 5 Example 2: A cohort SW-CRT Depression management– a cohort SW-CRT • Structural multidisciplinary approach to depression management • Participants – Residents who provided informed consent • Setting: – 33 units within nursing homes (Dementia / Somatic) • Outcome: – Depression prevalence • Sample size: – 793 patients – 80% power to detect a 30 to 40% reduction in prevalence (circa 20-30%) • Outcome – Questionnaire (Cornell scale for depression) Leontjevas R, Gerritsen DL, Smalbrugge M, Teerenstra S, Vernooij-Dassen MJ, Koopmans RT. A structural multidisciplinary approach to depression management in nursing-home residents: a multicentre, stepped-wedge cluster-randomised trial. Lancet. 2013 Jun 9;381(9885):2255-64. doi: 10.1016/S0140-6736(13)60590-5. Epub 2013 May 2. PubMed PMID: 23643110.
  • 6. 5/12/2015 6 Example 3 – the Gambia hepatitis study The Gambia hepatitis study • Step lengths 10 to 12 weeks • National coverage after 4 years • Geographically defined areas • Study started 1980s – 30 year follow-up • Vaccine – efficacy against hep B • Main outcome – liver disease • Vaccine rolled out – national infant vaccination schedule
  • 7. 5/12/2015 7 Is the SW-CRT the right design for my trial? • Pragmatic considerations – Does it allow a randomised evaluation which otherwise would not be possible? • Logistical considerations – Allows sequential role out • Efficiency – Minimise number clusters / participants / observations • Duration – Will it necessarily extend the trial? – Time between exposure and follow-up Word of caution … • Lack of concealment of allocation – Risk of selection bias • Avoid individual patient recruitment – Routinely collected outcome data Chalmers: “Although one of the reasons that the streptomycin trial has become iconic is … random number tables …. it was because successful concealment of allocation”
  • 8. 5/12/2015 8 Example of a CRT with lack of concealment of allocation • Results in baseline imbalance • Due to recruitment of individuals after allocation known • Will it be better or worse in SW-CRT? Variations to the common design • More than two treatment comparisons • Hybrid designs – mixtures of parallel designs and stepped studies • Transition periods • Multiple levels (i.e. clustering within clustering) • Repeated measures (cohort designs)
  • 9. 5/12/2015 9 To follow…. • What sample size do I need? • What is the most efficient design? • How to extend the design to all for more than two treatments? • How do I analyse a SW-CRT? Summary • SW-CRT a pragmatic study design which reconciles the need for robust evaluations with political or logistical constraints. • Unbiased design when: – No individual patient recruitment (routinely collected outcome) • Efficient design when: – Higher the ICC (process outcomes) – Limited number of clusters • Design and analysis – Appropriate consideration of time effects in power and analysis
  • 10. 5/12/2015 10 References 1 (methodology) • Mdege ND, Man MS, Brown CATN, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. Journal of Clinical Epidemiology 2011; 64:936–948. • Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015 Feb 6;350:h391. doi: 10.1136/bmj.h391. PubMed PMID: 25662947. • Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182-91. References 2 (motivating examples) • Bion J, Richardson A, Hibbert P, Beer J, Abrusci T, McCutcheon M, et al. ‘Matching Michigan’: a 2-year stepped interventional programme to minimise central venous catheter-blood stream infections in intensive care units in England. BMJ Qual Saf2013;22:110-23 • Baicker K, Taubman SL, Allen HL, Bernstein M, Gruber JH, Newhouse JP, Schneider EC, Wright BJ, Zaslavsky AM, Finkelstein AN; Oregon Health Study Group, Carlson M, Edlund T, Gallia C, Smith J. The Oregon experiment--effects of Medicaid on clinical outcomes. N Engl J Med. 2013 May 2;368(18):1713-22. doi: 10.1056/NEJMsa1212321. PubMed PMID: 23635051; PubMed Central PMCID: PMC3701298. • King G, Gakidou E, Imai K, Lakin J, Moore RT, Nall C, Ravishankar N, Vargas M, Téllez-Rojo MM, Avila JE, Avila MH, Llamas HH. Public policy for the poor? A randomised assessment of the Mexican universal health insurance programme. Lancet. 2009 Apr 25;373(9673):1447-54. doi: 10.1016/S0140-6736(09)60239-7. Epub 2009 Apr 7. PubMed PMID: 19359034.