Presentation evidence base website


Published on

Published in: Education, Health & Medicine
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Presentation evidence base website

  1. 1. Drug and alcohol prevention How do we find out what works?
  2. 2. Many people worryabout the use ofdrugs (includingalcohol and tobacco)by young people
  3. 3. There are many interventions - inschools, families and the community - which claim to reduce drug misuse.
  4. 4. ? ?How can we test whether they actually work? ? ?
  5. 5. Higher quality trials give more certaintyabout results Randomised controlled trial Best practice Statistically matched control group Before and after data with a control group Before and after data
  6. 6. Measure outcomes before and after intervention 5% Percent 4% 4.0% 3.5% drinking 3% alcohol in past week 2% 1% 0% Before After Intervention What does this tell us? Very little without a control group.
  7. 7. With a control group... 5% 4.7% ControlPercent 4% 4.0% Smaller increase in 3.5%drinking drinking in 3% 3.2%alcohol in intervention grouppast week 2% 1% 0% Before After Intervention
  8. 8. What do we know about the control group?The following methods give increasing confidence thatthe comparison is a fair one:• Common sense – avoiding obvious pitfalls such as those trying out the intervention tending to be in more prosperous areas.• Statistical ‘matching’ techniques using more information about individuals in the groups.• Random allocation between the intervention and control groups: this is called a “Randomised controlled trial”
  9. 9. Randomised controlled trials (RCTs) arethe ‘gold standard’ for measuring impact
  10. 10. Sample size matters• This is because a behaviour (for example drinking in the past week) will vary between individuals across the wider population.• If a sample of 1000 15 year olds in London are randomly selected and 200 (20%) drank in the past week, you can be confident that the true percentage for all 15 year olds in London is fairly close to 20%.• In contrast, if you select ten young people at random and two of them drank in the past week, that doesn’t tell you much at all.
  11. 11. Statistical analysis• So, as well as looking at the size of the difference between your intervention and control groups, the size of your sample is also important.• Larger samples give more confidence that the difference between two groups is genuine and not due to random variation.• Once it is calculated as being sufficiently unlikely (less than a 5% chance) that the result is due to random variation, the finding is said to be ‘statistically significant’.
  12. 12. Find out more...• The Centre for Analysis of Youth Transitions (CAYT) is creating a repository of impact studies on young people’s services and programmes -• European Quality Standards have been developed for drug prevention and contain useful information on evaluating outcomes. evention-standards• ‘Test, Learn, Adapt: Developing Public Policy with Randomised Controlled Trials’ is a more general discussion of RCTs in public policy
  13. 13. floor, 67 – 69 Cowcross StreetLondonEC1M 6PURegistered Charity No: 1112339Registered Company No: 5609241Scottish Charity No: SC041210