Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Dmi Evaluation Mcgarrell


Published on

Published in: Education, Business
  • Be the first to comment

  • Be the first to like this

Dmi Evaluation Mcgarrell

  1. 1. Evaluating the Drug Market Intervention Initiative BJA Drug Market Intervention Workshop July 2009
  2. 2. Evaluation Issues <ul><li>How will we know if DMI made a difference? </li></ul><ul><li>Need to measure and understand – what we did </li></ul><ul><li>Impact on neighborhood, citizens, individuals </li></ul><ul><li>Utilizing multiple measures </li></ul><ul><li>Compared to what? </li></ul>
  3. 3. Evaluation Issues <ul><li>Evaluation includes both an assessment of what was done and whether it had an impact </li></ul><ul><li>Process Evaluation </li></ul><ul><ul><li>Program monitoring (“outputs”) </li></ul></ul><ul><li>Outcome Evaluation </li></ul><ul><ul><li>What are you trying to affect? (“outcomes”) </li></ul></ul>
  4. 4. Design Issues- Comparisons <ul><li>Pre/post design </li></ul><ul><li>Trends </li></ul><ul><li>Comparison groups </li></ul><ul><ul><li>DMI target areas compared to drug market areas not receiving intensive intervention </li></ul></ul><ul><ul><li>Drug market offenders involved DMI compared to those involved in traditional enforcement </li></ul></ul><ul><ul><li>Surrounding areas to examine “displacement” and “diffusion of benefits” </li></ul></ul>
  5. 5. Possible Data Sources – Individual Impact <ul><li>Program records (e.g., clients served) </li></ul><ul><li>Probation/parole history </li></ul><ul><ul><li>Meeting attendance </li></ul></ul><ul><ul><li>Number of visits (i.e. home visits) </li></ul></ul><ul><ul><li>Employment status </li></ul></ul><ul><ul><li>Urine testing </li></ul></ul><ul><li>Criminal history data </li></ul><ul><ul><li>Pre/post intervention </li></ul></ul><ul><ul><li>Arrest, conviction, sentencing </li></ul></ul>
  6. 6. Possible Data Sources – Individual Impact <ul><li>Self report data (e.g. survey or interview*) </li></ul><ul><ul><li>Perception of risk (victimization; enforcement) </li></ul></ul><ul><ul><li>Self-reported offenses </li></ul></ul><ul><ul><li>Gun carrying behavior </li></ul></ul><ul><ul><li>* Sample surveys available at </li></ul></ul>
  7. 7. Possible Data Sources – Community Impact <ul><li>Law enforcement data </li></ul><ul><ul><li>Offenses known to police by various offense types </li></ul></ul><ul><ul><li>Arrests </li></ul></ul><ul><ul><li>Calls for police service </li></ul></ul><ul><li>Community survey </li></ul><ul><li>Interviews/focus groups with residents </li></ul><ul><li>Systematic observation/ethnographic approaches </li></ul>
  8. 8. Outcome Measures (Individual Level) <ul><li>Employment </li></ul><ul><li>Participation in social service programs </li></ul><ul><ul><li>Education, substance abuse counseling, food, clothing, housing </li></ul></ul><ul><li>Arrest records </li></ul><ul><ul><li>Prevalence </li></ul></ul><ul><ul><li>Incidence </li></ul></ul><ul><ul><li>Location of new arrests (assess displacement) </li></ul></ul><ul><li>Contact with law enforcement/courts </li></ul>
  9. 9. Outcome Measures (Individual Level) <ul><li>Perceptions of the certainty and severity of punishment (deterrence) </li></ul><ul><li>Perceptions of social support services </li></ul><ul><li>Perceptions of procedural and substantive justice </li></ul><ul><li>Perceptions of police and the criminal justice system </li></ul><ul><ul><li>Trust in police </li></ul></ul>
  10. 10. Outcome Measures (Community Level) <ul><li>Drug hotline reports </li></ul><ul><li>Calls for service </li></ul><ul><li>Drug buy attempts </li></ul><ul><li>Crime incidents </li></ul><ul><ul><li>Property; Violent; Drug-related; Total Gun Crime </li></ul></ul>
  11. 11. Outcome Measures (Community Level) <ul><li>Perceptions of neighborhood residents and influentials – “quality of life” </li></ul><ul><ul><li>Perceived changes in levels of crime </li></ul></ul><ul><ul><li>Perceived changes in level of physical and social disorder </li></ul></ul><ul><ul><li>Perceptions of neighborhood safety/fear of crime </li></ul></ul><ul><ul><li>Neighborhood cohesion/relations </li></ul></ul><ul><ul><li>Collective efficacy (neighbors willing to look out for others and area) </li></ul></ul><ul><ul><li>Perceptions of the police and justice system </li></ul></ul>
  12. 12. Summary <ul><li>Greatest impact is likely at the neighborhood level </li></ul><ul><li>Showing results will buy support </li></ul><ul><li>Assistance is available </li></ul><ul><ul><li>MSU technical assistance role to support evaluation </li></ul></ul>