Overview of YOSEC Development and use of the Youth Offending Services Effectiveness Checklist All intellectual property ri...
YOSEC – what is it?! <ul><li>Youth Offending Services Effectiveness Checklist </li></ul><ul><li>Checks how much of ‘what w...
Main YOSEC documents
History of YOSEC <ul><li>Long-held dream of mine </li></ul><ul><li>Funded by multiple youth  justice agencies in NZ who co...
YOSEC – aims  <ul><li>Help funders makes decisions on who to fund, taking into account how much of  ‘what works’ a provide...
Informing funding <ul><li>Funding systems lack way of assessing fit with evidence-base </li></ul><ul><li>Funders can quick...
Two halves of the apple <ul><li>Programme capability AND likely impact on crime </li></ul><ul><li>Capability only can mean...
The impact of doing ‘what works’ <ul><li>1/Provide more hours of services to high risk - 10% less crime </li></ul><ul><li>...
Aiding provider development <ul><li>Works like a mirror – hold up to provider </li></ul><ul><li>to see areas that are  </l...
Aiding provider development 2 <ul><li>Means you know what  to work on and what to  spend money on </li></ul><ul><li>Helps ...
Development process <ul><li>I systematically reviewed international research on ‘what works’  </li></ul><ul><li>Converted ...
Development process <ul><li>Held 6 national consultation meetings with youth justice and cultural experts </li></ul><ul><l...
Cultural consultation process <ul><li>Included Maori and Pacific cultural and programme experts in initial six consultatio...
Cultural consultation process <ul><li>3 days of hui with Maori cultural experts </li></ul><ul><li>3 days fono with Pacific...
Cultural sections <ul><li>Only one section is specifically about ‘culture’ </li></ul><ul><li>Cultural issues built into mo...
Flow chart of using YOSEC
Who fills it out <ul><li>Designed to be self-administered by provider – ‘fudge factor’ </li></ul><ul><li>Independent asses...
How long it takes to do <ul><li>Both long and short versions take 1.5 to 3 hours to fill in </li></ul><ul><li>Depends on h...
YOSEC meetings are not like this!
How long it takes to do <ul><li>Doing development plan  takes a few more hours </li></ul><ul><li>Less than half the checkl...
Eg of detailed action plan   Date: 1 February 2007   Item no YOSEC score  Action plan to build or protect strengths Do by ...
Using YOSEC over time <ul><li>Can do YOSEC more than once – cheap and quick (relatively speaking) </li></ul><ul><li>Shows ...
Considerations re funding <ul><li>Suggest don’t cut or stop programme funding after first YOSEC assessment </li></ul><ul><...
Considerations re funding <ul><li>Recommend doing development for at least one year before re-assessing </li></ul><ul><li>...
Main provider concerns <ul><li>Very busy – YOSEC another thing to fit into a hectic schedule </li></ul><ul><li>Already hav...
Main provider concerns <ul><li>Anxious about impact on funding, scared of losing it </li></ul><ul><li>May not interested i...
Addressing provider concerns <ul><li>Important to find out what concerns are and reassure providers </li></ul><ul><li>Cove...
Incentives to do YOSEC <ul><li>Pay provider for time doing YOSEC </li></ul><ul><li>Guarantee not to stop funding for speci...
Upcoming SlideShare
Loading in …5
×

YOSEC - Assessing how much of 'what works' programmes do - Kaye McLaren

736 views
658 views

Published on

Published in: Business, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
736
On SlideShare
0
From Embeds
0
Number of Embeds
29
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • YOSEC - Assessing how much of 'what works' programmes do - Kaye McLaren

    1. 1. Overview of YOSEC Development and use of the Youth Offending Services Effectiveness Checklist All intellectual property rights and copyright for this presentation held by Kaye McLaren. To be used only with her permission. [email_address]
    2. 2. YOSEC – what is it?! <ul><li>Youth Offending Services Effectiveness Checklist </li></ul><ul><li>Checks how much of ‘what works’ to reduce youth offending a programme is actually doing </li></ul>
    3. 3. Main YOSEC documents
    4. 4. History of YOSEC <ul><li>Long-held dream of mine </li></ul><ul><li>Funded by multiple youth justice agencies in NZ who could see the potential </li></ul><ul><li>No changes without my agreement – protects YOSEC quality </li></ul>
    5. 5. YOSEC – aims <ul><li>Help funders makes decisions on who to fund, taking into account how much of ‘what works’ a provider is doing </li></ul><ul><li>Help providers identify their strengths to protect, and where it’s worth putting time and money into development </li></ul>
    6. 6. Informing funding <ul><li>Funding systems lack way of assessing fit with evidence-base </li></ul><ul><li>Funders can quickly and easily assess this using YOSEC </li></ul>
    7. 7. Two halves of the apple <ul><li>Programme capability AND likely impact on crime </li></ul><ul><li>Capability only can mean no </li></ul><ul><li>less crime or even more crime </li></ul><ul><li>‘ What works’ only can mean </li></ul><ul><li>effective programmes fall over </li></ul>
    8. 8. The impact of doing ‘what works’ <ul><li>1/Provide more hours of services to high risk - 10% less crime </li></ul><ul><li>2/ Target factors known to be causally linked to crime - 19% less crime </li></ul><ul><li>3/ Use behavioural techniques - 23% less crime </li></ul><ul><li>Do all three = 32% reduction in reoffending </li></ul><ul><li>Do none = 7% increase in reoffending </li></ul>
    9. 9. Aiding provider development <ul><li>Works like a mirror – hold up to provider </li></ul><ul><li>to see areas that are </li></ul><ul><li>looking good </li></ul><ul><li>and those that are not so flash! </li></ul>
    10. 10. Aiding provider development 2 <ul><li>Means you know what to work on and what to spend money on </li></ul><ul><li>Helps funders identify what development to fund most urgently </li></ul>
    11. 11. Development process <ul><li>I systematically reviewed international research on ‘what works’ </li></ul><ul><li>Converted findings into a draft checklist </li></ul><ul><li>Wrote programme development guide </li></ul>
    12. 12. Development process <ul><li>Held 6 national consultation meetings with youth justice and cultural experts </li></ul><ul><li>Revised checklist and did scoring guide – marathon task! </li></ul>
    13. 13. Cultural consultation process <ul><li>Included Maori and Pacific cultural and programme experts in initial six consultation meetings nationwide </li></ul><ul><li>Reviewed cultural research </li></ul><ul><li>My research reviewed by a cultural expert </li></ul>
    14. 14. Cultural consultation process <ul><li>3 days of hui with Maori cultural experts </li></ul><ul><li>3 days fono with Pacific cultural experts </li></ul><ul><li>Largely happy but had some suggestions for improving it </li></ul>
    15. 15. Cultural sections <ul><li>Only one section is specifically about ‘culture’ </li></ul><ul><li>Cultural issues built into most questions </li></ul><ul><li>Reflects idea that cultural practice is normal good practice </li></ul>
    16. 16. Flow chart of using YOSEC
    17. 17. Who fills it out <ul><li>Designed to be self-administered by provider – ‘fudge factor’ </li></ul><ul><li>Independent assessment is more reliable and builds partnership </li></ul><ul><li>Surprised by funder willingness to train and resource assessment staff </li></ul>
    18. 18. How long it takes to do <ul><li>Both long and short versions take 1.5 to 3 hours to fill in </li></ul><ul><li>Depends on how much people talk! </li></ul><ul><li>Then more time for looking at documentation or talk to stakeholders – worth it for extra accuracy </li></ul>
    19. 19. YOSEC meetings are not like this!
    20. 20. How long it takes to do <ul><li>Doing development plan takes a few more hours </li></ul><ul><li>Less than half the checklist is questions - less pages wouldn’t mean less time </li></ul><ul><li>To get information any other way takes months or even years </li></ul><ul><li>Involves process or outcome evaluation </li></ul>
    21. 21. Eg of detailed action plan   Date: 1 February 2007   Item no YOSEC score Action plan to build or protect strengths Do by date     Level 1 items   B1 Engaging with clients     1 Train and encourage staff to be supportive in practical ways, e.g. helping with benefit hassles, food or transport          In staff meeting identify main areas of practical help we can provide by brain storming then choosing the most viable ones (Staff responsible: NAME)          Develop brief training session of information and skills needed to provide this help (Staff responsible: NAME)          Develop information kit on relevant services e.g. benefits, policy on transporting clients etc (Staff responsible: NAME) 1 Feb 08     1 April 07     1 June 07     1 June 07
    22. 22. Using YOSEC over time <ul><li>Can do YOSEC more than once – cheap and quick (relatively speaking) </li></ul><ul><li>Shows you where programme got closer to ‘what works’ over time </li></ul><ul><li>Obvious where strengths drifted </li></ul><ul><li>Can track what actions still need doing </li></ul>
    23. 23. Considerations re funding <ul><li>Suggest don’t cut or stop programme funding after first YOSEC assessment </li></ul><ul><li>Not fair to providers – historically been little development and training in ‘what works’ in New Zealand </li></ul><ul><li>‘ Throw money at it and hope for the best’ </li></ul>
    24. 24. Considerations re funding <ul><li>Recommend doing development for at least one year before re-assessing </li></ul><ul><li>YOSEC score not only reason for cutting funding – how well staff relate to clients, how willing they are to change </li></ul><ul><li>Recommend funding </li></ul><ul><li>for development </li></ul>
    25. 25. Main provider concerns <ul><li>Very busy – YOSEC another thing to fit into a hectic schedule </li></ul><ul><li>Already have a </li></ul><ul><li>lot of compliance </li></ul><ul><li>paperwork which </li></ul><ul><li>they are not paid </li></ul><ul><li>to do </li></ul>
    26. 26. Main provider concerns <ul><li>Anxious about impact on funding, scared of losing it </li></ul><ul><li>May not interested in changing programme – think it’s good enough already </li></ul>
    27. 27. Addressing provider concerns <ul><li>Important to find out what concerns are and reassure providers </li></ul><ul><li>Cover how to do </li></ul><ul><li>this in training </li></ul><ul><li>Using a powerpoint presentation like this at the start can help the provider </li></ul>
    28. 28. Incentives to do YOSEC <ul><li>Pay provider for time doing YOSEC </li></ul><ul><li>Guarantee not to stop funding for specific development period </li></ul><ul><li>Tag YOSEC reports to funding applications </li></ul><ul><li>Provide a significant development fund </li></ul>

    ×