Expanding Possibilities<br />Program Evaluation Plan for <br />2009- 2011<br />Presented by Rob Rice, Ph.D., LMHC<br />Sep...
Rob Rice, Ph.D., LMHC<br />Ph.D., University of Rochester, April 2009<br />Director for Easter Seals New York, 2004-2009<b...
Program Evaluation Model for Expanding Possibilities<br />Martin, L. & Kettner, P. (2009). Measuring the Performance of Hu...
Output Performance Measures<br />Based on the following 2 grant priorities:<br />The percentage of relevant school personn...
Output Measure #1<br />Units of Service: One completed training of a school’s personnel <br />Completion of Service: 1 yea...
Output Measure #2<br />Units of Service: # of schools/community based organizations that receive technical assistance <br ...
Quality Performance Measures<br />Based on the following grant priority:<br />	All services will be provided in a linguist...
Quality Measures<br />Quality Dimension: Cultural Competence<br />Mid grant objective: The cultural competence of the prog...
Outcome Performance Measures<br />Based on the following 3 grant priorities:<br />The percentage of schools served by the ...
Outcome Measure #1<br />Linkage Protocols<br />Objective: All 27 TST BOCES and component schools will have linkage protoco...
Outcome Measure #2<br />Student Access<br />Method of Evaluation: referrals for mental health services will be tracked by ...
Exactly What We Need From You<br />Schools must identify appropriate staff to complete Likertbased survey intended to meas...
How to Reach Me<br />Cell (585) 727-4811<br />Office (585) 385-7318<br />E-mail: rrice@sjfc.edu<br />
Upcoming SlideShare
Loading in...5
×

Expanding Possibilities Program Evaluation

353

Published on

Program Evaluation Plan for Expanding Possibilities Program

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
353
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Expanding Possibilities Program Evaluation

  1. 1. Expanding Possibilities<br />Program Evaluation Plan for <br />2009- 2011<br />Presented by Rob Rice, Ph.D., LMHC<br />September 24th, 2009<br />
  2. 2. Rob Rice, Ph.D., LMHC<br />Ph.D., University of Rochester, April 2009<br />Director for Easter Seals New York, 2004-2009<br />Currently a full time faculty member in the St. John Fisher College Masters Program in Mental Health Counseling<br />Excited about the Expanding Possibilities Project!<br />
  3. 3. Program Evaluation Model for Expanding Possibilities<br />Martin, L. & Kettner, P. (2009). Measuring the Performance of Human Service Programs, 2nd Ed. SAGE Publishing. <br />Basic Systems Model<br />Expanded Systems Model<br />Inputs<br />Process (treatment plan or service delivery methodology)<br />Output<br />Quality (e.g., responsiveness, strength-based, etc.)<br />Outcomes (results)<br />Feedback<br />
  4. 4. Output Performance Measures<br />Based on the following 2 grant priorities:<br />The percentage of relevant school personnel, community based organizations, and families served by the grant trained to make appropriate referrals.<br />Provide technical assistance and consultation to each school, community based organizations, and families participating in the program.<br />
  5. 5. Output Measure #1<br />Units of Service: One completed training of a school’s personnel <br />Completion of Service: 1 year<br />Mid-grant objective: 50% of the relevant school mental health staff is trained to make appropriate referrals to mental health services<br />End of grant objective: 95% of the relevant school mental health staff is trained to make appropriate referrals to mental health services.<br />Method of Evaluation: The director will collect and report data to the program evaluator on a monthly basis<br />
  6. 6. Output Measure #2<br />Units of Service: # of schools/community based organizations that receive technical assistance <br />Completion of Service: 1 year<br />Mid-grant objective: 18 of the 27 schools and five community based organizations have received technical assistance and consultation from the program.<br />End of grant objective: all 27 schools and at least 8 community based organizations<br />Method of Evaluation: The director will collect and report data to the program evaluator on a monthly basis<br />
  7. 7. Quality Performance Measures<br />Based on the following grant priority:<br /> All services will be provided in a linguistically appropriate and culturally competent method.<br />
  8. 8. Quality Measures<br />Quality Dimension: Cultural Competence<br />Mid grant objective: The cultural competence of the program will increase by 8%<br />End of grant objective: The cultural competence of the program will increase by 15%<br />Method of Evaluation: Likert based survey will be provided to families, schools, and mental health agencies<br />This survey will also endeavor to capture valuable data related to other quality dimensions important to the program (e.g., strength-based, solution-focused)<br />
  9. 9. Outcome Performance Measures<br />Based on the following 3 grant priorities:<br />The percentage of schools served by the grant that have comprehensive, detailed linkage protocols in place.<br />Improve linkages with all mental health community based organizations and government entities in Seneca and Tompkins County.<br />The program’s effectiveness will be evaluated as to the effectiveness of the program in increasing student access to mental health services and recommendations will be made to the Secretary of Education about the sustainability of the program.<br />
  10. 10. Outcome Measure #1<br />Linkage Protocols<br />Objective: All 27 TST BOCES and component schools will have linkage protocols in place.<br />Method of Evaluation: The existence of linkage protocols will be verified with the principle of each school. <br />Relevant school staff will receive a Likert based survey intended to measure dimensions such as collaboration, accessibility , ease, responsiveness, effectiveness, sustainability, leadership, policies, resources, political climate, connectedness, community understanding, stigma, and other indicators. <br />The increase in reported results will indicate the improvement in the system. <br />
  11. 11. Outcome Measure #2<br />Student Access<br />Method of Evaluation: referrals for mental health services will be tracked by the school staff appointed to serve as the point person for the Expanding Possibilities Program. This data will be communicated to the Program Evaluator monthly.<br />The independent evaluator will provide a baseline, first year, and second year evaluation of the program.<br />
  12. 12. Exactly What We Need From You<br />Schools must identify appropriate staff to complete Likertbased survey intended to measure dimensions such as collaboration, accessibility , ease, responsiveness, effectiveness, sustainability, leadership, policies, resources, political climate, connectedness, community understanding, stigma, and other indicators. At a recent meeting, the Expanding Possibilities Team suggested using the newly formed linkage committees for this purpose. (Outcome Measure #1) TIMEFRAME: 12/09, 9/10, 9/11<br />School point people must begin tracking referrals for mental health services and communicate this data to the Program Evaluator monthly (Outcome Measure #2) TIMEFRAME: begin reporting 11/09<br />
  13. 13. How to Reach Me<br />Cell (585) 727-4811<br />Office (585) 385-7318<br />E-mail: rrice@sjfc.edu<br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×