Research In Action #2


Published on

Issue 2: Effectiveness of Mentoring Program Practices.

This series was developed by MENTOR and translates the latest mentoring research into tangible strategies for mentoring practitioners. Research In Action (RIA) makes the best available research accessible and relevant to the mentoring field.

Published in: Health & Medicine, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Research In Action #2

  1. 1. Research in Action Series Effectiveness of Mentoring Program Practices
  2. 2. Overview of Research in Action Series <ul><li>MENTOR has developed an innovative series - Research in Action </li></ul><ul><li>Translates the latest research on mentoring into tangible strategies for mentoring practitioners. </li></ul><ul><li>Makes the best available research accessible and relevant to the mentoring field.   </li></ul><ul><li>Using the Research in Action series, programs can ensure their practices are based on current research, resulting in improved services and better impacts for young people. </li></ul>
  3. 3. <ul><li>10 issues </li></ul><ul><li>Each issue provides:   </li></ul><ul><ul><li>Research </li></ul></ul><ul><ul><li>Action </li></ul></ul><ul><ul><li>Resources </li></ul></ul>Overview of Research in Action Series
  4. 4. Research in Action Issues: <ul><li>Mentoring: A Key Resource for Promoting Positive Youth Development </li></ul><ul><li>Effectiveness of Mentoring Program Practices </li></ul><ul><li>Program Staff in Youth Mentoring Programs: Qualifications, Training, and Retention </li></ul><ul><li>Fostering Close and Effective Relationships in Youth Mentoring Programs </li></ul><ul><li>Why Youth Mentoring Relationships End </li></ul><ul><li>School-Based Mentoring </li></ul><ul><li>Cross-Age Peer Mentoring </li></ul><ul><li>Mentoring Across Generations: Engaging 50+ Adults as Mentors </li></ul><ul><li>Youth Mentoring: Do Race and Ethnicity Really Matter? </li></ul><ul><li>Mentoring: A Promising Intervention for Children of Prisoners </li></ul>
  5. 5. Issue 2: Program Effectiveness <ul><li>Download this issue by visiting </li></ul><ul><li>The research section of this issue was written by David L. DuBois, Ph.D., University of Illinois at Chicago </li></ul>
  6. 6. Objective of Mentoring <ul><li>The central objective of any youth mentoring program is to establish and support beneficial relationships between youth and their identified mentors. </li></ul>
  7. 7. Objective of Mentoring <ul><li>High-quality programs establish and support relationships that are: </li></ul><ul><ul><li>Effective </li></ul></ul><ul><ul><li>Safe </li></ul></ul><ul><ul><li>Efficient </li></ul></ul><ul><ul><li>Sustainable/growth-oriented </li></ul></ul>
  8. 8. Effectiveness vs. Quality <ul><li>Program Effectiveness </li></ul><ul><li>Impacts on mentoring relationship quality </li></ul><ul><li>Youth outcomes </li></ul><ul><li>Program Quality </li></ul><ul><li>Safety </li></ul><ul><li>Efficiency </li></ul><ul><li>Sustainability </li></ul>
  9. 9. Program Effectiveness Problem DuBois, Holloway, Valentine, & Cooper, 2002
  10. 10. Mentoring Best Practices: Circles of Evidence Best Practices * Includes evidence obtained from sources other than formal research, such as client satisfaction surveys, program participant outcomes, and community demographic trends. Research * Professional Expertise & Experience *Local Resources & Needs *Client/Stakeholder Preferences & Beliefs
  11. 11. Conceptual and Methodological Issues <ul><li>Effects of any practice on program effectiveness will be dependent on a range of other factors </li></ul><ul><li>“ Local adaptation-fidelity debate” </li></ul><ul><li>Clear guidelines/benchmarks needed to assess presence or absence of evidence-based practices </li></ul>
  12. 12. Sources of Evidence <ul><li>Both formal research literature and internal analyses of information by mentoring programs are potentially relevant to evaluating the effectiveness of a practice. </li></ul>
  13. 13. Research on Program Practices <ul><li>Descriptive Studies </li></ul><ul><li>Highlight important trends that merit further investigation </li></ul><ul><li>Provide information concerning the extent to which evidence-based practices are being adopted and adapted </li></ul>MENTORING IN AMERICA 2005
  14. 14. Researching Program Practices <ul><li>Typical program evaluation is designed to estimate cumulative effects that are produced by the multiple practices that comprise a given program rather than the unique contribution of any one practice </li></ul>
  15. 15. Meta-Analysis <ul><li>Program practices predictive of stronger positive effects on youth outcomes </li></ul>(DuBois et al., 2002) Structured activities for mentors and youth Ongoing (post-match) training for mentors Clearly established expectations for frequency of mentor-youth contact Using mentors with backgrounds in helping roles or professions Use of community settings for mentoring Procedures for systematic monitoring of program implementation Support for parent involvement
  16. 16. Pre-Match Training <ul><li>Available evidence regarding the effectiveness of pre-match training for mentors is mixed </li></ul><ul><ul><li>Meta-analysis found that the youth outcomes were not significantly greater </li></ul></ul><ul><ul><li>A 2002 study found that mentors with less than two hours of training reported the least close relationship; those with more than six hours reported the closest relationships </li></ul></ul><ul><ul><li>A 1993 study found indicators of quality relationships did not vary significantly between those who received training and those who did not </li></ul></ul>
  17. 17. Conclusions <ul><li>This issue provides practitioners with a framework to examine research in the field of mentoring. This research is in the early stages and this makes it difficult to make informed decisions in regard to program practice. There is still much to study. </li></ul>
  18. 18. Action: Evaluation <ul><li>Program evaluation can measure </li></ul><ul><ul><li>Youth outcomes </li></ul></ul><ul><ul><li>Program processes </li></ul></ul><ul><ul><li>Specific program practices </li></ul></ul>
  19. 19. Evaluating Program Practices <ul><li>Step One: Identify problem, challenge, or opportunity </li></ul><ul><li>Step Two: Develop a hypothesis or prediction </li></ul><ul><li>Step Three: Determine which practice to assess </li></ul>
  20. 20. Evaluating Program Practices <ul><li>Step Four: Formulate the research question </li></ul><ul><li>Step Five: Design the evaluation </li></ul><ul><li>Step Six: Collect and analyze the data </li></ul><ul><li>Step Seven: Use the results </li></ul>
  21. 21. Resources <ul><li>Information Technology International (ITI) </li></ul><ul><li>ITI provides professional, programmatic, and technical support to government and industry. </li></ul><ul><li> </li></ul><ul><li>Evaluating your Program: A Beginner’s Self-Evaluation Workbook for Mentoring Programs. </li></ul><ul><li> </li></ul>
  22. 22. Resources <ul><li>MENTOR/National Mentoring Partnership </li></ul><ul><li> </li></ul><ul><li>The leader in expanding the power of mentoring to millions of young Americans who want and need adult mentors. </li></ul><ul><ul><li>The Elements of Effective Practice </li></ul></ul><ul><ul><li>How to Build a Successful Mentoring Program Using the Elements of Effective Practice™ </li></ul></ul><ul><ul><li>How to Select a Survey to Assess Your Adult-Youth Mentoring Program </li></ul></ul>
  23. 23. Resources <ul><li>Northwest Regional Educational Laboratory: National Mentoring Center </li></ul><ul><li> </li></ul><ul><li>National organization that provides training and technical assistance to youth mentoring programs. </li></ul><ul><ul><li>Frequently Asked Questions About Research and Evaluation </li></ul></ul><ul><ul><li>Measuring the Quality of Mentor Youth Relationships: A Tool for Mentoring Programs </li></ul></ul>
  24. 24. Resources <ul><li>Search Institute </li></ul><ul><li> </li></ul><ul><li>Provides leadership, information, and resources to promote positive healthy development of youth. </li></ul><ul><li>What's Working? Tools for Evaluating Your Mentoring Program </li></ul><ul><ul><li>Now available as a free download </li></ul></ul>
  25. 25. Resources
  26. 26. Michigan Resources <ul><li>Mentor Michigan </li></ul><ul><li> </li></ul><ul><li>MSU Extension </li></ul><ul><li> </li></ul>
  27. 27. <ul><li>This presentation provides an overview of Research in Action Issue 2: </li></ul><ul><li>Effectiveness of Mentoring Program Practices </li></ul><ul><li>This tool was produced by MENTOR/The National Mentoring Partnership </li></ul>