This document discusses measuring the effectiveness of mentoring and return on investment of coaching and mentoring programs. It provides examples of how to measure individual and organizational outcomes from these programs. Key measures include individual performance, skills development, relationship quality, retention rates, and organizational culture. The document also discusses establishing standards for coaching quality through coach assessments and certification.

1. Measuring the Effectiveness of Mentoring Professor David Clutterbuck and Lis Merrick

2. The RoI of Coaching & Mentoring How HR can achieve greatest value from investment in coaching & mentoring Professor David Clutterbuck

3. What issues do you need to address with regard to Coaching RoI, and why? © 2010 Clutterbuck Associates

4. The coaching spectrum Line manager coaching Off-line internal skills and behavioural coaching Internally resourced executive coaching Externally resourced executive coaching Mentoring © 2010 Clutterbuck Associates

5. How does responsibility for developing talent divide out between: Line manager? HR? Sponsor? Mentor? The learner ? Discussion: How clearly do people in your organisation understand their own and other players’ responsibilities? © 2010 Clutterbuck Associates

6. Problems measuring RoI in coaching Problems in measurement include: Short-term v long-term outcomes may conflict Goals are often emergent, not fixed at the beginning Easy fixes are the most easily measurable, but typically the least important in terms of value Client self-assessment is not a reliable measure © 2010 Clutterbuck Associates

7. Some elements of VFM Change is acknowledged and sustained Change affects more than just the client, but those they work with (i.e. it’s systemic) Cost is related to impact on the business Coaches’ relative competence is related to the level at which they operate © 2010 Clutterbuck Associates

8. Measuring the effectiveness of Line Manager coaching © 2010 Clutterbuck Associates

9. What drivers and impediments do you see for line manager coaching in your organization? © 2010 Clutterbuck Associates

10. Like a dance, effective coaching requires the active, informed cooperation of at least two people. Training a line manager as a coach and expecting the team to pick it up as they go is like a tango, where only one of the partners knows the steps! © 2010 Clutterbuck Associates

11. Elements of a systemic approach to coaching within the team Everyone learns at least the basics of coaching Everyone learns how to be coached Learning about coaching takes place over time, with opportunities to experiment and practise There is a positive psychological contract Everyone may be coached by anyone (including the leader/manager) There is ample time for reflection together © 2010 Clutterbuck Associates

12. Measuring line manager coaching Coaching behaviours of line manager Coaching behaviours of coachee/team member Relationship quality Broad individual outcomes: performance, learning, enabling, emotional Skinny individual outcomes: specific skills or behaviours Outcomes for other stakeholders: the team and other colleagues © 2010 Clutterbuck Associates

13. Measurement: coaching Process Performance Organisation system Team System Individual © 2010 Clutterbuck Associates

14. Assessing external executive coaches © 2010 Clutterbuck Associates

15. How do you know how the executive coaches you use compare to “world class” coaches? © 2010 Clutterbuck Associates

16. Why assess executive coaches? Coaching qualifications are not reliable indicators of competence and “fit”, in general Coach provider organisations cannot guarantee the suitability of all their coach pool Client feedback is not a reliable indicator of coach performance The coaching market is evolving rapidly – someone considered an effective, leading edge coach three years ago may be considered mediocre today, unless they have invested heavily in CPD © 2010 Clutterbuck Associates

17. Why an assessment centre? Assesses coaches from several perspectives (what they do, what they say, how they think) Provides a consistent benchmark, against which to compare candidate coaches Indicates that the organization is serious about the quality of the executive coaches it hires Educates people in the business about what to expect from good coaching Overcomes ad hoc hiring of “man in the bar” Enables HR to set bands of coaching capability and fees Major cost savings, both immediate and long term © 2010 Clutterbuck Associates

18. What makes an effective assessment centre? Clarity of the competences to be assessed Multiple perspectives on each competence Assessors are trained to ensure consistency of scoring Participants are clear about the purpose of each activity and what is being assessed Assessors have sufficient time between activities to reflect and confer Volunteers are briefed thoroughly about their role Confidentiality and participant safety Participant reflection is taken into account in the overall assessment Feedback to participants © 2010 Clutterbuck Associates

19. The key elements of a coach assessment centre Robust application process to identify suitable candidates Helping selected coaches prepare Psychological interview, to identify relevant personality and or other dysfunctions, which may cause concern Panel interview, to assess knowledge, CPD, ethicality, use of supervision, “organisational fit” and other aspects of practice “Real play” using executive volunteers Reflections by coachee Reflections by coach Feedback to coach © 2010 Clutterbuck Associates

20. Some critical questions How do we ensure the appropriate level of applicants? What do we do with existing executive coaches? What experienced resources (coaches, coaching psychologists etc) do we have in-house and what do we need to buy in? How will we manage the politics (internal and external)? What is our communication plan (internally and externally)? © 2010 Clutterbuck Associates

21. Where coaches most often fail to perform Use of supervision Managing boundaries Relevance and depth of CPD Commercial awareness – linking issues with the business context Defining their personal philosophy of coaching Over-dependence on simplistic models (e.g. GROW) Too narrow a portfolio of coaching approaches © 2010 Clutterbuck Associates

22. After the assessment centre Ranking the candidates Feedback to participants Induction of accredited pool Long-term supervision and development of the pool Internal communications Coach promotion © 2010 Clutterbuck Associates

23. Some lessons we’ve learned Don’t over-promise on the amount of feedback Maintain broad support from both HR and the line Have a process to ensure the safety of volunteers, who experience poor or dangerous coaching Professional organisations can be highly supportive and helpful Calibrate frequently © 2010 Clutterbuck Associates

24. What have we achieved? Removed poor and dangerous coaches Increased confidence of HR and the line in the quality of coaching provision Regularised executive coaching fees into bands according to level of client and intervention Potentially, reduced the average number of coaching sessions required (to be measured after a year) Raised the profile and awareness of coaching across the organisation Stimulated coaching pool providers to vet their coaches more thoroughly and regularly Contributed to raising coaching standards generally © 2010 Clutterbuck Associates

25. Evolution of coach competence © 2010 Clutterbuck Associates

26. What have you done/could you do to give internal coaches equal status with external? © 2010 Clutterbuck Associates

27. Measuring mentoring Longitudinal measures better than single point Individual outcomes: Career, developmental, enabling and emotional Organizational outcomes: retention, job commitment Programme quality: International Standards for Mentoring Programmes in Employment © 2010 Clutterbuck Associates

28. Sustaining RoI Some of the essential ingredients include: An influential head of coaching and mentoring Continued top level backing Links to HR systems and developmental priorities (e.g. diversity) and to CSR Opportunities for continuous development of internal coaches & mentors, and levels of qualification Measurement of relationship quality and coaching/mentoring behaviours, as well as outcomes © 2010 Clutterbuck Associates

29. Measuring mentoring Longitudinal measures better than single point Individual outcomes: Career, developmental, enabling and emotional Organizational outcomes: retention, job commitment Programme quality: International Standards for Mentoring Programmes in Employment © 2010 Clutterbuck Associates

30. Sustaining RoI Some of the essential ingredients include: An influential head of coaching and mentoring Continued top level backing Links to HR systems and developmental priorities (e.g. diversity) and to CSR Opportunities for continuous development of internal coaches & mentors, and levels of qualification Measurement of relationship quality and coaching/mentoring behaviours, as well as outcomes © 2010 Clutterbuck Associates

31. When to measure Before the programme start (Climate for mentoring + general participant expectations) At the beginning (Specific participant expectations) After 2/3 meetings (Is this a good match?) After 4-6 months (Are relationships working? What support do people need?) After 12 months (Short-term - mainly developmental - outcomes) After 24 months (Longer-term – career – outcomes)

32. 1. Individual Mentee and Mentor Development Through the organisation’s performance management system Promotion and retention figures Attitude questionnaires/360 degree feedback © Coach Mentoring Ltd 2008 11 January 2011 32

33. 2. Mentoring Relationships Number and frequency of meetings Average length of relationships Number of requests for new mentors Number of relationships with agreed contracts (if that is a voluntary process) Confidential 3rd party feedback © Coach Mentoring Ltd 2008 11 January 2011 33

34. 3. Evaluation of a Mentoring Programme Prog Level Rel Level Process Outputs

35. Final Evaluation Has the programme achieved its objectives? Have you evaluated change in skills/benefits obtained/feelings of participants/process effectiveness? How well did your process meet your needs? Return to organisation - Has it contributed to your overall development process? © Coach Mentoring Ltd 2008 11 January 2011 35

36. Validated scales Organisational context Goal clarity, commitment and alignment Mentoring behaviours (by both parties) Relationship quality Outcomes – career, developmental, enabling and emotional

37. Formal assessment: the ISMPE The International Standards for Mentoring Programmes in Employment cover: Clarity of purpose Stakeholder training and briefing Selecting and matching Measurement and review Ethics and pastoral care Support systems and administration

39. Gold schemes are among the most effective and well-managed in the world

41. Outcomes Hard measures of mentoring effectiveness Retention Appraisal scores Increased sales/outputs Proportion of proposals based on customer value-added Employee engagement data Diversity statistics Quality improvement data Actual promotions Quality improvement data Actual promotions Process Frequency of meetings Numbers of pairs that stay the course

43. Significant changes in behaviour or competence, as seen by mentee or via 360 feedback

44. Increased self-confidence

45. Improved work-life balance, stress etc

46. Improved work-life balance, stress etc

47. Process

48. Perception of relationship quality

50. Continuous improvement Measurement encourages good practice in mentoring dyads Communicate survey data to participants and sponsors – ask them to help contextualise responses and use them to initiate programme improvements Look for patterns in the data – e.g. Why do male mentees appear to be less trusting of their mentors than females? Conduct an annual programme review and make it part of your report to senior management Where appropriate, benchmark against other similar organisations

51. Discussion: How would you now respond if your CEO asked you to prove the RoI for coaching and mentoring in your organisation? © 2010 Clutterbuck Associates

52. Clutterbuck AssociatesTel: +44 (0)1628 606850Email: info@clutterbucksassociates.co.ukwww.gpcoachingandmentoring.com © 2010 Clutterbuck Associates