Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Spotlight: Self Evaluation Tool for Action in Partnership

193 views

Published on

Self Evaluation Tool for Action in Partnership

This tool provides members of a partnership with the opportunity to express perceptions and opinions on their partnership experiences. The tool’s 18 items are related to the following six requirements for effective partnership work:
1. the range of perspectives relevant to the issue
2. early stakeholder involvement in strategic decisions
3. engagement of stakeholders in negotiating and influencing
decisions
4. commitment of strategic and pivotal stakeholders to the project
5. partnership arrangements that favour equalization of power
among the stakeholders
6. partnership arrangements that help build collective action

How can the Self-evaluation Tool for Action in Partnership help you?

Public health professionals collaborate with others and participate in partnerships throughout their careers. This tool allows members of partnerships to evaluate themselves and learn about the requirements for effective partnership work. This tool is an English translation/adaptation of the Outil diagnostique de l’action en partenariat, created in French, in Québec, in 2008. It is now available in both official languages and can facilitate bilingual evaluation within or across partnerships. The target audience for the Self-evaluation Tool for Action in Partnership also includes any members of a partnership who have decided to participate in self-evaluation.

Click here to access the tool: http://www.nccmt.ca/knowledge-repositories/search/316

Click here to access additional references and resources: https://www.slideshare.net/NCCMT/selfevaluation-tool-for-action-in-partnershiploutil-diagnostique-de-laction-en-partenariat-references-resourcesrfrences-et-ressources.

The National Collaborating Centre for Methods and Tools (NCCMT) is funded by the Public Health Agency of Canada and affiliated with McMaster University. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada.

NCCMT is one of six National Collaborating Centres (NCCs) for Public Health. The Centres promote and improve the use of scientific research and other knowledge to strengthen public health practices and policies in Canada.

Published in: Education
  • Be the first to comment

  • Be the first to like this

Spotlight: Self Evaluation Tool for Action in Partnership

  1. 1. Follow us @nccmt Suivez-nous @ccnmo Self-evaluation Tool for Action in Partnership Presenters: Angèle Bilodeau, PhD Gillian Kranias, MES Julia Fursova, PhD(c), MAEd, MPH February 27, 2019 1:00 - 2:30 PM EST
  2. 2. Follow us @nccmt Suivez-nous @ccnmo 2 Housekeeping Use Chat to post comments and/or questions during the webinar • ‘Send’ questions to All (not privately to ‘Host’) Connection issues • Recommend using a wired Internet connection (vs. wireless), • WebEx 24/7 help line • 1-866-229-3239 Participant Side Panel in WebEx Chat
  3. 3. Follow us @nccmt Suivez-nous @ccnmo After Today 3 The PowerPoint presentation (in English and French) and English audio recording will be made available. These resources will be available at: http://www.nccmt.ca/previous-webinars
  4. 4. Follow us @nccmt Suivez-nous @ccnmo Poll Question #1 4 How many people are watching today’s session with you? A. Just me B. 2-3 C. 4-5 D. 6-10 E. >10
  5. 5. Follow us @nccmt Suivez-nous @ccnmo 5 Self-evaluation Tool for Action in Partnership http://www.nccmt.ca/knowledge-repositories/search/316
  6. 6. Follow us @nccmt Suivez-nous @ccnmo 6
  7. 7. Follow us @nccmt Suivez-nous @ccnmo 7 NCCMT Products and Services Registry of Methods and Tools Online Learning Resources Workshops and Webinars Video Series Networking and Outreach Knowledge Repositories
  8. 8. Follow us @nccmt Suivez-nous @ccnmo Poll Question #2 8 How familiar are you with the method or tool we are discussing today? A. I am not familiar with the method or tool B. I have heard of the method or tool C. I have used the method or tool
  9. 9. Follow us @nccmt Suivez-nous @ccnmo Presenters 9 Angèle Bilodeau, PhD Full Professor/Researcher, School of Public Health, University of Montreal (Lead author of the original French tool) Gillian Kranias, MES Bilingual Health Promotion Consultant, Partnership Support, Health Nexus
  10. 10. Follow us @nccmt Suivez-nous @ccnmo Self-Evaluation Tool for Action in Partnership A best practice and user-friendly tool to evaluate the degree of achievement of the quality requirements of effective action in partnership Available online at: https://www.nccmt.ca/knowledge-repositories/search/316 and https://en.healthnexus.ca/sites/en.healthnexus.ca/files/resources/selfevaluationtool.pdf Translation and cultural adaptation from: Outil diagnostique de l’action en partenariat (Bilodeau et al., 2014)
  11. 11. Follow us @nccmt Suivez-nous @ccnmo  Based on 6 requirements for effective partnerships  From a series of case studies based on Actor-Network Theory  Based on evidence from the research literature  Focuses on best practices  A collective self-evaluation tool: situates a partnership according to three levels of achievement Self-Evaluation Tool for Action in Partnership (2017) 11
  12. 12. Follow us @nccmt Suivez-nous @ccnmo Validation of the Original French Tool Works properly for partnerships engaged in a collective project Allows for a good convergence between respondents within the same partnership Distinguishes between partnerships with better and worse scores and helps identify areas of difficulty 12
  13. 13. Follow us @nccmt Suivez-nous @ccnmo Methodology of translation and cultural adaptation 1) Expert committee with two parallel translations 2) Pretest with target users, using group interview method Resulting properties of the translated tool 1) Equivalent with the original 2) Solid cultural adaptation to targeted context Self-Evaluation Tool for Action in Partnership (2017) 13
  14. 14. Follow us @nccmt Suivez-nous @ccnmo 1. Conduct a group discussion on each of the 18 items. 2. Answer the questionnaire individually, and then talk as a group. 3. Answer the questionnaire individually, then compile all the responses, and then discuss them together. Options for Performing a Collective Evaluation Pay particular attention to items for which answers are less favourable. 14
  15. 15. Follow us @nccmt Suivez-nous @ccnmo Three Types of Partnership Evaluation 1. One time evaluation: Strong/weak items OR requirements : indicate the strengths and weaknesses of the partnership Items lacking consensus: indicate possible areas of controversy Items left blank: indicate that important aspects of partnership escape some respondents 2. Longitudinal evaluation : shows improvement or deterioration over time 3. Summary portrait across multiple partnerships within a similar context: highlights collective issues 15
  16. 16. Follow us @nccmt Suivez-nous @ccnmo 16 Theoretical Foundations of the Tool PROCESS QUALITY OF ACTION Participation Dynamics + Partnership Arrangements Force of attraction Anchoring/Relevance Project Viability 6 Requirements
  17. 17. Follow us @nccmt Suivez-nous @ccnmo 17 The range of perspectives relevant to the issue Early stakeholder involvement in strategic decisions Engagement of stakeholders in negotiating and influencing decisions Commitment of strategic and pivotal stakeholders to the project 1 2 3 4 Participation Dynamics …promote quality of action, if they allow/include:
  18. 18. Follow us @nccmt Suivez-nous @ccnmo Partnership Arrangements …promote quality of action, if they favour: Equalization of power among the stakeholders Collective action 5 6 18
  19. 19. Follow us @nccmt Suivez-nous @ccnmo Active Ingredients of Participation Access to, and information sharing are the active element through which participation contributes to the quality of action. This makes it possible to widen the possibilities of convergence among actors. Some concepts (slide 1 of 4) 19
  20. 20. Follow us @nccmt Suivez-nous @ccnmo Equalization of power among stakeholders means establishing structures and mechanisms aimed at reducing the subordination that results from structural inequality among actors. Hence, (all) actors can identify concrete indicators of their influence and interdependence. Equalization of power allows the actors to combine their knowledge, practices and resources. Equalization of Power Some concepts (slide 2 of 4) 20
  21. 21. Follow us @nccmt Suivez-nous @ccnmo Collective construction (co-construction) of action is accomplished by combining the knowledge and assets of actors. The combination of actors’ paradigms for action generate the added value of working in partnership. Collective construction of action is noticeable when change in thinking and action is a direct result of combining the knowledge and assets of the partners. Co-construction of Action Some concepts (slide 3 of 4) 21
  22. 22. Follow us @nccmt Suivez-nous @ccnmo The collective construction of action is accomplished by:  The reinforcement of convergences that rally the actors;  The resolution of controversies that prevent them from cooperating. The Resolution of Controversies involves :  Deliberation-clarification and confrontation of positions;  addition of actors introducing new knowledge and resources;  Reinforcement of certain links and abandonment of others (e.g. engagement of new actors, retirement of others);  Development of new, more robust options for action that facilitate cooperation. Some concepts (slide 4 of 4) 22
  23. 23. Follow us @nccmt Suivez-nous @ccnmo Items that measure each of the 6 conditions 23
  24. 24. Follow us @nccmt Suivez-nous @ccnmo The range of perspectives relevant to the issue #1 In our partnership, stakeholders connected to the issue and its options for action are included as partners #2 People with lived experience of the issue actively participate in our partnership 1 24
  25. 25. Follow us @nccmt Suivez-nous @ccnmo Early stakeholder involvement in strategic decisions #3 In our partnership, partners are actively involved in analyzing issues and developing options for action, and not in implementation alone 2 25
  26. 26. Follow us @nccmt Suivez-nous @ccnmo Engagement of stakeholders in negotiating and influencing decisions #4 In our partnership, community groups have a real influence on decisions 3 26
  27. 27. Follow us @nccmt Suivez-nous @ccnmo Commitment of strategic and pivotal stakeholders to the project #5 In our partnership, partners are in a position to make decisions and commit resources #9 In our partnership, partner organizations continue to work together for the full duration of projects #10 In our partnership, essential resources for successful action are mobilized #11 Our partnership succeeds in bringing in the new stakeholders it needs to move forward 4 27
  28. 28. Follow us @nccmt Suivez-nous @ccnmo Partnership arrangements that favour equalization of power among the stakeholders #12 In our partnership, all points of view are given equal consideration in discussions and in decisions #13 In our partnership, everyone’s part in carrying out activities is acknowledged equitably #14 Partners benefit equitably from the partnership #16 In our partnership, the criteria and mechanisms for accountability (reporting to whom, when and about what) are negotiated between the funders and funded community organizations 5 28
  29. 29. Follow us @nccmt Suivez-nous @ccnmo Partnership arrangements that help build collective action # 6 In our partnership, the exchange of diverse points of view expands the possibilities for action # 7 In our partnership, the partners are able to identify their disagreements and discuss them # 8 In our partnership, partners succeed in resolving their disagreements #15 In our partnership, partners can move beyond their own interests to find common ground in the interests of the populations they serve #17 In our partnership, partners mobilize around new, holistic options for action that go beyond simple coordination of each partner’s actions #18 In our partnership, partners modify their actions, programs or services (what they already do) in order to arrive at new options for action 6 29
  30. 30. Follow us @nccmt Suivez-nous @ccnmo Examples of results obtained with the tool 30
  31. 31. Follow us @nccmt Suivez-nous @ccnmo Partners benefit equitably from the partnership. Equalization of power among the stakeholders5 All points of view are given equal consideration Criteria and mechanisms for accountability are negotiated Everyone’s part in carrying out activities is acknowledged equitably 31
  32. 32. Follow us @nccmt Suivez-nous @ccnmo Presenter 32 Julia Fursova, PhD(c), MAEd, MPH PhD Candidate, Environmental Studies, York University, Toronto, Evaluation Consultant, Health Nexus.
  33. 33. Follow us @nccmt Suivez-nous @ccnmo Julia’s experience with the tool • The adaption of the original tool in the context of partnership work for system change, e.g. projects addressing gender equity with focus on women’s participation in political action • The tool was applied with 5 partnership projects involving various number of participating organisations and agencies (varying from 2 partners to 6 partners) • The development of the Partnership Assessment Wheel was funded through the Department for Women and Gender Equality (former Status of Women Canada) 33
  34. 34. Follow us @nccmt Suivez-nous @ccnmo Reasons for the adaptation of the tool • The work of Health Nexus in the context of health promotion • The imperative of aligning approach to evaluation (and its methods and tools) with the key principles of health promotion • We adopted participatory developmental approach to evaluation to ensure that evaluation results are used for rapid feedback to inform Health Nexus’ approach to partnership support and to enhance collaboration between partners. Participatory Empowering Inter- disciplinary Appropriate to the context 34
  35. 35. Follow us @nccmt Suivez-nous @ccnmo Reasons for the adaptation continued • To align data collection methods and tools with goals and principles of developmental participatory evaluation • To support reflective practice development within partnerships • To facilitate dialogue between partners to collectively identify the objectives for strengthening equitable and collaborative work among partners • Reflective practice or praxis, is a process of thinking about one’s action in the context of social forces and structures that influence choices and the course of action, the dynamic interaction of action and thinking about action (Freire, 1970; Barndt, 2011). 35
  36. 36. Follow us @nccmt Suivez-nous @ccnmo
  37. 37. Follow us @nccmt Suivez-nous @ccnmo Partnership Assessment Wheel in connection with other wheels Socratic method Action- reflection cycle, or the ‘spiral of learning’ Dialectical thinking Medicine Wheel 37
  38. 38. Follow us @nccmt Suivez-nous @ccnmo The symbolism of the wheel for partnerships https://www.publicdomainpictures.net/pictures/30000/velka/wagon-wheel.jpg https://www.publicdomainpictures.net/pictures/100000/nahled/broken-wagon-wheel.jpg 38
  39. 39. Follow us @nccmt Suivez-nous @ccnmo Steps of the process: Individual Reflection • Clarifying who the partners are for each circle, where inner circle represent ‘core partners’ and extended circles includes ‘other engaged partners’ • Individual reflection with the Partnership Assessment Wheel where each participants assessed each segment for both circles using the following colour code: YES SOMEWHAT / SOMETIMES NO I cannot provide input due to lack of information or insufficient involvement with the project. 39
  40. 40. Follow us @nccmt Suivez-nous @ccnmo Steps of the process: Sharing Stories or red dot1 Example of green dot 1 Example of yellow dot • Participants were asked to think about the stories that illustrate their dots and provide: • 1 example for a ‘green dot’ and • 1 example for a ‘yellow’ or ‘red’ dot • The examples were recorded on the sticky notes of respective colour 40
  41. 41. Follow us @nccmt Suivez-nous @ccnmo Steps of the Process: Collective Reflection Please note that the image on the photograph has been specifically created for the webinar and does not represent an actual partnership. • Are there ‘green’ areas? • Are there yellow/red areas? • Stories, examples shared… • What draws your attention? • What thoughts and insights does the wheel provoke? 41
  42. 42. Follow us @nccmt Suivez-nous @ccnmo Reflective practice development • Collectively selecting a segment of the wheel to strengthen • A segment that calls for attention – where there is either a lack of consensus or a strong agreement for requiring further work/intervention AND • Which segment/level “is doable”? (with some attention and support, including from Health Nexus) 42
  43. 43. Follow us @nccmt Suivez-nous @ccnmo Guidelines for the application of the tool • Familiarity with the contexts of a partnership • Partnership Assessment Wheel is not a stand alone activity, prior to its implementation partners and facilitators need to be grounded in the context of their work • Explicit focus on reflective practice development and dialogue • Shared commitment among facilitators and participants to equalising power among partners 43
  44. 44. Follow us @nccmt Suivez-nous @ccnmo Facilitation tips • Implement the activity in the spirit of curiosity and collaborative inquiry into deeper truths • Affirm and celebrate partners’ collective strengths before moving into partnership assessment as an activity • Clarify with participants that the dots are not indicators of success or failure but markers that signify challenges and strength at a given point in time, a snapshot of a particular moment/state that is context dependent • When sharing stories behind the dots, look for how strengths and challenges connect with the internal and external contexts of the partnership, i.e. what are the influencing factors behind the colour- coded dots? • Focus on sharing stories rather than ‘counting the dots’ 44
  45. 45. Follow us @nccmt Suivez-nous @ccnmo Many partners, big and small 45
  46. 46. Follow us @nccmt Suivez-nous @ccnmo We need to avoid this… 46
  47. 47. Follow us @nccmt Suivez-nous @ccnmo By paying attention to power differential among actors and achieving empowering participation for all partners, including small ones. 47
  48. 48. Follow us @nccmt Suivez-nous @ccnmo 48 Your Comments/Questions • Use Chat to post comments and/or questions • ‘Send’ questions to All (not privately to ‘Host’) Chat Participant Side Panel in WebEx
  49. 49. Follow us @nccmt Suivez-nous @ccnmo 49 Poll Question #3 Could this method or tool be useful in practice? A. Very useful B. Somewhat useful C. Not at all useful D. Don’t know
  50. 50. Follow us @nccmt Suivez-nous @ccnmo Your Feedback is Important 50 Please take a few minutes to share your thoughts on today’s webinar. Your comments and suggestions help to improve the resources we offer and plan future webinars. The short survey is available at: https://surveys.mcmaster.ca/limesurvey/index.php/ 219685?lang=en
  51. 51. Follow us @nccmt Suivez-nous @ccnmo 51 Poll Question #4 What are your next steps? (Check all that apply) A. Access the method/tool referenced in the presentation B. Read the NCCMT summary about the method/tool described today C. Consider using the method/tool in practice D. Tell a colleague about the method/tool
  52. 52. Follow us @nccmt Suivez-nous @ccnmo Share your story! • Are you using EIDM in your practice? We want to hear about it! • Email us: nccmt@mcmaster.ca • Need support for EIDM? Contact us for help! • Email us: nccmt@mcmaster.ca • We typically respond within 24 business hours 52
  53. 53. Follow us @nccmt Suivez-nous @ccnmo Webinar Series from NCCMT www.nccmt.ca/webinar-series • Spotlight on Methods and Tools • Topic-Specific Methods and Tools • Online Journal Club • Peer-to-peer Webinars 53
  54. 54. Follow us @nccmt Suivez-nous @ccnmo The National Collaborating Centre for Methods and Tools (NCCMT) is hosted by McMaster University and funded by the Public Health Agency of Canada. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada. For more information about the National Collaborating Centre for Methods and Tools: NCCMT website www.nccmt.ca Contact: nccmt@mcmaster.ca

×