090421_abstract01 copie.pdf 1 21.04.2009 17:51:26
Making Knowledge Transfer and Exchange (KTE) Relevant and Effective for HIV/AIDS Community Based Organisations (CBOs)
Building an Evaluation Plan of the Out illons-Nous Project of the Coalition des organismes communautaires québécois de lutte contre le sida (COCQ-Sida)
Mélina Bernier, Ghayas Fadel, Ken Monteith
e Outillons-Nous (ON) is a KTE structure where community workers share practices and collaborate with researchers to update
interventions based on new evidence and/or develop further research questions that need to be investigated. Over the last few years, the
project’s structure and methodology were updated based on participants’ evaluations and discussions with the organising committees.
However, no follow up procedure or outcome analysis was done after these changes to document the e cacy or value of the ON. To build the evaluation plan, three data collection strategies were used:
A review of organisational documents such as the values and mission statement and the operational objectives
Objective Analysis of the evaluation forms completed by participants of ON from 2006 to 2008 and minutes from meetings of the
Develop a validated evaluation plan based on the Savoir-faire et Savoir-dire community evaluation guide (Zúñiga, R, Luly, M-H, 2005) Analysis of focus group discussions and individual interviews with key stakeholders. e interview content was qualitatively
and empowerment evaluation principles (Fetterman, DM, Wandersman, A, 2005) to judge the e cacy and value of the ON training analysed and various themes were categorised.
We performed 8 interviews with 15 stakeholders: We used a convenience sample to include di erent contexts and populations: Horizontal analysis of the interviews also provided a series of contextual factors and preexisting
variables that need to be taken into account in the evaluation process. ese include:
Community workers Montréal Housing services
An intervention coordinator Outside Montréal Prevention services Geographical location and distance
Executive Directors of member organisations Support services Organisations that regularly participate in ON, Varying backgrounds and experience of participants
Members of the Board of Directors of COCQ-Sida that include regional those that don’t, and those that rarely participate
High rate of personnel turnover in community based organisations
representatives of people living with HIV/AIDS (PHAs)
Variety of communities served and di erent organisational mandates
A representative of the funding agency Based on the analysis of the interviews with stakeholders and the review of organisational
documents, we were able to build a logic model that represents the ON project as it currently Available training programs already in place
A researcher who previously presented at an ON session
stands. Availability of time and human resources
Internal organisational culture
Group HIV/AIDS community based organisations in Québec to:
Foster and support the emergence of joint actions
Encourage, support and consolidate community action in the ght against HIV/AIDS
Foster solidarity in the movement
Pool approaches, activities and resources Process evaluation
To respond to the issues a ecting people living with HIV or AIDS and everyone else who may be a ected by HIV.
Identify knowledge and capacity building needs based on:
Improve the quality of life of people living with HIV/AIDS
Consultation with di erent stakeholders, PHAs, member organisations and researchers
Foster prevention e orts, improve access to quality healthcare and support services
New research ndings
Inform and educate the public of the risks of HIV transmission
Lower the incidence of new infections
New and innovative intervention practices
Relevant issues related to advancements in HIV/AIDS
Hold three to ve ON sessions per year.
Plan, organise and hold interactive ON sessions using di erent pedagogical tools to ensure full Sessions should achieve the maximum possible
participation and successful KTE. Sessions are open to community workers, volunteers, PHAs, number of the objectives previously stated.
coordinators and Executive Directors of member organisations as well as institutional partners.
Enhance the capacity of community workers and volunteers of member organisations
Create and promote opportunities for networking, KTE and partnerships for community workers and member organisations
Foster partnerships between researchers and community based organisations
Recognize, share and put into practice the expertise of community workers
Facilitate access to new research results, especially for organisations outside Montréal input output
Harmonise interventions, update knowledge and inform practices based on new research data and evidence
Develop and implement new interventions, programs and tools
Multiply the impact of the ON by training new agents and providing continuing education modules cost advantages
Explore innovative practices
Provoke collective thinking and discussions about di erent issues related to HIV/AIDS, community work and action
Facilitate participation of member organisations from across the province by providing logistical and nancial support
Monitor and evaluate ON outcomes, provide follow up and support and make necessary changes to improve actions
For the funding agency: keep in touch with the reality of front line community work
For researchers: provide a KTE structure to reach a broader audience of stakeholders Efficiency evaluation
Relevance evaluation Efficacy evaluation
Projects in community based organisations sometimes evolve organically as collective actions towards a shared social goal. is evolutionary process makes it di cult to document the project as a whole and to identify evaluation criteria.
Using the Savoir-faire et Savoir-dire guide and empowerment evaluation principles allowed us to build a logic model informed by the various stakeholders’ experiences of the ON. We were able to document the project and gain a better understanding of its dynamic as opposed to a
preconceived idea that does not re ect the complex reality of the ON. We also identi ed a series of contextual factors and preexsiting variables that a ect the project.
In this community based approach, objectives are viewed as guidelines and not as speci c end results. is way, the evaluation takes into account expected and unexpected results, whether they are positive or negative. Furthermore, this process ensures that e cacy and value will be
judged according to the needs of the stakeholders and within the organisation’s means and mission.
e logic model has to be updated as the project continues to evolve. is will ensure internal and external validity both for the COCQ-Sida and the funding agency. e savoir faire et savoir dire guide contains various tools that can be used to this purpose.
e proposed logic model will be validated by stakeholders and necessary adjustments will be made. It will inform the evaluation plan of the ON sessions which will take place in the coming year.
References cited Acknowledgement
Fetterman, DM. and A Wandersman. 2005. Empowerment Evaluation Principles in Practice. New York, London: e Guilford Press. e authors would like to thank all the interview participants for their time and valuable input. We would also like to thank Valérie Marchand, Caroline Racicot and Sarah
Zúñiga, R and M.-H Luly. 2005. Savoir-faire et Savoir-dire: un guide d’évaluation communautaire. Montréal : COCQ-Sida. Raymond for their contribution.