• Save
Living the Values of Engagement and the Strategic View with Program Evaluation: The BC Community Action Initiatives’ Journey with a Multi-Year Provincial Evaluation Process
Upcoming SlideShare
Loading in...5
×
 

Living the Values of Engagement and the Strategic View with Program Evaluation: The BC Community Action Initiatives’ Journey with a Multi-Year Provincial Evaluation Process

on

  • 439 views

William Reid, MNP LLP ...

William Reid, MNP LLP
Dr. Laura Tate, Community Action Initiative
Scott Graham, Social Planning and Research Council of BC

The BC Community Action Initiative was established to facilitate community-based, partnership-driven, and culturally safe approaches that promote mental health; prevent harmful use of substances; and improve services and supports for those affected by mental health/illness and problematic substance use. Over a three year period, SPARC BC in partnership with MNP LLP is leading a provincial evaluation with both formative and summative aspects, and that is further supported by quarterly performance reporting and digital stories. This presentation will provide for an overview of, and sharing of experiences from both the program being evaluated and those evaluating, the BC Community Action Initiative. In so doing, it will speak to the shared discoveries of collaboration as the evaluation studies and performance reporting unfolded; the engagement of a multi-stakeholder Leadership Council and community project evaluators; and, orienting a provincial evaluation in a fashion that tells the story of system-wide results along with community collaboration, action, and impacts.

Statistics

Views

Total Views
439
Views on SlideShare
422
Embed Views
17

Actions

Likes
0
Downloads
0
Comments
0

2 Embeds 17

http://www.linkedin.com 16
https://www.linkedin.com 1

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Living the Values of Engagement and the Strategic View with Program Evaluation: The BC Community Action Initiatives’ Journey with a Multi-Year Provincial Evaluation Process Presentation Transcript

  • 1. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|The BC Community Action Initiatives’ Journey with a Multi-Year Provincial Evaluation ProcessJUNE 11th, 2013CANADIAN EVALUATION SOCIETYNATIONAL CONFERENCELiving the Values of Engagement and the StrategicView with Program Evaluation:
  • 2. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Developing a Multi-Year Evaluation Plan• Setting the foundation including a detailed outline of project phases,work-steps, timelines and resource estimates• Orientation of the Leadership Council to evaluation and performancemeasurement practices• Formation of an Evaluation Advisory Committee• Preparation of the guiding evaluation and measurement framework• Creation of an online monitoring tool• Conduct of webinars with community project leads• Digital story development planningSlide 2Nine out of ten community project leads either “agreed” or “stronglyagreed” that the webinar session was interesting and relevant to theirorganizations as well as their projects
  • 3. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Developing a Multi-Year Evaluation Plan continued• An evaluation toolkit was created for the community project leads,providing information and templates in support of:o Preparing a project evaluation plano Using performance measures and research methodso Applying guiding principles and resources in support of projectevaluations that involve Aboriginal communitieso Analyzing evaluation datao Putting evaluation standards into practice• A reference bank of project performance measures and questionswas also developed and distributed to community project leadsSlide 3The illustrative measures and questions were grouped according to theiruse with participants in a program or service; for print, digital and/oronline materials and resources; and for project partners
  • 4. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Overview of the Completed Evaluation Steps• A formative evaluation was the first to be carried out, addressingthe:o Appropriateness of stated outcomes as markers of success, andpriorities, for the Community Action Initiativeo State of alignment with Provincial plans and undertakingso Level of awareness of the Community Action Initiativeo Shifts in, or emerging, government directions and needso Strengths of, challenges facing, and opportunities to enhancethe Community Action Initiativeo The methods included the conduct of structured interviews and theadministration of an online surveySlide 4The formative evaluation highlighted a need to address the state ofcommunications and outreach on the Community Action Initiative, andits sustainability including in regards to governance
  • 5. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Overview of the Completed Evaluation Steps continued• Following on this, a baseline performance measures report wasproduced, providing data on areas of interest such as:o Continued and new involvement of community organizationso Awareness of mental health and problematic substance use, aswell as evidence-based and culturally appropriate practiceso Strategic cross-sector as well as cultural partnerships and networkso Knowledge that is being created and sharedo Community capacity to address mental health and problematicsubstance useo Funding and resources leveraged, populations being reached, andthe evaluation related activities carried out by projectsSlide 5All of the invited project leads took part, making it a 100% rate ofresponse, with data being reported in such as way as to highlight anydifferences between the first two cycles of funding
  • 6. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Overview of the Completed Evaluation Steps continued• A hybrid evaluation has been very recently completed, with a focus on:o The continued relevance of the Community Action Initiativeo The delivery and distribution of fundingo The extent of achievement of immediate, intended outcomes• The methods included:o A focused literature search and summary of peer-reviewed articleso An analysis of key documents including project-specific evaluationsand progress reportso Web-enabled surveys of project leads, project collaborators, andorganizations receiving convening grants or unsuccessful in theirapplications for fundingSlide 6In April, 2013, it was announced the Community Action Initiative willreceive $15 million to support its mandate for collaborative, communityaction that addresses substance use and promotes mental health
  • 7. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Making it Real: Applying Results• Decision-making and strategic planning:o Understanding scaling constraintso Case for sustainability lenso Case for other capacity-building• Strengthening administrative processes• Direct engagement with ProvinceSlide 7“It’s important to us to know that communities receiving our fundinghave made a difference in addressing mental health and substanceuse”. Co-Chair Barb Keith
  • 8. P: 555.123.4568 F: 555.123.4567123 West Main Street, New York,NY 10001www.rightcare.com|Thank youSPARC BCMNP LLPCAI BChttp://www.sparc.bc.ca/http://www.mnpconsulting.ca/http://www.communityactioninitiative.ca/|William (Bill) Reid, MBA, CMC, CESenior Director, MNP LLPDIRECT: 778.265.8885CELL : 250.418.0473bill.reid@mnp.cahttp://ca.linkedin.com/in/billreidmnpScott Graham, MAManager of Research and ConsultingSPARC BCDIRECT: 604.718.8501sgraham@sparc.bc.caLaura E. Tate, PhD.Provincial DirectorCommunity Action InitiativeDIRECT: 250.589.5422ltate@communityactioninitiative.ca