This document discusses evaluating community engagement programs. It explains that evaluation involves systematically collecting information about a program's activities and outcomes to track progress, make judgements, and improve effectiveness. For community engagement specifically, evaluation can determine what worked well or not, if engagement met its objectives, and if it enhanced knowledge and decision-making. The document recommends clarifying a program's logic, outcomes, and purpose of evaluation with stakeholders. It also suggests establishing performance indicators and methods for collecting and analyzing information to both manage programs adaptively and use findings.
Utilization focused evaluation: an introduction (Part 1 - ROER4D) SarahG_SS
Introductory slides on Utilization Focused Evaluation (UFE) that I presented to the ROER4D team (http://roer4d.org/) on 22 September 2014 as part of the project's evaluation process.
Utilization focused evaluation: an introduction (Part 1 - ROER4D) SarahG_SS
Introductory slides on Utilization Focused Evaluation (UFE) that I presented to the ROER4D team (http://roer4d.org/) on 22 September 2014 as part of the project's evaluation process.
This presentation is the continuation of the first part, which was all about the basics of program evaluation. This ppt contains slides describing the impact evaluation in details and also the logical framework is also explained with practical examples.
N.B: Please go through it, using slide view to use the animation effects.
Two Examples of Program Planning, Monitoring and EvaluationMEASURE Evaluation
Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.
Monitoring is the continuous collection of data and information on specified indicators to assess the implementation of a development intervention in relation to activity schedules and expenditure of allocated funds, and progress and achievements in relation to its intended outcome.
Evaluation is the periodic assessment of the design implementation, outcome, and impact of a development intervention. It should assess the relevance and achievement of the intended outcome, and implementation performance in terms of effectiveness and efficiency, and the nature, distribution, and sustainability of impact.
Promoting a culture of monitoring and evaluation in educational institutions. How to develop a M&E system, and grounding M&E planning on the Logical Framework Approach, and using Logframe as reference for M&E.
Self-Assessment of Organizational Capacity in Monitoring & EvaluationMEASURE Evaluation
Presentation that captures self-assessments of two teams of Ethiopian health officers (most of whom have M&E responsibilities): those from SNNP Regional Health Bureau and those from the Sidama Zonal Health Department.
Successful organizations are constantly monitoring, evaluating, and improving based off of their successes and failures. Learn how to design your own monitoring and evaluation program with this deck from WAN, and learn more on our free Strategic Advocacy Course, available at: http://worldanimal.net/our-programs/strategic-advocacy-course-new/about
SUBJECT: SOCIO EDUCATIONAL PROJECT
TUTOR: DR. MIGUEL PONCE
THEME: PART III. PROJECT EVALUATION
STUDENTS:
MONTESDEOCA BENITEZ DIANA PRISCILA
PACHACAMA SIMBAÑA DAYSI ALEXANDRA
This presentation is the continuation of the first part, which was all about the basics of program evaluation. This ppt contains slides describing the impact evaluation in details and also the logical framework is also explained with practical examples.
N.B: Please go through it, using slide view to use the animation effects.
Two Examples of Program Planning, Monitoring and EvaluationMEASURE Evaluation
Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.
Monitoring is the continuous collection of data and information on specified indicators to assess the implementation of a development intervention in relation to activity schedules and expenditure of allocated funds, and progress and achievements in relation to its intended outcome.
Evaluation is the periodic assessment of the design implementation, outcome, and impact of a development intervention. It should assess the relevance and achievement of the intended outcome, and implementation performance in terms of effectiveness and efficiency, and the nature, distribution, and sustainability of impact.
Promoting a culture of monitoring and evaluation in educational institutions. How to develop a M&E system, and grounding M&E planning on the Logical Framework Approach, and using Logframe as reference for M&E.
Self-Assessment of Organizational Capacity in Monitoring & EvaluationMEASURE Evaluation
Presentation that captures self-assessments of two teams of Ethiopian health officers (most of whom have M&E responsibilities): those from SNNP Regional Health Bureau and those from the Sidama Zonal Health Department.
Successful organizations are constantly monitoring, evaluating, and improving based off of their successes and failures. Learn how to design your own monitoring and evaluation program with this deck from WAN, and learn more on our free Strategic Advocacy Course, available at: http://worldanimal.net/our-programs/strategic-advocacy-course-new/about
SUBJECT: SOCIO EDUCATIONAL PROJECT
TUTOR: DR. MIGUEL PONCE
THEME: PART III. PROJECT EVALUATION
STUDENTS:
MONTESDEOCA BENITEZ DIANA PRISCILA
PACHACAMA SIMBAÑA DAYSI ALEXANDRA
Learn to create a program logic model. Designed for Cooperative Extension Service professionals providing university outreach programs. Logic models are a mainstay in the program development process for community-based, outreach programs.
This presentation is all about the project Management which includes level of success of a project, Monitoring & evaluation, LFA in view of development sector. This presentation has been prepared in view of development/Social or Non-profit sector.
Note: Any kind of feedback from industry experts will always be appreciated.
Organizational Capacity-Building Series - Session 6: Program EvaluationINGENAES
This session describes different kinds of program evaluations, and key evaluation considerations. These presentations are are part of a workshop series that was implemented in Nepal and 2016 as part of the INGENAES initiative.
This gives the information about programme evaluation, planning of evaluation, requirement and purpose of evaluation, steps involved in evaluation, Uses of evaluation, Stakeholder and their role in evaluation, finding and analysing the result of evaluation, Standards of effective evaluation, utilization of evaluation.
This is a sample of training concepts related to grant or funding proposal development. You will note that it refers to HIV/AIDS services, although the concepts are universal. Customizable training of this type is currently offered in South Florida or Central Indiana. Courses are available in Strategic Planning, Board Orientation and Training, Program Development, Grant Writing and Evaluation. Courses may be introductory in nature or highly advanced resulting in completed projects.
Presentation by Jared Jageler, David Adler, Noelia Duchovny, and Evan Herrnstadt, analysts in CBO’s Microeconomic Studies and Health Analysis Divisions, at the Association of Environmental and Resource Economists Summer Conference.
Understanding the Challenges of Street ChildrenSERUDS INDIA
By raising awareness, providing support, advocating for change, and offering assistance to children in need, individuals can play a crucial role in improving the lives of street children and helping them realize their full potential
Donate Us
https://serudsindia.org/how-individuals-can-support-street-children-in-india/
#donatefororphan, #donateforhomelesschildren, #childeducation, #ngochildeducation, #donateforeducation, #donationforchildeducation, #sponsorforpoorchild, #sponsororphanage #sponsororphanchild, #donation, #education, #charity, #educationforchild, #seruds, #kurnool, #joyhome
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
This session provides a comprehensive overview of the latest updates to the Uniform Administrative Requirements, Cost Principles, and Audit Requirements for Federal Awards (commonly known as the Uniform Guidance) outlined in the 2 CFR 200.
With a focus on the 2024 revisions issued by the Office of Management and Budget (OMB), participants will gain insight into the key changes affecting federal grant recipients. The session will delve into critical regulatory updates, providing attendees with the knowledge and tools necessary to navigate and comply with the evolving landscape of federal grant management.
Learning Objectives:
- Understand the rationale behind the 2024 updates to the Uniform Guidance outlined in 2 CFR 200, and their implications for federal grant recipients.
- Identify the key changes and revisions introduced by the Office of Management and Budget (OMB) in the 2024 edition of 2 CFR 200.
- Gain proficiency in applying the updated regulations to ensure compliance with federal grant requirements and avoid potential audit findings.
- Develop strategies for effectively implementing the new guidelines within the grant management processes of their respective organizations, fostering efficiency and accountability in federal grant administration.
Up the Ratios Bylaws - a Comprehensive Process of Our Organizationuptheratios
Up the Ratios is a non-profit organization dedicated to bridging the gap in STEM education for underprivileged students by providing free, high-quality learning opportunities in robotics and other STEM fields. Our mission is to empower the next generation of innovators, thinkers, and problem-solvers by offering a range of educational programs that foster curiosity, creativity, and critical thinking.
At Up the Ratios, we believe that every student, regardless of their socio-economic background, should have access to the tools and knowledge needed to succeed in today's technology-driven world. To achieve this, we host a variety of free classes, workshops, summer camps, and live lectures tailored to students from underserved communities. Our programs are designed to be engaging and hands-on, allowing students to explore the exciting world of robotics and STEM through practical, real-world applications.
Our free classes cover fundamental concepts in robotics, coding, and engineering, providing students with a strong foundation in these critical areas. Through our interactive workshops, students can dive deeper into specific topics, working on projects that challenge them to apply what they've learned and think creatively. Our summer camps offer an immersive experience where students can collaborate on larger projects, develop their teamwork skills, and gain confidence in their abilities.
In addition to our local programs, Up the Ratios is committed to making a global impact. We take donations of new and gently used robotics parts, which we then distribute to students and educational institutions in other countries. These donations help ensure that young learners worldwide have the resources they need to explore and excel in STEM fields. By supporting education in this way, we aim to nurture a global community of future leaders and innovators.
Our live lectures feature guest speakers from various STEM disciplines, including engineers, scientists, and industry professionals who share their knowledge and experiences with our students. These lectures provide valuable insights into potential career paths and inspire students to pursue their passions in STEM.
Up the Ratios relies on the generosity of donors and volunteers to continue our work. Contributions of time, expertise, and financial support are crucial to sustaining our programs and expanding our reach. Whether you're an individual passionate about education, a professional in the STEM field, or a company looking to give back to the community, there are many ways to get involved and make a difference.
We are proud of the positive impact we've had on the lives of countless students, many of whom have gone on to pursue higher education and careers in STEM. By providing these young minds with the tools and opportunities they need to succeed, we are not only changing their futures but also contributing to the advancement of technology and innovation on a broader scale.
Many ways to support street children.pptxSERUDS INDIA
By raising awareness, providing support, advocating for change, and offering assistance to children in need, individuals can play a crucial role in improving the lives of street children and helping them realize their full potential
Donate Us
https://serudsindia.org/how-individuals-can-support-street-children-in-india/
#donatefororphan, #donateforhomelesschildren, #childeducation, #ngochildeducation, #donateforeducation, #donationforchildeducation, #sponsorforpoorchild, #sponsororphanage #sponsororphanchild, #donation, #education, #charity, #educationforchild, #seruds, #kurnool, #joyhome
A process server is a authorized person for delivering legal documents, such as summons, complaints, subpoenas, and other court papers, to peoples involved in legal proceedings.
ZGB - The Role of Generative AI in Government transformation.pdfSaeed Al Dhaheri
This keynote was presented during the the 7th edition of the UAE Hackathon 2024. It highlights the role of AI and Generative AI in addressing government transformation to achieve zero government bureaucracy
2. Thinking about evaluation
1. Clarify the program logic/outcomes as part of the planning process
2. Establish the purpose/uses of the evaluation with priority stakeholders
taking account of their needs/questions
3. Establish the type of information needed (performance indicators)
4. Establish the sources and methods for collecting information and
timeline for delivery of findings
5. Analyse information, make judgements
6. Use the judgements/findings to adaptively manage your program
3. Evaluating community engagement
What is evaluation and why is it important in community
engagement?
Program logic - one approach
Benefits and challenges
Supporting resources
4. What is evaluation?
Evaluation is
“the process of making a judgement about the value or worth of an
object under review” (Owen 2006:9).
carried out in social, corporate and government settings
a form of knowledge that informs decision-making about an object,
which is developed by systematically assessing its operation (Owen
2006:19)
influenced by values and context
Evaluation is the systematic collection of information about the
activities and outcomes of programs to:
track progress
make judgements and decisions
improve effectiveness
build understandings
Short term
Longer term
5. Why evaluate?
Judge merit or worth
Improve programs
Generate
knowledge/understandings
Engage stakeholders
Be accountable
Gain support for future
projects
6. Why evaluate community engagement?
Evaluation enables you to find out:
What worked well and what did not?
Did engaging with citizens or communities actually
meet the engagement objectives?
Did engagement enhance knowledge and decision
making?
Were there any unanticipated outcomes?
Was engagement cost effective in terms of time and
resources?
What does this mean for next time?
7. Evaluating Engagement
Evaluation can be valuable in a number of ways to:
Assist planning for future consultation programs
Develop appropriate techniques for particular objectives
Develop appropriate techniques for participants with differing needs
Improve effectiveness of consultation techniques
Increase consultation skills of staff
Assessing the effects of the engagement on the issues and
processes with which it is concerned. This may require ways of
measuring attitudes or levels of knowledge ‘before and after’ the
engagement .
8. Integrated engagement and evaluation
Community
Engagement
Initiate
and scope
Develop
and plan
Implement
and
monitor
Evaluate
and close
9. Links with community engagement
Community
engagement
Evaluation
Initiate and scope phase Clarify objectives, clarify assumptions,
define stakeholders, clarify roles, identify
risks, evaluation template – decide
formal/informal evaluation
Develop and plan Change control plan, communications plan,
reporting strategies, documentation
Implement and monitor Tracking progress, monitoring and data
collection, feedback and adjust
Evaluate and close Finalise evaluation documentation, conduct
the formal/informal evaluation, conduct
team review, communicate outcomes and
findings
10. What is Program Logic?
How we make sense of a program
A tool for establishing the logical
connections – why, what and how,
from inputs through to the ultimate
outcomes
Allows the logic of a project to be
questioned and challenged, and
helps to identify assumptions that
link steps together
Connects the evaluation activities
with the intended short, medium
and long term outcomes
Is not a project plan
12. Hierarchy of Outcomes
• Impact on the overall issue and ultimate goals (social/economic, artistic, organisational,
communications and sustainability outcomes).
Ultimate outcomes
• Changes in individual and group knowledge, attitudes, skills; changes in aspirations,
intentions, practices and behaviour.
Intermediate outcomes
• Levels and nature of participation; reactions to the outputs/activities by
participants/stakeholders. Participation in activities, the quality and use of program
collateral and the range and appropriateness of activities is assessed at this level.
Immediate outcomes
• The products/services/activities the program actually offers to engage participants.
Outputs/activities
• Priority issues that the program must to respond to: (social, organisational, sectoral,
communications) based on existing or new information (policies, data, consultation,
research).
Needs
14. How do we make sense of a program?
Efficiency
Action/
outputs
Outcomes
Resources/
inputs
Process
Problem/
issue
Effectiveness
Appropriateness
Needs
15. Linking outcomes to priority needs –
you know it makes sense…doesn’t it?
Sealand Community Engagement in Stormwater
Management Project
(AKA Stubby Holders for School Kids)
Stormwater run-off, turbidity and siltation in local
waterways
Land clearing due to residential developments
Project focus on engagement with local school-kids, to
inform and educate their parents regarding the
importance of reducing stormwater run-off into local
rivers
Raindrop character, school performances, educational
messages and collateral including stubby holders with
pollution prevention messages
16. Developing a project evaluation action plan
Outcomes
Hierarchy
Evaluation Questions
(What do we want to know?)
Data sources
(Where will we
find the
information?)
Standard
(How do we
judge it?)
Utilisation
(How will
we use it?)
Ultimate outcomes
Immediate outcomes
Activities/output
Needs
17. Thinking about evaluation
1. Clarify the program logic/outcomes as part of the planning process
2. Establish the purpose/uses of the evaluation with priority stakeholders
taking account of their needs/questions
3. Establish the type of information needed (performance indicators)
4. Establish the sources and methods for collecting information and
timeline for delivery of findings
5. Analyse information, make judgements
6. Use the judgements/findings to adaptively manage your program
18. Thinking about data
From the beginning…………….
What’s the available data?
Does it respond to the evaluation questions and help demonstrate
desired outcomes?
Who is the audience – and what will they value as evidence?
Build off the existing platform
What else do you need to collect?
Who else can provide data?
Consider quality and consistency
Is it replicable?
Consider different types of data and perspectives.
19. Demonstrating success
Evaluation matters – it demonstrates impact and outcomes
For best results, build it in from the beginning
Program logic makes sense of why, what and how
It challenges our assumptions, and focusses appropriate activity
It doesn’t have to be complicated
An integrated approach delivers a more robust process and
outcomes
It supports transparency and accountability
We learn from it!
20. Resources
NSW Office of Environment and Heritage (former NSW Department
of Environment and Conservation) 2004, Does your project make a
difference?,
http://www.environment.nsw.gov.au/resources/communities/040110-
Project-Evaluation.pdf
Hendricks, Alison, Evaluation Framework for Community
Engagement Based on the United Nations Brisbane Declaration,
http://www.iap2.org.au/sitebuilder/resources/knowledge/asset/files/4
0/undecevaluationframeworkforcommunityengagement.pdf
Queensland Government 2011, Engaging Queenslanders:
evaluating community engagement,
http://www.qld.gov.au/web/community-engagement/guides-
factsheets/evaluating/
SR
Thank you for coming along today.
My name is Susan Rudland and I work for a company called Urbis
We are specialists in community engagement, evaluation, research and social planning
Delivered over 200 stakeholder and community engagement programs for councils, state government and NGOs, across environmental, sustainability, planning and land-use processes
We use social research and evaluation to strengthen robust and accountable engagement
SR
It is important to clearly articulate the community engagement process to be evaluated.
“Clearly articulating the community engagement program is the most important aspect of any evaluation because it guides the development of evaluation questions and performance criteria which will be used to measure the success of the program. In other words, unless it is clear how a community engagement program is meant to function and what it is meant to achieve there is no way of judging how successful it is.” (Queensland Government 2011)
Community engagement – what constitutes success (and how do we know)?
There is no one way to engage communities – it all depends on the issue, the aims and the desired outcomes. Engagement planning often focusses on developing activities and tools – how we plan to engage. But it is important to stand back and take some time to consider why we are engaging and what we are seeking to achieve, before going to the how.
A focus on the drivers for engagement and the desired outcomes is important to identify measures of success. When funding is limited, the issues are contentious, and stakeholders are diverse, how will you demonstrate and communicate success to others?
The NSW Supreme Court recently handed down a judgement regarding what constitutes genuine and effective consultation according to the NSW Strategic Regional Land Use Policy Delivery Guidelines, "Guidelines for community consultation requirements for the extraction of coal and petroleum, including coal seam gas". The case was brought by Metgasco Limited v Minister for Resources and Energy, regarding the suspension of metgasco operations for failing to consult genuinely and effectively with the community – the evidence presented was that they had failed to persuade the community to support the project. The court found in favour of Metgasco, saying that a consultation process that does not persuade the community to support a project is not necessarily a failure or ineffective. Notwithstanding what you may think of how Metgasco did or did not engage with the community, the case has raised all sorts of discussion on social media, with many suggesting that it supports a focus on activities, not outcomes – and that this is actually a vindication – as if the only outcome that community engagement never seeks to achieve is persuasion and agreement.
I think that’s a mistake – community engagement is much more than process and activity – it often seeks to deliver a range of crucial outcomes – otherwise, why are we here and how can our efforts be judged effective and genuine? Community engagement may seek to educate, inform, support and resource people. It may seek to facilitate changes in attitudes, knowledge and behaviours. It may seek to achieve environmental improvements. provide ongoing avenues and channels of communication. It may seek to document complex questions and factors for consideration. It may seek to produce innovative and creative solutions through co-design and co-creation. And there a number of other objectives that may be in play. The question is – have we defined what are we trying to achieve, how we will measure success, and how we will know we have made a difference? If we haven’t done that, engagement runs the risk of being reduced to a judgement of how good the workshop biscuits were and did people have a good time. I think that does a real disservice to all the very creative and experienced engagement practitioners out there who are trying to make a difference.
Program logic is one method of integrating evaluation and measurement thinking, into the design of an engagement project right at the beginning. Program logic asks the question does it make sense, how do we know, how is this demonstrated, and what else do we need to consider. It offers an action research framework to strengthen engagement practice, manage risk and communicate achievements more broadly. This presentation introduces key concepts and frameworks that may be applied in different engagement projects, large and small.
So I would like to explore some key issues in this presentation:
what is evaluation and why is it important to community engagement
Introduce a program logic approach
Consider some of the challenges
Identify some of the benefits
And leave you with some resources you may wish to consider.
Starter Question:
Before I go on, I am keen to hear from you. I wonder if you could pair up, talk to the person next to you for about 5 minutes, and share with one another – in your role, what do you need evaluation to do? What do you see as the key benefits?
what you see as the key challenges and benefits of evaluating community engagement. Just 5 minutes together, and then I will invite some of you to share those key challenges and benefits.
Round robin intros - So as a quick ice-breaker we would like you to introduce yourself and tell us about your role in community engagement and how evaluation is relevant to you
What do you need evaluation to do/what are the anticipated benefits for your work?
SR
The key principles are as follows:
Evaluation should be an integral part of the planning and management of community engagement activities
Evaluation should be a structured and planned process
The scale and scope of the evaluation should reflect the purpose, audience, and the scale and significance of the community engagement activities
Evaluation should, wherever possible, be a participatory activity
SR
Evaluation is helpful for those keen to:
Build your capacity to think critically and be consistently evaluative in your work;
Improve your ability to construct convincing and evidence-based rationales for new and existing work;
Meaningfully assess the value of your approach;
Demonstrate or defend the value of what you do;
Enhance the rigour of your decision-making and problem-solving;
Check that you get value-for-money and create new efficiencies;
Have more frequent and structured conversations with your teams, supervisors or sectors about creating and evaluating change;
Be responsive to the needs and interests of your stakeholders;
Articulate your purpose/focus of activities and track progress toward it; and
Consistently adapt your approach as you go, based on lessons learnt.
There are two key reasons for evaluating community engagement:
The process and tools used to implement community engagement – Was the engagement appropriate?
The impacts and outcomes of community engagement – what difference did the engagement activity make? – Was it effective?
The benefits of evaluating community engagement activities include:
Identifying and articulating lessons and achievements to improve practice
Building an evidence base for innovative and best-practice community engagement including creating standards and benchmarks
Contributing to engagement capability development by providing feedback on performance
Presenting opportunities for further participation in the evaluation process
Providing evidence for communities and clients of how effective engagement works.
Evaluation is an important tool in determining whether a consultation program achieved its objectives, and whether the most effective and suitable techniques were applied.
Evaluation can be embedded into any engagement project – it is part of the usual process of planning, designing, doing and reviewing. In appreciative inquiry, or action research projects, you might think of this as the discovery, dream, design, and deliver phases. If I could insert a word that started with D for evaluation and adapt, I would! But you get the picture. Its an iterative, ongoing, adaptive process. It informs how you design, what you do, and how you reflect on that.
Embedding evaluative thinking into community engagement strengthens and enhances the engagement process.
SR
So what is program logic and how do we use it to evaluate community engagement?
Program logic models describe the sequence of events for bringing about change and relate activities to outcomes. It describes the assumptions about how and why a program will work by identifying “what causes what” to connect the evaluation with the intended short, medium and longer-term outcomes.
Program logic focuses on the main steps that need to be achieved so that the project can be tracked to see if it is on the right path, or whether changes are required to the proposed methodology and if so why this may have occurred.
Program logic is not a project plan, and should not replace a project plan, but should be used at the beginning of the process to refine and make sure that proposed evaluation activities are relevant to the intended outcome of the engagement activity.
Benefits of PL:
Illustrates the logic or theory of a program
Focuses on what matters - outcomes
Can be used to create dialogue and shared understanding of a program between different stakeholders and those being evaluated
Helps to identify gaps
Makes assumptions explicit
Identify appropriate questions for your evaluation based on the program
Determine data collection sources and methods and when to collect data
SR
A backcasting approach is used to develop the program logic. Program logic starts with the intended future outcome and works backwards to the how, when and whom (inputs and outputs).
This involves identifying what is the vision of the project and then working backwards to identify the necessary steps required to achieve short, medium and long term outcomes. This allows you to think through what is needed to create the future, rather than thinking about what is currently happening and trying to predict the future.
When using program logic to evaluate community engagement activities, the ultimate outcome is a process of engaging the community.
SR
Every program logic starts with a hierarchy of outcomes approach.
Program logic models include the following:
CURRENT SITUATION/NEED: What is the current situation that the program is responding to.
INPUTS - This is what you invest including human and financial resources and time.
ACTIVITIES, ACTIONS or OUTPUTS – What you are going to do including different community engagement activities conducted. Any ‘products’ that are produced (eg. submissions, workshop notes or summary reports).
OUTCOMES – short-term, medium-term and longer-term outcomes
Short term outcomes are what happens as a result of a particular activity and usually include changes to a specific community and participants due to a particular activity.
Medium term outcomes can include changes to policies, plans and projects and broader changes to communities and government.
Longer term outcomes are those that are fundamental changes in the social, environmental, economic and governance priorities.
SR
Outcomes need to be:
Realistic
Measurable
Achievable
Relevant
Performance indicators:
Level of participation
Usefulness of the information
Extent to which they are being heard being and influence
Commitment to process
Changes in decision makers views/perceptions
Efficiency of delivery of plan
Cost effectiveness
But as well as thinking about what we want to achieve – we need to identify measures of success. This is where we start to build the logic of an engagement program.
Fabulous activities, supported across local schools, high levels of participation and engagement by schoolkids years 1 to 3.
Did it make a difference? Was it appropriate? Was it effective? For whom and why?
What needed to happen? Engagement with local residential developers and builders and construction teams, to ensure appropriate management practices and minimise runoff. Not school kids and not their parents.
If we had developed the program logic to start with, and mapped out our desired outcomes, we could have delivered an outcome that went beyond a misguided activity.
How might we have done that – spent a couple of hours, at the outset of the project, before doing anything!
SR
It is important to clearly articulate the community engagement process to be evaluated.
“Clearly articulating the community engagement program is the most important aspect of any evaluation because it guides the development of evaluation questions and performance criteria which will be used to measure the success of the program. In other words, unless it is clear how a community engagement program is meant to function and what it is meant to achieve there is no way of judging how successful it is.” (Queensland Government 2011)
SR
SR
I started off by referring to the recent court judgement about what constitutes success in community engagement. Program logic is one approach that allows us all to consider that question early. Program logic holds us to the why, before we jump to the how. It embeds evaluation thinking into program design and planning, and offers a structured framework for reflection that allows us to learn and adapt along the way. It can be as simple or as complicated as you need it to be, as some of these resources will demonstrate.
