A presentation made by Dr. Norman Walzer and Andy Blanke to the 2013 Community Development Society meeting in Charleston, South Carolina on July 24, 2013.
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADEthinktankinitiative
This document summarizes a study that evaluated the impact of formality on micro enterprise performance in Lima, Peru. The study used an encouragement design where 300 micro enterprises were randomly selected to receive an incentive to obtain an operating license, while the remaining 304 firms served as the comparison group. Surveys were conducted with all firms at baseline and over two and a half years to measure outcomes. The results found that operating with a municipal license had no statistically significant effect on firm performance measures like revenues, profits, employment levels, or access to credit. This suggests that simply providing licenses may not be enough to improve firm performance, and that formalization programs require a broader scope. The findings provide relevant evidence for policymakers on the limited impacts of
This document discusses perspectives on getting research into use from the Research and Policy in Development program at ODI. It notes that policymakers find research evidence difficult to use due to speed, superficiality, spin, secrecy, and scientific ignorance. Evidence is also just one factor among others that influence policy. The document outlines various knowledge strategies organizations can use to increase research impact, from simply disseminating information to deeply collaborating. It emphasizes understanding the political and social context, building stakeholder relationships and capacity, and being explicit about theories of change. Achieving greater research use may require new skills, focus, incentives, business models, and organizational change.
This document outlines a developmental evaluation approach used by the Bill and Melinda Gates Foundation's Community Partnerships Portfolio to understand system change in the postsecondary field. It describes the current state of the postsecondary system and the goals and outcomes of the initiative. A developmental evaluation was used because the initiative was complex, innovative and untested. Key lessons included that developmental evaluation looks different than other types of evaluation by engaging partners, developing tools for multiple uses, and refining tools over time. The evaluation aimed to develop understanding of what the system change model might look like through a reflective process.
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...thinktankinitiative
3ie funds high-quality impact evaluations that are policy-relevant and useful for decision-making. 3ie has learned that researchers must engage stakeholders early and throughout the process to increase the likelihood of findings being taken up and used. 3ie now requires researchers to develop policy influence plans and engage in ongoing discussions with implementing agencies to ensure studies answer relevant questions and produce feasible recommendations. While impact evaluations can provide compelling evidence, uptake is a political process and single studies rarely drive major policy changes.
The document discusses the development of a monitoring and evaluation (M&E) strategy for PRISE, a research consortium working in East Africa, West Africa, and Central/South Asia. It outlines five key monitoring areas for PRISE: 1) strategy and direction, 2) management, 3) outputs, 4) uptake and outcomes, and 5) context. For each area, it identifies key evaluation questions and discusses challenges in implementing the M&E strategy, such as defining outcomes and distributing monitoring responsibilities across partners and levels.
This document discusses developing indicators to measure progress on adaptation. It provides an overview of key concepts including what indicators are, frameworks for developing them, and the selection process. The selection process involves developing criteria, identifying key issues, building a conceptual framework, drafting indicators, and reviewing them. An example from Canada outlines identifying adaptation needs, stakeholders, themes to describe the agricultural system, and developing a shortlist of 25 indicators. The document stresses that developing indicators is iterative and collaborative, and that the process is as important as the final product.
The document summarizes an information meeting for a Master's program in Digital Media at a university in Seattle. The meeting agenda includes introductions, an overview of the program which has been running since 2001 and has graduated almost 100 students, and perspectives from current students and alumni. The program focuses on design, economics, history, law, policy and implications of digital technology. Core courses make up a third of the program and electives cover topics like branding, content creation, writing, and global policy. The degree requires 45 credits which most students complete in 18-36 months. Graduates are prepared for digital media management and production roles.
A case study of community engagement research to promote_cpedthinktankinitiative
This document summarizes a case study of community engagement research conducted in Nigeria's Niger Delta region to promote peace among five communities. The research team conducted surveys and focus groups with representatives from the communities. The findings showed different types of conflicts affecting the communities. As a result of presentations to community stakeholders, a Peace Committee was formed with rotating leadership among the communities. The community engagement model was then presented to local government and other organizations, some of which adopted aspects of the approach. The summary highlights ethical challenges including ensuring community participation, addressing power imbalances, and maintaining methodological rigor while involving communities in the research process.
Impact Evaluation Step by Step Evaluating the Impact of Formality_GRADEthinktankinitiative
This document summarizes a study that evaluated the impact of formality on micro enterprise performance in Lima, Peru. The study used an encouragement design where 300 micro enterprises were randomly selected to receive an incentive to obtain an operating license, while the remaining 304 firms served as the comparison group. Surveys were conducted with all firms at baseline and over two and a half years to measure outcomes. The results found that operating with a municipal license had no statistically significant effect on firm performance measures like revenues, profits, employment levels, or access to credit. This suggests that simply providing licenses may not be enough to improve firm performance, and that formalization programs require a broader scope. The findings provide relevant evidence for policymakers on the limited impacts of
This document discusses perspectives on getting research into use from the Research and Policy in Development program at ODI. It notes that policymakers find research evidence difficult to use due to speed, superficiality, spin, secrecy, and scientific ignorance. Evidence is also just one factor among others that influence policy. The document outlines various knowledge strategies organizations can use to increase research impact, from simply disseminating information to deeply collaborating. It emphasizes understanding the political and social context, building stakeholder relationships and capacity, and being explicit about theories of change. Achieving greater research use may require new skills, focus, incentives, business models, and organizational change.
This document outlines a developmental evaluation approach used by the Bill and Melinda Gates Foundation's Community Partnerships Portfolio to understand system change in the postsecondary field. It describes the current state of the postsecondary system and the goals and outcomes of the initiative. A developmental evaluation was used because the initiative was complex, innovative and untested. Key lessons included that developmental evaluation looks different than other types of evaluation by engaging partners, developing tools for multiple uses, and refining tools over time. The evaluation aimed to develop understanding of what the system change model might look like through a reflective process.
Impact Evaluation for Policy Making_Promoting Uptake of Impact Evaluation Fin...thinktankinitiative
3ie funds high-quality impact evaluations that are policy-relevant and useful for decision-making. 3ie has learned that researchers must engage stakeholders early and throughout the process to increase the likelihood of findings being taken up and used. 3ie now requires researchers to develop policy influence plans and engage in ongoing discussions with implementing agencies to ensure studies answer relevant questions and produce feasible recommendations. While impact evaluations can provide compelling evidence, uptake is a political process and single studies rarely drive major policy changes.
The document discusses the development of a monitoring and evaluation (M&E) strategy for PRISE, a research consortium working in East Africa, West Africa, and Central/South Asia. It outlines five key monitoring areas for PRISE: 1) strategy and direction, 2) management, 3) outputs, 4) uptake and outcomes, and 5) context. For each area, it identifies key evaluation questions and discusses challenges in implementing the M&E strategy, such as defining outcomes and distributing monitoring responsibilities across partners and levels.
This document discusses developing indicators to measure progress on adaptation. It provides an overview of key concepts including what indicators are, frameworks for developing them, and the selection process. The selection process involves developing criteria, identifying key issues, building a conceptual framework, drafting indicators, and reviewing them. An example from Canada outlines identifying adaptation needs, stakeholders, themes to describe the agricultural system, and developing a shortlist of 25 indicators. The document stresses that developing indicators is iterative and collaborative, and that the process is as important as the final product.
The document summarizes an information meeting for a Master's program in Digital Media at a university in Seattle. The meeting agenda includes introductions, an overview of the program which has been running since 2001 and has graduated almost 100 students, and perspectives from current students and alumni. The program focuses on design, economics, history, law, policy and implications of digital technology. Core courses make up a third of the program and electives cover topics like branding, content creation, writing, and global policy. The degree requires 45 credits which most students complete in 18-36 months. Graduates are prepared for digital media management and production roles.
A case study of community engagement research to promote_cpedthinktankinitiative
This document summarizes a case study of community engagement research conducted in Nigeria's Niger Delta region to promote peace among five communities. The research team conducted surveys and focus groups with representatives from the communities. The findings showed different types of conflicts affecting the communities. As a result of presentations to community stakeholders, a Peace Committee was formed with rotating leadership among the communities. The community engagement model was then presented to local government and other organizations, some of which adopted aspects of the approach. The summary highlights ethical challenges including ensuring community participation, addressing power imbalances, and maintaining methodological rigor while involving communities in the research process.
Tools for Measuring Place-Based Systems ChangeJustin Piff
This document discusses tools for measuring place-based and systems change initiatives. It emphasizes that evaluating systems change requires understanding events, patterns, and systemic structures. Frameworks presented measure changes in behaviors, relationships, policies, communication and resource allocation across stakeholders. Effective evaluation orients towards learning, involves community perspectives, and monitors changes at multiple levels over time.
This document outlines an emerging public value approach to open data planning activities. It discusses CTG's three priorities of knowledge creation, information dissemination, and capacity building. It then describes using a public value proposition framework to assess open data initiatives. This framework evaluates initiatives based on their expected public, private, and agency costs and returns, as well as direct citizen benefits, public-at-large benefits, and secondary performance gains. The document also provides examples of open data initiatives recently implemented by various government agencies and outlines a six-step process for identifying an initiative, stakeholders, and assessing the public value expected to be created.
The document summarizes research on the external context factors that influence think tank decision-making and performance. It outlines the main research questions, which examine how context is defined and measured, how it affects think tanks, and how think tanks respond to context. Four main external context factors are identified: political and economic context, donors, intellectual context, and civil society context. The research involved interviews, literature reviews, surveys, and case studies to explore these relationships. Context was operationalized using quantitative indicators that are widely available, consistent, and understandable. Preliminary results found few significant relationships between context measures and think tank outcomes, but a negative correlation between GDP and levels of policy discussion, implementation, and adoption.
This document describes an action research process used by the Active Citizens' Development Network (ACDN) in Sri Lanka to engage communities in research. ACDN worked with the Center for Poverty Analysis (CEPA) to collaboratively formulate research questions, have communities gather and analyze data, and ensure research quality. The process included organizing existing community data, storytelling workshops to construct narratives for preliminary analysis, and validating findings through additional data and discussions. The value of this approach was that it enabled communities to generate knowledge to address their own problems, demystified research, democratized knowledge production, and blurred roles between researchers and communities.
EPR Annual Conference 2020 Workshop 3 - David Banes EPR1
The document discusses current trends in assistive technology (AT) services and products. It notes increasing demand for AT due to demographic and economic pressures. Technology is becoming more pervasive and available on demand. Artificial intelligence can enable context-aware, personalized AT that predicts needs and provides autonomous functions and content clarification. In response, the AT ecosystem must focus on principles like resilience, fluidity, flexibility and frugality. The document provides contact information for the author to learn more.
Ending Violence Against Women and Children means learning how to have a Collective Impact (CI). This presentation draws from CI literature to show how the BBW Network is evolving using the CI model.
The document discusses the RAPID Outcome Mapping Approach for influencing policy change. It provides an overview of the typical policy process and different approaches for influencing policy, such as through cooperation, evidence-based advocacy, or activism. It then outlines the six steps of the RAPID Outcome Mapping Approach: 1) start by defining policy objectives, 2) use tools like the AIIM matrix to map actors and influence, 3) conduct a force field analysis to assess positive and negative forces, 4) create a SWOT analysis to evaluate strengths, weaknesses, opportunities and threats, 5) identify appropriate strategies like developing networks or conducting research, and 6) monitor and evaluate progress using tools like outcome mapping.
Randomized Controlled Trials: Insights for Civic Tech Andrew Westbury
Randomized controlled trials – or RCTs – have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies – like microfinance – and identifying the value of previously-unorthodox activities, like unconditional cash transfers.
However, what have these powerful tools taught us about state capacity, government accountability, and responsiveness? Moreover, what does the RCT literature tell us about the use of technology to improve public services and galvanize citizen groups?
Unfortunately, state capacity and government accountability are some of the least-researched areas of international development. The International Initiative for Impact Evaluation (3ie) reports that less than 3% of registered impact evaluations focus on governance-related issues.
Moreover, a review of 175 recent RCTs identified only approximately 30 that included a specific tech-focus and few of these evaluated used tech from the “bottom-up” to catalyse community-action, peer-to-peer collaboration, and citizen-led efforts to address civic issues.
The Center for Effective Global Action (CEGA) at UC-Berkeley has recently launched a multi-year effort to support randomised evaluations of governance interventions around the world. As a part of this process, CEGA this year published a white paper, surveying over 200 recent impact evaluations on governance issues to identify “what works” and highlight open research questions.
This document discusses key considerations for conducting program evaluations, including:
1) Evaluations must fit the specific context and involve multiple stakeholders to understand differing perspectives.
2) Evaluators should facilitate negotiations between stakeholders to develop shared understanding of the evaluation's purpose and questions.
3) Evaluations should have a clear purpose such as formative, summative, or knowledge generation.
4) Evaluation questions should help focus the evaluation and be tied to the program's goals, objectives, and theory of change. A variety of social science methods can be used to rigorously answer the questions.
Presentation by Andy Feldman on Bridging Evidence and Innovation made at the ...OECD Governance
This presentation by Andy Feldman was made at the OECD conference on Innovating the Public Sector: From Ideas to Impact (12-13 November 2014). For more information visit the OECD Observatory of Public Sector Innovation: https://www.oecd.org/governance/observatory-public-sector-innovation/events/.
An information meeting was held on December 12, 2006 in Seattle to discuss the Master of Communication in Digital Media program. The agenda included introductions, an overview of the program, student and alumni perspectives, and a question and answer session. The program, established in 2001, focuses on design, economics, history, law, policy, research and social implications of digital technology. Core courses make up one-third of the curriculum and cover digital media law and policy, technology trends, and research methodologies. Electives include branding, content creation, writing, and global policy courses. The degree requires 45 credits which can be completed in 18-36 months, with most students taking two courses per quarter part-time. Graduates are prepared
Alternative approaches, follow the feedback, plan for adaptation rahaim updatedCORE Group
This document discusses alternative approaches to behavior change programs in complex environments. It emphasizes the importance of engagement, listening, and adapting to feedback. Key points discussed include:
- Programs should focus on applying various data sources, including information that is often overlooked but important for understanding community perspectives.
- Engaging community members in data collection can provide both qualitative and quantitative data on behaviors and experiences with the intervention. This requires strategies to relay this data back to the project team.
- While data collection has costs, integrating audience feedback directly into planning and implementation can deepen engagement at a lower cost. Flexibility is important to allow for quick adjustments.
- Possible adjustments based on feedback include modifying messages, messengers
February 9: Facilitation Notes for Targeted Topics Forum | Blane Harvey and C...NAP Global Network
Facilitation notes by Blane Harvey and Catherine Fisher, IISD, as part of the NAP Global Network's Targeted Topics Forum held in Nadi, Fiji, in February 2018.
This document summarizes a sociological model and tools for mineral exploration companies to build positive relationships with communities. It is based on 240 interviews and 9 case studies. The model involves understanding reference communities, interactional needs, and building trust through dialogue. Relationships are key to success. Matrices can track relationship quality over time. Internally, companies should apply these processes to integrate cultures and adapt externally. Understanding sociological processes allows strategies to develop shared meanings and overlap between a company and communities.
The document discusses collective impact and the role of backbone organizations in Wayne County. It provides an overview of collective impact principles and conditions, describing how Forward Wayne County acts as a backbone organization to guide vision, support aligned activities, establish shared measurements, build public will, and advance policy. It then outlines Forward Wayne County's work over the past year to address issues like early childhood success, neighborhood development, and employability. Moving forward, it plans to focus on continuous communication, data analysis, resource mobilization, and dashboard development to improve outcomes county-wide through collective impact.
Tools for Measuring Place-Based Systems ChangeJustin Piff
This document discusses tools for measuring place-based and systems change initiatives. It emphasizes that evaluating systems change requires understanding events, patterns, and systemic structures. Frameworks presented measure changes in behaviors, relationships, policies, communication and resource allocation across stakeholders. Effective evaluation orients towards learning, involves community perspectives, and monitors changes at multiple levels over time.
This document outlines an emerging public value approach to open data planning activities. It discusses CTG's three priorities of knowledge creation, information dissemination, and capacity building. It then describes using a public value proposition framework to assess open data initiatives. This framework evaluates initiatives based on their expected public, private, and agency costs and returns, as well as direct citizen benefits, public-at-large benefits, and secondary performance gains. The document also provides examples of open data initiatives recently implemented by various government agencies and outlines a six-step process for identifying an initiative, stakeholders, and assessing the public value expected to be created.
The document summarizes research on the external context factors that influence think tank decision-making and performance. It outlines the main research questions, which examine how context is defined and measured, how it affects think tanks, and how think tanks respond to context. Four main external context factors are identified: political and economic context, donors, intellectual context, and civil society context. The research involved interviews, literature reviews, surveys, and case studies to explore these relationships. Context was operationalized using quantitative indicators that are widely available, consistent, and understandable. Preliminary results found few significant relationships between context measures and think tank outcomes, but a negative correlation between GDP and levels of policy discussion, implementation, and adoption.
This document describes an action research process used by the Active Citizens' Development Network (ACDN) in Sri Lanka to engage communities in research. ACDN worked with the Center for Poverty Analysis (CEPA) to collaboratively formulate research questions, have communities gather and analyze data, and ensure research quality. The process included organizing existing community data, storytelling workshops to construct narratives for preliminary analysis, and validating findings through additional data and discussions. The value of this approach was that it enabled communities to generate knowledge to address their own problems, demystified research, democratized knowledge production, and blurred roles between researchers and communities.
EPR Annual Conference 2020 Workshop 3 - David Banes EPR1
The document discusses current trends in assistive technology (AT) services and products. It notes increasing demand for AT due to demographic and economic pressures. Technology is becoming more pervasive and available on demand. Artificial intelligence can enable context-aware, personalized AT that predicts needs and provides autonomous functions and content clarification. In response, the AT ecosystem must focus on principles like resilience, fluidity, flexibility and frugality. The document provides contact information for the author to learn more.
Ending Violence Against Women and Children means learning how to have a Collective Impact (CI). This presentation draws from CI literature to show how the BBW Network is evolving using the CI model.
The document discusses the RAPID Outcome Mapping Approach for influencing policy change. It provides an overview of the typical policy process and different approaches for influencing policy, such as through cooperation, evidence-based advocacy, or activism. It then outlines the six steps of the RAPID Outcome Mapping Approach: 1) start by defining policy objectives, 2) use tools like the AIIM matrix to map actors and influence, 3) conduct a force field analysis to assess positive and negative forces, 4) create a SWOT analysis to evaluate strengths, weaknesses, opportunities and threats, 5) identify appropriate strategies like developing networks or conducting research, and 6) monitor and evaluate progress using tools like outcome mapping.
Randomized Controlled Trials: Insights for Civic Tech Andrew Westbury
Randomized controlled trials – or RCTs – have dramatically changed the development landscape, casting doubt on the effectiveness of accepted strategies – like microfinance – and identifying the value of previously-unorthodox activities, like unconditional cash transfers.
However, what have these powerful tools taught us about state capacity, government accountability, and responsiveness? Moreover, what does the RCT literature tell us about the use of technology to improve public services and galvanize citizen groups?
Unfortunately, state capacity and government accountability are some of the least-researched areas of international development. The International Initiative for Impact Evaluation (3ie) reports that less than 3% of registered impact evaluations focus on governance-related issues.
Moreover, a review of 175 recent RCTs identified only approximately 30 that included a specific tech-focus and few of these evaluated used tech from the “bottom-up” to catalyse community-action, peer-to-peer collaboration, and citizen-led efforts to address civic issues.
The Center for Effective Global Action (CEGA) at UC-Berkeley has recently launched a multi-year effort to support randomised evaluations of governance interventions around the world. As a part of this process, CEGA this year published a white paper, surveying over 200 recent impact evaluations on governance issues to identify “what works” and highlight open research questions.
This document discusses key considerations for conducting program evaluations, including:
1) Evaluations must fit the specific context and involve multiple stakeholders to understand differing perspectives.
2) Evaluators should facilitate negotiations between stakeholders to develop shared understanding of the evaluation's purpose and questions.
3) Evaluations should have a clear purpose such as formative, summative, or knowledge generation.
4) Evaluation questions should help focus the evaluation and be tied to the program's goals, objectives, and theory of change. A variety of social science methods can be used to rigorously answer the questions.
Presentation by Andy Feldman on Bridging Evidence and Innovation made at the ...OECD Governance
This presentation by Andy Feldman was made at the OECD conference on Innovating the Public Sector: From Ideas to Impact (12-13 November 2014). For more information visit the OECD Observatory of Public Sector Innovation: https://www.oecd.org/governance/observatory-public-sector-innovation/events/.
An information meeting was held on December 12, 2006 in Seattle to discuss the Master of Communication in Digital Media program. The agenda included introductions, an overview of the program, student and alumni perspectives, and a question and answer session. The program, established in 2001, focuses on design, economics, history, law, policy, research and social implications of digital technology. Core courses make up one-third of the curriculum and cover digital media law and policy, technology trends, and research methodologies. Electives include branding, content creation, writing, and global policy courses. The degree requires 45 credits which can be completed in 18-36 months, with most students taking two courses per quarter part-time. Graduates are prepared
Alternative approaches, follow the feedback, plan for adaptation rahaim updatedCORE Group
This document discusses alternative approaches to behavior change programs in complex environments. It emphasizes the importance of engagement, listening, and adapting to feedback. Key points discussed include:
- Programs should focus on applying various data sources, including information that is often overlooked but important for understanding community perspectives.
- Engaging community members in data collection can provide both qualitative and quantitative data on behaviors and experiences with the intervention. This requires strategies to relay this data back to the project team.
- While data collection has costs, integrating audience feedback directly into planning and implementation can deepen engagement at a lower cost. Flexibility is important to allow for quick adjustments.
- Possible adjustments based on feedback include modifying messages, messengers
February 9: Facilitation Notes for Targeted Topics Forum | Blane Harvey and C...NAP Global Network
Facilitation notes by Blane Harvey and Catherine Fisher, IISD, as part of the NAP Global Network's Targeted Topics Forum held in Nadi, Fiji, in February 2018.
This document summarizes a sociological model and tools for mineral exploration companies to build positive relationships with communities. It is based on 240 interviews and 9 case studies. The model involves understanding reference communities, interactional needs, and building trust through dialogue. Relationships are key to success. Matrices can track relationship quality over time. Internally, companies should apply these processes to integrate cultures and adapt externally. Understanding sociological processes allows strategies to develop shared meanings and overlap between a company and communities.
The document discusses collective impact and the role of backbone organizations in Wayne County. It provides an overview of collective impact principles and conditions, describing how Forward Wayne County acts as a backbone organization to guide vision, support aligned activities, establish shared measurements, build public will, and advance policy. It then outlines Forward Wayne County's work over the past year to address issues like early childhood success, neighborhood development, and employability. Moving forward, it plans to focus on continuous communication, data analysis, resource mobilization, and dashboard development to improve outcomes county-wide through collective impact.
The American Planning Association (APA) is developing a program to designate comprehensive plans that meet certain sustainability standards. An APA task force explored using comprehensive plans as tools to help communities achieve sustainable outcomes. The APA will develop standards based on principles like livable built environments and regional resilience. Communities can apply for designation by self-assessing their plan against the standards. Trained reviewers will score plans and determine the designation level. The APA is still working out details like the application process and maintaining the standards over time. The presentation discusses similarities and differences to other certification programs and gets feedback on ensuring the criteria can apply to all community types and sizes.
This document provides an overview of a executive masterclass bootcamp on impact measurement hosted by the CSR Training Institute. It introduces the faculty team who will be teaching sessions on impact measurement frameworks, applying frameworks to case studies, SDGs and impact measurement, and emerging trends. It provides backgrounds on each faculty member and their relevant experience. The agenda and objectives of the bootcamp are outlined, focusing on developing an understanding of impact measurement and applying the framework to real projects. Guiding principles for the sessions are discussed and a caution is given around evolving terminology in the field.
PCM - Project Cycle Management, Training on Evaluationrexcris
The document discusses key concepts in project evaluation including definitions of evaluation, the project cycle, when evaluations should occur, purposes of evaluations, and criteria for evaluating development assistance including relevance, efficiency, effectiveness, impact, and sustainability. It provides examples of questions to consider under each of the five evaluation criteria. The summary focuses on defining the five evaluation criteria - relevance, efficiency, effectiveness, impact, and sustainability.
Evaluability Assessments and Choice of Evaluation MethodsDebbie_at_IDS
The document discusses evaluability assessments (EAs) and how they can inform the choice of evaluation methods. Key points:
- EAs examine a project's design, available information, and context to determine if and how an evaluation could be conducted. They help ensure evaluations are useful and feasible.
- Common EA steps include reviewing documentation, engaging stakeholders, and making recommendations about a project's logic, monitoring systems, and potential evaluation approaches.
- Choosing evaluation methods depends on the EA results as well as the evaluation's purpose, required credibility, complexity of the intervention, and available resources. Methods like experiments provide strong evidence of impact but are difficult to implement.
- EAs improve evaluation quality by engaging
1) The document outlines key components to include in an impact framework for assessing ICT-enabled social innovation initiatives, including ICT, personal social services, social innovation, social investment, and impact assessment.
2) It discusses recognized measurement methodologies involving setting goals, developing a framework, selecting metrics, and undertaking analysis. Theories of change are commonly used.
3) Stakeholders in impact measurement are identified as impact creators, funders, beneficiaries and recipients, each with different perspectives.
4) Existing good practice frameworks address measuring social impact generally as well as specific areas like ICT and social innovation. Guidelines emphasize qualitative and quantitative approaches.
This document discusses approaches to measuring social impact. It outlines the differences between metrics, analytics, and big data, as well as transactions, interactions, and social impact. It then describes the social impact creation cycle and challenges to measuring social impact. The document recommends a comprehensive approach that uses metrics, analytics, and strategic planning to identify clear goals and assess high-value initiatives. It emphasizes measuring success in increasing social impact as the ultimate goal.
Project Sustainability workshop session; Anna Lindh FoundationKarl Donert
A workshop on Project Sustainability. An analysis and key questions to consider for project sustainability and management. Some theoretical and practical aspects.
Metrics is a hot topic within all fundraising fields. Measurement models have been established for monitoring the work of frontline fundraisers in order to assess the variety of activities performed as well as the schedule, pace, and outcomes of those activities. With this information in hand, choices can be made about which fundraising activities are most effective in achieving the desired donor behavior, most obviously giving.
Whole systems change across a neighbourhood
How can we collaborate with people to help them build their resilience? Get under the skin of the culture and the lives people live. Identify people’s feelings and experiences of community and understand what people think is shaped by different values and by the environment and infrastructure around them. The future of collaboration could bring many opportunities but people find it more difficult to live and act together than before. How can we help people…and communities build their resilience? Understand people’s different situations and capabilities to develop pathways that help them build resilient relationships. Help people experience and practice change together. Help people grow everyday practices into sustainable projects. Turn people’s everyday motivations into design principles. Support infrastructure that connects different cultures of collaboration. Build relationships with people designing in collaboration for the future…now.
The document discusses community services reform in Victoria and identifies several challenges faced in previous reform attempts, including issues of trust, funding not matching rhetoric, and discontinuity of policy. It proposes a place-based approach to child and family services planning centered around outcomes-focused funding packages for vulnerable families organized at the local level through collaborative governance between government and community organizations.
Social return on investment (SROI) is an approach to evaluating programs and projects that aims to account for non-financial outcomes using monetary values. It measures social, environmental, and economic impacts in relation to costs to generate an SROI ratio. The document outlines the SROI method, including establishing scope, mapping outcomes, valuing outcomes, calculating impact, and generating the ratio. It also discusses appropriate and inappropriate uses as well as challenges, such as quantifying social impacts and explaining financial proxies to stakeholders.
Building Capacity for Collaborative Action: Can Collective Impact Help Advanc...Arbor Day Foundation
This document discusses how collective impact can help build capacity for urban forestry efforts. It introduces collective impact as a framework with five conditions: common agenda, shared measurement, mutually reinforcing activities, continuous communication, and a backbone organization. It then summarizes a regional urban forestry strategy project in Portland and Vancouver that applied collective impact. By bringing different organizations together toward shared goals of increasing tree canopy and collaboration, the project helped advance urban forestry in the region.
The formulation phase of a national urban policy involves designing the policy vision, objectives, strategies and actions through consultation and engagement with stakeholders. Key considerations for formulation include determining the lead agency, assessing data availability, stakeholder participation, and available resources. The best policy options are identified based on consistency with priorities, effectiveness, costs/benefits, and feasibility of implementation. Formal adoption and endorsement by government bodies are followed by planning to enact the policy through laws, decrees or other mechanisms. The national urban policy document should outline governance, spatial, financial, economic, social and environmental sustainability.
Program evaluation is needed to provide policymakers information on program effectiveness and areas for improvement. The roles of a professional evaluator include collecting relevant information, applying standards to make judgments on a program's merit, worth and significance, and communicating evaluation results to stakeholders. Examples of evaluation uses span various sectors such as education, nonprofit, business and industry to improve programs and make decisions about program adoption and continuation.
Similar to Measuring Community Development: Moving Beyond Jobs and Investment (20)
This document summarizes recent population trends in Illinois based on Census Bureau data. It finds that:
- Illinois has experienced a net population loss over the last decade, losing over 159,000 residents between 2010-2019, while neighboring states like Indiana and Minnesota have grown.
- Both rural and urban areas of Illinois have seen population declines, with the Chicago metro area losing over 94,000 residents between 2013-2018, an unprecedented loss.
- Only 7 of Illinois' 102 counties grew between 2018-2019, and few have seen gains this decade, putting Illinois at risk of losing a congressional seat after the 2020 Census if trends continue.
June 2019 marked the tenth anniversary of the official end of the last recession. Illinois suffered a net loss of over 325,000 jobs during the recession.
Since the recession, the Illinois economy experienced a much slower recovery than neighboring states or the nation. Illinois gained of 285,700 jobs between June 2009 and June 2019. However, there are almost 40,000 fewer jobs now than were lost during the recession.
Downstate metros and rural counties were disproportionally impacted by job losses during the recession, with many continuing to lose jobs after the recession. Over half of Illinois’ counties had lower overall employment in June 2019 than at the end of the recession.
A presentation made to the Illinois Higher Education Civic Engagement Collaborative of Chicago on April 26 2019 at the University of Illinois-Chicago by CGS Research Assiciate Brian Harger.
Manufacturing is an integral
part of the Illinois economy.
While it accounts for 12.1% of
the State’s GDP and 7.8% of
total employment, it also
impacts many other sectors of
the economy.
Manufacturers also spend
millions of dollars on goods
and services from local
suppliers, which in turn
supports addiƟonal jobs and
business sales. In addiƟon,
manufacturing workers, as well
as the employees of related
suppliers, spend their earnings
on food, housing,
ransportaƟon, healthcare,
entertainment, and other
consumer goods in their
communiƟes.
When these factors are taken
into account, manufacturing
contributes 24.7% of Illinois’
total GDP and supports one in
five jobs.
A workshop presented by Diana Robinson and Brian Harger to the The Governor's Summit on Work-Based Learning at Illinois Central College in East Peoria on Monday, October 1 2018.
Presentation by Diana Robinson and Brian Harger to the The Governor's Summit on Work-Based Learning at Illinois Central College in East Peoria on Monday, October 1 2018.
Brian Harger presented an overview of recent population trends in Whiteside County, Illinois and their implications. The county's population has declined slightly from 2010 to 2017. There has been a demographic transition with a growing elderly population and declining youth population. This impacts employment, with more retired older workers and a shrinking labor force. Economic indicators like median income and GDP per capita have increased slightly but poverty rates have remained stable. Challenges for the future include retaining the youth population and adapting to job automation. Potential strategies discussed include retraining workers, entrepreneurship programs, and community-supported enterprises.
Manufacturing’s total contribution to the Northwest
Illinois economy (GDP) in 2016 was over $2.6 billion;
36.4% of the total GDP of the Region. This infographic summarizes the contribution of manufacturing to the Northwest Illinois economy. The analysis was created by the the Center for Governmental Studies at Northern Illinois University in cooperation with the Whiteside County Department of Economic Development.
A brief presentation of recent population trends in Illinois from 2010 to 2017 along with related commentary. This is part of an ongoing series of presentations on topics relevant to Illinois and the U.S. midwest.
A presentation made by Brian Harger and Sherrie Taylor at the Illinois Association for Institutional Research 2017 Annual Forum on the role and process of environmental scanning in higher education.
This report represents a year-long collaboration among economic development and business leaders
in Carroll, Lee, Ogle, Stephenson, and Whiteside counties to identify potential economic development
strategies and projects. The findings are based on personal interviews with business leaders, electronic
surveys of businesses regarding compensation issues, and phone interviews of residents about status and
availability for employment changes. Considerable attention was paid to workforce characteristics and
whether population changes will challenge the ability of employers to hire workers in the future. All of
the information collected contributed to understanding the ways in which the region can position itself
to start, retain, and attract businesses.
This presentation explores recent trends in Illinois manufacturing based on technological intensity. Authored by Brian Harger, Research Associate at the Center for Governmental Studies at Northern Illinois University.
A presentation to the McHenry County Council of Governments made on October 28, 2015 by Brian Harger, Research Associate at the NIU Center for Governmental Studies.
The document provides an analysis of industry clusters and the labor market in North Central Illinois. It identifies five high potential industry clusters: Agribusiness, Food Processing and Technology; Energy; Machinery Manufacturing; Mining; and Transportation and Logistics. These clusters have a significant regional presence and supply chain synergies. The analysis also finds that the region has approximately 25,700 available workers for employers, including 16,300 underemployed workers and 9,400 unemployed workers actively seeking work. Key industries within the clusters have potential for new business development or expansion.
The document provides an economic impact analysis of the mining industry in LaSalle County, Illinois. It finds that in 2013, the mining industry was responsible for sustaining 1,979 jobs in LaSalle County, including 820 direct jobs in the mining companies. The industry also generated $1.2 billion in total output and $404.2 million in value-added impacts. It discusses the history of mining in the county dating back to the 19th century and describes the current industries, which include crushed limestone, sand and gravel, and silica sand mining.
In April 2014, the North Central Illinois Council of Governments (NCICG) contracted with the Center for Governmental Studies (CGS) at Northern Illinois University (NIU) to prepare a regional analysis for the six counties in North Central Illinois. The NCICG offers primary community development services including: Bureau, Grundy, LaSalle, Marshall, Putnam, and Stark counties.
The objective of the regional analysis was to analyze demographic and business trends and characteristics of the region, and ultimately identify industry clusters, or concentrations of competing, complementary, and/or interdependent firms and industries which conduct business with each other and/or have common needs for talent, technology, and infrastructure.
The CGS analysis of the region identified five high potential industry clusters. These clusters are compatible with the existing or proposed land use, zoning, and infrastructure capacity of the development area.
A short presentation on recent economic trends in the metro Chicago region with a particular regard to the suburban or "Collar Counties". While the recovery from the recent recession has been uneven, the region has considerable resources to draw upon and competitive advantages that it has only begun to exploit.
How to Download & Install Module From the Odoo App Store in Odoo 17Celine George
Custom modules offer the flexibility to extend Odoo's capabilities, address unique requirements, and optimize workflows to align seamlessly with your organization's processes. By leveraging custom modules, businesses can unlock greater efficiency, productivity, and innovation, empowering them to stay competitive in today's dynamic market landscape. In this tutorial, we'll guide you step by step on how to easily download and install modules from the Odoo App Store.
Gender and Mental Health - Counselling and Family Therapy Applications and In...PsychoTech Services
A proprietary approach developed by bringing together the best of learning theories from Psychology, design principles from the world of visualization, and pedagogical methods from over a decade of training experience, that enables you to: Learn better, faster!
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptxCapitolTechU
Slides from a Capitol Technology University webinar held June 20, 2024. The webinar featured Dr. Donovan Wright, presenting on the Department of Defense Digital Transformation.
THE SACRIFICE HOW PRO-PALESTINE PROTESTS STUDENTS ARE SACRIFICING TO CHANGE T...indexPub
The recent surge in pro-Palestine student activism has prompted significant responses from universities, ranging from negotiations and divestment commitments to increased transparency about investments in companies supporting the war on Gaza. This activism has led to the cessation of student encampments but also highlighted the substantial sacrifices made by students, including academic disruptions and personal risks. The primary drivers of these protests are poor university administration, lack of transparency, and inadequate communication between officials and students. This study examines the profound emotional, psychological, and professional impacts on students engaged in pro-Palestine protests, focusing on Generation Z's (Gen-Z) activism dynamics. This paper explores the significant sacrifices made by these students and even the professors supporting the pro-Palestine movement, with a focus on recent global movements. Through an in-depth analysis of printed and electronic media, the study examines the impacts of these sacrifices on the academic and personal lives of those involved. The paper highlights examples from various universities, demonstrating student activism's long-term and short-term effects, including disciplinary actions, social backlash, and career implications. The researchers also explore the broader implications of student sacrifices. The findings reveal that these sacrifices are driven by a profound commitment to justice and human rights, and are influenced by the increasing availability of information, peer interactions, and personal convictions. The study also discusses the broader implications of this activism, comparing it to historical precedents and assessing its potential to influence policy and public opinion. The emotional and psychological toll on student activists is significant, but their sense of purpose and community support mitigates some of these challenges. However, the researchers call for acknowledging the broader Impact of these sacrifices on the future global movement of FreePalestine.
How to Manage Reception Report in Odoo 17Celine George
A business may deal with both sales and purchases occasionally. They buy things from vendors and then sell them to their customers. Such dealings can be confusing at times. Because multiple clients may inquire about the same product at the same time, after purchasing those products, customers must be assigned to them. Odoo has a tool called Reception Report that can be used to complete this assignment. By enabling this, a reception report comes automatically after confirming a receipt, from which we can assign products to orders.
6. Ongoing challenges
• Cost‐effectiveness vs Relevance
State/national sources 1 year behind
Local quantitative studies are expensive
• Relevance vs Comparability
Communities have unique goals
Need benchmarks, best practices
• Cost‐effectiveness vs Comparability
Case studies not generalizable
Local quantitative studies are expensive
7. Models of Measurement
Universal
Contingent‐
Independent
Contingent‐ Facilitated
• Quantitative focus
• Unique goals
• Unique goals
• Common goals
• Not comparable
• Limited comparability
• Comparable
• Own strategic plan and
• Technical assistance
• Secondary data
• Technical assistance
from larger organization
consultants
• Qualitative and
quantitative
• Primary and secondary
data
from larger organization
• Qualitative focus
• Mostly primary data
8. Trends in Measurement Practices
• 1960’s ‐ quality of life measures nationally
• 1970’s ‐ quality of life locally in CA and NY
• 1980’s & 90’s
Sustainability in Seattle
Benchmarking economic development in Oregon
• 2000’s ‐ application to rural communities
• Recent years‐ growing technical assistance
Developmental models
Focus on Sustainability
Measuring community wealth
• Growing Interest by Foundations in Measuring Investment
Outcomes
9. Early Interest by Nonprofit Sector*
• Financial Accountability
• Program Products or Outputs
• Adherence to Standards of Quality in Service Delivery
• Participant‐related Measures (need)
• Key Performance Indicators
• Client Satisfaction (not instituted until later)
* Margaret Plantz, Martha Taylor Greenway, and Michael Henricks. 1997. “Outcome Measurement: Showing
Results in the Nonprofit Sector.” New Directions for Evaluation, no. 75.
10. Success Measures
Neighborworks USA
• National Grant‐making Organization
• Provides Online toolkit
• 122 possible indicators
Social, environmental, economic
Local choice
Survey guides/templates
State/national sources
• Used by 300 organizations in 48 states
• Common use ‐ housing programs
Changes in property values
Survey satisfaction w/ home quality, safety
• Strategic plan ‐ choose own indicators
• Cost‐effective ‐ technical assistance
14. Central Appalachian Network
(Ohio, Kentucky, Tennessee, Virginia, West Virginia)
• Strategic plan for improving quality of life for farmers
• 7 forms of capital
Intellectual‐ stock of knowledge, creativity, innovation
Social‐ new relationships‐ restaurants putting local food on menus
Built‐ freezing facilities built to aid farmers (economic)
Natural‐ acres of farmland preserved (environment)
Political – stock of power ands goodwill held in region
Financial‐ growing farm income (social, economic)
Cultural‐ influences ways how people define and approach issues
• Cost‐effective
Secondary sources for economic Indicators
Case studies for social capital
Indicators collected as part of operations
15. Summary
• Plan must come first
Define goals
Gain support
• Smaller organizations need technical assistance
Current data sources
Guides/templates
Consultants
• Be qualitative when measuring process
More timely
Case studies
• Use quantitative measures when measuring outcomes
Identifies problems, results
• Conduct research to understand indicators and policy
intervention