Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Evaluating Systems Change - Annexes


Published on

Whole systems change across a neighbourhood

How can we collaborate with people to help them build their resilience? Get under the skin of the culture and the lives people live. Identify people’s feelings and experiences of community and understand what people think is shaped by different values and by the environment and infrastructure around them. The future of collaboration could bring many opportunities but people find it more difficult to live and act together than before. How can we help people…and communities build their resilience? Understand people’s different situations and capabilities to develop pathways that help them build resilient relationships. Help people experience and practice change together. Help people grow everyday practices into sustainable projects. Turn people’s everyday motivations into design principles. Support infrastructure that connects different cultures of collaboration. Build relationships with people designing in collaboration for the future…now.

Published in: Government & Nonprofit
  • Be the first to comment

  • Be the first to like this

Evaluating Systems Change - Annexes

  1. 1. Annexes • Overview of evaluation methods & processes • Evaluating the impact of programme on residents • Sampling residents • Evaluating the impact of the programme on the process of systems change • Baseline & sampling systems change • Types of perspectives of evaluating interventions
  2. 2. Overview of evaluation methods & processes
  3. 3. Evaluating the impact of programme on residents • What are the different actions, behaviours & people that have influenced the outcome / change in behaviour (see Behaviour Change Wheel) • To what extent can the outcome achieved be attributed to the intervention or programme? (i.e. could inactive residents have become more active anyway, have staff benefited from other training that has helped them influence resident's behaviours) • What are the pathways that have led to the change in behavior? Behaviour Change Wheel
  4. 4. Sampling residents • Randomised sampling, such as using a residents survey • Cluster sampling, such as getting Activity Hubs to carry out research • Extreme case sampling, interviewing people who used to be inactive but are now active, but also getting others active • Snowball sampling, asking residents / community connectors to identify people to recommend to speak to • Multi-stage sampling, using different sampling methods
  5. 5. Evaluating the impact of the programme on the process of systems change • Context—improving the political environment that surrounds a system so it produces the policy and funding changes needed to create and sustain it • Components—establishing programs and services that produce results for system stakeholders and/or participants • Connections—creating strong and effective linkages across system components that improve results for clients • Infrastructure—developing support that systems need to function effectively • Scale—ensuring a comprehensive system is available to as many people as possible
  6. 6. Baselining systems change What is the system? • Describe the system the programme/change is expected to influence • Describe the system’s relationships and dynamics. • Describe the diverse goals or perspectives within the system. What is the systems change intervention (the programme building blocks)? • Describe how the intervention will be governed or implemented. • Describe the key points of the intervention’s theories of change and action. Describe the intervention’s intended outcomes. What are the goals of the systems change evaluation? • Describe the evaluation’s users, purposes and methods. Example
  7. 7. Sampling systems change • As the evaluation of systems change will be iterative, we want the sampling methods to be iterative and not fixed from the start
  8. 8. Types of perspectives of evaluating interventions • Did the intervention do what was intended? • Did the intervention produce the expected results within its intended focus area? • To what extent can a specific impact be attributed to the intervention? • Did the intervention make a difference? • How has the intervention made a difference?