13.45: As people arrive, teas, coffees 14.00: Welcome: Housekeeping
14.20 Presentation: What is monitoring, what is evaluation? Monitoring: ongoing data gathering, e.g. to see if things are on track. Evaluation: end of project (or other key point). Analysis of what you have collected. Full scale detailed process to judge the value of a project or service, using the information gathered through monitoring
10.20 Presentation: What is monitoring, what is evaluation? Monitoring: ongoing data gathering, e.g. to see if things are on track. Evaluation: end of project (or other key point). Analysis of what you have collected. Full scale detailed process to judge the value of a project or service, using the information gathered through monitoring
14.45. Presentation MVSC Development Team Example 14.50: Now in pairs, do one for your project or organisation. Together identify the overall aim of your project, some specific aims then some activities. Language: middle section use words to describe change: e.g. to increase; promote; improve; reduce; enable; develop Bottom section use words such as: provide organise run etc. There is information in your packs on how to produce a triangle. Go round. Everyone happy? Why does this matter? It’s a lot easier to monitor and evaluate a project if you know what you intend it to achieve in the first place!
15.45: Presentation and example Indicator – gives evidence of progress towards aims. Take one activity as an example: MVSC training programme. Outputs: Numbers of courses; number of people attending; number of different groups who attended (e.g. if targeted at specific groups) The output performance indicator could be the number of bookings and who has booked e.g target group. Outcomes: aims were to improve the governance of vol orgs and to have a better funded and informed voluntary sector. Are we on the way to achieving this? Indicators: People who attend the courses say their groups are now more efficient and their committees understand their roles and responsibilities. More successful funding applications are submitted, so groups are becoming better resourced People attending training sessions are becoming more confident at managing their organisations as they have the relevant information. In twos: take one activity and a related aim and discuss with your partner what a couple of indicators could be for each. Worth remembering SMART: Relate to setting targets, but equally appropriate when setting performance indicators) Specific (clear, easily understood), Measurable, Achievable, Relevant and Time-limited
PACKS Additional support. Evaluation forms.
ICT for Outcomes Monitoring 23 rd May 2011
Raising awareness of a range of ICT tools that can be deployed to improve the efficiency and effectiveness of outcomes monitoring.
Overall Aim Specific Aims Activities Outcomes Outputs VCOs make better use of ICT to deliver their services More effective & efficient service delivery Staff & volunteers have the necessary skills Training Onsite & remote technical support ICT Healthchecks & Action Plans Source: Charities Evaluation Service Superhighways Fit for purpose & stable ICT infrastructure
The Outcomes Star can provide outcomes data at four levels:
For individual service users: the Star gives a snapshot of where they were on each outcome area when they joined the project and at each review – the difference between starting point and review shows the progress made in that time.
For a project as a whole: the average starting points on entry to the service and the amount of progress made in a specified time period or over their life-time in the project can be calculated – this gives a picture of the project outcomes. The Outcomes Star™ online can provide this information at the touch of a button.
For a group of projects across an organisation: the same information as above can be calculated for each project allowing comparison between different services. In addition users of the Outcomes Star™ online can compare the progress made by different sub-groups of clients, for example women and men or older and younger service users.
For similar projects across a sector: the same analyses as described above can be carried out for a sector as a whole. This makes it possible to establish benchmarks identifying good practice and building an outcomes-focused evidence base. This is only possible using the Outcomes Star™ online.