13.45: As people arrive, teas, coffees 14.00: Welcome: Housekeeping
14.20 Presentation: What is monitoring, what is evaluation? Monitoring: ongoing data gathering, e.g. to see if things are on track. Evaluation: end of project (or other key point). Analysis of what you have collected. Full scale detailed process to judge the value of a project or service, using the information gathered through monitoring
PACKS Additional support. Evaluation forms.
Outcomes & ICT KVA Nov 2012
ICT for Outcomes Monitoring 27th November 2012 Raising awareness of a range of ICT tools that can be deployed to improve the efficiency and effectiveness of outcomes monitoring.
Session objectives • Learn how ICT can help with collecting, storing, retrieving and presenting outcomes information • Understand more about the processes involved in implementing a holistic system • See demonstrations looking at ‘off the shelf systems selected for relevance in terms of services, client group and cost • Start identifying specific tools that will enable you to better capture information relating to your organisations outcomes • Draft an action plan to support adoption of these tools over the next year 6 – 12 months
Your current practiceHow are you currently using ICT to capture& evidence Outcomes?What challenges do you face?Do you already have ideas for how you canimprove this process?
Why ICT can help?Greater efficiency: • Automating manual processes • Reducing paperwork • Reducing staff timeGreater effectiveness: • Sharing / accessing information • Analysing data in more sophisticated ways • Presenting information with greater impact & to a wider variety of audiences
Collecting Outcomes information • Online surveys • Website feedback • Outreach laptops • Digital / video cameras • Dictaphones / mobile phones • Diaries / blogs
Developing a system…First steps Get together as a team and identify and agree the what, how, when, why and then capture this on paper Remember to include bother outputs and outcomes
Next steps… Carry out an audit of current systems – what are you using, what works well, what frustrates you etc Document how you are structuring your information e.g. the ‘fields’ you are using Draw up a brief – include some background and specify what you need – remember to future proof
Next steps… Then consider… • Is this something that can be realistically developed in house? • If not, research whether a system already exists to meet your needs? • If not, budget for the bespoke option
Resources required? Upgraded ICT infrastructure?A new system or developments to an existing system? Data migration or start from scratch? Staff roles and training?
Selecting a database for monitoring http://www.ces-vol.org.uk/Resources/Charitie
Outcomes starVersions currently available: Homelessness Star Mental Health Recovery Star Teen Star Alcohol Star Work Star Older Persons Star Family Star Community StarVersions currently in development: Music Therapy Star Life Star for learning disability Spectrum Star for autism & aspergers syndrome Sexual Health Star Well-being Star Empowerment Star for domestic violence services
Teen StarThis version has been developed for and with teenagers in a substance misuse setting but should be applicable in other settings. Outcome areas (6): • Drugs and alcohol • Well-being • Safety and security • Structure and education • Behaviour and citizenship • Family and other key adults These link to the five high-level Every Child Matters (ECM) outcomes….
Evidencing outcomes at differentlevelsThe Outcomes Star can provide outcomes data at four levels: For individual service users: the Star gives a snapshot of where they were on each outcome area when they joined the project and at each review – the difference between starting point and review shows the progress made in that time. For a project as a whole: the average starting points on entry to the service and the amount of progress made in a specified time period or over their life-time in the project can be calculated – this gives a picture of the project outcomes. The Outcomes Star™ online can provide this information at the touch of a button. For a group of projects across an organisation: the same information as above can be calculated for each project allowing comparison between different services. In addition users of the Outcomes Star™ online can compare the progress made by different sub-groups of clients, for example women and men or older and younger service users. For similar projects across a sector: the same analyses as described above can be carried out for a sector as a whole. This makes it possible to establish benchmarks identifying good practice and building an outcomes-focused evidence base. This is only possible using the Outcomes Star™ online.
Developing an action plan Outcomes & indicators Using ICT to capture / present this information Resources required – infrastructure & skills Allocating responsibility / setting a timeline
For more help contact: Superhighways 0208 255 email@example.com