13.45: As people arrive, teas, coffees 14.00: Welcome: Housekeeping
14.20 Presentation: What is monitoring, what is evaluation? Monitoring: ongoing data gathering, e.g. to see if things are on track. Evaluation: end of project (or other key point). Analysis of what you have collected. Full scale detailed process to judge the value of a project or service, using the information gathered through monitoring
PACKS Additional support. Evaluation forms.
Outcomes & ict cva june 2013
ICT for Outcomes Monitoring &
Raising awareness of a range
of ICT tools that can be used to
improve the efficiency and
effectiveness of outcomes
monitoring & evaluation
• Learn how ICT can help with collecting, storing, retrieving and
presenting outcomes information
• Understand more about the processes involved in implementing a
• See demonstrations looking at ‘off the shelf' systems selected for
relevance in terms of services, client group and cost
• Start identifying specific tools that will enable you to better capture
information relating to your organisations outcomes
• Draft an action plan to support adoption of these tools over the next
year 6 – 12 months
How are you currently using ICT to capture
& evidence Outcomes?
What challenges do you face?
Do you already have ideas for how you can
improve this process?
Your current practice
Why ICT can help?
• Automating manual processes
• Reducing paperwork
• Reducing staff time
• Sharing / accessing information
• Analysing data in more sophisticated ways
• Presenting information with greater impact & to a
wider variety of audiences
Collecting Outcomes information
• Online surveys
• Website feedback
• Outreach laptops
• Digital / video cameras
• Dictaphones / mobile phones
• Diaries / blogs
Developing a system…
Get together as a team and identify and
agree the what, how, when, why and
then capture this on paper
Remember to include bother outputs and
Carry out an audit of current systems
– what are you using, what works
well, what frustrates you etc
Document how you are structuring
your information e.g. the ‘fields’ you
Draw up a brief – include some
background and specify what you
need – remember to future proof
• Is this something that can be
realistically developed in house?
• If not, research whether a system
already exists to meet your needs?
• If not, budget for the bespoke option
Upgraded ICT infrastructure?
A new system or developments to an
Data migration or start from scratch?
Staff roles and training?
Selecting a database for monitoring
Versions currently available:
Mental Health Recovery Star
Older Person's Star
Versions currently in development:
Music Therapy Star
Life Star for learning disability
Spectrum Star for autism & aspergers syndrome
Sexual Health Star
Empowerment Star for domestic violence services
This version has been developed for and with teenagers in a
substance misuse setting but should be applicable in
Outcome areas (6):
• Drugs and alcohol
• Safety and security
• Structure and education
• Behaviour and citizenship
• Family and other key adults
These link to the five high-level Every Child Matters
Evidencing outcomes at different
The Outcomes Star can provide outcomes data at four levels:
For individual service users: the Star gives a snapshot of where they were on
each outcome area when they joined the project and at each review – the difference
between starting point and review shows the progress made in that time.
For a project as a whole: the average starting points on entry to the service and
the amount of progress made in a specified time period or over their life-time in the
project can be calculated – this gives a picture of the project outcomes. The
Outcomes Star™ online can provide this information at the touch of a button.
For a group of projects across an organisation: the same information as above
can be calculated for each project allowing comparison between different services.
In addition users of the Outcomes Star™ online can compare the progress made by
different sub-groups of clients, for example women and men or older and younger
For similar projects across a sector: the same analyses as described above can
be carried out for a sector as a whole. This makes it possible to establish
benchmarks identifying good practice and building an outcomes-focused evidence
base. This is only possible using the Outcomes Star™ online.
Developing an action plan
Outcomes & indicators
Using ICT to capture / present this
Resources required – infrastructure &
Allocating responsibility / setting a
Best practice issues
Are you registered with the information
Do you have a data protection & privacy
policy and explain why you collect data
and what it will be used for?
Do you ask for permission to use
photos / videos?
Is your client data secure i.e. password
protected, backed up, safeguarded with
anti virus software and a firewall?
For follow up support
0208 255 8040