Evidencing Outcomes,  Benefits and Impact <ul><li>Belanda Consulting </li></ul><ul><li>Jay Dempster </li></ul><ul><li>[ema...
Dual  three roles Evaluation of the BCEct Project (v.v. programme strategic objectives) Support to BCEct trial sites (v.v....
Demystifying the complexity INPUTs OUTPUTs Context Purpose Partnerships MARKETING  ENTERPRISE RESEARCH INNOVATION Outcomes...
How can you identify, capture and demonstrate the impact of the services you provide? <ul><li>Identifying  what has been t...
Demonstrating your capacity to support BCE… PICK AN EXAMPLE SERVICE OR PRODUCT YOU HAVE DEVELOPED … <ul><li>What are you a...
Capturing & evidencing impact <ul><ul><li>FORMATIVE  to inform planning, practice </li></ul></ul><ul><ul><li>SUMMATIVE  fo...
Three aspects to focus on … <ul><li>Effectiveness of your activities in producing the intended  outcomes </li></ul><ul><li...
From BCE Embedding processes… A framework for outcomes? <ul><li>Policy & strategy </li></ul><ul><li>Processes & business s...
1. An Activity System   framework
Gathering  rich  evidence <ul><li>Evidence is anything that helps to confirm or illustrate an outcome or impact. </li></ul...
Consider how you might produce ‘rich’ reports from your activities & outcomes ... 1. What are your key ‘aims’  and their r...
What, who, where, how, when? 2. What forms of evidence are you gathering, or might you proactively & purposefully collect ...
Upcoming SlideShare
Loading in...5
×

Jisc Advance BCE Evidencing Outcomes Benefits & Outcomes

603

Published on

Presentation by Jay Dempster (Belanda Consulting) given at JISC Advance: Services, RSCs & BCE 10th June 2010, British LIbrary, London

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
603
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Jisc Advance BCE Evidencing Outcomes Benefits & Outcomes

  1. 1. Evidencing Outcomes, Benefits and Impact <ul><li>Belanda Consulting </li></ul><ul><li>Jay Dempster </li></ul><ul><li>[email_address] uk </li></ul><ul><li>0845.159.0065 </li></ul><ul><li>Helen Beetham </li></ul>
  2. 2. Dual three roles Evaluation of the BCEct Project (v.v. programme strategic objectives) Support to BCEct trial sites (v.v. institutional & project objectives) Cross support (JISC services, CPD & A&E)
  3. 3. Demystifying the complexity INPUTs OUTPUTs Context Purpose Partnerships MARKETING ENTERPRISE RESEARCH INNOVATION Outcomes Benefits Impacts Methodology Implementation Aims Background Future implications Sustainable practice Lessons learned Recommendations PROCESS Communities Activities Facilitation (Institutional) BUSINESS interests (Departmental) ACADEMIC interests Structures Operations Decision making
  4. 4. How can you identify, capture and demonstrate the impact of the services you provide? <ul><li>Identifying what has been taken up or implemented by clients for supporting BCE activity between and amongst different kinds of communities, illustrated by examples . </li></ul><ul><li>Documenting the outcomes from those interventions, any pre-requisite shifts in policies, processes, practices or attitudes that indicate impact of your activities. </li></ul><ul><li>Analysing how this relates to specific stakeholders’ aims, interests or concerns and creating targeted dissemination materials. </li></ul>STORY + EVIDENCE = TRANSFER
  5. 5. Demonstrating your capacity to support BCE… PICK AN EXAMPLE SERVICE OR PRODUCT YOU HAVE DEVELOPED … <ul><li>What are you aiming to achieve </li></ul><ul><li>What are your starting points </li></ul><ul><li>What approaches have you taken </li></ul><ul><li>What has worked well & why </li></ul><ul><li>How do you know </li></ul><ul><li>What are the main success factors </li></ul><ul><li>What advice can you give to others </li></ul>PURPOSE LESSONS LEARNED CONTEXT IMPLEMENTATION METHODOLOGY EVIDENCE RECOMMENDATIONS
  6. 6. Capturing & evidencing impact <ul><ul><li>FORMATIVE to inform planning, practice </li></ul></ul><ul><ul><li>SUMMATIVE for final reports, case studies, dissemination </li></ul></ul><ul><ul><li>What questions to ask </li></ul></ul><ul><ul><li>Which kinds of evidence to gather </li></ul></ul><ul><ul><li>How to analysis the data arising </li></ul></ul><ul><ul><li>Measurements or indicators </li></ul></ul><ul><ul><li>Wider BCE impact </li></ul></ul>
  7. 7. Three aspects to focus on … <ul><li>Effectiveness of your activities in producing the intended outcomes </li></ul><ul><li>Gathering ‘rich’ evidence across the ‘product development cycle’ (e.g. for services, resources, events) </li></ul><ul><li>Contribution to higher level JISC programme objectives and institutional/BCE impact </li></ul>
  8. 8. From BCE Embedding processes… A framework for outcomes? <ul><li>Policy & strategy </li></ul><ul><li>Processes & business systems </li></ul><ul><li>Partnerships & resources </li></ul><ul><li>Roles & skills </li></ul><ul><li>Customer perception & measurement </li></ul><ul><li>Key performance indicators. </li></ul>http://www.jiscinfonet.ac.uk/infokits/embedding-bce/workbook
  9. 9. 1. An Activity System framework
  10. 10. Gathering rich evidence <ul><li>Evidence is anything that helps to confirm or illustrate an outcome or impact. </li></ul><ul><li>Derived from: </li></ul><ul><ul><li>formal evaluation (data collected & analysed) </li></ul></ul><ul><ul><li>reflective practice (emerging ‘story’, case studies from engagement with stakeholders) </li></ul></ul><ul><ul><li>captured creative forms of data (screenshots, images, diagrams, podcasts or video interviews) </li></ul></ul><ul><li>‘ Message to market’ match … substantiates claims in ways stakeholders can appreciate & understand </li></ul><ul><li>Quantitative + Qualitative data … overcomes generalisation & exemplification in complex systems & processes </li></ul>
  11. 11. Consider how you might produce ‘rich’ reports from your activities & outcomes ... 1. What are your key ‘aims’ and their related outcomes? 2. Examples of evidence of outcomes & impact
  12. 12. What, who, where, how, when? 2. What forms of evidence are you gathering, or might you proactively & purposefully collect as part of your activities that relate to those outcomes? Some example outcomes/evidence are provided

×