Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Jisc Advance BCE Evidencing Outcomes Benefits & Outcomes


Published on

Presentation by Jay Dempster (Belanda Consulting) given at JISC Advance: Services, RSCs & BCE 10th June 2010, British LIbrary, London

  • Be the first to comment

  • Be the first to like this

Jisc Advance BCE Evidencing Outcomes Benefits & Outcomes

  1. 1. Evidencing Outcomes, Benefits and Impact <ul><li>Belanda Consulting </li></ul><ul><li>Jay Dempster </li></ul><ul><li>[email_address] uk </li></ul><ul><li>0845.159.0065 </li></ul><ul><li>Helen Beetham </li></ul>
  2. 2. Dual three roles Evaluation of the BCEct Project (v.v. programme strategic objectives) Support to BCEct trial sites (v.v. institutional & project objectives) Cross support (JISC services, CPD & A&E)
  3. 3. Demystifying the complexity INPUTs OUTPUTs Context Purpose Partnerships MARKETING ENTERPRISE RESEARCH INNOVATION Outcomes Benefits Impacts Methodology Implementation Aims Background Future implications Sustainable practice Lessons learned Recommendations PROCESS Communities Activities Facilitation (Institutional) BUSINESS interests (Departmental) ACADEMIC interests Structures Operations Decision making
  4. 4. How can you identify, capture and demonstrate the impact of the services you provide? <ul><li>Identifying what has been taken up or implemented by clients for supporting BCE activity between and amongst different kinds of communities, illustrated by examples . </li></ul><ul><li>Documenting the outcomes from those interventions, any pre-requisite shifts in policies, processes, practices or attitudes that indicate impact of your activities. </li></ul><ul><li>Analysing how this relates to specific stakeholders’ aims, interests or concerns and creating targeted dissemination materials. </li></ul>STORY + EVIDENCE = TRANSFER
  5. 5. Demonstrating your capacity to support BCE… PICK AN EXAMPLE SERVICE OR PRODUCT YOU HAVE DEVELOPED … <ul><li>What are you aiming to achieve </li></ul><ul><li>What are your starting points </li></ul><ul><li>What approaches have you taken </li></ul><ul><li>What has worked well & why </li></ul><ul><li>How do you know </li></ul><ul><li>What are the main success factors </li></ul><ul><li>What advice can you give to others </li></ul>PURPOSE LESSONS LEARNED CONTEXT IMPLEMENTATION METHODOLOGY EVIDENCE RECOMMENDATIONS
  6. 6. Capturing & evidencing impact <ul><ul><li>FORMATIVE to inform planning, practice </li></ul></ul><ul><ul><li>SUMMATIVE for final reports, case studies, dissemination </li></ul></ul><ul><ul><li>What questions to ask </li></ul></ul><ul><ul><li>Which kinds of evidence to gather </li></ul></ul><ul><ul><li>How to analysis the data arising </li></ul></ul><ul><ul><li>Measurements or indicators </li></ul></ul><ul><ul><li>Wider BCE impact </li></ul></ul>
  7. 7. Three aspects to focus on … <ul><li>Effectiveness of your activities in producing the intended outcomes </li></ul><ul><li>Gathering ‘rich’ evidence across the ‘product development cycle’ (e.g. for services, resources, events) </li></ul><ul><li>Contribution to higher level JISC programme objectives and institutional/BCE impact </li></ul>
  8. 8. From BCE Embedding processes… A framework for outcomes? <ul><li>Policy & strategy </li></ul><ul><li>Processes & business systems </li></ul><ul><li>Partnerships & resources </li></ul><ul><li>Roles & skills </li></ul><ul><li>Customer perception & measurement </li></ul><ul><li>Key performance indicators. </li></ul>
  9. 9. 1. An Activity System framework
  10. 10. Gathering rich evidence <ul><li>Evidence is anything that helps to confirm or illustrate an outcome or impact. </li></ul><ul><li>Derived from: </li></ul><ul><ul><li>formal evaluation (data collected & analysed) </li></ul></ul><ul><ul><li>reflective practice (emerging ‘story’, case studies from engagement with stakeholders) </li></ul></ul><ul><ul><li>captured creative forms of data (screenshots, images, diagrams, podcasts or video interviews) </li></ul></ul><ul><li>‘ Message to market’ match … substantiates claims in ways stakeholders can appreciate & understand </li></ul><ul><li>Quantitative + Qualitative data … overcomes generalisation & exemplification in complex systems & processes </li></ul>
  11. 11. Consider how you might produce ‘rich’ reports from your activities & outcomes ... 1. What are your key ‘aims’ and their related outcomes? 2. Examples of evidence of outcomes & impact
  12. 12. What, who, where, how, when? 2. What forms of evidence are you gathering, or might you proactively & purposefully collect as part of your activities that relate to those outcomes? Some example outcomes/evidence are provided