Presentation outlining the proposed evaluation frameowrk to be used by the BCE Programme.

1. JISC BCE Programme – ‘Evaluation Phase 1’ Evaluation Framework – Implications for BCE Projects A Presentation by: Dr. Steve Johnson WM Enterprise 05.03.2009

3. Elements of the Evaluation Framework Capital Evaluation Framework JISC Evaluation Handbook Attribution Sustainability Practical solutions Identification of good practice Quality Flexibility Short, medium & long-term measures Programme, work stream and project level evaluation Strategic & operational levels Formative & summative Elements to be included within the Framework

6. Evaluation Framework – Programme & Work Stream Level High-level Strategy and Policy Impact Type of Impact Reach and impact Spatial Type of institution Contribution to policy development Local level Regional level National level Work stream 6 Work stream 5 Work stream 4 Work stream 3 Work stream 2 Work stream 1 Outcome/ Impact

7. Evaluation Framework – Programme & Work Stream Level Impact on JISC Type of Impact Impact on JISC strategy/activity Awareness of JISC JISC-wide coherence Work stream 6 Work stream 5 Work stream 4 Work stream 3 Work stream 2 Work stream 1 Outcome/ Impact

8. Evaluation Framework – Programme & Work Stream Level (Impact on) Institutional Strategies Type of Impact Role of IT in institutional strategies Collaboration between institutions Institutional joined-up thinking Impact on institutional strategies Work stream 6 Work stream 5 Work stream 4 Work stream 3 Work stream 2 Work stream 1 Outcome/ Impact

9. Evaluation Framework – Programme & Work Stream Level (Impact on) Institutional BCE Activities Type of Impact Take-up of BCE products Increased BCE income Engagement in partnership and network activity Work stream 6 Work stream 5 Work stream 4 Work stream 3 Work stream 2 Work stream 1 Outcome/ Impact

10. Evaluation Framework – Programme & Work Stream Level Wider BCE Impacts Type of Impact Improved quality and quantity of work-based and community education Improving the quality of services offered to employers, communities, third sector groups and learners Work stream 6 Work stream 5 Work stream 4 Work stream 3 Work stream 2 Work stream 1 Outcome/ Impact

11. Evaluation Framework: Project Level TYPE OF IMPACT OUTCOME/IMPACT Project-level evaluation: focus on BENEFITS Measurement against specific project aims/objectives Improved quality and quantity of work-based and community education Improving the quality of services offered to employers, community, third sector groups and learners Wider BCE Impacts Take-up of BCE products Increased BCE income Engagement in partnership and network activity Institutional BCE Activities Collaboration between institutions Role of IT in institutional strategies Institutional joined-up thinking Impact on institutional strategies Institutional strategies Awareness of JISC Impact on JISC strategy/activity JISC-wide coherence Impact on JISC Reach and impact (spatial, type of institution) Contribution to policy development (local, regional, national level) To be assessed on project-by-project basis, using Evaluation Framework as guide To feed into overall strategic evaluation of JISC BCE High-level strategy and policy impact

14. WM Enterprise Bradford Office The Design Exchange 34 Peckover Street Little Germany Bradford BD1 5BD t: 01274 743600 e: [email_address] w: www.wm-enterprise.co.uk  Birmingham  London  Merseyside  Bradford  Surrey