Curtis Cartwright Programme Evaluation Jan2010


Published on

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Curtis Cartwright Programme Evaluation Jan2010

  1. 1. Evaluation<br />Dr Geoff Curtis<br />Dr Rob Hawtin<br />29 January 2010<br />Institutional Innovation Programme<br />
  2. 2. Overview<br />Institutional Innovation Programme (IIP)<br />Evaluation questions<br />Headlines from evaluation of Round 1 projects<br />Initial findings<br />Lessons identified<br />Evaluation of Round 2 projects<br />Approach<br />Your contribution<br />Self-evaluation guidance<br />
  3. 3. Institutional Innovation Programme<br />Issues with JISC approach to ICT in education and research<br />Often applies to specific problems of department / institution<br />Not the sector<br />Solution often technology- rather than business-led<br />Not necessarily sustainable<br />
  4. 4. IIP concept<br />Institutional approach<br />Build on advances from JISC innovation activities<br />Proven practices, technologies, standards and services<br />Often substantial internal business change for institution<br />Supported by significant senior management involvement<br />Fund range of substantial ICT deployments/business change activities<br />Use as exemplars to demonstrate innovation and good practice<br />Extend benefits to sector<br />Benefits realisation activities<br />Problem areas identified<br />professional bodies<br />other initiatives<br />
  5. 5. Top-level evaluation questions<br />1: Is IIP concept useful as general approach for institution-wide problems?<br />2: Is IIP delivering desired outcomes at institutional level for key areas of institutional ICT concern?<br />Improved community engagement<br />Improved and sustained JISC leadership to the sector<br />Improved capacity, knowledge and skills and diversity of background;<br />Sustainable technological solutions<br />Development of good practice approaches<br />Evidence base for good practice and dissemination<br />Overall sustainability of outcomes<br />3: Is IIP being managed well?<br />
  6. 6. Evaluation<br />Assessment of evaluation questions<br />Lessons identified?<br />Improvements?<br />What else?<br />Evaluating programme not the projects<br />
  7. 7. Initial findings –IIP concept<br />Assessment <br />Useful general approach for creating sustainable change<br />More general applicability<br />Lesson identified<br />Need to select/manage projects to meet IIP characteristics<br />Areas for improvement<br />Benefits realisation activities<br />More stringent selection of areas of institutional concern and projects<br />Training on concept and implementation<br />Review approach to planning/funding of benefits realisation activities<br />
  8. 8. Initial findings – IIP delivery<br />Assessment<br />Too early for definitive assessment <br />SSBR had only just started<br />Likely to mature post project completion<br />Aspirational nature of outcomes<br />Continue to focus on desired outcomes<br />
  9. 9. Initial findings – IIP management<br />The programme is generally well managed<br />Lack of programme management resource and overall scale of Round 2 projects might be a risk to programme<br />Focus role of SSBR<br />
  10. 10. Initial findings – summary<br />
  11. 11. Evaluation of IIP – phase 2<br />Approach<br />Phase 1 was by interviews against detailed questions<br />Many more Round 2 projects<br />Evaluation based on<br />Questionnaires<br />Detailed evaluation questions as before<br />Quantitative and qualitative<br />Stakeholders<br />Project teams<br />Follow-up interviews, where necessary<br />Other available information<br />Programme meetings<br />Final and completion reports<br />Self-evaluation<br />
  12. 12. Evaluation of Round 2 projects<br />Your contribution<br />Please find time to respond to questionnaires<br />End February<br />Please do your final and completion reports<br />Good things<br />Lessons identified<br />
  13. 13. Self-evaluation<br />JISC evaluation handbook<br />Based on your evaluation plans<br />Tips on self-evaluation<br />Outcomes<br />
  14. 14. Contact us<br /> 01483 685023<br /> 01483 685024<br />