Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Curtis Cartwright Programme Evaluation Jan2010


Published on

Published in: Education
  • Be the first to comment

  • Be the first to like this

Curtis Cartwright Programme Evaluation Jan2010

  1. 1. Evaluation<br />Dr Geoff Curtis<br />Dr Rob Hawtin<br />29 January 2010<br />Institutional Innovation Programme<br />
  2. 2. Overview<br />Institutional Innovation Programme (IIP)<br />Evaluation questions<br />Headlines from evaluation of Round 1 projects<br />Initial findings<br />Lessons identified<br />Evaluation of Round 2 projects<br />Approach<br />Your contribution<br />Self-evaluation guidance<br />
  3. 3. Institutional Innovation Programme<br />Issues with JISC approach to ICT in education and research<br />Often applies to specific problems of department / institution<br />Not the sector<br />Solution often technology- rather than business-led<br />Not necessarily sustainable<br />
  4. 4. IIP concept<br />Institutional approach<br />Build on advances from JISC innovation activities<br />Proven practices, technologies, standards and services<br />Often substantial internal business change for institution<br />Supported by significant senior management involvement<br />Fund range of substantial ICT deployments/business change activities<br />Use as exemplars to demonstrate innovation and good practice<br />Extend benefits to sector<br />Benefits realisation activities<br />Problem areas identified<br />professional bodies<br />other initiatives<br />
  5. 5. Top-level evaluation questions<br />1: Is IIP concept useful as general approach for institution-wide problems?<br />2: Is IIP delivering desired outcomes at institutional level for key areas of institutional ICT concern?<br />Improved community engagement<br />Improved and sustained JISC leadership to the sector<br />Improved capacity, knowledge and skills and diversity of background;<br />Sustainable technological solutions<br />Development of good practice approaches<br />Evidence base for good practice and dissemination<br />Overall sustainability of outcomes<br />3: Is IIP being managed well?<br />
  6. 6. Evaluation<br />Assessment of evaluation questions<br />Lessons identified?<br />Improvements?<br />What else?<br />Evaluating programme not the projects<br />
  7. 7. Initial findings –IIP concept<br />Assessment <br />Useful general approach for creating sustainable change<br />More general applicability<br />Lesson identified<br />Need to select/manage projects to meet IIP characteristics<br />Areas for improvement<br />Benefits realisation activities<br />More stringent selection of areas of institutional concern and projects<br />Training on concept and implementation<br />Review approach to planning/funding of benefits realisation activities<br />
  8. 8. Initial findings – IIP delivery<br />Assessment<br />Too early for definitive assessment <br />SSBR had only just started<br />Likely to mature post project completion<br />Aspirational nature of outcomes<br />Continue to focus on desired outcomes<br />
  9. 9. Initial findings – IIP management<br />The programme is generally well managed<br />Lack of programme management resource and overall scale of Round 2 projects might be a risk to programme<br />Focus role of SSBR<br />
  10. 10. Initial findings – summary<br />
  11. 11. Evaluation of IIP – phase 2<br />Approach<br />Phase 1 was by interviews against detailed questions<br />Many more Round 2 projects<br />Evaluation based on<br />Questionnaires<br />Detailed evaluation questions as before<br />Quantitative and qualitative<br />Stakeholders<br />Project teams<br />Follow-up interviews, where necessary<br />Other available information<br />Programme meetings<br />Final and completion reports<br />Self-evaluation<br />
  12. 12. Evaluation of Round 2 projects<br />Your contribution<br />Please find time to respond to questionnaires<br />End February<br />Please do your final and completion reports<br />Good things<br />Lessons identified<br />
  13. 13. Self-evaluation<br />JISC evaluation handbook<br />Based on your evaluation plans<br />Tips on self-evaluation<br />Outcomes<br />
  14. 14. Contact us<br /> 01483 685023<br /> 01483 685024<br />