Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Corporate slide master With guidelines for corporate presentations Applying SROI in the evaluation of Libraries for Life  ...
Outline of talk <ul><li>Wales context  </li></ul><ul><li>Libraries for Life strategy and evaluation </li></ul><ul><li>Soci...
Wales   context 3 million people, 20% speak Welsh 1 National Library of Wales 22 local authority library services  c. 12 H...
What is CyMAL? <ul><li>Policy division of Welsh Government  </li></ul><ul><li>(Cymru Museums Archives and Libraries) </li>...
Libraries for life 2008-11 <ul><li>Funding £10.5 m </li></ul><ul><ul><li>2008-09 £1m + £1.5m capital </li></ul></ul><ul><u...
Evaluation framework <ul><li>Independent research company Scotinform, with  Associates </li></ul><ul><li>16 month evaluati...
What is SROI? <ul><li>  </li></ul><ul><li>  </li></ul><ul><li>Framework for measuring and accounting for value </li></ul><...
<ul><li>2 work strands assessed </li></ul><ul><li>Workforce Development </li></ul><ul><li>CLLIP – 2 case study libraries <...
<ul><li>Establishing scope and identifying key stakeholders  </li></ul><ul><li>Mapping outcomes </li></ul><ul><li>Evidenci...
<ul><li>Focus groups held with library staff and users </li></ul><ul><li>SROI relevant questions included in evaluation su...
Outcomes Identified <ul><li>Outcomes </li></ul><ul><li>Workforce Development:  £3.12* of SROI </li></ul><ul><li>Pontarddul...
Findings from the SROI Process <ul><li>Staff and users benefited; increased usage and users and improved staff working env...
SROI and Measuring Impact of Libraries for Life <ul><li>Challenging process </li></ul><ul><li>Many stakeholders and indica...
Other findings and conclusions <ul><li>“…  excellent value for money…” </li></ul><ul><li>Wide reach impact of an holistic ...
Future issues <ul><li>Data gathering framework vital </li></ul><ul><li>SROI suitability for large programmes?  </li></ul><...
Contact details <ul><li>Alyson Tyler  alyson.tyler@wales.gsi.gov.uk </li></ul><ul><li>@libalyson </li></ul><ul><li>http://...
Upcoming SlideShare
Loading in …5
×

Applying SROI in the evaluation of Libraries for Life

0 views

Published on

Paper presented at 9th Northumbria International Conference on Performance Measurement in Libraries and Information Services, York, UK, 22-25th August 2011.

Outlines the Libraries for Life strategy in Wales from 2008-11 and the use of SROI as part of the evaluation of the strategy for two of the work strands.
(SROI = Social return on investment)

Published in: Education, Business
  • Be the first to comment

  • Be the first to like this

Applying SROI in the evaluation of Libraries for Life

  1. 1. Corporate slide master With guidelines for corporate presentations Applying SROI in the evaluation of Libraries for Life CyMAL: Amgueddfeydd Archifau a Llyfrgelloedd Cymru CyMAL: Museums Archives and Libraries Wales Dr Alyson Tyler Libraries Development Adviser CyMAL, Welsh Government @libalyson Alison Kennedy ASK Consulting
  2. 2. Outline of talk <ul><li>Wales context </li></ul><ul><li>Libraries for Life strategy and evaluation </li></ul><ul><li>Social Return on Investment </li></ul><ul><li>Issues to consider </li></ul><ul><li>Questions </li></ul>Grandad Bibli – part of marketing campaign
  3. 3. Wales context 3 million people, 20% speak Welsh 1 National Library of Wales 22 local authority library services c. 12 HE libraries (mergers ongoing) c. 23 FE libraries (mergers ongoing) 50+ health libraries 5 Prison libraries School libraries Workplace libraries Image from CC Flickr - giveawayboy
  4. 4. What is CyMAL? <ul><li>Policy division of Welsh Government </li></ul><ul><li>(Cymru Museums Archives and Libraries) </li></ul><ul><li>Cross-domain approach </li></ul><ul><li>Policy development, grant programmes, advice and support </li></ul><ul><li>Library strategies: </li></ul><ul><ul><li>2005-07 @ your library </li></ul></ul><ul><ul><li>2008-11 Libraries for Life </li></ul></ul>Government building in Aberystwyth
  5. 5. Libraries for life 2008-11 <ul><li>Funding £10.5 m </li></ul><ul><ul><li>2008-09 £1m + £1.5m capital </li></ul></ul><ul><ul><li>2009-10 £1m + £3m capital </li></ul></ul><ul><ul><li>2010-11 £1m + £3m capital </li></ul></ul><ul><li>Work strands </li></ul><ul><ul><li>Community Learning Libraries Programme </li></ul></ul><ul><ul><li>Online content and resources </li></ul></ul><ul><ul><li>Regional Library Partnerships framework </li></ul></ul><ul><ul><li>National marketing strategy </li></ul></ul><ul><ul><li>Developing workforce skills </li></ul></ul><ul><ul><li>Welsh Public Libraries Standards Framework Three </li></ul></ul>
  6. 6. Evaluation framework <ul><li>Independent research company Scotinform, with Associates </li></ul><ul><li>16 month evaluation process – interim reports </li></ul><ul><li>Qualitative research: </li></ul><ul><ul><li>Literature review – country comparator </li></ul></ul><ul><ul><li>Interviews with CyMAL staff </li></ul></ul><ul><ul><li>Interviews with strand leaders and key stakeholders </li></ul></ul><ul><ul><li>Survey of heads of library services </li></ul></ul><ul><ul><li>Staff: survey (online), focus groups (online and face to face) </li></ul></ul><ul><ul><li>Users: survey (online and paper), focus groups (online and face to face) </li></ul></ul><ul><ul><li>Non-users: interviews (face to face) and focus groups (online and face to face) </li></ul></ul><ul><li>SROI analysis on two programme strands </li></ul>
  7. 7. What is SROI? <ul><li>  </li></ul><ul><li>  </li></ul><ul><li>Framework for measuring and accounting for value </li></ul><ul><li>Developed by Cabinet Office of the Third Sector </li></ul><ul><li>It measures relevant change </li></ul><ul><li>Value rather than money </li></ul>
  8. 8. <ul><li>2 work strands assessed </li></ul><ul><li>Workforce Development </li></ul><ul><li>CLLIP – 2 case study libraries </li></ul><ul><li>Pontarddulais (near Swansea, south Wales) </li></ul><ul><li>Wrexham (north Wales) </li></ul>SROI - Process
  9. 9. <ul><li>Establishing scope and identifying key stakeholders </li></ul><ul><li>Mapping outcomes </li></ul><ul><li>Evidencing outcomes and giving them a value </li></ul><ul><li>Establishing impact </li></ul><ul><li>Calculating the SROI </li></ul><ul><li>Reporting, using and embedding </li></ul>SROI – 6 Stage Process
  10. 10. <ul><li>Focus groups held with library staff and users </li></ul><ul><li>SROI relevant questions included in evaluation surveys </li></ul><ul><li>CyMAL reports and management information analyzed </li></ul>SROI – Information Gathering
  11. 11. Outcomes Identified <ul><li>Outcomes </li></ul><ul><li>Workforce Development: £3.12* of SROI </li></ul><ul><li>Pontarddulais : £3.42* of SROI </li></ul><ul><li>Wrexham: £2.16* of SROI </li></ul><ul><li>“ SROI is not just a number but a story about change which includes narrative, qualitative, quantitative and financial aspects” </li></ul><ul><li>* = unverified </li></ul>
  12. 12. Findings from the SROI Process <ul><li>Staff and users benefited; increased usage and users and improved staff working environments </li></ul><ul><li>Staff benefitted from increased levels of skills and confidence and higher earning potential </li></ul><ul><li>Provided valuable insight into wider impacts and benefits of the investment in the library sector in Wales </li></ul>
  13. 13. SROI and Measuring Impact of Libraries for Life <ul><li>Challenging process </li></ul><ul><li>Many stakeholders and indicators identified </li></ul><ul><li>Not always possible to find a financial proxy to show the benefit (materiality) </li></ul><ul><li>Consulting with large number of stakeholders biggest challenge </li></ul><ul><li>Not an appropriate measurement tool for a programme of this size </li></ul><ul><li>Tool would be more appropriate for smaller, discreet projects </li></ul>
  14. 14. Other findings and conclusions <ul><li>“… excellent value for money…” </li></ul><ul><li>Wide reach impact of an holistic approach to investment in libraries </li></ul><ul><li>Value of partnerships across the library sector </li></ul><ul><li>Intrinsic ‘value’ of libraries, even from non-users </li></ul>
  15. 15. Future issues <ul><li>Data gathering framework vital </li></ul><ul><li>SROI suitability for large programmes? </li></ul><ul><li>Other economic impact tools e.g. joint ROI project 2011-12 </li></ul><ul><li>Other options for measuring performance in libraries (cf our Public Library Standards) </li></ul>
  16. 16. Contact details <ul><li>Alyson Tyler alyson.tyler@wales.gsi.gov.uk </li></ul><ul><li>@libalyson </li></ul><ul><li>http://libalyson.wordpress.com </li></ul><ul><li>www.wales.gov.uk/cymal - Evaluation report available here </li></ul><ul><li>Alison Kennedy alison.kennedy@askconsulting.org.uk </li></ul><ul><li>www.askconsulting.org.uk </li></ul><ul><li>Scotinform www.scotinform.co.uk </li></ul>

×