1.
Metrics and Social Web Services: Quantitative Evidence for their Use & Impact Welcome Brian Kelly UKOLN University of Bath Bath, UK UKOLN is supported by: http://www.ukoln.ac.uk/web-focus/events/workshops/eim-2011-07/ This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence (but note caveat) Acceptable Use Policy Recording this talk, taking photos, discussing the talk using Twitter, blogs, etc. is permitted but please try to minimise distractions to others. Twitter: #ukolneim Blog: Twitter: http://ukwebfocus.wordpress.com/ @briankelly

2.
You are free to: copy, share, adapt or re-mix; photograph, film or broadcast; blog, live-blog or post video of this presentation provided that: You attribute the work to its author and respect the rights and licences associated with its components. Idea from Cameron Neylon Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only CCZero . Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at: http://www.thisismyurl.com/free-downloads/15-free-speech-bubble-icons-for-popular-websites Off the record questions, comments should be flagged

3.
Evidence, Impact, Metrics <ul><li>Evidence, Impact, Metrics (EIM): </li></ul><ul><ul><li>UKOLN activity funded by the JISC </li></ul></ul><ul><li>Aims to: </li></ul><ul><ul><li>Explore ways of gathering evidence which can demonstrate the impact of services and devise appropriate metrics to support such work </li></ul></ul><ul><li>By: </li></ul><ul><ul><li>Three one-day workshops </li></ul></ul><ul><ul><li>Gathering of evidence and discussing approaches and issues on UK Web Focus blog </li></ul></ul><ul><ul><li>A final report </li></ul></ul>

4.
Workshop Aims <ul><li>By the end of the workshop we should: </li></ul><ul><ul><li>Have an appreciation of the importance of the need to gather and interpret evidence </li></ul></ul><ul><ul><li>Understand how metrics can be used to demonstrate the value and ROI of services. </li></ul></ul><ul><ul><li>Have seen examples of how institutions are gathering and using evidence </li></ul></ul><ul><ul><li>Be aware of limitations of such approaches </li></ul></ul><ul><ul><li>Discussed ways in which such approaches can be used across the sector </li></ul></ul>Introduction

5.
The Context <ul><li>The need to demonstrate value in light of Government cuts </li></ul>NB 1D view: no comments on ROI, comparisons with print, TV, … costs

6.
Open Data <ul><li>Government to ‘force’ Unis to publish data about courses, student experiences, … </li></ul><ul><ul><li>Builds on Labour’s Open Gov initiative </li></ul></ul><ul><ul><li>An opportunity to be welcomed? </li></ul></ul><ul><ul><li>Can take initiative in publishing open data about uses of social media </li></ul></ul>

7.
Numbers Matter <ul><li>“ Sales of 25 million iPads in just 14 months. 200 million iOS devices in total. 15 billion songs downloaded since 2003. 130 million books. 14 billion apps downloaded from a store that now runs to 425,000 apps.” </li></ul>BBC News 7 Jun 11 JISC-funded OII Impact report: “ The media and the public are influenced by numbers and metrics ”

8.
Prisoner’s Dilemma <ul><li>We can all benefit by: </li></ul><ul><ul><li>Sharing best practices </li></ul></ul><ul><ul><li>Understanding limitations </li></ul></ul><ul><ul><li>Agreeing on ways forward </li></ul></ul><ul><li>But concerns that: </li></ul><ul><ul><li>We might be doing badly </li></ul></ul><ul><ul><li>We might not be doing as well as our rivals </li></ul></ul><ul><ul><li>We don’t want to boast </li></ul></ul><ul><ul><li>We want a perfect solution, not a good enough one </li></ul></ul><ul><ul><li>We want to learnt from others, but not share our experiences </li></ul></ul>Prisoner’s dilemma: why people might not cooperate even if it is in their best interests to do so. Concerns

9.
Programme Time Content 10.20-10.25 Introduction , Brian Kelly, UKOLN 10.25-10.45 Why Impact, ROI and Marketing are No Longer Dirty Words! , Amber Thomas, JISC 10.45-11.00 Surveying our Landscape from Top to Bottom Brian Kelly, UKOLN 11.00-11.20 Learning From Institutional Approaches , Ranjit Sidhu 11.20-11.40 Identity, Scholarship and Metrics , Martin Weller, Open University 11.40-12.30 Breakout groups 1 12.30-13.30 Lunch 13.30-13.50 Experiences at the Open University , Andrew Law, Open University 13.50-14.10 The Script Kiddie's Perspective , Tony Hirst, Open University 14.10-15.00 Breakout groups 2 15.00-15.15 Coffee 15.15-15.45 Report Back & Action Plans 15.45-16.00 Conclusions

10.
Questions <ul><li>Any questions or comments? </li></ul>Note that resources used in the workshop and notes from the workshop will be made available shortly. See ukwebfocus.wordpress.com for further information