SlideShare a Scribd company logo
Measuring impact and quality
Workshop: Measuring the use of online resources
Tom Edmonds
OpenAthens Product Manager
Maximising the ROI for library budgets

•   Lightening demo!
•   Where does your library budget go?
•   What challenges do you face?
•   Some solutions
•   YOU
•   Case studies
Eduserv - OpenAthens


     1994          2000          2008           2009             2010              2011          Today…


• Athens      • Athens     • Athens    • 33% of the       • US               • US Navy     • > 4,000
  developed &   adopted by   became      Australian         Department of      Medicine      customers
  first web     NHS England OpenAthens   healthcare         Veteran            Information   use
  service       in the UK                market adopts      Affairs adopts     Systems       OpenAthens
  launched                               OpenAthens         OpenAthens         Support     • > 4 million
                                         - SAH                                 Agency        users
                                         - DoH Victoria                        adopts        worldwide
                                                                               OpenAthens




                                                                                            www.eduserv.org.uk

                                                                                      [Lightning demo]
Identity & Access Management - markets

                                     Public
Academic   Healthcare   Publishing   Sector     Commercial




                                              [Lightning demo]
Some library stats.




                      www.eduserv.org.uk
Library developments

1999


                                Print
                                Print and online
2007
                                Online



2009


                        100%
                                   Source: Ebsco
                               www.eduserv.org.uk
Where does your library budget go?



                                          Resources
                                          Personnel
                                          Buildings
                                          Other




                                     www.eduserv.org.uk
Where does your library budget go?

                      23%
         13%
                                                           Resources
                                                           Personnel
       25%                           39%                   Buildings
                                                           Other




                                                      www.eduserv.org.uk
                                     Source: commercial research company
Where does your resources budget go?


                                          e-Journals
                          68%
                                          Online databases
 2%                                       Print
  2%
                                          Magazines & newspapers
       10%                                Books
  3%
               15%                        e-Books




                                                  www.eduserv.org.uk
                                 Source: commercial research company
Where does your e-resources budget go?




                                                www.eduserv.org.uk
                                  Source: Bath Spa University (2010)
JISC Activity data programme
Looking for the link between library usage and student
attainment
“There is a statistically significant correlation across a number of
universities between library activity data and student attainment”

- thank you to the JISC & Huddersfield University




                                                              www.eduserv.org.uk
www.eduserv.org.uk
www.eduserv.org.uk
1   2:1          2:2   3
70.0



                                                                        59.3
60.0
                  56.8                                 56.4
                                     53.1
        50.3
50.0              53.1
                                                       50.9
        49.5                         49.8
                                                                        48.5


40.0
        39.2
                                     36.4              37.2
                  36.1
                                                                        34.3
30.0


        26.1

20.0              22.8               23.0              22.3
                                                                        21.1

                                                                www.eduserv.org.uk

10.0
       2005/06   2006/07         2007/08              2008/09          2009/10
www.eduserv.org.uk
What are the challenges?
…for optimizing your library spend




                                     www.eduserv.org.uk
Challenges…

• Budgets




              www.eduserv.org.uk
Challenges…

• Budgets
• Suppliers
   • Increasing subscription costs
   • Lack of flexibility.




                                     www.eduserv.org.uk
Challenges…

• Budgets
• Suppliers
• Technologies
    •   IP address management
    •   Authentication steps for both the library and publisher
    •   User ID setups
    •   A to Z list management
    •   OpenURL management
    •   Licence compliance policy management
    •   Support: troubleshooting, downtime, usage monitoring, training etc.

                                                                              www.eduserv.org.uk
The challenges…

•   Budgets
•   Suppliers
•   Technologies
•   politics




                    Source: stus.com
                   www.eduserv.org.uk
The challenges…

•   Budgets
•   Suppliers
•   Technologies
•   politics
•   Usability




                   www.eduserv.org.uk
www.eduserv.org.uk
www.eduserv.org.uk

             23
www.eduserv.org.uk

             24
www.eduserv.org.uk

             25
www.eduserv.org.uk

             26
www.eduserv.org.uk

             27
The challenges…

•   Budgets
•   Suppliers
•   Technologies
•   politics
•   Usability
•   Users.


                   www.eduserv.org.uk
The “Path of least resistance”

“...an information [seeker] will
tend to use the most convenient
search method, in the least
exacting mode available.
Information seeking behaviour
stops as soon as minimally
acceptable results are found.”


                                   Source: http://en.wikipedia.org/wiki/
                                                    www.eduserv.org.uk
Principle of Least Effort

“...numerous studies have shown users
are often willing to sacrifice information
quality for accessibility. This fast food
approach to information consumption
drives librarians crazy. ‘Our information
is healthier and tastes better too’ they
shout.”

- Peter Morville (“Ambient Findability”, 2005)
                                                 www.eduserv.org.uk

                                                              30
www.eduserv.org.uk
             31
Marketing your library




                         www.eduserv.org.uk
Social media

“I found out all my students were looking
at material in the VLE but going straight
to Facebook to use the discussion tools
and discuss the material and the
lectures. I thought I might as well join
them and ask them questions in their
preferred space.”
 - What is Web 2.0? Ideas, technologies and implications
for education. Paul Anderson. A JISC report
                                                           www.eduserv.org.uk
Mobilise your library…




                         www.eduserv.org.uk
Market your resources




                               Source: Gungahlin Library, Australia
                        flickr.com/photos/silversprite/5120507383
                                            www.eduserv.org.uk
Library portal




                 www.eduserv.org.uk
Over to you...




What have you done/are doing to get more from your library budget?

                                                          www.eduserv.org.uk
Case Study 1:




                www.eduserv.org.uk
Small UK HE institution

Objectives:    to implement Shibboleth
               reduce burden of administering access
               increase use of electronic resources
Constraints:   no IT resource

Solution:      implement a local authentication
               solution.

                                                  www.eduserv.org.uk
Project: duration – 9 months…




                                www.eduserv.org.uk
Small UK HE institution – one year on…

• No access queries
• Handful of Athens queries!
• Integration with Google Docs
   • Gmail access for post-graduates
• Increased resource usage
   • 20,000 more sessions in 2010/11.


                                         www.eduserv.org.uk
Small UK HE institution – number of logins

   Year/
            January      February        March
   Month

             No.    %    No.      %    No.       %

   2009    16,460         8,247        13,860

   2010    18,198   11   11,345   37   21,276    54

   2011    22,930 39     27,359 232    27,446    98


                                                      www.eduserv.org.uk
Case Study 2:




                www.eduserv.org.uk
Commercial research library

Objectives:    to simplify working in a fluid environment
               manage changing need for information

Constraints:   fixed (if not falling) budget

Solution:      re-negotiate licences
               integrate library services.

                                                    www.eduserv.org.uk
User behaviour:




                  Copied in the library
                  Borrowed
                  Downloaded



                  www.eduserv.org.uk
What are the consequences?

          Subscription cost                  Number of downloads

60,000                               6,000
50,000                               5,000
40,000                               4,000
30,000                               3,000
20,000                               2,000
10,000                               1,000
    -                                   -
         2007     2008        2009           2007    2008      2009


                                                             www.eduserv.org.uk
What are the consequences?
                   Cost per download

    20.00

    18.00

    16.00

    14.00

    12.00

    10.00

     8.00

     6.00

     4.00

     2.00

     0.00
            2007         2008          2009


                                              www.eduserv.org.uk
Three steps to improve ROI

• Re-negotiated subscriptions

• Implemented a local identity and access management
  solution (OpenAthens)

• Implemented OpenURL and A to Z list management
  using TDNet.

                                               www.eduserv.org.uk
Re-negotiated subscriptions

Publisher 1
• No movement on price or licencing terms
• No alternative arrangements available

• From 2010, the complete collection was replaced by a
  collection of the most used titles.



                                                 www.eduserv.org.uk
What were the consequences?

                Subscription cost                         Number of downloads
60,000                                     6,000


50,000                                     5,000


40,000                                     4,000


30,000                                     3,000


20,000                                     2,000


10,000                                     1,000


    -                                         -
         2007    2008      2009     2010           2007        2008     2009        2010




                                                                           www.eduserv.org.uk
What were the consequences?
                   Cost per download

    20.00

    18.00

    16.00

    14.00

    12.00

    10.00

     8.00

     6.00

     4.00

     2.00

     0.00
            2007   2008        2009    2010


                                              www.eduserv.org.uk
The impact: publisher 1

• End users have less access

• Library service is curtailed

• Publisher loses income.




                                 www.eduserv.org.uk
Re-negotiated subscriptions

Publisher 2:
• 2007 ~35 journals, not much used
• 2008 cancelled most of them
• 2010 new arrangement with publisher
          o download everything at a fixed price
          o subscriptions commence when it is profitable.



                                                 www.eduserv.org.uk
What were the consequences?

                Cost of subscriptions                         Number of downloads
80,000
                                               6,000
70,000

60,000                                         5,000


50,000                                         4,000

40,000
                                               3,000
30,000
                                               2,000
20,000

                                               1,000
10,000

    -                                             -
         2007     2008      2009        2010           2007     2008     2009        2010




                                                                            www.eduserv.org.uk
What were the consequences?
                   Cost per download

    40.00


    35.00


    30.00


    25.00


    20.00


    15.00


    10.00


     5.00


     0.00
            2007    2008        2009   2010


                                              www.eduserv.org.uk
The impact: publisher 2

• End users have more access than they did 3 years ago

• The library service improves

• Publisher regains income.




                                                www.eduserv.org.uk
Conclusions…

•   Negotiate
•   Technology solutions
•   Environment
•   Social media
•   Traditional tools




                           www.eduserv.org.uk
Thank you for listening




Twitter: @edm0nds
Skype: tomedmonds.eduserv
Email: tom.edmonds@eduserv.org.uk


                                    www.eduserv.org.uk

More Related Content

Viewers also liked

Virginia Power "Every student counts: measuring the impact of informal learni...
Virginia Power "Every student counts: measuring the impact of informal learni...Virginia Power "Every student counts: measuring the impact of informal learni...
Virginia Power "Every student counts: measuring the impact of informal learni...CILIP ARLG
 
Collaborative learning areas
Collaborative learning areasCollaborative learning areas
Collaborative learning areasNigel Ross
 
Measuring social impact draft 3
Measuring social impact draft 3Measuring social impact draft 3
Measuring social impact draft 3Stephen Abram
 
THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...
THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...
THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...Glee Cillo
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of LearningYaKu Loveria
 
Assessment Of Student Learning
Assessment Of Student LearningAssessment Of Student Learning
Assessment Of Student LearningArlan Villanueva
 

Viewers also liked (7)

Virginia Power "Every student counts: measuring the impact of informal learni...
Virginia Power "Every student counts: measuring the impact of informal learni...Virginia Power "Every student counts: measuring the impact of informal learni...
Virginia Power "Every student counts: measuring the impact of informal learni...
 
Collaborative learning areas
Collaborative learning areasCollaborative learning areas
Collaborative learning areas
 
Measuring social impact draft 3
Measuring social impact draft 3Measuring social impact draft 3
Measuring social impact draft 3
 
THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...
THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...
THE LEARNING AREAS,CO-CURRICULAR AND COMMUNITY INVOLVEMENT PROGRAM UNDER THE ...
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
 
Assessment of learning 1
Assessment of learning 1Assessment of learning 1
Assessment of learning 1
 
Assessment Of Student Learning
Assessment Of Student LearningAssessment Of Student Learning
Assessment Of Student Learning
 

Similar to CILIP ARLG '12: Measuring impact and quality

Eduserv Foundation SL projects
Eduserv Foundation SL projectsEduserv Foundation SL projects
Eduserv Foundation SL projectsEduserv Foundation
 
eduserv-foundation-sl-projects1881
eduserv-foundation-sl-projects1881eduserv-foundation-sl-projects1881
eduserv-foundation-sl-projects1881webuploader
 
Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014myspacelibrarian
 
Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014myspacelibrarian
 
Collaborative Opportunities In Erm
Collaborative Opportunities In ErmCollaborative Opportunities In Erm
Collaborative Opportunities In Ermsarahbart
 
PORSCHE Sharing e-learning resources SHA Newbury
PORSCHE Sharing e-learning resources SHA NewburyPORSCHE Sharing e-learning resources SHA Newbury
PORSCHE Sharing e-learning resources SHA Newburyheamedev
 
How can UK academic libraries respond to the current issues in scholarly publ...
How can UK academic libraries respond to the current issues in scholarly publ...How can UK academic libraries respond to the current issues in scholarly publ...
How can UK academic libraries respond to the current issues in scholarly publ...Stuart Dempster
 
Credit and Collaboration in MOOCs: Where are we now?
Credit and Collaboration in MOOCs: Where are we now?Credit and Collaboration in MOOCs: Where are we now?
Credit and Collaboration in MOOCs: Where are we now?tbirdcymru
 
Affordable Learning $olutions Fair, San Jose State University
Affordable Learning $olutions Fair, San Jose State UniversityAffordable Learning $olutions Fair, San Jose State University
Affordable Learning $olutions Fair, San Jose State UniversityEmily Puckett Rodgers
 
Content Curation – New L&D Mindset & Skill Set
Content Curation – New L&D Mindset & Skill SetContent Curation – New L&D Mindset & Skill Set
Content Curation – New L&D Mindset & Skill SetLearningCafe
 
Sustainable support for OER at the University of Edinburgh
Sustainable support for OER at the University of EdinburghSustainable support for OER at the University of Edinburgh
Sustainable support for OER at the University of EdinburghNick Sheppard
 
Public Knowledge Project
Public Knowledge ProjectPublic Knowledge Project
Public Knowledge ProjectAlbert Borrero
 
Watch out, it's behind you: publishers' tactics and the challenge they pose f...
Watch out, it's behind you: publishers' tactics and the challenge they pose f...Watch out, it's behind you: publishers' tactics and the challenge they pose f...
Watch out, it's behind you: publishers' tactics and the challenge they pose f...Danny Kingsley
 
BL Labs at Online Information 2013
BL Labs at Online Information 2013BL Labs at Online Information 2013
BL Labs at Online Information 2013labsbl
 
Demystifying OER and Bridge to Success
Demystifying OER and Bridge to SuccessDemystifying OER and Bridge to Success
Demystifying OER and Bridge to SuccessBrandon Muramatsu
 
#OpenScot Update for Warsaw Policy Forum June 2017
#OpenScot Update for Warsaw Policy Forum June 2017#OpenScot Update for Warsaw Policy Forum June 2017
#OpenScot Update for Warsaw Policy Forum June 2017Joe Wilson
 
Open Educational Resources (OER): The Landscape of the Future
Open Educational Resources (OER): The Landscape of the FutureOpen Educational Resources (OER): The Landscape of the Future
Open Educational Resources (OER): The Landscape of the FutureBrandon Muramatsu
 
Short brown presentation 26th june 2011
Short brown presentation 26th june 2011Short brown presentation 26th june 2011
Short brown presentation 26th june 2011Gillian Brown
 
Trustees Presentation
Trustees PresentationTrustees Presentation
Trustees PresentationCable Green
 
Introduction to Open Educational Resources (OER)
 Introduction to Open Educational Resources (OER) Introduction to Open Educational Resources (OER)
Introduction to Open Educational Resources (OER)Michael Paskevicius
 

Similar to CILIP ARLG '12: Measuring impact and quality (20)

Eduserv Foundation SL projects
Eduserv Foundation SL projectsEduserv Foundation SL projects
Eduserv Foundation SL projects
 
eduserv-foundation-sl-projects1881
eduserv-foundation-sl-projects1881eduserv-foundation-sl-projects1881
eduserv-foundation-sl-projects1881
 
Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014
 
Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014Moo cs and libraries bc faculty day 2014
Moo cs and libraries bc faculty day 2014
 
Collaborative Opportunities In Erm
Collaborative Opportunities In ErmCollaborative Opportunities In Erm
Collaborative Opportunities In Erm
 
PORSCHE Sharing e-learning resources SHA Newbury
PORSCHE Sharing e-learning resources SHA NewburyPORSCHE Sharing e-learning resources SHA Newbury
PORSCHE Sharing e-learning resources SHA Newbury
 
How can UK academic libraries respond to the current issues in scholarly publ...
How can UK academic libraries respond to the current issues in scholarly publ...How can UK academic libraries respond to the current issues in scholarly publ...
How can UK academic libraries respond to the current issues in scholarly publ...
 
Credit and Collaboration in MOOCs: Where are we now?
Credit and Collaboration in MOOCs: Where are we now?Credit and Collaboration in MOOCs: Where are we now?
Credit and Collaboration in MOOCs: Where are we now?
 
Affordable Learning $olutions Fair, San Jose State University
Affordable Learning $olutions Fair, San Jose State UniversityAffordable Learning $olutions Fair, San Jose State University
Affordable Learning $olutions Fair, San Jose State University
 
Content Curation – New L&D Mindset & Skill Set
Content Curation – New L&D Mindset & Skill SetContent Curation – New L&D Mindset & Skill Set
Content Curation – New L&D Mindset & Skill Set
 
Sustainable support for OER at the University of Edinburgh
Sustainable support for OER at the University of EdinburghSustainable support for OER at the University of Edinburgh
Sustainable support for OER at the University of Edinburgh
 
Public Knowledge Project
Public Knowledge ProjectPublic Knowledge Project
Public Knowledge Project
 
Watch out, it's behind you: publishers' tactics and the challenge they pose f...
Watch out, it's behind you: publishers' tactics and the challenge they pose f...Watch out, it's behind you: publishers' tactics and the challenge they pose f...
Watch out, it's behind you: publishers' tactics and the challenge they pose f...
 
BL Labs at Online Information 2013
BL Labs at Online Information 2013BL Labs at Online Information 2013
BL Labs at Online Information 2013
 
Demystifying OER and Bridge to Success
Demystifying OER and Bridge to SuccessDemystifying OER and Bridge to Success
Demystifying OER and Bridge to Success
 
#OpenScot Update for Warsaw Policy Forum June 2017
#OpenScot Update for Warsaw Policy Forum June 2017#OpenScot Update for Warsaw Policy Forum June 2017
#OpenScot Update for Warsaw Policy Forum June 2017
 
Open Educational Resources (OER): The Landscape of the Future
Open Educational Resources (OER): The Landscape of the FutureOpen Educational Resources (OER): The Landscape of the Future
Open Educational Resources (OER): The Landscape of the Future
 
Short brown presentation 26th june 2011
Short brown presentation 26th june 2011Short brown presentation 26th june 2011
Short brown presentation 26th june 2011
 
Trustees Presentation
Trustees PresentationTrustees Presentation
Trustees Presentation
 
Introduction to Open Educational Resources (OER)
 Introduction to Open Educational Resources (OER) Introduction to Open Educational Resources (OER)
Introduction to Open Educational Resources (OER)
 

More from Eduserv

Phase two of OpenAthens SP evolution including OpenID connect option
Phase two of OpenAthens SP evolution including OpenID connect optionPhase two of OpenAthens SP evolution including OpenID connect option
Phase two of OpenAthens SP evolution including OpenID connect optionEduserv
 
Partnership Licensing - allowing access to licensed resources
Partnership Licensing - allowing access to licensed resources Partnership Licensing - allowing access to licensed resources
Partnership Licensing - allowing access to licensed resources Eduserv
 
Lightning talk - EBSCO
Lightning talk - EBSCOLightning talk - EBSCO
Lightning talk - EBSCOEduserv
 
Lightning talk - Boopsie
Lightning talk - BoopsieLightning talk - Boopsie
Lightning talk - BoopsieEduserv
 
Lightning talk - Softlink
Lightning talk - SoftlinkLightning talk - Softlink
Lightning talk - SoftlinkEduserv
 
Lightning talk - Third Iron BrowZine
Lightning talk - Third Iron BrowZineLightning talk - Third Iron BrowZine
Lightning talk - Third Iron BrowZineEduserv
 
Lightning talk - Eduserv Chest Agreements
Lightning talk - Eduserv Chest AgreementsLightning talk - Eduserv Chest Agreements
Lightning talk - Eduserv Chest AgreementsEduserv
 
Phase one of OpenAthens SP evolution
Phase one of OpenAthens SP evolutionPhase one of OpenAthens SP evolution
Phase one of OpenAthens SP evolutionEduserv
 
Key considerations when mapping your end user experience
Key considerations when mapping your end user experienceKey considerations when mapping your end user experience
Key considerations when mapping your end user experienceEduserv
 
Our product development methodology
Our product development methodologyOur product development methodology
Our product development methodologyEduserv
 
How Readers Discover Content
How Readers Discover ContentHow Readers Discover Content
How Readers Discover ContentEduserv
 
OpenAthens product update
OpenAthens product updateOpenAthens product update
OpenAthens product updateEduserv
 
OpenAthens Customer Conference - Welcome address
OpenAthens Customer Conference - Welcome addressOpenAthens Customer Conference - Welcome address
OpenAthens Customer Conference - Welcome addressEduserv
 
Generating leads with content marketing
Generating leads with content marketingGenerating leads with content marketing
Generating leads with content marketingEduserv
 
Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016
Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016
Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016Eduserv
 
Mobius from Maplesoft
Mobius from MaplesoftMobius from Maplesoft
Mobius from MaplesoftEduserv
 
QSR NVivo
QSR NVivo QSR NVivo
QSR NVivo Eduserv
 
How Eduserv are helping local government organisations
How Eduserv are helping local government organisationsHow Eduserv are helping local government organisations
How Eduserv are helping local government organisationsEduserv
 
Is cloud the right fit for your needs?
Is cloud the right fit for your needs?Is cloud the right fit for your needs?
Is cloud the right fit for your needs?Eduserv
 
Planning your cloud strategy: Adur and Worthing Councils
Planning your cloud strategy: Adur and Worthing CouncilsPlanning your cloud strategy: Adur and Worthing Councils
Planning your cloud strategy: Adur and Worthing CouncilsEduserv
 

More from Eduserv (20)

Phase two of OpenAthens SP evolution including OpenID connect option
Phase two of OpenAthens SP evolution including OpenID connect optionPhase two of OpenAthens SP evolution including OpenID connect option
Phase two of OpenAthens SP evolution including OpenID connect option
 
Partnership Licensing - allowing access to licensed resources
Partnership Licensing - allowing access to licensed resources Partnership Licensing - allowing access to licensed resources
Partnership Licensing - allowing access to licensed resources
 
Lightning talk - EBSCO
Lightning talk - EBSCOLightning talk - EBSCO
Lightning talk - EBSCO
 
Lightning talk - Boopsie
Lightning talk - BoopsieLightning talk - Boopsie
Lightning talk - Boopsie
 
Lightning talk - Softlink
Lightning talk - SoftlinkLightning talk - Softlink
Lightning talk - Softlink
 
Lightning talk - Third Iron BrowZine
Lightning talk - Third Iron BrowZineLightning talk - Third Iron BrowZine
Lightning talk - Third Iron BrowZine
 
Lightning talk - Eduserv Chest Agreements
Lightning talk - Eduserv Chest AgreementsLightning talk - Eduserv Chest Agreements
Lightning talk - Eduserv Chest Agreements
 
Phase one of OpenAthens SP evolution
Phase one of OpenAthens SP evolutionPhase one of OpenAthens SP evolution
Phase one of OpenAthens SP evolution
 
Key considerations when mapping your end user experience
Key considerations when mapping your end user experienceKey considerations when mapping your end user experience
Key considerations when mapping your end user experience
 
Our product development methodology
Our product development methodologyOur product development methodology
Our product development methodology
 
How Readers Discover Content
How Readers Discover ContentHow Readers Discover Content
How Readers Discover Content
 
OpenAthens product update
OpenAthens product updateOpenAthens product update
OpenAthens product update
 
OpenAthens Customer Conference - Welcome address
OpenAthens Customer Conference - Welcome addressOpenAthens Customer Conference - Welcome address
OpenAthens Customer Conference - Welcome address
 
Generating leads with content marketing
Generating leads with content marketingGenerating leads with content marketing
Generating leads with content marketing
 
Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016
Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016
Pre-launch introduction to the new OpenAthens SP dashboard - 13/09/2016
 
Mobius from Maplesoft
Mobius from MaplesoftMobius from Maplesoft
Mobius from Maplesoft
 
QSR NVivo
QSR NVivo QSR NVivo
QSR NVivo
 
How Eduserv are helping local government organisations
How Eduserv are helping local government organisationsHow Eduserv are helping local government organisations
How Eduserv are helping local government organisations
 
Is cloud the right fit for your needs?
Is cloud the right fit for your needs?Is cloud the right fit for your needs?
Is cloud the right fit for your needs?
 
Planning your cloud strategy: Adur and Worthing Councils
Planning your cloud strategy: Adur and Worthing CouncilsPlanning your cloud strategy: Adur and Worthing Councils
Planning your cloud strategy: Adur and Worthing Councils
 

Recently uploaded

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...Product School
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxAbida Shariff
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backElena Simperl
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeCzechDreamin
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesThousandEyes
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1DianaGray10
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomCzechDreamin
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaRTTS
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...Elena Simperl
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Thierry Lestable
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupCatarinaPereira64715
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...Product School
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoTAnalytics
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsExpeed Software
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationZilliz
 

Recently uploaded (20)

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 

CILIP ARLG '12: Measuring impact and quality

  • 1. Measuring impact and quality Workshop: Measuring the use of online resources Tom Edmonds OpenAthens Product Manager
  • 2. Maximising the ROI for library budgets • Lightening demo! • Where does your library budget go? • What challenges do you face? • Some solutions • YOU • Case studies
  • 3. Eduserv - OpenAthens 1994 2000 2008 2009 2010 2011 Today… • Athens • Athens • Athens • 33% of the • US • US Navy • > 4,000 developed & adopted by became Australian Department of Medicine customers first web NHS England OpenAthens healthcare Veteran Information use service in the UK market adopts Affairs adopts Systems OpenAthens launched OpenAthens OpenAthens Support • > 4 million - SAH Agency users - DoH Victoria adopts worldwide OpenAthens www.eduserv.org.uk [Lightning demo]
  • 4. Identity & Access Management - markets Public Academic Healthcare Publishing Sector Commercial [Lightning demo]
  • 5. Some library stats. www.eduserv.org.uk
  • 6. Library developments 1999 Print Print and online 2007 Online 2009 100% Source: Ebsco www.eduserv.org.uk
  • 7. Where does your library budget go? Resources Personnel Buildings Other www.eduserv.org.uk
  • 8. Where does your library budget go? 23% 13% Resources Personnel 25% 39% Buildings Other www.eduserv.org.uk Source: commercial research company
  • 9. Where does your resources budget go? e-Journals 68% Online databases 2% Print 2% Magazines & newspapers 10% Books 3% 15% e-Books www.eduserv.org.uk Source: commercial research company
  • 10. Where does your e-resources budget go? www.eduserv.org.uk Source: Bath Spa University (2010)
  • 11. JISC Activity data programme Looking for the link between library usage and student attainment “There is a statistically significant correlation across a number of universities between library activity data and student attainment” - thank you to the JISC & Huddersfield University www.eduserv.org.uk
  • 14. 1 2:1 2:2 3 70.0 59.3 60.0 56.8 56.4 53.1 50.3 50.0 53.1 50.9 49.5 49.8 48.5 40.0 39.2 36.4 37.2 36.1 34.3 30.0 26.1 20.0 22.8 23.0 22.3 21.1 www.eduserv.org.uk 10.0 2005/06 2006/07 2007/08 2008/09 2009/10
  • 16. What are the challenges? …for optimizing your library spend www.eduserv.org.uk
  • 17. Challenges… • Budgets www.eduserv.org.uk
  • 18. Challenges… • Budgets • Suppliers • Increasing subscription costs • Lack of flexibility. www.eduserv.org.uk
  • 19. Challenges… • Budgets • Suppliers • Technologies • IP address management • Authentication steps for both the library and publisher • User ID setups • A to Z list management • OpenURL management • Licence compliance policy management • Support: troubleshooting, downtime, usage monitoring, training etc. www.eduserv.org.uk
  • 20. The challenges… • Budgets • Suppliers • Technologies • politics Source: stus.com www.eduserv.org.uk
  • 21. The challenges… • Budgets • Suppliers • Technologies • politics • Usability www.eduserv.org.uk
  • 28. The challenges… • Budgets • Suppliers • Technologies • politics • Usability • Users. www.eduserv.org.uk
  • 29. The “Path of least resistance” “...an information [seeker] will tend to use the most convenient search method, in the least exacting mode available. Information seeking behaviour stops as soon as minimally acceptable results are found.” Source: http://en.wikipedia.org/wiki/ www.eduserv.org.uk
  • 30. Principle of Least Effort “...numerous studies have shown users are often willing to sacrifice information quality for accessibility. This fast food approach to information consumption drives librarians crazy. ‘Our information is healthier and tastes better too’ they shout.” - Peter Morville (“Ambient Findability”, 2005) www.eduserv.org.uk 30
  • 32. Marketing your library www.eduserv.org.uk
  • 33. Social media “I found out all my students were looking at material in the VLE but going straight to Facebook to use the discussion tools and discuss the material and the lectures. I thought I might as well join them and ask them questions in their preferred space.” - What is Web 2.0? Ideas, technologies and implications for education. Paul Anderson. A JISC report www.eduserv.org.uk
  • 34. Mobilise your library… www.eduserv.org.uk
  • 35. Market your resources Source: Gungahlin Library, Australia flickr.com/photos/silversprite/5120507383 www.eduserv.org.uk
  • 36. Library portal www.eduserv.org.uk
  • 37. Over to you... What have you done/are doing to get more from your library budget? www.eduserv.org.uk
  • 38. Case Study 1: www.eduserv.org.uk
  • 39. Small UK HE institution Objectives: to implement Shibboleth reduce burden of administering access increase use of electronic resources Constraints: no IT resource Solution: implement a local authentication solution. www.eduserv.org.uk
  • 40. Project: duration – 9 months… www.eduserv.org.uk
  • 41. Small UK HE institution – one year on… • No access queries • Handful of Athens queries! • Integration with Google Docs • Gmail access for post-graduates • Increased resource usage • 20,000 more sessions in 2010/11. www.eduserv.org.uk
  • 42. Small UK HE institution – number of logins Year/ January February March Month No. % No. % No. % 2009 16,460 8,247 13,860 2010 18,198 11 11,345 37 21,276 54 2011 22,930 39 27,359 232 27,446 98 www.eduserv.org.uk
  • 43. Case Study 2: www.eduserv.org.uk
  • 44. Commercial research library Objectives: to simplify working in a fluid environment manage changing need for information Constraints: fixed (if not falling) budget Solution: re-negotiate licences integrate library services. www.eduserv.org.uk
  • 45. User behaviour: Copied in the library Borrowed Downloaded www.eduserv.org.uk
  • 46. What are the consequences? Subscription cost Number of downloads 60,000 6,000 50,000 5,000 40,000 4,000 30,000 3,000 20,000 2,000 10,000 1,000 - - 2007 2008 2009 2007 2008 2009 www.eduserv.org.uk
  • 47. What are the consequences? Cost per download 20.00 18.00 16.00 14.00 12.00 10.00 8.00 6.00 4.00 2.00 0.00 2007 2008 2009 www.eduserv.org.uk
  • 48. Three steps to improve ROI • Re-negotiated subscriptions • Implemented a local identity and access management solution (OpenAthens) • Implemented OpenURL and A to Z list management using TDNet. www.eduserv.org.uk
  • 49. Re-negotiated subscriptions Publisher 1 • No movement on price or licencing terms • No alternative arrangements available • From 2010, the complete collection was replaced by a collection of the most used titles. www.eduserv.org.uk
  • 50. What were the consequences? Subscription cost Number of downloads 60,000 6,000 50,000 5,000 40,000 4,000 30,000 3,000 20,000 2,000 10,000 1,000 - - 2007 2008 2009 2010 2007 2008 2009 2010 www.eduserv.org.uk
  • 51. What were the consequences? Cost per download 20.00 18.00 16.00 14.00 12.00 10.00 8.00 6.00 4.00 2.00 0.00 2007 2008 2009 2010 www.eduserv.org.uk
  • 52. The impact: publisher 1 • End users have less access • Library service is curtailed • Publisher loses income. www.eduserv.org.uk
  • 53. Re-negotiated subscriptions Publisher 2: • 2007 ~35 journals, not much used • 2008 cancelled most of them • 2010 new arrangement with publisher o download everything at a fixed price o subscriptions commence when it is profitable. www.eduserv.org.uk
  • 54. What were the consequences? Cost of subscriptions Number of downloads 80,000 6,000 70,000 60,000 5,000 50,000 4,000 40,000 3,000 30,000 2,000 20,000 1,000 10,000 - - 2007 2008 2009 2010 2007 2008 2009 2010 www.eduserv.org.uk
  • 55. What were the consequences? Cost per download 40.00 35.00 30.00 25.00 20.00 15.00 10.00 5.00 0.00 2007 2008 2009 2010 www.eduserv.org.uk
  • 56. The impact: publisher 2 • End users have more access than they did 3 years ago • The library service improves • Publisher regains income. www.eduserv.org.uk
  • 57. Conclusions… • Negotiate • Technology solutions • Environment • Social media • Traditional tools www.eduserv.org.uk
  • 58. Thank you for listening Twitter: @edm0nds Skype: tomedmonds.eduserv Email: tom.edmonds@eduserv.org.uk www.eduserv.org.uk