INSIGHT USAGE STATISTICS

        Mockup Presentation
    for indepth usage analysis of
Repositories, Publications and Authors

             maurice.vanderfeesten       1
“Since it is their [Funding Agencies] mission to
promote research, many funding agencies
support open access. [...] Thus the question
arises whether the money invested in open
access is on a par with its research impact.”
                                    Johannes Fournier (German Research Foundation)

Berlin6, 13 May 2008, Session 7 - Pondering on Research Impact and Cost Effectiveness

                                                      http://oa.mpg.de/berlin6/index8a92.html?page_id=75



                                  maurice.vanderfeesten                                               2
“ Scientific information has the power to
transform our lives for the better – it is too
valuable to be locked away. In addition, every EU
citizen has the right to access and benefit from
knowledge produced using public funds.”
    Neelie Kroes, Vice-President of the European Commission for the Digital Agenda

                                                         Ghent, 2 December 2010




                               maurice.vanderfeesten                             3
The question of how to measure the
effectiveness of such a publishing model [Open
Access] was simple, according to Liebrand – by
usage levels.
                   Wim Liebrand, chief executive of SURFfoundation

              Research Information, January 2011, Issue 51, page 17




                      maurice.vanderfeesten                       4
Vorming nieuw SURF programma, Platform ICT&Onderzoek
         Consultatie bijeenkomst, 21 April 2011




                   maurice.vanderfeesten           5
Journal
           Article
        Individual        Impact =
            Topic

citation (h-index & h’-index , eigenfactor, g-index, h-b-index, etc.)
      + usage (downloads & views)
            + peer-review (expert opinion)
                   + alt-metrics (storage, links, bookmarks,
                             conversations/reviews/opinions)




                                                                          altmetrics.org &
                            maurice.vanderfeesten                                     6
                                               en.wikipedia.org/wiki/Category:Bibliometrics
2011-04-26

INSIGHT SURVEY RESULTS


             maurice.vanderfeesten   7
Repository managers able to make efforts for delivering
     statistics before the OpenAccess week 2011
1.    Erasmus Universiteit Rotterdam
2.    NWO / CWI
3.    Rijksuniversiteit Groningen
4.    Technische Universiteit Delft
5.    Universiteit Leiden
6.    Universiteit Maastricht
7.    Universiteit Utrecht
8.    Universiteit van Amsterdam
9.    Universiteit van Tilburg
10.   Vrije Universiteit
11.   Wageningen Universiteit & Researchcentrum

                         maurice.vanderfeesten        8
Repository managers positive towards
     sharing common statistics
1.    Erasmus Universiteit Rotterdam
2.    NWO / CWI
3.    Rijksuniversiteit Groningen
4.    Technische Universiteit Delft
5.    Universiteit Leiden
6.    Universiteit Maastricht
7.    Universiteit Twente
8.    Universiteit Utrecht
9.    Universiteit van Amsterdam
10.   Universiteit van Tilburg
11.   Vrije Universiteit
12.   Wageningen Universiteit & Researchcentrum


                            maurice.vanderfeesten   9
What repository managers want
• Visualisation of:                  • Numbers of:
   –   Totals                               – Objects
   –   Usage over time                      – Metadata Views
   –   Geographics                          – Fulltext Downloads
   –   Popularity                    • Filtered by:
                                            –    Time period
                                            –    Institution
                                            –    Publication Type
                                            –    Single Publication *
                                            –    Single Author *

                                                         *) added value for researchers


                         maurice.vanderfeesten                                      10
Visualising statistics
• For Repository Managers
  – Insight Repositories Dashboard
• For Researchers
  – Insight Publication Dashboard
  – Insight Author Dashboard




                     maurice.vanderfeesten   11
for repository managers

INSIGHT REPOSITORIES


                          maurice.vanderfeesten   12
maurice.vanderfeesten   13
insight-statistics




                                                              [Views] Downloads
Views: 77.594         Downloads: 908.434   Objects: 606.985
                                                               362        3362


                                                               256        2256



                                                               131        1131




  Views
  Downloads
  Objects
  Views/Objects
  Downloads/Objects




                          maurice.vanderfeesten                                   14
maurice.vanderfeesten   15
maurice.vanderfeesten   16
maurice.vanderfeesten   17
maurice.vanderfeesten   18
[Views] Downloads




maurice.vanderfeesten                 19
maurice.vanderfeesten   20
maurice.vanderfeesten   21
maurice.vanderfeesten   22
for the Researchers

INSIGHT PUBLICATIONS


                      maurice.vanderfeesten   23
Statistieken




               maurice.vanderfeesten   24
Overzicht

Statistieken




                                   Views
                                                Views: 14
                                                Downloads: 219




                Views
                Downloads
               Objects
               Views/Objects
               Downloads/Objects




                                           maurice.vanderfeesten   25
for the Researchers

INSIGHT AUTHORS


                      maurice.vanderfeesten   26
Statistieken




               maurice.vanderfeesten   27
Overzicht



Statistieken
                                                                        Views Downloads
                           Views
                                                                         362       3362
                                           Views: 679
                                           Downloads: 5127
                                                                         256       2256



                                                                         131       1131




               Views
               Downloads
               Objects
               Views/Objects
               Downloads/Objects




                                             maurice.vanderfeesten
                                   urn:nbn:nl:ui:11-dbi/49edad50a2f3e
                                   urn:nbn:nl:ui:11-dbi/443cd774057d6                     28
                                   urn:nbn:nl:ui:11-dbi/44902c349fcc0
                                   urn:nbn:nl:ui:11-dbi/44d872431bbdc
PAST: SURE1


              maurice.vanderfeesten   29
• Infrastructuur, architectuur, protocollen en
  beheer
   – SURE uitwissel standaard (OAI-PMH+OpenURL ContextObjects)
   – SURE robot filter list (based on international acceptance)
   – SURE repository module (download, deploy, configure)
   – SURE log aggregator
   – SURE API Services
• Dagelijkse harvest
• Downloads en views per identifier
http://wiki.surffoundation.nl/display/statistics/Project+results
                                  maurice.vanderfeesten            30
UvA



VU




      maurice.vanderfeesten   31
Statistics in international context, using the same standards

PRESENT: OPENAIRE


                              maurice.vanderfeesten             32
maurice.vanderfeesten   33
maurice.vanderfeesten   34
PRESENT: SURE2


            maurice.vanderfeesten   35
Business case
• Op een aantrekkelijke manier de impact en
  gebruik van Open Access Publicaties
  presenteren van Repositories in Nederland.
• Biedt een additionele mogelijkheid om impact
  te meten (in de maatschappij).

• Voor wie: Repository Managers &
  Onderzoekers

                   maurice.vanderfeesten     36
Resultaten
• Downloads en views per Auteur, Publication
• Statistics Dashboard
• Verder uitrol en inbedding in landelijke
  repository community en Narcis



• Resultaat op OpenAccess Week 2011 (okt)

                   maurice.vanderfeesten       37
NWO/CWI
TUD
UL                                DANS
UM
UU
UvA
UvT
VU
WUR
          Embedable </> HTML code snippets




                    maurice.vanderfeesten    38
Project indeling
           WP1: Project Management

  WP2: Repository
Dashboard (buiten narcis)
development + roadmapping        WP5: Repositories
  WP3: End-user                 implementation and
 Dashboard (in narcis)               Support

WP4: Log Harvesting


            WP6: Kennis disseminatie




                    maurice.vanderfeesten            39
Project uitvoering
• WP1: Project management
    – UvT
• WP2: Repository Dashboard development (buiten narcis)
    – DANS
• WP3: End-user Dashboard development (in narcis)
    – DANS
• WP4: Log Harvesting
    – DANS
• WP5: Repository implementatie en Support
    – Implementation: EUR, NWO/CWI, TUD, UM, UU, UvT, WUR (≈16uur per IR)
    – Support: VU, UvA, UL (≈2uur per te implementeren IR)
• WP6: Kennis disseminatie
    – UL
    – Artikel & Conferentie?
    – Exposure in SURFshare community: nieuwsbrief, scienceguide, etc.


                                 maurice.vanderfeesten                      40
Budget verdeling
                                                          €7.500
                       WP1: Project Management


        WP2: Repository
      Dashboard (buiten narcis)
          development + roadmapping       WP5: Repositories
€12.500     WP3: End-user                implementation and
                                                             Eigen-
           Dashboard (in narcis)              support       bijdrage

      WP4: Log Harvesting


                       WP6: Kennis disseminatie             €5.000



                                                      Penvoerder     100% subsidie
                                                      DANS           50% subsidie + 50% matching
                                                      Instellingen   Eigen bijdrage (=100% matching)
                                maurice.vanderfeesten Instelling     100% subsidie             41
Vervolgstappen
•   Project Plan – richting BIK
•   Letter of intent (eindverantwoordelijke repositories)
•   Subsidievoorwaarde penvoerder
•   Planning communiceren
    – Kickoff: 1 juni
    – Resultaat: okt OpenAccess Week 2011



                         maurice.vanderfeesten              42
vanderfeesten@surf.nl

VRAGEN?


                        maurice.vanderfeesten   43

SURE2 Statistics dashboard mockup

  • 1.
    INSIGHT USAGE STATISTICS Mockup Presentation for indepth usage analysis of Repositories, Publications and Authors maurice.vanderfeesten 1
  • 2.
    “Since it istheir [Funding Agencies] mission to promote research, many funding agencies support open access. [...] Thus the question arises whether the money invested in open access is on a par with its research impact.” Johannes Fournier (German Research Foundation) Berlin6, 13 May 2008, Session 7 - Pondering on Research Impact and Cost Effectiveness http://oa.mpg.de/berlin6/index8a92.html?page_id=75 maurice.vanderfeesten 2
  • 3.
    “ Scientific informationhas the power to transform our lives for the better – it is too valuable to be locked away. In addition, every EU citizen has the right to access and benefit from knowledge produced using public funds.” Neelie Kroes, Vice-President of the European Commission for the Digital Agenda Ghent, 2 December 2010 maurice.vanderfeesten 3
  • 4.
    The question ofhow to measure the effectiveness of such a publishing model [Open Access] was simple, according to Liebrand – by usage levels. Wim Liebrand, chief executive of SURFfoundation Research Information, January 2011, Issue 51, page 17 maurice.vanderfeesten 4
  • 5.
    Vorming nieuw SURFprogramma, Platform ICT&Onderzoek Consultatie bijeenkomst, 21 April 2011 maurice.vanderfeesten 5
  • 6.
    Journal Article Individual Impact = Topic citation (h-index & h’-index , eigenfactor, g-index, h-b-index, etc.) + usage (downloads & views) + peer-review (expert opinion) + alt-metrics (storage, links, bookmarks, conversations/reviews/opinions) altmetrics.org & maurice.vanderfeesten 6 en.wikipedia.org/wiki/Category:Bibliometrics
  • 7.
    2011-04-26 INSIGHT SURVEY RESULTS maurice.vanderfeesten 7
  • 8.
    Repository managers ableto make efforts for delivering statistics before the OpenAccess week 2011 1. Erasmus Universiteit Rotterdam 2. NWO / CWI 3. Rijksuniversiteit Groningen 4. Technische Universiteit Delft 5. Universiteit Leiden 6. Universiteit Maastricht 7. Universiteit Utrecht 8. Universiteit van Amsterdam 9. Universiteit van Tilburg 10. Vrije Universiteit 11. Wageningen Universiteit & Researchcentrum maurice.vanderfeesten 8
  • 9.
    Repository managers positivetowards sharing common statistics 1. Erasmus Universiteit Rotterdam 2. NWO / CWI 3. Rijksuniversiteit Groningen 4. Technische Universiteit Delft 5. Universiteit Leiden 6. Universiteit Maastricht 7. Universiteit Twente 8. Universiteit Utrecht 9. Universiteit van Amsterdam 10. Universiteit van Tilburg 11. Vrije Universiteit 12. Wageningen Universiteit & Researchcentrum maurice.vanderfeesten 9
  • 10.
    What repository managerswant • Visualisation of: • Numbers of: – Totals – Objects – Usage over time – Metadata Views – Geographics – Fulltext Downloads – Popularity • Filtered by: – Time period – Institution – Publication Type – Single Publication * – Single Author * *) added value for researchers maurice.vanderfeesten 10
  • 11.
    Visualising statistics • ForRepository Managers – Insight Repositories Dashboard • For Researchers – Insight Publication Dashboard – Insight Author Dashboard maurice.vanderfeesten 11
  • 12.
    for repository managers INSIGHTREPOSITORIES maurice.vanderfeesten 12
  • 13.
  • 14.
    insight-statistics [Views] Downloads Views: 77.594 Downloads: 908.434 Objects: 606.985 362 3362 256 2256 131 1131 Views Downloads Objects Views/Objects Downloads/Objects maurice.vanderfeesten 14
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
    for the Researchers INSIGHTPUBLICATIONS maurice.vanderfeesten 23
  • 24.
    Statistieken maurice.vanderfeesten 24
  • 25.
    Overzicht Statistieken Views Views: 14 Downloads: 219 Views Downloads Objects Views/Objects Downloads/Objects maurice.vanderfeesten 25
  • 26.
    for the Researchers INSIGHTAUTHORS maurice.vanderfeesten 26
  • 27.
    Statistieken maurice.vanderfeesten 27
  • 28.
    Overzicht Statistieken Views Downloads Views 362 3362 Views: 679 Downloads: 5127 256 2256 131 1131 Views Downloads Objects Views/Objects Downloads/Objects maurice.vanderfeesten urn:nbn:nl:ui:11-dbi/49edad50a2f3e urn:nbn:nl:ui:11-dbi/443cd774057d6 28 urn:nbn:nl:ui:11-dbi/44902c349fcc0 urn:nbn:nl:ui:11-dbi/44d872431bbdc
  • 29.
    PAST: SURE1 maurice.vanderfeesten 29
  • 30.
    • Infrastructuur, architectuur,protocollen en beheer – SURE uitwissel standaard (OAI-PMH+OpenURL ContextObjects) – SURE robot filter list (based on international acceptance) – SURE repository module (download, deploy, configure) – SURE log aggregator – SURE API Services • Dagelijkse harvest • Downloads en views per identifier http://wiki.surffoundation.nl/display/statistics/Project+results maurice.vanderfeesten 30
  • 31.
    UvA VU maurice.vanderfeesten 31
  • 32.
    Statistics in internationalcontext, using the same standards PRESENT: OPENAIRE maurice.vanderfeesten 32
  • 33.
  • 34.
  • 35.
    PRESENT: SURE2 maurice.vanderfeesten 35
  • 36.
    Business case • Opeen aantrekkelijke manier de impact en gebruik van Open Access Publicaties presenteren van Repositories in Nederland. • Biedt een additionele mogelijkheid om impact te meten (in de maatschappij). • Voor wie: Repository Managers & Onderzoekers maurice.vanderfeesten 36
  • 37.
    Resultaten • Downloads enviews per Auteur, Publication • Statistics Dashboard • Verder uitrol en inbedding in landelijke repository community en Narcis • Resultaat op OpenAccess Week 2011 (okt) maurice.vanderfeesten 37
  • 38.
    NWO/CWI TUD UL DANS UM UU UvA UvT VU WUR Embedable </> HTML code snippets maurice.vanderfeesten 38
  • 39.
    Project indeling WP1: Project Management WP2: Repository Dashboard (buiten narcis) development + roadmapping WP5: Repositories WP3: End-user implementation and Dashboard (in narcis) Support WP4: Log Harvesting WP6: Kennis disseminatie maurice.vanderfeesten 39
  • 40.
    Project uitvoering • WP1:Project management – UvT • WP2: Repository Dashboard development (buiten narcis) – DANS • WP3: End-user Dashboard development (in narcis) – DANS • WP4: Log Harvesting – DANS • WP5: Repository implementatie en Support – Implementation: EUR, NWO/CWI, TUD, UM, UU, UvT, WUR (≈16uur per IR) – Support: VU, UvA, UL (≈2uur per te implementeren IR) • WP6: Kennis disseminatie – UL – Artikel & Conferentie? – Exposure in SURFshare community: nieuwsbrief, scienceguide, etc. maurice.vanderfeesten 40
  • 41.
    Budget verdeling €7.500 WP1: Project Management WP2: Repository Dashboard (buiten narcis) development + roadmapping WP5: Repositories €12.500 WP3: End-user implementation and Eigen- Dashboard (in narcis) support bijdrage WP4: Log Harvesting WP6: Kennis disseminatie €5.000 Penvoerder 100% subsidie DANS 50% subsidie + 50% matching Instellingen Eigen bijdrage (=100% matching) maurice.vanderfeesten Instelling 100% subsidie 41
  • 42.
    Vervolgstappen • Project Plan – richting BIK • Letter of intent (eindverantwoordelijke repositories) • Subsidievoorwaarde penvoerder • Planning communiceren – Kickoff: 1 juni – Resultaat: okt OpenAccess Week 2011 maurice.vanderfeesten 42
  • 43.
    vanderfeesten@surf.nl VRAGEN? maurice.vanderfeesten 43