LibMeter Seminar Intro Current Practice

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

0 comments

Post a comment

    Post a comment
    Embed Video
    Edit your comment Cancel

    Favorites, Groups & Events

    LibMeter Seminar Intro Current Practice - Presentation Transcript

    1. Striving for Excellence with Electronic Library Statistics Indicators for Performance Evaluation Introduction – Current Practice Institut für Informationswissenschaft, University of Applied Sciences, Cologne (FH-Köln IIW) Seminar on Library Evaluation (S. FÜHLES-UBACH) Peter Ahrens Guest Lecture V 1.00a – 2009-05-18 Cologne, 7th May 2009
    2. LibMeter Seminar
      • This LibMeter Introduction Seminar
      • is a continuation from the following
      • Slideshare Presentation:
      • Current Practice – Basics
      • It also relates to:
      • LibMeter Case Study #1
      • (University of Düsseldorf)
    3. Roadmap of this Presentation Introduction - Current Practice
      • I. Introduction - Basics
        • A Quick Futuristic Web Tour
        • Usage Stats for the Rest of Us (No Maths please!)
        • Library Role, Services & Usage
      • II. Introduction – Current Practise
        • Where to get Usage Figures from ?
        • How to interpret usage Figures ?
        • LibMeter Case Studies
      • III. Perspectives
    4. Where to get Usage Figures for Electronic Services?
    5. German Library Statistics DBS 2007+
    6. Which Parties are involved in Generating Service and Stats ?
      • Sorry, we need to become technical again – Stats Source
      • One Party-Scenario (Examples: OPAC hits, Homepage)
        • Service Provider = Library
        • += Raw Statistics Provider = Webserver/ IT Department
        • (+/- allied special statistics service provider)
      • Two Party-Scenario (Example: COUNTER stats)
        • Lib. + Content Provider = Online Publisher / Service Host
      • Three Party Scenario (Examples EZB; OpenURL)
        • Lib. + Content + Web Service provider - Library Computing Service
          • usually Server with powerful integrated specific statistic tools
      • Multi Party-Scenario: (Example BIX Virtual Library Use)
        • Lib. + Content + Web Service + Stats Provider
    7. DBS Starts reporting on Electronic Usage in 2007
      • DBS Variable Analysis (VA) is available since 2004
      • DBS-VA contains annual data back to 1999
      • DBS reports on 6 electronic „OUTPUT“-parameters (=use or usage) since 2007
    8. Use of Electronic Resources & Online Services in DBS (2007)
      • General Services (1 Party or 1 Party+)
        • Visits of Library-Homepage (Zählpixel)
        • Visits of OPAC (Zählpixel) *1.)
      • Content Delivery (2 Parties) *2.)
        • Full Text Downloads of locally licensed articles (COUNTER)
        • Database Search Sessions (+/-COUNTER)
        • Fulltext Views of locally managed Electronic Documents
      • Context –Pointing –Linking Services (3 Parties) *2.)
        • Links to licensed eJournals (Homepages) (EZB=A-Z List)
    9. Availability of Electronic Usage Data is Still Limited (DBS 2007) Compiled from Data downloaded from: http://www.bibliotheksstatistik.de/eingabe/dynrep/index.php [2009-04-15]
    10. Sample University Library Profile (DBS) Basics on Library-“Size“, -Input & Output
      • Actions
        • Raw Numbers
          • Often very high values
          • Go beyond imagination
        • Work Basis: User Numbers
          • Different Types
          • Can be combined to Primary User Number
        • Standardization
          • Key Step: Calculation of „ Value per User per Year “ = Normalization
      • Benefits
        • Numbers become imaginable
        • Numbers can be memorized
        • Numbers become comparable
      Data downloaded from www.bibliotheksstatistik.de into PC-Spreadsheet Program, [2009-05-03]
    11. Looking at one Parameter (EZB) reported by 2 statistics hosts EZB Admin versus DBS 2007
    12. Linking to „Electronic Journals“ What it means ? What is counted ?
      • Different reporting definitions – CAVE, Don‘t compare apple and pears !
        • Standard EZB reports for a member institution (library)
          • A+B+C+D = EZB_Standard ( include all EZB-Requests issued from one Institution)
        • Special EZB reporting for DBS/Par. #181 (automatic upload 2007 onwards)
          • B+C = EZB_for_DBS ( exclude A+D = Open Access, NatLis, free Grey Lit + PPV)
      • What does this mean in actual numbers (e.g. for ULB Düsseldorf for 2007)
        • EZB_for_DBS = 124.421 ; Total Counts: EZB_Standard = 185.361 => +/- 60.940
      A = free access B = locally licensed C = As B but only certain years D = paid full text, not licensed Access Category of Publication
    13. Pros and Cons of counting EZB „free“ eJournal-Linking activity ?
      • NO (B&C only) - Controlling & accounting approach (DBS 2007)
        • „ Free“ eSources do not comply with usage indicator DBS#181 definition - to have clearly locally attributable cost & effort
          • Direct Cost is a pre-requisit for DBS#181 = No direct cost, no count !
            • „ Maßgeblich ist immer die Prämisse, dass diese Angebote der Bibliothek Aufwand (Geld und Arbeit) verursachen und damit eine mit den vorhandenen Ressourcen erbrachte Leistung darstellen“ (*)
          • Content 1-to-1 correlated with (paid!) COUNTER articles DBS#183
      • YES (+A&D): Service monitoring approach (EZB basic Report)
        • Library participates in community effort of coop. cataloguing to keep EZB alive
        • Service is clearly attributable to local users of a given institution
        • Many additional Service events for similar service (+50%)
          • Reporting would allow analysis of trends in usage of electronic scholarly information and significant related library services (abd community efforts)
            • What is the bulk use of all NatLis, all Open Access journals ?
            • Are there differences between Institution(s) (Types)
            • Are there Proportion Shifts between A, B, C & D over time (Berlin-Declaration, DFG)
    14. Looking annually at 1 Parameter (EZB) at 1 time (DBS 2007) for many libraries
    15. Comparing EZB Use (B+C) among University Libraries in 2007 Compiled from DBS VA: http://www.bibliotheksstatistik.de/eingabe/dynrep/index.php [2009-04-15] EZB (B+C only) call as per DBS 2007 Standardized per Primary User per Year
    16. Comparing Usage at different Types of Institutions
    17. 2007 EZB Usage per Primary User at Universities versus Polytechs
      • EZB Statistics
        • Universities (n=57)
          • Median = 6,2
          • Mean / Average = 6.9
          • Standard Deviation = 5.6
          • Variation Coefficient = 0.8
        • Polytechs (n=34)
          • Median = 0,42 (sic!)
          • Mean / Average = 2.0
          • Standard Deviation = 6.1
          • Variation Coefficient =3.0
        • Düsseldorf:
          • Mean / Average 7.0
          • = 0.13 Std. Dev. above Mean
      While you may calculate Mean and St. Dev. for a population, make sure it is normally distributed before drawing further conclusions (check Median) !
    18. Looking at Distribution among University Libraries & Polytechs ?
      • A: Number of EZB calls correlated with conventional Loans* ?
        • NO, there is no correlation
      • B: Number of EZB calls correlated with the Staff/Student ratio* ?
        • YES, there seems to be a weak positive correlation
        • i.e. higher staff proportion goes along with higher the EZB usage
        • In other words (Hypothesis): Staff uses EZB eJournal-Catalogue more than Students
        • This is not astonishing, but for the first time it becomes quantifiable
      A B
    19. BIX-2008+ Performance Indicator „Virtual Use“
    20. HDM Usage Counts for Electronic Library „Traffic“ Data: Courtesy of I. SIEBERT & J. KREISCHE, University Library Düsseldorf from private Website at HDM [2009-04-30]
    21. BIX Performance-Indicator „Virtual Library Use“
      • New (per 2008*) in German Library Performance Index „BIX“
      • Normalized Combined Parameter: „Virtual Annual Use“
      • Definition: (OPAC & Homepage) / Number of Primary Users
      • Simple Interpretation
    22. Electronic Usage enters the „Main Stage“ in 2008 (with BIX)
      • „ Simple“ Standardized Parameters (meaningful !)
      • Annual Library „Use“ per Primary User:
        • Physical visits: 110,8
        • Virtual Use: 204,7
      • Simple Statements
        • Average User comes every second workday
        • Average virtual user comes daily
        • CAVE: Only „front door“
    23. From Electronic Library Output to „Virtual Use“ (DBS2007 > BIX2008)
      • Principle
        • Take reliable Usage figures from different relevant Services with high number of Events per User per Year
        • Combine to new parameter
      • Benefits
        • Comprehensive & Easy to understand
        • Easy to compare
          • E.g. with physical use
      • Limits
        • Difficult to standardize Homepage & OPAC counts across institutions (different software, no established counting standard)
        • HDM-Zählpixel-Provider limits
    24. How SMART is „Virtual Use“ ?
      • S pecific :
      • Quite general
      • M easurable :
      • YES Community Standard with help of HDM Zählpixel
      • A chievable and Attributable :
      • Library is actively producing Service
      • Today every library can produce #
      • R elevant and Realistic :
      • YES Users frequently go there
      • Closely tied to core services
      • How representative for total spectrum of electronic Library Services ?
      • T ime-bound, Timely, Trackable, and Targeted :
      • No log-files publicly available (yet?)
      • Not available for all periods
    25. DBS & BIX Statistics Benefits & Limits
      • Benefits
      • Broad Institutions Base
      • Fairly Comprehensive
      • Creates Awareness
        • Community
        • Public
      • Online Data Warehouse
        • Transparency
        • Allows Meta Studies
      • Limits
      • Few Parameters
      • Limited Scope
        • i.e. more detailled services missing
      • Standardization Problems
      • Incomplete data
      • Only Annual Data
      • Time Lag
      • International Comparability ?
    26. Journal & Database Vendors (COUNTER)
    27. COUNTER provides „standardized“ Usage Stats
    28. Example: Usage of Subscribed Journals Via COUNTER & SUSHI & ScholarlyStats
    29. COUNTER Statistics Benefits & Limits
      • Benefits
      • Working towards Standardization of Online Content Usage Counting
      • Accepted international (commercial Providers) Code of Conduct
      • Available for hundreds of publishers & Database providers
        • Available for most e-Journals
      • Basis for Commercial Discussions with Publishers and Hosts
        • External: With providers
        • Internal: With faculty
      • Limits
      • Commercial Content only
        • OpenAccess, PubMed, Google Scholar missing
      • Expertise & work needed to handle the hundreds and thousands of spreadsheets
      • Needs Tools to handle Data
        • XML-Harvester (SUSHI)
        • Warehouse: ScholarlyStats
      • Standardization Problems
        • No ISO Standard !
      • Focus on Publishers Content, not Library e-Services
      • Can you trust your Providers ?
    30. Standardzed Library Services (e.g. OpenURL)
      • Generation: Static Links (1992+)
      INTERNET Sources Targets Statischer Link: URL
    31. 2. Generation: Persist. Identifier Links INTERNET BIBLIOTHEK Sources Targets Datenbases of Links CrossRef DOI Too dynamic, Too much work For Library
    32. 3. Generation: Context sensitive Links OpenURL Resolver INTERNET Virtual Library Sources Targets OpenURL-Resolver LinkServer Service Menu Link to fulltext Document Delivery Interlibrary Loan OPAC Entry Store in PBS Lookup in WoS … CATALOG INDEX BOOK JOURNAL
    33. Linking with OpenURL Resolver Principle & URL-Syntax http://sfx.aaa.edu/menu? genre=article&issn=1234-5678 &volume=12&issue=3&spage=1&epage=8&date=1998 &aulast=Smith&aufirst=Paul
    34. Commercial Introduction of LinkResolvers (2000-2004)
    35. OpenURL Dynamically Links to the „Appropriate Copies“
    36. OpenURL Statistics available ad hoc with Breakdowns - SFX Admin Center
      • Ermittlung der Link-Nutzung in der Datenbank CAPlus für Feb.-Apr. 06
      • zusammengefaßt monatlich
      • Eingeschränkt nur auf die Gruppe der (echten) universitären Nutzer
      • Ausgabe differenziert nach Dokumentenzahl zu denen elektronischer Volltext geboten werden konnte (incl. Nationallizenzen) versus kein elektronischer Volltext (nur andere SFX-Dienste der Bibliothek)
      • Anmerkung: Dieser Statistik-Typ erlaubt das einfache Abschätzen und Monitoring von Volltext-Abdeckungsgraden für verschiedene Datenbanken, Fachbereiche oder Anwenderungruppen.
    37. OpenURL Statistics Benefits & Limits
      • Benefits
      • Global ISO Standard
      • Counts fully comparable
      • Very wide scope of service
      • Built-In Report Generators
        • Easy, fast, flexible, reliable
      • distinguishes licensing types (local, consortial, national, free)
      • Multiple Facets breakdown possible
        • Sources, Targets, Services …
        • Variable Periods
        • Sub-Groups of Users (IP-based or other)
      • Service and Context focussed (not just content)
      • Limits
      • Not all libraries have OpenURL resolver yet (about 95 % of University Libraries do)
      • Not official DBS-parameter (yet?)
      • Extra Cost of OpenRUL Resolver Service
      • Not all Links go through OpenURL (same applies for other link types)
      • Some sources do not send source-ID -> remain unidentified
    38. Working more with Usage Figures Case Studies
    39. LibMeter Case _ Study #1
      • Basics of Electronic Use
      • BIX „Virtual Use“
      • @ ULBD Uni Düsseldorf
      Data: Personal Communication May 2009, Courtesy of Dr. Kreische, ULBD Düsseldorf See separate Slide show
    40. Selected Readings to broaden and to deepen your Understanding
        • BIX - Der Bibliotheksindex 2008. B.I.T.online Sonderheft. 2008 Juni ;1-56.   
        • Blecic DD, Fiscella JB, Wiberley Jr SE . Measurement of Use of Electronic Resources: Advances in Use Statistics and Innovations in Resource Functionality. College and Research Libraries. 2007 ;68(1):26-44.   
        • Ceynowa VK, Coners A . Balanced Scorecard für wissensch. Bibliotheken. Vittorio Klostermann; 2002.   
        • Gallagher J, Bauer K, Dollar DM . Evidence-based librarianship: Utilizing data from all available sources to make judicious print cancellation decisions. Lib. Collections, Acq. & Tech. Serv.. 2005 ;29(2):169-179.   
        • George Boston, Whang M . E-Resources Usage Data: Apples to Oranges and Fixing Holes   [Internet]. Atlanta: 2008. [zitiert 2009 Apr 22]
          • Available_from:http://209.85.129.132/search?q=cache:mj5wfYDT2BoJ:https://smartech.gatech.edu/bitstream/1853/20874/13/Boston_Whang_ERL_final.ppt+scholarly-stats+sfx&cd=4&hl=de&ct=clnk&gl=de&client=firefox-a 
        • Hutzler E . Bibliotheken gestalten Zukunft : Kooperative Wege zur digitalen Bibliothek. Dr. Friedrich Geißelmann zum 65. Geburtstag. Universitätsverlag Göttingen; 2008.   
        • Kreische J . Die Messung von Vernetzung. Nutzungsstatistiken mit SFX [Internet]. Münster: 2006.
          • Available from: http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=9728  7.
        • Kreische J . Zwischen Ranking und Qualitätsmanagement: BIX WB [Internet]. Mannheim: 2008.
          • Available from: http://www.opus-bayern.de/bib-info/volltexte/2008/583/pdf/BIX%20Mannheim%20(Word%202003).pdf
        • Poll R, te Boekhorst P , Measuring quality, Saur, München, 2007.  
        • Lossau N . digital services in academic libraries. In: Digital Convergence - Libraries of the Future: Libraries of the Future‎. Springer; 2008.   
        • Shepherd P . The feasibility of developing and implementing journal usage factors: a research project sponsored by UKSG. Serials. 2007;20(2):117-123.
    41. Special Thanks for critical & constructive discussions to:
        • Joachim KREISCHE, ULB Düsseldorf
        • Simone FÜHLES-UBACH, FH Köln
        • Eric MULDER, Den Haag
        • Marion MÜLLER , ULB Düsseldorf
        • Jessica BUSCHMANN, Dortmund
        • Nol VERHAGEN, UvA, Amsterdam
        • Sylvia THIELE , UB Dortmund
        • Britta RIEBSCHLÄGER , ULB Düsseldorf
        • Peter KOSTÄDT, UB Köln
    42. About me – Key Fields of Interests Libraries Early 1970s – Founding highschool library Early 1980s - Converting Card Catalog to electronic (Mainframe & punchcards) Late 1980s creating bibliographic database for 5.000+ article reprints (Mac) Since 1990 consulting scholarly libraries on retrieval systems, End user friendyness Hospital Libraries Life Sciences & Statistics Ph.D. thesis on pattern recognition in brain Several peer-reviewed publicatios Presentations
      • Publishing & Software
      • Editing & Managing highschool journal for 5 years
      • Heading Cycling Campaign Newsletter for 3 years
      • Knowledge Finder – Biomedical Search Engine
      • Distribution & Localization for Europe
      • 12 years e- Ressources
      • Elsevier / Kluver / Ex Libris
      • Science Direct,Embase.com, Ovid, SFX, MetaLib
      • Knowledge Management
      • 1990s Scientific Knowledge Management Software
      • Development & Distribution
      • Late 1990s e-library transformation
      • consulting, Projects, trainings
      • Mid 2000s Library e-services
      • Development of Cooperative strategies
      • Market Analysis & Business Planning
      Information Technology in the Sciences Late 1970s first own programming on handheld computers, then Mainframes, then Apple II, then Mac Late 1980s German Academic Software Price for co-developping a relational bibliographicpProgram - PARiS 1990s Fuzzy logic, natural language & relevance ranked output retrieval Late 1990s – Online e-Journal and integrated search platforms Mid 2000s – OpenURL, Context sensitive linking, Metasearch, ERM, Recommenders, Library 2.0
    43. LibMeter Seminar
      • This LibMeter Introduction Seminar
      • is a continuation from the following
      • Slideshare Presentation:
      • Current Practice – Basics
      • It also relates to:
      • LibMeter Case Study #1
      • (University of Düsseldorf)
      x
    44. LibMeter Seminar
      • Personal Announcement:
      • It is intended to continue this series slowly
      • with further modules amongst others on:
      • Detecting, following and predicting Usage-Trends
      • Measuring Impact of e-Service Marketing Events
      • International Library Comparisons
      • Comparing Academic & Library Excellence
      x
    45. LibMeter Seminar
      • The End !
      • Thank You
      • Peter Ahrens
      • libmeter-at-gmail.com
      x

    + LibMeterLibMeter, 6 months ago

    custom

    767 views, 0 favs, 0 embeds more stats

    This session on electronic usage analysis was held more

    More info about this document

    © All Rights Reserved

    Go to text version

    • Total Views 767
      • 767 on SlideShare
      • 0 from embeds
    • Comments 0
    • Favorites 0
    • Downloads 5
    Most viewed embeds

    more

    All embeds

    less

    Flagged as inappropriate Flag as inappropriate
    Flag as inappropriate

    Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

    Cancel
    File a copyright complaint
    Having problems? Go to our helpdesk?

    Categories