LibMeter Seminar Introduction Basics

956 views

Published on

This session on electronic usage analysis was held as part of a seminar about library evaluation for 3rd year librarian students at the Cologne University of Applied Science (FH Köln), Germany on May 7th 2009

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
956
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
25
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • LibMeter Seminar Introduction Basics

    1. 1. Striving for Excellence with Electronic Library Statistics Indicators for Performance Evaluation Introduction - Basics Institut für Informationswissenschaft, University of Applied Sciences, Cologne (FH-Köln IIW) Seminar on Library Evaluation (S. FÜHLES-UBACH) Peter Ahrens Guest Lecture V 1.00a – 2009-05-18 Cologne, 7th May 2009
    2. 2. LibMeter Seminar <ul><li>The LibMeter Introduction Seminar </li></ul><ul><li>is continued with the following </li></ul><ul><li>Slideshare Presentations: </li></ul><ul><li>Current Practice eUsage Reporting </li></ul><ul><li>It also relates to: </li></ul><ul><li>LibMeter Case Study #1 </li></ul><ul><li>(University of Düsseldorf) </li></ul>x
    3. 3. Roadmap of this Presentation Introduction - Basics <ul><li>I. Introduction - Basics </li></ul><ul><ul><li>A Quick Futuristic Web Tour </li></ul></ul><ul><ul><li>Usage Stats for the Rest of Us (No Maths please!) </li></ul></ul><ul><ul><li>Library Role, Services & Usage </li></ul></ul><ul><li>II. Introduction – Current Practise </li></ul><ul><ul><li>Where to get Usage Figures from ? </li></ul></ul><ul><ul><li>How to interpret usage Figures ? </li></ul></ul><ul><ul><li>LibMeter Case Studies </li></ul></ul><ul><li>III. Perspectives </li></ul>
    4. 4. Roadmap of this Presentation LibMeter Introduction Basics <ul><li>I. Introduction </li></ul><ul><ul><li>A Quick Futuristic Web Tour </li></ul></ul><ul><ul><li>Usage Stats for the Rest of Us (No Maths please!) </li></ul></ul><ul><ul><li>Library Role, Services & Usage </li></ul></ul><ul><li>II. Practise </li></ul><ul><ul><li>Where to get Usage Figures from ? </li></ul></ul><ul><ul><li>How to interpret usage Figures ? </li></ul></ul><ul><ul><li>LibMeter Case Studies </li></ul></ul><ul><li>III. Perspectives </li></ul>
    5. 5. LibMeter Seminar <ul><li>Introduction </li></ul>x
    6. 6. Questions to Start Are you familiar with ? <ul><li>EZB </li></ul><ul><li>DBIS </li></ul><ul><li>DBS </li></ul><ul><li>BIX </li></ul><ul><li>DOI/CrossRef </li></ul><ul><li>COUNTER </li></ul><ul><li>OpenURL </li></ul>
    7. 7. New Kind of Science & Library Stats on Web 2.0
    8. 8. Example for Webometrics: Ranking of World Universities http://www.webometrics.info/top100_continent.asp?cont=europe [2009-04-25]
    9. 9. What „Google Insight“ can tell about German Libraries and Archives ? (I) http://www.google.com/insights/search/# q=Anna%20amalia&cmpt=q [2009-05-18]
    10. 10. What „Google Insight“ tells about German Libraries and Archives II http://www.google.com/insights/search/#q=anna%20amalia%2Cstadtarchiv%20k%C3%B6ln&cmpt=q (2009-04-24)
    11. 11. Usage Stats Theory Part I For the Rest of Us (No Maths please!)
    12. 12. Basic Terms I <ul><li>Log </li></ul><ul><ul><li>Record of Events </li></ul></ul><ul><li>Count = Value = Figure </li></ul><ul><ul><li>Numerical Quantity Data </li></ul></ul><ul><li>Parameter </li></ul><ul><ul><li>Variable (numerical) value; Here: Output ! </li></ul></ul><ul><li>Indicator </li></ul><ul><ul><li>Something giving information </li></ul></ul><ul><li>Statistics = „Stats“ </li></ul><ul><ul><li>Collection of numerical data </li></ul></ul><ul><ul><li>Analysis and Interpretation of Statistical Data </li></ul></ul>
    13. 13. Basic Terms II <ul><li>Logging </li></ul><ul><ul><li>Storing and preserving a File-record with detailed technical Information about all occuring service events (Web) </li></ul></ul><ul><li>Usage (figures or statistics) </li></ul><ul><ul><li>Quantitative parameters/values derived from filtering and processing Log-Files (aggregating, relating, normalizing) </li></ul></ul><ul><ul><li>Usage monitoring = analysing (web) usage figures over time (longitudinal) or between services (transversal) </li></ul></ul><ul><li>Usability </li></ul><ul><ul><li>Degree of suitability of (web) service for purpose </li></ul></ul>
    14. 14. Basic Terms III <ul><li>Performance </li></ul><ul><ul><li>Degree of Effectiveness (e.g. of work or a service) </li></ul></ul><ul><li>Ranking </li></ul><ul><ul><li>Position in Relation to others </li></ul></ul><ul><ul><li>Working out Ranking Order </li></ul></ul><ul><li>Rating </li></ul><ul><ul><li>classification of something on a scale according to how much or how little of a quality it possesses </li></ul></ul><ul><li>Benchmarking </li></ul><ul><ul><li>Comparing against a standard against which something can be measured </li></ul></ul>
    15. 15. Reporting Frequencies & Effect on Potential Uses and Users <ul><li>It takes Time for Results </li></ul><ul><li>2 periods for first value </li></ul><ul><li>3 periods for first pair </li></ul><ul><li>4 periods for confirmed trend </li></ul><ul><li>5 periods for change in trend </li></ul><ul><li>Annual Reporting </li></ul><ul><li>Good picture after 5 yrs </li></ul><ul><li>Longterm Dev. & Strategy </li></ul><ul><li>Monthly reporting </li></ul><ul><li>Picture after a quarter </li></ul><ul><li>Planning on Department or workgroup level </li></ul><ul><li>Daily reporting </li></ul><ul><li>Picture after a week </li></ul><ul><li>Individual actions </li></ul>
    16. 16. Usage Stats Theory Part II Analysis & Interpretation (Sorry some Maths required!)
    17. 17. Digesting Usage Figures - I Determining Relevant Derivatives <ul><li>Help! Too many too confusing too large numbers ... </li></ul><ul><li>Various Aspects of „Usage“ </li></ul><ul><ul><li>Baseline Figures </li></ul></ul><ul><ul><ul><li>Normalized and Standardized Figures </li></ul></ul></ul><ul><ul><ul><li>Change-Rates </li></ul></ul></ul><ul><ul><ul><li>Previous Periods </li></ul></ul></ul><ul><ul><li>(+/- Comparison with other Services) </li></ul></ul><ul><ul><li>(+/- External Comparison) </li></ul></ul><ul><ul><ul><li>Ranking, Rating </li></ul></ul></ul>
    18. 18. Basic Terms IV Usage Counts and Derivatives <ul><li>Value </li></ul><ul><ul><li>Example: Downloads (D) </li></ul></ul><ul><li>Normalized Value or Ratio (per external basis) </li></ul><ul><ul><li>Example: Downloads per User (DpU) </li></ul></ul><ul><li>First Derivative (by time=rate) – per period </li></ul><ul><ul><li>Example: Downloads per User per Year (DpUpY) </li></ul></ul><ul><li>Second Derivative –> Trend </li></ul><ul><ul><li>Example: Growth/Decline=Change (CoDpUpY) </li></ul></ul><ul><li>Third Derivative - > Trend Change </li></ul><ul><ul><li>Example: Acceleation/Slowdown (CoCoDpUpY) </li></ul></ul>
    19. 19. Product Introduction Phases My Own Idealized Schema <ul><li>Phase I – Breakout </li></ul><ul><li>Accelleration from zero base </li></ul><ul><li>Pattern A/B/C 0>+ / 0>++ / 0>+++ </li></ul><ul><li>Low counts, quickly rising growth rate, very positive trend </li></ul><ul><li>Timeline: 0 - 33 % </li></ul><ul><li>Phase II – Growth (exponent.) </li></ul><ul><li>+>+++ / ++>+++>++ / +++>0> --- </li></ul><ul><li>Timeline: 34 – 66 % </li></ul><ul><li>Phase III – Maturation </li></ul><ul><li>Slowing Growth, to Plateau </li></ul><ul><li>+++ / ++>0 / - >0 </li></ul><ul><li>Timeline: 67 – 100 % </li></ul>I II III
    20. 20. From Library Service Introduction to Product Life Cycle Approach <ul><li>Consider </li></ul><ul><li>a Library Service a Standard Product </li></ul><ul><li>Apply </li></ul><ul><li>Theories from Econometrics to „Webometrics“ </li></ul><ul><li>See </li></ul><ul><li>Overlaps </li></ul><ul><li>Substitution Cycles </li></ul>
    21. 21. Questions asked: How is the Library doing with eServices? <ul><li>How high is a specific usage ? </li></ul><ul><ul><li>Absolute / standardized / ranked / rated </li></ul></ul><ul><li>Where is Library/are Users heading ? </li></ul><ul><ul><li>Externally: Ranking compared </li></ul></ul><ul><ul><ul><li>to Peer-Institutions </li></ul></ul></ul><ul><ul><ul><li>Other Countries </li></ul></ul></ul><ul><ul><li>Internally </li></ul></ul><ul><ul><ul><li>Count development: Growth/Decline </li></ul></ul></ul><ul><ul><ul><li>Increased Speed or Slowdown </li></ul></ul></ul><ul><ul><ul><li>Reversal of current Trend </li></ul></ul></ul><ul><ul><ul><li>Comparison with potential alternative/competing Services </li></ul></ul></ul>
    22. 22. Which Library Decicisons are supported by Usage Figures ? <ul><li>CONTENT </li></ul><ul><li>Acquisitions / Subscriptions </li></ul><ul><ul><li>Renewals </li></ul></ul><ul><ul><li>Cancelations </li></ul></ul><ul><ul><li>Newly identified content </li></ul></ul><ul><li>SERVICES </li></ul><ul><li>Web Customer Communication </li></ul><ul><li>Web Services, Interfaces & Features </li></ul><ul><li>Computer System Investments </li></ul><ul><li>Human Resource Allocation </li></ul>
    23. 23. LibMeter Seminar <ul><li>Current Practise </li></ul><ul><li>eUsage Reporting </li></ul>x
    24. 24. (Electronic) Library Role, Services & Usage
    25. 25. How Needs, Services, Usage & Community Value are related ? C O M M U N I T Y with N E E D S E R V I C E S C O P E U T I L I T Y USABILITY ACCESSIBILITY VISIBILITY AWARENESS USAGE ( = ACCEPTANCE) VALUE
    26. 26. New Thinking required for Virtual Library Services World
    27. 27. Who is your Customer ? Many ways to count Users <ul><li>Multiple Definitions for User Base </li></ul><ul><ul><li>Affiliated Users </li></ul></ul><ul><ul><ul><li>Primary users (Students, Staff) </li></ul></ul></ul><ul><ul><ul><li>Guests (registered and others) </li></ul></ul></ul><ul><ul><ul><li>Special User Groups (faculties, institutes etc.) </li></ul></ul></ul><ul><ul><li>Active Users </li></ul></ul><ul><ul><ul><li>Recurring Users (e.g. last 12 months) </li></ul></ul></ul><ul><ul><ul><li>Power Users (frequent uses) </li></ul></ul></ul><ul><li>Identification methods </li></ul><ul><ul><li>Individual Registration (OPAC for Borrowing, ILL, Copies) </li></ul></ul><ul><ul><li>IP-based Log-In (+/- Proxy; -> Institutional IP-Domains) </li></ul></ul><ul><ul><li>Other Authentication via single-sign-on, SHIBBOLETH </li></ul></ul>
    28. 28. Selected Readings to broaden and to deepen your Understanding <ul><ul><li>BIX - Der Bibliotheksindex 2008. B.I.T.online Sonderheft. 2008 Juni ;1-56.    </li></ul></ul><ul><ul><li>Blecic DD, Fiscella JB, Wiberley Jr SE . Measurement of Use of Electronic Resources: Advances in Use Statistics and Innovations in Resource Functionality. College and Research Libraries. 2007 ;68(1):26-44.    </li></ul></ul><ul><ul><li>Ceynowa VK, Coners A . Balanced Scorecard für wissensch. Bibliotheken. Vittorio Klostermann; 2002.    </li></ul></ul><ul><ul><li>Gallagher J, Bauer K, Dollar DM . Evidence-based librarianship: Utilizing data from all available sources to make judicious print cancellation decisions. Lib. Collections, Acq. & Tech. Serv.. 2005 ;29(2):169-179.    </li></ul></ul><ul><ul><li>George Boston, Whang M . E-Resources Usage Data: Apples to Oranges and Fixing Holes   [Internet]. Atlanta: 2008. [zitiert 2009 Apr 22] </li></ul></ul><ul><ul><ul><li>Available_from:http://209.85.129.132/search?q=cache:mj5wfYDT2BoJ:https://smartech.gatech.edu/bitstream/1853/20874/13/Boston_Whang_ERL_final.ppt+scholarly-stats+sfx&cd=4&hl=de&ct=clnk&gl=de&client=firefox-a  </li></ul></ul></ul><ul><ul><li>Hutzler E . Bibliotheken gestalten Zukunft : Kooperative Wege zur digitalen Bibliothek. Dr. Friedrich Geißelmann zum 65. Geburtstag. Universitätsverlag Göttingen; 2008.    </li></ul></ul><ul><ul><li>Kreische J . Die Messung von Vernetzung. Nutzungsstatistiken mit SFX [Internet]. Münster: 2006. </li></ul></ul><ul><ul><ul><li>Available from: http://docserv.uni-duesseldorf.de/servlets/DocumentServlet?id=9728  7. </li></ul></ul></ul><ul><ul><li>Kreische J . Zwischen Ranking und Qualitätsmanagement: BIX WB [Internet]. Mannheim: 2008. </li></ul></ul><ul><ul><ul><li>Available from: http://www.opus-bayern.de/bib-info/volltexte/2008/583/pdf/BIX%20Mannheim%20(Word%202003).pdf </li></ul></ul></ul><ul><ul><li>Poll R, te Boekhorst P , Measuring quality, Saur, München, 2007.   </li></ul></ul><ul><ul><li>Lossau N . digital services in academic libraries. In: Digital Convergence - Libraries of the Future: Libraries of the Future‎. Springer; 2008.    </li></ul></ul><ul><ul><li>Shepherd P . The feasibility of developing and implementing journal usage factors: a research project sponsored by UKSG. Serials. 2007;20(2):117-123. </li></ul></ul>
    29. 29. Special Thanks for critical & constructive discussions to: <ul><ul><li>Joachim KREISCHE, ULB Düsseldorf </li></ul></ul><ul><ul><li>Simone FÜHLES-UBACH, FH Köln </li></ul></ul><ul><ul><li>Eric MULDER, Den Haag </li></ul></ul><ul><ul><li>Marion MÜLLER , ULB Düsseldorf </li></ul></ul><ul><ul><li>Jessica BUSCHMANN, Dortmund </li></ul></ul><ul><ul><li>Nol VERHAGEN, UvA, Amsterdam </li></ul></ul><ul><ul><li>Sylvia THIELE , UB Dortmund </li></ul></ul><ul><ul><li>Britta RIEBSCHLÄGER , ULB Düsseldorf </li></ul></ul><ul><ul><li>Peter KOSTÄDT, UB Köln </li></ul></ul>
    30. 30. About me – Key Fields of Interests Libraries Early 1970s – Founding highschool library Early 1980s - Converting Card Catalog to electronic (Mainframe & punchcards) Late 1980s creating bibliographic database for 5.000+ article reprints (Mac) Since 1990 consulting scholarly libraries on retrieval systems, End user friendyness Hospital Libraries Life Sciences & Statistics Ph.D. thesis on pattern recognition in brain Several peer-reviewed publicatios Presentations <ul><li>Publishing & Software </li></ul><ul><li>Editing & Managing highschool journal for 5 years </li></ul><ul><li>Heading Cycling Campaign Newsletter for 3 years </li></ul><ul><li>Knowledge Finder – Biomedical Search Engine </li></ul><ul><li>Distribution & Localization for Europe </li></ul><ul><li>12 years e- Ressources </li></ul><ul><li>Elsevier / Kluver / Ex Libris </li></ul><ul><li>Science Direct,Embase.com, Ovid, SFX, MetaLib </li></ul><ul><li>Knowledge Management </li></ul><ul><li>1990s Scientific Knowledge Management Software </li></ul><ul><li>Development & Distribution </li></ul><ul><li>Late 1990s e-library transformation </li></ul><ul><li>consulting, Projects, trainings </li></ul><ul><li>Mid 2000s Library e-services </li></ul><ul><li>Development of Cooperative strategies </li></ul><ul><li>Market Analysis & Business Planning </li></ul>Information Technology in the Sciences Late 1970s first own programming on handheld computers, then Mainframes, then Apple II, then Mac Late 1980s German Academic Software Price for co-developping a relational bibliographicpProgram - PARiS 1990s Fuzzy logic, natural language & relevance ranked output retrieval Late 1990s – Online e-Journal and integrated search platforms Mid 2000s – OpenURL, Context sensitive linking, Metasearch, ERM, Recommenders, Library 2.0
    31. 31. LibMeter Seminar <ul><li>The LibMeter Introduction Seminar </li></ul><ul><li>is continued with the following </li></ul><ul><li>Slideshare Presentations: </li></ul><ul><li>Current Practice eUsage Reporting </li></ul><ul><li>It also relates to: </li></ul><ul><li>LibMeter Case Study #1 </li></ul><ul><li>(University of Düsseldorf) </li></ul>x
    32. 32. LibMeter Seminar <ul><li>Personal Announcement: </li></ul><ul><li>It is intended to continue this series slowly </li></ul><ul><li>with further modules amongst others on: </li></ul><ul><li>Detecting, following and predicting Usage-Trends </li></ul><ul><li>Measuring Impact of e-Service Marketing Events </li></ul><ul><li>International Library Comparisons </li></ul><ul><li>Comparing Academic & Library Excellence </li></ul>x
    33. 33. LibMeter Seminar <ul><li>The End ! </li></ul><ul><li>Thank You </li></ul><ul><li>Peter Ahrens </li></ul><ul><li>libmeter-at-gmail.com </li></ul>x

    ×