• Like
Basics Terminology Nat Lib Stats Lib Meter Zbw Hh Workshop
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Basics Terminology Nat Lib Stats Lib Meter Zbw Hh Workshop

  • 746 views
Published

Part 1-2 of 5; Beta Version 0.8 of Transparencies …

Part 1-2 of 5; Beta Version 0.8 of Transparencies
about Management Workshop on Usage analysis of electronic library services
At ZBW-Hamburg 2009-11-06
(C) LibMeter , 2009, Peter Ahrens
all rights reserved

Published in Technology , Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
746
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
8
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics Further considerations: usage  perceived value  acceptance  Influence  User‘s Mind Space  mind share
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-13_Snippets
  • 2009-05-13_Snippets
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-11-06_new Need_retouch – Give examples for EZB 2008
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-19_Current_Practice
  • 2009-05-19_Current_Practice
  • 2009-05-19_Current_Practice
  • 2009-05-19_Current_Practice
  • 2009-05-19_Current_Practice
  • 2009-05-19_Current_Practice BIX 2008 takes DBS 2007 figures
  • 2009-05-19_Current_Practice
  • 2009-05-18_Basics
  • 2009-10-16 modify 2009-05-19_Current_Practice
  • 2009-05-18_Basics
  • 2009-05-18_Basics
  • 2009-05-18_Basics

Transcript

  • 1. LibMeter - Library eMetrics Basics & Terminology Workshop ZBW-HH Part 1-2 Nutzungsanalyse elektronischer Informationsdienstleistungen für das praktische Bibliotheks-Management Veranstalter: Berufsverband Information Bibliothek e. V. (BIB) Landesgruppe Hamburg 6. November 2009 Referent: Dr. Peter Ahrens Freier Referent Assistenz: Tanja Haberkorn Beta 0.8 2009-11-01
  • 2. Nutzungsanalyse elektronischer Informationsdienstleistungen für das praktische Bibliotheks-Management Grundlagen Standortbestimmung & Perspektiven
    • Vorstellung Programm Überblick
    • 1. Grundlagen und Begriffe
    • 2. DBS & BIX Vorstelllung
    • praktischer Teil – BIX Übungen
    • 3. Nationale eUsage Jahres-Statistiken
    • 4. COUNTER, OpenURL & u.a. Monatsstatistiken
    • 5.Alternativ-Blöcke
    • 6. Diskussion & Feedback
  • 3. LibMeter Seminar
    • 1. Intro
    x
  • 4. LibMeter Seminar
    • Introduction
    x
  • 5. Questions to Start Are you familiar with ?
    • EZB / DBIS
    • DBS / BIX
    • Indikatoren-Raster
    • COUNTER / Sushi
    • OpenURL / SFX
    • OPAC 2.0 Funktionen
    • Web Analytics
  • 6. How Needs, Services, Usage & Community Value are related ? C O M M U N I T Y with N E E D S E R V I C E S S C O P E U T I L I T Y USABILITY ACCESSIBILITY VISIBILITY AWARENESS USAGE ( = ACCEPTANCE) VALUE - Performance
  • 7. What Performance Indicators to measure ?
    • Input
      • Resourcen: Finanzen, Räume, Personal, Bestände, PCs
    • Output
      • Bestände, Angebote
      • Besuche, Ausleihen, konv. Nutzung & elektron.
    • Outcome / Impact - Wirksamkeit
      • Z.B. Informationskompetenz, Wissen
      • Z.B. Fähigkeiten / Verhaltensänderungen
  • 8. How to collect data about Libary‘s eService Usage with eMetrics?
    • 4 Dimensions of Assessment
    • Census counts (full):
      • externally generated, Vendor usage data (eg COUNTER)
      • Locally/internally generated usage data, (eg OpenURL)
    • Sample counts (random or non-random):
      • externally generated, web survey data
      • Internally generated, web survey/usage data
  • 9. eMetrics and broader context of Library assessment not covered
    • Integrated Assessment Instruments
      • LibQual / ServQual
        • Measure users expectations and subjective fullfillment of Library Services
    • ISO 2789 und ISO 11620
    • Management Approaches
      • Balanced Scorecard
      • Library Controlling Cycles
  • 10. How to look at any Statistic ?
    • Motivation (Why)
    • Methods / Tools / Technologies (How)
    • Limitations (Scope, Issues, Problems)
    • Observations (Figures / Results)
    • Interpretation (Changes, Trends, Pittfalls)
    • Consequences (Decisions, Actions)
    • And remember: Don‘t trust any statistic you did not fake yourself !
  • 11. Questions asked: How are we doing ?
    • How high is a specific usage ? (absolute/normalized)
    • How does this compare to peer-institutions?
    • How does this compare to other services?
    • What is the trend ?
      • Growth/Decline
      • Acceleration, Slowdown
      • Life-Cycle Phase
  • 12. Usage „Stats“ Terms & Difinitions
  • 13. Basic Terms I
    • Log (item)
      • Record of Events
    • Count = Value = Figure = Measure = Parameter
      • Numerical Quantity Data
      • Variable (numerical) value; Here: Output Parameter!
    • Indicator
      • Something giving information, indicating something
    • Statistics = „Stats“
      • Collection of numerical data
      • Analysis and Interpretation of Statistical Data
  • 14. Basic Terms II
    • Logging
      • Storing and preserving a File-record with detailed technical Information about all occuring service events (Web)
    • Usage (figures or statistics)
      • Quantitative parameters/values derived from filtering and processing Log-Files (aggregating, relating, normalizing)
      • Usage monitoring = analysing (web) usage figures over time (longitudinal) or between services (transversal)
    • Usability
      • Degree of suitability of (web) service for purpose
  • 15. Basic Terms III
    • Performance
      • Degree of Effectiveness (e.g. of work or a service)
    • Ranking
      • Position in Relation to others / Working out Ranking Order
    • Rating
      • classification of something on a scale according to how much or how little of a quality it possesses
    • Benchmarking
      • Comparing against a standard against which something can be measured
    • Best Practice
  • 16. Basic Terms IV Descriptive Statistics
    • Minimum / Maximum
      • Smallest value / Highest value
    • Average (Artihmetic Mean)
      • Sum of all values divided by total number
    • Median
      • Value in the middle of the range
    • Standard Deviation (Measure for average Distance)
    • Variation Coefficient (Measure for Width of Distribution)
    • Quantil, Percentil, Quartil … (->Indikatoren-Raster)
    • (Skewness, Kurtosis …)
  • 17. Basic Terms V Usage Counts and Derivatives
    • Value
      • Example: Downloads (D)
    • Normalized Value or Ratio (per external basis)
      • Example: Downloads per User (DpU)
    • First Derivative (by time=rate) – per period
      • Example: Downloads per User per Year (DpUpY)
    • Second Derivative –> Change Rate
      • Example: Growth/Decline=Change (CoDpUpY)
    • Third Derivative - > Trend
      • Example: Acceleation/Slowdown (CoCoDpUpY)
  • 18. Reporting Frequencies & Effect on Potential Uses and Users
    • It takes Time for Results
    • 2 periods for first value
    • 3 periods for first pair
    • 4 periods for confirmed trend
    • 5 periods for change in trend
    • Annual Reporting
    • Good picture after 5 yrs
    • Longterm Dev. & Strategy
    • Monthly reporting
    • Picture after a quarter
    • Planning on Department or workgroup level
    • Daily reporting
    • Picture after a week
    • Individual actions
  • 19. LibMeter Seminar
    • 2. NatLibStats
    x
  • 20. Comparing Usage at different Types of Institutions
  • 21. 2007 EZB Usage per Primary User at Universities versus Polytechs
    • EZB Statistics
      • Universities (n=57)
        • Median = 6,2
        • Mean / Average = 6.9
        • Standard Deviation = 5.6
        • Variation Coefficient = 0.8
      • Polytechs (n=34)
        • Median = 0,42 (sic!)
        • Mean / Average = 2.0
        • Standard Deviation = 6.1
        • Variation Coefficient =3.0
      • Düsseldorf:
        • Mean / Average 7.0
        • = 0.13 Std. Dev. above Mean
    While you may calculate Mean and St. Dev. for a population, make sure it is normally distributed before drawing further conclusions (check Median) !
  • 22. Looking annually at 1 Parameter (EZB) at 1 time (DBS 2007) for many libraries
  • 23. Comparing EZB Use among University Libraries in 2007 Compiled from DBS VA: http://www.bibliotheksstatistik.de/eingabe/dynrep/index.php [2009-04-15] EZB (B+C only) call as per DBS 2007 Standardized per Primary User per Year
  • 24. Sample University Library Profile (DBS) Basics on Library-“Size“, -Input & Output
    • Actions
      • Raw Numbers
        • Often very high values
        • Go beyond imagination
      • Work Basis: User Numbers
        • Different Types
        • Can be combined to Primary User Number
      • Standardization
        • Key Step: Calculation of „ Value per User per Year “ = Normalization
    • Benefits
      • Numbers become imaginable
      • Numbers can be memorized
      • Numbers become comparable
    Data downloaded from www.bibliotheksstatistik.de into PC-Spreadsheet Program, [2009-05-03]
  • 25. BIX Performance-Indicator „Virtual Library Use“
    • New (per 2008*) in German Library Performance Index „BIX“
    • Normalized Combined Parameter: „Virtual Annual Use“
    • Definition: (OPAC & Homepage) / Number of Primary Users
    • Simple Interpretation
  • 26. How SMART is „Virtual Use“ ?
    • S pecific :
    • Quite general
    • M easurable :
    • YES Community Standard with help of HDM Zählpixel
    • A chievable and Attributable :
    • Library is actively producing Service
    • Today every library can produce #
    • R elevant and Realistic :
    • YES Users frequently go there
    • Closely tied to core services
    • How representative for total spectrum of electronic Library Services ?
    • T ime-bound, Timely, Trackable, and Targeted :
    • No log-files publicly available (yet?)
    • Not available for all periods
  • 27. Go to Screens List
      • Slides on
      • DBS, BibS,BIX & ARL
      • (Start Present_26 Slide 07)
  • 28. German Library Statistics 10 Year Overview Price Index DE Education 1999 to 2008 > + 50 % 2008 1999
  • 29. DBS Variable Analysis Selection Criteria
    • Coverage:
      • Total libraries ca. 14.000; scientific 350)
      • 1999 onwards
      • Up to 300 – 400 measures/parameters per institution
    • Selection criteria for „Variable Statistische Auswertung“
    • Class - Questionnaire (Public, Scientific, Special …)
    • Countries
    • Years
    • Measures / Parameters
    • Libraries
      • Type of Institution
      • Ownership (public – private etc)
      • Size Class of Collection
      • Region
      • Library System levels (1 or 2)
  • 30. „ DBS Variable Analysis“ (Display!) Selection Dialogue
  • 31. DBS Variable Analysis Result Table
  • 32. DBS – Indikatorenraster Benchmark for Public Libraries
    • Logical Framework
      • Public Libraries Only
      • 1 of 5 Community Size Classes
      • 2007 (only as per 2009-10-10)
    • Data Shown
      • 21 Indicators calculated from Primary Measures
      • Grouped in 4 Dimensions
      • Minimum, Median, Maximum
      • 6 Percentile Ranges
      • Positioning „own“ Library
  • 33. DBS – Public Libraries Indicatorgrid „Indikatorenraster“
  • 34. German Library Statistics 2009 New Online Exploration Tool - BibS
  • 35. Basic interactive Comparrison in Time Series
  • 36. BIX - 1-Level Univ. Libraries Ranking Result Table in Print 2006
  • 37. (Germany+) BIX Library Statistics Index - Overview
  • 38. (Germany+) BIX Library Statistics Index - Measures
  • 39. (Germany+) BIX Measures over Years
  • 40. (Germany+) BIX Compare & Show „Usage“
  • 41. American Association of Research Libraries (ARL) – Interactive Statistics
  • 42. ARL – Interactive Statistics Dynamic Ratio Calculator
  • 43. ARL – Interactive Statistics Example: Serials $ per Student
  • 44. ARL – Interactive Statistics Example: Library Service Hours
  • 45. ARL – Interactive Statistics Service Hours over time @ 9 Inst. ARL – Interactive Statistics Example: Library Service Hours
  • 46. Consortial Statistics Sites
    • HeBIS – Statistikserver
      • Z.B. COUNTER Hebis Verbund
      • Nationallizenzen
    • Z.B. Hbz
    • Z.B. GBV
  • 47. National Statistics (e.g. BIX/DBS) Benefits & Limits
    • Benefits
    • Broad Institutions Base
    • Fairly Comprehensive
    • Creates Awareness
      • Community
      • Public
    • Online Data Warehouse
      • Transparency
      • Allows Meta Studies
    • Limits
    • Limited Parameter Set Scope
      • i.e. more detailled services missing
    • Data completeness & quality
    • Standardization Issues
    • Time Lag, Annual Frequency
    • National Differences
    • International Comparability ?
    • Interactivity/-Download
    • Meta-Analysis Tools, Charts
  • 48. Diskussionsfragen
      • Wann erste Ergebnisse ?
      • Wie lange auf welche Aussagen warten ?
  • 49. National Library Statistics (Links to Interactive Tables)
    • ARL (Am. Assoc. Res. Libr.) Interactive Stats
    • Germany/ Austria
      • BIX Benchmarking (Academic Libraries)
      • DBS - Variable Auswertung
      • BibS - Bibliothek-Suchmaschine
    • Static Tables:
      • Netherlands UKB-NL Summary
      • Switzerland – Bundesamt für Statistik
  • 50. LibMeter Seminar
    • 2. b
    • Übungen
    x
  • 51. Go to Screens List
      • Übungen hier
  • 52. Diskussionsfragen
      • Welche Komponenten können Nationalstatistiken haben ?
      • Möglichkeiten und Grenzen ?
      • Wie SMART Virtual Use ?