Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
‘Good Enough’
Applying a Holistic Approach for Practical,
Systematic Collection Assessment
Madeline Kelly
Head, Collection...
Agenda
Collection assessment basics
Obstacles to collection assessment
Holistic or “good enough” assessment: what is it?
H...
Collection Assessment Basics
Goals of Assessment
Collection Assessment Basics
Goals of Assessment
space savings
accreditation
showing ROI
cost savings
identifying
strength...
Collection Assessment Basics
Tools & Methods
Collection Assessment Basics
Tools & Methods
list-checking
quantity
citation
analysis
user
responses
external
standards
us...
Barriers to Systematic Assessment
Barriers to Systematic Assessment
STAFF
Barriers to Systematic Assessment
STAFF TIME
Barriers to Systematic Assessment
STAFF TIME
TOOLS
Barriers to Systematic Assessment
STAFF TIME
TURNOVER TOOLS
Barriers to Systematic Assessment
STAFF TIME
TURNOVER TOOLS
SCOPE
The Holistic Approach
The Holistic Approach
Multi-tool approach
Snapshot of each subject area
Big picture perspective
The Holistic Approach
Emphasis is on usable results, not
perfect results
Multi-tool approach
Snapshot of each subject area...
Benefits of Good Enough
Flexible
Benefits of Good Enough
Flexible
Manageable
Benefits of Good Enough
Flexible
Manageable
Sustainable
Holistic Assessment @ Mason
Key aspects of our approach:
Subject-specific assessments
Tiered portfolio of tools
Consistency
Subject-Specific Approach
One subject at a time
Minimal burden on subject librarians
Opportunity to revise procedures
The Tools & Structure
The Tools & Structure
Bowker Book Analysis – Review of reputable bibliographies – OCLC
Collection Evaluation comparison to...
The Tools & Structure
Bowker Book Analysis – Review of reputable bibliographies – OCLC
Collection Evaluation comparison to...
The Tools & Structure
Bowker Book Analysis – Review of reputable bibliographies – OCLC
Collection Evaluation comparison to...
A Consistent Process
A Consistent Process
standardized
procedures, document
formatting, and file
names
A Consistent Process
standardized
procedures, document
formatting, and file
names
detailed
documentation
A Consistent Process
standardized
procedures, document
formatting, and file
names
detailed
documentation
cycle of assessme...
Results @ Mason
Results @ Mason
Seven complete, three in progress
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Acceptable pace
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Acceptable pace
Concise final reports
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Acceptable pace
Lots of usable data
Conc...
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Acceptable pace
Lots of usable data
Grad...
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Acceptable pace
Lots of usable data
Grad...
Results @ Mason
Seven complete, three in progress
Reasonable amount of staff time
Acceptable pace
Lots of usable data
Grad...
Barriers Revisited
STAFF TIME
TURNOVER TOOLS
SCOPE
Barriers Revisited
STAFF TIME
TURNOVER TOOLS
SCOPE
Requires 1 FTE
Low burden on
subject librarians
Statistical
expertise n...
Barriers Revisited
STAFF TIME
TURNOVER TOOLS
SCOPE
Requires 1 FTE
Low burden on
subject librarians
Statistical
expertise n...
Barriers Revisited
STAFF TIME
TURNOVER TOOLS
SCOPE
Requires 1 FTE
Low burden on
subject librarians
Statistical
expertise n...
Barriers Revisited
STAFF TIME
TURNOVER TOOLS
SCOPE
Requires 1 FTE
Low burden on
subject librarians
Statistical
expertise n...
Barriers Revisited
STAFF TIME
TURNOVER TOOLS
SCOPE
Requires 1 FTE
Low burden on
subject librarians
Statistical
expertise n...
Bottom Line
Bottom Line
There are still adjustments
we want to make
Bottom Line
There are still adjustments
we want to make
but the methodology
allows for that
Bottom Line
There are still adjustments
we want to make
but the methodology
allows for that
and we are getting in the
habi...
Thank you!
I’m happy to answer any
questions now or via e-mail.
I’m also happy to share portions
of our methodology, templ...
Upcoming SlideShare
Loading in …5
×

NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University

1,721 views

Published on

NISO Virtual Conference: Expanding the Assessment Toolbox: Blending the Old and New Assessment Practices

‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment
Madeline Kelly, Head of Collection Development, University Libraries, George Mason University

Published in: Education
  • Be the first to like this

NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University

  1. 1. ‘Good Enough’ Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly Head, Collection Development George Mason University Libraries
  2. 2. Agenda Collection assessment basics Obstacles to collection assessment Holistic or “good enough” assessment: what is it? Holistic assessment @ Mason Successes Questions
  3. 3. Collection Assessment Basics Goals of Assessment
  4. 4. Collection Assessment Basics Goals of Assessment space savings accreditation showing ROI cost savings identifying strengths identifying gaps
  5. 5. Collection Assessment Basics Tools & Methods
  6. 6. Collection Assessment Basics Tools & Methods list-checking quantity citation analysis user responses external standards usage analysis
  7. 7. Barriers to Systematic Assessment
  8. 8. Barriers to Systematic Assessment STAFF
  9. 9. Barriers to Systematic Assessment STAFF TIME
  10. 10. Barriers to Systematic Assessment STAFF TIME TOOLS
  11. 11. Barriers to Systematic Assessment STAFF TIME TURNOVER TOOLS
  12. 12. Barriers to Systematic Assessment STAFF TIME TURNOVER TOOLS SCOPE
  13. 13. The Holistic Approach
  14. 14. The Holistic Approach Multi-tool approach Snapshot of each subject area Big picture perspective
  15. 15. The Holistic Approach Emphasis is on usable results, not perfect results Multi-tool approach Snapshot of each subject area Big picture perspective
  16. 16. Benefits of Good Enough Flexible
  17. 17. Benefits of Good Enough Flexible Manageable
  18. 18. Benefits of Good Enough Flexible Manageable Sustainable
  19. 19. Holistic Assessment @ Mason Key aspects of our approach: Subject-specific assessments Tiered portfolio of tools Consistency
  20. 20. Subject-Specific Approach One subject at a time Minimal burden on subject librarians Opportunity to revise procedures
  21. 21. The Tools & Structure
  22. 22. The Tools & Structure Bowker Book Analysis – Review of reputable bibliographies – OCLC Collection Evaluation comparison to peers – WorldCat – HathiTrust – Outstanding Academic Titles – Review of peer databases – Modified Brief Test – Sustainable Collection Services unique titles
  23. 23. The Tools & Structure Bowker Book Analysis – Review of reputable bibliographies – OCLC Collection Evaluation comparison to peers – WorldCat – HathiTrust – Outstanding Academic Titles – Review of peer databases – Modified Brief Test – Sustainable Collection Services unique titles ILL statistics – Citation analysis of key journals – E-journal usage – Database usage – Survey of faculty – Survey of graduate students
  24. 24. The Tools & Structure Bowker Book Analysis – Review of reputable bibliographies – OCLC Collection Evaluation comparison to peers – WorldCat – HathiTrust – Outstanding Academic Titles – Review of peer databases – Modified Brief Test – Sustainable Collection Services unique titles ILL statistics – Citation analysis of key journals – E-journal usage – Database usage – Survey of faculty – Survey of graduate students Citation analysis of monographs – Accreditation guidelines
  25. 25. A Consistent Process
  26. 26. A Consistent Process standardized procedures, document formatting, and file names
  27. 27. A Consistent Process standardized procedures, document formatting, and file names detailed documentation
  28. 28. A Consistent Process standardized procedures, document formatting, and file names detailed documentation cycle of assessment and revision
  29. 29. Results @ Mason
  30. 30. Results @ Mason Seven complete, three in progress
  31. 31. Results @ Mason Seven complete, three in progress Reasonable amount of staff time
  32. 32. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace
  33. 33. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Concise final reports
  34. 34. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Concise final reports
  35. 35. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Gradually accumulating results Concise final reports
  36. 36. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Gradually accumulating results Success in revising procedures Concise final reports
  37. 37. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Gradually accumulating results Success in revising procedures Accommodates turnover Concise final reports
  38. 38. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE
  39. 39. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required
  40. 40. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating
  41. 41. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating Multiple tools allow for “triangulation” Problematic tools can be dropped
  42. 42. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating Assessment Manual complete Replaced full-time staff with Graduate Assistant successfully Multiple tools allow for “triangulation” Problematic tools can be dropped
  43. 43. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating Assessment Manual complete Replaced full-time staff with Graduate Assistant successfully Multiple tools allow for “triangulation” Problematic tools can be dropped Each subject is a manageable chunk Key subject areas can be prioritized Goals can be adjusted over time No pressure for each tool to be perfect
  44. 44. Bottom Line
  45. 45. Bottom Line There are still adjustments we want to make
  46. 46. Bottom Line There are still adjustments we want to make but the methodology allows for that
  47. 47. Bottom Line There are still adjustments we want to make but the methodology allows for that and we are getting in the habit of viewing our collections more critically.
  48. 48. Thank you! I’m happy to answer any questions now or via e-mail. I’m also happy to share portions of our methodology, templates, and documentation with those who are interested in the holistic approach.

×