NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University
•
1 like•2,059 views
NISO Virtual Conference: Expanding the Assessment Toolbox: Blending the Old and New Assessment Practices ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (19)
Similar to NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University
Similar to NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University (20)
More from National Information Standards Organization (NISO)
More from National Information Standards Organization (NISO) (20)
Recently uploaded
Recently uploaded (20)
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly, Head of Collection Development, University Libraries, George Mason University
- 1. ‘Good Enough’ Applying a Holistic Approach for Practical, Systematic Collection Assessment Madeline Kelly Head, Collection Development George Mason University Libraries
- 2. Agenda Collection assessment basics Obstacles to collection assessment Holistic or “good enough” assessment: what is it? Holistic assessment @ Mason Successes Questions
- 3. Collection Assessment Basics Goals of Assessment
- 4. Collection Assessment Basics Goals of Assessment space savings accreditation showing ROI cost savings identifying strengths identifying gaps
- 5. Collection Assessment Basics Tools & Methods
- 6. Collection Assessment Basics Tools & Methods list-checking quantity citation analysis user responses external standards usage analysis
- 7. Barriers to Systematic Assessment
- 8. Barriers to Systematic Assessment STAFF
- 9. Barriers to Systematic Assessment STAFF TIME
- 10. Barriers to Systematic Assessment STAFF TIME TOOLS
- 11. Barriers to Systematic Assessment STAFF TIME TURNOVER TOOLS
- 12. Barriers to Systematic Assessment STAFF TIME TURNOVER TOOLS SCOPE
- 14. The Holistic Approach Multi-tool approach Snapshot of each subject area Big picture perspective
- 15. The Holistic Approach Emphasis is on usable results, not perfect results Multi-tool approach Snapshot of each subject area Big picture perspective
- 16. Benefits of Good Enough Flexible
- 17. Benefits of Good Enough Flexible Manageable
- 18. Benefits of Good Enough Flexible Manageable Sustainable
- 19. Holistic Assessment @ Mason Key aspects of our approach: Subject-specific assessments Tiered portfolio of tools Consistency
- 20. Subject-Specific Approach One subject at a time Minimal burden on subject librarians Opportunity to revise procedures
- 21. The Tools & Structure
- 22. The Tools & Structure Bowker Book Analysis – Review of reputable bibliographies – OCLC Collection Evaluation comparison to peers – WorldCat – HathiTrust – Outstanding Academic Titles – Review of peer databases – Modified Brief Test – Sustainable Collection Services unique titles
- 23. The Tools & Structure Bowker Book Analysis – Review of reputable bibliographies – OCLC Collection Evaluation comparison to peers – WorldCat – HathiTrust – Outstanding Academic Titles – Review of peer databases – Modified Brief Test – Sustainable Collection Services unique titles ILL statistics – Citation analysis of key journals – E-journal usage – Database usage – Survey of faculty – Survey of graduate students
- 24. The Tools & Structure Bowker Book Analysis – Review of reputable bibliographies – OCLC Collection Evaluation comparison to peers – WorldCat – HathiTrust – Outstanding Academic Titles – Review of peer databases – Modified Brief Test – Sustainable Collection Services unique titles ILL statistics – Citation analysis of key journals – E-journal usage – Database usage – Survey of faculty – Survey of graduate students Citation analysis of monographs – Accreditation guidelines
- 26. A Consistent Process standardized procedures, document formatting, and file names
- 27. A Consistent Process standardized procedures, document formatting, and file names detailed documentation
- 28. A Consistent Process standardized procedures, document formatting, and file names detailed documentation cycle of assessment and revision
- 29. Results @ Mason
- 30. Results @ Mason Seven complete, three in progress
- 31. Results @ Mason Seven complete, three in progress Reasonable amount of staff time
- 32. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace
- 33. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Concise final reports
- 34. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Concise final reports
- 35. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Gradually accumulating results Concise final reports
- 36. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Gradually accumulating results Success in revising procedures Concise final reports
- 37. Results @ Mason Seven complete, three in progress Reasonable amount of staff time Acceptable pace Lots of usable data Gradually accumulating results Success in revising procedures Accommodates turnover Concise final reports
- 38. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE
- 39. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required
- 40. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating
- 41. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating Multiple tools allow for “triangulation” Problematic tools can be dropped
- 42. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating Assessment Manual complete Replaced full-time staff with Graduate Assistant successfully Multiple tools allow for “triangulation” Problematic tools can be dropped
- 43. Barriers Revisited STAFF TIME TURNOVER TOOLS SCOPE Requires 1 FTE Low burden on subject librarians Statistical expertise not required Completed 3 during pilot year On track to complete 10 in second year Pace accelerating Assessment Manual complete Replaced full-time staff with Graduate Assistant successfully Multiple tools allow for “triangulation” Problematic tools can be dropped Each subject is a manageable chunk Key subject areas can be prioritized Goals can be adjusted over time No pressure for each tool to be perfect
- 44. Bottom Line
- 45. Bottom Line There are still adjustments we want to make
- 46. Bottom Line There are still adjustments we want to make but the methodology allows for that
- 47. Bottom Line There are still adjustments we want to make but the methodology allows for that and we are getting in the habit of viewing our collections more critically.
- 48. Thank you! I’m happy to answer any questions now or via e-mail. I’m also happy to share portions of our methodology, templates, and documentation with those who are interested in the holistic approach.