Overview of process used by the Clifton Park-Halfmoon Public Library to create a survey tool for consistent digital resource evaluation. Presented as a flash talk during the SMART Membership Meeting at the 2015 NYLA Conference.
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Bringing Consistency to Digital Resource Evaluation
1. Bringing Consistency to
Digital Resource Evaluation
Paula Weaver, Digital Services Librarian
Clifton Park-Halfmoon Public Library
SMART Flash Talk Oct. 2015
3. Issues
No standard review process
Decisions based on subjective review
Lack of documentation on decisions
Growing # of potential resources
Increasing $ for existing resources
4. Goal
Create a means to consistently review and evaluate
digital resources to support selection decisions
5. Tool & Process
Developed survey for resource evaluation
Broken down into five steps
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
6. Determine Criteria
Reviewed and selected criteria
Library requirements
Key Issues for E-Resource Collection Development Guide
published by IFLA
Evaluation Criteria For Electronic Resources by Rutgers
University Libraries
E-Resources Collection Development Policy - December 2014
Revision by Columbia College Chicago Library
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
7. Create Survey
Grouped into 6 categories
Content
Search
Documentation
Cost
Vendor Support
Technical Considerations
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Digital Services
o 27 questions
all librarians
o 55 questions
8. Create Survey
Created in Word originally
Converted to SurveyMonkey
Ease of use and re-use
Results summarized for easier analysis and decision making
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
9. Create Survey
Modified open-ended questions to specific options
and comments
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
11. Establish Process
Create copy of survey for each evaluation
Three or more librarians review resource and
complete survey
Appropriate department and Digital Services
Analyze survey responses and make decision
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
12. Implement
Reviewed with librarians
Started use in May 2015
Results exported and saved
Feedback incorporated
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
13. Maintain Survey
Continuous process
Updated questions
o New/changed criteria
o Modified options
Added logic to skip questions
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
14. Future Improvements
Continue making updates
Incorporate quantitative aspect to simplify
evaluation decision
Make less “database-ish” and relevant for wider
variety of digital resources
17. Resources
Key Issues for e-Resource Collection Development: A Guide for
Libraries
Sharon Johnson, with Ole Gunnar Evensen, Julia Gelfand, Glenda Lammers,
Lynn Sipe and Nadia Zilper
Publisher: IFLA Acquisition & Collection Development Section
http://www.ifla.org/publications/key-issues-for-e-resource-collection-
development-a-guide-for-libraries?og=55
Evaluation Criteria For Electronic Resources
Susan J. Beck, Rutgers University Libraries
http://www.libraries.rutgers.edu/rul/staff/collection_dev/reports/eval_criteria
_e-resources.shtml
E-Resources Collection Development Policy - December 2014 Revision
Columbia College Chicago Library
http://library.colum.edu/about/policies/e-resources-collection-development-
policy.html