SlideShare a Scribd company logo
Bringing Consistency to
Digital Resource Evaluation
Paula Weaver, Digital Services Librarian
Clifton Park-Halfmoon Public Library
SMART Flash Talk Oct. 2015
Agenda
 Issues
 Goal
 Tool & Process
 Future Improvements
 Q & A
Issues
 No standard review process
 Decisions based on subjective review
 Lack of documentation on decisions
 Growing # of potential resources
 Increasing $ for existing resources
Goal
 Create a means to consistently review and evaluate
digital resources to support selection decisions
Tool & Process
 Developed survey for resource evaluation
 Broken down into five steps
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Determine Criteria
 Reviewed and selected criteria
 Library requirements
 Key Issues for E-Resource Collection Development Guide
published by IFLA
 Evaluation Criteria For Electronic Resources by Rutgers
University Libraries
 E-Resources Collection Development Policy - December 2014
Revision by Columbia College Chicago Library
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Create Survey
 Grouped into 6 categories
 Content
 Search
 Documentation
 Cost
 Vendor Support
 Technical Considerations
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Digital Services
o 27 questions
all librarians
o 55 questions
Create Survey
 Created in Word originally
 Converted to SurveyMonkey
 Ease of use and re-use
 Results summarized for easier analysis and decision making
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Create Survey
 Modified open-ended questions to specific options
and comments
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Create Survey
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Establish Process
 Create copy of survey for each evaluation
 Three or more librarians review resource and
complete survey
 Appropriate department and Digital Services
 Analyze survey responses and make decision
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Implement
 Reviewed with librarians
 Started use in May 2015
 Results exported and saved
 Feedback incorporated
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Maintain Survey
 Continuous process
 Updated questions
o New/changed criteria
o Modified options
 Added logic to skip questions
Determine
Criteria
Create
Survey
Establish
Process
Implement
Maintain
Survey
1 2 3 4 5
Future Improvements
 Continue making updates
 Incorporate quantitative aspect to simplify
evaluation decision
 Make less “database-ish” and relevant for wider
variety of digital resources
Customizable
 Customize for any library
 Email pweaver@sals.edu to get a PDF version of our survey
Questions
Resources
 Key Issues for e-Resource Collection Development: A Guide for
Libraries
 Sharon Johnson, with Ole Gunnar Evensen, Julia Gelfand, Glenda Lammers,
Lynn Sipe and Nadia Zilper
 Publisher: IFLA Acquisition & Collection Development Section
 http://www.ifla.org/publications/key-issues-for-e-resource-collection-
development-a-guide-for-libraries?og=55
 Evaluation Criteria For Electronic Resources
 Susan J. Beck, Rutgers University Libraries
 http://www.libraries.rutgers.edu/rul/staff/collection_dev/reports/eval_criteria
_e-resources.shtml
 E-Resources Collection Development Policy - December 2014 Revision
 Columbia College Chicago Library
 http://library.colum.edu/about/policies/e-resources-collection-development-
policy.html

More Related Content

What's hot

Ppt ch10 gpoc
Ppt ch10 gpocPpt ch10 gpoc
Ppt ch10 gpoc
TAMUCSocialWork
 
Agile Methods Adoption on Software Development @ Agile 2014
Agile Methods Adoption on Software Development @ Agile 2014Agile Methods Adoption on Software Development @ Agile 2014
Agile Methods Adoption on Software Development @ Agile 2014
Caio Cestari
 
SPEC Kit 303 in the UK and Ireland:
SPEC Kit 303 in the UK and Ireland: SPEC Kit 303 in the UK and Ireland:
SPEC Kit 303 in the UK and Ireland:
Stephen Town
 
The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...
The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...
The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...
Information Development World
 
Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...
Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...
Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...
Mikhail Vink
 
Product roadmap
Product roadmapProduct roadmap
Product roadmap
itslearning
 
Afterschool Program Quality Self Assessment Tool Usage
Afterschool Program Quality Self Assessment Tool UsageAfterschool Program Quality Self Assessment Tool Usage
Afterschool Program Quality Self Assessment Tool Usage
YouthToday
 
AnswerOverflow
AnswerOverflowAnswerOverflow
AnswerOverflow
Neelima Rathi
 
Ces 2013 - Doing Developmental Evaluation at the System Level
Ces 2013 - Doing Developmental Evaluation at the System LevelCes 2013 - Doing Developmental Evaluation at the System Level
Ces 2013 - Doing Developmental Evaluation at the System Level
CesToronto
 
Escape the data dungeon: Shedding light on strategies to share your findings
Escape the data dungeon: Shedding light on strategies to share your findingsEscape the data dungeon: Shedding light on strategies to share your findings
Escape the data dungeon: Shedding light on strategies to share your findings
Kimberly Vardeman
 
Brian_Brown_Resume
Brian_Brown_ResumeBrian_Brown_Resume
Brian_Brown_Resume
Brian Brown
 
Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...
Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...
Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...
Blackboard APAC
 
Action Research
Action Research Action Research
Action Research
kparkerslmc
 
Measuring and monitoring the benefits of a shared LMS
Measuring and monitoring the benefits of a shared LMSMeasuring and monitoring the benefits of a shared LMS
Measuring and monitoring the benefits of a shared LMS
rachaelwhitfield
 
Using real-time dashboards to improve student engagement in virtual learning ...
Using real-time dashboards to improve student engagement in virtual learning ...Using real-time dashboards to improve student engagement in virtual learning ...
Using real-time dashboards to improve student engagement in virtual learning ...
Bob Bodily
 
Empowerment Evaluation with David Fetterman
Empowerment Evaluation with David FettermanEmpowerment Evaluation with David Fetterman
Empowerment Evaluation with David Fetterman
SAGE Publishing
 
Ofqual’s work on quality of marking
Ofqual’s work on quality of marking Ofqual’s work on quality of marking
Ofqual’s work on quality of marking
Ofqual Slideshare
 
Able mc neil foster ucisa sero
Able mc neil foster ucisa seroAble mc neil foster ucisa sero
Able mc neil foster ucisa sero
Ed Foster
 
Improving reading list user experience at Imperial College London
Improving reading list user experience at Imperial College LondonImproving reading list user experience at Imperial College London
Improving reading list user experience at Imperial College London
Andrew Preater
 
Jisc learning analytics july-overview
Jisc learning analytics july-overviewJisc learning analytics july-overview
Jisc learning analytics july-overview
Paul Bailey
 

What's hot (20)

Ppt ch10 gpoc
Ppt ch10 gpocPpt ch10 gpoc
Ppt ch10 gpoc
 
Agile Methods Adoption on Software Development @ Agile 2014
Agile Methods Adoption on Software Development @ Agile 2014Agile Methods Adoption on Software Development @ Agile 2014
Agile Methods Adoption on Software Development @ Agile 2014
 
SPEC Kit 303 in the UK and Ireland:
SPEC Kit 303 in the UK and Ireland: SPEC Kit 303 in the UK and Ireland:
SPEC Kit 303 in the UK and Ireland:
 
The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...
The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...
The Measure of Success: Key Metrics for Monitoring Content Quality with Brian...
 
Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...
Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...
Mikhail Vink, "Problem Generation and Answer Verification using Open Data Arr...
 
Product roadmap
Product roadmapProduct roadmap
Product roadmap
 
Afterschool Program Quality Self Assessment Tool Usage
Afterschool Program Quality Self Assessment Tool UsageAfterschool Program Quality Self Assessment Tool Usage
Afterschool Program Quality Self Assessment Tool Usage
 
AnswerOverflow
AnswerOverflowAnswerOverflow
AnswerOverflow
 
Ces 2013 - Doing Developmental Evaluation at the System Level
Ces 2013 - Doing Developmental Evaluation at the System LevelCes 2013 - Doing Developmental Evaluation at the System Level
Ces 2013 - Doing Developmental Evaluation at the System Level
 
Escape the data dungeon: Shedding light on strategies to share your findings
Escape the data dungeon: Shedding light on strategies to share your findingsEscape the data dungeon: Shedding light on strategies to share your findings
Escape the data dungeon: Shedding light on strategies to share your findings
 
Brian_Brown_Resume
Brian_Brown_ResumeBrian_Brown_Resume
Brian_Brown_Resume
 
Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...
Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...
Bb Education on Tour | Blackboard Learning Analytics | Chris Eske, Platform S...
 
Action Research
Action Research Action Research
Action Research
 
Measuring and monitoring the benefits of a shared LMS
Measuring and monitoring the benefits of a shared LMSMeasuring and monitoring the benefits of a shared LMS
Measuring and monitoring the benefits of a shared LMS
 
Using real-time dashboards to improve student engagement in virtual learning ...
Using real-time dashboards to improve student engagement in virtual learning ...Using real-time dashboards to improve student engagement in virtual learning ...
Using real-time dashboards to improve student engagement in virtual learning ...
 
Empowerment Evaluation with David Fetterman
Empowerment Evaluation with David FettermanEmpowerment Evaluation with David Fetterman
Empowerment Evaluation with David Fetterman
 
Ofqual’s work on quality of marking
Ofqual’s work on quality of marking Ofqual’s work on quality of marking
Ofqual’s work on quality of marking
 
Able mc neil foster ucisa sero
Able mc neil foster ucisa seroAble mc neil foster ucisa sero
Able mc neil foster ucisa sero
 
Improving reading list user experience at Imperial College London
Improving reading list user experience at Imperial College LondonImproving reading list user experience at Imperial College London
Improving reading list user experience at Imperial College London
 
Jisc learning analytics july-overview
Jisc learning analytics july-overviewJisc learning analytics july-overview
Jisc learning analytics july-overview
 

Viewers also liked

The power of perception
The power of perceptionThe power of perception
The power of perception
Chandan Dubey
 
Fri papal response to luther
Fri papal response to lutherFri papal response to luther
Fri papal response to luther
Travis Klein
 
Thurs maya city states
Thurs maya city statesThurs maya city states
Thurs maya city states
Travis Klein
 
Tues greek and maya
Tues greek and mayaTues greek and maya
Tues greek and maya
Travis Klein
 
Ինչպիսին պետք է լինի
Ինչպիսին պետք է լինիԻնչպիսին պետք է լինի
Ինչպիսին պետք է լինի
tatevabrahamyan
 
Mit2 092 f09_lec10
Mit2 092 f09_lec10Mit2 092 f09_lec10
Mit2 092 f09_lec10
Rahman Hakim
 
04 tues oppo costs choices
04 tues oppo costs choices04 tues oppo costs choices
04 tues oppo costs choices
Travis Klein
 
Corporate Social Responsibility
Corporate Social ResponsibilityCorporate Social Responsibility
Corporate Social Responsibility
Mamta Binani
 
02 tues demand consumer surplus
02 tues demand consumer surplus02 tues demand consumer surplus
02 tues demand consumer surplus
Travis Klein
 
Tire safety
Tire safetyTire safety
Tire safety
Chandan Dubey
 
Pozo requena fotonovel·la
Pozo requena fotonovel·laPozo requena fotonovel·la
Pozo requena fotonovel·lamgonellgomez
 
Modern infrastructure for business data lake
Modern infrastructure for business data lakeModern infrastructure for business data lake
Modern infrastructure for business data lake
EMC
 
Cost curves
Cost curvesCost curves
Cost curves
Travis Klein
 
Mit2 092 f09_lec03
Mit2 092 f09_lec03Mit2 092 f09_lec03
Mit2 092 f09_lec03
Rahman Hakim
 
HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템
박 민규
 
Year 2070
Year 2070Year 2070
Year 2070
Chandan Dubey
 
Block political vs physical maps
Block political vs physical mapsBlock political vs physical maps
Block political vs physical maps
Travis Klein
 
The Digital Universe in 2020 - United States
The Digital Universe in 2020 - United StatesThe Digital Universe in 2020 - United States
The Digital Universe in 2020 - United States
EMC
 
COBieOWL An OWL ontology based on COBie standard
COBieOWL An OWL ontology based on COBie standardCOBieOWL An OWL ontology based on COBie standard
COBieOWL An OWL ontology based on COBie standard
Ana Roxin
 

Viewers also liked (20)

The power of perception
The power of perceptionThe power of perception
The power of perception
 
Fri papal response to luther
Fri papal response to lutherFri papal response to luther
Fri papal response to luther
 
альбом пс 192
альбом пс 192альбом пс 192
альбом пс 192
 
Thurs maya city states
Thurs maya city statesThurs maya city states
Thurs maya city states
 
Tues greek and maya
Tues greek and mayaTues greek and maya
Tues greek and maya
 
Ինչպիսին պետք է լինի
Ինչպիսին պետք է լինիԻնչպիսին պետք է լինի
Ինչպիսին պետք է լինի
 
Mit2 092 f09_lec10
Mit2 092 f09_lec10Mit2 092 f09_lec10
Mit2 092 f09_lec10
 
04 tues oppo costs choices
04 tues oppo costs choices04 tues oppo costs choices
04 tues oppo costs choices
 
Corporate Social Responsibility
Corporate Social ResponsibilityCorporate Social Responsibility
Corporate Social Responsibility
 
02 tues demand consumer surplus
02 tues demand consumer surplus02 tues demand consumer surplus
02 tues demand consumer surplus
 
Tire safety
Tire safetyTire safety
Tire safety
 
Pozo requena fotonovel·la
Pozo requena fotonovel·laPozo requena fotonovel·la
Pozo requena fotonovel·la
 
Modern infrastructure for business data lake
Modern infrastructure for business data lakeModern infrastructure for business data lake
Modern infrastructure for business data lake
 
Cost curves
Cost curvesCost curves
Cost curves
 
Mit2 092 f09_lec03
Mit2 092 f09_lec03Mit2 092 f09_lec03
Mit2 092 f09_lec03
 
HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템
 
Year 2070
Year 2070Year 2070
Year 2070
 
Block political vs physical maps
Block political vs physical mapsBlock political vs physical maps
Block political vs physical maps
 
The Digital Universe in 2020 - United States
The Digital Universe in 2020 - United StatesThe Digital Universe in 2020 - United States
The Digital Universe in 2020 - United States
 
COBieOWL An OWL ontology based on COBie standard
COBieOWL An OWL ontology based on COBie standardCOBieOWL An OWL ontology based on COBie standard
COBieOWL An OWL ontology based on COBie standard
 

Similar to Bringing Consistency to Digital Resource Evaluation

AnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountabilityAnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountability
Ijeoma Anyanwu
 
Research panel
Research panelResearch panel
Research panel
NAFCareerAcads
 
M0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-FinalM0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-Final
Research in Action, Inc.
 
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
National Information Standards Organization (NISO)
 
Management-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesManagement-Oriented Evaluation Approaches
Management-Oriented Evaluation Approaches
Larry Weas
 
Documenting Your Academy story - Creating an Evidence Binder
Documenting Your Academy story - Creating an Evidence BinderDocumenting Your Academy story - Creating an Evidence Binder
Documenting Your Academy story - Creating an Evidence Binder
NAFCareerAcads
 
Evaluation of the TOIA project
Evaluation of the TOIA projectEvaluation of the TOIA project
Evaluation of the TOIA project
grainne
 
M0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINALM0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINAL
Research in Action, Inc.
 
Fall 2011 Online Reviews: An Interactive Approach
Fall 2011 Online Reviews: An Interactive ApproachFall 2011 Online Reviews: An Interactive Approach
Fall 2011 Online Reviews: An Interactive Approach
Carla Bradley
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
Yen Bunsoy
 
North Central Accreditation Conference
North Central Accreditation ConferenceNorth Central Accreditation Conference
North Central Accreditation Conference
Laura Zeller, Lake Central School Corporation
 
Using Analytics to Deliver Engaging Courses
Using Analytics to Deliver Engaging CoursesUsing Analytics to Deliver Engaging Courses
Using Analytics to Deliver Engaging Courses
Lambda Solutions
 
Jisc learning analytics mar2017
Jisc learning analytics mar2017Jisc learning analytics mar2017
Jisc learning analytics mar2017
Paul Bailey
 
U mass data-project proposal-noapp
U mass data-project proposal-noappU mass data-project proposal-noapp
U mass data-project proposal-noapp
Daisy LaFlamme
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating Assessments
Christina Sax
 
ASLGConf2014LizDandDonnaOD 2016
ASLGConf2014LizDandDonnaOD 2016ASLGConf2014LizDandDonnaOD 2016
ASLGConf2014LizDandDonnaOD 2016
Liz Dore
 
Evaluation and usability - ACPET e Mentor session
Evaluation and usability - ACPET e Mentor sessionEvaluation and usability - ACPET e Mentor session
Evaluation and usability - ACPET e Mentor session
Yum Studio
 
May19 Cwms
May19 CwmsMay19 Cwms
May19 Cwms
marciehull
 
Space, Technology, Education, & People for Success to redefining the referenc...
Space, Technology, Education, & People for Successto redefining the referenc...Space, Technology, Education, & People for Successto redefining the referenc...
Space, Technology, Education, & People for Success to redefining the referenc...
University College Cork
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learning
Caroline Conlon
 

Similar to Bringing Consistency to Digital Resource Evaluation (20)

AnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountabilityAnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountability
 
Research panel
Research panelResearch panel
Research panel
 
M0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-FinalM0-Orientation-JAN2014-Final
M0-Orientation-JAN2014-Final
 
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
 
Management-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesManagement-Oriented Evaluation Approaches
Management-Oriented Evaluation Approaches
 
Documenting Your Academy story - Creating an Evidence Binder
Documenting Your Academy story - Creating an Evidence BinderDocumenting Your Academy story - Creating an Evidence Binder
Documenting Your Academy story - Creating an Evidence Binder
 
Evaluation of the TOIA project
Evaluation of the TOIA projectEvaluation of the TOIA project
Evaluation of the TOIA project
 
M0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINALM0-Orientation-June 2014-FINAL
M0-Orientation-June 2014-FINAL
 
Fall 2011 Online Reviews: An Interactive Approach
Fall 2011 Online Reviews: An Interactive ApproachFall 2011 Online Reviews: An Interactive Approach
Fall 2011 Online Reviews: An Interactive Approach
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
 
North Central Accreditation Conference
North Central Accreditation ConferenceNorth Central Accreditation Conference
North Central Accreditation Conference
 
Using Analytics to Deliver Engaging Courses
Using Analytics to Deliver Engaging CoursesUsing Analytics to Deliver Engaging Courses
Using Analytics to Deliver Engaging Courses
 
Jisc learning analytics mar2017
Jisc learning analytics mar2017Jisc learning analytics mar2017
Jisc learning analytics mar2017
 
U mass data-project proposal-noapp
U mass data-project proposal-noappU mass data-project proposal-noapp
U mass data-project proposal-noapp
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating Assessments
 
ASLGConf2014LizDandDonnaOD 2016
ASLGConf2014LizDandDonnaOD 2016ASLGConf2014LizDandDonnaOD 2016
ASLGConf2014LizDandDonnaOD 2016
 
Evaluation and usability - ACPET e Mentor session
Evaluation and usability - ACPET e Mentor sessionEvaluation and usability - ACPET e Mentor session
Evaluation and usability - ACPET e Mentor session
 
May19 Cwms
May19 CwmsMay19 Cwms
May19 Cwms
 
Space, Technology, Education, & People for Success to redefining the referenc...
Space, Technology, Education, & People for Successto redefining the referenc...Space, Technology, Education, & People for Successto redefining the referenc...
Space, Technology, Education, & People for Success to redefining the referenc...
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learning
 

Recently uploaded

"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
c5vrf27qcz
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
Edge AI and Vision Alliance
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 

Recently uploaded (20)

"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 

Bringing Consistency to Digital Resource Evaluation

  • 1. Bringing Consistency to Digital Resource Evaluation Paula Weaver, Digital Services Librarian Clifton Park-Halfmoon Public Library SMART Flash Talk Oct. 2015
  • 2. Agenda  Issues  Goal  Tool & Process  Future Improvements  Q & A
  • 3. Issues  No standard review process  Decisions based on subjective review  Lack of documentation on decisions  Growing # of potential resources  Increasing $ for existing resources
  • 4. Goal  Create a means to consistently review and evaluate digital resources to support selection decisions
  • 5. Tool & Process  Developed survey for resource evaluation  Broken down into five steps Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 6. Determine Criteria  Reviewed and selected criteria  Library requirements  Key Issues for E-Resource Collection Development Guide published by IFLA  Evaluation Criteria For Electronic Resources by Rutgers University Libraries  E-Resources Collection Development Policy - December 2014 Revision by Columbia College Chicago Library Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 7. Create Survey  Grouped into 6 categories  Content  Search  Documentation  Cost  Vendor Support  Technical Considerations Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5 Digital Services o 27 questions all librarians o 55 questions
  • 8. Create Survey  Created in Word originally  Converted to SurveyMonkey  Ease of use and re-use  Results summarized for easier analysis and decision making Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 9. Create Survey  Modified open-ended questions to specific options and comments Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 11. Establish Process  Create copy of survey for each evaluation  Three or more librarians review resource and complete survey  Appropriate department and Digital Services  Analyze survey responses and make decision Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 12. Implement  Reviewed with librarians  Started use in May 2015  Results exported and saved  Feedback incorporated Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 13. Maintain Survey  Continuous process  Updated questions o New/changed criteria o Modified options  Added logic to skip questions Determine Criteria Create Survey Establish Process Implement Maintain Survey 1 2 3 4 5
  • 14. Future Improvements  Continue making updates  Incorporate quantitative aspect to simplify evaluation decision  Make less “database-ish” and relevant for wider variety of digital resources
  • 15. Customizable  Customize for any library  Email pweaver@sals.edu to get a PDF version of our survey
  • 17. Resources  Key Issues for e-Resource Collection Development: A Guide for Libraries  Sharon Johnson, with Ole Gunnar Evensen, Julia Gelfand, Glenda Lammers, Lynn Sipe and Nadia Zilper  Publisher: IFLA Acquisition & Collection Development Section  http://www.ifla.org/publications/key-issues-for-e-resource-collection- development-a-guide-for-libraries?og=55  Evaluation Criteria For Electronic Resources  Susan J. Beck, Rutgers University Libraries  http://www.libraries.rutgers.edu/rul/staff/collection_dev/reports/eval_criteria _e-resources.shtml  E-Resources Collection Development Policy - December 2014 Revision  Columbia College Chicago Library  http://library.colum.edu/about/policies/e-resources-collection-development- policy.html