SlideShare a Scribd company logo
NISO Training Series
ASSESSMENT PRACTICES AND METRICS
FOR
THE 21ST CENTURY
Martha Kyrillidou, Ph.D., MLS, MEd
QUALITYMETRICS, LLC
Helping libraries and information providers achieve success
www.qualitymetricsllc.com
#assessment21 @nisoinfo @qualitymetrics1 @Kyrillidou
OCT 19, 2018
Our Series Is … and Is Not
• Address broad advanced themes about key assessment issues that you
are facing in your organization and give you ideas for moving forward
strategically
• A series with a strategic and broad focus, but is not training for in-depth
or hands-on assessment methods
• Enable you to begin thinking about a new kind of assessment plan and
new approaches to some ideas you have, but is not a complete planning
exercise
• Introduce you to new resources, particularly new colleagues, that may
be of assistance to you in the future, but is not a consultation to
address your key assessment issue(s)
• Challenge you to think broadly and creatively
Guest Lecturers
Martha Kyrillidou, QualityMetrics LLC
Starr Hoffman, University of Nevada – Las Vegas
Frankie Wilson, Bodleian Library, Oxford University
Rachel Lewellen, Harvard
Sarah Murphy, Ohio State
Steven Braun, Northeastern
Nancy Turner, Temple
Charles Watkinson, University of Michigan
Skeptical Homer
•“Oh, people can come up
with statistics to prove
anything Kent
[Brockman]. 14% of
people know that.”
•“Facts are meaningless.
You could use facts to
prove anything that's
even remotely true!”
• Homer Simpson
It ain’t what you don’t know
that gets you into trouble
It’s what you know for sure
that just ain’t so
-- Mark Twain
Structure Culture
Open
Transparent
Trustworthy
Excellent
High Quality
Inspiring
Structure
Systems
Finance
Communications
Project
Management
Human
Resources
Development
Operations
Information Crossroads
Strategic Planning
Leadership Development
Financial and HR Systems Improvements
Information Technology
Staffing
Collections
Old, New, and Emerging Services
Assessment is a structured process to:
•Learn about and from our communities
•Use data for effective management &
decision-making
•Communicate with customers & stakeholders
•Seek opportunities for collaboration &
comparisons
•Help demonstrate library value
Culture of Assessment
Assessment is evident in our planning documents such as strategic plans
Assessment is a campus priority
Administrators/managers are committed to supporting assessment
Staff accepts responsibility for assessment activities
There is support and rewards for staff who engage in assessment
Policies and procedures are designed to enable, not inhibit, fulfilling user information
needs
Collaboration and cooperation exists among individuals and departments
My library considers user needs when allocating resources
My library actively cultivates a positive relationship with its users
Assessment leads to results in my library
My library routinely collects, uses, and disseminates meaningful user data/feedback
My library evaluates its operations and programs for quality
Staff have expertise and skills in assessment
ASSESSMENT
&
USER
EXPERIENCE
AUX
OR
UXA
RESEARCH
AUXR
OR
UXAR
PURPOSE
METHODS
QUANTITATIVE
QUALITATIVE
MIXED
DESIGN THINKING
ANALYSIS
UNDERSTANDING
REPRESENTATION
DIVERSITY
COMMUNICATION
ADVOCACY
What’s in a name?
Assessment & User Experience
Assessment Analyst & Consultant
Assessment and Data Visualization Analyst
Web Experience Project Lead
Application Development Project Lead
Strategic Planning & Assessment
Collection Evaluation & Assessment
Planning, Marketing & Communication
Acquisitions & Appraisal
Student Success Librarian
DISCOVERY
Infrastructure
1. What are the current strengths of our
assessment program?
2. What data are useful to you for
decision making?
3. What would you like to see in the
future from the library assessment
program?
Thank you
martha@qualitymetricsllc.com

More Related Content

What's hot

NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
National Information Standards Organization (NISO)
 
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivoConducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
QSR International
 
Developing a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivoDeveloping a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivo
QSR International
 
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
National Information Standards Organization (NISO)
 
The Informationist: Pushing the Boundaries
The Informationist: Pushing the BoundariesThe Informationist: Pushing the Boundaries
The Informationist: Pushing the Boundaries
Elaine Martin
 
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
National Information Standards Organization (NISO)
 
Evaluating Libraries
Evaluating LibrariesEvaluating Libraries
Evaluating Libraries
Pamela MacKellar
 
Some Glaring Mistakes made by Researchers in Education in Statistical Analysis
Some Glaring Mistakes made by Researchers in Education in Statistical AnalysisSome Glaring Mistakes made by Researchers in Education in Statistical Analysis
Some Glaring Mistakes made by Researchers in Education in Statistical Analysis
Madhavi Dharankar
 
Teacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher EducationTeacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher Education
Dr. Ollé János
 
Library Metrics and Measurement: Counting What Counts & Making it Matter
Library Metrics and Measurement: Counting What Counts & Making it MatterLibrary Metrics and Measurement: Counting What Counts & Making it Matter
Library Metrics and Measurement: Counting What Counts & Making it Matter
Emily Clasper
 
NAWResume
NAWResumeNAWResume
Research courses for the EdD
Research courses for the EdDResearch courses for the EdD
Research courses for the EdD
CPEDInitiative
 
Data, evidence and outcomes
Data, evidence and outcomes Data, evidence and outcomes
Data, evidence and outcomes
Joe Matthews
 
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
Matt Mawer
 
Star Chart
Star ChartStar Chart
Star Chart
rach02hix
 
Library Assessment
Library AssessmentLibrary Assessment
Library Assessment
libraryassessment
 
Library Assessment
Library AssessmentLibrary Assessment
Library Assessment
libraryassessment
 
Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
Managing with Data: Using ACRLMetrics and PLAmetrics WebinarManaging with Data: Using ACRLMetrics and PLAmetrics Webinar
Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
ALATechSource
 
2008 regional educational laboratory board of directors (rel midwest)
2008 regional educational laboratory board of directors (rel midwest) 2008 regional educational laboratory board of directors (rel midwest)
2008 regional educational laboratory board of directors (rel midwest)
Christopher Thorn
 
Using NVivo in Healthcare - Steps for a More Effective Strategy
Using NVivo in Healthcare - Steps for a More Effective StrategyUsing NVivo in Healthcare - Steps for a More Effective Strategy
Using NVivo in Healthcare - Steps for a More Effective Strategy
QSR International
 

What's hot (20)

NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
 
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivoConducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
 
Developing a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivoDeveloping a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivo
 
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
NISO Apr 29 Virtual Conference Keynote Address: The Value of Library-Provided...
 
The Informationist: Pushing the Boundaries
The Informationist: Pushing the BoundariesThe Informationist: Pushing the Boundaries
The Informationist: Pushing the Boundaries
 
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
NISO Apr 29 Virtual Conference: Definitions for appropriate metrics and calcu...
 
Evaluating Libraries
Evaluating LibrariesEvaluating Libraries
Evaluating Libraries
 
Some Glaring Mistakes made by Researchers in Education in Statistical Analysis
Some Glaring Mistakes made by Researchers in Education in Statistical AnalysisSome Glaring Mistakes made by Researchers in Education in Statistical Analysis
Some Glaring Mistakes made by Researchers in Education in Statistical Analysis
 
Teacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher EducationTeacher and Researcher Performance Quality Assessment in Higher Education
Teacher and Researcher Performance Quality Assessment in Higher Education
 
Library Metrics and Measurement: Counting What Counts & Making it Matter
Library Metrics and Measurement: Counting What Counts & Making it MatterLibrary Metrics and Measurement: Counting What Counts & Making it Matter
Library Metrics and Measurement: Counting What Counts & Making it Matter
 
NAWResume
NAWResumeNAWResume
NAWResume
 
Research courses for the EdD
Research courses for the EdDResearch courses for the EdD
Research courses for the EdD
 
Data, evidence and outcomes
Data, evidence and outcomes Data, evidence and outcomes
Data, evidence and outcomes
 
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
Evaluation methodology: How do we know what we know? (5th DHG, Helsinki)
 
Star Chart
Star ChartStar Chart
Star Chart
 
Library Assessment
Library AssessmentLibrary Assessment
Library Assessment
 
Library Assessment
Library AssessmentLibrary Assessment
Library Assessment
 
Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
Managing with Data: Using ACRLMetrics and PLAmetrics WebinarManaging with Data: Using ACRLMetrics and PLAmetrics Webinar
Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
 
2008 regional educational laboratory board of directors (rel midwest)
2008 regional educational laboratory board of directors (rel midwest) 2008 regional educational laboratory board of directors (rel midwest)
2008 regional educational laboratory board of directors (rel midwest)
 
Using NVivo in Healthcare - Steps for a More Effective Strategy
Using NVivo in Healthcare - Steps for a More Effective StrategyUsing NVivo in Healthcare - Steps for a More Effective Strategy
Using NVivo in Healthcare - Steps for a More Effective Strategy
 

Similar to Kyrillidou Session One NISO Training Assessment Practices

Governance Day 042718
Governance Day 042718Governance Day 042718
Governance Day 042718
Deanna Romano
 
Leading a Successful Change Initiative
Leading a Successful Change InitiativeLeading a Successful Change Initiative
Leading a Successful Change Initiative
The Conference for Entrepreneurial Librarians
 
Independent Colleges and Universities of Texas/ LeTourneau University webinar
Independent Colleges and Universities of Texas/ LeTourneau University webinarIndependent Colleges and Universities of Texas/ LeTourneau University webinar
Independent Colleges and Universities of Texas/ LeTourneau University webinar
Joseph Garcia
 
Introduction to the Assessment for Learning Project
Introduction to the Assessment for Learning ProjectIntroduction to the Assessment for Learning Project
Introduction to the Assessment for Learning Project
Next Generation Learning Challenges
 
Help! I have a sick school! Principal and Teacher Evaluations Can Heal
Help! I have a sick school! Principal and Teacher Evaluations Can HealHelp! I have a sick school! Principal and Teacher Evaluations Can Heal
Help! I have a sick school! Principal and Teacher Evaluations Can Heal
Susan Labadi
 
Meaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matterMeaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matter
Rebecca Jones
 
Greek Life Research Project
Greek Life Research ProjectGreek Life Research Project
Greek Life Research Project
Brooke Boyd
 
NEEDS ASSESSMENT - Copy.pptx
NEEDS ASSESSMENT - Copy.pptxNEEDS ASSESSMENT - Copy.pptx
NEEDS ASSESSMENT - Copy.pptx
TheophilusBaidoo3
 
Library Connect Webinar Slides
Library Connect Webinar SlidesLibrary Connect Webinar Slides
Library Connect Webinar Slides
Library_Connect
 
FerrellWalker.pptx
FerrellWalker.pptxFerrellWalker.pptx
FerrellWalker.pptx
Jisc
 
Succession Planning and Cross Training: Boldly Preparing for Staff Transition...
Succession Planning and Cross Training: Boldly Preparing for Staff Transition...Succession Planning and Cross Training: Boldly Preparing for Staff Transition...
Succession Planning and Cross Training: Boldly Preparing for Staff Transition...
Palatine Library
 
Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017
Rebecca Jones
 
KPI: Keeping Purposeful Intelligence. CSE Event Cardiff Nov 2013.
KPI: Keeping Purposeful Intelligence.  CSE Event Cardiff Nov 2013.KPI: Keeping Purposeful Intelligence.  CSE Event Cardiff Nov 2013.
KPI: Keeping Purposeful Intelligence. CSE Event Cardiff Nov 2013.
jamiesoh
 
KPI presentation - Northumbria conference 2013
KPI presentation - Northumbria conference 2013KPI presentation - Northumbria conference 2013
KPI presentation - Northumbria conference 2013
jamiesoh
 
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Blackboard APAC
 
HIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptx
HIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptxHIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptx
HIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptx
AndyIbrahim4
 
Building a Culture of Assessment: What I've Learned from Research, Trial, and...
Building a Culture of Assessment: What I've Learned from Research, Trial, and...Building a Culture of Assessment: What I've Learned from Research, Trial, and...
Building a Culture of Assessment: What I've Learned from Research, Trial, and...
Meredith Farkas
 
YP CORPORATE TRAINING Resume
YP CORPORATE TRAINING ResumeYP CORPORATE TRAINING Resume
YP CORPORATE TRAINING Resume
Melody Conner
 
Dept culture in promoting values of Education
Dept culture in promoting values of EducationDept culture in promoting values of Education
Dept culture in promoting values of Education
Vivek631355
 
Pattie= masters unm portfolio
Pattie= masters unm portfolioPattie= masters unm portfolio
Pattie= masters unm portfolio
Pattie Salas
 

Similar to Kyrillidou Session One NISO Training Assessment Practices (20)

Governance Day 042718
Governance Day 042718Governance Day 042718
Governance Day 042718
 
Leading a Successful Change Initiative
Leading a Successful Change InitiativeLeading a Successful Change Initiative
Leading a Successful Change Initiative
 
Independent Colleges and Universities of Texas/ LeTourneau University webinar
Independent Colleges and Universities of Texas/ LeTourneau University webinarIndependent Colleges and Universities of Texas/ LeTourneau University webinar
Independent Colleges and Universities of Texas/ LeTourneau University webinar
 
Introduction to the Assessment for Learning Project
Introduction to the Assessment for Learning ProjectIntroduction to the Assessment for Learning Project
Introduction to the Assessment for Learning Project
 
Help! I have a sick school! Principal and Teacher Evaluations Can Heal
Help! I have a sick school! Principal and Teacher Evaluations Can HealHelp! I have a sick school! Principal and Teacher Evaluations Can Heal
Help! I have a sick school! Principal and Teacher Evaluations Can Heal
 
Meaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matterMeaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matter
 
Greek Life Research Project
Greek Life Research ProjectGreek Life Research Project
Greek Life Research Project
 
NEEDS ASSESSMENT - Copy.pptx
NEEDS ASSESSMENT - Copy.pptxNEEDS ASSESSMENT - Copy.pptx
NEEDS ASSESSMENT - Copy.pptx
 
Library Connect Webinar Slides
Library Connect Webinar SlidesLibrary Connect Webinar Slides
Library Connect Webinar Slides
 
FerrellWalker.pptx
FerrellWalker.pptxFerrellWalker.pptx
FerrellWalker.pptx
 
Succession Planning and Cross Training: Boldly Preparing for Staff Transition...
Succession Planning and Cross Training: Boldly Preparing for Staff Transition...Succession Planning and Cross Training: Boldly Preparing for Staff Transition...
Succession Planning and Cross Training: Boldly Preparing for Staff Transition...
 
Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017
 
KPI: Keeping Purposeful Intelligence. CSE Event Cardiff Nov 2013.
KPI: Keeping Purposeful Intelligence.  CSE Event Cardiff Nov 2013.KPI: Keeping Purposeful Intelligence.  CSE Event Cardiff Nov 2013.
KPI: Keeping Purposeful Intelligence. CSE Event Cardiff Nov 2013.
 
KPI presentation - Northumbria conference 2013
KPI presentation - Northumbria conference 2013KPI presentation - Northumbria conference 2013
KPI presentation - Northumbria conference 2013
 
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
 
HIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptx
HIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptxHIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptx
HIGHER EDUCATION LEADERSHIP PROGRAM FRAMEWORK (2).pptx
 
Building a Culture of Assessment: What I've Learned from Research, Trial, and...
Building a Culture of Assessment: What I've Learned from Research, Trial, and...Building a Culture of Assessment: What I've Learned from Research, Trial, and...
Building a Culture of Assessment: What I've Learned from Research, Trial, and...
 
YP CORPORATE TRAINING Resume
YP CORPORATE TRAINING ResumeYP CORPORATE TRAINING Resume
YP CORPORATE TRAINING Resume
 
Dept culture in promoting values of Education
Dept culture in promoting values of EducationDept culture in promoting values of Education
Dept culture in promoting values of Education
 
Pattie= masters unm portfolio
Pattie= masters unm portfolioPattie= masters unm portfolio
Pattie= masters unm portfolio
 

More from National Information Standards Organization (NISO)

Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
National Information Standards Organization (NISO)
 
Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"
National Information Standards Organization (NISO)
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
National Information Standards Organization (NISO)
 
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
National Information Standards Organization (NISO)
 
Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"
Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"
Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"
National Information Standards Organization (NISO)
 
Mattingly "AI and Prompt Design: LLMs with NER"
Mattingly "AI and Prompt Design: LLMs with NER"Mattingly "AI and Prompt Design: LLMs with NER"
Mattingly "AI and Prompt Design: LLMs with NER"
National Information Standards Organization (NISO)
 
Mattingly "AI & Prompt Design: Named Entity Recognition"
Mattingly "AI & Prompt Design: Named Entity Recognition"Mattingly "AI & Prompt Design: Named Entity Recognition"
Mattingly "AI & Prompt Design: Named Entity Recognition"
National Information Standards Organization (NISO)
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
National Information Standards Organization (NISO)
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
National Information Standards Organization (NISO)
 
Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"
National Information Standards Organization (NISO)
 
Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"
National Information Standards Organization (NISO)
 
Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"
National Information Standards Organization (NISO)
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
National Information Standards Organization (NISO)
 
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
National Information Standards Organization (NISO)
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
National Information Standards Organization (NISO)
 
Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"
National Information Standards Organization (NISO)
 
Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"
National Information Standards Organization (NISO)
 
Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"
National Information Standards Organization (NISO)
 
Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"
National Information Standards Organization (NISO)
 
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
National Information Standards Organization (NISO)
 

More from National Information Standards Organization (NISO) (20)

Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
 
Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"Benner "Expanding Pathways to Publishing Careers"
Benner "Expanding Pathways to Publishing Careers"
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
 
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
 
Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"
Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"
Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"
 
Mattingly "AI and Prompt Design: LLMs with NER"
Mattingly "AI and Prompt Design: LLMs with NER"Mattingly "AI and Prompt Design: LLMs with NER"
Mattingly "AI and Prompt Design: LLMs with NER"
 
Mattingly "AI & Prompt Design: Named Entity Recognition"
Mattingly "AI & Prompt Design: Named Entity Recognition"Mattingly "AI & Prompt Design: Named Entity Recognition"
Mattingly "AI & Prompt Design: Named Entity Recognition"
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"
 
Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"
 
Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
 
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
 
Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"
 
Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"
 
Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"
 
Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"
 
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
 

Recently uploaded

How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17
Celine George
 
Observational Learning
Observational Learning Observational Learning
Observational Learning
sanamushtaq922
 
78 Microsoft-Publisher - Sirin Sultana Bora.pptx
78 Microsoft-Publisher - Sirin Sultana Bora.pptx78 Microsoft-Publisher - Sirin Sultana Bora.pptx
78 Microsoft-Publisher - Sirin Sultana Bora.pptx
Kalna College
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
Jyoti Chand
 
Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)
nitinpv4ai
 
Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10
nitinpv4ai
 
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptxRESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
zuzanka
 
Skimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S EliotSkimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S Eliot
nitinpv4ai
 
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
ImMuslim
 
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptx
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptxCapTechTalks Webinar Slides June 2024 Donovan Wright.pptx
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptx
CapitolTechU
 
Temple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation resultsTemple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation results
Krassimira Luka
 
Standardized tool for Intelligence test.
Standardized tool for Intelligence test.Standardized tool for Intelligence test.
Standardized tool for Intelligence test.
deepaannamalai16
 
Accounting for Restricted Grants When and How To Record Properly
Accounting for Restricted Grants  When and How To Record ProperlyAccounting for Restricted Grants  When and How To Record Properly
Accounting for Restricted Grants When and How To Record Properly
TechSoup
 
How to Setup Default Value for a Field in Odoo 17
How to Setup Default Value for a Field in Odoo 17How to Setup Default Value for a Field in Odoo 17
How to Setup Default Value for a Field in Odoo 17
Celine George
 
Bonku-Babus-Friend by Sathyajith Ray (9)
Bonku-Babus-Friend by Sathyajith Ray  (9)Bonku-Babus-Friend by Sathyajith Ray  (9)
Bonku-Babus-Friend by Sathyajith Ray (9)
nitinpv4ai
 
A Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two HeartsA Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two Hearts
Steve Thomason
 
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
TechSoup
 
220711130083 SUBHASHREE RAKSHIT Internet resources for social science
220711130083 SUBHASHREE RAKSHIT  Internet resources for social science220711130083 SUBHASHREE RAKSHIT  Internet resources for social science
220711130083 SUBHASHREE RAKSHIT Internet resources for social science
Kalna College
 
Data Structure using C by Dr. K Adisesha .ppsx
Data Structure using C by Dr. K Adisesha .ppsxData Structure using C by Dr. K Adisesha .ppsx
Data Structure using C by Dr. K Adisesha .ppsx
Prof. Dr. K. Adisesha
 
Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...
PsychoTech Services
 

Recently uploaded (20)

How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17How to Download & Install Module From the Odoo App Store in Odoo 17
How to Download & Install Module From the Odoo App Store in Odoo 17
 
Observational Learning
Observational Learning Observational Learning
Observational Learning
 
78 Microsoft-Publisher - Sirin Sultana Bora.pptx
78 Microsoft-Publisher - Sirin Sultana Bora.pptx78 Microsoft-Publisher - Sirin Sultana Bora.pptx
78 Microsoft-Publisher - Sirin Sultana Bora.pptx
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
 
Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)Oliver Asks for More by Charles Dickens (9)
Oliver Asks for More by Charles Dickens (9)
 
Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10Haunted Houses by H W Longfellow for class 10
Haunted Houses by H W Longfellow for class 10
 
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptxRESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
 
Skimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S EliotSkimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S Eliot
 
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
 
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptx
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptxCapTechTalks Webinar Slides June 2024 Donovan Wright.pptx
CapTechTalks Webinar Slides June 2024 Donovan Wright.pptx
 
Temple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation resultsTemple of Asclepius in Thrace. Excavation results
Temple of Asclepius in Thrace. Excavation results
 
Standardized tool for Intelligence test.
Standardized tool for Intelligence test.Standardized tool for Intelligence test.
Standardized tool for Intelligence test.
 
Accounting for Restricted Grants When and How To Record Properly
Accounting for Restricted Grants  When and How To Record ProperlyAccounting for Restricted Grants  When and How To Record Properly
Accounting for Restricted Grants When and How To Record Properly
 
How to Setup Default Value for a Field in Odoo 17
How to Setup Default Value for a Field in Odoo 17How to Setup Default Value for a Field in Odoo 17
How to Setup Default Value for a Field in Odoo 17
 
Bonku-Babus-Friend by Sathyajith Ray (9)
Bonku-Babus-Friend by Sathyajith Ray  (9)Bonku-Babus-Friend by Sathyajith Ray  (9)
Bonku-Babus-Friend by Sathyajith Ray (9)
 
A Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two HeartsA Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two Hearts
 
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
 
220711130083 SUBHASHREE RAKSHIT Internet resources for social science
220711130083 SUBHASHREE RAKSHIT  Internet resources for social science220711130083 SUBHASHREE RAKSHIT  Internet resources for social science
220711130083 SUBHASHREE RAKSHIT Internet resources for social science
 
Data Structure using C by Dr. K Adisesha .ppsx
Data Structure using C by Dr. K Adisesha .ppsxData Structure using C by Dr. K Adisesha .ppsx
Data Structure using C by Dr. K Adisesha .ppsx
 
Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...
 

Kyrillidou Session One NISO Training Assessment Practices

  • 1. NISO Training Series ASSESSMENT PRACTICES AND METRICS FOR THE 21ST CENTURY Martha Kyrillidou, Ph.D., MLS, MEd QUALITYMETRICS, LLC Helping libraries and information providers achieve success www.qualitymetricsllc.com #assessment21 @nisoinfo @qualitymetrics1 @Kyrillidou OCT 19, 2018
  • 2. Our Series Is … and Is Not • Address broad advanced themes about key assessment issues that you are facing in your organization and give you ideas for moving forward strategically • A series with a strategic and broad focus, but is not training for in-depth or hands-on assessment methods • Enable you to begin thinking about a new kind of assessment plan and new approaches to some ideas you have, but is not a complete planning exercise • Introduce you to new resources, particularly new colleagues, that may be of assistance to you in the future, but is not a consultation to address your key assessment issue(s) • Challenge you to think broadly and creatively
  • 3. Guest Lecturers Martha Kyrillidou, QualityMetrics LLC Starr Hoffman, University of Nevada – Las Vegas Frankie Wilson, Bodleian Library, Oxford University Rachel Lewellen, Harvard Sarah Murphy, Ohio State Steven Braun, Northeastern Nancy Turner, Temple Charles Watkinson, University of Michigan
  • 4. Skeptical Homer •“Oh, people can come up with statistics to prove anything Kent [Brockman]. 14% of people know that.” •“Facts are meaningless. You could use facts to prove anything that's even remotely true!” • Homer Simpson
  • 5. It ain’t what you don’t know that gets you into trouble It’s what you know for sure that just ain’t so -- Mark Twain
  • 8. Information Crossroads Strategic Planning Leadership Development Financial and HR Systems Improvements Information Technology Staffing Collections Old, New, and Emerging Services
  • 9. Assessment is a structured process to: •Learn about and from our communities •Use data for effective management & decision-making •Communicate with customers & stakeholders •Seek opportunities for collaboration & comparisons •Help demonstrate library value
  • 10. Culture of Assessment Assessment is evident in our planning documents such as strategic plans Assessment is a campus priority Administrators/managers are committed to supporting assessment Staff accepts responsibility for assessment activities There is support and rewards for staff who engage in assessment Policies and procedures are designed to enable, not inhibit, fulfilling user information needs Collaboration and cooperation exists among individuals and departments My library considers user needs when allocating resources My library actively cultivates a positive relationship with its users Assessment leads to results in my library My library routinely collects, uses, and disseminates meaningful user data/feedback My library evaluates its operations and programs for quality Staff have expertise and skills in assessment
  • 21. What’s in a name? Assessment & User Experience Assessment Analyst & Consultant Assessment and Data Visualization Analyst Web Experience Project Lead Application Development Project Lead Strategic Planning & Assessment Collection Evaluation & Assessment Planning, Marketing & Communication Acquisitions & Appraisal Student Success Librarian
  • 23. Infrastructure 1. What are the current strengths of our assessment program? 2. What data are useful to you for decision making? 3. What would you like to see in the future from the library assessment program?
  • 24.