SlideShare a Scribd company logo
1 of 11
The NISO Altmetrics Initiative
NISO Update
ALA Annual – June 28, 2015
Nettie Lagace (@abugseye)
NISO Associate Director for Programs
Why worth funding?
• In order to move out of “pilot” and “proof-of-
concept” phases …
• Altmetrics must coalesce around commonly
understood definitions, calculations and data
sharing practices
• Altmetrics must be able to be audited
• Organizations who want to apply metrics will
need to understand them and ensure consistent
application and meaning across the community
Phase 1: Brainstorming
October 9, 2013 - San Francisco, CA
December 11, 2013 - Washington, DC
January 23-24, 2014 - Philadelphia, PA
Round of 1-on-1 interviews – March/Apr
Phase 1 report published in June 2014
June 26-27, 2015 5
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Unimportant
Of little importance
Moderately important
Important
Very important
n=118
Community Feedback on Project Idea Themes
Phase 2: Development
Presentations of Phase 1 report (June 2014)
Prioritization Effort (June - Nov, 2014)
Project approval (Nov - Dec 2014)
Working group formation (Jan - March 2015)
Consensus Development (March 2015 - Feb 2016)
Trial Use Period (Feb 15 - May 16)
Publication of final recommendations (Aug 16)
Working Groups
• A development of definitions and descriptions of
use
• Bdefinitions for appropriate metrics and
calculation methodologies for specific output
types and promotion and facilitation of use of
persistent identifiers
• C development of strategies to improve data
quality through source data providers.
Steering Committee
Calendar
• April 2015 – Group(s) start working
• October 2015 – Draft document(s)
• Fall 2015 – Comment period(s)
• November 2015 – NISO Report to Sloan
Foundation
• Spring 2016 – Completion of final draft(s)
http://www.niso.org/topics/tl/altmetrics_initiative/
Thank you!
Questions?
@abugseye

More Related Content

Similar to NISO Altmetrics Initiative Update at ALA Annual Conference

Evaluation amidst complexity: 8 questions evaluators should ask
Evaluation amidst complexity: 8 questions evaluators should askEvaluation amidst complexity: 8 questions evaluators should ask
Evaluation amidst complexity: 8 questions evaluators should askAnn Larson
 
AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?
AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?
AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?Tiffany Smith
 
Project Management Agility Global Survey - M.I.T.
Project Management Agility Global Survey - M.I.T.Project Management Agility Global Survey - M.I.T.
Project Management Agility Global Survey - M.I.T.Edivandro Conforto
 
logic mode is used for project analsysis
logic mode is used for project analsysislogic mode is used for project analsysis
logic mode is used for project analsysisAschalew37
 
logit model for program and service delivery works
logit model for program and service delivery workslogit model for program and service delivery works
logit model for program and service delivery worksAschalew37
 
Integrating Impact Planning into Research Projects: Reflections from the STEP...
Integrating Impact Planning into Research Projects: Reflections from the STEP...Integrating Impact Planning into Research Projects: Reflections from the STEP...
Integrating Impact Planning into Research Projects: Reflections from the STEP...STEPS Centre
 
Evaluations to improve organisational effectiveness
Evaluations to improve organisational effectivenessEvaluations to improve organisational effectiveness
Evaluations to improve organisational effectivenessInnocent Karugota Muhumuza
 
Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsDebbie_at_IDS
 
Tools And Resources For Continuous Improvement Of Technology In Schools
Tools And Resources For Continuous Improvement Of Technology In SchoolsTools And Resources For Continuous Improvement Of Technology In Schools
Tools And Resources For Continuous Improvement Of Technology In Schoolsfridayinstitute
 
CAQDAS 2014 From graph paper to digital research our Framework journey
CAQDAS 2014 From graph paper to digital research our Framework journeyCAQDAS 2014 From graph paper to digital research our Framework journey
CAQDAS 2014 From graph paper to digital research our Framework journeyKandy Woodfield
 
0 SUSTAINABLE PROJECTS OVERVIEW. 2 docx
0  SUSTAINABLE  PROJECTS OVERVIEW. 2 docx0  SUSTAINABLE  PROJECTS OVERVIEW. 2 docx
0 SUSTAINABLE PROJECTS OVERVIEW. 2 docxEstelle Gautier
 
Using Developmental Evaluation to Support Prototyping: A Workshop
Using Developmental Evaluation to Support Prototyping:A Workshop Using Developmental Evaluation to Support Prototyping:A Workshop
Using Developmental Evaluation to Support Prototyping: A Workshop unitedwaycgy
 
Evaluation tips and tools from 40+ Technology Enhance Learning projects
Evaluation tips and tools from 40+ Technology Enhance Learning projectsEvaluation tips and tools from 40+ Technology Enhance Learning projects
Evaluation tips and tools from 40+ Technology Enhance Learning projectsRachel Harris
 
Why is an evaluation plan What does it.docx
Why is an evaluation plan What does it.docxWhy is an evaluation plan What does it.docx
Why is an evaluation plan What does it.docxbkbk37
 
Danielle_Sandler_Resume_6.10
Danielle_Sandler_Resume_6.10Danielle_Sandler_Resume_6.10
Danielle_Sandler_Resume_6.10Danielle Sandler
 
UX Evaluation Design of an Online Editor for Infographics Creation
UX Evaluation Design of an Online Editor for Infographics CreationUX Evaluation Design of an Online Editor for Infographics Creation
UX Evaluation Design of an Online Editor for Infographics CreationNadia Serveti
 
The HHS Ventures Fund | 2016 Overview
The HHS Ventures Fund | 2016 OverviewThe HHS Ventures Fund | 2016 Overview
The HHS Ventures Fund | 2016 OverviewHHS IDEA Lab
 

Similar to NISO Altmetrics Initiative Update at ALA Annual Conference (20)

Basics of Extension Evaluation (Foundations Course 2019)
Basics of Extension Evaluation (Foundations Course 2019)Basics of Extension Evaluation (Foundations Course 2019)
Basics of Extension Evaluation (Foundations Course 2019)
 
Evaluation amidst complexity: 8 questions evaluators should ask
Evaluation amidst complexity: 8 questions evaluators should askEvaluation amidst complexity: 8 questions evaluators should ask
Evaluation amidst complexity: 8 questions evaluators should ask
 
AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?
AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?
AEA 2016 - 17 Step Checklist for UFE Evaluation: A Formal Dinner or A La Carte?
 
Project Management Agility Global Survey - M.I.T.
Project Management Agility Global Survey - M.I.T.Project Management Agility Global Survey - M.I.T.
Project Management Agility Global Survey - M.I.T.
 
NISO's Altmetrics Initiative
NISO's Altmetrics InitiativeNISO's Altmetrics Initiative
NISO's Altmetrics Initiative
 
logic mode is used for project analsysis
logic mode is used for project analsysislogic mode is used for project analsysis
logic mode is used for project analsysis
 
logit model for program and service delivery works
logit model for program and service delivery workslogit model for program and service delivery works
logit model for program and service delivery works
 
Integrating Impact Planning into Research Projects: Reflections from the STEP...
Integrating Impact Planning into Research Projects: Reflections from the STEP...Integrating Impact Planning into Research Projects: Reflections from the STEP...
Integrating Impact Planning into Research Projects: Reflections from the STEP...
 
Evaluations to improve organisational effectiveness
Evaluations to improve organisational effectivenessEvaluations to improve organisational effectiveness
Evaluations to improve organisational effectiveness
 
Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation Methods
 
Tools And Resources For Continuous Improvement Of Technology In Schools
Tools And Resources For Continuous Improvement Of Technology In SchoolsTools And Resources For Continuous Improvement Of Technology In Schools
Tools And Resources For Continuous Improvement Of Technology In Schools
 
M&e strategy 'reach vulnerable' annex 13.
M&e strategy 'reach vulnerable' annex 13.M&e strategy 'reach vulnerable' annex 13.
M&e strategy 'reach vulnerable' annex 13.
 
CAQDAS 2014 From graph paper to digital research our Framework journey
CAQDAS 2014 From graph paper to digital research our Framework journeyCAQDAS 2014 From graph paper to digital research our Framework journey
CAQDAS 2014 From graph paper to digital research our Framework journey
 
0 SUSTAINABLE PROJECTS OVERVIEW. 2 docx
0  SUSTAINABLE  PROJECTS OVERVIEW. 2 docx0  SUSTAINABLE  PROJECTS OVERVIEW. 2 docx
0 SUSTAINABLE PROJECTS OVERVIEW. 2 docx
 
Using Developmental Evaluation to Support Prototyping: A Workshop
Using Developmental Evaluation to Support Prototyping:A Workshop Using Developmental Evaluation to Support Prototyping:A Workshop
Using Developmental Evaluation to Support Prototyping: A Workshop
 
Evaluation tips and tools from 40+ Technology Enhance Learning projects
Evaluation tips and tools from 40+ Technology Enhance Learning projectsEvaluation tips and tools from 40+ Technology Enhance Learning projects
Evaluation tips and tools from 40+ Technology Enhance Learning projects
 
Why is an evaluation plan What does it.docx
Why is an evaluation plan What does it.docxWhy is an evaluation plan What does it.docx
Why is an evaluation plan What does it.docx
 
Danielle_Sandler_Resume_6.10
Danielle_Sandler_Resume_6.10Danielle_Sandler_Resume_6.10
Danielle_Sandler_Resume_6.10
 
UX Evaluation Design of an Online Editor for Infographics Creation
UX Evaluation Design of an Online Editor for Infographics CreationUX Evaluation Design of an Online Editor for Infographics Creation
UX Evaluation Design of an Online Editor for Infographics Creation
 
The HHS Ventures Fund | 2016 Overview
The HHS Ventures Fund | 2016 OverviewThe HHS Ventures Fund | 2016 Overview
The HHS Ventures Fund | 2016 Overview
 

More from National Information Standards Organization (NISO)

More from National Information Standards Organization (NISO) (20)

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"
 
Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"
 
Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
 
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
 
Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"
 
Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"
 
Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"
 
Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"
 
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
 
Ross and Clark "Strategic Planning"
Ross and Clark "Strategic Planning"Ross and Clark "Strategic Planning"
Ross and Clark "Strategic Planning"
 
Mattingly "Data Mining Techniques: Classification and Clustering"
Mattingly "Data Mining Techniques: Classification and Clustering"Mattingly "Data Mining Techniques: Classification and Clustering"
Mattingly "Data Mining Techniques: Classification and Clustering"
 
Straza "Global collaboration towards equitable and open science: UNESCO Recom...
Straza "Global collaboration towards equitable and open science: UNESCO Recom...Straza "Global collaboration towards equitable and open science: UNESCO Recom...
Straza "Global collaboration towards equitable and open science: UNESCO Recom...
 
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
 
Kriegsman "Integrating Open and Equitable Research into Open Science"
Kriegsman "Integrating Open and Equitable Research into Open Science"Kriegsman "Integrating Open and Equitable Research into Open Science"
Kriegsman "Integrating Open and Equitable Research into Open Science"
 
Mattingly "Ethics and Cleaning Data"
Mattingly "Ethics and Cleaning Data"Mattingly "Ethics and Cleaning Data"
Mattingly "Ethics and Cleaning Data"
 
Mercado-Lara "Open & Equitable Program"
Mercado-Lara "Open & Equitable Program"Mercado-Lara "Open & Equitable Program"
Mercado-Lara "Open & Equitable Program"
 

NISO Altmetrics Initiative Update at ALA Annual Conference

  • 1. The NISO Altmetrics Initiative NISO Update ALA Annual – June 28, 2015 Nettie Lagace (@abugseye) NISO Associate Director for Programs
  • 2.
  • 3. Why worth funding? • In order to move out of “pilot” and “proof-of- concept” phases … • Altmetrics must coalesce around commonly understood definitions, calculations and data sharing practices • Altmetrics must be able to be audited • Organizations who want to apply metrics will need to understand them and ensure consistent application and meaning across the community
  • 4. Phase 1: Brainstorming October 9, 2013 - San Francisco, CA December 11, 2013 - Washington, DC January 23-24, 2014 - Philadelphia, PA Round of 1-on-1 interviews – March/Apr Phase 1 report published in June 2014
  • 5. June 26-27, 2015 5 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Unimportant Of little importance Moderately important Important Very important n=118 Community Feedback on Project Idea Themes
  • 6. Phase 2: Development Presentations of Phase 1 report (June 2014) Prioritization Effort (June - Nov, 2014) Project approval (Nov - Dec 2014) Working group formation (Jan - March 2015) Consensus Development (March 2015 - Feb 2016) Trial Use Period (Feb 15 - May 16) Publication of final recommendations (Aug 16)
  • 7.
  • 8. Working Groups • A development of definitions and descriptions of use • Bdefinitions for appropriate metrics and calculation methodologies for specific output types and promotion and facilitation of use of persistent identifiers • C development of strategies to improve data quality through source data providers.
  • 10. Calendar • April 2015 – Group(s) start working • October 2015 – Draft document(s) • Fall 2015 – Comment period(s) • November 2015 – NISO Report to Sloan Foundation • Spring 2016 – Completion of final draft(s)

Editor's Notes

  1. Develop specific definitions for alternative assessment metrics. (87.9%) Promote and facilitate use of persistent identifiers in scholarly communications. (82.8%) Develop strategies to improve data quality through normalization of source data across providers. (80.8%) Identify research output types that are applicable to the use of metrics. (79.8%) Define appropriate metrics and calculation methodologies for specific output types, such as software, datasets, or performances. (78.1%) Explore creation of standardized APIs or download or exchange formats to facilitate data gathering. (72.5%) Research issues surrounding the reproducibility of metrics across providers. (70.7%)