Gordon - Lightning talk at NISO Altmetrics Initiative


Published on

Greg Gordon - Building trust into altmetrics Lightning talk at NISO Altmetrics Initiative Brainstorming conference in San Francisco, CA on October 9, 2013

Published in: Technology, Education
1 Like
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • NISO to Develop Standards and Recommended Practices for AltmetricsGrant from Sloan Foundation will fund community-informed effort to standardize collection and use of alternative metrics measuring research impactBaltimore, MD - June 20, 2013 - The National Information Standards Organization (NISO) announces a new two-phase project to study, propose, and develop community-based standards or recommended practices in the field of alternative metrics. Assessment of scholarship is a critical component of the research process, impacting everything from which projects get funded to who gains promotion and tenure to which publications gain prominence. Since Eugene Garfield's pioneering work in the 1960s, much of the work on research assessment has been based upon citations, a valuable measure but one that has failed to keep pace with online reader behavior, network interactions with content, social media, and online content management. Exemplified by innovative new platforms like ImpactStory, a new movement is growing to develop more robust alternative metrics—called altmetrics—that complement traditional citation metrics. NISO will first hold several in-person and virtual meetings to identify critical areas where altmetrics standards or recommended practices are needed and then convene a working group to develop consensus standards and/or recommended practices. The project is funded through a $207,500 grant from the Alfred P. Sloan Foundation."Citation analysis lacks ways to measure the newer and more prevalent ways that articles generate impact such as through social networking tools like Twitter, Facebook, or blogs," explains Nettie Lagace, NISO's Associate Director for Programs. "Additionally, new forms of scholarly outputs, such as datasets, software tools, algorithms, or molecular structures are now commonplace, but they are not easily—if at all—assessed by traditional citation metrics. These are two among the many concerns the growing movement around altmetrics is trying to address.""For altmetrics to move out of its current pilot and proof-of-concept phase, the community must begin coalescing around a suite of commonly understood definitions, calculations, and data sharing practices," states Todd Carpenter, NISO Executive Director. "Organizations and researchers wanting to apply these metrics need to adequately understand them, ensure their consistent application and meaning across the community, and have methods for auditing their accuracy. We must agree on what gets measured, what the criteria are for assessing the quality of the measures, at what granularity these metrics are compiled and analyzed, how long a period the altmetrics should cover, the role of social media in altmetrics, the technical infrastructure necessary to exchange this data, and which new altmetrics will prove most valuable. The creation of altmetrics standards and best practices will facilitate the community trust in altmetrics, which will be a requirement for any broad-based acceptance, and will ensure that these altmetrics can be accurately compared and exchanged across publishers and platforms.""Sensible, community-informed, discipline-sensitive standards and practices are essential if altmetrics are to play a serious role in the evaluation of research," says Joshua M. Greenberg, Director of the Alfred P. Sloan Foundation's Digital Information Technology program. "With its long history of crafting just such standards, NISO is uniquely positioned to help take altmetrics to the next level."The first phase of the project will gather two groups of invited experts in altmetrics research, traditional publishing, bibliometrics, and faculty assessment for in-person discussions with the goal of identifying key altmetrics issues and those that can best be addressed through standards or recommended practices. This input will form the basis of two virtual meetings open to the public to further refine and prioritize the issues. Additional community input will be sought through an array of electronic and social mechanisms and events coordinated with major community conferences. A report summarizing this input will identify the specific areas where NISO should develop standards or recommended practices, which will be undertaken by a working group convened in phase two. The complete project from initial meetings to publication of standards is expected to take two years. Information about the meetings and other methods for participation will be announced on the NISO website (www.niso.org) and in the monthly Newsline e-newsletter (www.niso.org/publications/newsline/).
  • 18 month backlog for 2 journals
  • There are problems, there are issues and the evangelists on both sides aren’t going to resolve them THUS the need for THIS discussion – for STANDARDS
  • LIMIT THE SCOPE OF YOUR GREATNESS – What did you say NO to today?Jobs said in an interview with Betsy Morris in 2008, "People think focus means saying 'yes' to the thing you've got to focus on. But that's not what it means at all. It means saying 'no' to the hundred other good ideas that there are. You have to pick carefully. I'm actually as proud of the things we haven't done as the things we have done.”
  • Gordon - Lightning talk at NISO Altmetrics Initiative

    1. 1. NISO Altmetrics 2013
    2. 2. TRUST Gregg_Gordon@SSRN.Com SSRNblog.com @SSRN facebook: SSRNCommunity
    3. 3. TRUST what is it good for … Gregg_Gordon@SSRN.Com SSRNblog.com @SSRN facebook: SSRNCommunity
    4. 4. 537,000 1,210,000 1,730,000 2,200,000 2,800,000 2,950,000 3,400,000 4,950,000 6,850,000 7,900,000 8,400,000 9,300,000 11,000,000 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 SSRN Downloads
    5. 5. 537,000 1,210,000 1,730,000 2,200,000 2,800,000 2,950,000 3,400,000 4,950,000 6,850,000 7,900,000 8,400,000 9,300,000 11,000,000 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 SSRN Downloads Ranking Accounting Ph.D. Programs and Faculties Using Social Science Research Network Downloads Lawrence D. Brown Ranking Law Schools: Using SSRN to Measure Scholarly Performance Bernard S. Black and Paul L. Caron Ranking Journals Using Social Science Research Network Downloads Lawrence D. Brown Assessing the SSRN-Based Law School Rankings Theodore Eisenberg
    6. 6. problems are solvable
    7. 7. To attain knowledge, add things every day. To attain wisdom, subtract things every day. - Lao Tzu