Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Research impact beyond metrics

12,273 views

Published on

Traditional metrics, such as the h-index and journal impact factors, are used to measure the scholarly impact of research. However, in the current climate of accountability by funding providers, fund recipients would benefit from a more comprehensive impact management system (IMS) to facilitate the capture and reporting of narratives (including metrics) about research impact in the academy, on social policy, in industry, and ultimately with the public.

Librarians have always been good at telling and facilitating stories. Research support librarians can use their storytelling skills to contribute to the implementation and administration of an impact management system. Being able to translate research impact into harvestable and reportable metadata is the key.

Published in: Education
  • Get Now to Read PDF eBook === http://capitolcurrents.com/b017wotsfe-current-research-in-acupuncture-by-ying-xia-published-august-2012.html
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • I would HIGHLY recommend the bulimia recovery program. Shaye and the girls on the site are beyond amazing. Without even meeting anyone, I have felt kindness, love, and incredible support. For that reason alone it is worth it. But the guides, information, meal planning tools, binge tracker, blog, forums, and vidoes are more reasons to join. I truly think that if you struggle with an eating disorder this program will help you overcome it and change your life for the better. ■■■ https://tinyurl.com/y88w4b6s
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Research impact beyond metrics

  1. 1. Impact beyond metrics: Tellingyour research impact storyResearch Support Community DayBrisbane, Australia, 11 February 2013Pat LoriaResearch LibrarianUniversity of Southern Queensland
  2. 2. Limitations of traditional metrics Scholarly Public Recommended Faculty of 1000 Popular press Cited Traditional citations Wikipedia Discussed Scholarly blogs Facebook, Twitter Saved Mendeley, CiteULike Delicious Viewed PDF views HTML views Adapted from Jason Priem, Altmetrics and Revolutions: https://docs.google.com/presentation/pub?id=1Y4JnchsmHHiOQdJsEpQr33qm MWqhZJrPTDAg1cZoCcI&start=false&loop=false&delayms=3000#slide=id.i0
  3. 3. Limitations of traditional metrics Scholarly Public Recommended Faculty of 1000 Popular press Cited Traditional citations Wikipedia Discussed Scholarly blogs Facebook, Twitter Saved Mendeley, CiteULike Delicious Viewed PDF views HTML views Adapted from Jason Priem, Altmetrics and Revolutions: https://docs.google.com/presentation/pub?id=1Y4JnchsmHHiOQdJsEpQr33qm MWqhZJrPTDAg1cZoCcI&start=false&loop=false&delayms=3000#slide=id.i0
  4. 4. Three generations of impact metrics Journal- Author- Article- level level level metrics metrics metrics
  5. 5. Different levels of metrics  Journal-level metrics  Journal impact factor  SJR & SNIP  Author-level metrics  Citations per Paper (CPP)  H-index  Article-level metrics  Articles, datasets, blogs, code, artistic creations  Citations, mentions, views, downloads, etc.  Altmetric bookmarklet, ImpactStory, etc.
  6. 6. USQ and the NCP calculator  NCP: Normalized Citations per Paper  Developed by USQ (Library and Systems)  Uses Scopus RDCP data to normalize  Normalization creates a level playing field  Citations in low visibility/low citing fields normalized up  Citations in high visibility/high citing fields normalized down  Source code for NCP calculator to be released soon on GitHub
  7. 7. NCP calculator Citations: 2010; Papers: 2007-2009
  8. 8. Measuring impact beyond academia …impact is defined in a similar way as for the UK REF, i.e. “an effect on, change, benefit to the economy, society, culture, public policy or services, health, the environment or quality of life beyond academia”. ATN and Go8, Guidelines for completion of case studies in ATN/Go8 EIA Impact Assessment Trial: June – August 2012, http://www.atn.edu.au/eia/Docs/EIA_Trial_Guidelines_FINAL.pdf
  9. 9. Measuring impact beyond academia Impact Case Study (ATN & Go8, similar to REF)  Institution  SEO codes • Overheads? • Data sources?  Title of Case Study  Context  Summary of Case Study Impact  Details of Impact  Research underpinning Impact  Research outputs from research underpinning impact  Additional information:  Validation of impact  People  Investment income http://www.atn.edu.au/eia/Docs/EIA_Trial_Guidelines_FINAL.pdf
  10. 10. Alternative metrics or altmetrics [A]ltmetrics is the creation and study of new metrics based on the Social Web for analyzing, and informing scholarship. http://altmetrics.org/about/
  11. 11. Altmetric bookmarklet http://www.altmetric.com/bookmarklet.php
  12. 12. Altmetric bookmarklet  Free bookmark for Chrome, Firefox and Safari  Click on while viewing paper for impact data  Altmetric API can be embedded into second and third-party platforms, apps and mashups  Only works on PubMed, arXiv or DOI  Only supports publishers who embed Google Scholar friendly citation metadata  Twitter mentions are only available for articles published since July 2011 Example: Oxidants, antioxidants and the current incurability of metastatic cancers
  13. 13. Altmetric bookmarklet http://www.altmetric.com/bookmarklet.php Counts Disadvantages / Bugs Altmetric score Difficult to explain Tweeters Facebook users News outlets Science blogs Google+ users Mendeley readers CiteULike readers Connotea readers Bookmarklet only works on PubMed, arXiv or pages containing a DOI Only supports publishers who embed Scholar friendly citation metadata Twitter mentions are only available for articles published since July 2011
  14. 14. ImpactStory.org Artefact type Counts Known Bugs 12/12 Journal article Topsy Twitter coverage weak Dataset Science Seeker Different results for DOI Software PubMed and URL searches Slides Dryad Missing metrics Generic SlideShare Metrics too low Wikipedia Figshare PLoS Search PLoS ALM Delicious Facebook No link to mentions Scopus CiteULike GitHub Mendeley
  15. 15. ImpactStory.org
  16. 16. PlumAnalytics.com  Usage - Downloads, views, book holdings, ILL, document delivery  Captures - Favourites, bookmarks, saves, readers, groups, watchers  Mentions - blog posts, news stories, Wikipedia articles, comments, reviews  Social media - Tweets, +1s, likes, shares, ratings  Citations - Web of Science, Scopus, Google Scholar, Microsoft Academic Search
  17. 17. PlumAnalytics.com  articles  presentations  book chapters  source code  books  videos  clinical trials  greatest sources  datasets  researcher graph  figures  group metrics  grants  paid service  patents  no API available
  18. 18. Reasons to use altmetrics  Same reasons as using traditional metrics:  Grants, promotions, staff/program review  Review research dissemination strategy  Measure of influence and reach of output  Publishers can add value for authors/readers  Informed decisions by research managers  Comprehensive view of impact for funders  “Citation graph data is like Chekhov’s gun: once on stage, it has to be fired.” (Peter Vinkler, cited by Jason Priem, Altmetrics and Revolutions)
  19. 19. Article Level Metrics (ALMs) “Article-Level Metrics are a comprehensive set of impact indicators that enable numerous ways to assess and navigate research most relevant to the field” (http://article-level-metrics.plos.org/alm-info/)
  20. 20. PLoS ALMshttp://article-level-metrics.plos.org/alm-info/
  21. 21. PLoS example
  22. 22. Source: http://article-level-metrics.plos.org/researchers/
  23. 23. Research profile systems For example, Symplectic Elements:
  24. 24. The great objection! It’s not real impact! = It’s not scholarly impact. Research Impact Story Scholarly Public Government Industry
  25. 25. What is USQ’s research impact story?
  26. 26. Impact management system (IMS) • Metadata • Metadata • Metadata • Metadata • Metadata • Metadata • Metadata • Metadata Impact • Metadata Metrics Research Curriculum Outputs Vitae • Metadata • Metadata • Metadata • Metadata • Metadata • Metadata Esteem Human Measures ResourcesFlexible IMS Reportable Research Professional Income Activities • • • Metadata Metadata Metadata Metadata is key! • • • Metadata Metadata Metadata Community Industry Impact Impact • Metadata • Metadata Policy • Metadata • Metadata Impact • Metadata • Metadata • Metadata • Metadata • Metadata
  27. 27. Impact metadata Design according to reporting needs  Academic  Industry  Citation  Consultation  Publication  Partnership  Teaching  Patent  Supervision  Social  Research project  Altmetric  Research income  Facebook  Government  Twitter  Mendeley  Application  Wikipedia  Consultation  Engagement  Social policy  Media coverage
  28. 28. Discussions with Symplectic
  29. 29. Librarian as storyteller Image: http://kassonpubliclibrary.blogspot.com.au/2010/03/spring-planting-at-library-storytime.html
  30. 30. Advantages of IMS  Facilitates storytelling of research impact  Saves time for researchers and managers  Enables internal and external reporting  Evidence base for individual/program review  Accommodates government requirements  Data for case studies and grant applications  Impact captured for longitudinal analysis  Best IMS support transfer of data to other IMS  Managing impact: a new research literacy?
  31. 31. Take-aways  Holistic impact monitoring and reporting  Make it easy for academics and managers  Do you need an impact management system?  What is your research impact story? http://jeps.efpsa.org/blog/2012/06/20/maximizing-research-impact/
  32. 32. Research impact discussion Pat Loria Email: pat.loria@usq.edu.au Twitter: @pat_loria Image: http://www.duffysrehab.com/blog/want-to-make-an-impact-consider-betty-ford

×