Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Stephanie Faulkner - Understanding the performance of SciELO journals based on CiteScore, citation index comparisons and PlumX metrics


Published on

One of the basic functions of the SciELO Publishing Model is to follow up the performance of journals, national collections, the network and the overall program. In the context of national collections, which in most cases are financed by public resources and are highly selective regarding indexing, the good performance of journals is expected in line with the specific objectives of SciELO to contribute to their sustainable increase of editorial quality, visibility, use and impact. In addition to the specific objectives that apply to the entire network, national collections are governed by priorities determined by national policies and conditions.

The performance of journals and SciELO collections are evaluated by the following criteria:

• Institutionality, which refers to institutions responsible for the journals and their respective research communities as indicators of credibility and operational sustainability of journals;

• Good practices of editing and scholarly communication, which refers to the adherence to the SciELO indexing criteria that implies in adherence to the good practices of scholarly communication and adoption of innovations;

• Visibility, Use and Impact, which refer to the following contexts:
◦ Access and downloads indicators to articles’ full text files in HTML and PDF formats;
◦ Citations indicators or metrics considering different journal indexes;
◦ Web presence indicators or altmetrics.

The scope proposed for this working group encompasses the analysis of journals performance in accordance with the above criteria, taking into account the specificities of different thematic areas and different countries. The analysis and discussion of these three dimensions will be conducted by scholarly communication and bibliometrics experts with the support of representatives of national collections, journal editors and specialists.

Published in: Science
  • Be the first to comment

  • Be the first to like this

Stephanie Faulkner - Understanding the performance of SciELO journals based on CiteScore, citation index comparisons and PlumX metrics

  1. 1. | www.plumanalytics.com1 Understanding the performance of SciELO journals based on CiteScore, citation index comparisons and PlumX metrics 24 September 2018 Stephanie Faulkner | Product Manager | +1.732.216.5104
  2. 2. | www.plumanalytics.com2 Supporting and developing metrics for the full lifecycle of research We strive for broader use of open metrics that can be used by everyone responsibly. Research Metrics at Elsevier 2 Our Approach Elsevier Research Metrics Guidebook: intelligence/resource-library/research-metrics-guidebook
  3. 3. | www.plumanalytics.com3 Measuring Journal Impact Using CiteScore
  4. 4. | www.plumanalytics.com4 CiteScore • CiteScore is a simple way of measuring the citation impact of serial titles such as journals. Serial titles are defined as titles which publish on a regular basis (i.e. one or more volumes per year).
  5. 5. | www.plumanalytics.com5 CiteScore
  6. 6. | www.plumanalytics.com6 CiteScore Calculation
  7. 7. | www.plumanalytics.com7 CiteScore
  8. 8. | www.plumanalytics.com8 CiteScore Tracker • CiteScore Tracker is calculated in the same way as CiteScore, but for the current year rather than previous, complete years. The CiteScore Tracker calculation is updated every month, as a current indication of a title's performance.
  9. 9. | www.plumanalytics.com9 CiteScore Tracker
  10. 10. | www.plumanalytics.com10 CiteScore Rank & Trends
  11. 11. | www.plumanalytics.com11 CiteScore Rank & Trends
  12. 12. | www.plumanalytics.com12 Compare Journals
  13. 13. | www.plumanalytics.com13 Compare Journals
  14. 14. | www.plumanalytics.com14 CiteScore highlights for SciELO • Only one journal is in the 90th percentile in it’s category - Revisita de Saude Publica
  15. 15. | www.plumanalytics.com15 CiteScore highlights for SciELO - 9 journals are in the 75-89th percentile: - Clinics (88%) - Revista Brasileira de Politica Internacional (86%) - Journal of Venomous Animals and Toxins Including Tropical Diseases (85%) - Revista Brasiliera de Parasitologia Veterinaria (82%) - Journal of Applied Oral Science (79%) - Anais de Academia Brasiliera de Ciecneias (78%) - Brazilian Archives of Biology and Technology (76%) - Rodriguesia (75%) - Scientia Agricola (75%)
  16. 16. | www.plumanalytics.com16 CiteScore highlights for SciELO • 49 journals rank in the second quartile (74%- 50%) • 136 journals rank in the third quartile (49%- 25%) • 109 journals rank in the 4th quartile (24%-0%)
  17. 17. | www.plumanalytics.com17
  18. 18. | www.plumanalytics.com18 Measuring Performance Using PlumX Metrics
  19. 19. | www.plumanalytics.com19 Defining altmetrics • Altmetrics = Alternative ways of measuring the use and impact of scholarship • Altmetrics combine traditional impact measures (citation counts) with non-traditional measures • Altmetrics = ALL METRICS “Altmetrics are measures of scholarly impact mined from activity in online tools and environments” – Jason Priem, Co-Founder, ImpactStory Using Altmetrics to Illustrate the Impact of Open Access on Graduate Student Research (Barnett, Collister, Chan 2014)
  20. 20. | www.plumanalytics.com20 USAGE (clicks, downloads, views, library holdings, video plays) CAPTURES (bookmarks, code forks, favorites, readers, watchers) MENTIONS (blog/news posts, comments, reviews, Wikipedia links) SOCIAL MEDIA (tweets, likes, shares, comments) CITATIONS (citation indexes, patent citations, clinical citations) Metrics Categories
  21. 21. | www.plumanalytics.com21 USAGE Clicks, Downloads, Views, Library Holdings, Video plays • Is anyone reading our work? • Did anyone watch our videos? • Usage is the #1 stat researchers want to know after Citation counts • PlumX is the only product that includes Usage
  22. 22. | www.plumanalytics.com22 CAPTURES Readers, Exports/Saves, Favorites, Followers • Captures indicate that someone wants to come back to the work • The number of times a citation/abstract has been saved, emailed or printed • Early indicator of future citations
  23. 23. | www.plumanalytics.com23 MENTIONS Blog posts, News posts, Book reviews, Wikipedia references • This category measures people truly engaging with your research • Automatically uncover the conversations about your research • Discover feedback, opinions, etc.
  24. 24. | www.plumanalytics.com24 SOCIAL MEDIA Shares, likes, & comments, Tweets • Social media measures how well a publisher or researcher is promoting their work • Track the buzz and attention around your research output • This is especially important for early career researchers to measure and understand
  25. 25. | www.plumanalytics.com25 CITATIONS Citation Indexes, Patent Citations, Clinical Citations, Policy Citations • Citations still a standard of long-term impact • Including citations enables side-by-side analysis with other metrics categories
  26. 26. | www.plumanalytics.com26 Visualizing Impact: Plum Print • Includes the 5 categories of metrics • Circles dynamically change size based on metrics in each category
  27. 27. | www.plumanalytics.com27 PlumX Metrics in SciELO
  28. 28. | www.plumanalytics.com28 PlumX Artifact Page
  29. 29. | www.plumanalytics.com29 ACI Amazon Airiti bepress CABI CrossRef Dryad dSpace DynaMed Plus EBSCO ePrints Facebook figshare Github Goodreads Google+ Mendeley NICE (UK) OJS Journals PLOS PubMed PubMed Central Reddit RePEc SciElo Scopus SlideShare SourceForge SSRN Stack Exchange Twitter USPTO Vimeo Wikipedia Worldcat YouTube D MP Scholarly Data Exhaust – Data Source Examples
  30. 30. | www.plumanalytics.com30 PlumX Dashboard
  31. 31. | www.plumanalytics.com31 Most Citations 2013-2018: SciELO
  32. 32. | www.plumanalytics.com32 Most Citations 2013-2018: SciELO
  33. 33. | www.plumanalytics.com33 Most Citations 2013-2018: Scopus
  34. 34. | www.plumanalytics.com34 Most Citations 2013-2018: Scopus
  35. 35. | www.plumanalytics.com35 Benchmarking Journals by Country - Colombia
  36. 36. | www.plumanalytics.com36 Benchmarking Journals by Country - Colombia
  37. 37. | www.plumanalytics.com37 Benchmarking Journals by Country - Colombia
  38. 38. | www.plumanalytics.com38 Benchmarking Journals by Country - Colombia
  39. 39. | www.plumanalytics.com39 Benchmarking Journals by Subject Area
  40. 40. | www.plumanalytics.com40 Benchmarking Journals by Subject Area
  41. 41. | www.plumanalytics.com41 Summary • CiteScore metrics help you measure citation impact in a comprehensive and transparent way. • CiteScore Tracker provides you a way to see how your journal is performing in the current year. • CiteScore Rank & Trends lets you see how your journal ranks against other journals in the same category. • PlumX Metrics and the SciELO PlumX Dashboard gives you article-level metrics, organized by country/journal and subject area/journal. • The Subgroup Overview in the PlumX Dashboard allows you to benchmark by country, by journals in a country and by journals in a subject area, helping identify high and low performers and find insights about what is driving high performance.
  42. 42. | www.plumanalytics.com42 Questions?
  43. 43. Thank You +1.732.216.5104 Stephanie Faulkner Find out more information at: