Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Monitoring & evaluating the usage
of your Open Access journal
Applying scientific thinking
in the service of society
Agenda
 General tools
Ina Smith
 Platform specific tools (SciELO SA)
Louise van Heerden
 Journal specific tools (South ...
General Tools – Ina Smith
 Google Tools
 Piwik
 Publish or Perish
 Crossref
 Open Journal Systems (OJS)
About your Journal
Prepare your journal
 Search engine/harvester friendly – Base URL
http://journals.assaf.org.za/per/oai
 Standardized met...
Impact Factor
Thomson Reuters JIF against ethics and principles of
OA
relates less and less to citation rates
unrelated to...
Web of Science
 Guidelines:
http://wokinfo.com/essays/journal-selection-
process/
 Suggest a title:
http://ip-
science.t...
Scopus
 Guidelines:
https://www.elsevier.com/solutions/scopus/content
#content-policy-and-selection
 Suggest a title:
ht...
Norwegian Registry for Scientific Journals,
Series and Publishers Level 2
 Guidelines:
https://dbh.nsd.uib.no/publisering...
Google Mail
Register a Gmail account for your journal
https://accounts.google.com/SignUp
Google Analytics
Add the journal to Google Analytics
http://analytics.google.com
Google Analytics
Google Analytics
Embed
code in
every web
page
Create connection between OJS &
Google Analytics
Journal Manager >> System Plugins (General)
Google Analytics Results
Google Analytics
Google Scholar Metrics
List of titles: https://scholar.google.com/citations?view_op=top_venues
Overview:
https://scholar.g...
Register a new web site with Google
https://www.google.com/webmasters/tools/submit-url
Google Scholar Citations Profile
Google Scholar Citations Profile
https://scholar.google.co.za/intl/en/scholar/citations.html
Publish or Perish
Publish or Perish
Overview: http://www.harzing.com/pophelp/journal-
impact.htm
Download: http://www.harzing.com/resources/...
Piwik
https://piwik.org/
Crossref
http://www.crossref.org/06members/51depositor.html
10.17159/2413-3108/2009/v21i2a296
OJS (Open Journal Systems)
https://www.projectcounter.org/
OJS
Alternative Metrics in OJS
http://pkp-alm.lib.sfu.ca/
Usage of accompanying data sets
http://dataverse.org
https://www.datacite.org/
Platform specific tools – Louise van Heerden
SciELO SA
• Scientific Electronic Library Online (SciELO)
• SA’s premier open-access database
• Full-text, peer-reviewed j...
Statistics
1) SciELO Website
2) SciELO Analytics (Beta version)
SciELO uses the COUNTER Code of Practice
On the HTML - if a user stays on the page for more
than 10 seconds = 1 access
On ...
SciELO.org
journals evaluation
Português
Español
help
about this site
SciELO news
SciELO team
serial browsing
alphabetic l...
Journal citation reports
• Source data
• Impact factor on a two-year basis
• Impact factor on a three-year basis
• Half-li...
Journal citation reports
Published in…. Select date and the journal title
Journal citation reports URL
All
2016
2015
2014
...
Analytics SciELO SA – per Journal
Metrics of the usage of SAJS
within the SciELO system
Journal title/year No. of
issues
N...
2) SciELO Analytics
Link to SciELO Analytics (currently a beta version)
– Collection level
– Journal level
– Article level...
Analytics – SciELO SA Collection
Accesses in October 2016
Global usage
SciELO SA – most accessed journals
over the last 12 months
Journal html pdf abstracts total
SAMJ: South African
Medical Jo...
Most accessed articles
http://analytics.scielo.org/w/accesses/list/articles?collection=sza
Article html pdf abstract total...
Analytics SciELO SA – per Journal
Analytics – per Journal Article
Summary
1) SciELO Website : Link
2) SciELO Analytics (Beta version) Link
(Remember to right click and select “Translate to...
Analytics - Upcoming
To conclude, we look forward to the following:
• SciELO new interface (look and feel) – The beta
vers...
Journal specific tools
(South African Journal of Science)
Nadine Wubbeling & Linda Fick
Tools for increasing &
measuring the reach and
impact of your journal
1. Social Media
https://www.facebook.com/southafricanjournalofscience
Facebook
1. Social Media
https://twitter.com/SAJS_Official
Twitter
Social Media:
In-house analytics tools
Social Media:
In-house analytics tools
Buffer
Other tools
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
Twitte...
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
2. Electronic distribution
Media Releases:
Mailchimp
Mailchimp
Multimodal spatial mapping and visualisation of
Dinaledi Chamber and Rising Star Cave
Volume 112, Issue 5/6
Day of publica...
Plant metabolomics: A new frontier in phytochemical
analysis
Volume 109, Issue 5/6
Day of publication, 13 May 2013 – 13 vi...
3. Collaborate with authors & institutions
• Identify one or two articles to highlight per issue to start with.
Ask the au...
http://www.wits.ac.za/news/latest-news/research-news/2016/2016-07/hominin-cancer/
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
Day of...
4. Other publishing platforms and indexes
Article-level metrics to measure
your reach and impact
Google Analytics
https://analytics.google.com/analytics/web
Google Analytics
Drought, climate change and sustainability of water AUTHORS: in
agriculture: A roadmap towards the NWRS2
Views and Downloads
Summary
Tool Measure
Social Media Potential Audience, Likes, Clicks, Retweets, shares,
comments. Through in-house analytic...
Thank you!
 Susan Veldsman
susan@assaf.org.za
 Ina Smith
ina@assaf.org.za
 Louise van Heerden
louise@assaf.org.za
 Nad...
Monitoring & evaluating the usage of your Open Access Journal
Monitoring & evaluating the usage of your Open Access Journal
Upcoming SlideShare
Loading in …5
×

Monitoring & evaluating the usage of your Open Access Journal

496 views

Published on

Discussion of various tools to track the usage and return on investment of your journal.

Published in: Internet
  • Be the first to comment

  • Be the first to like this

Monitoring & evaluating the usage of your Open Access Journal

  1. 1. Monitoring & evaluating the usage of your Open Access journal Applying scientific thinking in the service of society
  2. 2. Agenda  General tools Ina Smith  Platform specific tools (SciELO SA) Louise van Heerden  Journal specific tools (South African Journal of Science) Nadine Wubbeling & Linda Fick
  3. 3. General Tools – Ina Smith  Google Tools  Piwik  Publish or Perish  Crossref  Open Journal Systems (OJS)
  4. 4. About your Journal
  5. 5. Prepare your journal  Search engine/harvester friendly – Base URL http://journals.assaf.org.za/per/oai  Standardized metadata schema (XML)  Google Sitemap  Open source software using open standards  Integration with other tools e.g. ORCID, Crossref DOIs, etc.  Web site vs Journal Management System
  6. 6. Impact Factor Thomson Reuters JIF against ethics and principles of OA relates less and less to citation rates unrelated to individual article quality in a journal unrelated to quality of individual scientist publishing in a given journal Display of IF information on journal web page discouraged 1. Corneliussen, S.T. (2016) ‘Bad summer for the journal impact factor’, Physics Today, . doi: 10.1063/PT.5.8183. 2. Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan, S., Taylor, S., Curry, S., de Montreal, U., @@, A., mmcnutt and Nature, S. (2016) ‘A simple proposal for the publication of journal citation distributions’, New Results, , p. 62109. doi: 10.1101/062109. 3. The demise of the impact factor: The strength of the relationship between citation rates and IF is down to levels last seen 40 years ago (2012) Available at: http://blogs.lse.ac.uk/impactofsocialsciences/2012/06/08/demise-impact-factor-relationship-citation- 1970s/ (Accessed: 11 August 2016).
  7. 7. Web of Science  Guidelines: http://wokinfo.com/essays/journal-selection- process/  Suggest a title: http://ip- science.thomsonreuters.com/info/journalsubmission -front/
  8. 8. Scopus  Guidelines: https://www.elsevier.com/solutions/scopus/content #content-policy-and-selection  Suggest a title: http://suggestor.step.scopus.com/suggestTitle/step 1.cfm
  9. 9. Norwegian Registry for Scientific Journals, Series and Publishers Level 2  Guidelines: https://dbh.nsd.uib.no/publiseringskanaler/OmKriter ier?request_locale=en  Suggest a title: https://dbh.nsd.uib.no/publiseringskanaler/OmPros edyrer?request_locale=en
  10. 10. Google Mail Register a Gmail account for your journal https://accounts.google.com/SignUp
  11. 11. Google Analytics Add the journal to Google Analytics http://analytics.google.com
  12. 12. Google Analytics
  13. 13. Google Analytics Embed code in every web page
  14. 14. Create connection between OJS & Google Analytics Journal Manager >> System Plugins (General)
  15. 15. Google Analytics Results
  16. 16. Google Analytics
  17. 17. Google Scholar Metrics List of titles: https://scholar.google.com/citations?view_op=top_venues Overview: https://scholar.google.co.za/intl/en/scholar/metrics.html#overview
  18. 18. Register a new web site with Google https://www.google.com/webmasters/tools/submit-url
  19. 19. Google Scholar Citations Profile
  20. 20. Google Scholar Citations Profile https://scholar.google.co.za/intl/en/scholar/citations.html
  21. 21. Publish or Perish
  22. 22. Publish or Perish Overview: http://www.harzing.com/pophelp/journal- impact.htm Download: http://www.harzing.com/resources/publish-or- perish
  23. 23. Piwik https://piwik.org/
  24. 24. Crossref http://www.crossref.org/06members/51depositor.html 10.17159/2413-3108/2009/v21i2a296
  25. 25. OJS (Open Journal Systems) https://www.projectcounter.org/
  26. 26. OJS
  27. 27. Alternative Metrics in OJS http://pkp-alm.lib.sfu.ca/
  28. 28. Usage of accompanying data sets http://dataverse.org https://www.datacite.org/
  29. 29. Platform specific tools – Louise van Heerden
  30. 30. SciELO SA • Scientific Electronic Library Online (SciELO) • SA’s premier open-access database • Full-text, peer-reviewed journals • Part of the SciELO Network started in Brazil • Managed by the Academy of Science of SA (ASSAf) • Funded by the South African Department of Science and Technology • Endorsed by the South African Department of Higher Education and Training • www.scielo.org.za
  31. 31. Statistics 1) SciELO Website 2) SciELO Analytics (Beta version)
  32. 32. SciELO uses the COUNTER Code of Practice On the HTML - if a user stays on the page for more than 10 seconds = 1 access On the PDF – if a user stays on the page for more than 30 seconds = 1 access No robot access is counted How SciELO defines ‘’access’’
  33. 33. SciELO.org journals evaluation Português Español help about this site SciELO news SciELO team serial browsing alphabetic list subject list search form article browsing author index subject index search form reports site usage Publishing statistics journal citation co-authors 1) SciELO SA Reports via the SciELO webiste URL
  34. 34. Journal citation reports • Source data • Impact factor on a two-year basis • Impact factor on a three-year basis • Half-life • Received citations • Granted citations Journal citation reports URL
  35. 35. Journal citation reports Published in…. Select date and the journal title Journal citation reports URL All 2016 2015 2014 2013 2012 2011 2010
  36. 36. Analytics SciELO SA – per Journal Metrics of the usage of SAJS within the SciELO system Journal title/year No. of issues No. of articles No. of granted citations No. of received citations Average articles per issue S. Afr. j. sci 59 791 28782 1288 13.41 2016 5 72 3407 138 14.40 2015 6 89 3862 104 14.83 2014 6 76 2935 139 12.67 2013 6 80 2695 145 13.33 2012 6 70 2695 127 11.67 2011 6 66 2251 127 11.00 2010 6 68 2420 81 11.33 2009 6 81 2586 132 13.50 2008 6 100 2848 182 16.67 2007 6 89 3083 113 14.83 Total 59 791 28782 1288 13.41
  37. 37. 2) SciELO Analytics Link to SciELO Analytics (currently a beta version) – Collection level – Journal level – Article level (Need DOI numbers for each document ) As it is still a beta version some of the terminology is still in Portuguese.
  38. 38. Analytics – SciELO SA Collection
  39. 39. Accesses in October 2016
  40. 40. Global usage
  41. 41. SciELO SA – most accessed journals over the last 12 months Journal html pdf abstracts total SAMJ: South African Medical Journal 364 115 130 965 40 579 535 659 Journal of the Southern African Institute of Mining and Metallurgy 208 626 136 169 38 535 383 330 South African Journal of Education 274 044 86 286 14 602 374 932 Water SA 217 427 77 110 26 547 321 084 South African Journal of Science 213 890 80 222 25 467 319 579
  42. 42. Most accessed articles http://analytics.scielo.org/w/accesses/list/articles?collection=sza Article html pdf abstract total Teaching practice: a make or break phase for student teachers 38991 825 73 39889 The influence of land use on water quality and diatom community structures in urban and agriculturally stressed rivers 34687 568 89 35344 Identifying risks facing the South African tourism industry 29574 961 55 30590
  43. 43. Analytics SciELO SA – per Journal
  44. 44. Analytics – per Journal Article
  45. 45. Summary 1) SciELO Website : Link 2) SciELO Analytics (Beta version) Link (Remember to right click and select “Translate to English”)
  46. 46. Analytics - Upcoming To conclude, we look forward to the following: • SciELO new interface (look and feel) – The beta version of the new interface will be released early December 2016 • Follow-up webinar when the new version is released
  47. 47. Journal specific tools (South African Journal of Science) Nadine Wubbeling & Linda Fick
  48. 48. Tools for increasing & measuring the reach and impact of your journal
  49. 49. 1. Social Media https://www.facebook.com/southafricanjournalofscience Facebook
  50. 50. 1. Social Media https://twitter.com/SAJS_Official Twitter
  51. 51. Social Media: In-house analytics tools
  52. 52. Social Media: In-house analytics tools
  53. 53. Buffer
  54. 54. Other tools
  55. 55. Earliest hominin cancer: 1.7-million-year-old osteosarcoma from Swartkrans Cave, South Africa Volume 112, Issue 7/8 Twitter: Retweets: 98 Likes: 24 Clicks: 94 Potential audience: 66 690 Facebook: Likes: 8 Clicks: 26 Shares: 2 Potential audience: 1060 #FossilCancer #SedibasWorld
  56. 56. Earliest hominin cancer: 1.7-million-year-old osteosarcoma from Swartkrans Cave, South Africa Volume 112, Issue 7/8
  57. 57. 2. Electronic distribution
  58. 58. Media Releases: Mailchimp
  59. 59. Mailchimp
  60. 60. Multimodal spatial mapping and visualisation of Dinaledi Chamber and Rising Star Cave Volume 112, Issue 5/6 Day of publication, 27 May 2016 – 145 visits Day of highlights email, 31 May 2016 – 115 visits (84 clicks on Mailchimp)
  61. 61. Plant metabolomics: A new frontier in phytochemical analysis Volume 109, Issue 5/6 Day of publication, 13 May 2013 – 13 visits
  62. 62. 3. Collaborate with authors & institutions • Identify one or two articles to highlight per issue to start with. Ask the author and institutions to:  Have the institutions write a media release and send to their distribution list or through a platform such as EurekAlert. Have them notify you of this so that you can keep track of the releases and share on social media.  Institutions sometimes work with media companies to publish news articles in traditional media outlets. Ask the authors if they are willing to work with these companies to write articles for newspapers or digital platforms.  Share articles on their own social media pages – make sure you retweet or share this on your own profiles
  63. 63. http://www.wits.ac.za/news/latest-news/research-news/2016/2016-07/hominin-cancer/
  64. 64. Earliest hominin cancer: 1.7-million-year-old osteosarcoma from Swartkrans Cave, South Africa Volume 112, Issue 7/8 Day of publication, 28 July 2016: 820 visits – 6 news items published including National Geographic and The Telegraph Day of highlights email, 29 July 2016: 848 visits – 2 articles on The Washington Post and News24 1 August 2016 - 2 major news articles including mention on Fox News
  65. 65. 4. Other publishing platforms and indexes
  66. 66. Article-level metrics to measure your reach and impact
  67. 67. Google Analytics https://analytics.google.com/analytics/web
  68. 68. Google Analytics Drought, climate change and sustainability of water AUTHORS: in agriculture: A roadmap towards the NWRS2
  69. 69. Views and Downloads
  70. 70. Summary Tool Measure Social Media Potential Audience, Likes, Clicks, Retweets, shares, comments. Through in-house analytics tools and external tools such as Buffer Electronic Distribution Opens and clicks. Views on your website. Through tools such as Mailchimp. Collaboration with authors/institutions Views and downloads on your website. Interaction of Social Media. Feedback from the authors and institutions. Other publishing platforms and indexes Citations through the platforms. Metrics such as views and downloads. Keep record of article-level metrics on your website such as views and downloads. By using tools such as Google Analytics or Altmetric.
  71. 71. Thank you!  Susan Veldsman susan@assaf.org.za  Ina Smith ina@assaf.org.za  Louise van Heerden louise@assaf.org.za  Nadine Wubbeling nadine@assaf.org.za  Linda Fick linda@assaf.org.za

×