Monitoring & evaluating the usage
of your Open Access journal
Applying scientific thinking
in the service of society
Agenda
 General tools
Ina Smith
 Platform specific tools (SciELO SA)
Louise van Heerden
 Journal specific tools (South African Journal of
Science)
Nadine Wubbeling & Linda Fick
General Tools – Ina Smith
 Google Tools
 Piwik
 Publish or Perish
 Crossref
 Open Journal Systems (OJS)
About your Journal
Prepare your journal
 Search engine/harvester friendly – Base URL
http://journals.assaf.org.za/per/oai
 Standardized metadata schema (XML)
 Google Sitemap
 Open source software using open standards
 Integration with other tools e.g. ORCID, Crossref
DOIs, etc.
 Web site vs Journal Management System
Impact Factor
Thomson Reuters JIF against ethics and principles of
OA
relates less and less to citation rates
unrelated to individual article quality in a journal
unrelated to quality of individual scientist publishing
in a given journal
Display of IF information on journal web page
discouraged
1. Corneliussen, S.T. (2016) ‘Bad summer for the journal impact factor’, Physics Today, . doi:
10.1063/PT.5.8183.
2. Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan,
S., Taylor, S., Curry, S., de Montreal, U., @@, A., mmcnutt and Nature, S. (2016) ‘A simple proposal
for the publication of journal citation distributions’, New Results, , p. 62109. doi: 10.1101/062109.
3. The demise of the impact factor: The strength of the relationship between citation rates and IF is
down to levels last seen 40 years ago (2012) Available at:
http://blogs.lse.ac.uk/impactofsocialsciences/2012/06/08/demise-impact-factor-relationship-citation-
1970s/ (Accessed: 11 August 2016).
Web of Science
 Guidelines:
http://wokinfo.com/essays/journal-selection-
process/
 Suggest a title:
http://ip-
science.thomsonreuters.com/info/journalsubmission
-front/
Scopus
 Guidelines:
https://www.elsevier.com/solutions/scopus/content
#content-policy-and-selection
 Suggest a title:
http://suggestor.step.scopus.com/suggestTitle/step
1.cfm
Norwegian Registry for Scientific Journals,
Series and Publishers Level 2
 Guidelines:
https://dbh.nsd.uib.no/publiseringskanaler/OmKriter
ier?request_locale=en
 Suggest a title:
https://dbh.nsd.uib.no/publiseringskanaler/OmPros
edyrer?request_locale=en
Google Mail
Register a Gmail account for your journal
https://accounts.google.com/SignUp
Google Analytics
Add the journal to Google Analytics
http://analytics.google.com
Google Analytics
Google Analytics
Embed
code in
every web
page
Create connection between OJS &
Google Analytics
Journal Manager >> System Plugins (General)
Google Analytics Results
Google Analytics
Google Scholar Metrics
List of titles: https://scholar.google.com/citations?view_op=top_venues
Overview:
https://scholar.google.co.za/intl/en/scholar/metrics.html#overview
Register a new web site with Google
https://www.google.com/webmasters/tools/submit-url
Google Scholar Citations Profile
Google Scholar Citations Profile
https://scholar.google.co.za/intl/en/scholar/citations.html
Publish or Perish
Publish or Perish
Overview: http://www.harzing.com/pophelp/journal-
impact.htm
Download: http://www.harzing.com/resources/publish-or-
perish
Piwik
https://piwik.org/
Crossref
http://www.crossref.org/06members/51depositor.html
10.17159/2413-3108/2009/v21i2a296
OJS (Open Journal Systems)
https://www.projectcounter.org/
OJS
Alternative Metrics in OJS
http://pkp-alm.lib.sfu.ca/
Usage of accompanying data sets
http://dataverse.org
https://www.datacite.org/
Platform specific tools – Louise van Heerden
SciELO SA
• Scientific Electronic Library Online (SciELO)
• SA’s premier open-access database
• Full-text, peer-reviewed journals
• Part of the SciELO Network started in Brazil
• Managed by the Academy of Science of SA (ASSAf)
• Funded by the South African Department of Science
and Technology
• Endorsed by the South African Department of Higher
Education and Training
• www.scielo.org.za
Statistics
1) SciELO Website
2) SciELO Analytics (Beta version)
SciELO uses the COUNTER Code of Practice
On the HTML - if a user stays on the page for more
than 10 seconds = 1 access
On the PDF – if a user stays on the page for more than
30 seconds = 1 access
No robot access is counted
How SciELO defines ‘’access’’
SciELO.org
journals evaluation
Português
Español
help
about this site
SciELO news
SciELO team
serial browsing
alphabetic list
subject list
search form
article
browsing
author index
subject index
search form
reports
site usage
Publishing statistics
journal citation
co-authors
1) SciELO SA Reports
via the SciELO webiste URL
Journal citation reports
• Source data
• Impact factor on a two-year basis
• Impact factor on a three-year basis
• Half-life
• Received citations
• Granted citations
Journal citation reports URL
Journal citation reports
Published in…. Select date and the journal title
Journal citation reports URL
All
2016
2015
2014
2013
2012
2011
2010
Analytics SciELO SA – per Journal
Metrics of the usage of SAJS
within the SciELO system
Journal title/year No. of
issues
No. of
articles
No. of granted
citations
No. of received
citations
Average articles
per issue
S. Afr. j. sci 59 791 28782 1288 13.41
2016 5 72 3407 138 14.40
2015 6 89 3862 104 14.83
2014 6 76 2935 139 12.67
2013 6 80 2695 145 13.33
2012 6 70 2695 127 11.67
2011 6 66 2251 127 11.00
2010 6 68 2420 81 11.33
2009 6 81 2586 132 13.50
2008 6 100 2848 182 16.67
2007 6 89 3083 113 14.83
Total 59 791 28782 1288 13.41
2) SciELO Analytics
Link to SciELO Analytics (currently a beta version)
– Collection level
– Journal level
– Article level (Need DOI numbers for each
document )
As it is still a beta version some of the terminology is
still in Portuguese.
Analytics – SciELO SA Collection
Accesses in October 2016
Global usage
SciELO SA – most accessed journals
over the last 12 months
Journal html pdf abstracts total
SAMJ: South African
Medical Journal
364 115 130 965 40 579 535 659
Journal of the Southern
African Institute of
Mining and Metallurgy
208 626 136 169 38 535 383 330
South African Journal of
Education
274 044 86 286 14 602 374 932
Water SA 217 427 77 110 26 547 321 084
South African Journal
of Science
213 890 80 222 25 467 319 579
Most accessed articles
http://analytics.scielo.org/w/accesses/list/articles?collection=sza
Article html pdf abstract total
Teaching practice: a make or
break phase for student
teachers
38991 825 73 39889
The influence of land use on
water quality and diatom
community structures in urban
and agriculturally stressed
rivers
34687 568 89 35344
Identifying risks facing the
South African tourism industry
29574 961 55 30590
Analytics SciELO SA – per Journal
Analytics – per Journal Article
Summary
1) SciELO Website : Link
2) SciELO Analytics (Beta version) Link
(Remember to right click and select “Translate to English”)
Analytics - Upcoming
To conclude, we look forward to the following:
• SciELO new interface (look and feel) – The beta
version of the new interface will be released early
December 2016
• Follow-up webinar when the new version is released
Journal specific tools
(South African Journal of Science)
Nadine Wubbeling & Linda Fick
Tools for increasing &
measuring the reach and
impact of your journal
1. Social Media
https://www.facebook.com/southafricanjournalofscience
Facebook
1. Social Media
https://twitter.com/SAJS_Official
Twitter
Social Media:
In-house analytics tools
Social Media:
In-house analytics tools
Buffer
Other tools
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
Twitter:
Retweets: 98
Likes: 24
Clicks: 94
Potential audience: 66 690
Facebook:
Likes: 8
Clicks: 26
Shares: 2
Potential audience: 1060
#FossilCancer
#SedibasWorld
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
2. Electronic distribution
Media Releases:
Mailchimp
Mailchimp
Multimodal spatial mapping and visualisation of
Dinaledi Chamber and Rising Star Cave
Volume 112, Issue 5/6
Day of publication, 27 May 2016 – 145 visits
Day of highlights email, 31 May 2016 – 115 visits
(84 clicks on Mailchimp)
Plant metabolomics: A new frontier in phytochemical
analysis
Volume 109, Issue 5/6
Day of publication, 13 May 2013 – 13 visits
3. Collaborate with authors & institutions
• Identify one or two articles to highlight per issue to start with.
Ask the author and institutions to:
 Have the institutions write a media release and send to
their distribution list or through a platform such as
EurekAlert. Have them notify you of this so that you can
keep track of the releases and share on social media.
 Institutions sometimes work with media companies to
publish news articles in traditional media outlets. Ask the
authors if they are willing to work with these companies to
write articles for newspapers or digital platforms.
 Share articles on their own social media pages – make
sure you retweet or share this on your own profiles
http://www.wits.ac.za/news/latest-news/research-news/2016/2016-07/hominin-cancer/
Earliest hominin cancer: 1.7-million-year-old
osteosarcoma from Swartkrans Cave, South Africa
Volume 112, Issue 7/8
Day of publication, 28 July 2016: 820 visits – 6 news items published
including National Geographic and The Telegraph
Day of highlights email, 29 July 2016: 848 visits – 2 articles on
The Washington Post and News24
1 August 2016 - 2 major news articles including
mention on Fox News
4. Other publishing platforms and indexes
Article-level metrics to measure
your reach and impact
Google Analytics
https://analytics.google.com/analytics/web
Google Analytics
Drought, climate change and sustainability of water AUTHORS: in
agriculture: A roadmap towards the NWRS2
Views and Downloads
Summary
Tool Measure
Social Media Potential Audience, Likes, Clicks, Retweets, shares,
comments. Through in-house analytics tools and
external tools such as Buffer
Electronic Distribution Opens and clicks. Views on your website. Through
tools such as Mailchimp.
Collaboration with
authors/institutions
Views and downloads on your website.
Interaction of Social Media. Feedback from the
authors and institutions.
Other publishing
platforms and indexes
Citations through the platforms. Metrics such as
views and downloads.
Keep record of article-level metrics on your website such as views and
downloads. By using tools such as Google Analytics or Altmetric.
Thank you!
 Susan Veldsman
susan@assaf.org.za
 Ina Smith
ina@assaf.org.za
 Louise van Heerden
louise@assaf.org.za
 Nadine Wubbeling
nadine@assaf.org.za
 Linda Fick
linda@assaf.org.za

Monitoring & evaluating the usage of your Open Access Journal

  • 1.
    Monitoring & evaluatingthe usage of your Open Access journal Applying scientific thinking in the service of society
  • 2.
    Agenda  General tools InaSmith  Platform specific tools (SciELO SA) Louise van Heerden  Journal specific tools (South African Journal of Science) Nadine Wubbeling & Linda Fick
  • 3.
    General Tools –Ina Smith  Google Tools  Piwik  Publish or Perish  Crossref  Open Journal Systems (OJS)
  • 4.
  • 5.
    Prepare your journal Search engine/harvester friendly – Base URL http://journals.assaf.org.za/per/oai  Standardized metadata schema (XML)  Google Sitemap  Open source software using open standards  Integration with other tools e.g. ORCID, Crossref DOIs, etc.  Web site vs Journal Management System
  • 6.
    Impact Factor Thomson ReutersJIF against ethics and principles of OA relates less and less to citation rates unrelated to individual article quality in a journal unrelated to quality of individual scientist publishing in a given journal Display of IF information on journal web page discouraged 1. Corneliussen, S.T. (2016) ‘Bad summer for the journal impact factor’, Physics Today, . doi: 10.1063/PT.5.8183. 2. Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan, S., Taylor, S., Curry, S., de Montreal, U., @@, A., mmcnutt and Nature, S. (2016) ‘A simple proposal for the publication of journal citation distributions’, New Results, , p. 62109. doi: 10.1101/062109. 3. The demise of the impact factor: The strength of the relationship between citation rates and IF is down to levels last seen 40 years ago (2012) Available at: http://blogs.lse.ac.uk/impactofsocialsciences/2012/06/08/demise-impact-factor-relationship-citation- 1970s/ (Accessed: 11 August 2016).
  • 7.
    Web of Science Guidelines: http://wokinfo.com/essays/journal-selection- process/  Suggest a title: http://ip- science.thomsonreuters.com/info/journalsubmission -front/
  • 8.
  • 9.
    Norwegian Registry forScientific Journals, Series and Publishers Level 2  Guidelines: https://dbh.nsd.uib.no/publiseringskanaler/OmKriter ier?request_locale=en  Suggest a title: https://dbh.nsd.uib.no/publiseringskanaler/OmPros edyrer?request_locale=en
  • 10.
    Google Mail Register aGmail account for your journal https://accounts.google.com/SignUp
  • 11.
    Google Analytics Add thejournal to Google Analytics http://analytics.google.com
  • 12.
  • 13.
  • 14.
    Create connection betweenOJS & Google Analytics Journal Manager >> System Plugins (General)
  • 15.
  • 16.
  • 17.
    Google Scholar Metrics Listof titles: https://scholar.google.com/citations?view_op=top_venues Overview: https://scholar.google.co.za/intl/en/scholar/metrics.html#overview
  • 18.
    Register a newweb site with Google https://www.google.com/webmasters/tools/submit-url
  • 19.
  • 20.
    Google Scholar CitationsProfile https://scholar.google.co.za/intl/en/scholar/citations.html
  • 21.
  • 22.
    Publish or Perish Overview:http://www.harzing.com/pophelp/journal- impact.htm Download: http://www.harzing.com/resources/publish-or- perish
  • 23.
  • 24.
  • 25.
    OJS (Open JournalSystems) https://www.projectcounter.org/
  • 26.
  • 27.
    Alternative Metrics inOJS http://pkp-alm.lib.sfu.ca/
  • 28.
    Usage of accompanyingdata sets http://dataverse.org https://www.datacite.org/
  • 29.
    Platform specific tools– Louise van Heerden
  • 30.
    SciELO SA • ScientificElectronic Library Online (SciELO) • SA’s premier open-access database • Full-text, peer-reviewed journals • Part of the SciELO Network started in Brazil • Managed by the Academy of Science of SA (ASSAf) • Funded by the South African Department of Science and Technology • Endorsed by the South African Department of Higher Education and Training • www.scielo.org.za
  • 31.
    Statistics 1) SciELO Website 2)SciELO Analytics (Beta version)
  • 32.
    SciELO uses theCOUNTER Code of Practice On the HTML - if a user stays on the page for more than 10 seconds = 1 access On the PDF – if a user stays on the page for more than 30 seconds = 1 access No robot access is counted How SciELO defines ‘’access’’
  • 33.
    SciELO.org journals evaluation Português Español help about thissite SciELO news SciELO team serial browsing alphabetic list subject list search form article browsing author index subject index search form reports site usage Publishing statistics journal citation co-authors 1) SciELO SA Reports via the SciELO webiste URL
  • 34.
    Journal citation reports •Source data • Impact factor on a two-year basis • Impact factor on a three-year basis • Half-life • Received citations • Granted citations Journal citation reports URL
  • 35.
    Journal citation reports Publishedin…. Select date and the journal title Journal citation reports URL All 2016 2015 2014 2013 2012 2011 2010
  • 36.
    Analytics SciELO SA– per Journal Metrics of the usage of SAJS within the SciELO system Journal title/year No. of issues No. of articles No. of granted citations No. of received citations Average articles per issue S. Afr. j. sci 59 791 28782 1288 13.41 2016 5 72 3407 138 14.40 2015 6 89 3862 104 14.83 2014 6 76 2935 139 12.67 2013 6 80 2695 145 13.33 2012 6 70 2695 127 11.67 2011 6 66 2251 127 11.00 2010 6 68 2420 81 11.33 2009 6 81 2586 132 13.50 2008 6 100 2848 182 16.67 2007 6 89 3083 113 14.83 Total 59 791 28782 1288 13.41
  • 37.
    2) SciELO Analytics Linkto SciELO Analytics (currently a beta version) – Collection level – Journal level – Article level (Need DOI numbers for each document ) As it is still a beta version some of the terminology is still in Portuguese.
  • 38.
    Analytics – SciELOSA Collection
  • 39.
  • 40.
  • 41.
    SciELO SA –most accessed journals over the last 12 months Journal html pdf abstracts total SAMJ: South African Medical Journal 364 115 130 965 40 579 535 659 Journal of the Southern African Institute of Mining and Metallurgy 208 626 136 169 38 535 383 330 South African Journal of Education 274 044 86 286 14 602 374 932 Water SA 217 427 77 110 26 547 321 084 South African Journal of Science 213 890 80 222 25 467 319 579
  • 42.
    Most accessed articles http://analytics.scielo.org/w/accesses/list/articles?collection=sza Articlehtml pdf abstract total Teaching practice: a make or break phase for student teachers 38991 825 73 39889 The influence of land use on water quality and diatom community structures in urban and agriculturally stressed rivers 34687 568 89 35344 Identifying risks facing the South African tourism industry 29574 961 55 30590
  • 43.
    Analytics SciELO SA– per Journal
  • 44.
    Analytics – perJournal Article
  • 45.
    Summary 1) SciELO Website: Link 2) SciELO Analytics (Beta version) Link (Remember to right click and select “Translate to English”)
  • 46.
    Analytics - Upcoming Toconclude, we look forward to the following: • SciELO new interface (look and feel) – The beta version of the new interface will be released early December 2016 • Follow-up webinar when the new version is released
  • 47.
    Journal specific tools (SouthAfrican Journal of Science) Nadine Wubbeling & Linda Fick
  • 48.
    Tools for increasing& measuring the reach and impact of your journal
  • 49.
  • 50.
  • 52.
  • 53.
  • 54.
  • 56.
  • 57.
    Earliest hominin cancer:1.7-million-year-old osteosarcoma from Swartkrans Cave, South Africa Volume 112, Issue 7/8 Twitter: Retweets: 98 Likes: 24 Clicks: 94 Potential audience: 66 690 Facebook: Likes: 8 Clicks: 26 Shares: 2 Potential audience: 1060 #FossilCancer #SedibasWorld
  • 58.
    Earliest hominin cancer:1.7-million-year-old osteosarcoma from Swartkrans Cave, South Africa Volume 112, Issue 7/8
  • 59.
  • 60.
  • 61.
  • 62.
    Multimodal spatial mappingand visualisation of Dinaledi Chamber and Rising Star Cave Volume 112, Issue 5/6 Day of publication, 27 May 2016 – 145 visits Day of highlights email, 31 May 2016 – 115 visits (84 clicks on Mailchimp)
  • 63.
    Plant metabolomics: Anew frontier in phytochemical analysis Volume 109, Issue 5/6 Day of publication, 13 May 2013 – 13 visits
  • 64.
    3. Collaborate withauthors & institutions • Identify one or two articles to highlight per issue to start with. Ask the author and institutions to:  Have the institutions write a media release and send to their distribution list or through a platform such as EurekAlert. Have them notify you of this so that you can keep track of the releases and share on social media.  Institutions sometimes work with media companies to publish news articles in traditional media outlets. Ask the authors if they are willing to work with these companies to write articles for newspapers or digital platforms.  Share articles on their own social media pages – make sure you retweet or share this on your own profiles
  • 65.
  • 66.
    Earliest hominin cancer:1.7-million-year-old osteosarcoma from Swartkrans Cave, South Africa Volume 112, Issue 7/8 Day of publication, 28 July 2016: 820 visits – 6 news items published including National Geographic and The Telegraph Day of highlights email, 29 July 2016: 848 visits – 2 articles on The Washington Post and News24 1 August 2016 - 2 major news articles including mention on Fox News
  • 67.
    4. Other publishingplatforms and indexes
  • 68.
    Article-level metrics tomeasure your reach and impact
  • 69.
  • 70.
    Google Analytics Drought, climatechange and sustainability of water AUTHORS: in agriculture: A roadmap towards the NWRS2
  • 71.
  • 72.
    Summary Tool Measure Social MediaPotential Audience, Likes, Clicks, Retweets, shares, comments. Through in-house analytics tools and external tools such as Buffer Electronic Distribution Opens and clicks. Views on your website. Through tools such as Mailchimp. Collaboration with authors/institutions Views and downloads on your website. Interaction of Social Media. Feedback from the authors and institutions. Other publishing platforms and indexes Citations through the platforms. Metrics such as views and downloads. Keep record of article-level metrics on your website such as views and downloads. By using tools such as Google Analytics or Altmetric.
  • 73.
    Thank you!  SusanVeldsman susan@assaf.org.za  Ina Smith ina@assaf.org.za  Louise van Heerden louise@assaf.org.za  Nadine Wubbeling nadine@assaf.org.za  Linda Fick linda@assaf.org.za