A Central Role for DOAJ in the Global Ecosystem of Open Access infrastructures

A CENTRAL ROLE FOR DOAJ IN THE
GLOBAL ECOSYSTEM OF OPEN ACCESS
INFRASTRUCTURES
X J T L U - I P C C O P E N A C C E S S S Y M P O S I U M
O P E N A C C E S S T R E N D S , O P P O R T U N I T I E S , A N D
C H A L L E N G E S
S U Z H O U O C T 2 7 , 2 0 1 7
T O M @ D O A J . O R G
E D I T O R - I N - C H I E F D O A J

You are free to:
Copy, share, adapt, or re-mix;
Blog, live-blog, or post video of;
This presentation. Provided that:
You attribute the work to its author and respect the rights
and licenses associated with its components.
Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only ccZero.
Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;

• The Role of Journal Indexing Services
• Differences between various indexing services
• Quality of Science: can scientific quality really be
measured reliably?
• drawbacks of citation analysis and ranking
• DOAJ criteria focus on quality of publishing
• DOAJ Services
• The DOAJ Ambassador Programme
• Worldwide political support for the DOAJ Index
• Role forDOAJ as Gatekeeper for Quality Open Access
Journals
Presentation overview

Centrally, publicly and
internationally available
community-curated list of high
quality open access journal titles
across all disciplines and
languages
The starting point for all
information searches for quality,
peer-reviewed open access
material
A hub for metadata for Open
Access articles and journals
The Role of DOAJ
DOAJ是什么

Becoming the Number 1 Source of
Information on open access journals
and content in the global North and
South
OUR VISION

• DOAJ Directory of Open Access Journals
O P E N A C C E S S J O U R N A L S O N L Y , N O R A N K I N G
• SCOPUS
O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S , R A N K I N G
• WEB OF SCIENCE
• NATIONAL LISTS
INDEXING SERVICES
数据库收录
for quality control

INFRASTRUCTURE SERVICES
FOR OPEN ACCESS
DOAJ IS PART OF THE INFRASTRUCTURES
NEEDED FOR OPEN ACCESS PUBLISHING
• OTHER SERVICES ARE
• ORCID
• LOCKSS
• SHERPA/ROMEO
• CROSSREF
• ALTMETRICS SERVICES LIKE IMPACT STORY, ALTMETRIC
• PKP OJS (OPEN JOURNAL SYSTEM)
• DRYAD. FIGSHARE and other datarepositories

• QUALITY OF PUBLISHING（出版的质量）
• QUALITY OF THE SCIENCE （科学的质量）
Assessing the Quality of a Journal
审核期刊的质量

o R E A S O N F O R B A D Q U A L I T Y O F S C I E N C E
o Scientific Method is flawed
o Peer-review is flawed
o Citation analysis has many drawbacks
o
Assessing Quality of Research
审核科学的质量

Can we measure the Quality of Research?
(in the current system)
For almost everything
we eat we can find
scientific evidence for
causing or preventing
cancer

Can we measure the Quality of Research?
(in the current system)
All the studies were
carefully done and
scientifically sound
Is everything we eat
associated with cancer?
A systematic cookbook
review
Jonathan D Schoenfeld
and John PA Ioannidis.
Am J Clin Nutrition
2013;97:127–34

Peer-review & the Quality of Research
Eisen JA, MacCallum CJ,
Neylon C (2013) Expert
Failure: Re-evaluating
Research Assessment. PLoS
Biol 11(10): e1001677.
doi:10.1371/journal.pbio.10
01677

o C I T A T I O N R A T E S A R E F O R A R T I C L E S N O T J O U R N A L S
o C I T A T I O N R A T E S N O T S A M E A S I M P A C T
o C I T I N G D O E S N O T N E C E S S A R I L Y M E A N R E A D I N G
o M O R E I S N O T B E T T E R
o S E L F C I T A T I O N S
o P E E R - F O R C E D C I T A T I O N S
Wageningen UR Library
Citations & Quality of Research
审核科学的质量

Table 2: Percentage of papers published
in 2013-2014 with number of citations
below the value of the 2015 JIF.
Larivière et al. (2016)
eLife 8.3 71.2%
EMBO J. 9.6 66.9%
J. Informetrics 2.4 68.4%
Nature 38.1 74.8%
Nature Comm. 11.3 74.1%
PLOS Biol. 8.7 66.8%
PLOS Genet. 6.7 65.3%
PLOS ONE 3.1 72.2%
Proc. R. Soc. B 4.8 65.7%
Science 34.7 75.5%
Sci. Rep. 5.2 73.2%
Journal JIF
% citable items
below JIF
0
10
20
30
40
50
60
70
80
90
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
eLife
0
5
10
15
20
25
30
35
40
45
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
EMBO J.
0
10
20
30
40
50
60
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
J. Informetrics
0
10
20
30
40
50
60
70
80
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Nature
0
50
100
150
200
250
300
350
400
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Nature Comm.
0
5
10
15
20
25
30
35
40
45
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
PLOS Biol.
0
20
40
60
80
100
120
140
160
180
200
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
PLOS Genet.
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
PLOS ONE
0
20
40
60
80
100
120
140
160
180
200
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Proc. R. Soc. B
0
10
20
30
40
50
60
70
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Science
0
200
400
600
800
1,000
1,200
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Sci. Rep.
highly skewed distribution of citations
高度不平衡的文献引用分布
doi: http://dx.doi.org/10.1101/
062109

• T R A C E T H E S O U R C E O F D A T A
• M A K E R E S E A R C H C O N N E C T I O N S / N E T W O R K S V I S I B L E
• F I N D K E Y P A P E R S F O R S P E C I F I C T O P I C S ( O P E N C I T A T I O N S
C O R P U S , P A R T O F I S 4 O A )
B U T :
• N O C O N C L U S I O N S O N I M P A C T F R O M A V E R A G E C I T A T I O N S C O R E S
• N O C O N C L U S I O N S O N Q U A L I T Y F R O M N U M B E R O F C I T A T I O N S
What can we do with Citations?
Blog.plos.org/biologue
1104029017

Initiative for Open Citations I4OC

San Francisco Declaration on Research Impact
关于科研影响力的旧金山声明
http://www.ascb.org/dora/
It doen’t matter where you
publish or how much you
publish, research
assessment should not be
based on journal citation
analysis like JIF or number
of articles published

• I O A N N I D I S : M O S T P U B L I S H E D M E D I C A L R E S E A R C H I S F A L S E
• B E T T E R E X P E R I M E N T A L S E T - U P , C O N T R O L P O S S I B I L I T I E S
• O P E N A C C E S S ( A R T I C L E S A N D D A T A ) O F F E R S B E T T E R
C O N T R O L P O S S I B I L I T I E S
• N E E D T O P U B L I S H A L L , N E G A T I V E A N D P O S I T I V E F I N D I N G S
• M O R E A T T E N T I O N F O R R E P R O D U C I B I L I T Y
Improving the Quality of Research
* Ioannidis JPA (2005) Why most published
research ﬁ ndings are false. PLoS Med 2(8): e124

NEED FOR OPEN ACCESS
OPEN ACCESS.....
• O F F E R S A C C E S S T O A L L W H O N E E D I T
• I S A N E S S E N T I A L P A R T O F O P E N S C I E N C E
• R E D U C E S T H E C O S T O F P U B L I S H I N G
• I M P R O V E S C O M M U N I C A T I O N i n S C I E N C E
• I M P R O V E S C O M M U N I C A T I O N a b o u t S C I E N C E
• O F F E R S B E S T P O S S I B I L I T I E S F O R F U L L P A R T I C I P A T I O N
I N T H E S C I E N T I F I C E N T E R P R I S E F O R A L L S C I E N T I S T S
I N T H E G L O B A L S O U T H A N D N O R T H

• A r t i c l e s o n l i n e f r e e t o r e a d = O p e n A c c e s s ?
A r t i c l e s o n l i n e f r e e t o d o w n l o a d = O p e n A c c e s s ?
• A u t h o r s c a n o n l y u s e a c c e p t e d o p e n a c c e s s a r t i c l e s f o r c l a s s r o o m u s e ,
p u t t h e m o n t h e i r o w n o r i n s t i t u t e w e b s i t e , m a k e l i m i t e d n r o f p r i n t s
• A u t h o r s n e e d t o r e t a i n t h e i r c o p y r i g h t i n O p e n A c c e s s ?
• O p e n a c c e s s c a n a l s o b e a f t e r 1 y e a r , 2 y e a r s o t h e r d e l a y
Common Misunderstandings on Open
Access
对开放获取常见的误解
• Open Access needs BOAI statement on journal website,
saying the article will be immediate open access, free to read, download,
distribute, print or use for whatever other legal purpose
AND Open Access needs licensing and copyright conditions telling who is
the owner of the work and telling who may use article content and for what
purposes
for instance CC-BY, CC-BY-NC, CC-BY-ND, CC-BY-SA
NO

ADVANTAGES OF OPEN
ACCESS
OPEN ACCESS.....
• A R T I C L E S R E C E I V E M O R E C I T A T I O N S
• A R T I C L E S A R E M O R E R E A D
• R E A C H E S A B I G G E R A U D I E N C E
• I S L E S S P R O N E T O B I A S
• A V O I D S D U P L I C A T E S T U D I E S
• A R T I C L E S C A N B E M O R E E A S I L Y C H E C K E D
• D A T A L E S S P R O N E T O M A N I P U L A T I O N
• I S B E T T E R F O R A D V A N C I N G S C I E N C E
• L E A D S T O M O R E I N N O V A T I O N
• L E A D S T O B E T T E R E D U C A T I O N

ONLY IN THE CASE
OF
QUALITY CONTROLLED
OPEN ACCESS JOURNALS
TRUE BUT ……

DOAJ BASICS
• INDEXING ALL OPEN ACCESS JOURNALS
ACCORDING TO STRICT CRITERIA
• RECOGNIZED BY GOVERNMENTS AND
INTERNATIONAL ORGANIZATIONS
• PROVIDING OF A PORTAL TO SEARCH AND
ACCESS THE FULL TEXT OF ARTICLES OF
ABOUT 10,000 JOURNALS IN OPEN ACCESS
• ALL DOAJ SERVICES ARE FREE
• THE DOAJ IS FUNDED BY ITS 'SPONSORS'
• THE DOAJ IS MANAGED BY A TEAM OF
PROFESSIONALS, VOLUNTEERS
AND AMBASSADORS WORLDWIDE

• DOAJ CRITERIA FOR QUALITY OPEN
ACCESS PUBLISHING
•Principles of transparency and Best Practice in Scholarly Publishing
•(DOAJ, OASPA, COPE, WAME)
Assessing the Quality of Publishing
（衡量出版质量）

WHAT IS QUALITY OPEN
ACCESS?
• Free and (almost) unrestricted access
• Adherence to the BOAI definition
• No Embargoes
• No Hybrid Journals
• Copyright ownership clearly described
• Use of open access licensing like Creative Commons or
equivalent

• N O T J U S T A B O U T P U B L I S H I N G
• B U T M O R E A N D M O R E A B O U T S E R V I C E S
• Sophisticated searching interface
•Altmetrics
•Citation analysis
• peer review (Publon)
• discussion platform (Researchgate)
The Future of Publishing: more services
Springer/nature Elsevier Digital Science
ResearchGate Publon PKP-OJS
Mendelej

• I N C R E A S E D C O O P E R A T I O N W I T H P K P - O J S
• I N T E G R A T I O N O F A L T M E T R I C S C O R E S
• I N T E G R A T I O N O F O R C I D
• I N T E G R A T I O N O F A R T I C L E D A T A L I N K S
• S E M I - A U T O M A T I C I N D E X U P D A T E S A N D S C R E E N I N G
• S E M A N T I C L I N K I N G O F S P E C I F I C C O N T E N T
• W O R L D W I D E A M B A S S A D O R P R O G R A M M E S
DOAJ Future Plans

DOAJ Worldwide
Ambassador Programme
DOAJ Ambassador Programme
extended to other regions
2017-2018
- Indonesia
- Korea
- Japan

Growing political support for DOAJ
DOAJ : Gatekeeper for Quality
Open Access

Source: http://www.scienceeurope.org/uploads/PressReleases/270415_Open_Access_New_Principles.pdf
Indexing
Copyright
Re-use
Sustainable
Archiving
Machine
Readability

INDONESIA
Ministry of Science and Technology
directive

Questionable Journals and Blacklists

• Low publishing quality
Journal name, website, fees, peer review, publisher, ownership, volume of
articles, advertisements, prominent soliciting for editors
• Low scientific quality
focus, format, self-citations, plagiarism
• Malpractice
false claims, hidden costs, spamming authors, wrong information
How DOAJ detects Questionable Journals

How you can detect Questionable Journals

October 2013
February 2014
.
WHAT ABOUT THE STING ??

.
THE STING : An example of Bad Science
•“The Sting” applied only to open access journals
• No comparison was made with the subscription
journals
• This study was an example of 'Bad Science'
• Many of the research results published in journals are
false, in subscription journals and in open access
journals
• 'Retraction Watch' only shows the top of the iceberg
------------------------------------------------------------------
---------
• Open access journals offer better control possibilities:
more readers, more exposure, more complete data
• Greater exposure is at the same time the reason why
bad reviews with open access stand out more
• Greater public exposure can be / and is in fact used to
discredit open access journals

Questionable Publishing: the Real Picture
• NOT ONLY IN OPEN ACCESS JOURNALS
• Not AS HIGH AS OFTEN REPORTED
according to a study* by Walt Crawford the number questionable publishers
in 2014 was about 3275 publishing about 121,000 articles and not 420,000
(Shen and Björk ** reported 8000 journals and 420,000 articles!!)
* http://walt.lishost.org/2015/11/ppppredatory-article-
counts-an-investigation-part-1/
**Shen and Björk. BMC Medicine201513:230

Proportion of low quality journals is comparable
between open access and subscription publishing
but it looks worse because Open Access journals are more visible
FACTS
• Not all subscription journals are in Scopus or WoS: only 20-30,000 of 100,000
(data Ulrich’s Web)
• Not all open access journals are in DOAJ : only about 10-12,000 of 30,000 ***
*** Walt Crawford
http://citesandinsights.info/civ17i1.pdf
Questionable Publishing in Perspective

CONCLUSION
Percentage of Quality checked
Journals in Open Access and
Subscription publishing systems
is comparable
Questionable Publishing in Perspective

IF OPEN ACCESS WERE REALLY
SUCH LOW QUALITY.....
 WHY WOULD SO MANY PUBLISHERS SWITCH TO OPEN
ACCESS?
 WHY WOULD 30 % OF ALL STM PAPERS TO DATE BE
PUBLISHED USING OPEN ACCESS?
 WHY WOULD OPEN ACCESS GROW AT TWICE THE RATE
OF TOLL ACCESS?
•
The Reality of Open Access
真正的开放获取

Thanks to :
Xin Bi and the Xi'an Jiaotong-Liverpool University ,
all the Library Consortia, Universities and Publishers and our
Sponsors for the financial support to DOAJ!
感谢我们所有的图书馆联盟，大学，出版商和赞助商对DOAJ
的财政支持！

Thank you for your attention!
谢谢你们的关注！
tom@doaj.org
lars
lars@doaj.org

DOAJ depends entirely on donations
https://doaj.org/membership

A Central Role for DOAJ in the Global Ecosystem of Open Access infrastructures

Recommended

Recommended

More Related Content

Similar to A Central Role for DOAJ in the Global Ecosystem of Open Access infrastructures

Similar to A Central Role for DOAJ in the Global Ecosystem of Open Access infrastructures (20)

More from DOAJ (Directory of Open Access Journals)

More from DOAJ (Directory of Open Access Journals) (20)

Recently uploaded

Recently uploaded (20)

A Central Role for DOAJ in the Global Ecosystem of Open Access infrastructures