SlideShare a Scribd company logo
Validation, Evaluation, Dissemination: 	
Academia’s gravest problems show
the way to the Next Generation
Repositories
Pandelis Perakakis, PhD
!
Open Scholar, CIC
University of Granada
@os_soc	
@ppandelis	
openscholar.org.uk	
perakakis@openscholar.org.uk
COAR annual meeting, Vienna 2016
Essential scholarly communication processes
controlled exclusively by journals
Validation
Richard Smith, former British Medical Journal editor
https://www.timeshighereducation.com/content/the-peer-review-drugs-dont-work
May 28, 2015
Validation
Does it ensure quality, reproducibility,
reliability?
http://www.cochrane.org/MR000016/METHOD_editorial-peer-review-for-improving-the-
quality-of-reports-of-biomedical-studies
http://www.nature.com/nature/journal/v483/n7391/full/483531a.html#t1
Validation
85 per cent of preclinical studies could not be replicated
Does it ensure quality, reproducibility,
reliability?
Validation
http://science.sciencemag.org/content/349/6251/aac4716.full
Does it ensure quality, reproducibility,
reliability?
Validation
http://brain.oxfordjournals.org/content/123/9/1964
Does it ensure quality, reproducibility,
reliability?
Validation
http://www.nature.com/news/2011/111005/full/478026a.html
Does it ensure quality, reproducibility,
reliability?
Validation
Pandelis, I have good
news. Pablo says he
will send the Frontiers
paper to …a very
good friend of ours
Does the system promote ethical
conduct?
Validation
Does the system promote ethical
conduct?
Validation
https://pdfs.semanticscholar.org/be9a/21d0e93adeb529f7a50d9d50f9d0a6d8f8be.pdf
Does it recognise quality?
Validation
What is the cost in time and money?
Validation
What is the cost in time and money?
https://www.timeshighereducation.com/news/unpaid-peer-review-is-worth-19bn/
402189.article
Validation
What we need:!
✓Many reviewers!
✓Experts in the field(s)!
✓Open reviews!
✓Transparent dialogue!
✓Reviewer recognition
What we have:!
✓2-3 reviewers!
✓Anonymous!
✓Non-public reviews!
✓Editorial decision!
✓System of favours
Evaluation
Receive credit based on “where” instead
of “what”
Evaluation
Receive credit based on “where” instead
of “what”
University Rankings
Evaluation
What does the name of the journal say
about its articles?
Numberofcitations
Number of articles
http://e-archivo.uc3m.es/bitstream/handle/10016/10968/
we1109.pdf;jsessionid=20173C78597F75F03057340D43D90102?sequence=1
Evaluation
What does the name of the journal say
about its articles?
http://journal.frontiersin.org/article/10.3389/fnhum.2013.00291
Evaluation
What does the name of the journal say
about its articles?
http://journal.frontiersin.org/article/10.3389/fnhum.2013.00291
Evaluation
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0056180
What does the name of the journal say
about its articles?
Evaluation
The journal long-tailed hierarchy
Evaluation
What we need:!
✓Multi-parametric indexes!
✓Overall assessment!
✓Dynamic assessment
What we have:!
✓Single index!
✓Mostly impact!
✓Static assessment
An alternative model
http://www.openscholar.org.uk/wp-content/uploads/2015/08/nsap_perakakis_2010.pdf
An example repository with
overlay review services
http://sjscience.org
The first Open Peer Review
Module for OA repositories
http://www.openscholar.org.uk/institutional-repositories-start-to-offer-peer-review-services/
The first Open Peer Review
Module for OA repositories
The first Open Peer Review Module for OA repositories
The first Open Peer Review Module for OA repositories
Building an alternative
reputation system
http://digital.csic.es/bitstream/10261/130842/1/Reputation_academic_world_Sierra.pdf
Validation, Evaluation, Dissemination: 	
Academia’s gravest problems show
the way to the Next Generation
Repositories
Pandelis Perakakis, PhD
!
Open Scholar, CIC
University of Granada
@os_soc	
@ppandelis	
openscholar.org.uk	
perakakis@openscholar.org.uk COAR annual meeting, Vienna 2016

More Related Content

Viewers also liked

Implementation Evaluation Of Manufacturing Training Program J Porter Hrd849 ...
Implementation Evaluation Of Manufacturing Training Program  J Porter Hrd849 ...Implementation Evaluation Of Manufacturing Training Program  J Porter Hrd849 ...
Implementation Evaluation Of Manufacturing Training Program J Porter Hrd849 ...
jforkin
 
Training and development
Training and developmentTraining and development
Training and development
Yesmitha
 
PCM - Project Cycle Management, Training on Evaluation
PCM - Project Cycle Management, Training on EvaluationPCM - Project Cycle Management, Training on Evaluation
PCM - Project Cycle Management, Training on Evaluation
rexcris
 

Viewers also liked (18)

Media Magazine Evaluation Problems Part 4
Media Magazine Evaluation Problems Part 4Media Magazine Evaluation Problems Part 4
Media Magazine Evaluation Problems Part 4
 
ILIKS2010 - Montali - Monitoring Time-Aware Commitments
ILIKS2010 - Montali - Monitoring Time-Aware CommitmentsILIKS2010 - Montali - Monitoring Time-Aware Commitments
ILIKS2010 - Montali - Monitoring Time-Aware Commitments
 
7 lecciones de vida jim rohn
7 lecciones de vida jim rohn7 lecciones de vida jim rohn
7 lecciones de vida jim rohn
 
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
 
Levels 1-4 Evaluation
Levels 1-4 EvaluationLevels 1-4 Evaluation
Levels 1-4 Evaluation
 
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
ICAR-IFPRI : Problems of Impact Evaluation Confounding Factors and Selection ...
 
Training Program Evaluation
Training Program EvaluationTraining Program Evaluation
Training Program Evaluation
 
Implementation Evaluation Of Manufacturing Training Program J Porter Hrd849 ...
Implementation Evaluation Of Manufacturing Training Program  J Porter Hrd849 ...Implementation Evaluation Of Manufacturing Training Program  J Porter Hrd849 ...
Implementation Evaluation Of Manufacturing Training Program J Porter Hrd849 ...
 
plastic surgery of the ear
plastic surgery of the earplastic surgery of the ear
plastic surgery of the ear
 
Yali presentation for snowplow amsterdam meetup number 2
Yali presentation for snowplow amsterdam meetup number 2Yali presentation for snowplow amsterdam meetup number 2
Yali presentation for snowplow amsterdam meetup number 2
 
Training and development
Training and developmentTraining and development
Training and development
 
Snowplow Analytics and Looker at Oyster.com
Snowplow Analytics and Looker at Oyster.comSnowplow Analytics and Looker at Oyster.com
Snowplow Analytics and Looker at Oyster.com
 
Project monitoring and evaluation by Samuel Obino Mokaya
Project monitoring and evaluation by Samuel Obino MokayaProject monitoring and evaluation by Samuel Obino Mokaya
Project monitoring and evaluation by Samuel Obino Mokaya
 
PCM - Project Cycle Management, Training on Evaluation
PCM - Project Cycle Management, Training on EvaluationPCM - Project Cycle Management, Training on Evaluation
PCM - Project Cycle Management, Training on Evaluation
 
Algunas lecciones de Job
Algunas lecciones de JobAlgunas lecciones de Job
Algunas lecciones de Job
 
On the-job training
On the-job trainingOn the-job training
On the-job training
 
Evaluation of Training & Development
Evaluation of Training & DevelopmentEvaluation of Training & Development
Evaluation of Training & Development
 
Training evaluation
Training evaluationTraining evaluation
Training evaluation
 

Similar to Validation, Evaluation, Dissemination: Academia’s gravest problems show the way to the Next Generation Repositories

Pathology-2016_Brochure
Pathology-2016_BrochurePathology-2016_Brochure
Pathology-2016_Brochure
Rebecca Paul
 
Program - 3rd Annual Drug Delivery and Formulation Summit 2013, San Diego
Program - 3rd Annual Drug Delivery and Formulation Summit 2013, San DiegoProgram - 3rd Annual Drug Delivery and Formulation Summit 2013, San Diego
Program - 3rd Annual Drug Delivery and Formulation Summit 2013, San Diego
Mark Blendheim
 
DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2
Valentina Diaz
 
DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2
valentina Diaz
 

Similar to Validation, Evaluation, Dissemination: Academia’s gravest problems show the way to the Next Generation Repositories (20)

Pathology-2016_Brochure
Pathology-2016_BrochurePathology-2016_Brochure
Pathology-2016_Brochure
 
World ADC Frankfurt 2015 - sample brochure
World ADC Frankfurt 2015 - sample brochureWorld ADC Frankfurt 2015 - sample brochure
World ADC Frankfurt 2015 - sample brochure
 
Aries systems eemug 2021 manuscript eval services panel sci score v2_edits
Aries systems eemug 2021 manuscript eval services panel sci score v2_editsAries systems eemug 2021 manuscript eval services panel sci score v2_edits
Aries systems eemug 2021 manuscript eval services panel sci score v2_edits
 
2021 INTRO TO QUALITY CONTROL.pptx
2021 INTRO TO QUALITY CONTROL.pptx2021 INTRO TO QUALITY CONTROL.pptx
2021 INTRO TO QUALITY CONTROL.pptx
 
Pharmaceutical Quality - The Office of
Pharmaceutical Quality -  The Office ofPharmaceutical Quality -  The Office of
Pharmaceutical Quality - The Office of
 
Program - 3rd Annual Drug Delivery and Formulation Summit 2013, San Diego
Program - 3rd Annual Drug Delivery and Formulation Summit 2013, San DiegoProgram - 3rd Annual Drug Delivery and Formulation Summit 2013, San Diego
Program - 3rd Annual Drug Delivery and Formulation Summit 2013, San Diego
 
Science Exchange - Measuring Research Efficiency & Quality
Science Exchange - Measuring Research Efficiency & QualityScience Exchange - Measuring Research Efficiency & Quality
Science Exchange - Measuring Research Efficiency & Quality
 
Professional use of Twitter and Healthcare Social Media #NPD100
Professional use of Twitter and Healthcare Social Media #NPD100Professional use of Twitter and Healthcare Social Media #NPD100
Professional use of Twitter and Healthcare Social Media #NPD100
 
Open-Access Mega-Journals (OAMJ): initial results presented at 2016 RLUK conf...
Open-Access Mega-Journals (OAMJ): initial results presented at 2016 RLUK conf...Open-Access Mega-Journals (OAMJ): initial results presented at 2016 RLUK conf...
Open-Access Mega-Journals (OAMJ): initial results presented at 2016 RLUK conf...
 
DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2
 
DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2DubaiVaccines-2015_Brochure_2
DubaiVaccines-2015_Brochure_2
 
The Surgical Safety Checklist; Rhetoric….or are we making a difference?
The Surgical Safety Checklist; Rhetoric….or are we making a difference?The Surgical Safety Checklist; Rhetoric….or are we making a difference?
The Surgical Safety Checklist; Rhetoric….or are we making a difference?
 
What is the future of scientific communication? Open Science (Claude Pirmez)
What is the future of scientific communication? Open Science (Claude Pirmez)What is the future of scientific communication? Open Science (Claude Pirmez)
What is the future of scientific communication? Open Science (Claude Pirmez)
 
Chain of Trust, a web quality assessment tool
Chain of Trust, a web quality assessment toolChain of Trust, a web quality assessment tool
Chain of Trust, a web quality assessment tool
 
Apr
AprApr
Apr
 
Apr
AprApr
Apr
 
Apr 1
Apr 1Apr 1
Apr 1
 
Apr 1
Apr 1Apr 1
Apr 1
 
Apr 1
Apr 1Apr 1
Apr 1
 
Apr 1
Apr 1Apr 1
Apr 1
 

More from Pandelis Perakakis

More from Pandelis Perakakis (10)

Ciencia Abierta COP Madrid
Ciencia Abierta COP MadridCiencia Abierta COP Madrid
Ciencia Abierta COP Madrid
 
Open Science: What, why, how?
Open Science: What, why, how?Open Science: What, why, how?
Open Science: What, why, how?
 
Why True Science is only Open Science
Why True Science is only Open ScienceWhy True Science is only Open Science
Why True Science is only Open Science
 
"One damned thing after another”: The journal monopoly, how it came to be, wh...
"One damned thing after another”: The journal monopoly, how it came to be, wh..."One damned thing after another”: The journal monopoly, how it came to be, wh...
"One damned thing after another”: The journal monopoly, how it came to be, wh...
 
Respiración para Psicólogos
Respiración para PsicólogosRespiración para Psicólogos
Respiración para Psicólogos
 
Open Access: the tip of the iceberg
Open Access: the tip of the iceberg Open Access: the tip of the iceberg
Open Access: the tip of the iceberg
 
Asthma-misconceptions-Facultad-Psicologia-29-05-2014
Asthma-misconceptions-Facultad-Psicologia-29-05-2014Asthma-misconceptions-Facultad-Psicologia-29-05-2014
Asthma-misconceptions-Facultad-Psicologia-29-05-2014
 
Open Peer Review to Save the World
Open Peer Review to Save the WorldOpen Peer Review to Save the World
Open Peer Review to Save the World
 
LIBRE presentation at the Horizon 2020 Infodays
LIBRE presentation at the Horizon 2020 InfodaysLIBRE presentation at the Horizon 2020 Infodays
LIBRE presentation at the Horizon 2020 Infodays
 
Beyond Open Access: Facing the Real Problems
Beyond Open Access: Facing the Real ProblemsBeyond Open Access: Facing the Real Problems
Beyond Open Access: Facing the Real Problems
 

Recently uploaded

Continuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discsContinuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discs
Sérgio Sacani
 
Jet reorientation in central galaxies of clusters and groups: insights from V...
Jet reorientation in central galaxies of clusters and groups: insights from V...Jet reorientation in central galaxies of clusters and groups: insights from V...
Jet reorientation in central galaxies of clusters and groups: insights from V...
Sérgio Sacani
 
Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...
Sérgio Sacani
 
Mitosis...............................pptx
Mitosis...............................pptxMitosis...............................pptx
Mitosis...............................pptx
Cherry
 
The solar dynamo begins near the surface
The solar dynamo begins near the surfaceThe solar dynamo begins near the surface
The solar dynamo begins near the surface
Sérgio Sacani
 
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Sérgio Sacani
 

Recently uploaded (20)

Hemoglobin metabolism: C Kalyan & E. Muralinath
Hemoglobin metabolism: C Kalyan & E. MuralinathHemoglobin metabolism: C Kalyan & E. Muralinath
Hemoglobin metabolism: C Kalyan & E. Muralinath
 
PLANT DISEASE MANAGEMENT PRINCIPLES AND ITS IMPORTANCE
PLANT DISEASE MANAGEMENT PRINCIPLES AND ITS IMPORTANCEPLANT DISEASE MANAGEMENT PRINCIPLES AND ITS IMPORTANCE
PLANT DISEASE MANAGEMENT PRINCIPLES AND ITS IMPORTANCE
 
National Biodiversity protection initiatives and Convention on Biological Di...
National Biodiversity protection initiatives and  Convention on Biological Di...National Biodiversity protection initiatives and  Convention on Biological Di...
National Biodiversity protection initiatives and Convention on Biological Di...
 
Virulence Analysis of Citrus canker caused by Xanthomonas axonopodis pv. citr...
Virulence Analysis of Citrus canker caused by Xanthomonas axonopodis pv. citr...Virulence Analysis of Citrus canker caused by Xanthomonas axonopodis pv. citr...
Virulence Analysis of Citrus canker caused by Xanthomonas axonopodis pv. citr...
 
NuGOweek 2024 full programme - hosted by Ghent University
NuGOweek 2024 full programme - hosted by Ghent UniversityNuGOweek 2024 full programme - hosted by Ghent University
NuGOweek 2024 full programme - hosted by Ghent University
 
Continuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discsContinuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discs
 
Ostiguy & Panizza & Moffitt (eds.) - Populism in Global Perspective. A Perfor...
Ostiguy & Panizza & Moffitt (eds.) - Populism in Global Perspective. A Perfor...Ostiguy & Panizza & Moffitt (eds.) - Populism in Global Perspective. A Perfor...
Ostiguy & Panizza & Moffitt (eds.) - Populism in Global Perspective. A Perfor...
 
METHODS OF TRANSCRIPTOME ANALYSIS....pptx
METHODS OF TRANSCRIPTOME ANALYSIS....pptxMETHODS OF TRANSCRIPTOME ANALYSIS....pptx
METHODS OF TRANSCRIPTOME ANALYSIS....pptx
 
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptxPlasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
 
WASP-69b’s Escaping Envelope Is Confined to a Tail Extending at Least 7 Rp
WASP-69b’s Escaping Envelope Is Confined to a Tail Extending at Least 7 RpWASP-69b’s Escaping Envelope Is Confined to a Tail Extending at Least 7 Rp
WASP-69b’s Escaping Envelope Is Confined to a Tail Extending at Least 7 Rp
 
Jet reorientation in central galaxies of clusters and groups: insights from V...
Jet reorientation in central galaxies of clusters and groups: insights from V...Jet reorientation in central galaxies of clusters and groups: insights from V...
Jet reorientation in central galaxies of clusters and groups: insights from V...
 
KOCH'S POSTULATE: an extensive over view.pptx
KOCH'S POSTULATE: an extensive over view.pptxKOCH'S POSTULATE: an extensive over view.pptx
KOCH'S POSTULATE: an extensive over view.pptx
 
mixotrophy in cyanobacteria: a dual nutritional strategy
mixotrophy in cyanobacteria: a dual nutritional strategymixotrophy in cyanobacteria: a dual nutritional strategy
mixotrophy in cyanobacteria: a dual nutritional strategy
 
Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...
 
GBSN - Microbiology (Unit 7) Microbiology in Everyday Life
GBSN - Microbiology (Unit 7) Microbiology in Everyday LifeGBSN - Microbiology (Unit 7) Microbiology in Everyday Life
GBSN - Microbiology (Unit 7) Microbiology in Everyday Life
 
Alternative method of dissolution in-vitro in-vivo correlation and dissolutio...
Alternative method of dissolution in-vitro in-vivo correlation and dissolutio...Alternative method of dissolution in-vitro in-vivo correlation and dissolutio...
Alternative method of dissolution in-vitro in-vivo correlation and dissolutio...
 
Mitosis...............................pptx
Mitosis...............................pptxMitosis...............................pptx
Mitosis...............................pptx
 
Extensive Pollution of Uranus and Neptune’s Atmospheres by Upsweep of Icy Mat...
Extensive Pollution of Uranus and Neptune’s Atmospheres by Upsweep of Icy Mat...Extensive Pollution of Uranus and Neptune’s Atmospheres by Upsweep of Icy Mat...
Extensive Pollution of Uranus and Neptune’s Atmospheres by Upsweep of Icy Mat...
 
The solar dynamo begins near the surface
The solar dynamo begins near the surfaceThe solar dynamo begins near the surface
The solar dynamo begins near the surface
 
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
 

Validation, Evaluation, Dissemination: Academia’s gravest problems show the way to the Next Generation Repositories