SlideShare a Scribd company logo

Creating a dataset of peer review in computer science conferences published by Springer

A
A
Aliaksandr BirukouVice President at Springer Nature

Computer science (CS) as a field is characterised by higher publication numbers and prestige of conference proceedings as opposed to scholarly journal articles. In this presentation we present preliminary results of the extraction and analysis of peer review information from computer science conferences published by Springer in almost 10,000 proceedings volumes. The results will be uploaded to lod.springer.com, with the purpose of creation of the largest dataset of peer review processes in CS conferences.

Creating a dataset of peer review in computer science conferences published by Springer

1 of 34
Download to read offline
University of Split
School of Medicine
Creating a dataset of peer review
in computer science conferences
published by Springer
Malički Mario, Birukou Aliaksandr
Short Term Scientific Mission
PEERE TD1306
New Frontiers of Peer Review
STSM 2 March to 20 May 2015
Background
 Computer science publishes more research as
conference proceedings than as journal articles
 More reviewers, faster publication
 They constitute 20-70% of references in journals
 Journals in CS (n=400) IF - 0,77 to 1,47
Proceedings n=10 310
 LNCS – Lecture Notes in Computer Science (8948 )
1995- 1000 volumes (40-50)
2002 – 2500 volumes (100)
>2010 – 2014 600 per year
 LNICST - Lecture Notes of the
Institute for Computer Sciences,
Social Informatics and
Telecommunications Engineering
(141)
 IFIP-AICT - Advances in
Information and Communication
Technology (525)
 LNBIP - Lecture Notes in Business
Information Processing (201)
 CCIS - Communications in
Computer and Information
Science (495)
LECTURE NOTES IN COMPUTER SCIENCE
 1973, from 1981. in Web of Science
 Scopus – 250 000 articles, WoS >100 k
 Md conference iteration is 7 (1-50) ~ 1500 conferences
0
0.2
0.4
0.6
0.8
1
1.2
1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
SNIP- Source normalized impact per paper
SNIP
Ad

Recommended

Implementing #CSforAll in Your District, TASA Midwinter Jan 2017
Implementing #CSforAll in Your District, TASA Midwinter Jan 2017Implementing #CSforAll in Your District, TASA Midwinter Jan 2017
Implementing #CSforAll in Your District, TASA Midwinter Jan 2017Hal Speed
 
Contributions to the multidisciplinarity of computer science and IS
Contributions to the multidisciplinarity of computer science and ISContributions to the multidisciplinarity of computer science and IS
Contributions to the multidisciplinarity of computer science and ISSaïd Assar
 
Building a Computer Science Pathway for Endorsements
Building a Computer Science Pathway for EndorsementsBuilding a Computer Science Pathway for Endorsements
Building a Computer Science Pathway for EndorsementsHal Speed
 
CS4TX Quarterly Webinar Jan 2017
CS4TX Quarterly Webinar Jan 2017CS4TX Quarterly Webinar Jan 2017
CS4TX Quarterly Webinar Jan 2017Hal Speed
 
Computer Science Imperative
Computer Science ImperativeComputer Science Imperative
Computer Science ImperativeHal Speed
 
Computer Science for All in Texas
Computer Science for All in TexasComputer Science for All in Texas
Computer Science for All in TexasHal Speed
 
Computer Science NAAC presentation Pratibha college Chinchwad
Computer Science NAAC presentation Pratibha college ChinchwadComputer Science NAAC presentation Pratibha college Chinchwad
Computer Science NAAC presentation Pratibha college ChinchwadDr.Ashvini Chaudhari Bhongade
 

More Related Content

What's hot

Making Sense of Computer Science Requirements Texas STEM Jan 2017
Making Sense of Computer Science Requirements Texas STEM Jan 2017Making Sense of Computer Science Requirements Texas STEM Jan 2017
Making Sense of Computer Science Requirements Texas STEM Jan 2017Hal Speed
 
Computer science curriculum based on Program learning outcomes and objectives
Computer science curriculum based on Program learning outcomes and objectivesComputer science curriculum based on Program learning outcomes and objectives
Computer science curriculum based on Program learning outcomes and objectivesJawad Khan
 
Making Sense of Texas Computer Science Requirements
Making Sense of Texas Computer Science RequirementsMaking Sense of Texas Computer Science Requirements
Making Sense of Texas Computer Science RequirementsHal Speed
 
Building a Computer Science Pipeline in Your District
Building a Computer Science Pipeline in Your DistrictBuilding a Computer Science Pipeline in Your District
Building a Computer Science Pipeline in Your DistrictWeTeach_CS
 
TASA/TASB 2015 Computer Science Imperative for K-12
TASA/TASB 2015 Computer Science Imperative for K-12TASA/TASB 2015 Computer Science Imperative for K-12
TASA/TASB 2015 Computer Science Imperative for K-12Hal Speed
 
Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...
Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...
Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...E Rey Garcia, MPA, DCS-EIS Candidate
 
Carol Fletcher CS Summit Welcome
Carol Fletcher CS Summit WelcomeCarol Fletcher CS Summit Welcome
Carol Fletcher CS Summit WelcomeWeTeach_CS
 
Priming the Computer Science Pump
Priming the Computer Science PumpPriming the Computer Science Pump
Priming the Computer Science PumpWeTeach_CS
 
Why computer science in K-12 by Code.org
Why computer science in K-12 by Code.orgWhy computer science in K-12 by Code.org
Why computer science in K-12 by Code.orgPeerasak C.
 
Building a Computer Science Pipeline
Building a Computer Science PipelineBuilding a Computer Science Pipeline
Building a Computer Science PipelineHal Speed
 
Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...
Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...
Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...WeTeach_CS
 
Panjab University UIET IT Syllabus 2014-15
Panjab University UIET IT Syllabus 2014-15Panjab University UIET IT Syllabus 2014-15
Panjab University UIET IT Syllabus 2014-15Rai Gourav Singh
 
Making Sense of Computer Science Requirements for Texas High Schools -- June ...
Making Sense of Computer Science Requirements for Texas High Schools -- June ...Making Sense of Computer Science Requirements for Texas High Schools -- June ...
Making Sense of Computer Science Requirements for Texas High Schools -- June ...Hal Speed
 
Sept 6 2021 BTech Artificial Intelligence and Data Science curriculum
Sept 6 2021 BTech Artificial Intelligence and Data Science curriculumSept 6 2021 BTech Artificial Intelligence and Data Science curriculum
Sept 6 2021 BTech Artificial Intelligence and Data Science curriculumFerdin Joe John Joseph PhD
 
ChenXin_Daniel_Han
ChenXin_Daniel_HanChenXin_Daniel_Han
ChenXin_Daniel_HanDaniel Han
 
Course file for theory of computation dt 08 08-2016.
Course file for theory of computation dt 08 08-2016.Course file for theory of computation dt 08 08-2016.
Course file for theory of computation dt 08 08-2016.sumit jain
 
Cv europass-20190831-nghiem-en
Cv europass-20190831-nghiem-enCv europass-20190831-nghiem-en
Cv europass-20190831-nghiem-enHoa Le
 

What's hot (19)

Making Sense of Computer Science Requirements Texas STEM Jan 2017
Making Sense of Computer Science Requirements Texas STEM Jan 2017Making Sense of Computer Science Requirements Texas STEM Jan 2017
Making Sense of Computer Science Requirements Texas STEM Jan 2017
 
Computer science curriculum based on Program learning outcomes and objectives
Computer science curriculum based on Program learning outcomes and objectivesComputer science curriculum based on Program learning outcomes and objectives
Computer science curriculum based on Program learning outcomes and objectives
 
Making Sense of Texas Computer Science Requirements
Making Sense of Texas Computer Science RequirementsMaking Sense of Texas Computer Science Requirements
Making Sense of Texas Computer Science Requirements
 
Building a Computer Science Pipeline in Your District
Building a Computer Science Pipeline in Your DistrictBuilding a Computer Science Pipeline in Your District
Building a Computer Science Pipeline in Your District
 
TASA/TASB 2015 Computer Science Imperative for K-12
TASA/TASB 2015 Computer Science Imperative for K-12TASA/TASB 2015 Computer Science Imperative for K-12
TASA/TASB 2015 Computer Science Imperative for K-12
 
Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...
Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...
Doctoral of Computer Science Enterprise Information Systems - Colorado Techni...
 
Be computer-engineering-2012
Be computer-engineering-2012Be computer-engineering-2012
Be computer-engineering-2012
 
Carol Fletcher CS Summit Welcome
Carol Fletcher CS Summit WelcomeCarol Fletcher CS Summit Welcome
Carol Fletcher CS Summit Welcome
 
Priming the Computer Science Pump
Priming the Computer Science PumpPriming the Computer Science Pump
Priming the Computer Science Pump
 
Why computer science in K-12 by Code.org
Why computer science in K-12 by Code.orgWhy computer science in K-12 by Code.org
Why computer science in K-12 by Code.org
 
Building a Computer Science Pipeline
Building a Computer Science PipelineBuilding a Computer Science Pipeline
Building a Computer Science Pipeline
 
Administrative
AdministrativeAdministrative
Administrative
 
Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...
Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...
Comparing the Efficacy of Face to Face, MOOC and Hybrid Computer Science Teac...
 
Panjab University UIET IT Syllabus 2014-15
Panjab University UIET IT Syllabus 2014-15Panjab University UIET IT Syllabus 2014-15
Panjab University UIET IT Syllabus 2014-15
 
Making Sense of Computer Science Requirements for Texas High Schools -- June ...
Making Sense of Computer Science Requirements for Texas High Schools -- June ...Making Sense of Computer Science Requirements for Texas High Schools -- June ...
Making Sense of Computer Science Requirements for Texas High Schools -- June ...
 
Sept 6 2021 BTech Artificial Intelligence and Data Science curriculum
Sept 6 2021 BTech Artificial Intelligence and Data Science curriculumSept 6 2021 BTech Artificial Intelligence and Data Science curriculum
Sept 6 2021 BTech Artificial Intelligence and Data Science curriculum
 
ChenXin_Daniel_Han
ChenXin_Daniel_HanChenXin_Daniel_Han
ChenXin_Daniel_Han
 
Course file for theory of computation dt 08 08-2016.
Course file for theory of computation dt 08 08-2016.Course file for theory of computation dt 08 08-2016.
Course file for theory of computation dt 08 08-2016.
 
Cv europass-20190831-nghiem-en
Cv europass-20190831-nghiem-enCv europass-20190831-nghiem-en
Cv europass-20190831-nghiem-en
 

Viewers also liked

Linked Open Data about Springer Nature conferences. The story so far
Linked Open Data about Springer Nature conferences. The story so farLinked Open Data about Springer Nature conferences. The story so far
Linked Open Data about Springer Nature conferences. The story so farAliaksandr Birukou
 
General presentation of the LiquidPub project
General presentation of the LiquidPub projectGeneral presentation of the LiquidPub project
General presentation of the LiquidPub projectAliaksandr Birukou
 
Project Contractv2
Project Contractv2Project Contractv2
Project Contractv2samluk
 
The Design of Data
The Design of DataThe Design of Data
The Design of DataIan White
 
Work In Progress
Work In ProgressWork In Progress
Work In Progresssamluk
 
Geotrends For 2011 And Beyond
Geotrends For 2011 And BeyondGeotrends For 2011 And Beyond
Geotrends For 2011 And BeyondIan White
 
Career And Inventory Management
Career And Inventory ManagementCareer And Inventory Management
Career And Inventory ManagementSven Kruijs
 
The Digestive System
The Digestive SystemThe Digestive System
The Digestive Systemjamesdeal1
 
Choose Respect Final Assessment
Choose Respect Final AssessmentChoose Respect Final Assessment
Choose Respect Final Assessmentguest78c6cc12
 
College Chapter 1 1
College Chapter 1 1College Chapter 1 1
College Chapter 1 1gmaidekamido
 
Next Generation Traffic: Is Your Network Ready?
Next Generation Traffic: Is Your Network Ready?Next Generation Traffic: Is Your Network Ready?
Next Generation Traffic: Is Your Network Ready?Anil Chopra
 
Research and Planning
Research and PlanningResearch and Planning
Research and Planningguestae5007f
 
Electrical characteristics
Electrical characteristicsElectrical characteristics
Electrical characteristicsdijahapple
 
Escala F F
Escala  F FEscala  F F
Escala F Falondra
 
Economic presentation
Economic presentationEconomic presentation
Economic presentationErin McClarty
 
Fotografia Panaderiay Pasteleria
Fotografia Panaderiay PasteleriaFotografia Panaderiay Pasteleria
Fotografia Panaderiay PasteleriaTaliana2009
 
дети войны
дети войныдети войны
дети войныmonolite
 
Measuring the potential of viral stuff
Measuring the potential of viral stuffMeasuring the potential of viral stuff
Measuring the potential of viral stuffBruno Mendonça
 

Viewers also liked (20)

Linked Open Data about Springer Nature conferences. The story so far
Linked Open Data about Springer Nature conferences. The story so farLinked Open Data about Springer Nature conferences. The story so far
Linked Open Data about Springer Nature conferences. The story so far
 
General presentation of the LiquidPub project
General presentation of the LiquidPub projectGeneral presentation of the LiquidPub project
General presentation of the LiquidPub project
 
Project Contractv2
Project Contractv2Project Contractv2
Project Contractv2
 
The Design of Data
The Design of DataThe Design of Data
The Design of Data
 
Work In Progress
Work In ProgressWork In Progress
Work In Progress
 
Geotrends For 2011 And Beyond
Geotrends For 2011 And BeyondGeotrends For 2011 And Beyond
Geotrends For 2011 And Beyond
 
Career And Inventory Management
Career And Inventory ManagementCareer And Inventory Management
Career And Inventory Management
 
The Digestive System
The Digestive SystemThe Digestive System
The Digestive System
 
Choose Respect Final Assessment
Choose Respect Final AssessmentChoose Respect Final Assessment
Choose Respect Final Assessment
 
College Chapter 1 1
College Chapter 1 1College Chapter 1 1
College Chapter 1 1
 
Next Generation Traffic: Is Your Network Ready?
Next Generation Traffic: Is Your Network Ready?Next Generation Traffic: Is Your Network Ready?
Next Generation Traffic: Is Your Network Ready?
 
Research and Planning
Research and PlanningResearch and Planning
Research and Planning
 
Electrical characteristics
Electrical characteristicsElectrical characteristics
Electrical characteristics
 
Escala F F
Escala  F FEscala  F F
Escala F F
 
Economic presentation
Economic presentationEconomic presentation
Economic presentation
 
Chapter 2 3
Chapter 2 3Chapter 2 3
Chapter 2 3
 
Fotografia Panaderiay Pasteleria
Fotografia Panaderiay PasteleriaFotografia Panaderiay Pasteleria
Fotografia Panaderiay Pasteleria
 
дети войны
дети войныдети войны
дети войны
 
2011 VPPR Training
2011 VPPR Training2011 VPPR Training
2011 VPPR Training
 
Measuring the potential of viral stuff
Measuring the potential of viral stuffMeasuring the potential of viral stuff
Measuring the potential of viral stuff
 

Similar to Creating a dataset of peer review in computer science conferences published by Springer

Workshop nwav 47 - LVS - Tool for Quantitative Data Analysis
Workshop nwav 47 - LVS - Tool for Quantitative Data AnalysisWorkshop nwav 47 - LVS - Tool for Quantitative Data Analysis
Workshop nwav 47 - LVS - Tool for Quantitative Data AnalysisOlga Scrivner
 
ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)
ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)
ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)Konstantinos Zagoris
 
M.tech.(cse) (regular) part i(semester i & ii)
M.tech.(cse) (regular) part i(semester i & ii)M.tech.(cse) (regular) part i(semester i & ii)
M.tech.(cse) (regular) part i(semester i & ii)Rekha Bhatia
 
[PythonPH] Transforming the call center with Text mining and Deep learning (C...
[PythonPH] Transforming the call center with Text mining and Deep learning (C...[PythonPH] Transforming the call center with Text mining and Deep learning (C...
[PythonPH] Transforming the call center with Text mining and Deep learning (C...Paul Lo
 
Training in Analytics, R and Social Media Analytics
Training in Analytics, R and Social Media AnalyticsTraining in Analytics, R and Social Media Analytics
Training in Analytics, R and Social Media AnalyticsAjay Ohri
 
Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...
Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...
Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...Gabriel Moreira
 
Software Measurement: Lecture 1. Measures and Metrics
Software Measurement: Lecture 1. Measures and MetricsSoftware Measurement: Lecture 1. Measures and Metrics
Software Measurement: Lecture 1. Measures and MetricsProgrameter
 
Building Learning to Rank (LTR) search reranking models using Large Language ...
Building Learning to Rank (LTR) search reranking models using Large Language ...Building Learning to Rank (LTR) search reranking models using Large Language ...
Building Learning to Rank (LTR) search reranking models using Large Language ...Sujit Pal
 
Paperpaper.docxResearch paperPlease see the Syllabus. You.docx
Paperpaper.docxResearch paperPlease see the Syllabus. You.docxPaperpaper.docxResearch paperPlease see the Syllabus. You.docx
Paperpaper.docxResearch paperPlease see the Syllabus. You.docxdanhaley45372
 
R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...
R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...
R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...BAINIDA
 
3 Software Estmation.ppt
3 Software Estmation.ppt3 Software Estmation.ppt
3 Software Estmation.pptSoham De
 
Discovering User's Topics of Interest in Recommender Systems
Discovering User's Topics of Interest in Recommender SystemsDiscovering User's Topics of Interest in Recommender Systems
Discovering User's Topics of Interest in Recommender SystemsGabriel Moreira
 
HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...
HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...
HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...Nawanan Theera-Ampornpunt
 
Data science training in hyderabad
Data science training in hyderabadData science training in hyderabad
Data science training in hyderabadGeohedrick
 
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...Lifeng (Aaron) Han
 
1. In a study to investigate the relative effectiveness of six dif.docx
1. In a study to investigate the relative effectiveness of six dif.docx1. In a study to investigate the relative effectiveness of six dif.docx
1. In a study to investigate the relative effectiveness of six dif.docxjackiewalcutt
 

Similar to Creating a dataset of peer review in computer science conferences published by Springer (20)

Workshop nwav 47 - LVS - Tool for Quantitative Data Analysis
Workshop nwav 47 - LVS - Tool for Quantitative Data AnalysisWorkshop nwav 47 - LVS - Tool for Quantitative Data Analysis
Workshop nwav 47 - LVS - Tool for Quantitative Data Analysis
 
ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)
ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)
ICFHR 2014 Competition on Handwritten KeyWord Spotting (H-KWS 2014)
 
M.tech.(cse) (regular) part i(semester i & ii)
M.tech.(cse) (regular) part i(semester i & ii)M.tech.(cse) (regular) part i(semester i & ii)
M.tech.(cse) (regular) part i(semester i & ii)
 
[PythonPH] Transforming the call center with Text mining and Deep learning (C...
[PythonPH] Transforming the call center with Text mining and Deep learning (C...[PythonPH] Transforming the call center with Text mining and Deep learning (C...
[PythonPH] Transforming the call center with Text mining and Deep learning (C...
 
CLIM Program: Remote Sensing Workshop, An Introduction to Systems and Softwar...
CLIM Program: Remote Sensing Workshop, An Introduction to Systems and Softwar...CLIM Program: Remote Sensing Workshop, An Introduction to Systems and Softwar...
CLIM Program: Remote Sensing Workshop, An Introduction to Systems and Softwar...
 
Training in Analytics, R and Social Media Analytics
Training in Analytics, R and Social Media AnalyticsTraining in Analytics, R and Social Media Analytics
Training in Analytics, R and Social Media Analytics
 
R tutorial
R tutorialR tutorial
R tutorial
 
Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...
Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...
Discovering User's Topics of Interest in Recommender Systems @ Meetup Machine...
 
Software Measurement: Lecture 1. Measures and Metrics
Software Measurement: Lecture 1. Measures and MetricsSoftware Measurement: Lecture 1. Measures and Metrics
Software Measurement: Lecture 1. Measures and Metrics
 
Building Learning to Rank (LTR) search reranking models using Large Language ...
Building Learning to Rank (LTR) search reranking models using Large Language ...Building Learning to Rank (LTR) search reranking models using Large Language ...
Building Learning to Rank (LTR) search reranking models using Large Language ...
 
Paperpaper.docxResearch paperPlease see the Syllabus. You.docx
Paperpaper.docxResearch paperPlease see the Syllabus. You.docxPaperpaper.docxResearch paperPlease see the Syllabus. You.docx
Paperpaper.docxResearch paperPlease see the Syllabus. You.docx
 
R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...
R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...
R Tool for Visual Studio และการทำงานร่วมกันเป็นทีม โดย เฉลิมวงศ์ วิจิตรปิยะกุ...
 
3 Software Estmation.ppt
3 Software Estmation.ppt3 Software Estmation.ppt
3 Software Estmation.ppt
 
Discovering User's Topics of Interest in Recommender Systems
Discovering User's Topics of Interest in Recommender SystemsDiscovering User's Topics of Interest in Recommender Systems
Discovering User's Topics of Interest in Recommender Systems
 
HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...
HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...
HL7 & HL7 CDA: The Implementation of Thailand's Healthcare Messaging Exchange...
 
Phpconf2008 Sphinx En
Phpconf2008 Sphinx EnPhpconf2008 Sphinx En
Phpconf2008 Sphinx En
 
Software metrics
Software metricsSoftware metrics
Software metrics
 
Data science training in hyderabad
Data science training in hyderabadData science training in hyderabad
Data science training in hyderabad
 
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Profession...
 
1. In a study to investigate the relative effectiveness of six dif.docx
1. In a study to investigate the relative effectiveness of six dif.docx1. In a study to investigate the relative effectiveness of six dif.docx
1. In a study to investigate the relative effectiveness of six dif.docx
 

More from Aliaksandr Birukou

Publishing conference proceedings internationally: how does it work
Publishing conference proceedings internationally: how does it workPublishing conference proceedings internationally: how does it work
Publishing conference proceedings internationally: how does it workAliaksandr Birukou
 
Технические аспекты публикации на нескольких языках – как правильно связать DOI
Технические аспекты публикации на нескольких языках – как правильно связать DOIТехнические аспекты публикации на нескольких языках – как правильно связать DOI
Технические аспекты публикации на нескольких языках – как правильно связать DOIAliaksandr Birukou
 
Conference Identity: persistent identifiers for conferences
Conference Identity: persistent identifiers for conferencesConference Identity: persistent identifiers for conferences
Conference Identity: persistent identifiers for conferencesAliaksandr Birukou
 
Springer LOD conference portal. Demo paper - screenshots
Springer LOD conference portal. Demo paper - screenshotsSpringer LOD conference portal. Demo paper - screenshots
Springer LOD conference portal. Demo paper - screenshotsAliaksandr Birukou
 
PersistentIDs and CrossMark for Conference Proceedings
PersistentIDs and CrossMark for Conference ProceedingsPersistentIDs and CrossMark for Conference Proceedings
PersistentIDs and CrossMark for Conference ProceedingsAliaksandr Birukou
 
Publishing conference proceedings internationally: Tips and tricks
Publishing conference proceedings internationally: Tips and tricksPublishing conference proceedings internationally: Tips and tricks
Publishing conference proceedings internationally: Tips and tricksAliaksandr Birukou
 
Linked Data Initiatives at Springer Verlag
Linked Data Initiatives at Springer Verlag Linked Data Initiatives at Springer Verlag
Linked Data Initiatives at Springer Verlag Aliaksandr Birukou
 
Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...Aliaksandr Birukou
 
Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...Aliaksandr Birukou
 
An Integrated Solution for Runtime Compliance Governance in SOA
An Integrated Solution for Runtime Compliance Governance in SOAAn Integrated Solution for Runtime Compliance Governance in SOA
An Integrated Solution for Runtime Compliance Governance in SOAAliaksandr Birukou
 
20101112 librinnovando liquidpub
20101112 librinnovando liquidpub20101112 librinnovando liquidpub
20101112 librinnovando liquidpubAliaksandr Birukou
 
Is peer review any good? A quantitative analysis of peer review
Is peer review any good? A quantitative analysis of peer reviewIs peer review any good? A quantitative analysis of peer review
Is peer review any good? A quantitative analysis of peer reviewAliaksandr Birukou
 
Liquid Journals - Intro and RoadMap
Liquid Journals - Intro and RoadMapLiquid Journals - Intro and RoadMap
Liquid Journals - Intro and RoadMapAliaksandr Birukou
 
Liquid Journals. Overview. How social computing and liquid knowledge will sha...
Liquid Journals. Overview. How social computing and liquid knowledge will sha...Liquid Journals. Overview. How social computing and liquid knowledge will sha...
Liquid Journals. Overview. How social computing and liquid knowledge will sha...Aliaksandr Birukou
 
Automated Experimentation in Social Informatics
Automated Experimentation in Social InformaticsAutomated Experimentation in Social Informatics
Automated Experimentation in Social InformaticsAliaksandr Birukou
 
General presentation of the LiquidPub project
General presentation of the LiquidPub projectGeneral presentation of the LiquidPub project
General presentation of the LiquidPub projectAliaksandr Birukou
 
Peer Review in the LiquidPub project
Peer Review in the LiquidPub projectPeer Review in the LiquidPub project
Peer Review in the LiquidPub projectAliaksandr Birukou
 
LiquidPub: Services at Service of Science
LiquidPub: Services at Service of ScienceLiquidPub: Services at Service of Science
LiquidPub: Services at Service of ScienceAliaksandr Birukou
 
Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...
Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...
Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...Aliaksandr Birukou
 
Diversity versus accuracy: solving the apparent dilemma facing recommender sy...
Diversity versus accuracy: solving the apparent dilemma facing recommender sy...Diversity versus accuracy: solving the apparent dilemma facing recommender sy...
Diversity versus accuracy: solving the apparent dilemma facing recommender sy...Aliaksandr Birukou
 

More from Aliaksandr Birukou (20)

Publishing conference proceedings internationally: how does it work
Publishing conference proceedings internationally: how does it workPublishing conference proceedings internationally: how does it work
Publishing conference proceedings internationally: how does it work
 
Технические аспекты публикации на нескольких языках – как правильно связать DOI
Технические аспекты публикации на нескольких языках – как правильно связать DOIТехнические аспекты публикации на нескольких языках – как правильно связать DOI
Технические аспекты публикации на нескольких языках – как правильно связать DOI
 
Conference Identity: persistent identifiers for conferences
Conference Identity: persistent identifiers for conferencesConference Identity: persistent identifiers for conferences
Conference Identity: persistent identifiers for conferences
 
Springer LOD conference portal. Demo paper - screenshots
Springer LOD conference portal. Demo paper - screenshotsSpringer LOD conference portal. Demo paper - screenshots
Springer LOD conference portal. Demo paper - screenshots
 
PersistentIDs and CrossMark for Conference Proceedings
PersistentIDs and CrossMark for Conference ProceedingsPersistentIDs and CrossMark for Conference Proceedings
PersistentIDs and CrossMark for Conference Proceedings
 
Publishing conference proceedings internationally: Tips and tricks
Publishing conference proceedings internationally: Tips and tricksPublishing conference proceedings internationally: Tips and tricks
Publishing conference proceedings internationally: Tips and tricks
 
Linked Data Initiatives at Springer Verlag
Linked Data Initiatives at Springer Verlag Linked Data Initiatives at Springer Verlag
Linked Data Initiatives at Springer Verlag
 
Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...
 
Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...Diversity-aware search for people, content, events AND Diversity-aware hiring...
Diversity-aware search for people, content, events AND Diversity-aware hiring...
 
An Integrated Solution for Runtime Compliance Governance in SOA
An Integrated Solution for Runtime Compliance Governance in SOAAn Integrated Solution for Runtime Compliance Governance in SOA
An Integrated Solution for Runtime Compliance Governance in SOA
 
20101112 librinnovando liquidpub
20101112 librinnovando liquidpub20101112 librinnovando liquidpub
20101112 librinnovando liquidpub
 
Is peer review any good? A quantitative analysis of peer review
Is peer review any good? A quantitative analysis of peer reviewIs peer review any good? A quantitative analysis of peer review
Is peer review any good? A quantitative analysis of peer review
 
Liquid Journals - Intro and RoadMap
Liquid Journals - Intro and RoadMapLiquid Journals - Intro and RoadMap
Liquid Journals - Intro and RoadMap
 
Liquid Journals. Overview. How social computing and liquid knowledge will sha...
Liquid Journals. Overview. How social computing and liquid knowledge will sha...Liquid Journals. Overview. How social computing and liquid knowledge will sha...
Liquid Journals. Overview. How social computing and liquid knowledge will sha...
 
Automated Experimentation in Social Informatics
Automated Experimentation in Social InformaticsAutomated Experimentation in Social Informatics
Automated Experimentation in Social Informatics
 
General presentation of the LiquidPub project
General presentation of the LiquidPub projectGeneral presentation of the LiquidPub project
General presentation of the LiquidPub project
 
Peer Review in the LiquidPub project
Peer Review in the LiquidPub projectPeer Review in the LiquidPub project
Peer Review in the LiquidPub project
 
LiquidPub: Services at Service of Science
LiquidPub: Services at Service of ScienceLiquidPub: Services at Service of Science
LiquidPub: Services at Service of Science
 
Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...
Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...
Reshaping Scientific Knowledge Dissemination and Evaluation in the Age of the...
 
Diversity versus accuracy: solving the apparent dilemma facing recommender sy...
Diversity versus accuracy: solving the apparent dilemma facing recommender sy...Diversity versus accuracy: solving the apparent dilemma facing recommender sy...
Diversity versus accuracy: solving the apparent dilemma facing recommender sy...
 

Recently uploaded

Advancing CAM Assay Image Analysis Using Deep Learning Software
Advancing CAM Assay Image Analysis Using Deep Learning SoftwareAdvancing CAM Assay Image Analysis Using Deep Learning Software
Advancing CAM Assay Image Analysis Using Deep Learning SoftwareKML Vision
 
A review of volcanic electrification of the atmosphere and volcanic lightning
A review of volcanic electrification of the atmosphere and volcanic lightningA review of volcanic electrification of the atmosphere and volcanic lightning
A review of volcanic electrification of the atmosphere and volcanic lightningSérgio Sacani
 
Carpal tunnel Syndrom Wesam Aljabali -1.pdf
Carpal tunnel Syndrom Wesam Aljabali -1.pdfCarpal tunnel Syndrom Wesam Aljabali -1.pdf
Carpal tunnel Syndrom Wesam Aljabali -1.pdfMsm_mo
 
Geological evidence of extensive N-fixation by volcanic lightning during very...
Geological evidence of extensive N-fixation by volcanic lightning during very...Geological evidence of extensive N-fixation by volcanic lightning during very...
Geological evidence of extensive N-fixation by volcanic lightning during very...Sérgio Sacani
 
IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1
IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1
IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1Sérgio Sacani
 
A seven-Earth-radius helium-burning star inside a 20.5-min detached binary
A seven-Earth-radius helium-burning star inside a 20.5-min detached binaryA seven-Earth-radius helium-burning star inside a 20.5-min detached binary
A seven-Earth-radius helium-burning star inside a 20.5-min detached binarySérgio Sacani
 
Construction of Magic Squares by Swapping Rows and Columns.pdf
Construction of Magic Squares by Swapping Rows and Columns.pdfConstruction of Magic Squares by Swapping Rows and Columns.pdf
Construction of Magic Squares by Swapping Rows and Columns.pdfLossian Barbosa Bacelar Miranda
 
Physics Chapter Three - Electric Fields and Charges
Physics Chapter Three - Electric Fields and ChargesPhysics Chapter Three - Electric Fields and Charges
Physics Chapter Three - Electric Fields and Chargesalinford
 
ROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsx
ROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsxROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsx
ROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsxAnkitChoudhary955647
 
6129093.ppt plasmodium parasite zoology.
6129093.ppt plasmodium parasite zoology.6129093.ppt plasmodium parasite zoology.
6129093.ppt plasmodium parasite zoology.ssuser4d911a
 
A recently formed ocean inside Saturn’s moon Mimas
A recently formed ocean inside Saturn’s moon MimasA recently formed ocean inside Saturn’s moon Mimas
A recently formed ocean inside Saturn’s moon MimasSérgio Sacani
 
Antibiotic Resistance: Global Threat to Public Health.pptx
Antibiotic Resistance: Global Threat to Public Health.pptxAntibiotic Resistance: Global Threat to Public Health.pptx
Antibiotic Resistance: Global Threat to Public Health.pptxSudnyankaKandge1
 
Quality safety and legislations of cosmetics.pptx
Quality safety and legislations of cosmetics.pptxQuality safety and legislations of cosmetics.pptx
Quality safety and legislations of cosmetics.pptxDeviSky1
 
Age dependent lactation dynamics in northern elephant seals-2.pptx
Age dependent lactation dynamics in northern elephant seals-2.pptxAge dependent lactation dynamics in northern elephant seals-2.pptx
Age dependent lactation dynamics in northern elephant seals-2.pptxElise. Baugh
 
Exploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptx
Exploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptxExploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptx
Exploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptxSamrat Tayade
 
Oral histology : BDS- 1st year Dental-Pulp-Ppt.ppt
Oral histology : BDS- 1st year Dental-Pulp-Ppt.pptOral histology : BDS- 1st year Dental-Pulp-Ppt.ppt
Oral histology : BDS- 1st year Dental-Pulp-Ppt.pptSOUMYAADRDEPTOFDENTA1
 
CW 2 - Frustrated Lewis Pair - Molly winterbottom.pdf
CW 2 - Frustrated Lewis Pair - Molly winterbottom.pdfCW 2 - Frustrated Lewis Pair - Molly winterbottom.pdf
CW 2 - Frustrated Lewis Pair - Molly winterbottom.pdfMollyWinterbottom
 
Analytical Coursework - Molly Winterbottom.pdf
Analytical Coursework - Molly Winterbottom.pdfAnalytical Coursework - Molly Winterbottom.pdf
Analytical Coursework - Molly Winterbottom.pdfMollyWinterbottom
 

Recently uploaded (20)

Advancing CAM Assay Image Analysis Using Deep Learning Software
Advancing CAM Assay Image Analysis Using Deep Learning SoftwareAdvancing CAM Assay Image Analysis Using Deep Learning Software
Advancing CAM Assay Image Analysis Using Deep Learning Software
 
A review of volcanic electrification of the atmosphere and volcanic lightning
A review of volcanic electrification of the atmosphere and volcanic lightningA review of volcanic electrification of the atmosphere and volcanic lightning
A review of volcanic electrification of the atmosphere and volcanic lightning
 
Carpal tunnel Syndrom Wesam Aljabali -1.pdf
Carpal tunnel Syndrom Wesam Aljabali -1.pdfCarpal tunnel Syndrom Wesam Aljabali -1.pdf
Carpal tunnel Syndrom Wesam Aljabali -1.pdf
 
Geological evidence of extensive N-fixation by volcanic lightning during very...
Geological evidence of extensive N-fixation by volcanic lightning during very...Geological evidence of extensive N-fixation by volcanic lightning during very...
Geological evidence of extensive N-fixation by volcanic lightning during very...
 
IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1
IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1
IM-1 Press Kit - Kit de Imprensa do Lançmento da Missão IM-1
 
A seven-Earth-radius helium-burning star inside a 20.5-min detached binary
A seven-Earth-radius helium-burning star inside a 20.5-min detached binaryA seven-Earth-radius helium-burning star inside a 20.5-min detached binary
A seven-Earth-radius helium-burning star inside a 20.5-min detached binary
 
Construction of Magic Squares by Swapping Rows and Columns.pdf
Construction of Magic Squares by Swapping Rows and Columns.pdfConstruction of Magic Squares by Swapping Rows and Columns.pdf
Construction of Magic Squares by Swapping Rows and Columns.pdf
 
LC MS.pptx
LC MS.pptxLC MS.pptx
LC MS.pptx
 
Physics Chapter Three - Electric Fields and Charges
Physics Chapter Three - Electric Fields and ChargesPhysics Chapter Three - Electric Fields and Charges
Physics Chapter Three - Electric Fields and Charges
 
ROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsx
ROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsxROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsx
ROLES OF MICROBES IN BIOCONTROL BY ANKIT CHOUDHARY.ppsx
 
6129093.ppt plasmodium parasite zoology.
6129093.ppt plasmodium parasite zoology.6129093.ppt plasmodium parasite zoology.
6129093.ppt plasmodium parasite zoology.
 
A recently formed ocean inside Saturn’s moon Mimas
A recently formed ocean inside Saturn’s moon MimasA recently formed ocean inside Saturn’s moon Mimas
A recently formed ocean inside Saturn’s moon Mimas
 
Antibiotic Resistance: Global Threat to Public Health.pptx
Antibiotic Resistance: Global Threat to Public Health.pptxAntibiotic Resistance: Global Threat to Public Health.pptx
Antibiotic Resistance: Global Threat to Public Health.pptx
 
Quality safety and legislations of cosmetics.pptx
Quality safety and legislations of cosmetics.pptxQuality safety and legislations of cosmetics.pptx
Quality safety and legislations of cosmetics.pptx
 
Age dependent lactation dynamics in northern elephant seals-2.pptx
Age dependent lactation dynamics in northern elephant seals-2.pptxAge dependent lactation dynamics in northern elephant seals-2.pptx
Age dependent lactation dynamics in northern elephant seals-2.pptx
 
Exploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptx
Exploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptxExploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptx
Exploring Artificial Intelligence_ Revolutionizing Tomorrow's World.pptx
 
Oral histology : BDS- 1st year Dental-Pulp-Ppt.ppt
Oral histology : BDS- 1st year Dental-Pulp-Ppt.pptOral histology : BDS- 1st year Dental-Pulp-Ppt.ppt
Oral histology : BDS- 1st year Dental-Pulp-Ppt.ppt
 
CW 2 - Frustrated Lewis Pair - Molly winterbottom.pdf
CW 2 - Frustrated Lewis Pair - Molly winterbottom.pdfCW 2 - Frustrated Lewis Pair - Molly winterbottom.pdf
CW 2 - Frustrated Lewis Pair - Molly winterbottom.pdf
 
Sujay NPAP Part One.pdf
Sujay NPAP Part One.pdfSujay NPAP Part One.pdf
Sujay NPAP Part One.pdf
 
Analytical Coursework - Molly Winterbottom.pdf
Analytical Coursework - Molly Winterbottom.pdfAnalytical Coursework - Molly Winterbottom.pdf
Analytical Coursework - Molly Winterbottom.pdf
 

Creating a dataset of peer review in computer science conferences published by Springer

  • 1. University of Split School of Medicine Creating a dataset of peer review in computer science conferences published by Springer Malički Mario, Birukou Aliaksandr Short Term Scientific Mission PEERE TD1306 New Frontiers of Peer Review
  • 2. STSM 2 March to 20 May 2015
  • 3. Background  Computer science publishes more research as conference proceedings than as journal articles  More reviewers, faster publication  They constitute 20-70% of references in journals  Journals in CS (n=400) IF - 0,77 to 1,47
  • 4. Proceedings n=10 310  LNCS – Lecture Notes in Computer Science (8948 ) 1995- 1000 volumes (40-50) 2002 – 2500 volumes (100) >2010 – 2014 600 per year
  • 5.  LNICST - Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (141)  IFIP-AICT - Advances in Information and Communication Technology (525)  LNBIP - Lecture Notes in Business Information Processing (201)  CCIS - Communications in Computer and Information Science (495)
  • 6. LECTURE NOTES IN COMPUTER SCIENCE  1973, from 1981. in Web of Science  Scopus – 250 000 articles, WoS >100 k  Md conference iteration is 7 (1-50) ~ 1500 conferences 0 0.2 0.4 0.6 0.8 1 1.2 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 SNIP- Source normalized impact per paper SNIP
  • 7. Linked Open Data  a method of publishing information in a structured format which enables data to be read automatically by computers  easy retrieval, analysis and linkage with other data
  • 8. Springer LOD City country conf "Beijing" "China" 110 "Paris" “France" 105 “Vienna" "Austria" 97 "Barcelona" "Spain" 79 "Berlin" "Germany" 76 "Rome" "Italy" 68 "Prague" "Czech Rep." 68 "Amsterdam" “Netherlands" 63 "Budapest" "Hungary" 61 "London" "UK" 59 "Tokyo" "Japan" 58
  • 9. Aim:  To add peer review data about conferences to Springer’s linked open database (no. of accepted/submitted papers, blinding, info on external reviewers, criteria, plagiarism check)
  • 10. Proceedings of IFIPTM 2008: Joint iTrust and PST Conferences on Privacy, Trust Management and Security, June 18-20, 2008, Trondheim, Norway
  • 11. Read >10 000 prefaces?  Jdownloader - download all front matters  UniPDf –convert .pdf to .txt  Perl scripts – regex matching
  • 12. Regular expression matching  “search” and extract Perl programm - Perl Compatible Regular Expressions - PHP, Ruby, Java  [hc]+at matches "hat", "cat", "hhat", "chat", "hcat", "cchchat", and so on, but not "at"  [hc]?at matches "hat", "cat", and "at"  [hc]*at matches "hat", "cat", "hhat", "chat", "cchchat"  cat|dog matches "cat" or "dog"
  • 13. Regular expression matching  foreach my $sentence (@$sentences){ if ($sentence =~m/(bd{1,3}%?b).+ (peer- ?|review(ed)?|abstracts?|submission|regular|invited|s ubmitted|accepted|select(ed)?|papers?|acceptance|de mo|several|manuscripts?|articles?|talks? |keynote paper|acceptance rate|(review(ed)?)|Easy?Chair|CyberChair{PRO}?/ gip) {
  • 14. Example The program committee accepted for presentation 64 regular papers, 21 posters, and 10 student papers. All papers underwent a thorough review process, with each paper receiving between 3 and 5 reviews as well as a meta-review that summed up the online discussion of the paper. Papers were accepted, based on blind peer-review. Submissions registered in the chosen system EasyChair.
  • 15. Pilot – 1770 books  5th March downloaded  for 251 conversion to .txt failed (Adobe - OCR)  Each 4 series were handled one by one and regex matching compared to full reading of 34 proceedings from one series (total 146)  For 136 volumes the (modified) script found no matching sentences that contained the combination of keywords and numbers. –these were also read
  • 16. Problem - Type of papers - 30+ full papers medium papers short papers posters tools demos extended abstracts abstracts application papers brief announcements case studies distinguished papers doctoral consortium experience experimental exploratory idea in progress industrial invited position practices rough diamonds system descriptions theory tutorials vision papers workshop papers technical communications
  • 17. Problem - inconsistency  Preface/ Welcome Address/Foreword/ General Chair’s  Organization/Organisation  Peerreview /peer-review/peer - review/peer review  Numbers written as words (twenty(-)one - 20-1) 201  mimimum  external/outside reviewers  The process was triple blind: reviewers did not know the authors’ names, authors did not know the reviewers’ names, and reviewers did not know the other reviewers’ names.
  • 18. Adapt  $text =~ s/^.*?Prefaceb//s; # remove all till preface, sometimes preface was report on  $text =~ s/^.*?Welcome Addressb//s;  $text =~ s/^.*?General Chair.?s Messageb//s;  $text =~ s/^.*?Forewordb//s;  $text =~ s/bTable of Contentsb.*//g; # remove table of contents  $text =~ s/bOrganizationb.*//g;  $text =~ s/bOrganisationb.*//g;
  • 19. Limitations  Preface as header  Table of contents – mentioned in the preface  Several conferences published within the same book  Several books handling the same conference
  • 20. Lack of Accuracy  we had a tremendous amount / many submission  aapproximately 237 submission  more than 300 submissions  almost 90 submissions  at least/minimum 3 reviewers  Each paper was reviewed by 3 or 4 referees
  • 21. Did read >50 000 sentences  After the first round of evaluation, 90 papers were selected. In the second round, 30 papers were accepted.  Received a record number of 152 submissions, materializing in 136 submissions  Of 238 full paper and 130 short submitted we accepted 54, and 48 of which 8 came from full paper submissions
  • 22. Missing information  acceptance rates – 53%  blinding – 7% (126 single blind vs 201 double blind)  external reviewers – 30%  online submission system – 17% - 25 different EasyChair ConfDriver ConfTool OpenConf CyberChair START WIMPE Springer OCS Confious Paperdyne Conf Master PaperPlaza Microsoft’s CMT Colibri SIGACT ConfManMETAFrame WebReview iChair CAWS MuCoMS IACR Electronic Submission Server EDAS OCMS CoMSTM
  • 23. Series Acc. rate 95 % CI Range LNICST 39% 36–48 17–78 IFIP AICT 42% 35–48 7–76 LNBIP 33% 32–37 6–70 CCIS 29% 27–32 18–79 LNCS 37% 34–40 9-84
  • 24. Peer Review  29 adjectives used to describe it: careful competent comprehensive constructive detailed diligent excellent extensive fair in- depth insightful intensive invaluable objective on-time outstanding professional qualified quality rigorous selective strenuous strict stringent strong substantial thorough thoughtful timely tough  Very few mentioned criteria (most commonly quality and originality)  number of reviewers (Md=3, 95%CI 3-3, range 2-11 )
  • 25. Peer Review cont.  We used a ranking list as resulted from the weighted average scores of all papers in a scale from 1 (lowest possible) to 6 (highest possible) as computed by taking into account the reviewer’s confidence as a weighting factor  In order to come up with a final decision, the meta- reviewers used a ranking list according to the weighted average scores of all papers on a scale from -3 (lowest possible) to +3 (highest possible), the reviewer’s confidence being used as the weighting factor.
  • 26.  Papers with a weighted average score of 3.7 or above but less than 4.0 were accepted as short papers.  Authors of 90 papers (out of a total of 181 papers) rated each review they received.  The average level of submissions was high, with 38 papers scoring above the average, and we were sorry to have to reject some of them.
  • 27.  If you make a submission to the workshop it will be read by everyone on the Programme Committee, but each reader is asked only to return a single score (Win, Draw, or Lose) rather than a detailed review. This means that a controversial paper (gaining equal numbers of 3 and 0 scores) will outrank a solid but boring 1 (which would get just 1 point from each reviewer).
  • 28. Plagiarism  1 of the submitted papers was also submitted to TOOLS Europe 2011 and was rejected by both conferences without reviews.  For quality control, we conducted a cross-check on the submitted papers for any possible duplicated submissions to 4 other related concurrent international conferences.
  • 29. Fields for future volumes  Number of submissions that were sent for peer review___  Number of accepted: a) full papers_____ b) short papers_____ c)other_______  Online submission system employed(e.g. EasyChair)  Type of peer review used: a) single blind b) double blind c)open peer review d)other  Average number of reviews per submission?_______  Use of external reviewers ?_________
  • 30. What’s Next for the STSM  Finalize the data  Put all the data in LOD  Publish a PEERE paper in Scientometrics
  • 31. Increasing the transparency of science  Compare conferences and follow their progress  Compare acc rates with citations and altmetrics  Prestige of conferences  Enable the organizers to fill in the missing data / consider mining the conference websites  Encourage journals/other fields to publish same data/ year
  • 32. Acknowledgments  Yannick Versley - for suggesting the first script: [0-9]+ (regular|invited|submitted|accepted) (submissions|papers)  Markus Kaindl – for LOD and Series extraction  Volha Bryl – for LOD and paper suggestions  Mislav Papparella – for suggesting Jdownloader  Frank Holzwarth – for help with .pdf conversion