SlideShare a Scribd company logo
Systematic Literature Studies:
Database Searches vs.
Backward Snowballing
DB-Searches vs. Snowballing

Outline
•
•
•
•
•

Context
Research Questions
Results
Conclusions
References

2
Context
DB-Searches vs. Snowballing

• Kitchenham and Charters [1]
 recommend starting with systematic searches in
databases using well-defined search strings to find
relevant literature.
• It is also recommended that snowballing from reference
lists of the identified articles should be used in addition.

• Webster and Watson [2]
 propose to use snowballing as the main method to
find relevant literature.
• backward snowballing (from the reference lists)
• forward snowballing (finding citations to the papers)

3
DB-Searches vs. Snowballing

Research Questions
• RQ1. To what extent do we find the same
research papers using two different review
approaches?

• RQ2. To what extent do we come to the same
conclusions using two different review
approaches?

4
Results
DB-Searches vs. Snowballing

• RQ1. same papers?
The (initial and final) set
of papers are different
both in the number and
the actual papers.
Although 27 papers
were common. More of
the 50% in each study.

5
Results
DB-Searches vs. Snowballing

• RQ2. same conclusions?

Regardless of the differences in the actual numbers
and figures, similar pattern were identified in both
studies and hence similar conclusions were drawn.
• However, when excluding the same papers from
both studies and analyzing only the remaining
unique papers of each study the identified patterns
seem to be slightly different

6
DB-Searches vs. Snowballing

Conclusions
• There is not a high dependency on whether
using database searches or snowballing.
• It is also quite obvious that the overlap will
become larger if combining the two search
strategies
 although the downside being that it generates
more work.

• More such comparison studies are required to
be able to compare the methods fairly.
7
References
DB-Searches vs. Snowballing

[1]

B. Kitchenham, S. Charters (2007): Guidelines for Performing
Systematic Literature Reviews in Software Engineering. Version 2.3,
Technical Report, Software Engineering Group, Keele University and
Department of Computer Science, University of Durham.

[2]

J. Webster, R. T. Watson (2002.): Analyzing the Past to Prepare for
the Future: Writing a Literature Review. MIS Quarterly 26(2): xiii-xxiii.

8
Comments and Questions

More Related Content

What's hot

Ch03 research plan
Ch03 research planCh03 research plan
Ch03 research plan
Cristina Merilles
 
Systematic literature review: An introduction
Systematic literature review: An introductionSystematic literature review: An introduction
Systematic literature review: An introduction
Khalid Mahmood
 
How to write the methodology chapter of a dissertation or thesis
How to write the methodology chapter of a dissertation or thesisHow to write the methodology chapter of a dissertation or thesis
How to write the methodology chapter of a dissertation or thesis
Ruwin Dias
 
How to structure your table for systematic review and meta analysis – Pubrica
How to structure your table for systematic review and meta analysis – PubricaHow to structure your table for systematic review and meta analysis – Pubrica
How to structure your table for systematic review and meta analysis – Pubrica
Pubrica
 
Systematic review
Systematic reviewSystematic review
Systematic review
Aboubakr Elnashar
 
Quantitativeandqualitativeresearch 100120032723-phpapp01
Quantitativeandqualitativeresearch 100120032723-phpapp01Quantitativeandqualitativeresearch 100120032723-phpapp01
Quantitativeandqualitativeresearch 100120032723-phpapp01
Vikrant Singh
 
Introduction to Data Management in Human Ecology
Introduction to Data Management in Human EcologyIntroduction to Data Management in Human Ecology
Introduction to Data Management in Human Ecology
Kern Rocke
 
Data collection
Data collectionData collection
Data collection
Asif nawaz khan (AUST)
 
Steps for Preparing Research Methodology - Phdassistance
Steps for Preparing Research Methodology - PhdassistanceSteps for Preparing Research Methodology - Phdassistance
Steps for Preparing Research Methodology - Phdassistance
PhD Assistance
 
Developing effective research proposal
Developing effective research proposalDeveloping effective research proposal
Developing effective research proposal
Khalid Mahmood
 
Research PLANNING IN EDUCATIONL RESEARCH
Research PLANNING IN EDUCATIONL RESEARCHResearch PLANNING IN EDUCATIONL RESEARCH
Research PLANNING IN EDUCATIONL RESEARCH
asmamaqsood4
 
Classification of Researcher's Collaboration Patterns Towards Research Perfor...
Classification of Researcher's Collaboration Patterns Towards Research Perfor...Classification of Researcher's Collaboration Patterns Towards Research Perfor...
Classification of Researcher's Collaboration Patterns Towards Research Perfor...
Nur Hazimah Khalid
 
Doing a systematic review: top tips for progressing your review
Doing a systematic review: top tips for progressing your reviewDoing a systematic review: top tips for progressing your review
Doing a systematic review: top tips for progressing your review
University of Liverpool Library
 
Research steps
Research stepsResearch steps
Research steps
Donald Navarro Kreitz
 
Lecture 2: Research Proposal Development
Lecture 2: Research Proposal DevelopmentLecture 2: Research Proposal Development
Lecture 2: Research Proposal Development
ESD UNU-IAS
 
Problems Encountered By Researcher in Bangladesh.pptx
Problems Encountered By Researcher in Bangladesh.pptxProblems Encountered By Researcher in Bangladesh.pptx
Problems Encountered By Researcher in Bangladesh.pptx
Md Fahimuzzaman
 
Research method ch04 research topic and design
Research method ch04 research topic and designResearch method ch04 research topic and design
Research method ch04 research topic and design
naranbatn
 
Systematic Review
Systematic ReviewSystematic Review
Systematic Review
2015UPM
 
Literature search for systematic literature review
Literature search for systematic literature reviewLiterature search for systematic literature review
Literature search for systematic literature review
Khalid Mahmood
 
Research methodology
Research methodologyResearch methodology
Research methodology
Priya Nigan
 

What's hot (20)

Ch03 research plan
Ch03 research planCh03 research plan
Ch03 research plan
 
Systematic literature review: An introduction
Systematic literature review: An introductionSystematic literature review: An introduction
Systematic literature review: An introduction
 
How to write the methodology chapter of a dissertation or thesis
How to write the methodology chapter of a dissertation or thesisHow to write the methodology chapter of a dissertation or thesis
How to write the methodology chapter of a dissertation or thesis
 
How to structure your table for systematic review and meta analysis – Pubrica
How to structure your table for systematic review and meta analysis – PubricaHow to structure your table for systematic review and meta analysis – Pubrica
How to structure your table for systematic review and meta analysis – Pubrica
 
Systematic review
Systematic reviewSystematic review
Systematic review
 
Quantitativeandqualitativeresearch 100120032723-phpapp01
Quantitativeandqualitativeresearch 100120032723-phpapp01Quantitativeandqualitativeresearch 100120032723-phpapp01
Quantitativeandqualitativeresearch 100120032723-phpapp01
 
Introduction to Data Management in Human Ecology
Introduction to Data Management in Human EcologyIntroduction to Data Management in Human Ecology
Introduction to Data Management in Human Ecology
 
Data collection
Data collectionData collection
Data collection
 
Steps for Preparing Research Methodology - Phdassistance
Steps for Preparing Research Methodology - PhdassistanceSteps for Preparing Research Methodology - Phdassistance
Steps for Preparing Research Methodology - Phdassistance
 
Developing effective research proposal
Developing effective research proposalDeveloping effective research proposal
Developing effective research proposal
 
Research PLANNING IN EDUCATIONL RESEARCH
Research PLANNING IN EDUCATIONL RESEARCHResearch PLANNING IN EDUCATIONL RESEARCH
Research PLANNING IN EDUCATIONL RESEARCH
 
Classification of Researcher's Collaboration Patterns Towards Research Perfor...
Classification of Researcher's Collaboration Patterns Towards Research Perfor...Classification of Researcher's Collaboration Patterns Towards Research Perfor...
Classification of Researcher's Collaboration Patterns Towards Research Perfor...
 
Doing a systematic review: top tips for progressing your review
Doing a systematic review: top tips for progressing your reviewDoing a systematic review: top tips for progressing your review
Doing a systematic review: top tips for progressing your review
 
Research steps
Research stepsResearch steps
Research steps
 
Lecture 2: Research Proposal Development
Lecture 2: Research Proposal DevelopmentLecture 2: Research Proposal Development
Lecture 2: Research Proposal Development
 
Problems Encountered By Researcher in Bangladesh.pptx
Problems Encountered By Researcher in Bangladesh.pptxProblems Encountered By Researcher in Bangladesh.pptx
Problems Encountered By Researcher in Bangladesh.pptx
 
Research method ch04 research topic and design
Research method ch04 research topic and designResearch method ch04 research topic and design
Research method ch04 research topic and design
 
Systematic Review
Systematic ReviewSystematic Review
Systematic Review
 
Literature search for systematic literature review
Literature search for systematic literature reviewLiterature search for systematic literature review
Literature search for systematic literature review
 
Research methodology
Research methodologyResearch methodology
Research methodology
 

Similar to DB searches vs. snowballing

Authorship
AuthorshipAuthorship
Authorship
MuhammadAsim423970
 
Rec4LRW – Scientific Paper Recommender System for Literature Review and Writing
Rec4LRW – Scientific Paper Recommender System for Literature Review and WritingRec4LRW – Scientific Paper Recommender System for Literature Review and Writing
Rec4LRW – Scientific Paper Recommender System for Literature Review and Writing
Aravind Sesagiri Raamkumar
 
A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...
A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...
A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...
Melinda Watson
 
Cocitation Networks and Random Walk
Cocitation Networks and Random WalkCocitation Networks and Random Walk
Cocitation Networks and Random Walk
URFIST de Paris
 
Analyzing Relationship Between Title Length Of Research Papers And Number Of ...
Analyzing Relationship Between Title Length Of Research Papers And Number Of ...Analyzing Relationship Between Title Length Of Research Papers And Number Of ...
Analyzing Relationship Between Title Length Of Research Papers And Number Of ...
Daphne Smith
 
A Semantically Enriched Recommendation & Visualization Approach for Academic ...
A Semantically Enriched Recommendation & Visualization Approach for Academic ...A Semantically Enriched Recommendation & Visualization Approach for Academic ...
A Semantically Enriched Recommendation & Visualization Approach for Academic ...
Scientific Information Analytics Group, Prof. Gipp
 
Improved author profiling through the use of citation classes
Improved author profiling through the use of citation classesImproved author profiling through the use of citation classes
Improved author profiling through the use of citation classes
bartthijs
 
NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...
NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...
NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...
National Information Standards Organization (NISO)
 
Dynamic extraction of key paper from the cluster using variance values of cit...
Dynamic extraction of key paper from the cluster using variance values of cit...Dynamic extraction of key paper from the cluster using variance values of cit...
Dynamic extraction of key paper from the cluster using variance values of cit...
IJDKP
 
MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...
MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...
MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...
The Statistical and Applied Mathematical Sciences Institute
 
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
Ludo Waltman
 
Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...
Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...
Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...
NASIG
 
A Citation-Based Recommender System For Scholarly Paper Recommendation
A Citation-Based Recommender System For Scholarly Paper RecommendationA Citation-Based Recommender System For Scholarly Paper Recommendation
A Citation-Based Recommender System For Scholarly Paper Recommendation
Daniel Wachtel
 
Part 1 Research workshop
Part 1 Research workshopPart 1 Research workshop
Part 1 Research workshop
Researchworkshop
 
82611944
8261194482611944
82611944
MelindaCahyani2
 
Cardiff bibliometrics repository ref_july 2014
Cardiff bibliometrics repository  ref_july 2014Cardiff bibliometrics repository  ref_july 2014
Cardiff bibliometrics repository ref_july 2014
rachaelwhitfield
 
Degreeproject
DegreeprojectDegreeproject
Degreeproject
Christian Sahlstr
 
A Comparative Study Of Citations And Links In Document Classification
A Comparative Study Of Citations And Links In Document ClassificationA Comparative Study Of Citations And Links In Document Classification
A Comparative Study Of Citations And Links In Document Classification
Whitney Anderson
 
Mixed methods designs
Mixed methods designs Mixed methods designs
Mixed methods designs
faisal khallab
 
Literature Review SNS
Literature Review SNSLiterature Review SNS
Literature Review SNS
Dr. S.N. Sridhara
 

Similar to DB searches vs. snowballing (20)

Authorship
AuthorshipAuthorship
Authorship
 
Rec4LRW – Scientific Paper Recommender System for Literature Review and Writing
Rec4LRW – Scientific Paper Recommender System for Literature Review and WritingRec4LRW – Scientific Paper Recommender System for Literature Review and Writing
Rec4LRW – Scientific Paper Recommender System for Literature Review and Writing
 
A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...
A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...
A Collaborative Approach Toward Scientific Paper Recommendation Using Citatio...
 
Cocitation Networks and Random Walk
Cocitation Networks and Random WalkCocitation Networks and Random Walk
Cocitation Networks and Random Walk
 
Analyzing Relationship Between Title Length Of Research Papers And Number Of ...
Analyzing Relationship Between Title Length Of Research Papers And Number Of ...Analyzing Relationship Between Title Length Of Research Papers And Number Of ...
Analyzing Relationship Between Title Length Of Research Papers And Number Of ...
 
A Semantically Enriched Recommendation & Visualization Approach for Academic ...
A Semantically Enriched Recommendation & Visualization Approach for Academic ...A Semantically Enriched Recommendation & Visualization Approach for Academic ...
A Semantically Enriched Recommendation & Visualization Approach for Academic ...
 
Improved author profiling through the use of citation classes
Improved author profiling through the use of citation classesImproved author profiling through the use of citation classes
Improved author profiling through the use of citation classes
 
NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...
NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...
NISO Apr 29 Virtual Conference: Dismantling a Single-Discipline Journal Bundl...
 
Dynamic extraction of key paper from the cluster using variance values of cit...
Dynamic extraction of key paper from the cluster using variance values of cit...Dynamic extraction of key paper from the cluster using variance values of cit...
Dynamic extraction of key paper from the cluster using variance values of cit...
 
MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...
MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...
MUMS: Transition & SPUQ Workshop - Uncertainty Quantification in Materials Wo...
 
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
 
Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...
Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...
Capturing and Analyzing Publication, Citation and Usage Data for Contextual C...
 
A Citation-Based Recommender System For Scholarly Paper Recommendation
A Citation-Based Recommender System For Scholarly Paper RecommendationA Citation-Based Recommender System For Scholarly Paper Recommendation
A Citation-Based Recommender System For Scholarly Paper Recommendation
 
Part 1 Research workshop
Part 1 Research workshopPart 1 Research workshop
Part 1 Research workshop
 
82611944
8261194482611944
82611944
 
Cardiff bibliometrics repository ref_july 2014
Cardiff bibliometrics repository  ref_july 2014Cardiff bibliometrics repository  ref_july 2014
Cardiff bibliometrics repository ref_july 2014
 
Degreeproject
DegreeprojectDegreeproject
Degreeproject
 
A Comparative Study Of Citations And Links In Document Classification
A Comparative Study Of Citations And Links In Document ClassificationA Comparative Study Of Citations And Links In Document Classification
A Comparative Study Of Citations And Links In Document Classification
 
Mixed methods designs
Mixed methods designs Mixed methods designs
Mixed methods designs
 
Literature Review SNS
Literature Review SNSLiterature Review SNS
Literature Review SNS
 

More from GESSI UPC

iStarJSON: A Lightweight Data-Format for i* Models
iStarJSON: A Lightweight Data-Format for i* ModelsiStarJSON: A Lightweight Data-Format for i* Models
iStarJSON: A Lightweight Data-Format for i* Models
GESSI UPC
 
Towards iStarML 2.0: Closing Gaps from Evolved Requirements
Towards iStarML 2.0: Closing Gaps from Evolved RequirementsTowards iStarML 2.0: Closing Gaps from Evolved Requirements
Towards iStarML 2.0: Closing Gaps from Evolved Requirements
GESSI UPC
 
Monitoring the service-based system lifecycle with SALMon
Monitoring the service-based system lifecycle with SALMonMonitoring the service-based system lifecycle with SALMon
Monitoring the service-based system lifecycle with SALMon
GESSI UPC
 
Ossap final
Ossap finalOssap final
Ossap final
GESSI UPC
 
Aligning Business Goals and Risks in OSS Adoption
Aligning Business Goals and Risks in OSS AdoptionAligning Business Goals and Risks in OSS Adoption
Aligning Business Goals and Risks in OSS Adoption
GESSI UPC
 
Jcis 2015-Towards Assessing Open Source Communities' Health using SOC Concepts
Jcis 2015-Towards Assessing Open Source Communities' Health using SOC ConceptsJcis 2015-Towards Assessing Open Source Communities' Health using SOC Concepts
Jcis 2015-Towards Assessing Open Source Communities' Health using SOC Concepts
GESSI UPC
 
RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)
RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)
RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)
GESSI UPC
 
Open expo2015 riscoss
Open expo2015 riscossOpen expo2015 riscoss
Open expo2015 riscoss
GESSI UPC
 
Oss2015
Oss2015Oss2015
Oss2015
GESSI UPC
 
Mobility4 all
Mobility4 allMobility4 all
Mobility4 all
GESSI UPC
 
Er14
Er14Er14
Er14
GESSI UPC
 
QuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software EcosystemsQuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software Ecosystems
GESSI UPC
 
Expert mining compsac-2014
Expert mining compsac-2014Expert mining compsac-2014
Expert mining compsac-2014
GESSI UPC
 
MoDRE 2014 @ RE keynote -- NFR-Aware MDD Processes
MoDRE 2014 @ RE keynote -- NFR-Aware MDD ProcessesMoDRE 2014 @ RE keynote -- NFR-Aware MDD Processes
MoDRE 2014 @ RE keynote -- NFR-Aware MDD Processes
GESSI UPC
 
Quantifying the Impact of OSS Adoption Risks with the help of i* Models
Quantifying the Impact of OSS Adoption Risks with the help of i* ModelsQuantifying the Impact of OSS Adoption Risks with the help of i* Models
Quantifying the Impact of OSS Adoption Risks with the help of i* Models
GESSI UPC
 
Applying Business Strategy Models in Organizations
Applying Business Strategy Models in OrganizationsApplying Business Strategy Models in Organizations
Applying Business Strategy Models in Organizations
GESSI UPC
 
Slides refsq'14 ds v1
Slides refsq'14 ds v1Slides refsq'14 ds v1
Slides refsq'14 ds v1
GESSI UPC
 
A Context Ontology for Service Provisioning and Consumption
A Context Ontology for Service Provisioning and ConsumptionA Context Ontology for Service Provisioning and Consumption
A Context Ontology for Service Provisioning and Consumption
GESSI UPC
 
Practical Experiences in Designing and Conducting Empirical Studies in Indust...
Practical Experiences in Designing and Conducting Empirical Studies in Indust...Practical Experiences in Designing and Conducting Empirical Studies in Indust...
Practical Experiences in Designing and Conducting Empirical Studies in Indust...
GESSI UPC
 
Cesi2014
Cesi2014Cesi2014
Cesi2014
GESSI UPC
 

More from GESSI UPC (20)

iStarJSON: A Lightweight Data-Format for i* Models
iStarJSON: A Lightweight Data-Format for i* ModelsiStarJSON: A Lightweight Data-Format for i* Models
iStarJSON: A Lightweight Data-Format for i* Models
 
Towards iStarML 2.0: Closing Gaps from Evolved Requirements
Towards iStarML 2.0: Closing Gaps from Evolved RequirementsTowards iStarML 2.0: Closing Gaps from Evolved Requirements
Towards iStarML 2.0: Closing Gaps from Evolved Requirements
 
Monitoring the service-based system lifecycle with SALMon
Monitoring the service-based system lifecycle with SALMonMonitoring the service-based system lifecycle with SALMon
Monitoring the service-based system lifecycle with SALMon
 
Ossap final
Ossap finalOssap final
Ossap final
 
Aligning Business Goals and Risks in OSS Adoption
Aligning Business Goals and Risks in OSS AdoptionAligning Business Goals and Risks in OSS Adoption
Aligning Business Goals and Risks in OSS Adoption
 
Jcis 2015-Towards Assessing Open Source Communities' Health using SOC Concepts
Jcis 2015-Towards Assessing Open Source Communities' Health using SOC ConceptsJcis 2015-Towards Assessing Open Source Communities' Health using SOC Concepts
Jcis 2015-Towards Assessing Open Source Communities' Health using SOC Concepts
 
RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)
RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)
RISCOSS: Gestión del riesgo en proyectos open source (Open Expo Day2015)
 
Open expo2015 riscoss
Open expo2015 riscossOpen expo2015 riscoss
Open expo2015 riscoss
 
Oss2015
Oss2015Oss2015
Oss2015
 
Mobility4 all
Mobility4 allMobility4 all
Mobility4 all
 
Er14
Er14Er14
Er14
 
QuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software EcosystemsQuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software Ecosystems
 
Expert mining compsac-2014
Expert mining compsac-2014Expert mining compsac-2014
Expert mining compsac-2014
 
MoDRE 2014 @ RE keynote -- NFR-Aware MDD Processes
MoDRE 2014 @ RE keynote -- NFR-Aware MDD ProcessesMoDRE 2014 @ RE keynote -- NFR-Aware MDD Processes
MoDRE 2014 @ RE keynote -- NFR-Aware MDD Processes
 
Quantifying the Impact of OSS Adoption Risks with the help of i* Models
Quantifying the Impact of OSS Adoption Risks with the help of i* ModelsQuantifying the Impact of OSS Adoption Risks with the help of i* Models
Quantifying the Impact of OSS Adoption Risks with the help of i* Models
 
Applying Business Strategy Models in Organizations
Applying Business Strategy Models in OrganizationsApplying Business Strategy Models in Organizations
Applying Business Strategy Models in Organizations
 
Slides refsq'14 ds v1
Slides refsq'14 ds v1Slides refsq'14 ds v1
Slides refsq'14 ds v1
 
A Context Ontology for Service Provisioning and Consumption
A Context Ontology for Service Provisioning and ConsumptionA Context Ontology for Service Provisioning and Consumption
A Context Ontology for Service Provisioning and Consumption
 
Practical Experiences in Designing and Conducting Empirical Studies in Indust...
Practical Experiences in Designing and Conducting Empirical Studies in Indust...Practical Experiences in Designing and Conducting Empirical Studies in Indust...
Practical Experiences in Designing and Conducting Empirical Studies in Indust...
 
Cesi2014
Cesi2014Cesi2014
Cesi2014
 

Recently uploaded

MARY JANE WILSON, A “BOA MÃE” .
MARY JANE WILSON, A “BOA MÃE”           .MARY JANE WILSON, A “BOA MÃE”           .
MARY JANE WILSON, A “BOA MÃE” .
Colégio Santa Teresinha
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
Celine George
 
Digital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments UnitDigital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments Unit
chanes7
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
Celine George
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
PIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf IslamabadPIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf Islamabad
AyyanKhan40
 
How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17
Celine George
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat  Leveraging AI for Diversity, Equity, and InclusionExecutive Directors Chat  Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
TechSoup
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
Priyankaranawat4
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
paigestewart1632
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
sayalidalavi006
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
RAHUL
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Akanksha trivedi rama nursing college kanpur.
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
heathfieldcps1
 
DRUGS AND ITS classification slide share
DRUGS AND ITS classification slide shareDRUGS AND ITS classification slide share
DRUGS AND ITS classification slide share
taiba qazi
 

Recently uploaded (20)

MARY JANE WILSON, A “BOA MÃE” .
MARY JANE WILSON, A “BOA MÃE”           .MARY JANE WILSON, A “BOA MÃE”           .
MARY JANE WILSON, A “BOA MÃE” .
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
 
Digital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments UnitDigital Artifact 1 - 10VCD Environments Unit
Digital Artifact 1 - 10VCD Environments Unit
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
PIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf IslamabadPIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf Islamabad
 
How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat  Leveraging AI for Diversity, Equity, and InclusionExecutive Directors Chat  Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UPLAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
LAND USE LAND COVER AND NDVI OF MIRZAPUR DISTRICT, UP
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
 
DRUGS AND ITS classification slide share
DRUGS AND ITS classification slide shareDRUGS AND ITS classification slide share
DRUGS AND ITS classification slide share
 

DB searches vs. snowballing

  • 1. Systematic Literature Studies: Database Searches vs. Backward Snowballing
  • 3. Context DB-Searches vs. Snowballing • Kitchenham and Charters [1]  recommend starting with systematic searches in databases using well-defined search strings to find relevant literature. • It is also recommended that snowballing from reference lists of the identified articles should be used in addition. • Webster and Watson [2]  propose to use snowballing as the main method to find relevant literature. • backward snowballing (from the reference lists) • forward snowballing (finding citations to the papers) 3
  • 4. DB-Searches vs. Snowballing Research Questions • RQ1. To what extent do we find the same research papers using two different review approaches? • RQ2. To what extent do we come to the same conclusions using two different review approaches? 4
  • 5. Results DB-Searches vs. Snowballing • RQ1. same papers? The (initial and final) set of papers are different both in the number and the actual papers. Although 27 papers were common. More of the 50% in each study. 5
  • 6. Results DB-Searches vs. Snowballing • RQ2. same conclusions? Regardless of the differences in the actual numbers and figures, similar pattern were identified in both studies and hence similar conclusions were drawn. • However, when excluding the same papers from both studies and analyzing only the remaining unique papers of each study the identified patterns seem to be slightly different 6
  • 7. DB-Searches vs. Snowballing Conclusions • There is not a high dependency on whether using database searches or snowballing. • It is also quite obvious that the overlap will become larger if combining the two search strategies  although the downside being that it generates more work. • More such comparison studies are required to be able to compare the methods fairly. 7
  • 8. References DB-Searches vs. Snowballing [1] B. Kitchenham, S. Charters (2007): Guidelines for Performing Systematic Literature Reviews in Software Engineering. Version 2.3, Technical Report, Software Engineering Group, Keele University and Department of Computer Science, University of Durham. [2] J. Webster, R. T. Watson (2002.): Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly 26(2): xiii-xxiii. 8