Procedures for Performing Systematic Review. This is general guideline for undertaking systematic reviews.The goal of this document is helpful for preparing systematic paper.

2. ㅣ

3. .
l concept of rigorous reviews
guidelines
l
l
introduction systematic reviews
stages

4. .
identifying evaluating interpreting
Reasons for Performing Systematic Reviews
• summarise existing evidence
• identify
• provide
• scientific value
• predefined search strategy
• completeness
The Importance of Systematic Reviews

5. .
identifying evaluating interpreting
Advantages and disadvantages
• provide information effects
phenomenon
• combine meta-analytic
•

6. .
Planning Conducting Reporting
The stages associated with planning the review are:
• need
• Development
•
• Selection
• assessment
• extraction monitoring
• synthesis
The stages associated with conducting the review are:

7. .
need for a systematic review
CRC [12] suggests the following checklist:
• objectives
• restrictions
• inclusion/exclusion criteria
• assess the quality
• extracted
• synthesised
combined
• conclusions flow evidence

8. .
need for a systematic review
From a more general viewpoint, Greenlaugh [9] suggests the following questions:
•
•
•
•
•

9. .
reduce the possibility researcher bias
most important activity research question.
The Research Question
In software engineering, questions can be adapted to software engineering issues as follows:
< Question Types >
• effect
•
• Identifying cost and risk factors
•
•

10. .
population
interventions
outcomes
< Population >
• role
• type
• application area

11. .
< Intervention >
• software technologies
•
< Outcomes >
• factors
•
population
interventions
outcomes

12. .
surrogate
measures misleading
less robust.
Protocol Review
• critical element
•

13. .
review start
Identification of Research
• find primary studies
•
Generating a search strategy>
• iterative benefit
research question

14. .
review start
Generating a search strategy>
•
population, intervention, outcomes, study designs.
• synonyms, abbreviations, and alternative spellings.
•

15. .
Identification of Research
•
Generating a search strategy>
Initial searches electronic
databases
• Reference lists review articles
• Journals grey
literature conference proceedings
•
•

16. .
positive results
negative results.
Publication Bias
•
•
Documenting the Search
• transparent replicable
•
•

17. .
Documenting the Search
•

18. 5. Conducting the review
• 5.1 Identification of Research
– 5.1.1 Generating a search strategy
Baron-Cohen S, Jolliffe T, Mortimore C,
Robertson M. Another advanced test
of theory of mind: evidence from very
high functioning adults with autism or
asperger syndrome. Journal of Child
Psychology and Psychiatry
1997;38:813–22.
Baron-Cohen S, Ring HA, Wheelwright
S, Bullmore ET, Brammer MJ, Simmons
A, et al. Social intelligence in the
normal and autistic brain: an fMRI
study. European Journal of
Neuroscience 1999;11:1891–8.
• 관련 논문의 Reference를 참조하여 중요 논문들을 찾음

19. 5. Conducting the review
• 5.1 Identification of Research
– 5.1.1 Generating a search strategy
• Journals (including company journals such as the IBM Journal of Research and
Development), grey literature (i.e. technical reports, work in progress) and conference
proceedings.
• Grey literature : 정식 시판되는 거시 아닌 기관에서 만든 보고서, 학술적인 기술보고서 등
 Neuropsychologia
 Journal of Cognitive Neuroscience
 Journal of Child Psychology and Psychiatry
 European Journal of Neuroscience
 Journal of Child Psychology and Psychiatry
• Internet

20. 5. Conducting the review
• 5.1 Identification of Research
– 5.1.3 Documenting the Search
– Wikipedia
List of academic databases and search
engines

21. .
Study selection criteria
•
• research question
•
Japanese or Chinese
papers are often difficult to access
• authors,
institutions, journals or year of publication
•

22. .
Study selection process
•
•
•
•
Reliability of inclusion decisions
•

23. .
Reliability of inclusion decisions
•

24. .
Quality Thresholds
• Study design

25. .
Quality Thresholds
•
•Table 5 disease condition
•

26. .
Using the Quality Instrument
Quality appraisal
synthesis of results
Limitations of Quality Assessment
• possible assume something wasn’t reported,

27. .
Data Extraction
objective of this stage data extraction forms
Contents of Data Collection Forms

28. .
Data Synthesis
Descriptive synthesis
Quantitative Synthesis
Quantitative data
Sample size
effect size
mean values confidence
interval

29. .
Presentation of Quantitative Results
presenting quantitative results forest plot
• means variance

30. .
•
•
size restriction.

31. .
Structure for systematic review

32. .
Peer Review
•
• Experts review
•
•
researchers and practitioners, it is worth organising a peer review.
•

33. .Final remarks
•