Download to read offline
Uploaded byElaine Lasda
Your Systematic Review: Getting Started
The document outlines the systematic review process, emphasizing the importance of protocol development, searching strategies, and reporting guidelines to ensure transparent and unbiased research. It discusses various forms of evidence synthesis, the need to define inclusion and exclusion criteria, and ways to refine research questions using frameworks like PICO and SPIDER. Additionally, it provides tips on searching for both traditional and grey literature, managing citations, and ensuring reproducibility throughout the research process.
More Related Content
Similar to Your Systematic Review: Getting Started
More from Elaine Lasda
Your Systematic Review: Getting Started
- 1. Your Systematic Review: GettingStarted Elaine Lasda Coordinator for Scholarly Communication & Subject Librarian for Social Welfare, Gerontology, Research Impact Sue Kaczor Subject Librarian for Public Health, Sciences
- 2. What Is aSystematic Review? • Form of Evidence Synthesis • Eliminates unreliable results • Correct for bias against the null hypothesis • A Team of researchers is needed to reduce bias
- 3. What is aSystematic Review? • Seeks to answer: • Is the intervention effective? • Is there sufficient evidence? • Studies are evaluated quantitatively and qualitatively
- 4. Other Evidence Synthesis Methods •Scoping Review • Evidence Gap Maps/Systematic Maps • Living Systematic Reviews • Rapid Reviews • Umbrella Reviews
- 5. Preparation & Process •Develop a protocol • Search • Appraisal • Synthesis • Writeup
- 6. Today we aretalking about: • Protocol development • Searching strategies • A little bit about Reporting Out/Writeup
- 7. Protocol Registration • Preregisteryour research plan • Gives backup that your methods are unbiased and predetermined before searching • Transparency • Can be embargoed • Some offer peer review of protocols as well as manuscript (Not OSF).
- 8. Where to Registeryour Protocol • PROSPERO • Campbell • Cochrane • Center for Open Science Registry
- 9. Protocol Development: Keepin Mind • Exploratory vs. confirmatory searching • Avoid HARK (hypothesizing after the results are known) • Replicability vs. Reproducibility • Transparency
- 10. Reporting Guidelines • DocumentEVERYTHING as you go • Select Guideline at the BEGINNING of the process • Keep track of details!
- 11. Reporting Guideline Examples •PRISMA – health sciences and others • ROSES – environmental sciences • MARS – APA Meta-analysis Reporting Standards • MECCIR – Methodological Expectations of Campbell Collaboration Intervention Reviews • Many modified and adapted versions as well….
- 12. PRISMA Flow Diagram •https://livealbany- my.sharepoint.com/personal/elasda_albany_edu/Documen ts/Systematic%20Review%20Resources/PRISMA_2020_flo w_diagram_new_SRs_v1.docx - • http://www.prisma- statement.org/PRISMAStatement/FlowDiagram (downloadable)
- 13. Tracking Spreadsheet • C:UserselainOneDrive- University at Albany - SUNYSystematic Review ResourcesTEMPLATE_Systematic_Review_FULL.xlsx • https://libguides.library.albany.edu/ld.php?content_id=52260138 (downloadable)
- 14. Formulating and RefiningYour Question • How? • Establish the focus of the review • Define inclusion and exclusion criteria • Answerable question • Why? • Define the type of study to be included • Develop your search strategy
- 15. Refining your question • Frameworks •PICO (Population, Intervention, Comparison, Outcome) • Sometimes add Timeframe and Study design • SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type) • SPICE (Setting, Perspective, Intervention, Comparison, Evaluation) • Many others…. can be adaptable
- 16. Inclusion and ExclusionCriteria • Set these AFTER your research question is defined! • Set these BEFORE your finalized searches are conducted! • Do test and scoping searches FIRST to develop research question, inclusion and exclusion criteria • Includes your framework PLUS: • Methods • language • publication years/date range • other factors about the research that need to be considered
- 17.
- 18. Exploratory Searching • Trysome vocabulary! • Disciplinary encyclopedias • Wikipedia • Refine as you learn new terms • Use Google Scholar at this stage to build vocabulary and get a lay of the land* • Choose appropriate Databases! • Working from a “Gold Standard Article” • Save searches as you refine them so you don’t have to reinvent the wheel *Generally, you will not use Scholar in your final protocol
- 19. AVOID • Searches thatcover multiple databases at once • Discovery layers, federated searching, selecting multiple dbs in a given platform • Searches of journal publishing platforms • (Science Direct is not a database! JSTOR - ugh!) • (Mostly) avoid Google Scholar • Certain circumstances it is unavoidable • There are best practices for when to use, ask your librarian
- 20. Searching PROTIPS: • Breakyour search into facets or concept blocks • Not all of your incl/excl criteria need to be in the search • Better to have more false positives than a restrictive search • False positives eliminated in screening process • Consider spelling variants (UK), synonyms, acronyms, etc. • Learn the database’s search syntax (help screens, YouTube, etc.) • truncation • proximity operators • thesaurus/subject headings
- 21. More PROTIPS • Testdatabase search strings by seeing if your “gold standard” article shows up in the results of your crafted search. • Add and remove terms one at a time to see effect on results list • Create the “template” search in your main database • Register this protocol • “Translate” it to other databases used in searching
- 22. Hedges/Filters • Already testedsearches for common elements in reviews • Shared openly • May have different validation levels • May need updated terms • Findable in Campbell, Cochran, Harvard Countway Library, others. • Simple google search of concept, database, and the word “hedge”
- 23. Grey Literature • Unpublishedmanuscripts, government reports, organizational studies, reputable sources but not in peer reviewed journals • Websites: NGOs, Government, Professional Organizations • Repositories (institutional, subject-specific, government document, others) • White Papers, Dissertations, Reports, etc.
- 24. Searching for GreyLiterature :PROTIPS • BASIC searching on most grey literature platforms • Searching is tedious and clunky (usually) • OSF has grey lit resources for searching • Campbell has a guide
- 25.
- 26. What do Ido with my searches? • Use a citation manager (Zotero or Endnote, usually) to manage the publication set (we can give you training on these) • Document counts from each db, counts after removing dupes, etc. • Title/abstract review for inclusion and exclusion criteria • Text review for those that pass • Qualitative evaluation (we can help you find examples) • Quantitative evaluation (we can help you find examples) • Analyze • Write up!
- 27.