Assessing Quality of Individual Studies Interactive Quiz  Prepared for: The Agency for Healthcare Research and Quality (AH...
<ul><li>The results of quality assessment are used at several steps in a systematic review. Some uses are required and som...
<ul><li>The process of quality assessment involves which series of steps? </li></ul><ul><li>Reading the article, arriving ...
<ul><li>In choosing a tool to evaluate quality, what is the most important consideration? </li></ul><ul><li>Familiarity wi...
<ul><li>When reporting quality assessment, what must systematic reviewers describe? </li></ul><ul><li>Criteria only </li><...
<ul><li>Quality assessment involves several steps: </li></ul><ul><ul><li>Identifying the study design </li></ul></ul><ul><...
<ul><li>This presentation was prepared by Meera Viswanathan, Ph.D., a member of the Research Triangle Institute – Universi...
Upcoming SlideShare
Loading in …5
×

Assessing Quality of Individual Studies Quiz

482 views

Published on

Published in: Health & Medicine
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
482
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Assessing Quality of Individual Studies Interactive Quiz
  • Quality Assessment in a Systematic Review Quality assessment is used at several steps in a systematic review. Some uses are required and some are optional. For which steps is quality assessment required? Correct. All reviews must use quality assessment for interpreting results of individual studies and for grading the body of evidence. Based on the topic and a priori assessment of evidence gaps, some reviews may also exclude poor-quality studies from the review or from meta-analyses. Incorrect. All reviews must use quality assessment for interpreting results of individual studies and for grading the body of evidence. Based on the topic and a priori assessment of evidence gaps, some reviews may also exclude poor-quality studies from the review or from meta-analyses. Incorrect. All reviews must use quality assessment for interpreting results of individual studies and for grading the body of evidence. Based on the topic and a priori assessment of evidence gaps, some reviews may also exclude poor-quality studies from the review or from meta-analyses.
  • Steps in Quality Assessment The process of quality assessment involves which series of steps? Incorrect. Although reviewers may have a sense of overall quality before assessing individual sources of bias, transparency of process is critical. Each predefined source of bias should be evaluated and recorded when reviewers arrive at an overall quality rating. Reviewers should identify study design, evaluate general and design-specific sources of bias based on a priori criteria, and use these assessments to arrive at an overall quality rating. Incorrect. Although reviewers may have a sense of overall quality before assessing individual sources of bias, transparency of process is critical. Each predefined source of bias should be evaluated and recorded when arriving at an overall quality rating. Reviewers should identify study design, evaluate general and design-specific sources of bias based on a priori criteria, and use these assessments to arrive at an overall quality rating. Correct. Study design is an important element of quality, but the conduct of the study is equally important. Although reviewers may have a sense of overall quality before assessing individual sources of bias, transparency of process is critical. Each predefined source of bias should be evaluated and recorded when arriving at an overall quality rating.
  • What Are the Best Tools To Evaluate Quality? In choosing a tool to evaluate quality, what is the most important consideration? Incorrect. Although reviewers may prefer tools that they have used in the past, they should first reevaluate those tools to ensure that they cover key sources of bias before they rely on familiar tools. Correct. Although reviewers may prefer tools that are familiar and/or short, they should reevaluate those tools to ensure that they cover key sources of bias. Incorrect. Although reviewers may prefer tools with fewer items, they should reevaluate those tools to ensure that they cover key sources of bias before they rely on shorter tools.
  • What To Describe in Quality Assessment When reporting quality assessment, what must systematic reviewers describe? Incorrect. Although quality criteria should be selected a priori and described fully, this information is not sufficient for the reader to understand how sources of bias may have influenced the overall quality rating. Quality assessment requires transparency at all stages. Correct. Identify criteria for evaluating sources of bias a priori . Report fully on all elements of quality for each individual study. Describe operationalism of every criterion. Report process for conflict resolution between raters. Accompany the overall quality rating (good, fair, or poor) with explanatory text. Incorrect. Quality criteria should be selected a priori and described fully, and the process for generating the overall quality rating should be described, but this information is not sufficient for the reader to understand how sources of bias may have influenced the overall quality rating. Quality assessment requires transparency at all stages.
  • Summary
  • Author This interactive quiz augments the module on assessing the quality of individual studies. This quiz was prepared by Meera Viswanathan, Ph.D., a member of the Research Triangle Institute – University of North Carolina Evidence-based Practice Center and is based on an update of chapter 6 in version 1.0 of the Methods Guide for Comparative Effectiveness Reviews (update available at: http://www.effectivehealthcare.ahrq.gov/ehc/products/60/294/2009_0805_principles1.pdf ).
  • Assessing Quality of Individual Studies Quiz

    1. 1. Assessing Quality of Individual Studies Interactive Quiz Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
    2. 2. <ul><li>The results of quality assessment are used at several steps in a systematic review. Some uses are required and some are optional. For which steps is quality assessment required? </li></ul><ul><li>Interpreting results of individual studies and grading the body of evidence </li></ul><ul><li>Selecting studies for inclusion and meta-analyses </li></ul><ul><li>All steps described for all topics </li></ul>Quality Assessment in a Systematic Review
    3. 3. <ul><li>The process of quality assessment involves which series of steps? </li></ul><ul><li>Reading the article, arriving at an overall quality rating, and then identifying sources of bias to support the quality rating </li></ul><ul><li>Applying a hierarchy of evidence, with randomized clinical trials being rated as highest quality, followed by nonrandomized comparative studies, and then case series </li></ul><ul><li>Identifying the study design, evaluating overall and design-specific sources of bias, and then arriving at a quality rating based on freedom from these biases </li></ul>Steps in Quality Assessment
    4. 4. <ul><li>In choosing a tool to evaluate quality, what is the most important consideration? </li></ul><ul><li>Familiarity with the tool </li></ul><ul><li>The degree to which the tool covers key sources of bias </li></ul><ul><li>The number of items on the tool </li></ul>What Are the Best Tools To Evaluate Quality?
    5. 5. <ul><li>When reporting quality assessment, what must systematic reviewers describe? </li></ul><ul><li>Criteria only </li></ul><ul><li>Criteria, processes, and the generation of overall quality ratings </li></ul><ul><li>Criteria and the generation of overall quality ratings </li></ul>What To Describe in Quality Assessment
    6. 6. <ul><li>Quality assessment involves several steps: </li></ul><ul><ul><li>Identifying the study design </li></ul></ul><ul><ul><li>Evaluating overall and design-specific sources of bias </li></ul></ul><ul><ul><li>Rating quality based on freedom from these biases </li></ul></ul><ul><li>Quality assessment is used in systematic reviews to: </li></ul><ul><ul><li>Interpret results of individual studies </li></ul></ul><ul><ul><li>Grade the body of evidence </li></ul></ul><ul><li>Methods used for quality assessment must be transparent </li></ul>Summary
    7. 7. <ul><li>This presentation was prepared by Meera Viswanathan, Ph.D., a member of the Research Triangle Institute – University of North Carolina Evidence-based Practice Center. </li></ul><ul><li>The presentation is based on an update of chapter 6 in version 1.0 of the Methods Guide for Comparative Effectiveness Reviews (update available at: http://www.effectivehealthcare. ahrq.gov/ehc/products/60/294/2009_0805_principles1.pdf ). </li></ul>Author

    ×