Graduated Critical Appraisal  in AT Education John T. Parsons, MS, ATC, AT/L Tamara Valovich McLeod, PhD, ATC, AT/L A.T. S...
Objectives <ul><li>Discuss the need critical analysis of published research studies.  </li></ul><ul><li>Identify and discu...
ASSIGNMENT CONTEXT
Presentation Activities <ul><li>Demonstration and discussion of the evolution of the critical appraisal assignment over ti...
 
 
Best Research Evidence <ul><li>Valid </li></ul><ul><li>Clinically relevant </li></ul><ul><li>Basic / clinical research </l...
Patient-Oriented Evidence <ul><li>Morbidity, mortality </li></ul><ul><li>Symptom improvement </li></ul><ul><li>Cost reduct...
Patient-Oriented Evidence That  Matters (POEM)
(Hurwtiz et al,  JBJS , 2000) Common Problem Uncommon Problem Patient-Oriented Evidence Best Best source of POEMs Relevanc...
Necessary Skills of Future Clinicians <ul><li>Information mastery </li></ul><ul><li>Clinical epidemiology </li></ul><ul><l...
Prescription for EBP  <ul><ul><li>Craft a clinical question </li></ul></ul><ul><ul><li>Search the best evidence </li></ul>...
ASSIGNMENT STRUCTURE
Progressive Assignment Components <ul><li>Identify & construct clinical question </li></ul><ul><li>Article annotation </li...
General Guidelines <ul><li>Article <5 yrs. old </li></ul><ul><li>Relevant to course focus </li></ul><ul><li>Single-spaced,...
Grading Form
AT 5070
Later Assignments
Annotation Clinical Relevance Clinical Question LOE Analysis “ Bottom Line” Patient Education Critical Appraisal AT 5070 A...
Annotation Components <ul><li>Problem / purpose </li></ul><ul><li>Methods </li></ul><ul><li>Results </li></ul><ul><li>Page...
Clinical Question Citation Problem & purpose Methods & results LOE, applicability, & patient education
Annotation Clinical Relevance Clinical Question LOE Analysis “ Bottom Line” Patient Education Critical Appraisal AT 5070 A...
CRAFTING A CLINICAL QUESTION
 
If Well-Formulated. . .
P I C O ATIENT NTERVENTION OMPARISON UTCOME
Patient or Problem How would you describe a group of patients similar to yours?  What  are  the most important characteris...
Intervention Which main intervention, prognostic factor or exposure are you considering What do you want to do for the pat...
Comparison What is the main alternative to compare with the intervention? <ul><li>… compared to those with no concussion h...
Outcomes What can you hope to accomplish, measure, improve or affect?  What are you trying to do for the patient?  Relieve...
Example <ul><li>A 46 year old male had been moving rocks for his rock garden when he felt a twinge and his low back became...
(Melnyk & Fineout-Overholt, 2005)
LEVELS OF EVIDENCE
Levels of Evidence vs. Strength of Recommendation <ul><li>Levels of Evidence </li></ul><ul><ul><li>Used with individual st...
Levels of Evidence / Strength of Recommendation <ul><li>Oxford Centre for Evidence Based Medicine </li></ul><ul><li>Streng...
SORT Ebell et al,  Am Fam Phys , 2004
SORT
AAOS
Anecdotal Animal / Bench research Unpublished clinical observations Case series Poorly designed cohort / case-control Case...
Annotation Clinical Relevance Clinical Question LOE Analysis “ Bottom Line” Patient Education Critical Appraisal AT 5070 A...
CRITICAL APPRAISAL
Why Appraise? Current Literature Quantity concerns Quality concerns
General Appraisal Questions <ul><li>Are the results of this study  valid ? </li></ul><ul><li>Are these valid results  impo...
Applicable Evidence? <ul><li>Is our patient so  different  that the results cannot apply? </li></ul><ul><li>Is the treatme...
Systematic Reviews <ul><li>Is the evidence from this SR  valid ? </li></ul><ul><li>Is the valid evidence from the SR  impo...
Critical Appraisal Worksheets <ul><li>CEBM website </li></ul><ul><ul><li>Links to appraisal worksheets </li></ul></ul><ul>...
 
STUDENT BEHAVIORAL MARKERS
Student Evaluations: From Class 2005-2006
Student Evaluations From Class 2006-2007
Behavioral Markers Annotation Clinical Relevance <ul><li>Connection to practice is difficult </li></ul><ul><li>Writing sty...
Behavioral Markers <ul><li>1-page limit </li></ul><ul><li>Purpose / problem ID </li></ul><ul><li>Question structure </li><...
Behavioral Markers <ul><li>Choosing proper tool </li></ul><ul><li>Demonstrating work </li></ul><ul><li>Study characteristi...
Future Modifications <ul><li>Collaboration </li></ul><ul><li>Critically Appraised Topic (CAT) </li></ul>
http://clinques.nlm.nih.gov/JitSearch. html The ClinicalQuestions Collection is a growing repository of questions that hav...
Upcoming SlideShare
Loading in...5
×

A Graduate Critical Appraisal Assignment for Athletic Training

3,577

Published on

Published in: Education, Health & Medicine
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,577
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • Informal – ask questions Progressive better word
  • Transcript of "A Graduate Critical Appraisal Assignment for Athletic Training"

    1. 1. Graduated Critical Appraisal in AT Education John T. Parsons, MS, ATC, AT/L Tamara Valovich McLeod, PhD, ATC, AT/L A.T. Still University
    2. 2. Objectives <ul><li>Discuss the need critical analysis of published research studies. </li></ul><ul><li>Identify and discuss the main components of a graduated critical appraisal </li></ul><ul><ul><li>Appropriately constructed clinical question (PICO) to direct patient care. </li></ul></ul><ul><ul><li>Levels of evidence or strength of recommendations of research articles </li></ul></ul><ul><ul><li>Critically appraisal of evidence. </li></ul></ul><ul><li>Identify “behavioral markers” from student participation in a graduated critical appraisal assignment </li></ul>
    3. 3. ASSIGNMENT CONTEXT
    4. 4. Presentation Activities <ul><li>Demonstration and discussion of the evolution of the critical appraisal assignment over time. </li></ul><ul><li>Demonstrate and discuss critical appraisal assignment grading criteria (e.g., grading matrix) </li></ul><ul><li>Demonstration of process of crafting a clinical question using PICO format: P atient, i ntervention, c omparison, o utcome. </li></ul><ul><li>Demonstration of CATs (Critically Appraised Topics) in athletic training and compare to purpose critical appraisal assignment and discuss value of CATs contribution to the profession </li></ul><ul><li>Demonstrate critical appraisal of article, including discussion of critical elements of appraisal for a given article type (i.e., intervention study; systematic review / meta-analysis; RCT) </li></ul><ul><li>Discussion Level of Evidence (LOE) component of critical appraisal assignment, including appropriate choice of LOE scale for athletic trainers. </li></ul><ul><li>Discuss student progression and maturation following regular engagement in critical appraisal assignment </li></ul>
    5. 7. Best Research Evidence <ul><li>Valid </li></ul><ul><li>Clinically relevant </li></ul><ul><li>Basic / clinical research </li></ul><ul><li>Patient-centered </li></ul><ul><li>Diagnostic efficacy </li></ul><ul><li>Prognostic markers </li></ul><ul><li>Treatment efficacy </li></ul>
    6. 8. Patient-Oriented Evidence <ul><li>Morbidity, mortality </li></ul><ul><li>Symptom improvement </li></ul><ul><li>Cost reduction </li></ul><ul><li>Quality of life </li></ul><ul><li>Highest quality evidence </li></ul>
    7. 9. Patient-Oriented Evidence That Matters (POEM)
    8. 10. (Hurwtiz et al, JBJS , 2000) Common Problem Uncommon Problem Patient-Oriented Evidence Best Best source of POEMs Relevance: I Only if Time May not be relevant to everyday practice Relevance: II Disease-Oriented Evidence Danger Can be misleading Relevance: III Worst Read only if extremely interested Relevance: IV
    9. 11. Necessary Skills of Future Clinicians <ul><li>Information mastery </li></ul><ul><li>Clinical epidemiology </li></ul><ul><li>Learn skills; not information </li></ul>
    10. 12. Prescription for EBP <ul><ul><li>Craft a clinical question </li></ul></ul><ul><ul><li>Search the best evidence </li></ul></ul><ul><ul><li>Critically appraise the evidence </li></ul></ul><ul><ul><li>Integrate the evidence </li></ul></ul><ul><ul><li>Evaluate effectiveness </li></ul></ul>
    11. 13. ASSIGNMENT STRUCTURE
    12. 14. Progressive Assignment Components <ul><li>Identify & construct clinical question </li></ul><ul><li>Article annotation </li></ul><ul><li>LOE analysis </li></ul><ul><li>Clinical “bottom line” </li></ul><ul><li>Statement of clinical relevance </li></ul><ul><li>Identify & complete critical appraisal </li></ul>
    13. 15. General Guidelines <ul><li>Article <5 yrs. old </li></ul><ul><li>Relevant to course focus </li></ul><ul><li>Single-spaced, 1-page limit </li></ul><ul><li>Hard-copy submitted + article </li></ul>
    14. 16. Grading Form
    15. 17. AT 5070
    16. 18. Later Assignments
    17. 19. Annotation Clinical Relevance Clinical Question LOE Analysis “ Bottom Line” Patient Education Critical Appraisal AT 5070 AT 5120 AT 5220
    18. 20. Annotation Components <ul><li>Problem / purpose </li></ul><ul><li>Methods </li></ul><ul><li>Results </li></ul><ul><li>Page limit requirements </li></ul>
    19. 21. Clinical Question Citation Problem & purpose Methods & results LOE, applicability, & patient education
    20. 22. Annotation Clinical Relevance Clinical Question LOE Analysis “ Bottom Line” Patient Education Critical Appraisal AT 5070 AT 5120 AT 5220
    21. 23. CRAFTING A CLINICAL QUESTION
    22. 25. If Well-Formulated. . .
    23. 26. P I C O ATIENT NTERVENTION OMPARISON UTCOME
    24. 27. Patient or Problem How would you describe a group of patients similar to yours? What are the most important characteristics of the patient? <ul><li>Are Football athletes… </li></ul><ul><li>In ice hockey athletes… </li></ul>P
    25. 28. Intervention Which main intervention, prognostic factor or exposure are you considering What do you want to do for the patient? What factor may influence the prognosis of the patient? <ul><li>… with a history of multiple concussions… </li></ul><ul><li>… does the use of full face shields… </li></ul>I
    26. 29. Comparison What is the main alternative to compare with the intervention? <ul><li>… compared to those with no concussion history ... </li></ul><ul><li>… compared to half face shields… </li></ul>C
    27. 30. Outcomes What can you hope to accomplish, measure, improve or affect? What are you trying to do for the patient? Relieve or eliminate the symptoms? <ul><li>… at greater risk for long term sequelae? </li></ul><ul><li>… decrease the risk of facial fractures? </li></ul>O
    28. 31. Example <ul><li>A 46 year old male had been moving rocks for his rock garden when he felt a twinge and his low back became excruciatingly painful. He's come into the ER and is extremely unhappy and demanding an MRI. You thought CT was the standard for diagnosis. P : patient with acute low back pain I : MRI C : CT Scan O : Diagnostic effectiveness Answerable Question : in patients with low back pain, is MRI more effective than CT scanning for diagnostic purposes? </li></ul>
    29. 32. (Melnyk & Fineout-Overholt, 2005)
    30. 33. LEVELS OF EVIDENCE
    31. 34. Levels of Evidence vs. Strength of Recommendation <ul><li>Levels of Evidence </li></ul><ul><ul><li>Used with individual studies to help clinicians to determine the value of the results reported </li></ul></ul><ul><ul><li>Usually ranks from 1-5, with 1 being the highest quality </li></ul></ul><ul><li>Strength of Recommendation </li></ul><ul><ul><li>Used with a body of literature to grade the recommendation for evidence to be used in clinical practice </li></ul></ul>
    32. 35. Levels of Evidence / Strength of Recommendation <ul><li>Oxford Centre for Evidence Based Medicine </li></ul><ul><li>Strength of Recommendation Taxonomy (SORT) </li></ul><ul><li>American Academy of Orthopaedic Surgeons (AAOS) </li></ul><ul><li>Grading of Recommendations, Assessment, Development and Evaluation (GRADE) </li></ul>
    33. 36. SORT Ebell et al, Am Fam Phys , 2004
    34. 37. SORT
    35. 38. AAOS
    36. 39. Anecdotal Animal / Bench research Unpublished clinical observations Case series Poorly designed cohort / case-control Case-control Cohort Well-designed RCTs / prospective studies Level 5 Level 4 Level 3 3a: SR of case-control studies 3b: Individual case-control Level 2 2a: SR of cohort studies 2b: Individual cohort studies 2c: Outcomes research Level 1 1a: SR of RCTs 1b: Individual RCTs 1c: All or none studies
    37. 40. Annotation Clinical Relevance Clinical Question LOE Analysis “ Bottom Line” Patient Education Critical Appraisal AT 5070 AT 5120 AT 5220
    38. 41. CRITICAL APPRAISAL
    39. 42. Why Appraise? Current Literature Quantity concerns Quality concerns
    40. 43. General Appraisal Questions <ul><li>Are the results of this study valid ? </li></ul><ul><li>Are these valid results important ? </li></ul><ul><li>Are the valid, important results applicable to my patient? </li></ul>
    41. 44. Applicable Evidence? <ul><li>Is our patient so different that the results cannot apply? </li></ul><ul><li>Is the treatment feasible in our setting? </li></ul><ul><li>What are our patient’s potential benefits and harms from the therapy? </li></ul><ul><li>What are our patient’s values and expectations ? </li></ul>
    42. 45. Systematic Reviews <ul><li>Is the evidence from this SR valid ? </li></ul><ul><li>Is the valid evidence from the SR important ? </li></ul><ul><li>Are the valid, important results from the SR applicable to my patient? </li></ul>
    43. 46. Critical Appraisal Worksheets <ul><li>CEBM website </li></ul><ul><ul><li>Links to appraisal worksheets </li></ul></ul><ul><ul><ul><li>http://www.cebm.utoronto.ca/teach/materials/caworksheets.htm </li></ul></ul></ul><ul><ul><li>Stats calculators (EBM toolbox – right side) </li></ul></ul><ul><ul><ul><li>http://www.cebm.utoronto.ca/ </li></ul></ul></ul><ul><ul><ul><li>Downloadable to a PDA </li></ul></ul></ul><ul><li>PEDro </li></ul><ul><ul><li>http://www.pedro.fhs.usyd.edu.au/scale_item.html </li></ul></ul>
    44. 48. STUDENT BEHAVIORAL MARKERS
    45. 49. Student Evaluations: From Class 2005-2006
    46. 50. Student Evaluations From Class 2006-2007
    47. 51. Behavioral Markers Annotation Clinical Relevance <ul><li>Connection to practice is difficult </li></ul><ul><li>Writing style & efficiency </li></ul>Patient Education
    48. 52. Behavioral Markers <ul><li>1-page limit </li></ul><ul><li>Purpose / problem ID </li></ul><ul><li>Question structure </li></ul><ul><li>Study design required for LOE </li></ul><ul><li>Prioritizing study factors that speak to question </li></ul>Clinical Question LOE Analysis “ Bottom Line” Summary
    49. 53. Behavioral Markers <ul><li>Choosing proper tool </li></ul><ul><li>Demonstrating work </li></ul><ul><li>Study characteristics (i.e., blinding, random assignment) </li></ul>Critical Appraisal
    50. 54. Future Modifications <ul><li>Collaboration </li></ul><ul><li>Critically Appraised Topic (CAT) </li></ul>
    51. 55. http://clinques.nlm.nih.gov/JitSearch. html The ClinicalQuestions Collection is a growing repository of questions that have been collected from healthcare providers in clinical settings across the country. The questions have been submitted by investigators who wish to share their data with other researchers.  http ://www.cebm.utoronto.ca / Main CEBM site  http ://www.pedro.fhs.usyd.edu.au/scale_item. html PEDro http ://ebmlibrarian.wetpaint.com / EBM Librarian - has info on appraisals and CATS http://www.cche.net/usersguides/ebm.aspHas info on the Users' Guides  http ://pubs.ama-assn.org/misc/usersguides. dtl Users' Guides  http ://www.ebmny.org/cats. html CATS  http ://www.otcats.com / OT CATS

    ×