Published on

Published in: Health & Medicine, Education
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. ACAD EMERG MED d December 2004, Vol. 11, No. 12 d 1283.e1 Feedback Barbara K. Richardson, MD Abstract The emergency department provides a rich environment for performing students. Although the following examples diverse patient encounters, rapid clinical decision making, pertain to medical student education, these techniques are and opportunities to hone procedural skills. Well-prepared applicable to the education of all adult learners, including faculty can utilize this environment to teach residents and residents and colleagues. Specific examples of redirection medical students and gain institutional recognition for their and reflection are offered, and pitfalls are reviewed. incomparable role and teamwork. Giving effective feedback Suggestions for streamlining verbal and written feedback is an essential skill for all teaching faculty. Feedback is and obtaining feedback from others in a fast-paced ongoing appraisal of performance based on direct observa- environment are given. Ideas for further individual and tion aimed at changing or sustaining a behavior. Tips from group faculty development are presented. Key words: the literature and the author’s experience are reviewed to feedback; medical students; faculty development; emer- provide formats for feedback, review of objectives, and gency medicine. ACADEMIC EMERGENCY MEDICINE elements of professionalism and how to deal with poorly 2004; 11:1283. The clerkship in emergency medicine (EM) should be may continue to disrupt shift flow and jeopardize the pinnacle of student autonomy in the fourth year, patient safety. a unique opportunity to amplify clinical skills and Faculty should keep in mind that they are role medical decision making in preparation for intern- models for students and provide continuous feedback ship. Integral to this transformation from student to as they interact with patients and families, residents, physician is excellent feedback provided by faculty students, staff, and consultants. There is no better and senior residents. However, like parents in child- place to learn how to prioritize tasks and patients, rearing, faculty members are expected to perform well focus on the life threats, negotiate solutions, redirect in this role with little advance training. the expectations of the patient and families to the Ende1 defines feedback as an informed, nonevalu- possible, anticipate the complications, and efficiently ative, and objective appraisal of performance that is arrive at an appropriate disposition than the emer- aimed at improving clinical skills rather than estimat- gency department (ED). Students are great mimics ing the student’s personal worth. Feedback differs and will copy the habits of their preceptors. The from evaluation in that it is immediate and formative, ability to provide feedback and serve as a role model rather than summative, and is directed toward en- is expected of all teaching faculty members. hancing the student’s ability to modify and improve their performance over time to meet the objectives of the clerkship. Feedback is targeted to specific behav- ELEMENTS OF EFFECTIVE FEEDBACK iors the student does well and those in need of 1. Clerkship Goals and Objectives Should Be improvement. The goal is to change a poor habit or Thoroughly Understood by Students and Precep- sustain and augment effective behavior over time. To tors from the Beginning. Web sites and e-mails in be most effective, feedback should be provided on advance of formal orientation sessions can facilitate a continuous basis throughout the clerkship, at the this process. EM clerkships are generally designed as end of a case or shift, and by the site director at the subinternships with expectation of student manage- midpoint of the rotation. If the learner does not ment of a variety of acuities and presentations, re- receive realistic feedback, then the wrong behaviors quired and optional procedures, mandatory didactic sessions, recommended reading, oral or written case discussions to foster lifelong learning, and a written From the Department of Emergency Medicine, Mount Sinai Medical examination. During formal orientation, students are Center (BKR), New York, NY. informed of the requirement to actively seek feedback Received January 1, 2004; revision received March 12, 2004; during and at the conclusion of every clinical shift. accepted May 3, 2004. Providing a feedback form to students for faculty Address for correspondence: Barbara K. Richardson, MD, Depart- to complete that includes queries on a witnessed ment of Emergency Medicine, Box 1620, Mount Sinai Medical Center, One Gustave Levy Place, New York, NY. e-mail: barbara. history and physical examination, observed proce- dures, and a list of objectives including eliciting his- doi:10.1197/j.aem.2004.08.036 tory and physical examinations, eliciting differential
  2. 2. 1283.e2 Richardson d FEEDBACK diagnoses, ability to formulate a management plan, time to reflect on what happened and how they might interpreting laboratory test results, performing pro- do it differently the next time. cedures, and interacting with patients as well as room for a narrative of strengths and weaknesses will 6. Feedback Should Be Specific and Limited to provide a daily reminder of faculty responsibility a Few Objectives at a Time. The pace of events in the and proof of student progress in the clerkship. It ED can be challenging to seasoned preceptors and formalizes the student and faculty feedback loop and daunting to students. Feedback can be effectively identifies faculty members over time who deserve done ‘‘on the run’’ as one reviews how a case is pro- extra credit for their work or need more help with the gressing or the communication skill of a student in process. conveying only essential information and the question on a requisition or consult. Bedside supervision of 2. Students and Patients Must Have a Safe Learn- a procedure is an opportunity for verbal rehearsal in ing Environment. Provide a safe setting for students advance of the procedure, followed by midcourse to experience autonomy in data gathering and initial corrections as needed during the procedure. Often evaluation of the patient. This is readily achieved in residents or nurses are invaluable preceptors for the lower acuity areas of the ED where students are essential procedures because they have significant encouraged to be the first ‘‘physician’’ beyond the recent experience in performance. Faculty must re- triage desk. In the trauma bay and cardiac rooms, serve time at the end of the shift to review a few key students are often involved in more peripheral tasks issues and provide for reflection by the student. These or observer status; however, faculty must ensure that are not mini lectures, which have been shown to foster learning issues and performance of students and dependence, but oriented to clinical skills and specific residents are addressed once the patient has been observations. stabilized. 7. A Format for Feedback. The sandwich technique 3. Students and Preceptors Must Share Mutual of good news, corrective action, and then good news Respect. Show students the respect you would give has been promoted by some as a useful way to to any other physician. Faculty interactions with provide feedback. Others believe that overemphasis students and their patients at the bedside will on the positive may undermine appreciation for, and strongly influence a student’s choice of subspecialty. attention to, the deficiency. Depending on the person- Do not be condescending or overbearing in your ality of the student, some may hear only the negative instruction or criticism of their talents. Respect their comment and lose confidence in their ability. Regard- opinion as to the clinical status of the patient. Ask less of technique used, comments should be specific, them to identify any areas of uncertainty. Underscore not personal (e.g., ‘‘ I noted you had trouble with the the importance of honesty in all clinical interactions. ABG’’ rather than ‘‘You are completely incompetent at Give them your undivided attention during their blood gases!’’). presentations; resist the urge to interrupt frequently. 8. Label Feedback. Unless clearly stated, students 4. Feedback Should Be Timely. Constructive feed- will fail to recognize feedback and you will not be back prevents poor first efforts from becoming bad recognized for your effort. Clearly identify your habits. Reserve corrective actions whenever possible comments as constructive feedback on the perfor- for private conversations. Global deficiencies in a stu- mance for that shift.2 dent should be brought early to the attention of the clerkship director. 9. Dealing with a Student’s Response to Feedback. Students with repeated problems should be inter- 5. Dealing with Poor Clinical Skills. A student may viewed in private. Students will be less defensive if be an exhaustive reporter of medical data but unable the site or clerkship director explores the student’s to organize the pertinent information for a concise perception of what is wrong and how he or she thinks oral presentation or chart note. Systematizing the it could be improved. Students are often relieved to approach driven by the chief complaint will improve learn that they can reform and still complete the future performance. Students may lack confidence in course in a satisfactory manner. Misperceptions can their clinical examination. Findings should be re- be dispelled. Students rotating through the ED post- viewed at bedside. Offer to demonstrate findings and match to their subspecialty of choice may have a lack procedures. More advanced students may require of motivation. Savvy preceptors should rejoice in their help with task prioritization or selecting evidence- success but underscore the potential value of the based therapeutic plans. It is useful to ask what they clerkship (makes the internship less daunting) and would like to know/see, etc. Students exhibiting poor the consequences of not achieving the minimum interpersonal skills with nurses or patients need objectives (failure to graduate on time). Serious in- a private session with the preceptor to allow them terpersonal difficulties are unlikely to be a new issue
  3. 3. ACAD EMERG MED d December 2004, Vol. 11, No. 12 d 1283.e3 by the fourth year of medical school. Discussions with d Give immediate feedback at the end of a shift or the dean’s office may yield appropriate corrective patient interaction, not just at specified times. actions. Students whose work appears to degenerate d Discuss criticisms with a student before writing toward the end of the clerkship may have a legitimate them into a final evaluation. reason, such as a family emergency or serious per- d Initiate feedback before students have to ask for it. sonal health issue. Upon discovery, students will still Feedback from faculty and senior residents will be required to complete the clerkship, albeit in a more differ in emphasis and rating but can provide valu- relaxed time frame. able insight into student performance. Residents tend to rate students higher than faculty and focus on team dynamics, work ethic, and procedural skills. Faculty 10. Legal and Illegal Criticisms. Limit feedback to more often comment on fund of knowledge, reason- remediable behavior. Preceptors who find themselves ing, and communication skills.6,7 very angry with a student should take a five-minute Faculty skills in feedback technique can be de- timeout before providing criticism. By first soliciting veloped in small group discussions, which include feedback from the student, a positive message is clerkship objectives, teaching tools, videotapes, and conveyed that both student and preceptor can im- critiqued role play.8 Starting with a needs assessment, prove their communication, performance, etc.3 Re- a program can be designed using lecture format, small member that students may be as stressed as faculty group discussions, and even standardized students to during a particularly busy shift. Taking time out after permit faculty to try out techniques and obtain valu- your shift for a brief meal break or the next day to able feedback from colleagues and mentors in a pro- review some of the salient points that could not be tected environment. covered in real time will strengthen the bond with the Residency directors in EM and other disciplines student and heighten your credibility. share the same interest in faculty development and may invite national speakers with expertise in this area. Departments or institutes of medical education FACULTY DEVELOPMENT in medical schools can create interdisciplinary di- Labeling all students as ‘‘phenomenal’’ may make you dactic and experiential sessions that focus on feed- a popular preceptor but does little to assist the student back and other key issues in teaching. Faculty with in identifying areas of weakness or help the site interest in teaching fellowships should consider director to determine whether the objectives are being CORD’s Navigating the Academic Waters program, met. Indirect comments, in an attempt to preserve the medical education programs (such as the one-month student’s self-esteem or facilitate the active learning programs at Stanford University), Association of process, may result in failure of the student to American Medical Colleges or Harvard Macy fellow- recognize a medical error as an error.4 Faculty fears ships, or an advanced degree program (such as the of student reprisal, failure to recruit students to the master’s in education offered at the University of specialty, or even litigation are unfounded if feedback Illinois). is respectful and based on objective observation. Nonetheless, faculty may be unwilling to discuss HELPFUL HINTS AND EXAMPLES OF marginal students on paper. Group meetings at FEEDBACK regular intervals with faculty and residents who supervise students are more likely to uncover serious 1. Student self-reflection.9 ‘‘What went well?’’ problems. Encourage calls from faculty if there are ‘‘What do you need to work on?’’ Solicit feedback concerns. Clerkship and site directors will also find it from the student on their performance during valuable to observe faculty–student interactions on an a particular encounter or shift. Although many unannounced basis. students will tend to be overcritical, it gives the Kernan et al.5 surveyed third-year students to faculty member insight into weaknesses the stu- identify faculty behaviors that facilitated learning. dent is aware of as well as those the student has Under the domain of feedback, 86%–97% of respond- not recognized. The faculty member can then ents agreed with the following: suggest specifics on how to improve through reading, study, skills, or practice.8 d Read notes promptly in the rotation to comment 2. Make specific observations. Pangaro10 developed regarding form, content, and length. the R-I-M-E (Reporter–Interpreter–Manager–Edu- d Do not stop at global criticism. Be specific and cator) construct to identify specific milestones in directive, citing alternative ways of doing the student progress. Some examples follow. pertinent skill. d Tell students when they are doing something well. d When an error is made, tell how to do it right; Feedback on Student as Reporter. ‘‘With Mrs. when they do, compliment them. Smith, I thought you were pressured to complete
  4. 4. 1284.e4 Richardson d FEEDBACK a thorough history on chest pain, which is important, not responded, what would your next step be? What but you didn’t give her much time to tell you about will be important in the education of your patient?’’ the quality and character of the pain. How might that ‘‘You have arrived at the most likely diagnosis. In change your index of suspicion for acute coronary emergency medicine, we must often make decisions syndrome in this patient?’’ based on a limited data set and time with the patient. ‘‘I have observed that you do not routinely inquire Abdominal pain is a frequent presenting complaint and about HIV status in patients with upper respiratory it is not possible or appropriate to perform exhaustive complaints. If you agree that knowledge of HIV status workups on every patient. What danger signs will you will affect your differential and treatment, where discuss with your patient to ensure prompt return if might be a good place to work this into your history a more serious condition is unfolding?’’ taking?’’ ‘‘Your explanation to the asthma patient on how to (Session following a corrective action) ‘‘Your effort avoid triggers and the proper way to use inhalers is to make your presentation and chart more problem likely to improve patient well being and reduce oriented has paid off! Your ability to focus on the further ED visits. You were smart to ask the patient problem(s) and be concise in documentation will be to return a demonstration and describe her under- a real timesaver during your internship and much standing of the discharge instructions.’’ appreciated by your colleagues and consultants.’’ 3. One goal of the clerkship is to improve efficiency Feedback on Student as Interpreter. ‘‘Your elder and focus in patient evaluation. A brief preview of patient presents with a history of heart failure and the chief complaint and vital signs with the bradycardia. Can you review your interpretation of student in advance of the patient evaluation will the ECG and electrolytes again? Great! You have identify those students who will need earlier correctly identified a ventricular escape rhythm and supervision and those patients who will need hypokalemia. How might they be related? What else a team approach. Students are granted some is in your differential?’’ autonomy with stable patients commensurate ‘‘You have done an admirable job on the history and with their experience. Students benefit most physical examination in this patient with acute head- when faculty seek their input and confirm ques- ache. In addition to what you believe to be the most tions or findings at the bedside, leaving students in likely diagnosis, what are others, which you must control of the case. Patients are usually tolerant of consider, in order not to miss a grave condition? What some delays that are inherent in this approach. might be a good source in which to find this in- However, faculty must assume control of a case formation?’’ whenever there is potential for harm to a patient.11 4. Interrater reliability will increase when multiple Feedback on Student as Patient Manager and encounters are included.12 Ten to 16 or more Educator. ‘‘Clarity in order writing is an important eight- to 12-hour shifts are easily incorporated way to reduce medical errors. The nursing staff ex- into a three- to four-week clerkship. Students may pects certain conventions. Let’s review your orders for get more valuable feedback if they work with the Mr. Jones. The nurses are looking for drug, dose, same faculty member for the majority of shifts. In route, and frequency.What source did you use to many departments, this is not possible due to learn about this drug and decide upon the dose?’’ conflicting demands on faculty and the desire to ‘‘You have presented two patients today with expose students to a variety of teaching styles. It is possible fractures. How might you reduce their always preferable to have a student present to the discomfort in X-ray? Do you need a diagnosis before same faculty member on a given shift. Students on administering pain medications? What would be ‘‘audition’’ electives should work several shifts appropriate? Would you like to review the steps with at least one member of the residency selec- before making a splint for this patient?’’ tion committee. The site or clerkship director (After concern was voiced by the RN chaperone) determines which scenario works best in view of ‘‘Can you walk me through the techniques you use to the number of students in a particular block. prepare a female patient for a pelvic exam? Would 5. Many faculty members believe that professional- you like me to demonstrate how I do it?’’ ism is the most important aspect of student ‘‘I notice that the alcoholic patient you are inter- assessment. Faculty members are encouraged to viewing is becoming quite agitated. It is a challenge to comment on maturity, responsibility, honesty, and manage patients who are potentially disruptive. Let’s respect for patients and staff demonstrated or step back for a moment and review what you know abrogated by the students. Do not permit or model and what you think might be going on.perhaps you inappropriate negative comments about recidivist should use a different approach.’’ or other challenging patients. Labeling can lead to ‘‘You did a great job recognizing and alleviating the gross negligence in patient care. Pejorative docu- airway obstruction in your patient. Had the patient mentation is an invitation to litigation.
  5. 5. ACAD EMERG MED d December 2004, Vol. 11, No. 12 d 1283.e5 6. Focus feedback on areas the student can control. and promote feedback on patient outcomes so essen- Primary objectives to practice in EM include the tial to our personal performance improvement. ability to establish and use a limited data set Clerkship directors are encouraged to explore quickly, prioritize tasks, engage in conservative resources within and beyond their own institution to diagnostic reasoning, and manage more than one assist in the development of excellent preceptors. patient simultaneously. Negative comments on Regular meetings between sites and visits by the speech defects or language difficulties are off limits. clerkship director to each site will help to maintain 7. Limit feedback to a few important observations. Do consistency and collaboration and reinforce the criti- not attempt to create the quintessential EM student cal role of site faculty in the training of students. in one session. Respect the fact that all students can Documentation of successful efforts in teaching stu- gain enormous value from your teaching and this dents is critical to institutional recognition and in- rotation. Accept that not all of them wish to emulate dividual faculty advancement. you and become emergency physicians! 8. Be receptive to suggestions from students about how to improve feedback. At our institution, References students are required to submit anonymous eval- 1. Ende J. Feedback in clinical medical education. JAMA. 1983; uations of the clerkship and faculty interactions in 250:777–81. order to obtain their grades. There are electronic 2. Albritton TA. Feedback. In: Fincher RE (ed). Guidebook for Clerkship Directors. Washington, DC: Association of American systems that facilitate this labor-intensive work. Medical Colleges, 2000, pp 135–8. Evaluations are reviewed by the site directors and 3. Weinholtz D, Edwards J. Providing feedback. In: Mumford L returned to individual preceptors at intervals to (ed). Teaching During Rounds: A Handbook for Attending preserve confidentiality. Just as a single negative Physicians and Residents. Baltimore: Johns Hopkins Press, comment is cause for concern regarding a student, 1992, pp 85–93. several negative comments about a faculty member 4. Ende J, Pomerantz A, Erickson F. Preceptors’ strategies for correcting residents in an ambulatory care medicine setting: should be addressed through a private conference a qualitative analysis. Acad Med. 1995; 70:224–9. or personalized faculty development session. 5. Kernan WN, Lee MY, Stone SL, Freudigman KA, O’Connor PG. Effective teaching for preceptors of ambulatory care: a survey of medical students. Am J Med. 2000; 108:499–502. CLOSING COMMENTS 6. Metheny WP. Limitations of physician ratings in the assessment of student clinical performance in an obstetrics and Aside from being required by the Liaison Committee gynecology clerkship. Obstet Gynecol. 1991; 78:136–41. on Medical Education, feedback is an integral part of 7. Hull AL. Medical student performance: a comparison of house our role as faculty and clerkship directors. For some of officer and attending staff as evaluators. Eval Health Prof. us with excellent observational and interpersonal 1982; 5:87–94. 8. Keenan JM, Seim HC, Bland CJ, Altemeier TM. A workshop skills, this is an easy transition. For the rest, thor- program to train volunteer community preceptors. Acad Med. oughly reviewing the goals of the clerkship, spending 1990; 65:46–7. time directly observing the students in action, and 9. Woolliscroft JO, TenHaken J, Smith J, Calhoun JG. Medical practicing active listening will produce better feed- students’ clinical self-assessments: comparisons with external measures of performance and the students’ self-assessment of back and enhance performance while maintaining overall performance and effort. Acad Med. 1993; 68:285–94. student motivation and self-confidence. 10. Pangaro L. A new vocabulary and other innovations to The successful clerkship will dramatically advance improve descriptive in-training evaluations. Acad Med. the student’s ability to apply clinical skills and prac- 1999; 74:1203–7. tice medical decision making as well as appreciate 11. Lesky LG, Borkan SC. Strategies to improve teaching in the challenges in EM. As students graduate to higher the ambulatory medicine setting. Arch Intern Med. 1990; 150:2133–7. domains, it is hoped that positive bonding with 12. Elnicki DM, Ainsworth MA. Evaluating the internal medicine ED faculty during the clerkship should inculcate re- clerkship: a Clerkship Directors in Internal Medicine spect for our work, encourage collegial interactions, commentary. Am J Med. 1994; 97:I–VII.