SlideShare a Scribd company logo
1 of 6
Download to read offline
ORIGINAL RESEARCH
A Simulation-Based Resident-as-Teacher Program:
The Impact on Teachers and Learners
Eli M. Miloslavsky, MD1
*, Zaven Sargsyan, MD2
, Janae K. Heath, MD1
, Rachel Kohn, MD3
, George A. Alba, MD1
,
James A. Gordon, MD, MPA4
, Paul F. Currier, MD1
1
Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts; 2
Department of Medicine, Baylor College of Medicine,
Houston, Texas; 3
Department of Medicine, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; 4
Department of Emergency
Medicine, Massachusetts General Hospital, Boston, Massachusetts.
BACKGROUND: Residency training is charged with improv-
ing resident teaching skills. Utilizing simulation in teacher
training has unique advantages such as providing a con-
trolled learning environment and opportunities for deliberate
practice.
OBJECTIVE: We assessed the impact of a simulation-
based resident-as-teacher (RaT) program.
DESIGN: A RaT program was embedded in an existing 8-
case simulation curriculum for 52 internal medicine (IM)
interns. Residents participated in a workshop, then served
as facilitators in the curriculum and received feedback from
faculty.
METHODS: Residentsā€™ teaching and feed back skills were
measured using a pre- and post-program self-assessment
and post-session and post-curriculum evaluations by intern
learners.
SETTING/PARTICIPANTS: Forty-one second- and third-
year residents participated in the study August 2013 to
October 2013 at a single center.
RESULTS: Pre- and post-program teaching skills were
assessed for 34 of 41 resident facilitators (83%) participat-
ing in 3.9 sessions on average. Partaking in the program led
to improvements in resident facilitatorsā€™ self-reported teach-
ing and feedback skills across all domains. The most signiļ¬-
cant improvement was in teaching in a simulated
environment (2.81 to 4.16, P < 0.001). Interns rated the cur-
riculum highly (81% ā€œexcellent,ā€ 19% ā€œgoodā€) and reported
that resident facilitators frequently utilized debrieļ¬ng techni-
ques covered in the RaT program.
CONCLUSIONS: Our simulation-based RaT program offered
a unique opportunity for deliberate practice of teaching skills
in a controlled environment and led to improvements in resi-
dent facilitatorsā€™ teaching and feed back skills. The simulation
curriculum, facilitated by residents, was well received by the
intern learners. Our program design may serve as a model for
the development of simulation curricula and RaT programs
within IM residencies. Journal of Hospital Medicine
2015;10:767ā€“772. VC 2015 Society of Hospital Medicine
Residency training, in addition to developing clinical
competence among trainees, is charged with improving
resident teaching skills. The Liaison Committee on Medi-
cal Education and the Accreditation Council for Gradu-
ate Medical Education require that residents be provided
with training or resources to develop their teaching
skills.1,2
A variety of resident-as-teacher (RaT) programs
have been described; however, the optimal format of
such programs remains in question.3
High-ļ¬delity medi-
cal simulation using mannequins has been shown to be
an effective teaching tool in various medical specialties4ā€“7
and may prove to be useful in teacher training.8
Teaching
in a simulation-based environment can give participants
the opportunity to apply their teaching skills in a clinical
environment, as they would on the wards, but in a more
controlled, predictable setting and without compromising
patient safety. In addition, simulation offers the opportu-
nity to engage in deliberate practice by allowing teachers
to facilitate the same case on multiple occasions with dif-
ferent learners. Deliberate practice, which involves task
repetition with feedback aimed at improving perform-
ance, has been shown to be important in developing
expertise.9
We previously described the ļ¬rst use of a high-
ļ¬delity simulation curriculum for internal medicine
(IM) interns focused on clinical decision-making skills,
in which second- and third-year residents served as
facilitators.10,11
Herein, we describe a RaT program
in which residents participated in a workshop, then
served as facilitators in the intern curriculum and
received feedback from faculty. We hypothesized that
such a program would improve residentsā€™ teaching
and feedback skills, both in the simulation environ-
ment and on the wards.
METHODS
We conducted a single-group study evaluating teach-
ing and feedback skills among upper-level resident
facilitators before and after participation in the RaT
program. We measured residentsā€™ teaching skills using
*Address for correspondence and reprint requests: Eli M. Miloslavsky,
MD, Massachusetts General Hospital, 55 Fruit St., Suite 2C, Boston, MA
02114; Telephone: 617-726-7938; Fax: 617-643-1274;
E-mail: emiloslavsky@mgh.harvard.edu
Additional Supporting Information may be found in the online version of
this article.
Received: March 1, 2015; Revised: May 14, 2015; Accepted: June 10,
2015
2015 Society of Hospital Medicine DOI 10.1002/jhm.2423
Published online in Wiley Online Library (Wileyonlinelibrary.com).
An Ofļ¬cial Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015 767
pre- and post-program self-assessments as well as eval-
uations completed by the intern learners after each
session and at the completion of the curriculum.
Setting and Participants
We embedded the RaT program within a simulation
curriculum administered July to October of 2013 for
all IM interns at Massachusetts General Hospital
(interns in the ā€œpreliminaryā€ program who planned to
pursue another ļ¬eld after the completion of the intern
year were excluded) (n 5 52). We invited postgradu-
ate year (PGY) II and III residents (n 5 102) to partic-
ipate in the IM simulation program as facilitators via
email. The curriculum consisted of 8 cases focusing
on acute clinical scenarios encountered on the general
medicine wards. The cases were administered during
1-hour sessions 4 mornings per week from 7 AM to 8
AM prior to clinical duties. Interns completed the cur-
riculum over 4 sessions during their outpatient rota-
tion. The case topics were (1) hypertensive emergency,
(2) post-procedure bleed, (3) congestive heart failure,
(4) atrial ļ¬brillation with rapid ventricular response,
(5) altered mental status/alcohol withdrawal, (6) non-
sustained ventricular tachycardia heralding acute coro-
nary syndrome, (7) cardiac tamponade, and (8)
anaphylaxis. During each session, groups of 2 to 3
interns worked through 2 cases using a high-ļ¬delity
mannequin (Laerdal 3G, Wappingers Falls, NY) with
2 resident facilitators. One facilitator operated the
mannequin, while the other served as a nurse. Each
case was followed by a structured debrieļ¬ng led by 1
of the resident facilitators (facilitators switched roles
for the second case). The number of sessions facili-
tated varied for each resident based on individual
schedules and preferences.
Four senior residents who were appointed as
simulation leaders (G.A.A., J.K.H., R.K., Z.S.) and
2 faculty advisors (P.F.C., E.M.M.) administered the
program. Simulation resident leaders scheduled facili-
tators and interns and participated in a portion of
simulation sessions as facilitators, but they were not
analyzed as participants for the purposes of this study.
The curriculum was administered without interfering
with clinical duties, and no additional time was pro-
tected for interns or residents participating in the
curriculum.
Resident-as-Teacher Program Structure
We invited participating resident facilitators to attend
a 1-hour interactive workshop prior to serving
as facilitators. The workshop focused on building
learner-centered and small-group teaching skills, as
well as introducing residents to a 5-stage debrieļ¬ng
framework developed by the authors and based on
simulation debrieļ¬ng best practices (Table 1).12ā€“14
Resident facilitators were observed by simulation
faculty and simulation resident leaders throughout the
intern curriculum and given structured feedback either
in-person immediately after completion of the simula-
tion session or via a detailed same-day e-mail if the
time allotted for feedback was not sufļ¬cient. Feedback
was structured by the 5 stages of debrieļ¬ng described
in Table 1, and included soliciting residentsā€™ observa-
tions on the teaching experience and speciļ¬c behaviors
observed by faculty during the scenarios. E-mail feed-
back (also structured by stages of debrieļ¬ng and
including observed behaviors) was typically followed
by verbal feedback during the next simulation session.
The RaT program was composed of 3 elements: the
workshop, case facilitation, and direct observation
with feedback. Because we felt that the opportunity
for directly observed teaching and feedback in a
ā€œward-likeā€ controlled environment was a unique
advantage offered by the simulation setting, we
included all residents who served as facilitators in the
TABLE 1. Stages of Debrieļ¬ng12ā€“14
Stage of Debrieļ¬ng Action Rationale
Emotional response Elicit learnersā€™ emotions about the case It is important to acknowledge and address both positive and negative emotions that arise
during the case before debrieļ¬ng the speciļ¬c medical and communications aspects of the
case. Unaddressed emotional responses may hinder subsequent debrieļ¬ng.
Objectives* Elicit learnersā€™ objectives and combine them with the stated learning
objectives of the case to determine debrieļ¬ng objectives
The limited amount of time allocated for debrieļ¬ng (15ā€“20 minutes) does not allow the facili-
tator to cover all aspects of medical management and communication skills in a particular
case. Focusing on the most salient objectives, including those identiļ¬ed by the learners,
allows the facilitator to engage in learner-centered debrieļ¬ng.
Analysis Analyze the learnersā€™ approach to the case Analyzing the learnersā€™ approach to the case using the advocacy-inquiry method11
seeks to
uncover the learnerā€™s assumptions/frameworks behind the decision made during the case.
This approach allows the facilitator to understand the learnersā€™ thought process and target
teaching points to more precisely address the learnersā€™ needs.
Teaching Address knowledge gaps and incorrect assumptions Learner-centered debrieļ¬ng within a limited timeframe requires teaching to be brief and tar-
geted toward the deļ¬ned objectives. It should also address the knowledge gaps and incor-
rect assumptions uncovered during the analysis phase.
Summary Summarize key takeaways Summarizing highlights the key points of the debrieļ¬ng and can be used to suggest further
exploration of topics through self-study (if necessary).
NOTE: *To standardize the learner experience, all interns received an e-mail after each session describing the key learning objectives and takeaway points with references from the medical literature for each case.
Miloslavsky et al | Simulation Resident-as-Teacher Program
768 An Official Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015
analysis, regardless of whether or not they had
attended the workshop.
Evaluation Instruments
Survey instruments were developed by the investiga-
tors, reviewed by several experts in simulation, pilot
tested among residents not participating in the simula-
tion program, and revised by the investigators.
Pre-program Facilitator Survey
Prior to the RaT workshop, resident facilitators com-
pleted a baseline survey evaluating their preparedness
to teach and give feedback on the wards and in a
simulation-based setting on a 5-point scale (see Sup-
porting Information, Appendix I, in the online version
of this article).
Post-program Facilitator Survey
Approximately 3 weeks after completion of the intern
simulation curriculum, resident facilitators were asked
to complete an online post-program survey, which
remained open for 1 month (residents completed this
survey anywhere from 3 weeks to 4 months after their
participation in the RaT program depending on the
timing of their facilitation). The survey asked residents
to evaluate their comfort with their current post-pro-
gram teaching skills as well as their pre-program skills
in retrospect, as previous research demonstrated that
learners may overestimate their skills prior to training
programs.15
Resident facilitators could complete the
surveys nonanonymously to allow for matched-pairs
analysis of the change in teaching skills over the
course of the program (see Supporting Information,
Appendix II, in the online version of this article).
Intern Evaluation of Facilitator Debrieļ¬ng Skills
After each case, intern learners were asked to anony-
mously evaluate the teaching effectiveness of the lead
resident facilitator using the adapted Debrieļ¬ng
Assessment for Simulation in Healthcare (DASH)
instrument.16
The DASH instrument evaluated the fol-
lowing domains: (1) instructor maintained an engag-
ing context for learning, (2) instructor structured the
debrieļ¬ng in an organized way, (3) instructor pro-
voked in-depth discussions that led me to reļ¬‚ect on
my performance, (4) instructor identiļ¬ed what I did
well or poorly and why, (5) instructor helped me see
how to improve or how to sustain good performance,
(6) overall effectiveness of the simulation session (see
Supporting Information, Appendix III, in the online
version of this article).
Post-program Intern Survey
Two months following the completion of the simula-
tion curriculum, intern learners received an anony-
mous online post-program evaluation assessing
program efļ¬cacy and resident facilitator teaching (see
Supporting Information, Appendix IV, in the online
version of this article).
Statistical Analysis
Teaching skills and learnersā€™ DASH ratings were com-
pared using the Student t test, Pearson v2
test, and
Fisher exact test as appropriate. Pre- and post-program
rating of teaching skills was undertaken in aggregate
and as a matched-pairs analysis.
The study was approved by the Partners Institu-
tional Review Board.
RESULTS
Forty-one resident facilitators participated in 118 indi-
vidual simulation sessions encompassing 236 case sce-
narios. Thirty-four residents completed the post-
program facilitator survey and were included in the
analysis. Of these, 26 (76%) participated in the
workshop and completed the pre-program survey.
Twenty-three of the 34 residents (68%) completed the
post-program evaluation nonanonymously (13 PGY-II,
10 PGY-III). Of these, 16 completed the pre-program
survey nonanonymously. The average number of ses-
sions facilitated by each resident was 3.9 (range, 1ā€“12).
Pre- and Post-program Self-Assessment of
Residentsā€™ Teaching Skills
Participation in the simulation RaT program led to
improvements in resident facilitatorsā€™ self-reported teach-
ing skills across multiple domains (Table 2). These
results were consistent when using the retrospective pre-
program assessment in matched-pairs analysis (n534)
and when performing the analysis using the true pre-pro-
gram preparedness compared to post-program comfort
with teaching skills in a non-matched-pairs fashion (n 5
26) and matched-pairs fashion (n 5 16). We report P val-
ues for the more conservative estimates using the retro-
spective pre-program assessment matched-pairs analysis.
The most signiļ¬cant improvements occurred in residentsā€™
ability to teach in a simulated environment (2.81 to 4.16,
P < 0.001 [5-point scale]) and give feedback (3.35 to
3.77, P < 0.001).
Resident facilitators reported that participation in
the RaT program had a signiļ¬cant impact on their
teaching skills both within and outside of the simula-
tion environment (Table 3). However, the greatest
TABLE 2. Pre- and Post-program Self-Assessment
of Resident Facilitators Teaching Skills*
Pre-program
Rating
(n Ā¼ 34)y
Post-program
Rating
(n Ā¼ 34)y P Value
Teaching on rounds 3.75 4.03 0.005
Teaching on wards outside rounds 3.83 4.07 0.007
Teaching in simulation 2.81 4.16 <0.001
Giving feedback 3.35 3.77 <0.001
NOTE: *Survey data were collected before participation in the workshop and 3 weeks after completion of
the 4-month curriculum. yFive-point Likert scale: very uncomfortable (1) to very comfortable (5).
Simulation Resident-as-Teacher Program | Miloslavsky et al
An Ofļ¬cial Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015 769
gains were seen in the domain of teaching in simulation.
It was also noted that participation in the program
improved resident facilitatorsā€™ medical knowledge.
Subgroup analyses were performed comparing the
perceived improvement in teaching and feedback skills
among those who did or did not attend the facilitator
workshop, those who facilitated 5 or more versus less
than 5 sessions, and those who received or did not
receive direct observation and feedback from faculty.
Although numerically greater gains were seen across
all 4 domains among those who attended the work-
shop, facilitated 5 or more sessions, or received feed-
back from faculty, only teaching on rounds and on
the wards outside rounds reached statistical signiļ¬-
cance (Table 4). It should be noted that all residents
who facilitated 5 or more sessions also attended the
workshop and received feedback from faculty. We
also compared perceived improvement among PGY-II
and PGY-III residents. In contrast to PGY-II residents,
who demonstrated an improvement in all 4 domains,
PGY-III residents only demonstrated improvement in
simulation-based teaching.
Intern Learnersā€™ Assessment of Resident
Facilitators and the Program Overall
During the course of the program, intern learners
completed 166 DASH ratings evaluating 34 resident
facilitators (see Supporting Information, Appendix V,
in the online version of this article). Ratings for the 6
DASH items ranged from 6.49 to 6.73 (7-point scale),
TABLE 3. Resident Facilitatorsā€™ Perceived Improvement in Skills Due to Resident-as-Teacher Program
Category Not at All Slightly Improved Moderately Improved Greatly Improved Not Sure
Teaching on rounds, n 5 34 4 (12%) 12 (35%) 13 (38%) 4 (12%) 1 (3%)
Teaching on wards outside rounds, n 5 34 3 (9%) 13 (38%) 12 (35%) 5 (15%) 1 (3%)
Teaching in simulation, n 5 34 0 (0%) 4 (12%) 7 (21%) 23 (68%) 0 (0%)
Giving feedback, n 5 34 4 (12%) 10 (29%) 12 (35%) 6 (18%) 2 (6%)
Medical knowledge, n 5 34 2 (6%) 11 (32%) 18 (53%) 3 (9%) 0 (0%)
TABLE 4. Pre- and Post-program Self-Assessment of Resident Facilitators Teaching Skills According to Number of
Sessions Facilitated, Workshop Attendance, Receipt of Feedback, and PGY Year
Pre-program Post-program P Value Pre-program Post-program P Value
Facilitated Less Than 5 Sessions (n Ā¼ 18) Facilitated 5 or More Sessions (n Ā¼ 11)
Teaching on rounds 3.68 3.79 0.16 3.85 4.38 0.01
Teaching on wards outside rounds 3.82 4 0.08 3.85 4.15 0.04
Teaching in simulation 2.89 4.06 <0.01 2.69 4.31 <0.01
Giving feedback 3.33 3.67 0.01 3.38 3.92 0.01
Did Not Attend Workshop (n Ā¼ 10) Attended Workshop (n Ā¼ 22)
Teaching on rounds 4 4.1 0.34 3.64 4 <0.01
Teaching on wards outside rounds 4 4 1.00 3.76 4.1 <0.01
Teaching in simulation 2.89 4.11 <0.01 2.77 4.18 <0.01
Giving feedback 3.56 3.78 0.17 3.27 3.77 <0.01
Received Feedback From Resident
Leaders Only (n Ā¼ 11) Received Faculty Feedback (n Ā¼ 21)
Teaching on rounds 3.55 3.82 0.19 3.86 4.14 0.01
Teaching on wards outside rounds 4 4 1.00 3.75 4.1 <0.01
Teaching in simulation 2.7 3.8 <0.01 2.86 4.33 <0.01
Giving feedback 3.2 3.6 0.04 3.43 3.86 <0.01
PGY-II (n Ā¼ 13) PGY-III (n Ā¼ 9)
Teaching on rounds 3.38 3.85 0.03 4.22 4.22 1
Teaching on wards outside rounds 3.54 3.85 0.04 4.14 4.14 1
Teaching in simulation 2.46 4.15 <0.01 3.13 4.13 <0.01
Giving feedback 3.23 3.62 0.02 3.5 3.88 0.08
NOTE: Abbreviations: PGY, postgraduate year.
Miloslavsky et al | Simulation Resident-as-Teacher Program
770 An Official Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015
demonstrating a high level of facilitator efļ¬cacy across
multiple domains. No differences in DASH scores
were noted among subgroups of resident facilitators
described in the previous paragraph.
Thirty-eight of 52 intern learners (73%) completed
the post-program survey.
All intern learners rated the overall simulation expe-
rience as either ā€œexcellentā€ (81%) or ā€œgoodā€ (19%)
on the post-program evaluation (4 or 5 on a 5-point
Likert scale, respectively). All interns strongly agreed
(72%) or agreed (28%) that the simulation sessions
improved their ability to manage acute clinical scenar-
ios. Interns reported that resident facilitators fre-
quently utilized speciļ¬c debrieļ¬ng techniques covered
in the RaT curriculum during the debrieļ¬ng sessions
(Table 5).
DISCUSSION
We describe a unique RaT program embedded within
a high-ļ¬delity medical simulation curriculum for IM
interns. Our study demonstrates that resident facilita-
tors noted an improvement in their teaching and feed-
back skills, both in the simulation setting and on the
wards. Intern learners rated residentsā€™ teaching skills
and the overall simulation curriculum highly, suggest-
ing that residents were effective teachers.
The use of simulation in trainee-as-teacher curricula
holds promise because it can provide an opportunity to
teach in an environment closely approximating the
wards, where trainees have the most opportunities to
teach. However, in contrast to true ward-based teach-
ing, simulation can provide predictable scenarios in a
controlled environment, which eliminates the distrac-
tions and unpredictability that exist on the wards, with-
out compromising patient safety. Recently, Toļ¬l et al.
described the ļ¬rst use of simulation in a trainee-as-
teacher program.17
The investigators utilized a
1-time simulation-based teaching session, during which
pediatric fellows completed a teacher-training work-
shop, developed and served as facilitators in a simulated
case, and received feedback. The use of simulation
allowed fellows an opportunity to apply newly acquired
skills in a controlled environment and receive feedback,
which has been shown to improve teaching skills.18
The experience from our program expands on that
of Toļ¬l et al., as well as previously described trainee-
as-teacher curricula, by introducing a component of
deliberate practice that is unique to the simulation set-
ting and has been absent from most previously
described RaT programs.3
Most residents had the
opportunity to facilitate the same case on multiple
occasions, allowing them to receive feedback and
make adjustments. Residents who facilitated 5 or
more sessions demonstrated more improvement, par-
ticularly in teaching outside of simulation, than resi-
dents who facilitated fewer sessions. It is notable that
PGY-II resident facilitators reported an improvement
in their teaching skills on the wards, though less pro-
nounced as compared to teaching in the simulation-
based environment, suggesting that beneļ¬ts of the pro-
gram may extend to nonā€“simulation-based settings.
Additional studies focusing on objective evaluation of
ward-based teaching are needed to further explore
this phenomenon. Finally, the self-reported improve-
ments in medical knowledge by resident facilitators
may serve as another beneļ¬t of our program.
Analysis of learner-level data collected in the post-
curriculum intern survey and DASH ratings provides
additional support for the effectiveness of the RaT
program. The majority of intern learners reported that
resident facilitators used the techniques covered in our
program frequently during debrieļ¬ngs. In addition,
DASH scores clustered around maximum efļ¬cacy for
all facilitators, suggesting that residents were effective
teachers. Although we cannot directly assess whether
the differences demonstrated in resident facilitatorsā€™
self-assessments translated to their teaching or were
signiļ¬cant from the learnersā€™ perspective, these results
support the hypothesis that self-assessed improve-
ments in teaching and feedback skills were signiļ¬cant.
In addition to improving resident teaching skills,
our program had a positive impact on intern learners
as evidenced by intern evaluations of the simulation
curriculum. While utilizing relatively few faculty
resources, our program was able to deliver an exten-
sive and well-received simulation curriculum to over
50 interns. The fact that 40% of second- and third-
year residents volunteered to teach in the program
despite the early morning timing of the sessions speaks
to the interest that trainees have in teaching in this
setting. This model can serve as an important and efļ¬-
cient learning platform in residency training programs.
It may be particularly salient to IM training programs
where implementation of simulation curricula is chal-
lenging due to large numbers of residents and limited
faculty resources. The barriers to and lessons learned
from our experience with implementing the simulation
curriculum have been previously described.10,11
TABLE 5. Resident Facilitatorsā€™ Use of Speciļ¬c Teaching Skills During Debrieļ¬ng as Rated by Intern Learners
Facilitator Behaviors Very Often, >75% Often, >50% Sometimes, 25%ā€“50% Rarely, <25% Never
Elicited emotional reactions, n 5 38 18 (47%) 16 (42%) 4 (11%) 0 (0%) 0 (0%)
Elicited objectives from learner, n 5 37 26 (69%) 8 (22%) 2 (6%) 1 (3%) 0 (0%)
Asked to share clinical reasoning, n 5 38 21 (56%) 13 (33%) 4 (11%) 0 (0%) 0 (0%)
Summarized learning points, n 5 38 31 (81%) 7 (19%) 0 (0%) 0 (0%) 0 (0%)
Spoke for less than half of the session, n 5 38 8 (22%) 17 (44%) 11 (28%) 2 (6%) 0 (0%)
Simulation Resident-as-Teacher Program | Miloslavsky et al
An Ofļ¬cial Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015 771
Our study has several limitations. Changes in resi-
dentsā€™ teaching skills were self-assessed, which may be
inaccurate as learners may overestimate their abilities.19
Although we collected data on the experiences of intern
learners that supported residentsā€™ self-assessment, fur-
ther studies using more objective measures (such as the
Objective Structured Teaching Exercise20
) should be
undertaken. We did not objectively assess improvement
of residentsā€™ teaching skills on the wards, with the
exception of the residentsā€™ self assessment. Due to the
timing of survey administration, some residents had as
little as 1 month between completion of the curriculum
and responding to the post-curriculum survey, limiting
their ability to evaluate their teaching skills on the
wards. The transferability of the skills gained in
simulation-based teaching to teaching on the wards
deserves further study. We cannot deļ¬nitively attribute
perceived improvement of teaching skills to the RaT
program without a control group. However, the fre-
quent use of recommended techniques during debrief-
ing, which are not typically taught in other settings,
supports the efļ¬cacy of the RaT program.
Our study did not allow us to determine which of
the 3 components of the RaT program (workshop,
facilitation practice, or direct observation and feed-
back) had the greatest impact on teaching skills or
DASH ratings, as those who facilitated more sessions
also completed the other components of the program.
Furthermore, there may have been a selection bias
among facilitators who facilitated more sessions.
Because only 16 of 34 participants completed both the
pre-program and post-program self-assessments in a
non-anonymous fashion, we were not able to analyze
the effect of pre-program factors, such as prior teach-
ing experience, on program outcomes. It should also be
noted that allowing resident facilitators the option to
complete the survey non-anonymously could have
biased our results. The simulation curriculum was con-
ducted in a single center, and resident facilitators were
self-selecting; therefore, our results may not be general-
izable. Finally, the DASH instrument was only admin-
istered after the RaT workshop and was likely limited
further by the ceiling effect created by the learnersā€™
high satisfaction with the simulation program overall.
In summary, our simulation-based RaT program
improved resident facilitatorsā€™ self-reported teaching
and feedback skills. Simulation-based training pro-
vided an opportunity for deliberate practice of teach-
ing skills in a controlled environment, which was a
unique component of the program. The impact of
deliberate practice on resident teaching skills and opti-
mal methods to incorporate deliberate practice in RaT
programs deserves further study. Our curriculum
design may serve as a model for the development of
simulation programs that can be employed to improve
both intern learning and resident teaching skills.
Acknowledgements
The authors acknowledge Deborah Navedo, PhD, Assistant Professor,
Massachusetts General Hospital Institute of Health Professions, and
Emily M. Hayden, MD, Assistant Professor, Department of Emergency
Medicine, Massachusetts General Hospital and Harvard Medical School,
for their assistance with development of the RaT curriculum. The
authors thank Dr. Jenny Rudolph, Senior Director, Institute for Medical
Simulation at the Center for Medical Simulation, for her help in teach-
ing us to use the DASH instrument. The authors also thank Dr. Daniel
Hunt, MD, Associate Professor, Department of Medicine, Massachusetts
General Hospital and Harvard Medical School, for his thoughtful review
of this manuscript.
Disclosure: Nothing to report.
References
1. Liaison Committee on Medical Education. Functions and structure of
a medical school: standards for accreditation of medical education
programs leading to the M.D. degree. Washington, DC, and Chicago,
IL: Association of American Medical Colleges and American Medical
Association; 2000.
2. Accreditation Council for Graduate Medical Education. ACGME pro-
gram requirements for graduate medical education in pediatrics.
Available at: http://www.acgme.org/acgmeweb/Portals/0/PFAssets/
2013-PR-FAQ-PIF/320_pediatrics_07012013.pdf. Accessed June 18,
2014.
3. Hill AG, Yu TC, Barrow M, Hattie J. A systematic review of resident-
as-teacher programmes. Med Educ. 2009;43(12):1129ā€“1140.
4. Okuda Y, Bryson EO, DeMaria S Jr, et al. The utility of simulation in
medical education: what is the evidence? Mt Sinai J Med. 2009;76:
330ā€“343.
5. Okuda Y, Bond WF, Bonfante G, et al. National growth in simulation
training within emergency medicine residency programs, 2003ā€“2008.
Acad Emerg Med. 2008;15:1113ā€“1116.
6. Fernandez R, Wang E, Vozenilek JA, et al. Simulation center accredi-
tation and programmatic benchmarks: a review for emergency medi-
cine. Acad Emerg Med. 2010;17(10):1093ā€“1103.
7. Cook DA. How much evidence does it take? A cumulative meta-
analysis of outcomes of simulation-based education. Med Educ. 2014;
48(8):750ā€“760.
8. Farrell SE, Pacella C, Egan D, et al.. Resident-as-teacher: a suggested
curriculum for emergency medicine. Acad Emerg Med. 2006;13(6):
677ā€“679.
9. Ericsson KA. Deliberate practice and the acquisition and maintenance
of expert performance in medicine and related domains. Acad Med.
2004;79(10 suppl):S70ā€“S81.
10. Miloslavsky EM, Hayden EM, Currier PF, Mathai SK, Contreras-
Valdes F, Gordon JA. Pilot program utilizing medical simulation in
clinical decision making training for internal medicine interns. J Grad
Med Educ. 2012;4:490ā€“495.
11. Mathai SK, Miloslavsky EM, Contreras-Valdes FM, et al. How we
implemented a resident-led medical simulation curriculum in a large
internal medicine residency program. Med Teach. 2014;36(4):279ā€“
283.
12. Rudolph JW, Simon R, Dufresne RL, Raemer DB. Thereā€™s no such
thing as ā€œnonjudgmentalā€ debrieļ¬ng: a theory and method for
debrieļ¬ng with good judgment. Simul Healthc. 2006;1:49ā€“55.
13. Minehart RD, Rudolph JW, Pian-Smith MCM, Raemer DB. Improv-
ing faculty feedback to resident trainees during a simulated case: a
randomized, controlled trial of an educational intervention. Anesthesi-
ology. 2014;120(1):160ā€“171.
14. Gardner R. Introduction to debrieļ¬ng. Semin Perinatol. 2013:
37(3)166ā€“174.
15. Howard G, Dailey PR. Response-shift bias: a source of contamination
of self-report measures. J Appl Psychol. 1979;4:93ā€“106.
16. Center for Medical Simulation. Debrieļ¬ng assessment for simulation in
healthcare. Available at: http://www.harvardmedsim.org/debrieļ¬ng-
assesment-simulation-healthcare.php. Accessed June 18, 2014.
17. Toļ¬l NM, Peterson DT, Harrington KF, et al. A novel iterative-
learner simulation model: fellows as teachers. J Grad Med Educ.
2014;6(1):127ā€“132.
18. Regan-Smith M, Hirschmann K, Iobst W. Direct observation of fac-
ulty with feedback: an effective means of improving patient-centered
and learner-centered teaching skills. Teach Learn Med. 2007;19(3):
278ā€“286.
19. Kruger J, Dunning D. Unskilled and unaware of it: how difļ¬culties in
recognizing oneā€™s own incompetence lead to inļ¬‚ated self assessments.
J Pers Soc Psychol. 1999;77:1121ā€“1134.
20. Morrison EH, Boker JR, Hollingshead J, et al. Reliability and validity
of an objective structured teaching examination for generalist resident
teachers. Acad Med. 2002;77(10 suppl):S29ā€“S32.
Miloslavsky et al | Simulation Resident-as-Teacher Program
772 An Official Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015

More Related Content

What's hot

Practicum Evaluation Paper-Riverpoint Writer
Practicum Evaluation Paper-Riverpoint WriterPracticum Evaluation Paper-Riverpoint Writer
Practicum Evaluation Paper-Riverpoint WriterLydia (Lydge) Veluz Reyes
Ā 
CPRG CSM 2015 Gahimer
CPRG CSM 2015 GahimerCPRG CSM 2015 Gahimer
CPRG CSM 2015 GahimerJulie Gahimer
Ā 
Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...
Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...
Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...Jenny Christner
Ā 
Clinical Nursing Education Redesign
Clinical Nursing Education Redesign Clinical Nursing Education Redesign
Clinical Nursing Education Redesign niederha
Ā 
MSSP-6-25-2012_Final_Summary_Report
MSSP-6-25-2012_Final_Summary_ReportMSSP-6-25-2012_Final_Summary_Report
MSSP-6-25-2012_Final_Summary_ReportDavid Anthony Lewis
Ā 
ITOSCE Poster Presentation 2014 Midyear
ITOSCE Poster Presentation 2014 MidyearITOSCE Poster Presentation 2014 Midyear
ITOSCE Poster Presentation 2014 MidyearLinda (Cari) Chestnut
Ā 
NAAHP Poster 2016_Hutchens&Matzko
NAAHP Poster 2016_Hutchens&MatzkoNAAHP Poster 2016_Hutchens&Matzko
NAAHP Poster 2016_Hutchens&MatzkoJessica Matzko
Ā 
Clinicalteachingmethodsusedinnursing 160702182508-converted
Clinicalteachingmethodsusedinnursing 160702182508-convertedClinicalteachingmethodsusedinnursing 160702182508-converted
Clinicalteachingmethodsusedinnursing 160702182508-convertedLalitaSharma39
Ā 
PhD_Dissertation_Long
PhD_Dissertation_LongPhD_Dissertation_Long
PhD_Dissertation_LongTracey Long
Ā 
Community Health Nursing Syllabus-sample
Community Health Nursing Syllabus-sampleCommunity Health Nursing Syllabus-sample
Community Health Nursing Syllabus-sampleYisehak Tura
Ā 
Newer Methods of Assessment in Medical Education
Newer Methods of Assessment in  Medical EducationNewer Methods of Assessment in  Medical Education
Newer Methods of Assessment in Medical EducationSwati Deshpande
Ā 
Rti academic-intervention-pyramid-tier-1-2-3
Rti academic-intervention-pyramid-tier-1-2-3Rti academic-intervention-pyramid-tier-1-2-3
Rti academic-intervention-pyramid-tier-1-2-3Reedheiress
Ā 
Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...
Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...
Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...iosrjce
Ā 
Psychological science in the public interest 2013-dunlosky-4-58
Psychological science in the public interest 2013-dunlosky-4-58Psychological science in the public interest 2013-dunlosky-4-58
Psychological science in the public interest 2013-dunlosky-4-58Sven Wassenaar
Ā 
Planning
PlanningPlanning
Planningahmed-mala
Ā 
Response to Intervention: What is it?
Response to Intervention: What is it?Response to Intervention: What is it?
Response to Intervention: What is it?paulaulloa671
Ā 
Response to Intervention: A Component in a Novel Educational Service Delivery...
Response to Intervention: A Component in a Novel Educational Service Delivery...Response to Intervention: A Component in a Novel Educational Service Delivery...
Response to Intervention: A Component in a Novel Educational Service Delivery...schoolpsychology
Ā 

What's hot (20)

Practicum Evaluation Paper-Riverpoint Writer
Practicum Evaluation Paper-Riverpoint WriterPracticum Evaluation Paper-Riverpoint Writer
Practicum Evaluation Paper-Riverpoint Writer
Ā 
CPRG CSM 2015 Gahimer
CPRG CSM 2015 GahimerCPRG CSM 2015 Gahimer
CPRG CSM 2015 Gahimer
Ā 
Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...
Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...
Christner.Long-TermGainAfterTeam-BasedLearningExp.TeachingAndLearningInMedici...
Ā 
Austin Journal of Anatomy
Austin Journal of AnatomyAustin Journal of Anatomy
Austin Journal of Anatomy
Ā 
Training for nurses working in teaching district hospital
Training for nurses working in teaching district hospitalTraining for nurses working in teaching district hospital
Training for nurses working in teaching district hospital
Ā 
Clinical Nursing Education Redesign
Clinical Nursing Education Redesign Clinical Nursing Education Redesign
Clinical Nursing Education Redesign
Ā 
Transforming Counseling Pedagogy with Horticulture Therapy Techniques
Transforming Counseling Pedagogy with Horticulture Therapy TechniquesTransforming Counseling Pedagogy with Horticulture Therapy Techniques
Transforming Counseling Pedagogy with Horticulture Therapy Techniques
Ā 
MSSP-6-25-2012_Final_Summary_Report
MSSP-6-25-2012_Final_Summary_ReportMSSP-6-25-2012_Final_Summary_Report
MSSP-6-25-2012_Final_Summary_Report
Ā 
ITOSCE Poster Presentation 2014 Midyear
ITOSCE Poster Presentation 2014 MidyearITOSCE Poster Presentation 2014 Midyear
ITOSCE Poster Presentation 2014 Midyear
Ā 
NAAHP Poster 2016_Hutchens&Matzko
NAAHP Poster 2016_Hutchens&MatzkoNAAHP Poster 2016_Hutchens&Matzko
NAAHP Poster 2016_Hutchens&Matzko
Ā 
Clinicalteachingmethodsusedinnursing 160702182508-converted
Clinicalteachingmethodsusedinnursing 160702182508-convertedClinicalteachingmethodsusedinnursing 160702182508-converted
Clinicalteachingmethodsusedinnursing 160702182508-converted
Ā 
PhD_Dissertation_Long
PhD_Dissertation_LongPhD_Dissertation_Long
PhD_Dissertation_Long
Ā 
Community Health Nursing Syllabus-sample
Community Health Nursing Syllabus-sampleCommunity Health Nursing Syllabus-sample
Community Health Nursing Syllabus-sample
Ā 
Newer Methods of Assessment in Medical Education
Newer Methods of Assessment in  Medical EducationNewer Methods of Assessment in  Medical Education
Newer Methods of Assessment in Medical Education
Ā 
Rti academic-intervention-pyramid-tier-1-2-3
Rti academic-intervention-pyramid-tier-1-2-3Rti academic-intervention-pyramid-tier-1-2-3
Rti academic-intervention-pyramid-tier-1-2-3
Ā 
Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...
Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...
Assessmentof Nursing Studentsā€™ Attitude toward Learning Communication Skills ...
Ā 
Psychological science in the public interest 2013-dunlosky-4-58
Psychological science in the public interest 2013-dunlosky-4-58Psychological science in the public interest 2013-dunlosky-4-58
Psychological science in the public interest 2013-dunlosky-4-58
Ā 
Planning
PlanningPlanning
Planning
Ā 
Response to Intervention: What is it?
Response to Intervention: What is it?Response to Intervention: What is it?
Response to Intervention: What is it?
Ā 
Response to Intervention: A Component in a Novel Educational Service Delivery...
Response to Intervention: A Component in a Novel Educational Service Delivery...Response to Intervention: A Component in a Novel Educational Service Delivery...
Response to Intervention: A Component in a Novel Educational Service Delivery...
Ā 

Similar to Jhm2423

An Intervention To Improve Respiratory Therapists Comfort With End-Of-Life Care
An Intervention To Improve Respiratory Therapists  Comfort With End-Of-Life CareAn Intervention To Improve Respiratory Therapists  Comfort With End-Of-Life Care
An Intervention To Improve Respiratory Therapists Comfort With End-Of-Life CareBrooke Heidt
Ā 
9th Annual William Davidson Medical Education Week
9th Annual William Davidson Medical Education Week9th Annual William Davidson Medical Education Week
9th Annual William Davidson Medical Education WeekOUWBEngagement
Ā 
Heart failure resources
Heart failure resourcesHeart failure resources
Heart failure resourcesRyan Squire
Ā 
SAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docx
SAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docxSAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docx
SAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docxrtodd599
Ā 
Poster - Billy Bryan1
Poster - Billy Bryan1Poster - Billy Bryan1
Poster - Billy Bryan1Billy Bryan
Ā 
Clinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdf
Clinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdfClinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdf
Clinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdfbkbk37
Ā 
1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and l1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and lVivan17
Ā 
Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...
Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...
Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...marcuskenyatta275
Ā 
Ueda2015 tupelo.nurses role in dm prevention dr.martyn molnar
Ueda2015 tupelo.nurses role in dm prevention dr.martyn molnarUeda2015 tupelo.nurses role in dm prevention dr.martyn molnar
Ueda2015 tupelo.nurses role in dm prevention dr.martyn molnarueda2015
Ā 
The Cardiac Progressive Care Unit Essay.pdf
The Cardiac Progressive Care Unit Essay.pdfThe Cardiac Progressive Care Unit Essay.pdf
The Cardiac Progressive Care Unit Essay.pdfsdfghj21
Ā 
Unit I. Introduction to Nursing Research.pptx
Unit I. Introduction to Nursing Research.pptxUnit I. Introduction to Nursing Research.pptx
Unit I. Introduction to Nursing Research.pptxshakirRahman10
Ā 
Interprofessional Simulation: An Effective Training Experience for Health Car...
Interprofessional Simulation: An Effective Training Experience for Health Car...Interprofessional Simulation: An Effective Training Experience for Health Car...
Interprofessional Simulation: An Effective Training Experience for Health Car...Dan Belford
Ā 
Dr. Ameri and class,After reflecting over the course of Advanced.docx
Dr. Ameri and class,After reflecting over the course of Advanced.docxDr. Ameri and class,After reflecting over the course of Advanced.docx
Dr. Ameri and class,After reflecting over the course of Advanced.docxmadlynplamondon
Ā 
Pilot Study Publication (in press)
Pilot Study Publication (in press)Pilot Study Publication (in press)
Pilot Study Publication (in press)naomi tutticci
Ā 
Research.docx
Research.docxResearch.docx
Research.docxsheeba307290
Ā 
Portfolio My class is NURSING RESEARCH 28358.pdf
Portfolio My class is NURSING RESEARCH 28358.pdfPortfolio My class is NURSING RESEARCH 28358.pdf
Portfolio My class is NURSING RESEARCH 28358.pdfsdfghj21
Ā 
Practicum Evaluation Summary Essay.docx
Practicum Evaluation Summary Essay.docxPracticum Evaluation Summary Essay.docx
Practicum Evaluation Summary Essay.docxstudywriters
Ā 

Similar to Jhm2423 (20)

An Intervention To Improve Respiratory Therapists Comfort With End-Of-Life Care
An Intervention To Improve Respiratory Therapists  Comfort With End-Of-Life CareAn Intervention To Improve Respiratory Therapists  Comfort With End-Of-Life Care
An Intervention To Improve Respiratory Therapists Comfort With End-Of-Life Care
Ā 
9th Annual William Davidson Medical Education Week
9th Annual William Davidson Medical Education Week9th Annual William Davidson Medical Education Week
9th Annual William Davidson Medical Education Week
Ā 
Zabar final report cg
Zabar final report cgZabar final report cg
Zabar final report cg
Ā 
Heart failure resources
Heart failure resourcesHeart failure resources
Heart failure resources
Ā 
SAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docx
SAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docxSAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docx
SAAD COLLEGE OF NURSING AND ALLIED HEALTH SCIENCESUNIVERSI.docx
Ā 
Poster - Billy Bryan1
Poster - Billy Bryan1Poster - Billy Bryan1
Poster - Billy Bryan1
Ā 
Clinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdf
Clinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdfClinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdf
Clinical Practicum CPCU at Tanner Medical Center Reflection Paper.pdf
Ā 
1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and l1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and l
Ā 
Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...
Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...
Test Bank for Fundamentals of Nursing, 3rd Edition by Barbara L Yoost Chapter...
Ā 
Ueda2015 tupelo.nurses role in dm prevention dr.martyn molnar
Ueda2015 tupelo.nurses role in dm prevention dr.martyn molnarUeda2015 tupelo.nurses role in dm prevention dr.martyn molnar
Ueda2015 tupelo.nurses role in dm prevention dr.martyn molnar
Ā 
2005 2008
2005 20082005 2008
2005 2008
Ā 
The Cardiac Progressive Care Unit Essay.pdf
The Cardiac Progressive Care Unit Essay.pdfThe Cardiac Progressive Care Unit Essay.pdf
The Cardiac Progressive Care Unit Essay.pdf
Ā 
Unit I. Introduction to Nursing Research.pptx
Unit I. Introduction to Nursing Research.pptxUnit I. Introduction to Nursing Research.pptx
Unit I. Introduction to Nursing Research.pptx
Ā 
Interprofessional Simulation: An Effective Training Experience for Health Car...
Interprofessional Simulation: An Effective Training Experience for Health Car...Interprofessional Simulation: An Effective Training Experience for Health Car...
Interprofessional Simulation: An Effective Training Experience for Health Car...
Ā 
Dr. Ameri and class,After reflecting over the course of Advanced.docx
Dr. Ameri and class,After reflecting over the course of Advanced.docxDr. Ameri and class,After reflecting over the course of Advanced.docx
Dr. Ameri and class,After reflecting over the course of Advanced.docx
Ā 
Pilot Study Publication (in press)
Pilot Study Publication (in press)Pilot Study Publication (in press)
Pilot Study Publication (in press)
Ā 
Cgp final analysis '08 '09
Cgp final analysis '08 '09Cgp final analysis '08 '09
Cgp final analysis '08 '09
Ā 
Research.docx
Research.docxResearch.docx
Research.docx
Ā 
Portfolio My class is NURSING RESEARCH 28358.pdf
Portfolio My class is NURSING RESEARCH 28358.pdfPortfolio My class is NURSING RESEARCH 28358.pdf
Portfolio My class is NURSING RESEARCH 28358.pdf
Ā 
Practicum Evaluation Summary Essay.docx
Practicum Evaluation Summary Essay.docxPracticum Evaluation Summary Essay.docx
Practicum Evaluation Summary Essay.docx
Ā 

Recently uploaded

DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
Ā 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxEyham Joco
Ā 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
Ā 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
Ā 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
Ā 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
Ā 
History Class XII Ch. 3 Kinship, Caste and Class (1).pptx
History Class XII Ch. 3 Kinship, Caste and Class (1).pptxHistory Class XII Ch. 3 Kinship, Caste and Class (1).pptx
History Class XII Ch. 3 Kinship, Caste and Class (1).pptxsocialsciencegdgrohi
Ā 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
Ā 
internship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerinternship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerunnathinaik
Ā 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
Ā 
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļøcall girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø9953056974 Low Rate Call Girls In Saket, Delhi NCR
Ā 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
Ā 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
Ā 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
Ā 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
Ā 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
Ā 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
Ā 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
Ā 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxAvyJaneVismanos
Ā 

Recently uploaded (20)

DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
Ā 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptx
Ā 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
Ā 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
Ā 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
Ā 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
Ā 
History Class XII Ch. 3 Kinship, Caste and Class (1).pptx
History Class XII Ch. 3 Kinship, Caste and Class (1).pptxHistory Class XII Ch. 3 Kinship, Caste and Class (1).pptx
History Class XII Ch. 3 Kinship, Caste and Class (1).pptx
Ā 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
Ā 
internship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerinternship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developer
Ā 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Ā 
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļøcall girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
Ā 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
Ā 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
Ā 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
Ā 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Ā 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
Ā 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
Ā 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
Ā 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
Ā 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptx
Ā 

Jhm2423

  • 1. ORIGINAL RESEARCH A Simulation-Based Resident-as-Teacher Program: The Impact on Teachers and Learners Eli M. Miloslavsky, MD1 *, Zaven Sargsyan, MD2 , Janae K. Heath, MD1 , Rachel Kohn, MD3 , George A. Alba, MD1 , James A. Gordon, MD, MPA4 , Paul F. Currier, MD1 1 Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts; 2 Department of Medicine, Baylor College of Medicine, Houston, Texas; 3 Department of Medicine, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania; 4 Department of Emergency Medicine, Massachusetts General Hospital, Boston, Massachusetts. BACKGROUND: Residency training is charged with improv- ing resident teaching skills. Utilizing simulation in teacher training has unique advantages such as providing a con- trolled learning environment and opportunities for deliberate practice. OBJECTIVE: We assessed the impact of a simulation- based resident-as-teacher (RaT) program. DESIGN: A RaT program was embedded in an existing 8- case simulation curriculum for 52 internal medicine (IM) interns. Residents participated in a workshop, then served as facilitators in the curriculum and received feedback from faculty. METHODS: Residentsā€™ teaching and feed back skills were measured using a pre- and post-program self-assessment and post-session and post-curriculum evaluations by intern learners. SETTING/PARTICIPANTS: Forty-one second- and third- year residents participated in the study August 2013 to October 2013 at a single center. RESULTS: Pre- and post-program teaching skills were assessed for 34 of 41 resident facilitators (83%) participat- ing in 3.9 sessions on average. Partaking in the program led to improvements in resident facilitatorsā€™ self-reported teach- ing and feedback skills across all domains. The most signiļ¬- cant improvement was in teaching in a simulated environment (2.81 to 4.16, P < 0.001). Interns rated the cur- riculum highly (81% ā€œexcellent,ā€ 19% ā€œgoodā€) and reported that resident facilitators frequently utilized debrieļ¬ng techni- ques covered in the RaT program. CONCLUSIONS: Our simulation-based RaT program offered a unique opportunity for deliberate practice of teaching skills in a controlled environment and led to improvements in resi- dent facilitatorsā€™ teaching and feed back skills. The simulation curriculum, facilitated by residents, was well received by the intern learners. Our program design may serve as a model for the development of simulation curricula and RaT programs within IM residencies. Journal of Hospital Medicine 2015;10:767ā€“772. VC 2015 Society of Hospital Medicine Residency training, in addition to developing clinical competence among trainees, is charged with improving resident teaching skills. The Liaison Committee on Medi- cal Education and the Accreditation Council for Gradu- ate Medical Education require that residents be provided with training or resources to develop their teaching skills.1,2 A variety of resident-as-teacher (RaT) programs have been described; however, the optimal format of such programs remains in question.3 High-ļ¬delity medi- cal simulation using mannequins has been shown to be an effective teaching tool in various medical specialties4ā€“7 and may prove to be useful in teacher training.8 Teaching in a simulation-based environment can give participants the opportunity to apply their teaching skills in a clinical environment, as they would on the wards, but in a more controlled, predictable setting and without compromising patient safety. In addition, simulation offers the opportu- nity to engage in deliberate practice by allowing teachers to facilitate the same case on multiple occasions with dif- ferent learners. Deliberate practice, which involves task repetition with feedback aimed at improving perform- ance, has been shown to be important in developing expertise.9 We previously described the ļ¬rst use of a high- ļ¬delity simulation curriculum for internal medicine (IM) interns focused on clinical decision-making skills, in which second- and third-year residents served as facilitators.10,11 Herein, we describe a RaT program in which residents participated in a workshop, then served as facilitators in the intern curriculum and received feedback from faculty. We hypothesized that such a program would improve residentsā€™ teaching and feedback skills, both in the simulation environ- ment and on the wards. METHODS We conducted a single-group study evaluating teach- ing and feedback skills among upper-level resident facilitators before and after participation in the RaT program. We measured residentsā€™ teaching skills using *Address for correspondence and reprint requests: Eli M. Miloslavsky, MD, Massachusetts General Hospital, 55 Fruit St., Suite 2C, Boston, MA 02114; Telephone: 617-726-7938; Fax: 617-643-1274; E-mail: emiloslavsky@mgh.harvard.edu Additional Supporting Information may be found in the online version of this article. Received: March 1, 2015; Revised: May 14, 2015; Accepted: June 10, 2015 2015 Society of Hospital Medicine DOI 10.1002/jhm.2423 Published online in Wiley Online Library (Wileyonlinelibrary.com). An Ofļ¬cial Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015 767
  • 2. pre- and post-program self-assessments as well as eval- uations completed by the intern learners after each session and at the completion of the curriculum. Setting and Participants We embedded the RaT program within a simulation curriculum administered July to October of 2013 for all IM interns at Massachusetts General Hospital (interns in the ā€œpreliminaryā€ program who planned to pursue another ļ¬eld after the completion of the intern year were excluded) (n 5 52). We invited postgradu- ate year (PGY) II and III residents (n 5 102) to partic- ipate in the IM simulation program as facilitators via email. The curriculum consisted of 8 cases focusing on acute clinical scenarios encountered on the general medicine wards. The cases were administered during 1-hour sessions 4 mornings per week from 7 AM to 8 AM prior to clinical duties. Interns completed the cur- riculum over 4 sessions during their outpatient rota- tion. The case topics were (1) hypertensive emergency, (2) post-procedure bleed, (3) congestive heart failure, (4) atrial ļ¬brillation with rapid ventricular response, (5) altered mental status/alcohol withdrawal, (6) non- sustained ventricular tachycardia heralding acute coro- nary syndrome, (7) cardiac tamponade, and (8) anaphylaxis. During each session, groups of 2 to 3 interns worked through 2 cases using a high-ļ¬delity mannequin (Laerdal 3G, Wappingers Falls, NY) with 2 resident facilitators. One facilitator operated the mannequin, while the other served as a nurse. Each case was followed by a structured debrieļ¬ng led by 1 of the resident facilitators (facilitators switched roles for the second case). The number of sessions facili- tated varied for each resident based on individual schedules and preferences. Four senior residents who were appointed as simulation leaders (G.A.A., J.K.H., R.K., Z.S.) and 2 faculty advisors (P.F.C., E.M.M.) administered the program. Simulation resident leaders scheduled facili- tators and interns and participated in a portion of simulation sessions as facilitators, but they were not analyzed as participants for the purposes of this study. The curriculum was administered without interfering with clinical duties, and no additional time was pro- tected for interns or residents participating in the curriculum. Resident-as-Teacher Program Structure We invited participating resident facilitators to attend a 1-hour interactive workshop prior to serving as facilitators. The workshop focused on building learner-centered and small-group teaching skills, as well as introducing residents to a 5-stage debrieļ¬ng framework developed by the authors and based on simulation debrieļ¬ng best practices (Table 1).12ā€“14 Resident facilitators were observed by simulation faculty and simulation resident leaders throughout the intern curriculum and given structured feedback either in-person immediately after completion of the simula- tion session or via a detailed same-day e-mail if the time allotted for feedback was not sufļ¬cient. Feedback was structured by the 5 stages of debrieļ¬ng described in Table 1, and included soliciting residentsā€™ observa- tions on the teaching experience and speciļ¬c behaviors observed by faculty during the scenarios. E-mail feed- back (also structured by stages of debrieļ¬ng and including observed behaviors) was typically followed by verbal feedback during the next simulation session. The RaT program was composed of 3 elements: the workshop, case facilitation, and direct observation with feedback. Because we felt that the opportunity for directly observed teaching and feedback in a ā€œward-likeā€ controlled environment was a unique advantage offered by the simulation setting, we included all residents who served as facilitators in the TABLE 1. Stages of Debrieļ¬ng12ā€“14 Stage of Debrieļ¬ng Action Rationale Emotional response Elicit learnersā€™ emotions about the case It is important to acknowledge and address both positive and negative emotions that arise during the case before debrieļ¬ng the speciļ¬c medical and communications aspects of the case. Unaddressed emotional responses may hinder subsequent debrieļ¬ng. Objectives* Elicit learnersā€™ objectives and combine them with the stated learning objectives of the case to determine debrieļ¬ng objectives The limited amount of time allocated for debrieļ¬ng (15ā€“20 minutes) does not allow the facili- tator to cover all aspects of medical management and communication skills in a particular case. Focusing on the most salient objectives, including those identiļ¬ed by the learners, allows the facilitator to engage in learner-centered debrieļ¬ng. Analysis Analyze the learnersā€™ approach to the case Analyzing the learnersā€™ approach to the case using the advocacy-inquiry method11 seeks to uncover the learnerā€™s assumptions/frameworks behind the decision made during the case. This approach allows the facilitator to understand the learnersā€™ thought process and target teaching points to more precisely address the learnersā€™ needs. Teaching Address knowledge gaps and incorrect assumptions Learner-centered debrieļ¬ng within a limited timeframe requires teaching to be brief and tar- geted toward the deļ¬ned objectives. It should also address the knowledge gaps and incor- rect assumptions uncovered during the analysis phase. Summary Summarize key takeaways Summarizing highlights the key points of the debrieļ¬ng and can be used to suggest further exploration of topics through self-study (if necessary). NOTE: *To standardize the learner experience, all interns received an e-mail after each session describing the key learning objectives and takeaway points with references from the medical literature for each case. Miloslavsky et al | Simulation Resident-as-Teacher Program 768 An Official Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015
  • 3. analysis, regardless of whether or not they had attended the workshop. Evaluation Instruments Survey instruments were developed by the investiga- tors, reviewed by several experts in simulation, pilot tested among residents not participating in the simula- tion program, and revised by the investigators. Pre-program Facilitator Survey Prior to the RaT workshop, resident facilitators com- pleted a baseline survey evaluating their preparedness to teach and give feedback on the wards and in a simulation-based setting on a 5-point scale (see Sup- porting Information, Appendix I, in the online version of this article). Post-program Facilitator Survey Approximately 3 weeks after completion of the intern simulation curriculum, resident facilitators were asked to complete an online post-program survey, which remained open for 1 month (residents completed this survey anywhere from 3 weeks to 4 months after their participation in the RaT program depending on the timing of their facilitation). The survey asked residents to evaluate their comfort with their current post-pro- gram teaching skills as well as their pre-program skills in retrospect, as previous research demonstrated that learners may overestimate their skills prior to training programs.15 Resident facilitators could complete the surveys nonanonymously to allow for matched-pairs analysis of the change in teaching skills over the course of the program (see Supporting Information, Appendix II, in the online version of this article). Intern Evaluation of Facilitator Debrieļ¬ng Skills After each case, intern learners were asked to anony- mously evaluate the teaching effectiveness of the lead resident facilitator using the adapted Debrieļ¬ng Assessment for Simulation in Healthcare (DASH) instrument.16 The DASH instrument evaluated the fol- lowing domains: (1) instructor maintained an engag- ing context for learning, (2) instructor structured the debrieļ¬ng in an organized way, (3) instructor pro- voked in-depth discussions that led me to reļ¬‚ect on my performance, (4) instructor identiļ¬ed what I did well or poorly and why, (5) instructor helped me see how to improve or how to sustain good performance, (6) overall effectiveness of the simulation session (see Supporting Information, Appendix III, in the online version of this article). Post-program Intern Survey Two months following the completion of the simula- tion curriculum, intern learners received an anony- mous online post-program evaluation assessing program efļ¬cacy and resident facilitator teaching (see Supporting Information, Appendix IV, in the online version of this article). Statistical Analysis Teaching skills and learnersā€™ DASH ratings were com- pared using the Student t test, Pearson v2 test, and Fisher exact test as appropriate. Pre- and post-program rating of teaching skills was undertaken in aggregate and as a matched-pairs analysis. The study was approved by the Partners Institu- tional Review Board. RESULTS Forty-one resident facilitators participated in 118 indi- vidual simulation sessions encompassing 236 case sce- narios. Thirty-four residents completed the post- program facilitator survey and were included in the analysis. Of these, 26 (76%) participated in the workshop and completed the pre-program survey. Twenty-three of the 34 residents (68%) completed the post-program evaluation nonanonymously (13 PGY-II, 10 PGY-III). Of these, 16 completed the pre-program survey nonanonymously. The average number of ses- sions facilitated by each resident was 3.9 (range, 1ā€“12). Pre- and Post-program Self-Assessment of Residentsā€™ Teaching Skills Participation in the simulation RaT program led to improvements in resident facilitatorsā€™ self-reported teach- ing skills across multiple domains (Table 2). These results were consistent when using the retrospective pre- program assessment in matched-pairs analysis (n534) and when performing the analysis using the true pre-pro- gram preparedness compared to post-program comfort with teaching skills in a non-matched-pairs fashion (n 5 26) and matched-pairs fashion (n 5 16). We report P val- ues for the more conservative estimates using the retro- spective pre-program assessment matched-pairs analysis. The most signiļ¬cant improvements occurred in residentsā€™ ability to teach in a simulated environment (2.81 to 4.16, P < 0.001 [5-point scale]) and give feedback (3.35 to 3.77, P < 0.001). Resident facilitators reported that participation in the RaT program had a signiļ¬cant impact on their teaching skills both within and outside of the simula- tion environment (Table 3). However, the greatest TABLE 2. Pre- and Post-program Self-Assessment of Resident Facilitators Teaching Skills* Pre-program Rating (n Ā¼ 34)y Post-program Rating (n Ā¼ 34)y P Value Teaching on rounds 3.75 4.03 0.005 Teaching on wards outside rounds 3.83 4.07 0.007 Teaching in simulation 2.81 4.16 <0.001 Giving feedback 3.35 3.77 <0.001 NOTE: *Survey data were collected before participation in the workshop and 3 weeks after completion of the 4-month curriculum. yFive-point Likert scale: very uncomfortable (1) to very comfortable (5). Simulation Resident-as-Teacher Program | Miloslavsky et al An Ofļ¬cial Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015 769
  • 4. gains were seen in the domain of teaching in simulation. It was also noted that participation in the program improved resident facilitatorsā€™ medical knowledge. Subgroup analyses were performed comparing the perceived improvement in teaching and feedback skills among those who did or did not attend the facilitator workshop, those who facilitated 5 or more versus less than 5 sessions, and those who received or did not receive direct observation and feedback from faculty. Although numerically greater gains were seen across all 4 domains among those who attended the work- shop, facilitated 5 or more sessions, or received feed- back from faculty, only teaching on rounds and on the wards outside rounds reached statistical signiļ¬- cance (Table 4). It should be noted that all residents who facilitated 5 or more sessions also attended the workshop and received feedback from faculty. We also compared perceived improvement among PGY-II and PGY-III residents. In contrast to PGY-II residents, who demonstrated an improvement in all 4 domains, PGY-III residents only demonstrated improvement in simulation-based teaching. Intern Learnersā€™ Assessment of Resident Facilitators and the Program Overall During the course of the program, intern learners completed 166 DASH ratings evaluating 34 resident facilitators (see Supporting Information, Appendix V, in the online version of this article). Ratings for the 6 DASH items ranged from 6.49 to 6.73 (7-point scale), TABLE 3. Resident Facilitatorsā€™ Perceived Improvement in Skills Due to Resident-as-Teacher Program Category Not at All Slightly Improved Moderately Improved Greatly Improved Not Sure Teaching on rounds, n 5 34 4 (12%) 12 (35%) 13 (38%) 4 (12%) 1 (3%) Teaching on wards outside rounds, n 5 34 3 (9%) 13 (38%) 12 (35%) 5 (15%) 1 (3%) Teaching in simulation, n 5 34 0 (0%) 4 (12%) 7 (21%) 23 (68%) 0 (0%) Giving feedback, n 5 34 4 (12%) 10 (29%) 12 (35%) 6 (18%) 2 (6%) Medical knowledge, n 5 34 2 (6%) 11 (32%) 18 (53%) 3 (9%) 0 (0%) TABLE 4. Pre- and Post-program Self-Assessment of Resident Facilitators Teaching Skills According to Number of Sessions Facilitated, Workshop Attendance, Receipt of Feedback, and PGY Year Pre-program Post-program P Value Pre-program Post-program P Value Facilitated Less Than 5 Sessions (n Ā¼ 18) Facilitated 5 or More Sessions (n Ā¼ 11) Teaching on rounds 3.68 3.79 0.16 3.85 4.38 0.01 Teaching on wards outside rounds 3.82 4 0.08 3.85 4.15 0.04 Teaching in simulation 2.89 4.06 <0.01 2.69 4.31 <0.01 Giving feedback 3.33 3.67 0.01 3.38 3.92 0.01 Did Not Attend Workshop (n Ā¼ 10) Attended Workshop (n Ā¼ 22) Teaching on rounds 4 4.1 0.34 3.64 4 <0.01 Teaching on wards outside rounds 4 4 1.00 3.76 4.1 <0.01 Teaching in simulation 2.89 4.11 <0.01 2.77 4.18 <0.01 Giving feedback 3.56 3.78 0.17 3.27 3.77 <0.01 Received Feedback From Resident Leaders Only (n Ā¼ 11) Received Faculty Feedback (n Ā¼ 21) Teaching on rounds 3.55 3.82 0.19 3.86 4.14 0.01 Teaching on wards outside rounds 4 4 1.00 3.75 4.1 <0.01 Teaching in simulation 2.7 3.8 <0.01 2.86 4.33 <0.01 Giving feedback 3.2 3.6 0.04 3.43 3.86 <0.01 PGY-II (n Ā¼ 13) PGY-III (n Ā¼ 9) Teaching on rounds 3.38 3.85 0.03 4.22 4.22 1 Teaching on wards outside rounds 3.54 3.85 0.04 4.14 4.14 1 Teaching in simulation 2.46 4.15 <0.01 3.13 4.13 <0.01 Giving feedback 3.23 3.62 0.02 3.5 3.88 0.08 NOTE: Abbreviations: PGY, postgraduate year. Miloslavsky et al | Simulation Resident-as-Teacher Program 770 An Official Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015
  • 5. demonstrating a high level of facilitator efļ¬cacy across multiple domains. No differences in DASH scores were noted among subgroups of resident facilitators described in the previous paragraph. Thirty-eight of 52 intern learners (73%) completed the post-program survey. All intern learners rated the overall simulation expe- rience as either ā€œexcellentā€ (81%) or ā€œgoodā€ (19%) on the post-program evaluation (4 or 5 on a 5-point Likert scale, respectively). All interns strongly agreed (72%) or agreed (28%) that the simulation sessions improved their ability to manage acute clinical scenar- ios. Interns reported that resident facilitators fre- quently utilized speciļ¬c debrieļ¬ng techniques covered in the RaT curriculum during the debrieļ¬ng sessions (Table 5). DISCUSSION We describe a unique RaT program embedded within a high-ļ¬delity medical simulation curriculum for IM interns. Our study demonstrates that resident facilita- tors noted an improvement in their teaching and feed- back skills, both in the simulation setting and on the wards. Intern learners rated residentsā€™ teaching skills and the overall simulation curriculum highly, suggest- ing that residents were effective teachers. The use of simulation in trainee-as-teacher curricula holds promise because it can provide an opportunity to teach in an environment closely approximating the wards, where trainees have the most opportunities to teach. However, in contrast to true ward-based teach- ing, simulation can provide predictable scenarios in a controlled environment, which eliminates the distrac- tions and unpredictability that exist on the wards, with- out compromising patient safety. Recently, Toļ¬l et al. described the ļ¬rst use of simulation in a trainee-as- teacher program.17 The investigators utilized a 1-time simulation-based teaching session, during which pediatric fellows completed a teacher-training work- shop, developed and served as facilitators in a simulated case, and received feedback. The use of simulation allowed fellows an opportunity to apply newly acquired skills in a controlled environment and receive feedback, which has been shown to improve teaching skills.18 The experience from our program expands on that of Toļ¬l et al., as well as previously described trainee- as-teacher curricula, by introducing a component of deliberate practice that is unique to the simulation set- ting and has been absent from most previously described RaT programs.3 Most residents had the opportunity to facilitate the same case on multiple occasions, allowing them to receive feedback and make adjustments. Residents who facilitated 5 or more sessions demonstrated more improvement, par- ticularly in teaching outside of simulation, than resi- dents who facilitated fewer sessions. It is notable that PGY-II resident facilitators reported an improvement in their teaching skills on the wards, though less pro- nounced as compared to teaching in the simulation- based environment, suggesting that beneļ¬ts of the pro- gram may extend to nonā€“simulation-based settings. Additional studies focusing on objective evaluation of ward-based teaching are needed to further explore this phenomenon. Finally, the self-reported improve- ments in medical knowledge by resident facilitators may serve as another beneļ¬t of our program. Analysis of learner-level data collected in the post- curriculum intern survey and DASH ratings provides additional support for the effectiveness of the RaT program. The majority of intern learners reported that resident facilitators used the techniques covered in our program frequently during debrieļ¬ngs. In addition, DASH scores clustered around maximum efļ¬cacy for all facilitators, suggesting that residents were effective teachers. Although we cannot directly assess whether the differences demonstrated in resident facilitatorsā€™ self-assessments translated to their teaching or were signiļ¬cant from the learnersā€™ perspective, these results support the hypothesis that self-assessed improve- ments in teaching and feedback skills were signiļ¬cant. In addition to improving resident teaching skills, our program had a positive impact on intern learners as evidenced by intern evaluations of the simulation curriculum. While utilizing relatively few faculty resources, our program was able to deliver an exten- sive and well-received simulation curriculum to over 50 interns. The fact that 40% of second- and third- year residents volunteered to teach in the program despite the early morning timing of the sessions speaks to the interest that trainees have in teaching in this setting. This model can serve as an important and efļ¬- cient learning platform in residency training programs. It may be particularly salient to IM training programs where implementation of simulation curricula is chal- lenging due to large numbers of residents and limited faculty resources. The barriers to and lessons learned from our experience with implementing the simulation curriculum have been previously described.10,11 TABLE 5. Resident Facilitatorsā€™ Use of Speciļ¬c Teaching Skills During Debrieļ¬ng as Rated by Intern Learners Facilitator Behaviors Very Often, >75% Often, >50% Sometimes, 25%ā€“50% Rarely, <25% Never Elicited emotional reactions, n 5 38 18 (47%) 16 (42%) 4 (11%) 0 (0%) 0 (0%) Elicited objectives from learner, n 5 37 26 (69%) 8 (22%) 2 (6%) 1 (3%) 0 (0%) Asked to share clinical reasoning, n 5 38 21 (56%) 13 (33%) 4 (11%) 0 (0%) 0 (0%) Summarized learning points, n 5 38 31 (81%) 7 (19%) 0 (0%) 0 (0%) 0 (0%) Spoke for less than half of the session, n 5 38 8 (22%) 17 (44%) 11 (28%) 2 (6%) 0 (0%) Simulation Resident-as-Teacher Program | Miloslavsky et al An Ofļ¬cial Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015 771
  • 6. Our study has several limitations. Changes in resi- dentsā€™ teaching skills were self-assessed, which may be inaccurate as learners may overestimate their abilities.19 Although we collected data on the experiences of intern learners that supported residentsā€™ self-assessment, fur- ther studies using more objective measures (such as the Objective Structured Teaching Exercise20 ) should be undertaken. We did not objectively assess improvement of residentsā€™ teaching skills on the wards, with the exception of the residentsā€™ self assessment. Due to the timing of survey administration, some residents had as little as 1 month between completion of the curriculum and responding to the post-curriculum survey, limiting their ability to evaluate their teaching skills on the wards. The transferability of the skills gained in simulation-based teaching to teaching on the wards deserves further study. We cannot deļ¬nitively attribute perceived improvement of teaching skills to the RaT program without a control group. However, the fre- quent use of recommended techniques during debrief- ing, which are not typically taught in other settings, supports the efļ¬cacy of the RaT program. Our study did not allow us to determine which of the 3 components of the RaT program (workshop, facilitation practice, or direct observation and feed- back) had the greatest impact on teaching skills or DASH ratings, as those who facilitated more sessions also completed the other components of the program. Furthermore, there may have been a selection bias among facilitators who facilitated more sessions. Because only 16 of 34 participants completed both the pre-program and post-program self-assessments in a non-anonymous fashion, we were not able to analyze the effect of pre-program factors, such as prior teach- ing experience, on program outcomes. It should also be noted that allowing resident facilitators the option to complete the survey non-anonymously could have biased our results. The simulation curriculum was con- ducted in a single center, and resident facilitators were self-selecting; therefore, our results may not be general- izable. Finally, the DASH instrument was only admin- istered after the RaT workshop and was likely limited further by the ceiling effect created by the learnersā€™ high satisfaction with the simulation program overall. In summary, our simulation-based RaT program improved resident facilitatorsā€™ self-reported teaching and feedback skills. Simulation-based training pro- vided an opportunity for deliberate practice of teach- ing skills in a controlled environment, which was a unique component of the program. The impact of deliberate practice on resident teaching skills and opti- mal methods to incorporate deliberate practice in RaT programs deserves further study. Our curriculum design may serve as a model for the development of simulation programs that can be employed to improve both intern learning and resident teaching skills. Acknowledgements The authors acknowledge Deborah Navedo, PhD, Assistant Professor, Massachusetts General Hospital Institute of Health Professions, and Emily M. Hayden, MD, Assistant Professor, Department of Emergency Medicine, Massachusetts General Hospital and Harvard Medical School, for their assistance with development of the RaT curriculum. The authors thank Dr. Jenny Rudolph, Senior Director, Institute for Medical Simulation at the Center for Medical Simulation, for her help in teach- ing us to use the DASH instrument. The authors also thank Dr. Daniel Hunt, MD, Associate Professor, Department of Medicine, Massachusetts General Hospital and Harvard Medical School, for his thoughtful review of this manuscript. Disclosure: Nothing to report. References 1. Liaison Committee on Medical Education. Functions and structure of a medical school: standards for accreditation of medical education programs leading to the M.D. degree. Washington, DC, and Chicago, IL: Association of American Medical Colleges and American Medical Association; 2000. 2. Accreditation Council for Graduate Medical Education. ACGME pro- gram requirements for graduate medical education in pediatrics. Available at: http://www.acgme.org/acgmeweb/Portals/0/PFAssets/ 2013-PR-FAQ-PIF/320_pediatrics_07012013.pdf. Accessed June 18, 2014. 3. Hill AG, Yu TC, Barrow M, Hattie J. A systematic review of resident- as-teacher programmes. Med Educ. 2009;43(12):1129ā€“1140. 4. Okuda Y, Bryson EO, DeMaria S Jr, et al. The utility of simulation in medical education: what is the evidence? Mt Sinai J Med. 2009;76: 330ā€“343. 5. Okuda Y, Bond WF, Bonfante G, et al. National growth in simulation training within emergency medicine residency programs, 2003ā€“2008. Acad Emerg Med. 2008;15:1113ā€“1116. 6. Fernandez R, Wang E, Vozenilek JA, et al. Simulation center accredi- tation and programmatic benchmarks: a review for emergency medi- cine. Acad Emerg Med. 2010;17(10):1093ā€“1103. 7. Cook DA. How much evidence does it take? A cumulative meta- analysis of outcomes of simulation-based education. Med Educ. 2014; 48(8):750ā€“760. 8. Farrell SE, Pacella C, Egan D, et al.. Resident-as-teacher: a suggested curriculum for emergency medicine. Acad Emerg Med. 2006;13(6): 677ā€“679. 9. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10 suppl):S70ā€“S81. 10. Miloslavsky EM, Hayden EM, Currier PF, Mathai SK, Contreras- Valdes F, Gordon JA. Pilot program utilizing medical simulation in clinical decision making training for internal medicine interns. J Grad Med Educ. 2012;4:490ā€“495. 11. Mathai SK, Miloslavsky EM, Contreras-Valdes FM, et al. How we implemented a resident-led medical simulation curriculum in a large internal medicine residency program. Med Teach. 2014;36(4):279ā€“ 283. 12. Rudolph JW, Simon R, Dufresne RL, Raemer DB. Thereā€™s no such thing as ā€œnonjudgmentalā€ debrieļ¬ng: a theory and method for debrieļ¬ng with good judgment. Simul Healthc. 2006;1:49ā€“55. 13. Minehart RD, Rudolph JW, Pian-Smith MCM, Raemer DB. Improv- ing faculty feedback to resident trainees during a simulated case: a randomized, controlled trial of an educational intervention. Anesthesi- ology. 2014;120(1):160ā€“171. 14. Gardner R. Introduction to debrieļ¬ng. Semin Perinatol. 2013: 37(3)166ā€“174. 15. Howard G, Dailey PR. Response-shift bias: a source of contamination of self-report measures. J Appl Psychol. 1979;4:93ā€“106. 16. Center for Medical Simulation. Debrieļ¬ng assessment for simulation in healthcare. Available at: http://www.harvardmedsim.org/debrieļ¬ng- assesment-simulation-healthcare.php. Accessed June 18, 2014. 17. Toļ¬l NM, Peterson DT, Harrington KF, et al. A novel iterative- learner simulation model: fellows as teachers. J Grad Med Educ. 2014;6(1):127ā€“132. 18. Regan-Smith M, Hirschmann K, Iobst W. Direct observation of fac- ulty with feedback: an effective means of improving patient-centered and learner-centered teaching skills. Teach Learn Med. 2007;19(3): 278ā€“286. 19. Kruger J, Dunning D. Unskilled and unaware of it: how difļ¬culties in recognizing oneā€™s own incompetence lead to inļ¬‚ated self assessments. J Pers Soc Psychol. 1999;77:1121ā€“1134. 20. Morrison EH, Boker JR, Hollingshead J, et al. Reliability and validity of an objective structured teaching examination for generalist resident teachers. Acad Med. 2002;77(10 suppl):S29ā€“S32. Miloslavsky et al | Simulation Resident-as-Teacher Program 772 An Official Publication of the Society of Hospital Medicine Journal of Hospital Medicine Vol 10 | No 12 | December 2015