Using the Communication Assessment Tool (CAT) to Assess Communication Skills ofFamily Medicine ResidentsLinda Myerholtz, Ph.D., Lynn Simons , Psy.D. , Sumi Felix, M.D., Tuan Nguyen, M.D. , Julie Brennan, Ph.D., Ana Rivera-Tovar, Ph.D., Pat Martin, PCC, Jeri Hepworth, Ph.D., Gregory Makoul, Ph.D.

CAT14-item patient satisfaction surveyPhysician interpersonal and communication skillsDevelopment based on sound psychometric methods5-point rating scale:1 = poor 2 = fair 3 = good 4 = very good 5 = excellentPaper and pencil, phone, internet administrationMakoul G, Krupat E, Chang C. Measuring patient views of physician communication skills: Development and testing of the Communication Assessment Tool. Patient Educ Couns 2007; 67:333-342.

Individualized Resident Sample Report

ObjectivesGather benchmarking data for the use of the CAT in Family Medicine residency programs Examine differences based on:Year in trainingNative language of the resident (native English speaking vs. non-native English speaking)Gender

Sample & MethodsSix Family Medicine residency programs Midwest & East coastUrban, suburban, rural communities13-38 residents per program127 residents Data Collection: Nov 2008- Dec 2008Paper and pencil version of the CAT1,880 complete/useable surveys

Scoring:Mean ratingsOverall By itemPercentage of “Excellent” ratings OverallBy Item

Demographic Characteristics of Residents

ResultsOverall mean percent “excellent” = 69.7% (SD = 40.4)Items rated most frequently as “excellent”Paid attention to me (73.6%)Treated me with respect (72.8%)Showed care and concern (72.6%)Items rated least frequently as “excellent”Encouraged me to ask questions (63.2%)Involved me in decisions (64.9%)Consistent with Makoul et al.’s findings for practicing physicians

Training YearOverall p = .015 PGY 1 vs. PGY 2 p =.018 ; PGY 1 vs. PGY 3 = p =.004 ; PGY 2 vs. PGY 3 = p = .55

Native Languagep = .06

Genderp = .81

LimitationsSample = Convenience sample of volunteering programsVariability in the number of surveys collected per resident

AdvantagesMeasures patient’s perspectiveUser friendly administration & scoringProvides empirical measure of core ACGME competencyDifferentiates between residents Easy to track changes over timeBenchmark data now available

Lessons Learned & Future NeedsIncrease sample sizesEvaluate changes over timeConsider efficacy of a minimum passing score58% has been recommended2Continue to expand benchmarking data2Wayne D, Cohen E, Makoul G, McGaghie W. The impact of judge selection on standard setting for a patient survey of physician communication skills. Acad Med 2008; 83: S17-20.