Assessing validity of standardized patient ratings of medical students’ communication behavior using the Roter interaction analysis system
Received 20 February 2007; received in revised form 23 August 2007; accepted 6 October 2007.
Abstract
Objective
The primary objective of this study is to examine concurrent validity of standardized patient (SP) ratings of second year medical students’ communication skills with the Roter interaction analysis system (RIAS).
Methods
We designed An Integrated Medical Encounter (AIME), to teach second year medical students the link between communication and clinical reasoning with emphasis placed on understanding the connection between biomedical and psychosocial aspects of patient care. We randomized 120 students to intervention (AIME) and control groups (non-AIME). Students completed two post-intervention SP encounters which were videotaped and coded using RIAS. SPs used a 30-item checklist to rate students’ communication behaviors.
Results
There were no differences between AIME and non-AIME students in age, ethnicity, gender, or college major; however, more AIME students reported prior health professional work. SPs rated AIME students’ rapport-building skills higher (mean [S.E.]: 4.1 [0.15] vs. 3.9 [0.15], p=0.05); however, there were no differences in data gathering, patient education/counseling. RIAS demonstrated that AIME students more frequently used rapport-building statements (60.4 [2.7] vs. 52.1 [2.8], p=0.03).
Conclusion
The RIAS confirmed SP ratings of differences in AIME and non-AIME students’ rapport-building skills.
Practice implications
Future studies in medical education should further examine the minimum number of SP ratings needed to effectively evaluate communication skills curricula when resources are limited.
aDivision of General Internal Medicine and Geriatrics, Department of Medicine, Tulane University Health Sciences Center, United States
bDivision of General Internal Medicine, Department of Medicine, Yale University School of Medicine, United States
cDivision of General Internal Medicine, Department of Medicine, Johns Hopkins University School of Medicine, United States
Corresponding author at: Division of General Internal Medicine and Geriatrics, 1430 Tulane Avenue, SL 16, New Orleans, LA 70112, United States. Tel.: +1 504 988 7518; fax: +1 504 988 8252.
ABSTRACT