VALIDITY AND RELIABILITY OF STANDARDIZED PATIENT ASSESSMENT FOR COMMUNICATION SKILLS FORMATIVE ASSESSMENT IN SECOND-YEAR MEDICAL STUDENTS
Main Article Content
Abstract
Objective: To determine the validity and reliability of standardized patients in assessing the communication skills formative assessment of second year Viet Duc medical students Pham Ngoc Thach University of Medicine.
Methods: A cross-sectional study was conducted on 50 second-year Viet Duc medical students, 5 standardized patients, and 2 lecturers at the Center for Elaboration Competency and Innovation in Clinical Simulation at Pham Ngoc Thach University of Medicine, from June 2025 to June 2026. Standardized patients and lecturers independently assessed students’ communication skills using an “abdominal pain” scenario and a checklist with confirmed content validity by six experts (CVI = 0.96, CVR = 0.92). Validity was assessed using Spearman’s correlation coefficients and the Mann-Whitney U test. Inter-rater reliability (Inter-RR) and intra-rater reliability (Intra-RR) were evaluated using intraclass correlation coefficient.
Results: Standardized patients showed strong correlations with lecturers scores in communication skills (r = 0.7-1.0; p < 0.01). There were no statistically significant differences in mean scores between standardized patients and lecturers (p > 0.05). Inter-rater reliability ranged from moderate to excellent (Inter-RR = 0.57-0.91). Intra-rater reliability of standardized patients after four weeks was good to excellent (Intra-RR = 0.72-0.95).
Conclusion: Standardized patients are a valid and reliable assessment tool for evaluating the communication skills formative assessment of second year Viet Duc medical students.
Article Details
Keywords
Standardized patient, communication skills, validity, reliability.
References
[2] Bolstad A.L, Sørlie V, Berntsen K et al. Reliability of standardized patients used in a communication study on international nurses in the United States of America. Nurs Health Sci, 2012, 14 (1): 67-73. doi: 10.1111/j.1442-2018.2011.00667.x.
[3] Talwalkar J.S, Murtha T.D, Prozora S, Fortin A.H, Morrison L.J, Ellman M.S. Assessing advanced communication skills via objective structured clinical examination: a comparison of faculty versus self, peer, and standardized patient assessors. Teaching and Learning in Medicine, 2020, 32 (3): 294-307. doi: 10.1080/10401334.2019.1704763.
[4] Bui T.H, Nguyen T.H.H, Tran T.D, Hoang V.L. Communication skills in standardized patient and peer assessment: a cross-sectional study. Journal of Nursing Science, 2025, 8 (1): 154-162. doi: 10.54436/jns.2025.01.887.
[5] Yusoff M.S.B. ABC of content validation and content validity index calculation. Education in Medicine Journal, 2019, 11 (2): 49-54. doi: 10.21315/eimj2019.11.2.6.
[6] Landis J.R, Koch G.G. The measurement of observer agreement for categorical data. Biometrics, 1977, 33 (1): 159-174. doi: 10.2307/2529310.
[7] Zanten V.M, Boulet J.R, McKinley D. Using standardized patients to assess the interpersonal skills of physicians: six years’ experience with a high-stakes certification examination. Health Commun, 2007, 22 (3): 195-205.
[8] Cahyono B.D, Zuhroidah I, Sujarwadi M. Effectiveness of standardized patients and role play simulation methods in improving self-confidence and therapeutic communication skills of nursing students. Nurse and Health Jurnal Keperawatan, 2020, 9 (1): 9-15.