Objective To provide formative evaluation training for clinical teachers on Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) method, and analyze the training effect.
Methods Clinical teachers were selected as the research subjects. The experimental group received Mini-CEX and DOPS training, while the control group did not receive training. Before and after the training, the experimental group were investigated the mastery of the training content through questionnaire. During the training, the experimental group rated the teaching videos. After the training, the experimental group were investigated for satisfaction with the training. After one month of training, the experimental group and control group received a formative assessment of the implementation ability.
Results 112 clinical teachers were included, including 56 in the experimental group and 56 in the control group. After the training, the 56 teachers in the experimental group showed a significant improvement in their self-evaluation scores for Mini-CEX and DOPS when compared with before training (P<0.05), and the Kendall's W coefficient of the Mini-CEX teaching video rating of the experimental group increased, indicating an improvement in rating consistency. The formative assessment implementation ability score of experimental group [(86.67±6.67) vs. (70.67±15.00) points for Mini-CEX, (89.41±5.97) vs. (77.39±5.50) points for DOPS] were higher than those in the control group. The overall satisfaction of the experimental group teachers with the training is relatively high [(4.04±0.50) points].
Conclusion Formative assessment is effective in deepening clinical teachers' understanding of formative assessment, improving the accuracy and consistency of formative assessment, and enhancing their ability to implement formative assessment.
Please download the PDF version to read the full text:
download
1.教育部临床医学专业认证工作委员会. 《中国本科医学教育标准——临床医学专业》(2022版)[EB/OL]. (2022-12-30) [2025-05-22]. https://wcame.meduc.cn/show.php?cid=20&id=505.html
2.Lörwald AC, Lehner FM, Nouns ZM, et al. The educational impact of mini-clinical evaluation exercise (Mini-CEX) and direct observation of procedural skills (DOPS) and its association with implementation: a systematic review and Meta-analysis [J]. PLoS One, 2018, 13(6): e0198009. DOI: 10.1371/journal.pone.0198009.
3.Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31[J]. Med Teach, 2007, 29(9): 855-871. DOI: 10.1080/01421590701775453.
4.Liao KC, Pu SJ, Liu MS, et al. Development and implementation of a mini-clinical evaluation exercise (mini-CEX) program to assess the clinical competencies of internal medicine residents: from faculty development to curriculum evaluation[J]. BMC Med Educ, 2013, 13: 31. DOI: 10.1186/1472-6920-13-31.
5.张进, 杨立斌, 郭庆峰, 等. 形成性评价在本科临床医学教育中的应用研究综述[J]. 中华医学教育杂志, 2020, (9): 731-735. [Zhang J, Yang LB, Guo QF, et al. Application of formative assessment in undergraduate clinical medicine education[J]. Chinese Journal of Medical Education, 2020, (9): 731-735.] DOI: 10.3760/cma.j.cn115259-20190926-00808.
6.郭中献, 沙丽艳, 伊静, 等. 参照系培训法在护理迷你临床演练评估评分者培训中的应用[J]. 中国护理管理, 2016, 16(9): 1225-1229. [Guo ZX, Sha LY, Yi J, et al. The application of frame-of-reference training on nursing-Mini-CEX rater training[J]. Chinese Nursing Management, 2016, 16(9): 1225-1229.] DOI: 10.3969/j.issn.1672-1756.2016.09.017.
7.中国医师协会.《住院医师规范化培训教学活动指南》(2022 年版)[EB/OL]. (2022-07-31)[2025-05-22]. https://www.ccgme-cmda.cn/pole-portal/#/detail?id=1729133572504781122&columnId=1751623757524193281.html
8.张进, 杨立斌, 张淑娥, 等. 形成性评价在本科临床医学教育中的实施现状与提升策略[J]. 中华医学教育杂志, 2021, 41(4): 372-375. [Zhang J, Yang LB, Zhang SE, et al. Implementation status and promotion strategy of formative assessment in undergraduate clinical medical education[J]. Chinese Journal of Medical Education, 2021, 41(4): 372-375.] DOI: 10.3760/cma.j.cn115259-20201014-01469.
9.宫月荣, 胡营滨. 形成性评价在临床医学教学中的应用[J]. 中国继续医学教育, 2019, 11(19): 32-34. [Gong YR, Hu YB. Application of formative evaluation in clinical medicine teaching[J]. China Continuing Medical Education, 2019, 11(19): 32-34.] DOI: 10.3969/j.issn.1674-9308.2019.19.014.
10.陈建松, 叶碧瑜, 蔡骏逸, 等. Mini-CEX和DOPS在精神医学临床教学中应用的一致性分析[J]. 现代医药卫生, 2021, 37(16): 2831-2834. [Chen JS, Ye BY, Cai JY, et al. Consistency analysis on the application of Mini-CEX and DOPS in clinical teaching of psychiatry[J]. Journal of Modern Medicine & Health, 2021, 37(16): 2831-2834.] DOI: 10.3969/j.issn.1009-5519.2021.16.038.
11.张文艳, 刘于, 于明峰. 综合培训法在迷你临床演练评估同质化评分培训中的应用[J]. 全科护理, 2022, 20(24): 3453-3456. [Zhang WY, Liu Y, Yu MF. Application of the comprehensive training method in the homogenization scoring training of mini-clinical evaluation exercise[J]. Chinese General Practice Nursing, 2022, 20(24): 3453-3456.] DOI: 10.12104/j.issn.1674-4748.2022.24.037.
12.Rauf A, Shamim MS, Aly SM, et al. Formative assessment in undergraduate medical education: concept, implementation and hurdles[J]. J Pak Med Assoc, 2014, 64(1): 72-75. https://pubmed.ncbi.nlm.nih.gov/24605718/
13.徐米清, 曹梅, 范嘉铨, 等. 住院医师规范化培训师资形成性评价能力的培训体会[J]. 中国毕业后医学教育, 2019, 3(5): 405-407, 465. [Xu MQ, Cao M, Fan JQ, et al. Training experience on the formative evaluation of faculty' teaching abilities in standardized residency training[J]. Chinese Journal of Graduate Medical Education, 2019, 3(5): 405-407, 465.] DOI: 10.3969/j.issn.2096-4293.2019.05.011.
14.Weallans J, Roberts C, Hamilton S, et al. Guidance for providing effective feedback in clinical supervision in postgraduate medical education: a systematic review[J]. Postgrad Med J, 2022, 98(1156): 138-149. DOI: 10.1136/postgradmedj-2020-139566.
15.Walsh E, Foley T, Sinnott C, et al. Developing and piloting a resource for training assessors in use of the Mini-CEX (mini clinical evaluation exercise)[J]. Educ Prim Care, 2017, 28(4): 243-245. DOI: 10.1080/14739879.2017.1280694.