Welcome to visit Zhongnan Medical Journal Press Series journal website!

Systematic review on the design and optimization of teaching evaluation tools for evidence-based medicine

Published on Oct. 25, 2023Total Views: 974 timesTotal Downloads: 273 timesDownloadMobile

Author: Yun-Yun WANG 1, 2, 3 Ying-Hui JIN 1, 2, 3 Yi GUO 1, 2, 3 Yong-Bo WANG 1, 2, 3 Xian-Tao ZENG 1, 2, 3

Affiliation: 1. Department of Evidence-Based Medicine and Clinical Epidemiology, Second School of Clinical Medicine, Wuhan University, Wuhan 430071, China 2. Center for Evidence-Based and Translational Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, China 3. Center for Evidence-Based and Translational Medicine, Wuhan University, Wuhan 430071, China

Keywords: Evidence-based medicine Teaching evaluation Tools Systematic review

DOI: 10.12173/j.issn.1004-5511.

Reference: Wang YY, Jin YH, Guo Y, Wang YB, Zeng XT. Systematic review on the design and optimization of teaching evaluation tools for evidence-based medicine[J]. Yixue Xinzhi Zazhi, 2023, 33(5): 395-408. DOI: 10.12173/j.issn.1004-5511.202310013. [Article in Chinese]

  • Abstract
  • Full-text
  • References
Abstract

Objective To compare and analyze the characteristics of the teaching evaluation tools for evidence-based medicine(EBM) in recent 5 years, so as to provide suggestions for further design and optimization of curriculum evaluation methods.

Methods PubMed, Web of Science, Chinese biomedical literature database, CNKI, Wanfang database were searched from January 1, 2018 to September 16, 2022. Two researchers screened the literature, extracted the objects, focused topics, psychometric indicators, item contents, etc. of the tools, and made a comprehensive analysis of the existing tools.

Results 16 articles (involving 14 tools) were finally included, all of which were reliable. Among them, 11 tools focus on the mastery level of the respondents' knowledge and (or) skills related to evidence-based medicine (the number of items ranges from 6 to 24), mostly involving the comprehensive cognition of evidence-based medicine, the understanding of common terms, the judgment of key concepts, the sharing and application of evidence-based practice, etc., and the evaluation criteria are mostly the judgment of right and wrong, self-evaluation, and the objective evaluation of feedback content; 7 tools focus on the true attitude of the respondents to the evidence-based practice (the number of items ranges from 3 to 21), and the evaluation criteria are mostly subjective intention options; 4 tools are used to understand the implementation frequency, time allocation and sharing of key links of evidence-based practice by the respondents (the number of items ranges from 6 to 18). The evaluation criteria are mostly subjective choices of frequency.

Conclusion The questionnaire of knowledge/skills and their attitudes and behaviors can be used as an auxiliary tool in the evaluation of EBM courses. However, it is still necessary to further optimize the content and proportion of items according to the teaching characteristics and goals of the teaching objects, and develop monitoring and evaluation tools for the teaching process of evidence-based medicine curriculum.

Full-text
Please download the PDF version to read the full text: download
References

1. 曾宪涛. 再谈循证医学[J]. 武警医学, 2016, 27(7): 649-654. [Zeng XT. Re-discuss evidence-based medicine[J]. Medical Journal of the Chinese People's Armed Police Forces, 2016, 27(7): 649-654.] DOI: 10.14010/j.cnki.wjyx.2016.07.001.

2. Schwarz MR, Wojtczak A. Global minimum essential requirements: a road towards competence-oriented medical education[J]. Med Teach, 2002, 24(2): 125-129. DOI: 10.1080/01421590220120740.

3. World Federation for Medical Education Office (WFME). WFME task force on defining international standards in basic medical education. Report of the working party, Copenhagen, 14-16 October 1999[J]. Med Educ, 2000,34(8): 665-675. DOI: 10.1046/j.1365-2923.2000.00722.x.

4. 教育部临床医学专业认证工作委员会 . 中国本科医学教育标准 : 临床医学专业 (2016 版 )[M]. 北京:北京大学医学出版社, 2017. [Working Committee for the Accreditation of Medical Education, Ministry of Education, China. Accreditation standards for basic medical education in China (2016)[M]. Beijing: Peking University Medical Press, 2017.]

5. Kumaravel B, Hearn JH, Jahangiri L, et al. A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education[J]. Syst Rev, 2020, 9(1): 91. DOI: 10.1186/s13643-020-01311-y.

6. 费娇娇, 李琰华, 李俊伟. 循证医学学习评估工具系统综述[J]. 中华全科医学, 2017, 15(7): 1217-1222.[Fei JJ, Li YH, Li JW. A systematic review on the instrument for evaluating evidence-based practice competency[J]. Chinese Journal of General Practice, 2017, 15(7): 1217-1222.] DOI: 10.16766 /j.cnki.issn.1674-4152.2017.07.038.

7. 耿劲松, 董建成, 蒋葵, 等. 循证医学教学效果评价指标的构建与实证分析[J]. 中国高等医学教育, 2011, (12): 9-10. [Geng JS, Dong JC, Jiang K, et al. Construction and empirical analysis of evaluation index of evidence-based medicine teaching effect[J].China Higher Medical Education, 2011, (12): 9-10. ] DOI: 10.3969/j.issn.1002-1701.2011.12.005.

8. Youssef N, Alharbi H. Validity and reliability of the English version of the Student Evidence-Based Practice Questionnaire among Arabic-speaking undergraduate students at health sciences colleges: A cross-sectional study[J]. Nurse Educ Today, 2022,118:105525. DOI: 10.1016/j.nedt.2022.105525.

9. Baumann AA, Vázquez AL, Macchione AC, et al. Translation and validation of the evidence-based practice attitude scale (EBPAS-15) to Brazilian Portuguese: Examining providers' perspective about evidence-based parent intervention[J]. Child Youth Serv Rev, 2022, 136:106421. DOI: 10.1016/j.childyouth.2022.106421.

10. Habibi MA, Amini M, Ostovarfar M, et al. Reliability and validity of the Persian version of the ACE tool: assessing medical trainees' competency in evidence-based medicine[J]. BMC Med Educ, 2022, 22(1):468. DOI: 10.1186/s12909-022-03540-2.

11. Ruano ASM, Motter FR, Lopes LC. Design and validity of an instrument to assess healthcare professionals' perceptions, behaviour, self-efficacy and attitudes towards evidence-based health practice: I-SABE[J]. BMJ Open, 2022, 12(4):e052767. DOI: 10.1136/bmjopen-2021-052767.

12. Norhayati MN, Nawi ZM. Validity and reliability of the Noor Evidence-Based Medicine Questionnaire: A cross-sectional study[J]. PLoS One, 2021,16(4): e0249660. DOI: 10.1371/journal.pone.0249660.

13. Patelarou A, Schetaki S, Giakoumidakis K, et al. Validation of the Evidence-Based Practice Competence Questionnaire for Nursing Students: A Cross-Sectional Study in Greece[J]. Nurs Rep,  2021,11(4): 765-774.DOI: 10.3390/nursrep11040073.

14. Park JE, Hwang JI. Psychometric Evaluation of the Korean Version of the Student Evidence-Based Practice Questionnaire (S-EBPQ)[J]. Asian Nurs Res (Korean Soc Nurs Sci),  2021,15(1): 47-52. DOI: 10.1016/j.anr.2020.10.003.

15. Cardoso D, Couto F, Cardoso AF, et al. Fresno test to measure evidence-based practice knowledge and skills for Portuguese undergraduate nursing students: A translation and adaptation study[J]. Nurse Educ Today, 2021, 97: 104671. DOI: 10.1016/j.nedt.2020.104671.

16. da Silva AM, Padula RS. Factor structure and short version of the modified Fresno test to assess the use of the evidence-based practice in physiotherapists[J]. BMC Med Educ, 2021, 21(1): 135. DOI: 10.1186/s12909-021-02535-9.

17. Jafari F, Azadi H, Abdi A, et al. Cultural validation of the competence in evidence-based practice questionnaire (EBP-COQ) for nursing students[J]. J Educ Health Promot, 2021, 10: 464. DOI: 10.4103/jehp.jehp_1534_20.

18. Van Giang N, Lin SY, Thai DH. A psychometric evaluation of the Vietnamese version of the Evidence-Based Practice Attitudes and Beliefs Scales[J]. Int J Nurs Pract, 2021, 27(6): e12896. DOI: 10.1111/ijn.12896.

19. Panczyk M, Iwanow L, Gaworska-Krzemińska A,et al. Validation study and setting norms of the evidence based practice competence questionnaire for nursing students: A cross-sectional study in Poland[J]. Nurse Educ Today, 2020, 88:104383. DOI: 10.1016/j.nedt.2020.104383.

20. Kerwien-Jacquier E, Verloo H, Pereira F, et al. Adaptation and validation of the evidence-based practice beliefs and implementation scales into German[J]. Nurs Open, 2020, 7(6): 1997-2008. DOI: 10.1002/nop2.593.

21. Skavberg Roaldsen K, Halvarsson A. Reliability of the Swedish version of the Evidence-Based Practice Attitude Scale assessing physiotherapist's attitudes to implementation of evidence-based practice[J]. PLoS One, 2019, 14(11): e0225467. DOI: 10.1371/journal.pone.0225467.

22. Hisham R, Ng CJ, Liew SM, et al. Development and validation of the Evidence Based Medicine Questionnaire (EBMQ) to assess doctors' knowledge, practice and barriers regarding the implementation of evidence-based medicine in primary care[J]. BMC Fam Pract, 2018, 19(1): 98. DOI: 10.1186/s12875-018-0779-5.

23. Rousselot N, Tombrey T, Zongo D, et al. Development and pilot testing of a tool to assess evidence-based practice skills among French general practitioners[J]. BMC Med Educ, 2018, 18(1): 254. DOI: 10.1186/s12909-018-1368-y. DOI: 10.1186/s12909-018-1368-y.

24. 黄进,赵宇亮,余钰,等.医学教育改革中的循证医学[J].中国循证医学杂志,2010,10(04):437-440.[Huang J, Zhao YL, Yu Y, et al. Evidence-Based Medicine in Medical Education Reform[J]. Chinese Journal of Evidence-Based Medicine, 2010,10(04):437-440. DOI: 10.7507/1672-2531.20100423.

25. 王云云, 王宇, 黄笛,等. 循证医学课程体系的建设与实践——以武汉大学为例 [J]. 医学新知, 2022, 32(1):74-80. [Wang YY, Wang Y, Huang D, et al. Construction and application of a curriculum system for evidencebased medicine: an example from Wuhan University[J].Yixue Xinzhi Zazhi, 2022, 32(1): 74-80.]  DOI: 10.12173/j.issn.1004-5511.202111004.

26.王云云, 王宇, 黄笛, 等. “互联网+ ”新型教学模式形成性评价体系构建及其应用于循证医学课程的思考[J]. 医学新知, 2022, 32(3): 233-240. [Wang YY, Wang Y, Huang D, el al. Suggestions for formative assessment system construction of the "internet+" new teaching mode and its application in an evidence-based medicine course[J]. Yixue Xinzhi Zazhi, 2022, 32(3): 233-240.] DOI: 10.12173/j.issn.1004-5511.202201032.