Objective  To investigate the knowledge base, learning attitudes, and practical abilities of students enrolling in an evidence-based medicine (EBM) course integrated with artificial intelligence (AI).

Methods  The study targeted students enrolled in the 2024–2025 academic year course “Evidence Synthesis and Application: Network Meta-Analysis” at Peking University Health Science Center. Data were collected through a self-developed electronic questionnaire covering AI-related knowledge, attitudes, practices, and expectations or concerns about the course. Differences between master’s and doctoral students were analyzed using the Mann-Whitney U test.

Results  A total of 46 students participated in the survey (34 Masters and below, and 12 PhDs). Most students demonstrated basic knowledge of AI and understood the core technologies of large language models, though their understanding of technical details was limited. Approximately 89.13% believed AI could enhance learning efficiency, and 84.78% expressed interest in using AI for Meta-analysis, yet many exhibited low trust in AI-generated content and were concerned about its impact on independent thinking. There were no statistically significant differences in attitudes towards the course between master and below students and doctoral students (P>0.05). In practice, students primarily used AI for tasks such as translation, writing, and information retrieval, with limited application to complex EBM-related tasks. Students also expressed concerns about the accuracy of AI-generated content and privacy security.

Conclusion  While students possess a foundational knowledge base and exhibit a positive attitude toward AI-assisted EBM courses, their trust in AI and practical application skills require improvement. These findings provide insights for reforming course content and teaching methods.

1. 陈耀龙, 孙雅佳, 罗旭飞, 等. 循证医学的核心方法与主要模型[J]. 协和医学杂志, 2023, 14(1): 1-8. [Chen YL, Sun YJ, Luo  XF, et al. The core methods and key models in evidence-based medicine[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 1-8] DOI: 10.12290/xhyxzz.2022- 0686.

2. 范美玉. 高质量循证医学证据获取与应用研究[J]. 协和医学杂志, 2023, 14(1): 39-43. [Fan MY. Research on high quality evidence acquisition and application of evidence-based medicine[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(1): 39-43] DOI: 10.12290/xhyxzz.2022-0202.

3. 章萌, 刘凤琪, 武珊珊, 等. 北京大学医学部循证医学课程选课研究生课前学情调查[J]. 医学新知, 2024, 34(7): 825-832. [Zhang M, Liu FQ, Wu SS, et al. Analysis of pre-course learning situation of postgraduates in the selection of evidence-based medicine course at Peking University Health Science Center[J]. Yixue Xinzhi Zazhi, 2024, 34(7): 825-832] DOI: 10.12173/j.issn.1004-5511.202311121.

4. Mills EJ, Thorlund K, Ioannidis JPA. Demystifying trial networks and network Meta-analysis[J]. BMJ, 2013, 346: f2914. DOI: 10.1136/bmj.f2914.

5. Murphy KA, Guisard Y, Curtin M, et al. Evidence-based practice: what do undergraduate health students think it means?[J]. Focus on Health Professional Education: A Multi-Professional Journal, 2019, 20(3): 12-29. DOI: 10.11157/fohpe.v20i3.319.

6. Saunders H, Gallagher-Ford L, Kvist T, et al. Practicing healthcare professionals' evidence-based practice competencies: an overview of systematic reviews[J]. Worldviews Evid Based Nurs, 2019, 16(3): 176-185. DOI: 10.1111/wvn.12363.

7. Lucas HC, Upperman JS, Robinson JR. A systematic review of large language models and their implications in medical education[J]. Med Educ, 2024, 58(11): 1276-1285. DOI: 10.1111/medu.15402.

8. 李戈, 吴涛, 章萌, 等. 大语言模型在循证实践和医学教育中的应用现状及对循证医学教学的启示[J]. 数字医学与健康, 2024, 2(2): 102-107. [Li G, Wu T, Zhang M, et al. Application and reflections of large language models in evidence-based practice and medical education[J]. Digital Medicine And Health, 2024, 2(2): 102-107.] DOI: 10.3760/cma.j.cn101909-20231109-00062.

9. Ng FYC, Thirunavukarasu AJ, Cheng H, et al. Artificial intelligence education: an evidence-based medicine approach for consumers, translators, and developers[J]. Cell Rep Med, 2023, 4(10): 101230. DOI: 10.1016/j.xcrm.2023.101230.

10. 刘佐相, 刘凤琪, 刘英丽, 等. 基于Canvas平台的混合式教学模式在研究生循证医学课程教学中的应用效果[J]. 中华医学教育杂志, 2022, 42(1): 46-49. [Liu ZX, Liu FQ, Liu  YL, et al. The effectiveness of blended teaching method based on canvas platform in the training of evidence-based medicine for postgraduates[J]. Chinese Journal of Medical Education, 2022, 42(1): 46-49.] DOI: 10.3760/cma.j.cn115259-20210426-00556.

11. 周琼, 徐亚苹, 蔡迎春. 高校学生人工智能素养能力现状及影响因素多维分析[J]. 图书情报知识, 2024, 41(3): 38-48. [Zhou Q, Xu YP, Cai YC. An examination of AI literacy among university students: current status and multifaceted influencing factors[J]. Documentation, Information & Knowledge, 2024, 41(3): 38-48.] DOI: 10.13366/j.dik.2024.03.038.

12. Hornberger M, Bewersdorff A, Nerdel C. What do university students know about artificial intelligence? Development and validation of an AI literacy test[J]. Computers and Education: Artificial Intelligence, 2023, 5: 100165. DOI: 10.1016/j.caeai.2023.100165.

13. Wang B, Rau P.L.P., Yuan T. Measuring user competence in using artificial intelligence: validity and reliability of artificial intelligence literacy scale[J]. Behaviour & Information Technology, 2023, 42(9): 1324-1337. DOI: 10.1080/0144929X.2022.2072768.

14. Valizadeh A, Moassefi M, Nakhostin-Ansari A, et al. Abstract screening using the automated tool Rayyan: results of effectiveness in three diagnostic test accuracy systematic reviews[J]. BMC Med Res Methodol, 2022, 22(1): 160. DOI: 10.1186/s12874-022-01631-8.

15. Oami T, Okada Y, Nakada TA. Performance of a large language model in screening citations[J]. JAMA Netw Open, 2024, 7(7): e2420496. DOI: 10.1001/jamanetworkopen.2024.20496.

16. Lai H, Ge L, Sun M, et al. Assessing the risk of bias in randomized clinical trials with large language models[J]. JAMA Netw Open, 2024, 7(5): e2412687. DOI: 10.1001/jamanetworkopen.2024.12687.

17. 罗旭飞, 吕晗, 史乾灵, 等. 大语言模型在循证医学领域的应用[J]. 中国循证医学杂志, 2024, 24(4): 373-377. [Luo XF, Lyu H, Shi QL, et al. The application of large language models in the field of evidence-based medicine[J]. Chinese Journal of Evidence-Based Medicine, 2024, 24(4): 373-377] DOI: 10.7507/1672-2531.202312067.

18. 顾雯洁, 丁杰. 生成式人工智能赋能信息科技课堂教学的应用策略[J]. 中国信息技术教育, 2024, (17): 95-99. [Gu WJ, Ding J. Application strategies of generative artificial intelligence in information technology classroom teaching[J]. China Information Technology Education, 2024, (17): 95-99.] DOI: 10.3969/j.issn.1674-2117.2024.17.048.