The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
The fundamentals of Artificial Intelligence in medical education research: AMEE Guide No. 156.
Abstract
The use of Artificial Intelligence (AI) in medical education has the potential to facilitate complicated tasks and improve efficiency. For example, AI could help automate assessment of written responses, or provide feedback on medical image interpretations with excellent reliability. While applications of AI in learning, instruction, and assessment are growing, further exploration is still required. There exist few conceptual or methodological guides for medical educators wishing to evaluate or engage in AI research. In this guide, we aim to: 1) describe practical considerations involved in reading and conducting studies in medical education using AI, 2) define basic terminology and 3) identify which medical education problems and data are ideally-suited for using AI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. (2015) · BMC Medicine · doi:10.1186/s12916-014-0241-z · Cited by 1,927
Schmidt, H. G., Norman, G. R., & Boshuizen, H. P. (1990) · Academic Medicine · doi:10.1097/00001888-199010000-00001 · Cited by 1,109
Human-computer collaboration for skin cancer recognition
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0942-0 · Cited by 1,024
(2019) · Cited by 986
Association Between Funding and Quality of Published Medical Education Research
Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007) · JAMA · doi:10.1001/jama.298.9.1002 · Cited by 958
Parsell, G., & Bligh, J. (1999) · Medical Education · doi:10.1046/j.1365-2923.1999.00298.x · Cited by 898
Research works printed but not linked: 4
- Krohn J Beyleveld G Bassens A. 2019. Deep learning illustrated: a visual interactive guide to Artificial Intelligence (Addison-Wesley Data & Analytics Series). 1st ed. Addison-Wesley Professional.
- Kulasegaram KM. 2022. Ottawa Consensus Statement on Big Data 2022 [in preparation]. Presented at the Ottawa Conference Lyon. https://www.ottawaconference.org/
- Linardatos P, Papastefanopoulos V, Kotsiantis S. 2021. Explainable AI: A. Rev Mach Learn Interpretability Methods" Entropy. 23(1):18.
- 10.1093/oi/authority.20110803095426960 · doi:10.1093/oi/authority.20110803095426960
Cited by
Franco D’Souza, R., Mathew, M., Mishra, V., & Surapaneni, K. M. (2024) · Medical Education Online · doi:10.1080/10872981.2024.2330250 · Cited by 147
“…access to a wide range of information, technology-enhanced teaching, adaptive assessments, immediate contextual feedback, collaborative learning through virtual platforms and support faculty in creating advanced, data-driven curricula to stay aligned with the dynamic landscape of education [3].”
BackgroundSridharan, K., & Sequeira, R. P. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05365-7 · Cited by 114
“Artificial intelligence (AI) has great potential to revo-lutionize the field of medical education from curricular conception to assessment [1].”
BackgroundDuan, S., Liu, C., Rong, T., Zhao, Y., & Liu, B. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07177-9 · Cited by 85
“For example, AI-based tools, such as intelligent virtual patient systems, advanced teaching platforms, and generative AI-based question-and-answer systems are progressively emerging in medical education, presenting opportunities to improve teaching efficacy and educational quality [11–13].”
Artificial Intelligence in Endodontic Education
Aminoshariae, A., Nosrat, A., Nagendrababu, V., Dianat, O., Mohammad‐Rahimi, H., O'Keefe, A. W., & Setzer, F. C. (2024) · Journal of Endodontics · doi:10.1016/j.joen.2024.02.011 · Cited by 75
Moldt, J.-A., Festl-Wietek, T., Fuhl, W., Zabel, S., Claassen, M., Wagner, S., Nieselt, K., & Herrmann-Werner, A. (2024) · JMIR Medical Education · doi:10.2196/58355 · Cited by 47
“While it is a hot topic among AI experts, health care students are not yet fully aware of the significance of AI, although the technology is expected to enter their professional lives in the future [31,54].”
Background
Metadata
- Authors
- Tolsgaard, M. G., Pusic, M. V., Sebok-Syer, S. S., Gin, B., Svendsen, M. B., Syer, M. D., Brydges, R., Cuddy, M. M., & Boscardin, C. K.
- Affiliations
- Copenhagen University Hospital (DK)
- Harvard University (US)
- Department of Emergency Medicine, Stanford University, Palo Alto, CA, USA
- University of California, San Francisco (US)
- Copenhagen Academy for Medical Education and Simulation (DK)
- Queen's University (CA)
- St. Michael's Hospital (CA)
- National Board of Medical Examiners (US)
- Corresponding author
- Tolsgaard, Martin G.
- ORCID
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2023-03-02
- Volume
- 45
- Issue
- 6
- Pages
- 565-573
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W4322758367
- Cited by
- 137
- References
- 37
- Citations by year
- 2026: 47 · 2025: 32 · 2024: 38 · 2023: 20
- FWCI
- 5.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- artificial intelligence, medical education, automated assessment, AI terminology, research evaluation
- MeSH terms
- Artificial Intelligence, Education, Medical, Humans, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The fundamentals of Artificial Intelligence in medical education research: AMEE Guide No. 156. https://app.cochat.ai/papers/10.1080/0142159x.2023.2180340
- The paper
- Tolsgaard, M. G., Pusic, M. V., Sebok-Syer, S. S., Gin, B., Svendsen, M. B., Syer, M. D., Brydges, R., Cuddy, M. M., & Boscardin, C. K. (2023). The fundamentals of Artificial Intelligence in medical education research: AMEE Guide No. 156. Medical Teacher. https://doi.org/10.1080/0142159x.2023.2180340
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.