Medical Ethics of Large Language Models in Medicine
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Large language models (LLMs) have shown significant promise related to their application in medical research, medical education, and clinical tasks. While acknowledging their capabilities, we face the challenge of striking a balance between defining and holding ethical boundaries and driving innovation in LLM technology for medicine. We herein propose a framework, grounded in four bioethical principles, to promote the responsible use of LLMs. This model requires the responsible application of LLMs by three parties — the patient, the clinician, and the systems that govern the LLM itself — and suggests potential approaches to mitigating the risks of LLMs in medicine. This approach allows us to use LLMs ethically, equitably, and effectively in medicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Large language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944
Self-citationAyers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613
Sheller, M. J., Edwards, B., Reina, G. A., Martin, J., Pati, S., Kotrotsou, A., Milchenko, M., Xu, W., Marcus, D., Colen, R. R., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-69250-1 · Cited by 1,646
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Dave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204
Principles of Clinical Ethics and Their Application to Practice
Varkey, B. (2021) · Medical Principles and Practice · doi:10.1159/000509119 · Cited by 1,171
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
The imperative for regulatory oversight of large language models (or generative AI) in healthcare
Meskó, B., & Topol, E. J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00873-0 · Cited by 1,047
Adapted large language models can outperform medical experts in clinical text summarization
Van Veen, D., Van Uden, C., Blankemeier, L., Delbrouck, J.-B., Aali, A., Bluethgen, C., Pareek, A., Polacin, M., Reis, E. P., Seehofnerová, A., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-02855-5 · Cited by 891
Rasmy, L., Xiang, Y., Xie, Z., Tao, C., & Zhi, D. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00455-y · Cited by 886
A large language model for electronic health records
Yang, X., Chen, A., PourNejatian, N., Shin, H. C., Smith, K. E., Parisien, C., Compas, C., Martin, C., Costa, A. B., Flores, M. G., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00742-2 · Cited by 847
Anil, R., Dai, A. M., Firat, O., Johnson, M., Lepikhin, D., Passos, A., Shakeri, S., Taropa, E., Bailey, P., Chen, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.10403 · Cited by 834
Genetic Misdiagnoses and the Potential for Health Disparities
Manrai, A. K., Funke, B. H., Rehm, H. L., Olesen, M. S., Maron, B. A., Szolovits, P., Margulies, D. M., Loscalzo, J., & Kohane, I. S. (2016) · New England Journal of Medicine · doi:10.1056/nejmsa1507092 · Cited by 808
LaMDA: Language Models for Dialog Applications
Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.-T., Jin, A., Bos, T., Baker, L., Du, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2201.08239 · Cited by 778
Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions
Abd-alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alabed Alrazak, S., & Sheikh, J. (2023) · JMIR Medical Education · doi:10.2196/48291 · Cited by 722
Yeo, Y. H., Samaan, J. S., Ng, W. H., Ting, P.-S., Trivedi, H., Vipani, A., Ayoub, W., Yang, J. D., Liran, O., Spiegel, B., et al. (2023) · doi:10.1101/2023.02.06.23285449 · Cited by 666
On the ethics of algorithmic decision-making in healthcare
Grote, T., & Berens, P. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105586 · Cited by 551
Zack, T., Lehman, E., Suzgun, M., Rodriguez, J. A., Celi, L. A., Gichoya, J., Jurafsky, D., Szolovits, P., Bates, D. W., Abdulnour, R.-E. E., et al. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00225-x · Cited by 510
Self-citationThe carbon impact of artificial intelligence
Dhar, P. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0219-9 · Cited by 509
Towards Generalist Biomedical AI
Tu, T., Azizi, S., Driess, D., Schaekermann, M., Amin, M., Chang, P.-C., Carroll, A., Lau, C., Tanno, R., Ktena, I., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.14334 · Cited by 483
Towards Generalist Biomedical AI
Tu, T., Azizi, S., Driess, D., Schaekermann, M., Amin, M., Chang, P.-C., Carroll, A., Lau, C., Tanno, R., Ktena, I., et al. (2024) · NEJM AI · doi:10.1056/aioa2300138 · Cited by 483
Harrer, S. (2023) · eBioMedicine · doi:10.1016/j.ebiom.2023.104512 · Cited by 480
What This Computer Needs Is a Physician: Humanism and Artificial Intelligence
Verghese, A., Shah, N. H., & Harrington, R. A. (2018) · JAMA · doi:10.1001/jama.2017.19198 · Cited by 468
Self-citationHealth system-scale language models are all-purpose prediction engines
Jiang, L. Y., Liu, X. C., Nejatian, N. P., Nasir-Moin, M., Wang, D., Abidin, A., Eaton, K., Riina, H. A., Laufer, I., Punjabi, P., et al. (2023) · Nature · doi:10.1038/s41586-023-06160-y · Cited by 460
A study of generative large language model for medical research and healthcare
Peng, C., Yang, X., Chen, A., Smith, K. E., PourNejatian, N., Costa, A. B., Martin, C., Flores, M. G., Zhang, Y., Magoc, T., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00958-w · Cited by 408
The shaky foundations of large language models and foundation models for electronic health records
Wornow, M., Xu, Y., Thapa, R., Patel, B., Steinberg, E., Fleming, S., Pfeffer, M. A., Fries, J., & Shah, N. H. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00879-8 · Cited by 324
Self-citationLarge pre-trained language models contain human-like biases of what is right and wrong to do
Schramowski, P., Turan, C., Andersen, N., Rothkopf, C. A., & Kersting, K. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00458-8 · Cited by 291
Checco, A., Bracciale, L., Loreti, P., Pinfield, S., & Bianchi, G. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00703-8 · Cited by 286
Čartolovni, A., Tomičić, A., & Lazić Mosler, E. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104738 · Cited by 267
Hopkins, A. M., Logan, J. M., Kichenadasse, G., & Sorich, M. J. (2023) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkad010 · Cited by 259
Skolnick, J., Gao, M., Zhou, H., & Singh, S. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c01114 · Cited by 251
Ning, Y., Teixayavong, S., Shang, Y., Savulescu, J., Nagaraj, V., Miao, D., Mertens, M., Ting, D. S. W., Ong, J. C. L., Liu, M., et al. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00143-2 · Cited by 212
Self-citationThe Advent of Generative Language Models in Medical Education
Karabacak, M., Ozkara, B. B., Margetis, K., Wintermark, M., & Bisdas, S. (2023) · JMIR Medical Education · doi:10.2196/48163 · Cited by 208
Thirunavukarasu, A. J., Hassan, R., Mahmood, S., Sanghera, R., Barzangi, K., El Mukashfi, M., & Shah, S. (2023) · JMIR Medical Education · doi:10.2196/46599 · Cited by 187
Decker, H., Trang, K., Ramirez, J., Colley, A., Pierce, L., Coleman, M., Bongiovanni, T., Melton, G. B., & Wick, E. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.36997 · Cited by 178
Arora, A., & Arora, A. (2022) · Future Healthcare Journal · doi:10.7861/fhj.2022-0013 · Cited by 161
Language models are an effective representation learning technique for electronic health record data
Steinberg, E., Jung, K., Fries, J. A., Corbin, C. K., Pfohl, S. R., & Shah, N. H. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103637 · Cited by 132
Self-citationEthical considerations about artificial intelligence for prognostication in intensive care
Beil, M., Proft, I., van Heerden, D., Sviri, S., & van Heerden, P. V. (2019) · Intensive Care Medicine Experimental · doi:10.1186/s40635-019-0286-6 · Cited by 124
Perturbation Sensitivity Analysis to Detect Unintended Model Biases
Prabhakaran, V., Hutchinson, B., & Mitchell, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1578 · Cited by 115
Ong, J. C. L., Seng, B. J. J., Law, J. Z. F., Low, L. L., Kwa, A. L. H., Giacomini, K. M., & Ting, D. S. W. (2024) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101356 · Cited by 111
Self-citationThe case for algorithmic stewardship for artificial intelligence and machine learning technologies
Eaneff, S., Obermeyer, Z., & Butte, A. J. (2020) · JAMA · doi:10.1001/jama.2020.9371 · Cited by 101
Self-citationReddy, S. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101304 · Cited by 99
ChatGPT and Physicians’ Malpractice Risk
Mello, M. M., & Guha, N. (2023) · JAMA Health Forum · doi:10.1001/jamahealthforum.2023.1938 · Cited by 80
The Emerging Role of Generative Artificial Intelligence in Medical Education, Research, and Practice
Shoja, M. M., Van de Ridder, J. M. M., & Rajput, V. (2023) · Cureus · doi:10.7759/cureus.40883 · Cited by 69
AI-generated text may have a role in evidence-based medicine
Peng, Y., Rousseau, J. F., Shortliffe, E. H., & Weng, C. (2023) · Nature Medicine · doi:10.1038/s41591-023-02366-9 · Cited by 64
Capturing Failures of Large Language Models Via Human Cognitive Biases
Jones, E., & Steinhardt, J. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-0856 · Cited by 48
The Artificial intelligence large language models and neuropsychiatry practice and research ethic
Zhong, Y., Chen, Y.-J., Zhou, Y., Lyu, Y.-A.-H., Yin, J.-J., & Gao, Y.-J. (2023) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2023.103577 · Cited by 44
Capturing Failures of Large Language Models via Human Cognitive Biases
Jones, E., & Steinhardt, J. (2022) · arXiv · doi:10.48550/arxiv.2202.12299 · Cited by 43
Caution with AI-generated content in biomedicine
Zhavoronkov, A. (2023) · Nature Medicine · doi:10.1038/d41591-023-00014-w · Cited by 39
Ethical and methodological challenges in building morally informed AI systems
Hagendorff, T., & Danks, D. (2023) · AI and Ethics · doi:10.1007/s43681-022-00188-y · Cited by 36
Ravi, A., Neinstein, A., & Murray, S. G. (2023) · ATS Scholar · doi:10.34197/ats-scholar.2023-0036ps · Cited by 31
The Unintended Consequences of Censoring Digital Technology - Evidence from Italy's ChatGPT Ban
Kreitmeir, D., & Raschky, P. A. (2023) · doi:10.31235/osf.io/v3cgs · Cited by 15
Generative Artificial Intelligence in Healthcare: Ethical Considerations and Assessment Checklist
Ning, Y., Teixayavong, S., Shang, Y., Savulescu, J., Nagaraj, V., Miao, D., Mertens, M., Ting, D. S. W., Ong, J. C. L., Liu, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.02107 · Cited by 9
Self-citation
Research works printed but not linked: 39
- Open AI Achiam J Adler S et al. GPT-4 technical report. March 15 2023 (https://arxiv.org/abs/2303.08774). Preprint. · arXiv
- Huang K Altosaar J Ranganath R. ClinicalBERT: modeling clinical notes and predicting hospital readmission. April 10 2019 (https://arxiv.org/abs/1904.05342). Preprint. · arXiv
- 10.1001/jamanetworkopen.2023.30320 · DOI · Paper page
- ICML. Clarification on large language model policy LLM. 2023 (https://icml.cc/Conferences/2023/llm-policy).
- 10.1038/d41586-022-03539-1 · DOI
- Zvyagin M Brace A Hippe K et al. GenSLMs: genome-scale language models reveal SARS-CoV-2 evolutionary dynamics. November 23 2022 (https://www.biorxiv.org/content/10.1101/2022.10.10.511571v2). Preprint. · doi:10.1101/2022.10.10.511571v2
- Jadon A Kumar S. Leveraging generative AI models for synthetic data generation in healthcare: balancing research and privacy. May 9 2023 (https://arxiv.org/abs/2305.05247). Preprint. · DOI · Paper page
- Van Veen D Van Uden C Blankemeier L et al. Clinical text summarization: adapting large language models can outperform human experts. October 30 2023 (https://pubmed.ncbi.nlm.nih.gov/37961377/). Preprint. · DOI · Paper page
- 10.1001/jamaophthalmol.2023.3314 · DOI
- 10.1016/j.xagr.2023.100165 · DOI · Paper page
- 10.1001/jama.268.11.1412 · doi:10.1001/jama.268.11.1412
- 10.1001/jamanetworkopen.2023.38050 · DOI
- Li C Zhang M Mei Q et al. Teach LLMs to personalize — an approach inspired by writing education. August 15 2023 (https://arxiv.org/abs/2308.07968). Preprint. · arXiv
- 10.1080/15265161.2022.2075968 · DOI
- Talboy AN Fuller E. Challenging the appearance of machine intelligence: cognitive bias in LLMs and best practices for adoption. April 3 2023 (https://arxiv.org/abs/2304.01358). Preprint. · arXiv
- Zack T Lehman E Suzgun M et al. Coding inequity: assessing GPT-4’s potential for perpetuating racial and gender biases in healthcare. July 16 2023 (https://www.medrxiv.org/content/10.1101/2023.07.13.23292577v1). Preprint. · DOI · Paper page
- 10.7759/cureus.39305 · DOI · Paper page
- 10.7759/cureus.38380 · DOI · Paper page
- 10.1001/jama.2023.9651 · DOI · Paper page
- 10.1186/s13010-023-00129-5 · DOI
- Ke Y Jin L Elangovan K et al. Development and testing of retrieval augmented generation in large language models — a case study report. January 29 2024 (https://arxiv.org/abs/2402.01733). Preprint. · DOI
- 10.1016/S2589-7500(23)00229-7 · doi:10.1016/s2589-7500(23)00229-7
- 10.1007/s11245-023-09911-8 · DOI · Paper page
- 10.1080/03605310590926812 · doi:10.1080/03605310590926812
- 10.1080/03605310590926821 · doi:10.1080/03605310590926821
- 10.1371/journal.pone.0271122 · DOI
- Kraljevic Z Bean D Shek A et al. Foresight — generative pretrained transformer (GPT) for modelling of patient timelines using EHRs. December 13 2022 (https://arxiv.org/abs/2212.08072). Preprint. · arXiv
- Chen C Feng X Zhou J Yin J Zheng X. Federated large language model: a position paper. July 18 2023 (https://arxiv.org/abs/2307.08925). Preprint. · arXiv
- 10.1016/j.oret.2022.03.019 · DOI
- Jiang J Liu X Fan C. Low-parameter federated learning with large language models. July 26 2023 (https://arxiv.org/abs/2307.13896). Preprint. · arXiv
- Yang W Li C Zhang J Zong C. BigTranslate: augmenting large language models with multilingual translation capability over 100 languages. May 29 2023 (https://arxiv.org/abs/2305.18098). Preprint. · arXiv
- Doddapaneni S Ramesh G Khapra MM Kunchukuttan A Kumar P. A primer on pretrained multilingual language models. July 1 2021 (https://arxiv.org/abs/2107.00676). Preprint. · arXiv
- 10.3350/cmh.2023.0089 · DOI · Paper page
- 10.1001/jamaoto.2023.0704 · DOI · Paper page
- Luchetti M. Global health and the 10/90 gap. BJMP 2014;7:a731. https://www.bjmp.org/content/global-health-and-1090-gap.
- 10.1001/jamapsychiatry.2023.1253 · DOI · Paper page
- 10.1001/jamaoncol.2023.2867 · DOI
- 10.1002/humu.23644 · DOI · Paper page
- 10.1038/s41467-022-28594-0 · DOI
Cited by
Large Language Models and Empathy: Systematic Review
Sorin, V., Brin, D., Barash, Y., Konen, E., Charney, A., Nadkarni, G., & Klang, E. (2024) · Journal of Medical Internet Research · doi:10.2196/52597 · Cited by 240
“While LLMs have the potential to improve and automate some medical tasks, there are significant limitations to these models and their integration [10,11].”
Benchmark evaluation of DeepSeek large language models in clinical decision-making
Sandmann, S., Hegselmann, S., Fujarski, M., Bickmann, L., Wild, B., Eils, R., & Varghese, J. (2025) · Nature Medicine · doi:10.1038/s41591-025-03727-2 · Cited by 233
“However, the integration of LLMs into clinical practice is not without challenges, necessitating careful validation and ethical considerations 6,7 .”
Berkhout, W. E. M., van Wijngaarden, J. J., Workum, J. D., van de Sande, D., Hilling, D. E., Jung, C., Meyfroidt, G., Gommers, D., Buijsman, S. N. R., & van Genderen, M. E. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.22866 · Cited by 75
Nong, P., & Ji, M. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf031 · Cited by 40
Bejan, C. A., Wang, M., Venkateswaran, S., Bergmann, E. A., Hiles, L., Xu, Y., Chandler, G. S., Brondfield, S., Silverstein, J., Wright, F., et al. (2026) · eBioMedicine · doi:10.1016/j.ebiom.2026.106227 · Cited by 24
“48 In the context of irAEs, biased GPT models may disproportionately misclassify patients from certain groups, resulting in their underrepresentation in pharmacoe-pidemiologic research and delayed identification in pharmacovigilance efforts, which could potentially compromise timely care and…”
Metadata
- Authors
- Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., & Ting, D. S. W.
- Venue
- NEJM AI
- Publisher
- Massachusetts Medical Society
- Published
- 2024-06-27
- Volume
- 1
- Issue
- 7
- ISSN
- 2836-9386 (ISSN-L)
- OpenAlex
- W4399737726
- Cited by
- 58
- References
- 61
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.