What Disease Does This Patient Have? A Large-Scale Open Domain Question Answering Dataset from Medical Exams
Open accessPublished version of a preprint
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a machine comprehension model. Through experiments, we find that even the current best method can only achieve 36.7%, 42.0%, and 70.1% of test accuracy on the English, traditional Chinese, and simplified Chinese questions, respectively. We expect MedQA to present great challenges to existing OpenQA systems and hope that it can serve as a platform to promote much stronger OpenQA models from the NLP community in the future.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“given that medical question datasets such as PubMedQA42 and MedQA43 consist of fixed question sets susceptible to memorization”
From An automated framework for assessing how well LLMs cite relevant medical references (2025) · cites this paper as [42]
In the citing paper
“Notably, in healthcare, medical NLP benchmarks like MedQA7, PubMedQA8 and the Massive Multitask Language Understanding (MMLU) serve as the de-facto reporting standard for state-of-the-art medical LLMs9–11 with claims of ‘superhuman’ performance in patient-facing tasks12.”
From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [7]
In the citing paper
“Current practice relies heavily on static, fixed-length benchmarks such as, MedQA2, MMLU-Med3, and MedBench4.”
From Leveraging computerized adaptive testing for cost-effective evaluation of large language models in medical benchmarking (2026) · cites this paper as [2]
In the citing paper
“Large-scale medical benchmarks often comprise tens of thousands of multiple-choice questions (MCQs) (e.g., MedQA: 12,723 items2; MedMCQA: 6,150 items9; MedBench: 40,041 items4; Med-HALT: 59,254 items10), leading to substantial token consumption and API costs—particularly for proprietary models.”
From Leveraging computerized adaptive testing for cost-effective evaluation of large language models in medical benchmarking (2026) · cites this paper as [2]
In the citing paper
“(5) MedQA, introduced by Jin et al. (2021), using the USMLE subset.”
From Sabotage Evaluations for Frontier Models (2024) · cites this paper as Jin et al. (2021)
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
Know What You Don't Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03822 · Cited by 2,242
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.740 · Cited by 2,103
Language Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1250 · Cited by 1,834
Research works printed but not linked: 3
- Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv.
- Dhingra, B., Mazaitis, K., and Cohen, W.W. (2017). Quasar: Datasets for Question Answering by Search and Reading. arXiv.
- Das, R., Dhuliawala, S., Zaheer, M., and McCallum, A. (2019). Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answering. arXiv.
Cited by
Items 601–700 of 762
Game-Theoretic Insights into Multi-Agent LLM Debate for Enhanced Clinical Question Answering
Sudhakara, S., & Sudhakara, S. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461952
Biomed-R 2 : Joint Diversity Retrieval and Evidence Reasoning for Biomedical Question Answering
Guan, H., Li, C., Zhang, W., Lian, Y., Guo, J., & Lü, W. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463381 · Cited by 1
RGPO: Ranking-Guided Preference Optimization for Reliable Clinical Reasoning
Hsu, C. T., Ding, J.-E., Hsu, H.-L., Hsu, C.-H., Yang, S., Yao, L.-H., Liao, C.-C., Liu, F., & Hung, F. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3688221
Aruna Gladys, A., Aishwarya, R., Vetriselvi, V., Daphne, S., Baskar, P. N., & Rajan, A. A. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10598-4 · Cited by 3
Addressing challenges in agentic retrieval of structured data from biomedical databasesPreprint
Halder, A., Singh, M., Kesarwani, R., Mathew, B., Bhattacharya, N., Chikhaliya, O., Motwani, D., Peela, S. C. M., Samanta, S., Nagdev, H., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.04.25.720782
A Comprehensive Analysis of Advancements in Medical Decision Support Systems
Mehra, S., Jain, B., Rani, D., Singh, P., & Varshney, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-19185-4_22
MediAI: A Specialized Medical LLM for Accurate Diagnosis and Clinical Documentation
Jain, C., Gola, K. K., Kaushik, A., Saini, A., & Vashistha, M. (2026) · Springer eBooks · doi:10.1007/978-981-95-4831-6_1
Ariel, D., Grumberg, L. R., Supakul, S., Wannasri, S., Mitchnik, I. Y., Lev, A., Ariyamethanon, W., Agbarieh, M., Miari, S., Laban, G., et al. (2026) · medRxiv · doi:10.64898/2026.05.09.26352813
Shi, P., Shui, Y., Jin, R., & Pan, Q. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00825-0 · Cited by 1
MonoRouter: Enforcing Monotonicity in Item Response Theory for LLM Routing
Zhu, Y. (2026) · International Conference on Generative Artificial Intelligence and Information Security (GAIIS) · doi:10.1109/gaiis69281.2026.11519177
田, 行. (2026) · Modeling and Simulation · doi:10.12677/mos.2026.155082
Iterative Dynamic Routing Framework for Medical Question Answering
Wang, C., Yang, X., Zhu, Y., Sun, M., Li, M., & Zhang, W. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7299-1_2
Performance of Large Language Models in Neurology Multiple‐Choice Questions
Habibi, G., Gargari, O. K., Hosseini, M., & Afchangi, K. (2026) · Acta Neurologica Scandinavica · doi:10.1155/ane/5623086
Building AI Benchmarks from Exam Documents
Kressig, B., Koller, N., & Schlag, I. (2026) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds70563.2026.00017
How Low Can Medical Llms Go? an Empirical Study of Low-Bit Quantization
Tasfia, T., Masum, A. K. M., Meyer, E., Cumbo, F., & Aygün, S. (2026) · IEEE Dallas Circuits and Systems Conference (DCAS) · doi:10.1109/dcas69364.2026.11545012 · Cited by 1
Proulx, J., Daines, B., Barton, M. B., Leonard, M. E., Garcia, J. A., Young, B., Snell, Q. O., West, T. W., Watson, S. R., Alqaseer, M., et al. (2026) · medRxiv · doi:10.64898/2026.06.05.26354271 · Cited by 1
MemSpec: Memory-Aware Runtime for Adaptive Draft Scheduling in Speculative Decoding on Edge Devices
Kim, E., Jeon, Y. J., & Han, M. (2026) · ACM SIGPLAN/SIGBED Conference on Languages, Compilers, and Tools for Embedded Systems (LCTES) · doi:10.1145/3814943.3816174
Evaluating teacher-supervised small medical language models for institution-constrained clinical QA
Du, G., Dimitriadis, D., & Li, X. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105095
Hwang, J., Namayanja, D. L., & Park, D. (2026) · JMIR AI · doi:10.2196/92843
A Retrieval-Augmented Medical Chatbot for Evidence-based Clinical Question Answering
Beuria, C., Shaw, P., Mohan, M., & J.Shanthini (2026) · International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV) · doi:10.1109/icicv68925.2026.11554752
Zhan, Z., Zhou, S., & Zhang, R. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag042 · Cited by 4
Seo, J., Kim, T., & Kim, J.-H. (2026) · Journal of Medical Internet Research · doi:10.2196/95877 · Cited by 1
Wang, Z., & Wang, L. (2026) · Machine Intelligence Research · doi:10.1007/s11633-025-1602-0
Gan, C., Cai, Y., Qian, S., Jin, S., Fu, B., Zhao, T., & Li, D. (2026) · Symmetry · doi:10.3390/sym18061048
Zhong, Q., Gong, J., Zhu, K., Liao, F., Liu, J., & Du, B. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116524
Wan, S., Zhang, J., Zhao, Z., & Ren, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37654-1_29
Basu, S., Patel, S., Sheth, P., Morgan, J., & Batniji, R. (2026) · Research Square · doi:10.21203/rs.3.rs-10153003/v1
PPAI: Enabling Personalized LLM Agent Interoperability for Collaborative Edge Intelligence
Wang, Z., Liu, Q., Guo, K., Wang, H., Lin, J., Hong, Z., & Guo, S. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571683 · Cited by 3
Beyond Price: A Technical Quality Framework for AI Antitrust
Wu, P. Y. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812338
Generative AI for healthcare: fundamentals, challenges, and perspectives
Chen, G., Liu, C., Anne, O. G., Tan, M., Xie, Z., Yin, J., Yip, J. W. L., Zhang, W., ZHU, J., & Ooi, B. C. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4927-2 · Cited by 10
Shanid, M., Prasad, G., Bawgi, V., & Gowda, S. (2026) · IEEE International Conference on Emerging Synergy Science and Technology (ICESST) · doi:10.1109/icesst69086.2026.11582854
Per-FedLoRA: Personalized Federated LoRA Fine-Tuning for Multi-Task Large Language Models
Chen, Z. L., Ji, Y., Peng, H. H., Wang, B., Shi, L., Zeng, Z., & Zhang, X. (2026) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc69287.2026.11580063
RoMa: A Credibility-Aware Fault-Tolerance Framework for LLM Multi-Agent Systems
Li, K., & Wu, F. (2026) · International Conference on Computer Supported Cooperative Work in Design · doi:10.1109/cscwd68734.2026.11582680
CKG-RAG: Enhancing LLM Reasoning in Medical Domain Using Contextual Knowledge Graphs
Zhang, J., Zhou, X., Qiao, X., Zhang, W., Chen, G., Zheng, X., Liu, C., & Lü, W. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582487
尚伯义, Gan, H.-S., Xue, D., Yu, B., Zhou, M., & Mukhtar, H. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11581587
VAIDYA: Validated Agents for Intelligent Diagnosis and Yielded Analysis
Shah, K., Bhutani, G., Sarbhangia, R., & Snehan, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30813-9_6
Li, C., Huang, S., Liu, J., Lei, M., Xing, J., Wu, K., Wang, L., & Luo, F. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3711494
A Cloud Native Data and Intelligence Framework for Medical Reasoning and Digital Health Analysis
Arya, P., M, D. B., & Khanna, M. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.356
RED: Retrieval-enhanced knowledge distillation for smaller language models
Li, X., Peng, S., Wakamiya, S., & Aramaki, E. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133599
Language Bias in Multilingual RAG: A Case Study in the Japanese Medical Domain
Huang, J., Cheng, F., Jiang, J., Kobayashi, K., & Aizawa, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-20897-2_9
Evaluating Parameter-Efficient Fine-Tuning of Open-Weight LLMs for Medical Question Answering
Zidan, A. H., Uddin, B., Ema, N. J., Amin, M. H., Uddin, M. S., & Ahmed, T. (2026) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn70047.2026.11594337
NumColBERT: Non-Intrusive Numeracy Injection for Late-Interaction Retrieval Models
Fujimaki, H., & Kato, M. P. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809688
Question-Type-Aware Methodology for Prompt Selection to Optimise Energy Usage
Khan, T., Kumar, V. K., & Ryan, C. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-30809-2_7
MedConf-RAG: Reliable Medical LLMs with Gated Graph Integration and Conformal Factuality Guarantees
Huang, X., Bu, Y., Zhang, N., Zhang, Y., Sheng, H., & Li, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2856-0_39 · Cited by 1
CauMed: Causal Graph-Based Reasoning for Medical QA
Narknoi, P., Dao, C.-T., Phan, T. T., & Peng, W.-C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2014-4_1
Tong, Y., Guo, W., & Cai, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3498-1_1
Explainable Medical LLM Combined Chain-of-Thought with Reinforcement Learning
Zhu, Z., Liu, P., Liu, X., Yuan, Y., Ge, Y., & Lu, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3495-0_34
Agarwal, R., Saini, S., Garg, R., & Rao, A. R. (2026) · IEEE International Conference on Smart Information Systems and Technologies (SIST) · doi:10.1109/sist61674.2026.11596307
Yu, Z., & Liu, X. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105081
Zhou, Z., Xue, C., & Zhuang, N. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3495-0_25
Zhang, X., Nie, X., Liu, Y., & Wang, Z. (2026) · Mathematics · doi:10.3390/math14142562
Knowledge Graphs vs. SQL over Structured EHR Data
Anagnou, L., Vezakis, A., Vezakis, I., Kakkos, I., Πετροπούλου, Ο., & Matsopoulos, G. K. (2026) · Future Internet · doi:10.3390/fi18070365
Dwivedi, R., Dwivedi, U. D., Keshari, Y. R., Kusal, S., & Mahadevkar, S. V. (2025) · IEEE Conference on Engineering Informatics (ICEI) · doi:10.1109/icei68356.2025.11603691
Niu, Z., Du, C., Wang, B., Song, Y., Xiong, J., & Li, L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3426-4_36
Style-Based Bias Backdoor Attacks on Medical LLMs Under In-Context Learning
Jiang, Y., Xiao, S., Lin, J., Hao, F., & Gu, T. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3426-4_7
Rafiei, A., Seo, J., Yürdem, B., & Çatak, F. Ö. (2026) · International Conference on Human Centric Artificial Intelligence (ICHCAI) · doi:10.1109/ichcai70183.2026.11607654
Zhang, X., WILSON, C. L., Eyre, H., Reed, D. E., Wai, T. H., Kloehn, A. T., Rosser, E. W., Luo, G., & Zeliadt, S. B. (2026) · JMIR Research Protocols · doi:10.2196/96346
Yang, M.-A., & Ha, K.-S. (2026) · BioMedInformatics · doi:10.3390/biomedinformatics6040049
Abayakoon, I., Altiary, M., & Hussain, F. K. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116692
Evaluating Open-Weight Large Language Models for a Local Clinical Assistant
Pires, M. J., & Véstias, M. (2026) · International Young Engineers Forum (YEF-ECE) · doi:10.1109/yef-ece70590.2026.11614644
Multi-Agent Medical Debate System for Clinical Reasoning
Bhoyar, S., Ansari, A., & Saxena, N. (2026) · IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT) · doi:10.1109/iaict71158.2026.11620877
Gandikota, L. R., Jegathesan, V., & Reddy, C. D. R. (2026) · International Conference on Artificial Intelligence Systems (AIS) · doi:10.1109/ais69919.2026.11621058
KGMedQA: An automated and comprehensive KG-based benchmark for biomedical LLM assessment
Hao, Q., Cheng, K., Liu, X., Wang, H., Shao, J., & Yang, C. (2026) · AI Open · doi:10.1016/j.aiopen.2026.07.001
iBRAHIMOĞLU, N., Demirezen, M. U., & Yıldız, F. (2026) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-026-01490-x · Cited by 2
Hallucination Is Not One Thing: A Two-Axis Taxonomy for Structured Diagnosis in Generative AI
Khan, M., Billion-Polak, P., & Khoshgoftaar, T. M. (2026) · IEEE Access · doi:10.1109/access.2026.3718830
Keuchel, M., Bisgin, P., Strube, T., Tschorn, N., Weltermann, L., & Meister, S. (2026) · JMIR Research Protocols · doi:10.2196/93509
Kaumenova, T., Chakraborty, S., Fosler‐Lussier, E., Gofar, K., Metcalf, I., Perrault, A., & White, M. (2026) · JMIR AI · doi:10.2196/88581 · Cited by 1
Vatsal, S., Dubey, H., & Bajaj, A. (2026) · IEEE Access · doi:10.1109/access.2026.3720396
Zhang, J., Li, Y., Feng, X., Zhang, L., Huang, Z., & Chen, C. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818853
EHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMs
Xie, Y., Han, K., Xiao, Y., Cui, H., Wu, G., Zhang, Z., Shu, K., Lu, J., Hu, X., & Yang, C. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817571 · Cited by 3
Jeon, K., Ko, Y., Jung, W., & Kim, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818040
SAFT: Safety-Preserving Adaptation via Fine-Tuning Transfer for Large Language Models
Ruan, Z., Yang, Y., Liang, Z., Chen, Y., & Chen, G. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817883
Evaluating large language models in specialized myopia knowledge and clinical reasoning
Li, Z., Xin, N., Wang, T., Li, X., & Jia, X. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1886498
Closing Reasoning Gaps in Clinical Agents with Differential Reasoning Learning
Liu, J., Jiang, Y., Krishnan, R., Padman, R., Zhang, Y., & Bian, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818958
LEAP: Learning-Dynamics-Guided Open-Loop Pricing for LLM Data Acquisition
Wang, Z., & Wang, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817932
RELIANCE: Curating and Evaluating Reproductive Health Information on Social Media
Balloli, V., Ellis, L. P., Mishra, V., Chi, A., Peahl, A. F., & Bondi, E. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817447 · Cited by 2
Chatbots for Healthcare: A Literature Review
Gupta, A., Kaushik, A., Sharma, H., & Archita (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-25694-2_28
Data and Knowledge Dual-Driven Text Embedding Approaches: A Survey
Chen, X., 詹佳青, Lin, J., Liu, H., Zhang, Q., Chen, J., & Chen, H. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3721883
From Similarity to Answerability: Reliable Medical Retrieval via LLM-Driven Utility Distillation
Ding, Z., & Chen, T. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00221
MediHive: A Decentralized Agent Collective for Medical Reasoning
Wang, X., & Yang, C. C. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00114
MetSEval-1k: A Comprehensive Benchmark for Evaluating Large Language Models in Meteorology
Yu, T., Wang, K., Li, Z. M., Wang, M., Chen, Y., Chen, H., Zhao, R., Xu, Y., Song, Y., & Xu, B. (2026) · Applied Sciences · doi:10.3390/app16168032
MedHopper: an agentic RAG-LLM system for multi-hop biomedical QA
Taktashov, R., Biziukova, N. Y., Dmitriev, A. V., & Tarasova, O. A. (2026) · Database · doi:10.1093/database/baag047
Assistant agent for smart classroom application: Past, present and future direction
Nguyen, T. A., Yến, H. T. N., & Ahn, Y. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-41632-3.00015-1
MEMRL: Aligning Medical Reasoning through Maximum Entropy Implicit Process Supervision
Zhu, X., & He, S. (2026) · IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE) · doi:10.1109/eespe68405.2026.11649286
Gao, J., Dong, L., & Hu, J. (2026) · doi:10.2196/preprints.109941
Black, K. C., Bunning, B., Jiang, Y., & Chen, J. H. (2026) · The Lancet Digital Health · doi:10.1016/j.landig.2026.101057 · Cited by 1
An interoperable research agent network for scientific discoveryPreprint
Cheong, T. L., Ji, X., Wang, Y., Zhou, Y., Li, B., Zhang, C., Huang, J., Wu, I., Li, A., & Cheung, E. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.08.13.744542
Framework for Grounding Healthcare LLMs in a Causal Knowledge Graph: A Cardiovascular ExamplePreprint
Mumtaz, U., Noor, A., & Ahmed, A. (2026) · Research Square · doi:10.21203/rs.3.rs-10720346/v1
Arzu, G. E., Umar, M., Fayaz, M., Ali, U., Dang, L. M., & Moon, H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116901
Yahan, M., Das, D., Zaman, M. T., Farabi, F., Sarker, K. U., & Islam, M. A. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-92-3681-7_28
GS-Chaff: Multi-Agent Prompt-Level Semantic Chaffing for Privacy-Preserving LLM Inference
Zhou, Q., Wang, Z., Yue, Z., Cai, L., Liu, K., & Qin, C. (2026) · Sensors · doi:10.3390/s26175385
MedEthicsBench: Evaluating Medical Ethics Reasoning Across Jurisdictions
Kang, Y., Lee, S.-Y., Chu, L., Qu, W., Liu, W., Hou, C., Wu, S., Cao, L., & Chu, W. C. (2026) · IEEE International Conference on Digital Health (ICDH) · doi:10.1109/icdh72779.2026.00031
Physician Edits to AI-Drafted Patient Messages and Their Impact on Clinical Workload
Poursoltan, L., Cao, J., Chen, W., Kim, E., Nakai, T. K., Boussina, A. E., Chua, A., Pan, J., Millen, M. M., Tai‐Seale, M., et al. (2026) · NEJM AI · doi:10.1056/aioa2501034 · Cited by 2
Neurosymbolic Large Language Models: A Survey of Symbolic Integration, Reasoning and Explainability
Rani, M., Mishra, B. K., & Thakker, D. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10794-4 · Cited by 2
Alomair, S. M., Alsuwayq, M., Alabbad, W., Albeladi, K., & Alhassan, Z. Q. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1934432
AI safety is a system property, not a sum of individual defenses
Chen, X., Lin, C., Zhu, L., Xu, Y., Su, J., & Wu, C. (2026) · Patterns · doi:10.1016/j.patter.2026.101686
Khaizaran, D., & Alhoori, H. (2026) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1109/chase69719.2026.00063
Guo, C., Zheng, J., Su, P., Tian, Z., Tang, J., Li, S., & Wang, T. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105112
Metadata
- Authors
- Jin, D., Pan, E., Oufattole, N., Weng, W.-H., Fang, H., & Szolovits, P.
- Affiliations
- Massachusetts Institute of Technology (US)
- Huazhong University of Science and Technology (CN)
- Computer Science and Artificial Intelligence, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
- Corresponding author
- Jin, Di
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2021-07-12
- Volume
- 11
- Issue
- 14
- Pages
- 6421
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3162922479
- Cited by
- 718
- References
- 41
- Citations by year
- 2026: 285 · 2025: 241 · 2024: 120 · 2023: 51 · 2022: 12 · 2021: 9
- FWCI
- 16.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- Preprints.org (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- open-domain question answering, medical question answering, multiple-choice questions, Chinese language, document retrieval, machine reading comprehension, disease diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.