PubMedQA: A Dataset for Biomedical Research Question Answering
Open accessThe DOI matches its Crossref record; 24 of the 26 references it cites were found in a registry or an index.
Abstract
Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William Cohen, Xinghua Lu. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“given that medical question datasets such as PubMedQA42 and MedQA43 consist of fixed question sets susceptible to memorization”
From An automated framework for assessing how well LLMs cite relevant medical references (2025) · cites this paper as [43]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“All analyses were performed on publicly available, de-identified benchmark datasets—MIRAGE [23], PubMedQA [24], and the medical licensing examination questions of Katz et al. [25]—used in accordance with their respective licenses and terms of use.”
From The economics of accuracy for medical reasoning with large language models (2026) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“PubMedQA (Jin et al., 2019) is a biomedical research QA dataset under the MIT license. It contains 1,000 expert-annotated questions ( pqa\_labeled\_split ) and 211K machine-labeled questions from PubMed abstracts (the most widely used biomedical literature resource).”
From MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Models (2025) · cites this paper as Jin et al., 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Notably, in healthcare, medical NLP benchmarks like MedQA7, PubMedQA8 and the Massive Multitask Language Understanding (MMLU) serve as the de-facto reporting standard for state-of-the-art medical LLMs9–11 with claims of ‘superhuman’ performance in patient-facing tasks12.”
From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“The ground truth question-answer pairs are sourced from the pqa\_labeled split of PubMedQA (Jin et al., 2019), which contains 1,000 expert-annotated samples, supplemented with 9,000 instances randomly selected from the pqa\_artificial split.”
From MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Models (2025) · cites this paper as Jin et al., 2019
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 2×
“We fine-tune BioBERT (Lee et al., 2019) on Pub-MedQA as a baseline.”
MethodThe Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“Unlike other QA datasets in which questions are asked by crowd-workers for existing contexts (Rajpurkar et al., 2016; Yang et al., 2018; Kočiskỳ et al., 2018), in PubMedQA contexts are generated to answer the questions and both are written by the same authors.”
BackgroundNatural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069 · cited 6×
“, 2018), Natural Questions (Kwiatkowski et al., 2019), ShARC (Saeidi et al.”
BackgroundMethodInfluentialBoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
Clark, C., Lee, K., Chang, M.-W., Kwiatkowski, T., Collins, M., & Toutanova, K. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1300 · Cited by 1,855
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., & Manning, C. D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1259 · Cited by 1,804 · cited 6×
“Supporting fact for the answer is highlighted . et al., 2018; Yang et al., 2018; Kwiatkowski et al., 2019), the largest annotated biomedical QA dataset, BioASQ (Tsatsaronis et al., 2015) has less than 3k training instances, most of which are simple factual questions.”
BackgroundMethodInfluentialSelf-citationEnhanced LSTM for Natural Language Inference
Chen, Q., Zhu, X., Ling, Z.-H., Wei, S., Jiang, H., & Inkpen, D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1152 · Cited by 1,113
Research works printed but not linked: 1
- 2012 Conference and Labs of the Evaluation ForumQuestion Answering For Machine Reading Evaluation (QA4MRE), Rome/Forner, J.[edit.]; ea , pages 1-14.
Cited by
Items 801–900 of 1,026
Knowing When Not to Answer: Abstention-Aware Scientific ReasoningPreprint
Abdaljalil, S., Serpedin, E., & Kurban, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.14189 · Cited by 7
OptiLeak: Efficient Prompt Reconstruction via Reinforcement Learning in Multi-tenant LLM ServicesPreprint
Wang, L., Zheng, X., Zhang, X., Zhang, Y., Wu, Y., & Wang, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.20595 · Cited by 7
MedMASLab: A Unified Orchestration Framework for Benchmarking Multimodal Medical Multi-Agent SystemsPreprint
Qian, Y., Hu, X., Yu, J., Xin, S., Chen, X., Zhang, J., Jiang, P.-T., Liu, J., & Li, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.09909 · Cited by 6
Meissa: Multi-modal Medical Agentic IntelligencePreprint
Chen, Y., Bai, X., Pan, Y., Zhou, Z., & Yuille, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.09018 · Cited by 6
Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsPreprint
Oermann, E. K., Jiang, L. Y., Chen, A., Han, X., Liu, C., Dua, R., Eaton, K., Wolff, F., Steele, R. J., Zhang, J., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9078142/v1 · Cited by 6
Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical TasksPreprint
Warner, B., Grandhi, R. S., Kieffer, M., Ouraq, A., Panigrahi, S., Ambwani, G., Bagga, K., Khandekar, N., Hariharan, A., Mishra, N., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.01417 · Cited by 6
Multi-Stream LLMs: Unblocking Language Models with Parallel Streams of Thoughts, Inputs and OutputsPreprint
Su, G., Yang, Y., Li, X., & Geiping, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.12460 · Cited by 6
ClinEnv: An Interactive Multi-Stage Long Horizon EHR Environment for AgentsPreprint
Lu, Y., Lin, Y., Shi, W., Tamo, J. B., Zhao, X., Wang, J., & Wang, M. D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.02568 · Cited by 6
Characterizing LLM Abstention Behavior in Science QA with Context Perturbations
Wen, B., Howe, B., & Wang, L. L. (2024) · arXiv · doi:10.48550/arxiv.2404.12452 · Cited by 5
MedRedQA for Medical Consumer Question Answering: Dataset, Tasks, and Neural Baselines
Nguyen, V., Karimi, S., Rybinski, M., & Xing, Z. (2023) · Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.ijcnlp-main.42 · Cited by 5
Language models scale reliably with over-training and on downstream tasks
Gadre, S. Y., Smyrnis, G., Shankar, V., Gururangan, S., Wortsman, M., Shao, R., Mercat, J., Fang, A., Li, J., Keh, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2403.08540 · Cited by 5
OpenResearcher: Unleashing AI for Accelerated Scientific Research
Zheng, Y., Sun, S., Qiu, L., Ru, D., Jiayang, C., Li, X., Lin, J., Wang, B., Luo, Y., Pan, R., et al. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2024.emnlp-demo.22 · Cited by 5
Sparse*BERT: Sparse Models Generalize To New tasks and Domains
Campos, D., Marques, A., Nguyen, T., Kurtz, M., & Zhai, C. (2022) · arXiv · doi:10.48550/arxiv.2205.12452 · Cited by 5
“For QA we leverage BioASQ task 7B (Baker et al., 2016) and PubMedQA (Jin et al., 2019).”
MethodSFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe
Xiao, Y., Zhang, S., Ghassemi, M., & Zhou, W. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.78 · Cited by 5
Adapter-Based Approaches to Knowledge-Enhanced Language Models: A Survey
Fichtl, A. M., Vladika, J., & Groh, G. (2024) · International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management · doi:10.5220/0013058500003838 · Cited by 5
Garcia, G. L., Manesco, J. R. R., Paiola, P. H., Ribeiro, P. H. C., Garcia, A. L. A., & Papa, J. P. (2025) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms65348.2025.00052 · Cited by 5
Sakhovskiy, A., & Tutubalina, E. V. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729901 · Cited by 5
Ung, C. Y., Correia, C., Zhang, Z. M., Caya, C., Zhu, S., Billadeau, D. D., & Li, H. (2025) · Cancers · doi:10.3390/cancers17213543 · Cited by 5
Efficient Medical Question Answering Through QLoRA Fine-Tuning and Knowledge Distillation
Brzęk, B., & Dziczkowski, G. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.268 · Cited by 5
Building Trust in Clinical LLMs: Bias Analysis and Dataset Transparency
Maslenkova, S., Christophe, C., Pimentel, M. A., Raha, T., Salman, M., Mahrooqi, A. A., Gupta, A., Khan, S., Rajan, R., & Kanithi, P. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1174 · Cited by 5
Kim, K., Kim, J., Jung, H., Mortensen, D. R., & Seo, J.-M. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11254331 · Cited by 5
Ko, Y., Seo, S., & Kim, H. (2025) · neural information processing systems · doi:10.52202/085713-4976 · Cited by 5
Şahin, M. Z., Derdiyok, F. B., Kılıç, S. A., Serbest, K., & Nas, K. (2026) · Bioengineering · doi:10.3390/bioengineering13010125 · Cited by 5
Fractional Rotation, Full Potential? Investigating Performance and Convergence of Partial RoPE
Khan, M. A., Gummadi, K. P., Gupta, M., & Ravichander, A. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1455 · Cited by 5
A Survey on LLM-Assisted Clinical Trial Recruitment
Ghosh, S., Schneider, M., Reinicke, C., & Eickhoff, C. (2025) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2025.ijcnlp-long.35 · Cited by 5
DS2-Instruct: Domain-Specific Data Synthesis for Large Language Models Instruction Tuning
Xu, R., Samia, N. I., & Liu, H. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.176 · Cited by 5
Xu, Y., Zhu, Y., Wang, H., Wu, Y. G., Ouyang, Y., Li, H., Zhou, W., Liu, X., Jiang, C., & Li, Q. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790835 · Cited by 5
Reason2Decide: Rationale-Driven Multi-Task Learning
Hasan, H. M. Q., Bashier, H. K., Dai, J., Kim, M.-Y., & Goebel, R. G. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3uo797cnah93 · Cited by 5
Li, J., Yuan, H., Luo, L., Lv, T., Jiang, Y., Wang, F., Zhang, P., Lv, H., Wang, J., Sun, Y., et al. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7299-1_29 · Cited by 5
Chen, R., Meng, Y., Lu, H., & Ding, X. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829833 · Cited by 5
Huang, X., Xiao, M., Qin, C., Long, Q., Chen, J., Zhou, Y., & Zhu, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817489 · Cited by 5
Şensoy, E., & Çıtırık, M. (2023) · Middle East African Journal of Ophthalmology · doi:10.4103/meajo.meajo_199_23 · Cited by 5
Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning
Peng, Q., Li, J., Huang, S., Jiang, Y., Gong, K., Ding, R., Ye, S., Zheng, C., Cai, Y., Yang, X., et al. (2026) · Machine Intelligence Research · doi:10.1007/s11633-026-1659-4 · Cited by 5
FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
Li, C., Zhao, Q., Mo, F., & Chen, C. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.127 · Cited by 5
SciMRC: Multi-perspective Scientific Machine Reading Comprehension
Zhang, X., Zheng, H., Nie, Y., Huang, H., & Mao, X. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3vbpdtewz2kj · Cited by 5
Headless Language Models: Learning without Predicting with Contrastive Weight Tying
Godey, N., de la Clergerie, É. V., & Sagot, B. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2309.08351 · Cited by 5
Wang, M., He, X., Liu, L., Fang, Q.-M., Zhang, M., Chen, H., & Liu, Y. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3368288 · Cited by 5
Layne, J., Ratul, Q. E. A., Serra, E., & Jajodia, S. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3663481 · Cited by 5
Paragraph Retrieval for Enhanced Question Answering in Clinical Documents
Lanz, V., & Pecina, P. (2024) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2024.bionlp-1.48 · Cited by 5
Liu, J., Ren, J., Bai, R., Zhang, Z., & Lu, Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125701 · Cited by 5
MIMIR: A Customizable Agent Tuning Platform for Enhanced Scientific Applications
Tang, X., Deng, C., Hanminwang, H., Wang, H., Zhao, Y., Shi, W., Fung, Y. R., Zhou, W., Cao, J., Ji, H., et al. (2024) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2024.emnlp-demo.49 · Cited by 5
MSEval: A Dataset for Material Selection in Conceptual Design to Evaluate Algorithmic Models
Jain, Y. P., Grandi, D., Groom, A., Cramer, B., & McComb, C. (2024) · Journal of Mechanical Design · doi:10.1115/1.4067453 · Cited by 5
Shi, Y., & Hu, X. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825237 · Cited by 5
Evaluating the Effectiveness of Cost-Efficient Large Language Models in Benchmark Biomedical Tasks
Jahan, I., Laskar, M. T. R., Peng, C., & Huang, J. X. (2025) · doi:10.21428/594757db.86843c77 · Cited by 5
Generating Multiple-choice Questions for Medical Question Answering with Distractors and Cue-masking
Sileo, D., Uma, K., & Moens, M. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/375gmipk72qh · Cited by 5
Vladika, J., Fichtl, A. M., & Matthes, F. (2024) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0012395200003636 · Cited by 5
ArgSciChat: A Dataset for Argumentative Dialogues on Scientific PapersPreprint
Ruggeri, F., Mesgar, M., & Gurevych, I. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.06690 · Cited by 5
Optimizing Class-Level Probability Reweighting Coefficients for Equitable Prompting AccuracyPreprint
Lin, R., & You, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.07623 · Cited by 5
Unforgettable Generalization in Language ModelsPreprint
Zhang, E., Choshen, L., & Andreas, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.02228 · Cited by 5
Merging Language and Domain Specific Models: The Impact on Technical Vocabulary AcquisitionPreprint
Rousset, T., Kakibuchi, T., Sasaki, Y., & Nomura, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.12001 · Cited by 5
Sekar, T., Kushal, Shankar, S., Mohammed, S., & Fiaidhi, J. (2025) · medRxiv · doi:10.1101/2025.05.03.25325604 · Cited by 5
Semi-structured LLM Reasoners Can Be Rigorously AuditedPreprint
Leng, J., Cohen, C. A., Zhang, Z., Xiong, C., & Cohen, W. W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.24217 · Cited by 5
Self-citationDivide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAGPreprint
Sun, X., Xie, J., Chen, Z., Liu, Q., Wu, S., Chen, Y., Song, B., Wang, W., Wang, Z., & Wang, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.20871 · Cited by 5
Demo: Guide-RAG: Evidence-Driven Corpus Curation for Retrieval-Augmented Generation in Long COVIDPreprint
DiGiacomo, P., Wang, H., Fang, J. D. D., Leng, Y., Brode, W. M., & Ding, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.15782 · Cited by 5
HealthBranches: Synthesizing Clinically-Grounded Question Answering Datasets via Decision PathwaysPreprint
Cosentino, C., Defilippo, A., Dossena, M., Irwin, C., Joubbi, S., & Lió, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.07308 · Cited by 5
iMAD: Intelligent Multi-Agent Debate for Efficient and Accurate LLM InferencePreprint
Fan, W., Yoon, J., & Ji, B. (2025) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.48550/arxiv.2511.11306 · Cited by 5
Breaking It Down: Domain-Aware Semantic Segmentation for Retrieval Augmented GenerationPreprint
Allamraju, A., Chitale, M. P., Adibhatla, H. S., Mishra, R., & Shrivastava, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.00367 · Cited by 5
Enhancing the Medical Context-Awareness Ability of LLMs via Multifaceted Self-Refinement LearningPreprint
Zhou, Y., Wang, Y., Wang, B., Ning, C., Liu, X., Wu, J., & Hao, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.10067 · Cited by 5
Kim, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.10996 · Cited by 5
Token-Guard: Towards Token-Level Hallucination Control via Self-Checking Decoding
Zhu, Y., Rong, H., & Luo, H. (2026) · International Conference on Learning Representations · doi:10.48550/arxiv.2601.21969 · Cited by 5
Liu, C., Sun, X., Xiao, X., Tassel, A. V., Xu, K., Reimann, K., Liao, D., Gerstein, M., Wang, T., Wang, X., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.00217 · Cited by 5
Guideline-Grounded Evidence Accumulation for High-Stakes Agent VerificationPreprint
Zhang, Y., Seedat, N., Dong, Y., Cui, P., Zhu, J., & van der Schaar, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.02798 · Cited by 6
Inform, Coach, Relate, Listen: Auditing LLM Caregiving Support RolesPreprint
Goel, D., Goyal, A., Duddu, V., Pal, O., Lee, J., Zhong, Q. J., Rodriguez, V. J., Brown, D. S., Yoo, D. W., Karkar, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.29473 · Cited by 5
AutoMedBench: Towards Medical AutoResearch with Agentic AI ModelsPreprint
Liu, J., Song, S., Wang, Y., Mao, J., Chen, H., Huang, X., Qi, T., Guo, P., Tang, Y., He, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.01961 · Cited by 5
Can AI Agents Synthesize Scientific Conclusions in Health?Preprint
Jung, H., Diniz, P. V., Roveda, J. R. C., da Silva, A. F., Jung, H., Tsai, E., Korolova, A., & Ribeiro, M. H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.11337 · Cited by 5
Tan, X., Liu, S., Wang, X., Liu, Q., Xu, X., Yuan, X., Zhu, L., & Zhang, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.16211 · Cited by 5
Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge BiasPreprint
Xu, Z., Li, S., Liu, H., Wang, X., Li, S., Song, Z., & Chen, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.11871 · Cited by 5
ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical UnderstandingPreprint
Yuan, H., Qian, Y., Tang, Z., Xu, X., Yang, S., Wu, L., Wang, J., Wang, P., Zeng, Z., Han, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.24743 · Cited by 7
Self-citationConformal Cascade: Distribution-Free Accuracy Guarantees for Multi-Tier LLM InferencePreprint
Dou, Y., Lian, S., & Li, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.25018 · Cited by 5
Freeman, J., Millikin, R. J., Xu, L., Sharma, I., Moore, B., Lock, C., Shine George, K., Bal, A., Mohanty, C., & Stewart, R. (2025) · BMC Bioinformatics · doi:10.1186/s12859-025-06350-7 · Cited by 4
Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning
Xu, W., Chan, H. P., Li, L., Aljunied, M., Yuan, R., Wang, J., Xiao, C., Chen, G., Liu, C., Li, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.07044 · Cited by 4
Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detection
Chen, J., Zhu, X., Liu, T., Chen, Y., Xinhui, C., Yuan, Y., Leong, C. T., Li, Z., Tang, L., Zhang, L., et al. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i22.34525 · Cited by 4
MedS³: Towards Medical Slow Thinking with Self-Evolved Soft Dual-sided Process Supervision
Jiang, S., Liao, Y., Chen, Z., Zhang, Y., Wang, Y., & Wang, Y. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i37.40395 · Cited by 4
Lu, K., Mehdinia, S., Man, K., Wong, C. W., Mao, A., & Eftekhari, Z. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00011 · Cited by 4
Huang, H., Velcin, J., & Kessaci, Y. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2025.findings-emnlp.576 · Cited by 6
Le, T. S., Le, H. S., Toan, T. L. M., Le, T. D., & Tuyen, N. T. V. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4724-1_20 · Cited by 4
Wen, A., Lu, Q., Chuang, Y.-N., Wang, G., Yuan, J., Zhang, J., Wang, L. H., Fu, S., Miller, K., Jia, H., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02253-2 · Cited by 4
Batch-of-Thought: Cross-Instance Learning for Enhanced LLM Reasoning
Yang, X., Jia, F., Xie, R., Xi, X., Bian, H., Li, J., & Agrawal, M. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.810 · Cited by 4
EpiQAL: Benchmarking Large Language Models in Epidemiological Question Answering and Reasoning
Wei, M., Min, D., Liu, Z., Xie, Y., Wu, G., Zhang, Z., Yang, C., Lau, M. S. Y., He, Q., Cheng, L., et al. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.2103 · Cited by 4
Self-citationTRUSS-Med: Medical Question Answering via Transformers, Retrieval, and Unified State Space Models
Zhu, X., Khan, M., Mhedhbi, E., Liang, Y., & Othmani, A. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356863 · Cited by 4
Do Clinical Question Answering Systems Really Need Specialised Medical Fine Tuning?
Ray, S. K., Kashyap, G. S., Tripathi, S., Joshi, N., Govindarajan, V., Ali, R., Gao, J., & Naseem, U. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-industry.64 · Cited by 4
VerifAI: A Verifiable Open-Source Search Engine for Biomedical Question Answering
Košprdić, M., Ljajić, A., Bašaragin, B., Medvecki, D., Cassano, L., & Milošević, N. (2026) · IEEE Access · doi:10.1109/access.2026.3676985 · Cited by 4
Who Judges the Judge? Evaluating LLM-as-a-Judge for French Medical open-ended QA
Belmadani, I., Khettari, O. E., Beaufils, P. C. D., Dufour, R., & Favre, B. (2026) · Workshop on Linguistic Analysis for Health (HeaLing) · doi:10.18653/v1/2026.healing-1.12 · Cited by 4
PKFAR: psychiatry knowledge-fused augmented reasoning with large language models
Wang, R., Yu, C., Dong, Q., Qiu, J., Wen, T., Zhang, W., & Qin, K. (2026) · Health Information Science and Systems · doi:10.1007/s13755-026-00447-w · Cited by 4
MediHive: A Decentralized Agent Collective for Medical Reasoning
Wang, X., & Yang, C. C. (2026) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-026-00239-7 · Cited by 4
PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
Huang, Y., Peng, R., Qiu, Z., Kang, J., Wen, Y., Schölkopf, B., & Liu, W. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1930 · Cited by 4
Zhan, Z., Zhou, S., & Zhang, R. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag042 · Cited by 5
When Retrieval Doesn’t Help: A Large-Scale Study of Biomedical RAG
Nourbakhsh, E., Slavin, R., Yang, K., & Rios, A. (2026) · BioNLP@ACL · doi:10.18653/v1/2026.bionlp-1.72 · Cited by 4
SciLitBench: Benchmark and Design Principles for LLM-Powered Systematic Literature Reviews
Zabaleta, M., & Lin, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.05505 · Cited by 4
Huang, Y., Gao, T., Zhang, J., Liu, X., & Wang, G. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822725 · Cited by 4
New Paradigm for Evaluating Scholar Summaries: A Facet-aware Metric and a Meta-evaluation Benchmark
Wang, T., Chen, X., Zhu, Q., Guo, T., Gao, S., Lu, Z., Gao, X., & Zhang, X. (2025) · ACM Transactions on Information Systems · doi:10.1145/3733597 · Cited by 4
Med-CoDE: Medical Critique based Disagreement Evaluation Framework
Gupta, M., Aizawa, A., & Shah, R. R. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-srw.11 · Cited by 4
Counterfactual Sensitivity Regularization for Trace-Sensitive Reasoning in Large Language Models
Akter, S., Shihab, I. F., & Sharma, A. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.539 · Cited by 4
Zheng, Y., Li, H., Yu, K., & Chen, L. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.522 · Cited by 4
+VeriRel: Verification Feedback to Enhance Document Retrieval for Scientific Fact Checking
Deng, X., Wang, X., & Stevenson, M. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3760822 · Cited by 4
TempTest: Local Normalization Distortion and the Detection of Machine-generated Text
Kempton, T., Burrell, S. A., & Cheverall, C. (2025) · Research Explorer (The University of Manchester) · doi:10.48550/arxiv.2503.20421 · Cited by 4
Zhu, S., Xie, Y., Tang, Y., Zhou, Y., Zhao, R., & Dong, X. (2025) · European Journal of Pediatrics · doi:10.1007/s00431-025-06602-x · Cited by 4
KScope: A Framework for Characterizing the Knowledge Status of Language Models
Xiao, Y., Chen, S., Gallifant, J., Bitterman, D. S., Hartvigsen, T., & Ghassemi, M. (2025) · neural information processing systems · doi:10.52202/085713-3446 · Cited by 4
Zang, Z., Gu, W., Yang, D., Ma, S., Zhang, Z., Fan, G., Ling, W.-K., Shen, Y., & YANG, F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464831 · Cited by 4
Zhang, H., & Wu, W. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2026.086343 · Cited by 4
Metadata
- Authors
- Jin, Q., Dhingra, B., Liu, Z., Cohen, W., & Lu, X.
- Affiliations
- University of Pittsburgh (US)
- Carnegie Mellon University (US)
- Google (United States) (US)
- Venue
- Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
- Published
- 2019
- Pages
- 2567-2577
- OpenAlex
- W2970482702
- Cited by
- 685
- References
- 26
- Citations by year
- 2026: 188 · 2025: 215 · 2024: 107 · 2023: 75 · 2022: 36 · 2021: 39 · 2020: 25
- FWCI
- 75.51
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- question answering, biomedical research, PubMed, scientific publications, datasets, biomedical question answering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.