PubMedQA: A Dataset for Biomedical Research Question Answering
Open accessThe DOI matches its Crossref record; 24 of the 26 references it cites were found in a registry or an index.
Abstract
Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William Cohen, Xinghua Lu. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“given that medical question datasets such as PubMedQA42 and MedQA43 consist of fixed question sets susceptible to memorization”
From An automated framework for assessing how well LLMs cite relevant medical references (2025) · cites this paper as [43]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“All analyses were performed on publicly available, de-identified benchmark datasets—MIRAGE [23], PubMedQA [24], and the medical licensing examination questions of Katz et al. [25]—used in accordance with their respective licenses and terms of use.”
From The economics of accuracy for medical reasoning with large language models (2026) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“PubMedQA (Jin et al., 2019) is a biomedical research QA dataset under the MIT license. It contains 1,000 expert-annotated questions ( pqa\_labeled\_split ) and 211K machine-labeled questions from PubMed abstracts (the most widely used biomedical literature resource).”
From MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Models (2025) · cites this paper as Jin et al., 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Notably, in healthcare, medical NLP benchmarks like MedQA7, PubMedQA8 and the Massive Multitask Language Understanding (MMLU) serve as the de-facto reporting standard for state-of-the-art medical LLMs9–11 with claims of ‘superhuman’ performance in patient-facing tasks12.”
From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“The ground truth question-answer pairs are sourced from the pqa\_labeled split of PubMedQA (Jin et al., 2019), which contains 1,000 expert-annotated samples, supplemented with 9,000 instances randomly selected from the pqa\_artificial split.”
From MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Models (2025) · cites this paper as Jin et al., 2019
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 2×
“We fine-tune BioBERT (Lee et al., 2019) on Pub-MedQA as a baseline.”
MethodThe Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“Unlike other QA datasets in which questions are asked by crowd-workers for existing contexts (Rajpurkar et al., 2016; Yang et al., 2018; Kočiskỳ et al., 2018), in PubMedQA contexts are generated to answer the questions and both are written by the same authors.”
BackgroundNatural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069 · cited 6×
“, 2018), Natural Questions (Kwiatkowski et al., 2019), ShARC (Saeidi et al.”
BackgroundMethodInfluentialBoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
Clark, C., Lee, K., Chang, M.-W., Kwiatkowski, T., Collins, M., & Toutanova, K. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1300 · Cited by 1,855
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., & Manning, C. D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1259 · Cited by 1,804 · cited 6×
“Supporting fact for the answer is highlighted . et al., 2018; Yang et al., 2018; Kwiatkowski et al., 2019), the largest annotated biomedical QA dataset, BioASQ (Tsatsaronis et al., 2015) has less than 3k training instances, most of which are simple factual questions.”
BackgroundMethodInfluentialSelf-citationEnhanced LSTM for Natural Language Inference
Chen, Q., Zhu, X., Ling, Z.-H., Wei, S., Jiang, H., & Inkpen, D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1152 · Cited by 1,113
Research works printed but not linked: 1
- 2012 Conference and Labs of the Evaluation ForumQuestion Answering For Machine Reading Evaluation (QA4MRE), Rome/Forner, J.[edit.]; ea , pages 1-14.
Cited by
Items 701–800 of 1,026
JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language ModelsPreprint
Jiang, J., Huang, J., & Aizawa, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.13317 · Cited by 8
All-in-One Tuning and Structural Pruning for Domain-Specific LLMsPreprint
Lu, L., Wang, Z., Bao, R., Wang, M., Li, F., Wu, Y., Jiang, W., Xu, J., Wang, Y., & Gao, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.14426 · Cited by 8
Training Dynamics Impact Post-Training Quantization Robustness
Catalan-Tatjer, A., Ajroldi, N., & Geiping, J. (2026) · International Conference on Learning Representations · doi:10.48550/arxiv.2510.06213 · Cited by 9
Bridging the Knowledge-Prediction Gap in LLMs on Multiple-Choice QuestionsPreprint
Park, Y., Pyun, H., & Jo, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.23782 · Cited by 8
Zhou, Y., Liu, X., Yan, C., Ning, C., Zhang, X., Li, B., Fu, X., Wang, S., Hu, G., Wang, Y., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.08349 · Cited by 8
Black-Box Behavioral Distillation Breaks Safety Alignment in Medical LLMsPreprint
Jahan, S., & Sun, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.09403 · Cited by 8
Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM AdaptationPreprint
Yang, Y., zeng, A., & Yang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.07935 · Cited by 8
MoCo: A One-Stop Shop for Model Collaboration ResearchPreprint
Feng, S., Bai, Y., Yang, Z., Wang, Y., Tan, Z., Yan, J., Lei, Z., Ding, W., Shi, W., Wang, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.21257 · Cited by 10
From Medical LLMs to Versatile Medical Agents: A Comprehensive SurveyPreprint
Zhou, Y., Zheng, H., Chen, D., Yang, H., Han, W., & Shen, J. (2026) · Authorea · doi:10.22541/au.177437366.61663600/v1 · Cited by 8
End-to-End Context Compression at ScalePreprint
Li, A., McLeish, S., Chen, H., Kalra, N., Chen, Z., Gazizov, A., Morisetty, V. A. S. K., Kailkhura, B., Menon, H., Liu, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.09659 · Cited by 8
Self-citationSystem1-Arena: Which Decisions Can Be Left to System 1?Preprint
Chen, T., Liu, X., An, R., Wang, Z., & Zhou, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.21244 · Cited by 9
Enhancing LLM Reasoning Capabilities Through Brokered Multi-Expert Reflection
Sheokand, T., Jain, G., Bahga, A., & Madisetti, V. K. (2025) · IEEE Access · doi:10.1109/access.2025.3561693 · Cited by 7
Oh, G., Kim, S., Park, S., & Kim, B.-H. (2026) · Journal of Medical Internet Research · doi:10.2196/90693 · Cited by 7
“PubMedQA [40] is a medical QA dataset comprising 500 research questions, each paired with a relevant abstract.”
Miao, Y., Wen, J., Luo, Y., & Li, J. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106136 · Cited by 10
Data augmentation for dense passage retrieval using corpus-passage frequency-based token deletion
Moon, A.-S., Kim, K., & Lee, J. (2025) · Journal Of Big Data · doi:10.1186/s40537-025-01257-9 · Cited by 7
CGBench: Benchmarking Language Model Scientific Reasoning for Clinical Genetics Research
Queen, O., Zhang, H. G., & Zou, J. (2025) · neural information processing systems · doi:10.52202/085713-0585 · Cited by 7
Jarchow, H., Bobrowski, C., Falk, S. S. I., Hermann, A., Kulaga, A. Y., Põder, J.-C., Unfried, M., Usanov, N., Zendeh, B., Kennedy, B. K., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01996-2 · Cited by 10
Karim, W., Alvi, R., Zaman, S. B., Abian, A. I., Raiaan, M. A. K., Mukta, S. H., Rashid, M. R. U., Islam, R., Sebastian, Y., & Azam, S. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10743-z · Cited by 7
Retrieval augmented large language model system for comprehensive drug contraindications
Bang, B., Yoon, J. C., Chang, D. J., Park, S., & Lee, Y. O. (2026) · Health Information Science and Systems · doi:10.1007/s13755-025-00420-z · Cited by 8
Patient-Similarity Cohort Reasoning in Clinical Text-to-SQL
Shen, Y., Zhao, Y., Ou, J., Huang, T., & Cohan, A. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-long.64 · Cited by 7
GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR
Zhang, J., Shi, L., Li, J., Xu, J., Gao, J., Hao, J., & He, R. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.1110 · Cited by 7
Min, D., Zhang, K., Wu, T., & Cheng, L. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.812 · Cited by 7
SciMDR: Advancing Scientific Multimodal Document Reasoning
Chen, Z., Zhao, Y., Wang, C., Han, R., Patwardhan, M., & Cohan, A. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.2070 · Cited by 8
When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical Pressure
Xiao, B., Tian, X., Song, X., Wang, H., Song, G., Zhao, S., & Qin, B. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.395 · Cited by 8
ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services
Ji, F., Yang, J., Song, Z., Gao, L., Liang, J., Chen, Z., Zhang, J., & Chen, X. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.2014 · Cited by 7
Knowledge-Guided Efficient Representation Learning for Biomedical Domain
Jha, K., Xun, G., Du, N., & Zhang, A. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467118 · Cited by 7
Question Answering on Biomedical Research Papers using Transfer Learning on BERT-Base Models
Pudasaini, S., & Shakya, S. (2023) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac58438.2023.10290240 · Cited by 7
Hu, J., Zhu, Y., Wu, L., Luo, Q., Teng, F., & Li, T. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02285-2 · Cited by 7
Malaviya, C., Lee, S., Roth, D., & Yatskar, M. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.168 · Cited by 7
MedicalBERT: enhancing biomedical natural language processing using pretrained BERT-based model
Reddy, K. S., Ragavenderan, N., Vasanth, K., Naik, G. N., Vishalakshi Prabhu, H., & Nagaraja, G. S. (2025) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v14.i3.pp2367-2378 · Cited by 7
Lanz, V., & Pecina, P. (2025) · Workshop on Patient-Oriented Language Processing (CL4Health) · doi:10.18653/v1/2025.cl4health-1.6 · Cited by 7
MedConMA: A Confidence-Driven Multi-agent Framework for Medical Q&A
Wang, R., Chen, Y., Zhang, W., Si, J., Guan, H., Peng, X., & Lü, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8180-8_33 · Cited by 7
Mutalik, R., Panchalingam, A., Singh, L. G., Osborn, T. J., Hawkins, E., & Middleton, S. E. (2025) · Workshop on Natural Language Processing Meets Climate Change (ClimateNLP) · doi:10.18653/v1/2025.climatenlp-1.15 · Cited by 7
C-PATH: Conversational Patient Assistance and Triage in Healthcare System
Shi, Q. F., Han, Q., & Soares, C. (2025) · IEEE International Conference on Digital Health (ICDH) · doi:10.1109/icdh67620.2025.00016 · Cited by 7
Efficient Tuning of Large Language Models for Knowledge-Grounded Dialogue Generation
Zhang, B., Ma, H., Li, D., Ding, J., Wang, J., Xu, B., & Lin, H.-F. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.17 · Cited by 6
AI in flow cytometry: Current applications and future directions
Yue, A., Brinkman, R. R., Nash, V., Junker, F., Bogdanoski, G., Divekar, A., Tyznik, A. J., Špidlen, J., Kern, W., Pétriz, J., et al. (2025) · Cytometry Part B Clinical Cytometry · doi:10.1002/cyto.b.22255 · Cited by 7
ImpRAG: Retrieval-Augmented Generation with Implicit Queries
Zhang, W., Lin, X., Stratos, K., Yih, W.-T., & Chen, M. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.472 · Cited by 7
Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Models
Tang, H., Liu, Y., Zhao, X., Liu, X., Zhang, Y., Zhang, K., Zhou, X., & Chen, E. (2025) · Proceedings · doi:10.1109/icdm65498.2025.00082 · Cited by 7
Huang, F., Kwak, H., & An, J. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.2074 · Cited by 7
Assessing ChatGPT’s Capability for Multiple Choice Questions Using RaschOnline: Observational Study
Chow, J. C., Cheng, T.-Y., Chien, T., & Chou, W. (2023) · JMIR Formative Research · doi:10.2196/46800 · Cited by 7
A Unified Knowledge Graph Augmentation Service for Boosting Domain-specific NLP Tasks
Ding, R., Han, X., & Wang, L. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.24 · Cited by 7
New Siamese Neural Networks for Text Classification and Ontologies Alignment
Menad, S., Laddada, W., Abdeddaïm, S., & Soualmia, L. F. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44355-8_2 · Cited by 7
Şensoy, E., & Çıtırık, M. (2024) · Journal of Current Ophthalmology · doi:10.4103/joco.joco_192_23 · Cited by 7
Beyond Fine-tuning: Unleashing the Potential of Continuous Pretraining for Clinical LLMs.
Christophe, C., Raha, T., Maslenkova, S., Salman, M., Kanithi, P., Pimentel, M. A., & Khan, S. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.618 · Cited by 7
FERMAT: An Alternative to Accuracy for Numerical Reasoning
Sivakumar, J., & Moosavi, N. S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.838 · Cited by 7
A Smart System to Generate and Validate Question Answer Pairs for COVID-19 Literature
Bhambhoria, R. V., Feng, L. Y., Sepehr, D., Chen, J., Cowling, C., Koçak, S. A., & Dolatabadi, E. (2020) · Workshop on Scholarly Document Processing (SDP) · doi:10.18653/v1/2020.sdp-1.4 · Cited by 7
Unlocking Model Insights: A Dataset for Automated Model Card GenerationPreprint
Singh, S., Lodwal, H., Malwat, H., Thakur, R., & Singh, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.12616 · Cited by 7
Zong, C. F., Chen, Y., Lü, W., Jian, S., Zhuang, Y., Chang, H., & Zhuang, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.09131 · Cited by 7
Sukeda, I. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.11783 · Cited by 7
GAPS: A Clinically Grounded, Automated Benchmark for Evaluating AI CliniciansPreprint
Chen, X., Sun, T., Su, D., Yu, A., Liu, J., Chen, Z., Jin, G., Wang, X. Y., Liu, J., Xiao, H., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.13734 · Cited by 7
HierSearch: A Hierarchical Enterprise Deep Search Framework Integrating Local and Web SearchesPreprint
Tan, J., Dou, Z., Yu, Y., Cheng, J., Ju, Q., Xie, J., & Wen, J.-R. (2025) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.48550/arxiv.2508.08088 · Cited by 7
Kartal, M. Y., Kose, S. K., Sevinç, K., & Aktas, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.01386 · Cited by 7
Continual Pre-training of MoEs: How robust is your router?
Therien, B., Joseph, C.-É., Sarwar, Z., Panda, A., Das, A., Zhang, S.-X., Rawls, S., Sahu, S., Belilovsky, E., & Rish, I. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2503.05029 · Cited by 7
Semantic-guided Diverse Decoding for Large Language ModelPreprint
Shi, W., Cui, Y., Wu, Y., Fang, J., Zhang, S., Li, M., Han, S., Zhu, J., Xu, J., & Zhou, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.23601 · Cited by 7
ChatGPT or A Silent Everywhere Helper: A Survey of Large Language ModelsPreprint
Akhtarshenas, A., Dini, A., & Ayoobi, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.17403 · Cited by 7
Prediction-Powered Risk Monitoring of Deployed Models for Detecting Harmful Distribution ShiftsPreprint
Zhang, G., Cai, Y., Yu, G., & Simeone, O. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02229 · Cited by 7
MedXIAOHE: A Comprehensive Recipe for Building Medical MLLMsPreprint
Shi, B., Cui, B., Jiang, B., Yu, D., Qian, F., Yang, H., Wang, H., Chen, J., Pan, J., Cao, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.12705 · Cited by 7
BRIDGE: Benchmark for multi-hop Reasoning In long multimodal Documents with Grounded EvidencePreprint
Xiang, B., Han, S. C., & Ding, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.07931 · Cited by 7
Conformal Selective Acting: Anytime-Valid Risk Control for RLVR-Trained LLMsPreprint
Khosravi, H., & Huo, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.20270 · Cited by 7
MedPRESS: A Multi-turn Benchmark for Patient-Pressure-Induced Medical Sycophancy in LLMsPreprint
Joy, S. S., & Farhan, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.02520 · Cited by 7
A Self-Evolving Framework for Multi-Agent Medical Consultation Based on Large Language Models
Chen, K., Qi, J., Huo, J., Tian, P., Meng, F., Yang, X., & Gao, Y. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10889517 · Cited by 6
“We use the MedQA [26] and PubMedQA [27] datasets to validate our framework.”
FrBMedQA: the first French biomedical question answering dataset
Kaddari, Z., & Bouchentouf, T. (2022) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v11.i4.pp1588-1595 · Cited by 6
ESG-Kor: A Korean Dataset for ESG-related Information Extraction and Practical Use Cases
Lee, J., Son, G., & Kim, M. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.387 · Cited by 6
Detecting Machine-Generated Long-Form Content with Latent-Space Variables
Tian, Y., Pan, Z., & Peng, N. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.608 · Cited by 6
Optimizing Communication and Performance in Federated Learning for Large Language Models
Song, I., & Lee, K. Y. (2025) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic64266.2025.10920742 · Cited by 6
MedCT: A Clinical Terminology Graph for Generative AI Applications in Healthcare
Chen, Y., Huang, D., Shen, Y., Xu, H., Sheng, L., Zhou, Q., & Wang, K. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-97557-8_3 · Cited by 6
Arkangel AI: A conversational agent for real-time, evidence-based medical question-answering
Villa, M. C., Castano-Villegas, N., Llano, I., Martinez, J., Guevara, M. F., Zea, J., & Velásquez, L. (2025) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2025.100274 · Cited by 6
Query-driven Document-level Scientific Evidence Extraction from Biomedical Studies
Pronesti, M., Bettencourt‐Silva, J. H., Flanagan, P., Pascale, A., Redmond, O., Belz, A., & Hou, Y. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1359 · Cited by 6
A framework to synthetically generate fine-grained hallucinated data
Saxena, A., Aggarwal, D., Badathala, N., & Bhattacharyya, P. (2025) · Language Resources and Evaluation · doi:10.1007/s10579-025-09864-x · Cited by 7
Zhan, Z., Zhou, S., Zeng, M., Song, Y., Yu, K., Song, M., Chen, X., Wang, J., Hou, Y., & Zhang, R. (2026) · npj Health Systems · doi:10.1038/s44401-026-00152-6 · Cited by 6
Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond
Chen, R., Wu, J., Wang, J., Zhang, X.-L., Fan, W., Lin, C., Wei, X., & Li, Q. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.622 · Cited by 6
CMedCalc-Bench: A Fine-Grained Benchmark for Chinese Medical Calculations in LLM
Zhang, Y., Zhu, Z., & Wu, X. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1302 · Cited by 6
Zhong, Q., Ding, L., Liao, F., Liu, J., Du, B., & Tao, D. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3720785 · Cited by 7
Optimal Transport Depth Up-Scaling
Cao, M., Wang, X., & Αλέτρας, Ν. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.520 · Cited by 6
Hassell, J., Zhang, D., Kim, H., Mitchell, T. M., & Junior, E. R. H. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813154 · Cited by 6
Structural Entropy Guided Agent for Detecting and Repairing Knowledge Deficiencies in LLMs
Wei, Y., Yu, X., Pan, T., Li, A., & Du, L. (2025) · neural information processing systems · doi:10.52202/085713-0116 · Cited by 6
Srinivasan, S., Ai, X., Lo, T. W. S., Gilson, A., Zou, M., Zou, K., Kim, H., Yang, M., Pushpanathan, K., Yew, S. M. E., et al. (2025) · Ophthalmology Science · doi:10.1016/j.xops.2025.101050 · Cited by 6
Compressing Language Models for Specialized Domains
Williams, M., Chrysostomou, G., Jeronymo, V. A., & Αλέτρας, Ν. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-long.347 · Cited by 6
FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization
Chen, H. M., Hu, S. X., Luk, W. W., Hospedales, T. M., & Fan, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00324 · Cited by 6
Dani, M., Prakash, M. J., Rosa, F., Akata, Z., & Liebe, S. (2026) · Communications Medicine · doi:10.1038/s43856-026-01653-z · Cited by 6
Advancing Domain Adaptation of BERT by Learning Domain Term Semantics
Yang, J. K., Hu, X., Huang, W., Yuan, H., Shen, Y., & Xiao, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-40292-0_2 · Cited by 6
Medical Document Embedding Enhancement with Heterogeneous Mixture-of-Experts
Liu, X., Zhu, Y., Pang, T., Xue, K., Zhang, X., & Fan, C. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822374 · Cited by 6
Zong, C., Wan, J., Tang, S.-L., & Zhang, L. (2025) · Artif. Intell. Medicine · doi:10.1016/j.artmed.2025.103246 · Cited by 5
Transformer-Based Open Domain Biomedical Question Answering at BioASQ8 Challenge.
Kazaryan, A., Sazanovich, U., & Belyaev, V. (2020) · CLEF (Working Notes) · Cited by 6
Active learning with feature matching for clinical named entity recognition
Le, L., Demartini, G., Zuccon, G., Zhao, G., & Zhang, X. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100015 · Cited by 6
Diffusion Language Model with Query-Document Relevance for Query-Focused Summarization
Huang, S., Qin, L., & Cao, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.735 · Cited by 6
Question‐driven text summarization using an extractive‐abstractive framework
Kia, M. A., Garifullina, A., Kern, M., Chamberlain, J., & Jameel, S. (2024) · Computational Intelligence · doi:10.1111/coin.12689 · Cited by 6
Wu, Y., Ting, H., Lam, T., & Luo, R. (2021) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3459930.3469557 · Cited by 6
Extractive-Boolean Question Answering for Scientific Fact Checking
Rakotoson, L., Letaillieur, C., Massip, S., & Laleye, F. A. A. (2022) · MAD@ICMR · doi:10.1145/3512732.3533580 · Cited by 5
Bridging Language Barriers in Healthcare: A Study on Arabic LLMsPreprint
Saadi, N., Raha, T., Christophe, C., Pimentel, M. A., Rajan, R., & Kanithi, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.09825 · Cited by 6
Genome-Bench: A Scientific Reasoning Benchmark from Real-World Expert DiscussionsPreprint
Yin, M., Qu, Y., Liu, D., Yang, L., Cong, L., & Wang, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.02.657538 · Cited by 6
Dobreva, J., Karasmanakis, I., Ivanišević, F., Horvat, T., Kitanovski, D., Gams, M., Mishev, K., & Simjanoska, M. (2025) · Data in Brief · doi:10.1016/j.dib.2025.112146 · Cited by 6
Who's Asking? Evaluating LLM Robustness to Inquiry Personas in Factual Question AnsweringPreprint
Akpinar, N.-J., Lee, C., Murdock, V., & Perona, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.12925 · Cited by 6
AGENT-X: Adaptive Guideline-based Expert Network for Threshold-free AI-generated teXt detectionPreprint
Li, J., Ye, M., Peng, C., Yin, X., & Wan, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.15261 · Cited by 7
Is (Selective) Round-To-Nearest Quantization All You Need?Preprint
Kogan, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.15909 · Cited by 6
Ryan, J., Gumilang, A. I., Wiliam, R., & Suhartono, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.04531 · Cited by 6
MedConsultBench: A Full-Cycle, Fine-Grained, Process-Aware Benchmark for Medical Consultation AgentsPreprint
Qiao, C., Huang, J., Zhao, D., Liu, Z., Shen, Y., Cheng, B., Lin, W., & Wu, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.12661 · Cited by 6
Self-citationMATRIX: A Multimodal Benchmark and Post-Training Framework for Materials SciencePreprint
McGrath, D., Chong, C., Kulkarni, R., Ceder, G., & Kolluru, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.00376 · Cited by 6
MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluation
Bazoge, A. (2026) · Scientific Data · doi:10.1038/s41597-026-06680-y · Cited by 7
Small Agent Group is the Future of Digital HealthPreprint
Yu, M., Tang, L., Zhang, D., Brens, R., Romero, E. J., Guo, N. L., Elkefi, S., & Xi, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.08013 · Cited by 7
Metadata
- Authors
- Jin, Q., Dhingra, B., Liu, Z., Cohen, W., & Lu, X.
- Affiliations
- University of Pittsburgh (US)
- Carnegie Mellon University (US)
- Google (United States) (US)
- Venue
- Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
- Published
- 2019
- Pages
- 2567-2577
- OpenAlex
- W2970482702
- Cited by
- 685
- References
- 26
- Citations by year
- 2026: 188 · 2025: 215 · 2024: 107 · 2023: 75 · 2022: 36 · 2021: 39 · 2020: 25
- FWCI
- 75.51
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- question answering, biomedical research, PubMed, scientific publications, datasets, biomedical question answering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.