Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; 1 of the 5 sources its claims cite were checked for support.

A Curated Dataset for Question Answering on Laboratory Test Reference Ranges and Interpretation

Open access

Abstract

LabQAR is a manually curated lab QA dataset with 550 reference ranges covering 363 unique lab tests and two QA sets for reference-range prediction and low/normal/high classification.

Overview

CoChat Summary

## TL;DR

LabQAR is a manually curated question-answering dataset built from 550 laboratory test reference ranges covering 363 unique tests, designed to evaluate both reference-range retrieval and lab-result interpretation. In baseline experiments, GPT-4o performed best on the reported tasks, reaching 63.3% accuracy on multiple-choice classification.

## Key findings

  • The dataset contains 550 lab test reference ranges spanning 363 unique lab tests and includes contextual variation such as gender-specific (26), age group-specific (7), women-related condition (15), and other condition (33) cases.
  • LabQAR was turned into two QA sets, each with 550 questions: Set 1 asks for the correct reference range, and Set 2 asks whether a value is Low, Normal, or High.
  • In baseline evaluation, GPT-4o achieved 63.3% accuracy on Set 2, compared with 43.1% for GPT-4 and 26.7% for LLaMA 3.1.
  • For Set 1, GPT-4 Turbo improved from 27.8% exact match to 49.8% within ±20%, and GPT-4o from 30.9% exact match to 50.5% within ±20%.

## Methods

  • The dataset was manually curated from authoritative sources, including Laposata's Laboratory Medicine, ABIM, and Stanford Medicine; the paper says the 550 reference ranges were extracted, standardized to include traditional and SI units, and mapped to LOINC identifiers.
  • Four undergraduate annotators extracted metadata such as test name, specimen type, age/sex specificity, clinical condition, and reference intervals; disagreements were resolved by consensus under supervision.
  • The authors built two JSON QA formats: open-ended range retrieval (Set 1) and multiple-choice classification (Set 2), then benchmarked LLaMA 3.1, GatorTronGPT, GPT-3.5 Turbo, GPT-4 Turbo, and GPT-4o using exact match plus ±10%/±20% tolerance for Set 1 and exact-match accuracy for Set 2.

## Limitations

  • The paper explicitly says the benchmarking experiments are only baseline demonstrations and do not constitute technical validation of the dataset itself or clinical deployment of the models.
  • The authors note that because GPT-4o pretraining details are not publicly disclosed, they cannot attribute its performance to specific architectural or data factors; this is stated in the paper.
  • Evident from the text: the evaluation uses synthetically generated Set 2 values and tolerance-based scoring for Set 1, so reported performance is tied to the dataset construction and scoring choices rather than real-world clinical use.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41597-026-07554-z

Cites

0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

1 Valid · 1 Not valid · 2 Not checked · 76 Own results and interpretations

28 more claims

Create a free account to see all 80 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 29
  • It may state two separate claims as one. 30
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 9

  1. Pal, A., Umapathi, L. K. & Sankarasubbu, M. MedMCQA: A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering. in Proceedings of the Conference on Health, Inference, and Learning (eds Flores, G., Chen, G. H., Pollard, T., Ho, J. C. & Naumann, T.) vol. 174 248–260 (PMLR, 2022).
  2. Vaswani, A. et al. Attention is All you Need. in Advances in Neural Information Processing Systems (eds Guyon, I. et al.) vol. 30 (Curran Associates, Inc., 2017).
  3. Laposata, M. Clinical Laboratory Reference Values. in Laposata’s Laboratory Medicine: Diagnosis of Disease in the Clinical Laboratory, 4th Edition (McGraw Hill, New York, NY, 2025).
  4. Clinical Guide to Laboratory Tests. (W.B. Saunders, Philadelphia London, 1995).
  5. AMA Manual of Style: A Guide for Authors and Editors. (Oxford Univ. Pr, Oxford, 2007).
  6. Clinical Diagnosis and Management by Laboratory Methods. (Saunders, Philadelphia, Pa. London, 2001).
  7. Tietz Textbook of Clinical Chemistry and Molecular Diagnostics (Saunders, St. Louis, Mo, 2013).
  8. Laposata, M. Clinical Laboratory Reference Values. in Laposata’s Laboratory Medicine: Diagnosis of Disease in the Clinical Laboratory, 3e (McGraw-Hill Education, New York, NY, 2019).
  9. Brown, T. et al. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems. (edsLarochelle, H., Ranzato, M., Hadsell, R., Balcan, M. F. & Lin, H.) vol. 33 1877–1901 (Curran Associates, Inc., 2020).

Metadata

Authors
Bhasuran, B., Jin, Q., Deville, A., Wu, Y., Hanna, K., Lu, Z., & He, Z.
Affiliations
  • Florida State University (US)
  • United States National Library of Medicine (US)
  • University of Florida Health (US)
  • University of South Florida (US)
Corresponding author
He, Zhe
Venue
Scientific Data
Published
2026-06-10
Volume
13
Issue
1
ISSN
2052-4463 (ISSN-L)
OpenAlex
W7164148867
Cited by
0
References
0
Type
data paper
Language
en
Open access
Licence
Locations
  • Scientific Data (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
Funders
  • U.S. Department of Health & Human Services | Agency for Healthcare Research and Quality (R21HS029969)
  • U.S. Department of Health & Human Services | NIH | National Center for Advancing Translational Sciences (UM1TR005128)
  • École Nationale d'Ingénieurs de Saint-Etienne (P30AG073105)
  • U.S. Department of Health & Human Services | NIH | U.S. National Library of Medicine
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Keywords
laboratory test interpretation, question answering, clinical decision support, large language models, GPT-4o, multiple-choice questions, specimen type
MeSH terms
Large Language Models, Humans, Reference Values, Clinical Laboratory Techniques, Decision Support Systems, Clinical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Curated Dataset for Question Answering on Laboratory Test Reference Ranges and Interpretation. https://app.cochat.ai/papers/10.1038/s41597-026-07554-z
The paper
Bhasuran, B., Jin, Q., Deville, A., Wu, Y., Hanna, K., Lu, Z., & He, Z. (2026). A Curated Dataset for Question Answering on Laboratory Test Reference Ranges and Interpretation. Scientific Data. https://doi.org/10.1038/s41597-026-07554-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.