McNemar χ2test revisited: comparing sensitivity and specificity of diagnostic examinations
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
When evaluating a novel diagnostic examination for clinical use, it should be compared with a reference standard, defined as the best available examination, which may include clinical and laboratory criteria. The novel examination and reference standard's results are usually presented in the form of a 2 x 2 table, which allows calculation of sensitivity, specificity and accuracy. It has been recommended that the measures of statistical uncertainty should be reported, such as the 95% confidence interval, when evaluating the accuracy of diagnostic examinations. Comparing the difference in sensitivity or specificity of a novel examination with the reference standard is important when evaluating its usefulness. The McNemar chi(2) test, used to compare discordance of two dichotomous responses, can be applied for this purpose. However, applying the McNemar test to a 2 x 2 table for comparing the accuracy of examinations is not recommended, since this test is sensitive to the proportion of positive versus negative subjects. Moreover, if the novel examination has higher sensitivity than the one considered as the reference standard, constructing a classic 2 x 2 table would result in low specificity of the novel examination. Thus, in order to compare sensitivities and specificities between examinations, this table is inappropriate and an independent reference standard is necessary. In this article, we propose the use of the McNemar chi(2) test to compare sensitivities between examinations using a 2 x 2 table exclusively among diseased patients, defined by a set of criteria and follow-up of patients. Likewise, specificities can be compared applying the McNemar test among healthy individuals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Yield of sputum induction in the diagnosis of pleural tuberculosis
Conde, M. B., Loivos, A. C., Rezende, V. M., Soares, S. L. M., Mello, F. C. Q., Reingold, A. L., Daley, C. L., & Kritski, A. L. (2003) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.2111019 · Cited by 204
Cited by
Evaluation metrics and statistical tests for machine learning
Rainio, O., Teuho, J., & Klén, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-56706-x · Cited by 1,338
Cleveland, A. A., Farley, M. M., Harrison, L. H., Stein, B., Hollick, R., Lockhart, S. R., Magill, S. S., Derado, G., Park, B. J., & Chiller, T. M. (2012) · Clinical Infectious Diseases · doi:10.1093/cid/cis697 · Cited by 366
Nguyen, M. H., Wissel, M. C., Shields, R. K., Salomoni, M. A., Hao, B., Press, E. G., Shields, R. M., Cheng, S., Mitsani, D., Vadnerkar, A., et al. (2012) · Clinical Infectious Diseases · doi:10.1093/cid/cis200 · Cited by 290
“The McNemar v(2) test was used to compare sensitivity and specificity between assays [9].”
MethodRaciti, P., Sue, J., Ceballos, R., Godrich, R., Kunz, J. D., Kapur, S., Reuter, V., Grady, L., Kanan, C., Klimstra, D. S., et al. (2020) · Modern Pathology · doi:10.1038/s41379-020-0551-y · Cited by 186
“We used McNemar’s test to compare sensitivity and specificity with and without Paige Prostate Alpha [15].”
MethodShields, R. K., Nguyen, M. H., Press, E. G., Kwa, A. L., Cheng, S., Du, C., & Clancy, C. J. (2012) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00027-12 · Cited by 171
Metadata
- Authors
- Trajman, A., & Luiz, R. R.
- Venue
- Scandinavian Journal of Clinical and Laboratory Investigation
- Publisher
- Informa UK Limited
- Published
- 2008-01
- Volume
- 68
- Issue
- 1
- Pages
- 77-80
- ISSN
- 0036-5513 (ISSN-L)
- 1502-7686
- OpenAlex
- W1977884142
- Cited by
- 218
- References
- 1
- FWCI
- 4.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: McNemar χ2test revisited: comparing sensitivity and specificity of diagnostic examinations. https://app.cochat.ai/papers/10.1080/00365510701666031
- The paper
- Trajman, A., & Luiz, R. R. (2008). McNemar χ2test revisited: comparing sensitivity and specificity of diagnostic examinations. Scandinavian Journal of Clinical and Laboratory Investigation. https://doi.org/10.1080/00365510701666031
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.