CoChat

Low power, type II errors, and other statistical problems in recent cardiovascular research

Williams, J. L., Hathaway, C. A., Kloster, K. L., Layne, B. H. · 1997 · American Journal of Physiology-Heart and Circulatory Physiology
Cited by 85

The DOI matches its Crossref record.

Abstract

Frequently in biomedical literature, measurements are considered “not statistically different” if a statistical test fails to achieve a P value that is < or = 0.05. This conclusion may be misleading because the size of each group is too small or the variability is large, and a type II error (false negative) is committed. In this study, we examined the probabilities of detecting a real difference (power) and type II errors in unpaired t-tests in Volumes 246 and 266 of the American Journal of Physiology: Heart and Circulatory Physiology. In addition, we examined all articles for other statistical errors. The median power of the t-tests was similar in these volumes (approximately 0.55 and approximately 0.92 to detect a 20% and a 50% change, respectively). In both volumes, approximately 80% of the studies with nonsignificant unpaired t-tests contained at least one t-test with a type II error probability > 0.30. Our findings suggest that low power and a high incidence of type II errors are common problems in this journal. In addition, the presentation of statistics was often vague, t-tests were misused frequently, and assumptions for inferential statistics usually were not mentioned or examined.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1152/ajpheart.1997.273.1.h487

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cited by

See all 85

Metadata

Authors
Williams, J. L., Hathaway, C. A., Kloster, K. L., & Layne, B. H.
Venue
American Journal of Physiology-Heart and Circulatory Physiology
Published
1997-07-01
Volume
273
Issue
1
Pages
H487-H493
ISSN
  • 0363-6135 (ISSN-L)
  • 1522-1539
OpenAlex
W1857390120
Cited by
85
References
0
FWCI
3.42
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Low power, type II errors, and other statistical problems in recent cardiovascular research. https://app.cochat.ai/papers/10.1152/ajpheart.1997.273.1.h487
The paper
Williams, J. L., Hathaway, C. A., Kloster, K. L., & Layne, B. H. (1997). Low power, type II errors, and other statistical problems in recent cardiovascular research. American Journal of Physiology-Heart and Circulatory Physiology. https://doi.org/10.1152/ajpheart.1997.273.1.h487

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.