Low power, type II errors, and other statistical problems in recent cardiovascular research
The DOI matches its Crossref record.
Abstract
Frequently in biomedical literature, measurements are considered “not statistically different” if a statistical test fails to achieve a P value that is < or = 0.05. This conclusion may be misleading because the size of each group is too small or the variability is large, and a type II error (false negative) is committed. In this study, we examined the probabilities of detecting a real difference (power) and type II errors in unpaired t-tests in Volumes 246 and 266 of the American Journal of Physiology: Heart and Circulatory Physiology. In addition, we examined all articles for other statistical errors. The median power of the t-tests was similar in these volumes (approximately 0.55 and approximately 0.92 to detect a 20% and a 50% change, respectively). In both volumes, approximately 80% of the studies with nonsignificant unpaired t-tests contained at least one t-test with a type II error probability > 0.30. Our findings suggest that low power and a high incidence of type II errors are common problems in this journal. In addition, the presentation of statistics was often vague, t-tests were misused frequently, and assumptions for inferential statistics usually were not mentioned or examined.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Understanding Power and Rules of Thumb for Determining Sample Sizes
Wilson Van Voorhis, C. R., & Morgan, B. L. (2007) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.03.2.p043 · Cited by 1,939
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Risk Factors of Pneumothorax and Bleeding
Yeow, K.-M., Su, I.-H., Pan, K.-T., Tsay, P.-K., Lui, K.-W., Cheung, Y.-C., & Chou, A. S.-B. (2004) · Chest · doi:10.1378/chest.126.3.748 · Cited by 433
A survey of the statistical power of research in behavioral ecology and animal behavior
Jennions, M. D. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.438 · Cited by 278
Statistics in medical journals: some recent trends
Altman, D. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001215)19:23<3275::aid-sim626>3.0.co;2-m · Cited by 254
Metadata
- Authors
- Williams, J. L., Hathaway, C. A., Kloster, K. L., & Layne, B. H.
- Venue
- American Journal of Physiology-Heart and Circulatory Physiology
- Publisher
- American Physiological Society
- Published
- 1997-07-01
- Volume
- 273
- Issue
- 1
- Pages
- H487-H493
- ISSN
- 0363-6135 (ISSN-L)
- 1522-1539
- OpenAlex
- W1857390120
- Cited by
- 85
- References
- 0
- FWCI
- 3.42
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Low power, type II errors, and other statistical problems in recent cardiovascular research. https://app.cochat.ai/papers/10.1152/ajpheart.1997.273.1.h487
- The paper
- Williams, J. L., Hathaway, C. A., Kloster, K. L., & Layne, B. H. (1997). Low power, type II errors, and other statistical problems in recent cardiovascular research. American Journal of Physiology-Heart and Circulatory Physiology. https://doi.org/10.1152/ajpheart.1997.273.1.h487
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.