The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Confidence intervals rather than P values: estimation rather than hypothesis testing.
Open accessAbstract
Overemphasis on hypothesis testing--and the use of P values to dichotomise significant or non-significant results--has detracted from more useful approaches to interpreting study results, such as estimation and confidence intervals. In medical studies investigators are usually interested in determining the size of difference of a measured outcome between groups, rather than a simple indication of whether or not it is statistically significant. Confidence intervals present a range of values, on the basis of the sample data, in which the population value for such a difference may lie. Some methods of calculating confidence intervals for means and differences between means are given, with similar information for proportions. The paper also gives suggestions for graphical display. Confidence intervals, if appropriate to the type of study, should be used for major findings in both the main text of a paper and its abstract.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diabetes and cardiovascular risk factors: the Framingham study
Kannel, W. B., & McGee, D. L. (1979) · Circulation · doi:10.1161/01.cir.59.1.8 · Cited by 1,317
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Self-citationThe Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
Self-citationPublication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Self-citationWang, X., Ouyang, Y., Liu, J., Zhu, M., Zhao, G., Bao, W., & Hu, F. B. (2014) · BMJ · doi:10.1136/bmj.g4490 · Cited by 1,596
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449
Reichard, P., Nilsson, B.-Y., & Rosenqvist, U. (1993) · New England Journal of Medicine · doi:10.1056/nejm199307293290502 · Cited by 1,202
Sample Size Requirements for Estimating Pearson, Kendall and Spearman Correlations
Bonett, D. G., & Wright, T. A. (2000) · Psychometrika · doi:10.1007/bf02294183 · Cited by 1,095
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
Sample size requirements for estimating intraclass correlations with desired precision
Bonett, D. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1108 · Cited by 987
Indices of Effect Existence and Significance in the Bayesian Framework
Makowski, D., Ben-Shachar, M. S., Chen, S. H. A., & Lüdecke, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02767 · Cited by 983
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934
Quality of life of people with epilepsy: a European study
Baker, G. A., Jacoby, A., Buck, D., Stalgis, C., & Monnet, D. (1997) · Epilepsia · doi:10.1111/j.1528-1157.1997.tb01128.x · Cited by 847
Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Miettinen, T. A., Puska, P., Gylling, H., Vanhanen, H., & Vartiainen, E. (1995) · New England Journal of Medicine · doi:10.1056/nejm199511163332002 · Cited by 739
Guidelines for Controlled Trials of Drugs in Migraine: Second Edition
International Headache Society Clinical Trials Subcommittee, Tfelt-Hansen, P., Block, G., Dahlöf, C., Diener, H.-C., Ferrari, M., Goadsby, P., Guidetti, V, Jones, B., Lipton, R., et al. (2000) · Cephalalgia · doi:10.1046/j.1468-2982.2000.00117.x · Cited by 698
(2011) · Cited by 675
Consumer effects of front-of-package nutrition labeling: An interdisciplinary meta-analysis
Ikonen, I., Sotgiu, F., Aydinli, A., & Verlegh, P. W. J. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00663-9 · Cited by 454
Understanding and interpreting confidence and credible intervals around effect estimates
Hespanhol, L., Vallio, C. S., Costa, L. M., & Saragiotto, B. T. (2019) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2018.12.006 · Cited by 390
Evolution of Reporting P Values in the Biomedical Literature, 1990-2015
Chavalarias, D., Wallach, J. D., Li, A. H. T., & Ioannidis, J. P. A. (2016) · JAMA · doi:10.1001/jama.2016.1952 · Cited by 370
Hughes, P., Turton, P., Hopper, E., & Evans, C. (2002) · The Lancet · doi:10.1016/s0140-6736(02)09410-2 · Cited by 375
Gøtzsche, P. C. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90017-2 · Cited by 339
Big Data in Public Health: Terminology, Machine Learning, and Privacy
Mooney, S. J., & Pejaver, V. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014208 · Cited by 325
Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine
Goodman, S. N., Berlin, J., Fletcher, S. W., & Fletcher, R. H. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-1-199407010-00003 · Cited by 324
A Proposal for Structured Reporting of Randomized Controlled Trials
Andrew, E. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520240054041 · Cited by 309
Randomized controlled trials – a matter of design
Siepmann, T., Spieth, P. M., Kubasch, A. S., Penzlin, A. I., Illigens, B. M.-W., & Barlinn, K. (2016) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s101938 · Cited by 292
Optogenetic inhibition of behavior with anion channelrhodopsins
Mohammad, F., Stewart, J. C., Ott, S., Chlebikova, K., Chua, J. Y., Koh, T.-W., Ho, J., & Claridge-Chang, A. (2017) · Nature Methods · doi:10.1038/nmeth.4148 · Cited by 276
Meta-Analyses of the Effects of Habitual Running on Indices of Health in Physically Inactive Adults
Hespanhol Junior, L. C., Pillay, J. D., van Mechelen, W., & Verhagen, E. (2015) · Sports Medicine · doi:10.1007/s40279-015-0359-y · Cited by 265
Naude, C. E., Schoonees, A., Senekal, M., Young, T., Garner, P., & Volmink, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100652 · Cited by 252
Strength training versus aerobic interval training to modify risk factors of metabolic syndrome
Stensvold, D., Tjønna, A. E., Skaug, E.-A., Aspenes, S., Stølen, T., Wisløff, U., & Slørdahl, S. A. (2010) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00996.2009 · Cited by 231
Schoevers, R. A., Deeg, D. J. H., van Tilburg, W., & Beekman, A. T. F. (2005) · The American Journal of Geriatric Psychiatry · doi:10.1097/00019442-200501000-00006 · Cited by 283
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
Cardiac effects of momentary assessed worry episodes and stressful events.
Pieper, S., Brosschot, J. F., van der Leeden, R., & Thayer, J. F. (2007) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31815a9230 · Cited by 182
An estimate of the science-wise false discovery rate and application to the top medical literature
Jager, L. R., & Leek, J. T. (2014) · Biostatistics · doi:10.1093/biostatistics/kxt007 · Cited by 179
Should Vascular Catheters Be Removed from All Patients with Candidemia? An Evidence-Based Review
Nucci, M., & Anaissie, E. (2002) · Clinical Infectious Diseases · doi:10.1086/338714 · Cited by 175
Morrison, L. G., Hargood, C., Pejovic, V., Geraghty, A. W. A., Lloyd, S., Goodman, N., Michaelides, D. T., Weston, A., Musolesi, M., Weal, M. J., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169162 · Cited by 162
(2006) · doi:10.1111/j.1743-6109.2006.00210.x · Cited by 157
Almenning, I., Rieber-Mohn, A., Lundgren, K. M., Shetelig Løvvik, T., Garnæs, K. K., & Moholdt, T. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138793 · Cited by 155
Caveats and pitfalls of ROC analysis in clinical microarray research (and how to avoid them)
Berrar, D., & Flach, P. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbr008 · Cited by 136
Pecori Giraldi, F., Ambrogio, A. G., De Martin, M., Fatti, L. M., Scacchi, M., & Cavagnini, F. (2007) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2007-0596 · Cited by 121
Silvester, J. A., Weiten, D., Graff, L. A., Walker, J. R., & Duerksen, D. R. (2016) · Nutrition · doi:10.1016/j.nut.2016.01.021 · Cited by 115
Evans, C., Connell, J., Barkham, M., Marshall, C., & Mellor‐Clark, J. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.384 · Cited by 107
Sargeant, J. M., O’connor, A. M., Gardner, I. A., Dickson, J. S., Torrence, M. E., Dohoo, C. M. P. I. R., Lefebvre, S. L., Morley, P. S., Ramirez, A., & Snedeker, K. (2010) · Journal of Food Protection · doi:10.4315/0362-028x-73.3.579 · Cited by 97
Nuzzo, J. L., Pinto, M. D., Nosaka, K., & Steele, J. (2024) · Sports Medicine · doi:10.1007/s40279-023-01937-7 · Cited by 85
Connell, J., Barkham, M., & Mellor-Clark, J. (2007) · British Journal of Guidance & Counselling · doi:10.1080/03069880601106781 · Cited by 78
Haag, G., Diener, H.-C., May, A., Meyer, C., Morck, H., Straube, A., Wessely, P., & Evers, S. (2011) · The Journal of Headache and Pain · doi:10.1007/s10194-010-0266-4 · Cited by 78
A randomized study of secondary prevention of early stage problem drinkers in primary health care
ROMELSJÖ, A., ANDERSSON, L., BARRNER, H., BORG, S., GRANSTRAND, C., HULTMAN, O., HÄSSLER, A., KäLLQUIST, A., MAGNUSSON, P., MORGELL, R., et al. (1989) · British Journal of Addiction · doi:10.1111/j.1360-0443.1989.tb00733.x · Cited by 63
Robinson, Z. P., Pelland, J. C., Remmert, J. F., Refalo, M. C., Jukic, I., Steele, J., & Zourdos, M. C. (2024) · Sports Medicine · doi:10.1007/s40279-024-02069-2 · Cited by 63
Schoenfeld, B. J., Vigotsky, A. D., Grgic, J., Haun, C., Contreras, B., Delcastillo, K., Francis, A., Cote, G., & Alto, A. (2020) · Physiological Reports · doi:10.14814/phy2.14427 · Cited by 56
Do baseline p-values follow a uniform distribution in randomised trials?
Bland, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076010 · Cited by 47
“For many years, researchers reporting clinical trials have been urged to replace P values with estimates and confidence intervals [10,11].”
BackgroundInterpretation of the p value: A national survey study in academic psychologists from Spain
Badenes-Ribera, L., Frías-Navarro, D., Monterde-i-Bort, H., & Pascual-Soler, M. (2015) · Psicothema · doi:10.7334/psicothema2014.283 · Cited by 41
“Regarding the CIs, studies reveal that they have advantages over the NHST procedures (Cumming, 2012; Cumming & Finch, 2005; Fidler, 2005; Gardner & Altman, 1986).”
Altman (2005) · doi:10.1016/s0025-7753(05)72203-x · Cited by 43
An analysis of the controversy over classical one-sided tests
Freedman, L. S. (2008) · Clinical Trials · doi:10.1177/1740774508098590 · Cited by 32
Young, C., Hanson, C., Craig, J. C., Clapham, K., & Williamson, A. (2017) · International Journal for Equity in Health · doi:10.1186/s12939-017-0652-5 · Cited by 30
Zhang, S., Heck, P. R., Meyer, M. N., Chabris, C. F., Goldstein, D. G., & Hofman, J. M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2302491120 · Cited by 30
Phylogenetic Analysis of Surface Areas of Mammals
Reynolds, P. S. (1997) · Journal of Mammalogy · doi:10.2307/1382944 · Cited by 26
Bernstein, M. T., Targownik, L. E., Sexton, K. A., Graff, L. A., Miller, N., & Walker, J. R. (2016) · Canadian Journal of Gastroenterology and Hepatology · doi:10.1155/2016/1681507 · Cited by 23
Tashiro, N., Manabe, K., & Ide, Y. (2012) · Journal of General Plant Pathology · doi:10.1007/s10327-012-0375-9 · Cited by 22
(2015) · HAL · Cited by 20
Pelland, J. C., Remmert, J. F., Robinson, Z. P., Hinson, S. R., & Zourdos, M. C. (2026) · Sports Medicine · doi:10.1007/s40279-025-02344-w · Cited by 18
Cui, M. (., Leng, M., Arbanas, J., Romanov, A., Tseng, C.-H., Wei, M. Y., Damberg, C. L., Harawa, N., Mafi, J. N., & Sarkisian, C. (2025) · Health Affairs Scholar · doi:10.1093/haschl/qxae175 · Cited by 2
Siddiqui, T., Zioupos, P., Kelly, K., England, L., Baldini, E., Viner, M., & Márquez-Grant, N. (2026) · Forensic Science International · doi:10.1016/j.forsciint.2026.113078 · Cited by 1
Metadata
- Authors
- Gardner, M. J., & Altman, D. G.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1986-03-15
- Volume
- 292
- Issue
- 6522
- Pages
- 746-750
- ISSN
- 0007-1447 (ISSN-L)
- 0267-0623
- 1468-5833
- OpenAlex
- W2104312285
- Cited by
- 2,010
- References
- 1
- FWCI
- 71.69
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
