The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Inference by eye: Reading the overlap of independent confidence intervals
Abstract
When 95 per cent confidence intervals (CIs) on independent means do not overlap, the two‐tailed p‐value is less than 0.05 and there is a statistically significant difference between the means. However, p for non‐overlapping 95 per cent CIs is actually considerably smaller than 0.05: If the two CIs just touch, p is about 0.01, and the intervals can overlap by as much as about half the length of one CI arm before p becomes as large as 0.05. Keeping in mind this rule—that overlap of half the length of one arm corresponds approximately to statistical significance at p = 0.05—can be helpful for a quick appreciation of figures that display CIs, especially if precise p‐values are not reported. The author investigated the robustness of this and similar rules, and found them sufficiently accurate when sample sizes are at least 10, and the two intervals do not differ in width by more than a factor of 2. The author reviewed previous discussions of CI overlap and extended the investigation to p‐values other than 0.05 and 0.01. He also studied 95 per cent CIs on two proportions, and on two Pearson correlations, and found similar rules apply to overlap of these asymmetric CIs, for a very broad range of cases. Wider use of figures with 95 per cent CIs is desirable, and these rules may assist easy and appropriate understanding of such figures. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Methods for Psychology.
Gudgeon, A. C., & Howell, D. C. (1994) · The Statistician · doi:10.2307/2348956 · Cited by 8,278
Two-sided confidence intervals for the single proportion: comparison of seven methods
Newcombe, R. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<857::aid-sim777>3.0.co;2-e · Cited by 5,107
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
Interval estimation for the difference between independent proportions: comparison of eleven methods
Newcombe, R. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<873::aid-sim779>3.0.co;2-i · Cited by 1,851
THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN TWO MEANS WHEN THE POPULATION VARIANCES ARE UNEQUAL
WELCH, B. L. (1938) · Biometrika · doi:10.1093/biomet/29.3-4.350 · Cited by 1,640
Publication Manual of the American Psychological Association: BOOK REVIEW
Yao, R. (2011) · Family and Consumer Sciences Research Journal · doi:10.1111/j.1552-3934.2011.02081.x · Cited by 1,451
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449 · cited 12×
“An informal adjustment towards conservatism, to protect against inflated Type 1 error rates [ 5 ], may be to use p 5 ] recommended a range of ways to think about CIs without invoking p values.”
BackgroundMethodInfluentialSelf-citationOn judging the significance of differences by examining the overlap between confidence intervals.
Schenker, N., & Gentleman, J. F. (2001) · The American Statistician · doi:10.1198/000313001317097960 · Cited by 1,218
Payton, M. E., Greenstone, M. H., & Schenker, N. (2003) · Journal of Insect Science · doi:10.1093/jis/3.1.34 · Cited by 856
Payton, M. E., Greenstone, M. H., & Schenker, N. (2003) · Journal of Insect Science · doi:10.1673/031.003.3401 · Cited by 699
Cited by
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Self-citationTrust and team performance: A meta-analysis of main effects, moderators, and covariates.
De Jong, B. A., Dirks, K. T., & Gillespie, N. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000110 · Cited by 616
The frequencies and disparities of adverse childhood experiences in the U.S.
Giano, Z., Wheeler, D. L., & Hubach, R. D. (2020) · BMC Public Health · doi:10.1186/s12889-020-09411-z · Cited by 463
Plant-soil feedback and the maintenance of diversity in Mediterranean-climate shrublands
Teste, F. P., Kardol, P., Turner, B. L., Wardle, D. A., Zemunik, G., Renton, M., & Laliberté, E. (2017) · Science · doi:10.1126/science.aai8291 · Cited by 424
Impacts of the COVID-19 pandemic on rural America
Mueller, J. T., McConnell, K., Burow, P. B., Pofahl, K., Merdjanoff, A. A., & Farrell, J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2019378118 · Cited by 391
Staphylococcus aureus Biofilms Promote Horizontal Transfer of Antibiotic Resistance
Savage, V. J., Chopra, I., & O'Neill, A. J. (2013) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.02008-12 · Cited by 340
Fair Statistical Communication in HCI
Dragicevic, P. (2016) · Human–Computer Interaction Series · doi:10.1007/978-3-319-26633-6_13 · Cited by 325
Trust, knowledge sharing, and innovative work behavior: empirical evidence from Poland
Kmieciak, R. (2021) · European Journal of Innovation Management · doi:10.1108/ejim-04-2020-0134 · Cited by 267
Karrer, T. M., Josef, A. K., Mata, R., Morris, E. D., & Samanez-Larkin, G. R. (2017) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2017.05.006 · Cited by 260
Tautges, N. E., Chiartas, J. L., Gaudin, A. C. M., O'Geen, A. T., Herrera, I., & Scow, K. M. (2019) · Global Change Biology · doi:10.1111/gcb.14762 · Cited by 258
Kay, M., Kola, T., Hullman, J. R., & Munson, S. A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858558 · Cited by 239
Hullman, J., Resnick, P., & Adar, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142444 · Cited by 194
Child first language and adult second language are both tied to general-purpose learning systems
Hamrick, P., Lum, J. A. G., & Ullman, M. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1713975115 · Cited by 120
Sleep mediates the association between adolescent screen time and depressive symptoms.
Li, X., Buxton, O. M., Lee, S., Chang, A.-M., Berger, L. M., & Hale, L. (2019) · Sleep Medicine · doi:10.1016/j.sleep.2019.01.029 · Cited by 115
Cowling, B. J., Perera, R. A. P. M., Valkenburg, S. A., Leung, N. H. L., Iuliano, A. D., Tam, Y. H., Wong, J. H. F., Fang, V. J., Li, A. P. Y., So, H. C., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciz1034 · Cited by 110
A meta-analytic review of mobile advertising research
Maseeh, H. I., Jebarajakirthy, C., Pentecost, R., Ashaduzzaman, M., Arli, D., & Weaven, S. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.06.022 · Cited by 88
Reck, C., Zietlow, A.-L., Müller, M., & Dubber, S. (2016) · Archives of Women's Mental Health · doi:10.1007/s00737-015-0590-4 · Cited by 81
Bauer, P., Brugger, J., König, F., & Posch, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-97711-8 · Cited by 68
Pennino, M. J., Leibowitz, S. G., Compton, J. E., Beyene, M. T., & LeDuc, S. D. (2022) · Science of The Total Environment · doi:10.1016/j.scitotenv.2021.149890 · Cited by 69
Legault, L., Ray, K., Hudgins, A., Pelosi, M., & Shannon, W. (2017) · Motivation and Emotion · doi:10.1007/s11031-016-9593-3 · Cited by 58
Muin, D. A., Wolzt, M., Marculescu, R., Sheikh Rezaei, S., Salama, M., Fuchs, C., Luger, A., Bragagna, E., Litschauer, B., & Bayerle-Eder, M. (2015) · Fertility and Sterility · doi:10.1016/j.fertnstert.2015.06.010 · Cited by 48
Communicating the Scientific Consensus on Climate Change: Diverse Audiences and Effects Over Time
Goldberg, M. H., Gustafson, A., van der Linden, S., Rosenthal, S. A., & Leiserowitz, A. (2022) · Environment and Behavior · doi:10.1177/00139165221129539 · Cited by 46
van Doeselaar, L., Klimstra, T. A., Denissen, J. J. A., Branje, S., & Meeus, W. (2018) · Developmental Psychology · doi:10.1037/dev0000479 · Cited by 37
Cullen, A. E., Addington, J., Bearden, C. E., Stone, W. S., Seidman, L. J., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., Mathalon, D. H., McGlashan, T. H., et al. (2020) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2020.104649 · Cited by 34
Do you remember? Rater memory systems and leadership measurement
Hansbrough, T. K., Lord, R. G., Schyns, B., Foti, R. J., Liden, R. C., & Acton, B. P. (2021) · The Leadership Quarterly · doi:10.1016/j.leaqua.2020.101455 · Cited by 33
Dang, C., Harrington, K. D., Lim, Y. Y., Ames, D., Hassenstab, J., Laws, S. M., Yassi, N., Hickey, M., Rainey-Smith, S., Robertson, J., et al. (2018) · Journal of Alzheimer’s Disease · doi:10.3233/jad-180507 · Cited by 31
(2015) · HAL · Cited by 20
Nielson, M. G., Rogers, A. A., & Cook, R. E. (2022) · Sex Roles · doi:10.1007/s11199-022-01285-2 · Cited by 7
Not a Silver Bullet for Loneliness: How Attachment and Age Shape Intimacy with AI Companions
Ciriello, R., Gal, U., & Turel, O. (2026) · arXiv · doi:10.48550/arxiv.2602.12476 · Cited by 4
LLM-assisted genre analysis: The effect of sampling temperature on reliability
Grullon-Polanco, L. (2026) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2026.100314 · Cited by 3
AI tutoring can safely and effectively support students: An exploratory RCT in UK classrooms
LearnLM Team, Eedi, :, Wang, A., Rysbek, A., Huber, A., Nambiar, A., Kenolty, A., Caulfield, B., Lilley-Draper, B., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.23633 · Cited by 1
“We then used the resulting posterior distributions to calculate the exact probability that outcomes in one group exceeded those in another, providing a more precise signal than a simple comparison of the intervals (cf. [21–23]).”
Metadata
- Authors
- Cumming, G.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2008-11-07
- Volume
- 28
- Issue
- 2
- Pages
- 205-220
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W1966165134
- Cited by
- 670
- References
- 37
- FWCI
- 7.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.