Adjust for multiple comparisons? It’s not that simple
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
P values were not corrected for multiple comparisons due to the small sample size and exploratory nature of the reported outcomes.
“As with the data contained in the original report [16], P values were not corrected for multiple comparisons due to the small sample size and exploratory nature of these reported outcomes [33,34].”
From Evaluation of exploratory fluid biomarkers from a phase 1 senolytic trial in mild Alzheimer's disease (2025) · cites this paper as [33]
In “The Statistician’s Page,” Althouse recommends reporting exploratory analyses without multiple-comparison adjustment and identifying them as exploratory. The cited passage does not give small sample size as a reason for foregoing correction, so it supports only part of the stated rationale. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965 · see citing works
What's wrong with Bonferroni adjustments
Perneger, T. V. (1998) · BMJ · doi:10.1136/bmj.316.7139.1236 · Cited by 5,900 · see citing works
Do multiple outcome measures require p-value adjustment?
Feise, R. J. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-8 · Cited by 1,299 · see citing works
The evolving case-control study
Cole, P. T. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90006-7 · Cited by 173 · see citing works
Is the clinical course of HIV infection changing?
Porter, K. (1997) · BMJ · doi:10.1136/bmj.315.7117.1236a · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Stekovic, S., Hofer, S. J., Tripolt, N., Aon, M. A., Royer, P., Pein, L., Stadler, J. T., Pendl, T., Prietl, B., Url, J., et al. (2019) · Cell Metabolism · doi:10.1016/j.cmet.2019.07.016 · Cited by 412 · see citing works
Karter, A. J., Parker, M. M., Moffet, H. H., Gilliam, L. K., & Dlott, R. (2021) · JAMA · doi:10.1001/jama.2021.6530 · Cited by 191 · see citing works
To adjust, or not to adjust, for multiple comparisons
Hooper, R. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111688 · Cited by 97 · see citing works
Antibiotic Exposure and Risk of Parkinson's Disease in Finland: A Nationwide Case‐Control Study
Mertsalmi, T. H., Pekkonen, E., & Scheperjans, F. (2020) · Movement Disorders · doi:10.1002/mds.27924 · Cited by 88 · see citing works
Fazlollahi, A. M., Yilmaz, R., Winkler-Schwartz, A., Mirchi, N., Ledwos, N., Bakhaidar, M., Alsayegh, A., & Del Maestro, R. F. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.34658 · Cited by 85 · see citing works
Adrian, M., McCauley, E., Berk, M. S., Asarnow, J. R., Korslund, K., Avina, C., Gallop, R., & Linehan, M. M. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13099 · Cited by 68 · see citing works
Nauck, M. A., Muus Ghorbani, M. L., Kreiner, E., Saevereid, H. A., Buse, J. B., & the LEADER Publication Committee on behalf of the LEADER Trial Investigators (2019) · Diabetes Care · doi:10.2337/dc19-0415 · Cited by 69 · see citing works
Islam, J. Y., Vidot, D. C., & Camacho-Rivera, M. (2021) · JCO Oncology Practice · doi:10.1200/op.20.00752 · Cited by 62 · see citing works
Fitzsimmons-Craft, E. E., Krauss, M. J., Costello, S. J., Floyd, G. M., Wilfley, D. E., & Cavazos-Rehg, P. A. (2020) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-019-00808-3 · Cited by 48 · see citing works
Amin‐Esmaeili, M., Farokhnia, M., Susukida, R., Leggio, L., Johnson, R. M., Crum, R. M., & Mojtabai, R. (2024) · Addiction · doi:10.1111/add.16409 · Cited by 43 · see citing works
Écija, C., Luque-Reca, O., Suso-Ribera, C., Catala, P., & Peñacoba, C. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9061763 · Cited by 42 · see citing works
The disaster worker resiliency training program: a randomized clinical trial
Mahaffey, B. L., Mackin, D. M., Rosen, J., Schwartz, R. M., Taioli, E., & Gonzalez, A. (2021) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-020-01552-3 · Cited by 41 · see citing works
Gray, K. E., Hoerster, K. D., Taylor, L., Krieger, J., & Nelson, K. M. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab113 · Cited by 35 · see citing works
An observational treatment study of metacognition in anxious-depression
Fox, C. A., Lee, C. T., Hanlon, A. K., Seow, T. X., Lynch, K., Harty, S., Richards, D., Palacios, J., O'Keane, V., Stephan, K. E., et al. (2023) · eLife · doi:10.7554/elife.87193 · Cited by 34 · see citing works
“Adjustments for multiple comparisons were not conducted for analyses of replicated effects, or exploratory analyses ( Althouse, 2016 ).”
BackgroundYoo, F., Schlosser, R. J., Storck, K. A., Ganjaei, K. G., Rowan, N. R., & Soler, Z. M. (2019) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22406 · Cited by 31 · see citing works
Garbarino, V. R., Palavicini, J. P., Melendez, J., Barthelemy, N. R., He, Y., Kautz, T. F., Lopez-Cruzan, M., Mathews, J. J., Xu, P., Zhang, B., et al. (2025) · Neurotherapeutics · doi:10.1016/j.neurot.2025.e00591 · Cited by 19 · see citing works
“As with the data contained in the original report [16], P values were not corrected for multiple comparisons due to the small sample size and exploratory nature of these reported outcomes [33,34].”
Chun, E. K., Donovan, M., Liu, Y., & Wang, Z. (2022) · Neurobiology of Stress · doi:10.1016/j.ynstr.2022.100427 · Cited by 18 · see citing works
Galante, J., Montero-Marín, J., Vainre, M., Dufour, G., García-Campayo, J., & Jones, P. B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305928 · Cited by 13 · see citing works
- Authors
- Althouse, A. D.
- Affiliations
- University of Pittsburgh Medical Center (US)
- Corresponding author
- Althouse, Andrew D.
- ORCID
- Althouse, Andrew D.
- Venue
- The Annals of Thoracic Surgery
- Publisher
- Elsevier BV
- Published
- 2016-05
- Volume
- 101
- Issue
- 5
- Pages
- 1644-1645
- ISSN
- 0003-4975 (ISSN-L)
- OpenAlex
- W2338184685
- Cited by
- 825
- References
- 5
- Citations by year
- 2026: 76 · 2025: 111 · 2024: 89 · 2023: 104 · 2022: 118 · 2021: 128 · 2020: 117 · 2019: 65 · 2018: 13 · 2017: 1 · 2016: 1
- FWCI
- 27.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Annals of Thoracic Surgery (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- multiple comparisons, multiple testing correction, subgroup analysis, ancillary studies, secondary outcomes, statistical significance
- MeSH terms
- Humans, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
