MultipleTesting.com: A tool for life science researchers for multiple hypothesis testing correction
Open accessPublished version of a preprint
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Scientists from nearly all disciplines face the problem of simultaneously evaluating many hypotheses. Conducting multiple comparisons increases the likelihood that a non-negligible proportion of associations will be false positives, clouding real discoveries. Drawing valid conclusions require taking into account the number of performed statistical tests and adjusting the statistical confidence measures. Several strategies exist to overcome the problem of multiple hypothesis testing. We aim to summarize critical statistical concepts and widely used correction approaches while also draw attention to frequently misinterpreted notions of statistical inference. We provide a step-by-step description of each multiple-testing correction method with clear examples and present an easy-to-follow guide for selecting the most suitable correction technique. To facilitate multiple-testing corrections, we developed a fully automated solution not requiring programming skills or the use of a command line. Our registration free online tool is available at www.multipletesting.com and compiles the five most frequently used adjustment tools, including the Bonferroni, the Holm (step-down), the Hochberg (step-up) corrections, allows to calculate False Discovery Rates (FDR) and q-values. The current summary provides a much needed practical synthesis of basic statistical concepts regarding multiple hypothesis testing in a comprehensible language with well-illustrated examples. The web tool will fill the gap for life science researchers by providing a user-friendly substitute for command-line alternatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“To account for multiple comparisons, Holm-adjusted p-values were used as the primary criterion for interpretation [26].”
From Characterization of human-animal interactions among pet owners in Mexico from a One Health perspective: A cross-sectional study (2026) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
Scientists rise up against statistical significance
Amrhein, V., Greenland, S., & McShane, B. (2019) · Nature · doi:10.1038/d41586-019-00857-9 · Cited by 2,983
Research works printed but not linked: 2
- 42. KS P, S D, MJ vdL. Multiple Testing Procedures: R multtest Package and Applications to Genomics, in Bioinformatics and Computational Biology Solutions Using R and Bioconductor. Springer. 2005.
- 43. Storey JD BA, Dabney A, Robinson D. qvalue: Q-value estimation for false discovery rate control. R package version 2220. 2020.
Cited by
Items 201–216 of 216
Aranyakasemsuk, S., Bantuchai, S., Kumpitak, C., Sattabongkot, J., & Kubera, A. (2026) · Medical and Veterinary Entomology · doi:10.1111/mve.70098
Frei, A. I., Berger, S., Grzonka, P., Amacher, S. A., Kliem, P. S. C., Gebhard, C. E., Hunziker, S., & Sutter, R. (2026) · Critical Care Medicine · doi:10.1097/ccm.0000000000007264
Residual BiLSTM-Based Error Correction Network for Li-Ion Battery SOC Estimation
Al-Hiyali, M. I., Hashim, Y., Kannan, R., Baarimah, A. O., & Abdulghani, A. M. (2026) · World Electric Vehicle Journal · doi:10.3390/wevj17090447
Çobaner, M., Tufan, A. E., Danış, A., İmrek, Y., & Sarı, M. (2026) · Pediatric Neurology · doi:10.1016/j.pediatrneurol.2026.08.007
Emotional and Early Maladaptive Schemas in Adolescents Diagnosed With Major Depressive Disorder
Sarı, M., İmrek, Y., Özcan, G. G., Öztürk, Y., Özyurt, G., Özdel, K., & Tufan, A. E. (2026) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000001886
Kyprianou, E., Saraslanidis, P., Tsalis, G. A., & Panoutsakopoulos, V. (2026) · Journal of Functional Morphology and Kinesiology · doi:10.3390/jfmk11030335
Wang, J., Liu, S., Fu, G., & Savic, D. A. (2026) · Water Research · doi:10.1016/j.watres.2026.126823
Lakó, B., Simon, A., Kubik, A. Z., Gyombolai, Z., & Kovács, É. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15197687
Once Upon a Genome: A Content Analysis of Narratives and Narrativity in News About Genomic Research
Bilandzić, H., Kinnebrock, S., Schug, M., & Engstler, T. (2026) · Science Communication · doi:10.1177/10755470261475308
Chen, J., Naveira, H., Zhang, J., Wu, N., & Xie, Z. (2026) · Ecology and Evolution · doi:10.1002/ece3.74293
Examining drivers’ perception of the low-speed zones in the Australian Capital Territory
Molloy, О., & Shahin, M. (2026) · Transportation Engineering · doi:10.1016/j.treng.2026.100460
Ghaffarpour, S., Rashidi, A., Ghazanfari, Z., Ghasemi, H., Khodashenas, Z., Izadi, P., Naghizadeh, M. M., & Ghazanfari, T. (2026) · Toxicology Letters · doi:10.1016/j.toxlet.2026.113201
Guillen, A., Valle-Asan, S., Barragan-Bustamante, J., & Lazo, R. (2026) · Plants · doi:10.3390/plants15192902
Dahrous, A., Abouelkheir, H. M., & Elnadoury, E. A. (2026) · BMC Oral Health · doi:10.1186/s12903-026-09816-z
Cortical responses to lipread and text-based audiovisual stimuli in adults with and without dyslexia
Cao, Y., Gentile, F., Naseri, P., Romanovska, L., & Bonte, M. L. (2026) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2026.1806964
Liu, C., Ke, Y., Guo, X., Wei, R., & Wang, X. A. (2026) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2026.104681
Metadata
- Authors
- Menyhart, O., Weltz, B., & Győrffy, B.
- Affiliations
- Institute of Molecular Life Sciences (HU)
- Semmelweis University (HU)
- Corresponding author
- Győrffy, Balázs
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-06-09
- Volume
- 16
- Issue
- 6
- Pages
- e0245824
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8189492
- OpenAlex
- W3168713078
- Cited by
- 216
- References
- 48
- Citations by year
- 2026: 48 · 2025: 51 · 2024: 56 · 2023: 29 · 2022: 23 · 2021: 9
- FWCI
- 21.81
- Type
- journal article
- Language
- en
- Update notices
- correction (2022-09-09)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Nemzeti Kutatási Fejlesztési és Innovációs Hivatal (2018-2.1.17-TET-KR-00001, 2020-1.1.6-JÖVŐ-2021-00013, 2018-1.3.1-VKE-2018-00032, 2020-4.1.1.-TKP2020)
- ELIXIR Hungary
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Keywords
- multiple comparisons, multiple testing correction, false positives, Bonferroni correction, false discovery rate, Q-value, statistical inference, life science research
- MeSH terms
- Biological Science Disciplines, Data Interpretation, Statistical, Humans, Models, Theoretical, Software, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.