An improved Bonferroni procedure for multiple tests of significance

SIMES, R. J.

doi:10.1093/biomet/73.3.751

Cited by 2,396Statistical Methods in Clinical TrialsProbability and Statistical ResearchStatistical Methods and Applications

An improved Bonferroni procedure for multiple tests of significance

SIMES, R. J.·1986·Biometrika

DOI 10.1093/biomet/73.3.751

Open this paper in CoChat — free account

Abstract

A modification of the Bonferroni procedure for testing multiple hypotheses is presented. The method, based on the ordered p-values of the individual tests, is less conservative than the classical Bonferroni procedure but is still simple to apply. A simulation study shows that the probability of a type I error of the procedure does not exceed the nominal significance level, α, for a variety of multivariate normal and multivariate gamma test statistics. For independent tests the procedure has type I error probability equal to α. The method appears particularly advantageous over the classical Bonferroni procedure when several highly-correlated test statistics are involved.

Integrity signals

Registry

Crossref · 10.1093/biomet/73.3.751

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

MBIs, compared to active controls, were more effective in enhancing state and trait attentional skills, executive functioning, and emotional clarity.
“evidence suggesting that MBIs, compared to active controls, were more effective in enhancing state and trait attentional skills [91], executive functioning [92], and emotional clarity [93].”
From Treatment condition as a moderator and change in trait mindfulness as a mediator of a brief mindfulness ecological momentary intervention for generalized anxiety disorder (2024) · cites this paper as [92]

A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · see citing works
Simultaneous Statistical Inference
Miller, R. G. (1981) · Springer series in statistics · doi:10.1007/978-1-4613-8122-8 · Cited by 5,608 · see citing works
An improved Bonferroni inequality and applications
Worsley, K. J. (1982) · Biometrika · doi:10.1093/biomet/69.2.297 · Cited by 218 · see citing works
On Multivariate Normal Probabilities of Rectangles: Their Dependence on Correlations
Šidák, Z. (1968) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698122 · Cited by 211 · see citing works
On Probabilities of Rectangles in Multivariate Student Distributions: Their Dependence on Correlations
Šidák, Z. (1971) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177693504 · Cited by 105 · see citing works

Flagged first, then by citations

Sorted by citations

Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · see citing works
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490 · see citing works
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829 · see citing works
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204 · see citing works
… and the Cross-Section of Expected Returns
Harvey, C. R., Liu, Y., & Zhu, H. (2016) · Review of Financial Studies · doi:10.1093/rfs/hhv059 · Cited by 2,119 · see citing works
On the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 1,349 · see citing works
Predictors of bullying and victimization in childhood and adolescence: A meta-analytic investigation
Cook, C. R., Williams, K. R., Guerra, N. G., Kim, T. E., & Sadek, S. (2010) · School Psychology Quarterly · doi:10.1037/a0020149 · Cited by 1,758 · see citing works
False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies
Glickman, M. E., Rao, S. R., & Schultz, M. R. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.03.012 · Cited by 1,561 · see citing works
Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
Storey, J. D., Taylor, J., & Siegmund, D. (2003) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2004.00439.x · Cited by 1,345 · see citing works
A Stagewise Rejective Multiple Test Procedure Based on a Modified Bonferroni Test
Hommel, G. (1988) · Biometrika · doi:10.1093/biomet/75.2.383 · Cited by 1,367 · see citing works
Do multiple outcome measures require p-value adjustment?
Feise, R. J. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-8 · Cited by 1,299 · see citing works
An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons
García, S., & Herrera, F. (2008) · Cited by 1,277 · see citing works
Multiple Comparisons Using R
Bretz, F., Hothorn, T., & Westfall, P. (2016) · doi:10.1201/9781420010909 · Cited by 1,233 · see citing works
Controlling the familywise error rate in functional neuroimaging: a comparative review
Nichols, T. E., & Hayasaka, S. (2003) · Statistical Methods in Medical Research · doi:10.1191/0962280203sm341ra · Cited by 1,210 · see citing works
Computational Molecular Evolution
Yang, Z. (2006) · doi:10.1093/acprof:oso/9780198567028.001.0001 · Cited by 1,143 · see citing works
A Linear Non-Gaussian Acyclic Model for Causal Discovery
Shimizu, S., Hoyer, P. O., Hyvärinen, A., & Kerminen, A. (2006) · Cited by 1,152 · see citing works
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,054 · see citing works
Adjusted P-Values for Simultaneous Inference
Wright, S. P. (1992) · Biometrics · doi:10.2307/2532694 · Cited by 1,026 · see citing works
A Scan for Positively Selected Genes in the Genomes of Humans and Chimpanzees
Nielsen, R., Bustamante, C. D., Clark, A. G., Glanowski, S., Sackton, T. B., Hubisz, M. J., Fledel-Alon, A., Tanenbaum, D. M., Civello, D., White, T. J., et al. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030170 · Cited by 998 · see citing works
Common genetic variants on 5p14.1 associate with autism spectrum disorders
Wang, K., Zhang, H., Ma, D., Bucan, M., Glessner, J. T., Abrahams, B. S., Salyakina, D., Imielinski, M., Bradfield, J. P., Sleiman, P. M. A., et al. (2009) · Nature · doi:10.1038/nature07999 · Cited by 989 · see citing works
Nonparametric Pairwise Multiple Comparisons in Independent Groups using Dunn's Test
Dinno, A. (2015) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1501500117 · Cited by 979 · see citing works
Pathway-Based Approaches for Analysis of Genomewide Association Studies
Wang, K., Li, M., & Bućan, M. (2007) · The American Journal of Human Genetics · doi:10.1086/522374 · Cited by 858 · see citing works
edgeR v4: powerful differential analysis of sequencing data with expanded functionality and improved support for small counts and larger datasets
Chen, Y., Chen, L., Lun, A. T. L., Baldoni, P. L., & Smyth, G. K. (2025) · Nucleic Acids Research · doi:10.1093/nar/gkaf018 · Cited by 898 · see citing works
A Randomized, Controlled Trial of Oral Propranolol in Infantile Hemangioma
Léauté-Labrèze, C., Hoeger, P. H., Mazereeuw‐Hautier, J., Guibaud, L., Baselga, E., Pošiūnas, G., Phillips, R., Cáceres, H., López‐Gutiérrez, J. C., Ballona, R., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1404710 · Cited by 794 · see citing works
A general introduction to adjustment for multiple comparisons
Chen, S., Feng, Z., & Xiaolian, Y. (2017) · Journal of Thoracic Disease · doi:10.21037/jtd.2017.05.34 · Cited by 764 · see citing works
TREM2 regulates microglial cholesterol metabolism upon chronic phagocytic challenge
Nugent, A. A., Lin, K., van Lengerich, B., Lianoglou, S., Przybyla, L., Davis, S. S., Llapashtica, C., Wang, J., Kim, D. J., Xia, D., et al. (2020) · Neuron · doi:10.1016/j.neuron.2019.12.007 · Cited by 745 · see citing works
Empirical Bayes methods and false discovery rates for microarrays
Efron, B., & Tibshirani, R. (2002) · Genetic Epidemiology · doi:10.1002/gepi.1124 · Cited by 684 · see citing works
Identification of Genetic Factors that Modify Clinical Onset of Huntington’s Disease
Lee, J.-M., Wheeler, V. C., Chao, M. J., Vonsattel, J. P. G., Pinto, R. M., Lucente, D., Abu-Elneel, K., Ramos, E. M., Mysore, J. S., Gillis, T., et al. (2015) · Cell · doi:10.1016/j.cell.2015.07.003 · Cited by 655 · see citing works
The early stages of duplicate gene evolution
Moore, R. C., & Purugganan, M. D. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2535513100 · Cited by 640 · see citing works
The nature of worry in generalized anxiety disorder: A predominance of thought activity
Borkovec, T. D., & Inz, J. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90027-g · Cited by 634 · see citing works
Using false discovery rates for multiple comparisons in ecology and evolution
Pike, N. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00061.x · Cited by 631 · see citing works
STREME: accurate and versatile sequence motif discovery
Bailey, T. L. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab203 · Cited by 631 · see citing works
MULTIPLE COMPARISON PROCEDURES UPDATED
Ludbrook, J. (1998) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/j.1440-1681.1998.tb02179.x · Cited by 613 · see citing works
Genetic evidence implicates the immune system and cholesterol metabolism in the aetiology of Alzheimer’s disease
Jones, L., Holmans, P. A., Hamshere, M. L., Harold, D., Moskvina, V., Ivanov, D., Pocklington, A., Abraham, R., Hollingworth, P., Sims, R., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013950 · Cited by 606 · see citing works
Accuracy and Power of Statistical Methods for Detecting Adaptive Evolution in Protein Coding Sequences and for Identifying Positively Selected Sites
Wong, W. S. W., Yang, Z., Goldman, N., & Nielsen, R. (2004) · Genetics · doi:10.1534/genetics.104.031153 · Cited by 599 · see citing works
Distinguishing differential susceptibility from diathesis–stress: Recommendations for evaluating interaction effects
Roisman, G. I., Newman, D. A., Fraley, R. C., Haltigan, J. D., Groh, A. M., & Haydon, K. C. (2012) · Development and Psychopathology · doi:10.1017/s0954579412000065 · Cited by 543 · see citing works
Functional Impact of 10 Days of Bed Rest in Healthy Older Adults
Kortebein, P., Symons, T. B., Ferrando, A., Paddon-Jones, D., Ronsen, O., Protas, E., Conger, S., Lombeida, J., Wolfe, R., & Evans, W. J. (2008) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/63.10.1076 · Cited by 550 · see citing works
Cyclophosphamide-Induced Cystitis and Bladder Cancer in Patients with Wegener Granulomatosis
Talar‐Williams, C., Hijazi, Y. M., Walther, M. M., Linehan, W. M., Hallahan, C. W., Lubensky, I., Kerr, G. S., Hoffman, G. S., Fauci, A. S., & Sneller, M. C. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-124-5-199603010-00003 · Cited by 531 · see citing works
Semuloparin for Thromboprophylaxis in Patients Receiving Chemotherapy for Cancer
Agnelli, G., George, D. J., Kakkar, A. K., Fisher, W., Lassen, M. R., Mismetti, P., Mouret, P., Chaudhari, U., Lawson, F. C., & Turpie, A. G. G. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1108898 · Cited by 531 · see citing works
A component analysis of cognitive-behavioral therapy for generalized anxiety disorder and the role of interpersonal problems.
Borkovec, T. D., Newman, M. G., Pincus, A. L., & Lytle, R. (2002) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.70.2.288 · Cited by 565 · see citing works
Truncated product method for combining P ‐values
Zaykin, D. V., Анатольевич, Ж. Л., Westfall, P. H., & Weir, B. S. (2002) · Genetic Epidemiology · doi:10.1002/gepi.0042 · Cited by 508 · see citing works
Resampling-based multiple testing for microarray data analysis
Ge, Y., Dudoit, S., & Speed, T. P. (2003) · Test · doi:10.1007/bf02595811 · Cited by 506 · see citing works
Testing for neglected nonlinearity in time series models
Lee, T., White, H., & Granger, C. W. J. (1993) · Journal of Econometrics · doi:10.1016/0304-4076(93)90122-l · Cited by 500 · see citing works
The harmonic mean <i>p</i> -value for combining dependent tests
Wilson, D. J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1814092116 · Cited by 449 · see citing works
A quantitative review of heterozygosity–fitness correlations in animal populations
Chapman, J. R., Nakagawa, S., Coltman, D. W., Slate, J., & Sheldon, B. C. (2009) · Molecular Ecology · doi:10.1111/j.1365-294x.2009.04247.x · Cited by 467 · see citing works
Design and Analysis of Quality of Life Studies in Clinical Trials
Fairclough, D. L. (2002) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420035438 · Cited by 477 · see citing works
Reproducible RNA-seq analysis using recount2
Collado‐Torres, L., Nellore, A., Kammers, K., Ellis, S., Taub, M. A., Hansen, K. D., Jaffe, A. E., Langmead, B., & Leek, J. T. (2017) · Nature Biotechnology · doi:10.1038/nbt.3838 · Cited by 439 · see citing works
ACAT: A Fast and Powerful p Value Combination Method for Rare-Variant Analysis in Sequencing Studies
Liu, Y., Chen, S., Li, Z., Morrison, A. C., Boerwinkle, E., & Lin, X. (2019) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2019.01.002 · Cited by 458 · see citing works
Hypoglycemia and clinical outcomes in patients with diabetes hospitalized in the general ward
Turchin, A., Matheny, M. E., Shubina, M., Scanlon, J. V., Greenwood, B., & Pendergrass, M. L. (2009) · Diabetes Care · doi:10.2337/dc08-2127 · Cited by 453 · see citing works
Adapting to unknown sparsity by controlling the false discovery rate
Abramovich, F., Benjamini, Y., Donoho, D. L., & Johnstone, I. M. (2006) · The Annals of Statistics · doi:10.1214/009053606000000074 · Cited by 455 · see citing works
Efficacy of a cognitive-behavioral treatment for generalized anxiety disorder: Evaluation in a controlled clinical trial
Ladouceur, R., Dugas, M. J., Freeston, M. H., Léger, E., Gagnon, F., & Thibodeau, N. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.6.957 · Cited by 446 · see citing works
A Sequentially Rejective Test Procedure Based on a Modified Bonferroni Inequality
ROM, D. M. (1990) · Biometrika · doi:10.1093/biomet/77.3.663 · Cited by 422 · see citing works
Study and treatment of post Lyme disease (STOP-LD)
Krupp, L., Hyman, L., GRIMSON, R. C., Coyle, P. K., Melville, P., Ahnn, S., Dattwyler, R. J., & Chandler, B. J. (2003) · Neurology · doi:10.1212/01.wnl.0000071227.23769.9e · Cited by 417 · see citing works
Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies
Cramer, A. O. J., van Ravenzwaaij, D., Matzke, D., Steingroever, H., Wetzels, R., Grasman, R. P. P. P., Waldorp, L., & Wagenmakers, E. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0913-5 · Cited by 416 · see citing works
Toeholds, Bid Jumps, and Expected Payoffs in Takeovers
Betton, S., & Eckbo, B. E. (2000) · Review of Financial Studies · doi:10.1093/rfs/13.4.841 · Cited by 396 · see citing works
Prognostic factors for survival in advanced non-small-cell lung cancer: univariate and multivariate analyses including recursive partitioning and amalgamation algorithms in 1,052 patients. The European Lung Cancer Working Party.
Paesmans, M., Sculier, J., Libert, P., Bureau, G., Dabouis, G., Thiriaux, J., Michel, J., Cutsem, O. V., SERGYSELS, R., & Mommen, P. (1995) · Journal of Clinical Oncology · doi:10.1200/jco.1995.13.5.1221 · Cited by 386 · see citing works
GATES: A Rapid and Powerful Gene-Based Association Test Using Extended Simes Procedure
Li, M., Gui, H., Kwan, J. S. H., & Sham, P. C. (2011) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.01.019 · Cited by 386 · see citing works
Polygenic basis and biomedical consequences of telomere length variation
Codd, V., Wang, Q., Allara, E., Musicha, C., Kaptoge, S. K., Stoma, S., Jiang, T., Hamby, S. E., Braund, P. S., Bountziouka, V. P., et al. (2021) · Nature Genetics · doi:10.1038/s41588-021-00944-6 · Cited by 376 · see citing works
Unintentional non-adherence to chronic prescription medications: How unintentional is it really?
Gadkari, A. S., & McHorney, C. A. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-98 · Cited by 380 · see citing works
Multiple hypothesis testing in genomics
Goeman, J., & Solari, A. (2014) · Statistics in Medicine · doi:10.1002/sim.6082 · Cited by 377 · see citing works
FungiDB: An Integrated Bioinformatic Resource for Fungi and Oomycetes
Basenko, E. Y., Pulman, J. A., Shanmugasundram, A., Harb, O. S., Crouch, K., Starns, D., Warrenfeltz, S. W., Aurrecoechea, C., Stoeckert, C. J., Kissinger, J. C., et al. (2018) · Journal of Fungi · doi:10.3390/jof4010039 · Cited by 352 · see citing works
Comparisons between rumination and worry in a non-clinical population
Watkins, E. R., Moulds, M. L., & Mackintosh, B. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.11.008 · Cited by 367 · see citing works
Exploring the false discovery rate in multichannel NIRS
Singh, A. K., & Dan, I. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.047 · Cited by 363 · see citing works
Enoxaparin versus Unfractionated Heparin in Elective Percutaneous Coronary Intervention
Montalescot, G., White, H. D., Gallo, R., Cohen, M. C., Steg, P. G., Aylward, P. E., Bode, C., Massimo Chiariello, A., King, S. B., Harrington, R. A., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa052711 · Cited by 359 · see citing works
Is the Effect of Procedural Justice on Police Legitimacy Invariant? Testing the Generality of Procedural Justice and Competing Antecedents of Legitimacy
Wolfe, S. E., Nix, J., Kaminski, R. J., & Rojek, J. J. (2015) · Journal of Quantitative Criminology · doi:10.1007/s10940-015-9263-8 · Cited by 353 · see citing works
The Simes Method for Multiple Hypothesis Testing With Positively Dependent Test Statistics
Sarkar, S. K., & Chang, C.-K. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473682 · Cited by 336 · see citing works
Group cognitive-behavioral therapy for generalized anxiety disorder: Treatment outcome and long-term follow-up
Dugas, M. J., Ladouceur, R., Léger, E., Freeston, M. H., Langolis, F., Provencher, M. D., & Boisvert, J.-M. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.4.821 · Cited by 331 · see citing works
Controlling the False Discovery Rate: A New Application to Account for Multiple and Dependent Tests in Local Statistics of Spatial Association
Castro, M. C., & Singer, B. H. (2006) · Geographical Analysis · doi:10.1111/j.0016-7363.2006.00682.x · Cited by 333 · see citing works
Outcomes of Add‐on Treatment with Lamotrigine in Partial Epilepsy
Smith, D. F., Baker, G. A., Davies, G., Dewey, M. E., & Chadwick, D. W. (1993) · Epilepsia · doi:10.1111/j.1528-1157.1993.tb02417.x · Cited by 330 · see citing works
Exposure to severe urban air pollution influences cognitive outcomes, brain volume and systemic inflammation in clinically healthy children
Calderón-Garcidueñas, L., Engle, R., Mora-Tiscareño, A., Styner, M., Gómez-Garza, G., Zhu, H., Jewells, V., Torres-Jardón, R., Romero, L., Monroy-Acosta, M. E., et al. (2011) · Brain and Cognition · doi:10.1016/j.bandc.2011.09.006 · Cited by 323 · see citing works
Generalizations of the familywise error rate
Lehmann, E. L., & Romano, J. P. (2005) · The Annals of Statistics · doi:10.1214/009053605000000084 · Cited by 320 · see citing works
Estimating the Proportion of True Null Hypotheses, with application to DNA Microarray Data
Langaas, M., Lindqvist, B. H., & Ferkingstad, E. (2005) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2005.00515.x · Cited by 316 · see citing works
Multiple Hypotheses Testing with Weights
Benjamini, Y., & Hochberg, Y. (1997) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00072 · Cited by 311 · see citing works
Metrics for External Model Evaluation with an Application to the Population Pharmacokinetics of Gliclazide
Brendel, K., Comets, E., Laffont, C. M., Laveille, C., & Mentré, F. (2006) · Pharmaceutical Research · doi:10.1007/s11095-006-9067-5 · Cited by 308 · see citing works
An Experimental Study of Catechol-O-Methyltransferase Val158Met Moderation of Δ-9-Tetrahydrocannabinol-Induced Effects on Psychosis and Cognition
Henquet, C., Rosa, A., A, L. K. M., Papiol, S., Fañanás, L., Drukker, M., Ramaekers, J. G., & van Os, J. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301197 · Cited by 299 · see citing works
Induction of smoking urge through imaginal and in vivo procedures: Physiological and self-report manifestations.
Drobes, D. J., & Tiffany, S. T. (1997) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.106.1.15 · Cited by 274 · see citing works
Molecular Evolution
Yang, Z. (2014) · doi:10.1093/acprof:oso/9780199602605.001.0001 · Cited by 273 · see citing works
The feasibility and outcome of clinic plus Internet delivery of cognitive-behavior therapy for childhood anxiety.
Spence, S. H., Holmes, J. M., March, S., & Lipp, O. V. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.3.614 · Cited by 261 · see citing works
Some Results on False Discovery Rate in Stepwise multiple testing procedures
Sarkar, S. K. (2002) · The Annals of Statistics · doi:10.1214/aos/1015362192 · Cited by 269 · see citing works
Adaptive designs for confirmatory clinical trials
Bretz, F., König, F., Brannath, W., Glimm, E., & Posch, M. (2009) · Statistics in Medicine · doi:10.1002/sim.3538 · Cited by 265 · see citing works
Modulation of the Osteosarcoma Expression Phenotype by MicroRNAs
Namløs, H. M., Meza‐Zepeda, L. A., Barøy, T., Østensen, I. H. G., Kresse, S. H., Kuijjer, M. L., Serra, M., Buerger, H., Cleton-Jansen, A., & Myklebost, O. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048086 · Cited by 264 · see citing works
Multiplicity Considerations in the Design and Analysis of Clinical Trials
Cook, R. J., & Farewell, V. T. (1996) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2983471 · Cited by 257 · see citing works
Generalizations of the Familywise Error Rate
Lehmann, E. L., & Romano, J. P. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1412-4_57 · Cited by 253 · see citing works
Cognitive--behavioral treatment of obsessive thoughts: A controlled study.
Freeston, M. H., Ladouceur, R., Gagnon, F., Thibodeau, N., Rhéaume, J., Letarte, H., & Bujold, A. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.3.405 · Cited by 300 · see citing works
Play it again Sam: Repeated exposure to emotionally evocative music polarises liking and smiling responses, and influences other affective reports, facial EMG, and heart rate
Witvliet, C., & Vrana, S. (2007) · Cognition & Emotion · doi:10.1080/02699930601000672 · Cited by 209 · see citing works
Neuropsychological functioning in nonmentally retarded autistic individuals
Minshew, N. J., Muenz, L. R., Goldstein, G., & Payton, J. B. (1992) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688639208402860 · Cited by 244 · see citing works
The occurrence of preterm delivery is linked to pregnancy-specific distress and elevated inflammatory markers across gestation
Coussons‐Read, M. E., Lobel, M., Carey, J. C., Kreither, M., D'Anna‐Hernandez, K., Argys, L. M., Ross, R. G., Brandt, C., & Cole, S. (2012) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2012.02.009 · Cited by 245 · see citing works
Smaller subcortical volumes and cognitive deficits in children with prenatal methamphetamine exposure
Chang, L., Smith, L. M., LoPresti, C. M., Yonekura, M. L., Kuo, J., Walot, I., & Ernst, T. M. (2004) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2004.06.004 · Cited by 243 · see citing works
Some probability inequalities for ordered $\rm MTP\sb 2$ random variables: a proof of the Simes conjecture
Sarkar, S. K. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144846 · Cited by 242 · see citing works
Multiple testing in clinical trials
Bauer, P. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100609 · Cited by 241 · see citing works
Optimally weighted, fixed sequence and gatekeeper multiple testing procedures
Westfall, P. H., & Krishen, A. (2001) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(01)00077-5 · Cited by 240 · see citing works
Cognitive-behavioral treatment of obsessive thoughts: a controlled study
Freeston, M. H., Ladouceur, R., Gagnon, F., Thibodeau, N., Rhéaume, J., Letarte, H., & Bujold, A. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.3.405 · Cited by 234 · see citing works
Deaths Occurring During the First Year After Treatment Onset for Polyarteritis Nodosa, Microscopic Polyangiitis, and Churg-Strauss Syndrome
Bourgarit, A., Toumelin, P. L., Pagnoux, C., Cohen, P., Mahr, A., Guern, V. L., Mouthon, L., & Guillevin, L. (2005) · Medicine · doi:10.1097/01.md.0000180793.80212.17 · Cited by 235 · see citing works
Characteristics of Clinical Trials to Support Approval of Orphan vs Nonorphan Drugs for Cancer
Kesselheim, A. S. (2011) · JAMA · doi:10.1001/jama.2011.769 · Cited by 231 · see citing works
Gatekeeping strategies for clinical trials that do not require all primary effects to be significant
Dmitrienko, A. A., Offen, W., & Westfall, P. H. (2003) · Statistics in Medicine · doi:10.1002/sim.1526 · Cited by 228 · see citing works
Association between the prevalence of obesity and adherence to the Mediterranean diet: the ATTICA study
Panagiotakos, D. B., Chrysohoou, C. A., Pitsavos, C. S., & Stefanadis, C. (2006) · Nutrition · doi:10.1016/j.nut.2005.11.004 · Cited by 226 · see citing works
A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion
Farcomeni, A. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206079046 · Cited by 222 · see citing works
Fisher’s exact approach for post hoc analysis of a chi-squared test
Shan, G., & Gerstenberger, S. (2017) · PLoS ONE · doi:10.1371/journal.pone.0188709 · Cited by 223 · see citing works
Testing for Neglected Nonlinearity in Time Series Models: A Comparison of Neural Network Methods and Alternative Tests
Lee, T.-H., & White, H. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511753961.009 · Cited by 213 · see citing works
Comparisons of methods for multiple hypothesis testing in neuropsychological research
Blakesley, R. E., Mazumdar, S., Dew, M. A., Houck, P. R., Tang, G., Reynolds, C. F., & Butters, M. A. (2009) · Neuropsychology · doi:10.1037/a0012850 · Cited by 206 · see citing works

Authors: SIMES, R. J.
Affiliations: The University of Sydney (AU)
Corresponding author: SIMES, R. J.
ORCID: SIMES, R. J.
Venue: Biometrika
Publisher: Oxford University Press (OUP)
Published: 1986
Volume: 73
Issue: 3
Pages: 751-754
ISSN: 0006-3444 (ISSN-L)
1464-3510
DOI: 10.1093/biomet/73.3.751
OpenAlex: W2099107563
Cited by: 2,396
References: 5
Citations by year: 2026: 61 · 2025: 77 · 2024: 92 · 2023: 89 · 2022: 97 · 2021: 93 · 2020: 129 · 2019: 143 · 2018: 98 · 2017: 100 · 2016: 110 · 2015: 98 · 2014: 119 · 2013: 97 · 2012: 89
FWCI: 10.84
Type: journal article
Language: en
Open access: closed
Locations: Biometrika (publishedVersion)
Funders: Medical Research Council
National Cancer Institute
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
Keywords: Bonferroni procedure, multiple comparisons, type I error probability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An improved Bonferroni procedure for multiple tests of significance

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks