Cited by 1,299Statistical Methods in Clinical TrialsMeta-analysis and systematic reviewsStatistical Methods in Epidemiology

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Do multiple outcome measures require p-value adjustment?

Open access

Feise, Ronald J·2002·BMC Medical Research Methodology

DOI 10.1186/1471-2288-2-8PMC PMC117123

Open this paper in CoChat — free account Open PDF

Abstract

BACKGROUND: Readers may question the interpretation of findings in clinical trials when multiple outcome measures are used without adjustment of the p-value. This question arises because of the increased risk of Type I errors (findings of false "significance") when multiple simultaneous hypotheses are tested at set p-values. The primary aim of this study was to estimate the need to make appropriate p-value adjustments in clinical trials to compensate for a possible increased risk in committing Type I errors when multiple outcome measures are used. DISCUSSION: The classicists believe that the chance of finding at least one test statistically significant due to chance and incorrectly declaring a difference increases as the number of comparisons increases. The rationalists have the following objections to that theory: 1) P-value adjustments are calculated based on how many tests are to be considered, and that number has been defined arbitrarily and variably; 2) P-value adjustments reduce the chance of making type I errors, but they increase the chance of making type II errors or needing to increase the sample size. SUMMARY: Readers should balance a study's statistical significance with the magnitude of effect, the quality of the study and with findings from other studies. Researchers facing multiple outcome measures might want to either select a primary outcome measure or use a global assessment measure, rather than adjusting the p-value.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1186/1471-2288-2-8

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
What's wrong with Bonferroni adjustments
Perneger, T. V. (1998) · BMJ · doi:10.1136/bmj.316.7139.1236 · Cited by 5,900
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,904
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Multiple Comparison Procedures
Hahs-Vaughn, D., & Lomax, R. (2013) · Routledge eBooks · doi:10.4324/9780203137819-17 · Cited by 2,132
A Stagewise Rejective Multiple Test Procedure Based on a Modified Bonferroni Test
Hommel, G. (1988) · Biometrika · doi:10.1093/biomet/75.2.383 · Cited by 1,367
Adjusting for multiple testing when reporting research results: the Bonferroni vs Holm methods.
Aickin, M., & Gensler, H. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.5.726 · Cited by 1,346
ON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE
Neyman, J., & Pearson, E. S. (1928) · Biometrika · doi:10.1093/biomet/20a.3-4.263 · Cited by 1,164

Show all 42 references

Sorted by citations

Adjust for multiple comparisons? It’s not that simple
Althouse, A. D. (2016) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2015.11.024 · Cited by 825
Don’t fear “fear conditioning”: Methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear
Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., Heitland, I., Hermann, A., Kuhn, M., Kruse, O., et al. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.026 · Cited by 837
COVID-19 and vaccine hesitancy: A longitudinal study
Fridman, A., Gershon, R., & Gneezy, A. (2020) · PLoS ONE · doi:10.1371/journal.pone.0250123 · Cited by 697
Differences in Rural and Urban Health Information Access and Use
Chen, X., Orom, H., Hay, J. L., Waters, E. A., Schofield, E., Li, Y., & Kiviniemi, M. T. (2018) · The Journal of Rural Health · doi:10.1111/jrh.12335 · Cited by 635
Escaping the Bonferroni iron claw in ecological studies
García, L. V. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.13046.x · Cited by 556
Meta-Analysis of MR Imaging in the Diagnosis of Breast Lesions
Peters, N. H. G. M., Rinkes, I. H. M. B., Zuithoff, N. P. A., Mali, W. P. T. M., Moons, K. G. M., & Peeters, P. H. M. (2007) · Radiology · doi:10.1148/radiol.2461061298 · Cited by 529
Rhea: a transparent and modular R pipeline for microbial profiling based on 16S rRNA gene amplicons
Lagkouvardos, I., Fischer, S. E., Kumar, N., & Clavel, T. (2017) · PeerJ · doi:10.7717/peerj.2836 · Cited by 441
An introduction to multiplicity issues in clinical trials: the what, why, when and how
Li, G., Taljaard, M., Van den Heuvel, E. R., Levine, M. A., Cook, D. J., Wells, G. A., Devereaux, P. J., & Thabane, L. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw320 · Cited by 381
Green and blue spaces and behavioral development in Barcelona schoolchildren: The BREATHE project
Amoly, E., Dadvand, P., Forns, J., López-Vicente, M., Basagaña, X., Julvez, J., Alvarez-Pedrerol, M., Nieuwenhuijsen, M. J., & Sunyer, J. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1408215 · Cited by 390
Determinants of Disease Presentation and Outcome during Cryptococcosis: The CryptoA/D Study
Dromer, F., Mathoulin-Pélissier, S., Launay, O., Lortholary, O., & the French Cryptococcosis Study Group (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040021 · Cited by 374
When to adjust alpha during multiple testing: a consideration of disjunction, conjunction, and individual testing
Rubin, M. (2021) · Synthese · doi:10.1007/s11229-021-03276-4 · Cited by 371
Prevalence of Disorders Recorded in Dogs Attending Primary-Care Veterinary Practices in England
O'Neill, D. G., Church, D. B., McGreevy, P. D., Thomson, P. C., & Brodbelt, D. C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090501 · Cited by 376
Association of a Smartphone Application With Medication Adherence and Blood Pressure Control: The MedISAFE-BP Randomized Clinical Trial
Morawski, K., Ghazinouri, R., Krumme, A., Lauffenburger, J. C., Lu, Z., Durfee, E., Oley, L., Lee, J., Mohta, N., Haff, N., et al. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.0447 · Cited by 333
Trials and tribulations of ‘omics data analysis: assessing quality of SIMCA-based multivariate models using examples from pulmonary medicine
Wheelock, Å. M., & Wheelock, C. E. (2013) · Molecular BioSystems · doi:10.1039/c3mb70194h · Cited by 344
Effectiveness of the AUDIT-C as a Screening Test for Alcohol Misuse in Three Race/Ethnic Groups
Frank, D., DeBenedetti, A. F., Volk, R. J., Williams, E. C., Kivlahan, D. R., & Bradley, K. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0594-0 · Cited by 336
Family-based training program improves brain function, cognition, and behavior in lower socioeconomic status preschoolers
Neville, H. J., Stevens, C., Pakulak, E., Bell, T. A., Fanning, J. L., Klein, S., & Isbell, E. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1304437110 · Cited by 359
Collaborative care for bipolar disorder, Part II: impact on clinical outcome, function, and costs.
Bauer, M. S., McBride, L., Williford, W. O., Glick, H., Kinosian, B., Altshuler, L., Beresford, T., Kilbourne, A. M., & Sajatovic, M. (2006) · Psychiatric Services · doi:10.1176/ps.2006.57.7.937 · Cited by 312
A Double-Blind Randomized Controlled Trial of N -Acetylcysteine in Cannabis-Dependent Adolescents
Gray, K. M., Carpenter, M. J., Baker, N. L., DeSantis, S. M., Kryway, E., Hartwell, K. J., McRae-Clark, A. L., & Brady, K. T. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12010055 · Cited by 306
Aerobic Exercise Alters Brain Function and Structure in Parkinson's Disease: A Randomized Controlled Trial
Johansson, M. E., Cameron, I. G. M., van der Kolk, N. M., de Vries, N. M., Klimars, E., Toni, I., Bloem, B. R., & Helmich, R. C. G. (2021) · Annals of Neurology · doi:10.1002/ana.26291 · Cited by 325
Effect of Collaborative Dementia Care via Telephone and Internet on Quality of Life, Caregiver Well-being, and Health Care Use: The Care Ecosystem Randomized Clinical Trial
Possin, K. L., Merrilees, J. J., Dulaney, S., Bonasera, S. J., Chiong, W., Lee, K., Hooper, S. M., Allen, I. E., Braley, T., Bernstein, A., et al. (2019) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2019.4101 · Cited by 272
Modular cognitive-behavioral therapy for body dysmorphic disorder: A randomized controlled trial
Wilhelm, S., Phillips, K. A., Didie, E., Buhlmann, U., Greenberg, J. L., Fama, J. M., Keshaviah, A., & Steketee, G. (2014) · Behavior Therapy · doi:10.1016/j.beth.2013.12.007 · Cited by 238
Correlation between retinal nerve fibre layer thickness and optic nerve head size: an optical coherence tomography study
Savini, G. (2005) · British Journal of Ophthalmology · doi:10.1136/bjo.2004.052498 · Cited by 218
Cognitive training as a potential treatment for overweight and obesity: A critical review of the evidence
Jones, A., Hardman, C. A., Lawrence, N., & Field, M. (2017) · Appetite · doi:10.1016/j.appet.2017.05.032 · Cited by 214
Common pitfalls in statistical analysis: The perils of multiple testing
Ranganathan, P., Pramesh, C. S., & Buyse, M. E. (2016) · Perspectives in Clinical Research · doi:10.4103/2229-3485.179436 · Cited by 206
Do p Values Lose Their Meaning in Exploratory Analyses? It Depends How You Define the Familywise Error Rate
Rubin, M. (2017) · Review of General Psychology · doi:10.1037/gpr0000123 · Cited by 226
Evaluation of a mindfulness-based intervention with and without virtual reality dialectical behavior therapy® mindfulness skills training for the treatment of generalized anxiety disorder in primary care: a pilot study
Navarro-Haro, M. V., Modrego-Alarcón, M., Hoffman, H. G., López-Montoyo, A., Navarro-Gil, M., Montero-Marin, J., García-Palacios, A., Borao, L., & García-Campayo, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00055 · Cited by 189
Tropical mangrove species discrimination using hyperspectral data: A laboratory study
Vaiphasa, C., Ongsomwang, S., Vaiphasa, T., & Skidmore, A. K. (2005) · Estuarine Coastal and Shelf Science · doi:10.1016/j.ecss.2005.06.014 · Cited by 196
Multiomics reveal non-alcoholic fatty liver disease in rats following chronic exposure to an ultra-low dose of Roundup herbicide
Mesnage, R., Renney, G., Séralini, G., Ward, M. A., & Antoniou, M. N. (2017) · Scientific Reports · doi:10.1038/srep39328 · Cited by 193
Neurocognitive profile in 22q11 deletion syndrome and schizophrenia
Chow, E. W. C., Watson, M., Young, D. A., & Bassett, A. S. (2006) · Schizophrenia Research · doi:10.1016/j.schres.2006.04.007 · Cited by 186
Changes in body composition and metabolic profile during interleukin 6 inhibition in rheumatoid arthritis
Tournadre, A., Pereira, B., Dutheil, F., Giraud, C., Courteix, D., Sapin, V., Frayssac, T., Mathieu, S., Malochet‐Guinamand, S., & Soubrier, M. (2017) · Journal of Cachexia Sarcopenia and Muscle · doi:10.1002/jcsm.12189 · Cited by 185
Correcting for multiple-testing in multi-arm trials: is it necessary and is it done?
Wason, J. M. S., Stecher, L., & Mander, A. (2014) · Trials · doi:10.1186/1745-6215-15-364 · Cited by 183
multiGSEA: a GSEA-based pathway enrichment analysis for multi-omics data
(2020) · doi:10.1186/s12859-020-03910-x · Cited by 170
The Risks of Aprotinin and Tranexamic Acid in Cardiac Surgery: A One-Year Follow-Up of 1188 Consecutive Patients
Martin, K., Wiesner, G., Breuer, T., Lange, R., & Tassani, P. (2008) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e318184bc20 · Cited by 176
Electrical stimulation enhances sensory recovery: A randomized controlled trial
Wong, J. N., Olson, J. L., Morhart, M. J., & Chan, K. M. (2015) · Annals of Neurology · doi:10.1002/ana.24397 · Cited by 177
Effects of Mirror Therapy on Motor and Sensory Recovery in Chronic Stroke: A Randomized Controlled Trial
Wu, C., Huang, P.-C., Chen, Y., Lin, K., & Yang, H.-W. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2013.02.007 · Cited by 173
An Updated Recommendation for Multiple Comparisons
Sauder, D., & DeMars, C. E. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918808784 · Cited by 181
Neuropsychological and psychiatric functioning in sheep farmers exposed to low levels of organophosphate pesticides
Ross, S. M., Brewin, C. R., Curran, H. V., Furlong, C. E., Abraham-Smith, K., & Harrison, V. (2010) · Open Research Online - ORO (The Open University) · Cited by 164
Impact of Depression and Post-Traumatic Stress Disorder on Functional Outcome and Health-Related Quality of Life of Patients with Mild Traumatic Brain Injury
Haagsma, J. A., Scholten, A. C., Andriessen, T. M. J. C., Vos, P. E., van Beeck, E. F., & Polinder, S. (2014) · Journal of Neurotrauma · doi:10.1089/neu.2013.3283 · Cited by 174
Cranberry Juice Consumption Lowers Markers of Cardiometabolic Risk, Including Blood Pressure and Circulating C-Reactive Protein, Triglyceride, and Glucose Concentrations in Adults
Novotny, J. A., Baer, D. J., Khoo, C., Gebauer, S. K., & Charron, C. S. (2015) · Journal of Nutrition · doi:10.3945/jn.114.203190 · Cited by 163
Ambient Air Pollution and Preeclampsia: A Spatiotemporal Analysis
Dadvand, P., Figueras, F., Basagaña, X., Beelen, R., Martinez, D., Cirach, M., Schembari, A., Hoek, G., Brunekreef, B., & Nieuwenhuijsen, M. J. (2013) · Environmental Health Perspectives · doi:10.1289/ehp.1206430 · Cited by 145
Evidence for epistasis between SLC6A4 and ITGB3 in autism etiology and in the determination of platelet serotonin levels
Coutinho, A. M., Sousa, I., Martins, M., Correia, C., Morgadinho, T., Bento, C., Marques, C., Ataíde, A., Miguel, T. S., Moore, J. H., et al. (2007) · Human Genetics · doi:10.1007/s00439-006-0301-3 · Cited by 153
Early perceptions and behavioural responses during the COVID-19 pandemic: a cross-sectional survey of UK adults
Atchison, C., Bowman, L. R., Vrinten, C., Redd, R., Pristerà, P., Eaton, J., & Ward, H. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-043577 · Cited by 379
Controlling the false discovery rate and increasing statistical power in ecological studies
Waite, T. A., & Campbell, L. G. (2006) · Ecoscience · doi:10.2980/1195-6860(2006)13[439:ctfdra]2.0.co;2 · Cited by 148
Alteration in pain modulation in women with persistent pain after lumpectomy: influence of catastrophizing
Edwards, R. R., Mensing, G., Cahalan, C., Greenbaum, S., Narang, S., Belfer, I., Schreiber, K. L., Campbell, C., Wasan, A. D., & Jamison, R. N. (2013) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2012.06.016 · Cited by 150
Colonization of second-trimester placenta parenchyma
Onderdonk, A. B., Hecht, J. L., McElrath, T. F., Delaney, M. L., Allred, E. N., & Leviton, A. (2008) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2007.11.068 · Cited by 146
Corpus callosum volume in children with autism
Hardan, A. Y., Pabalan, M., Gupta, N., Bansal, R., Melhem, N., Fedorov, S., Keshavan, M. S., & Minshew, N. J. (2009) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2009.03.005 · Cited by 148
No country for old men? The role of a ‘Gentlemen's Club’ in promoting social engagement and psychological well-being in residential care
Gleibs, I. H., Haslam, C., Jones, J. M., Alexander Haslam, S., McNeill, J., & Connolly, H. (2011) · Aging & Mental Health · doi:10.1080/13607863.2010.536137 · Cited by 140
Seventy-two-hour Returns May Not be a Good Indicator of Safety in the Emergency Department: A National Study
Pham, J. C., Kirsch, T. D., Hill, P. M., DeRuggerio, K., & Hoffmann, B. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01042.x · Cited by 138
Effects of an outpatient physical exercise program on hematopoietic stem-cell transplantation recipients: a randomized clinical trial
Knols, R. H., de Bruin, E. D., Uebelhart, D., Aufdemkampe, G., Schanz, U., Stenner, F., Hitz, F., Taverna, C., & Aaronson, N. K. (2010) · Bone Marrow Transplantation · doi:10.1038/bmt.2010.288 · Cited by 139
Secular Trends in the Lifetime Prevalence of Alcohol Dependence in the United States: A Re‐evaluation
Grucza, R. A., Bucholz, K. K., Rice, J. P., & Bierut, L. J. (2008) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2008.00635.x · Cited by 135
Parental cognitive impairment and child maltreatment in Canada
McConnell, D., Feldman, M. A., Aunos, M., & Prasad, N. (2011) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2011.04.005 · Cited by 134
Expanding the parameter space of anodal transcranial direct current stimulation of the primary motor cortex
Agboada, D., Mosayebi-Samani, M., Jamil, A., Kuo, M., & Nitsche, M. A. (2019) · Scientific Reports · doi:10.1038/s41598-019-54621-0 · Cited by 131
Multiple comparisons: To compare or not to compare, that is the question
Barnett, M. J., Doroudgar, S., Khosraviani, V., & Ip, E. J. (2021) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2021.07.006 · Cited by 133
Cognitive deficits in long-term anabolic-androgenic steroid users
Kanayama, G., Kean, J., Hudson, J. I., & Pope, H. G. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2012.11.008 · Cited by 136
Fat Consumption and Its Association With Age-Related Macular Degeneration
Chong, E. W. T. (2009) · Archives of Ophthalmology · doi:10.1001/archophthalmol.2009.60 · Cited by 136
Consumer Neuroscience-Based Metrics Predict Recall, Liking and Viewing Rates in Online Advertising
Guixeres, J., Alcañiz, J. E. B., Azofra, J. M. A., Alcañíz, M., Colomer, A., Fuentes-Hurtado, F., & Ornedo, V. N. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01808 · Cited by 148
Yoga and meditation for menopausal symptoms in breast cancer survivors—a randomized controlled trial
Cramer, H., Rabsilber, S., Lauche, R., Kümmel, S., & Dobos, G. (2015) · Cancer · doi:10.1002/cncr.29330 · Cited by 131
Penetrance of Polygenic Obesity Susceptibility Loci across the Body Mass Index Distribution
Abadi, A., Alyass, A., Robiou-du-Pont, S., Bolker, B. M., Singh, P., Mohan, V., Díaz, R., Engert, J. C., Yusuf, S., Gerstein, H. C., et al. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.10.007 · Cited by 125
Artificial intelligence-assisted optical diagnosis for the resect-and-discard strategy in clinical practice: the Artificial intelligence BLI Characterization (ABC) study
Rondonotti, E., Hassan, C., Tamanini, G., Antonelli, G., Andrisani, G., Leonetti, G., Paggi, S., Amato, A., Scardino, G., Di Paolo, D., et al. (2023) · Endoscopy · doi:10.1055/a-1852-0330 · Cited by 128
Effect of an Internet-Based Program on Weight Loss for Low-Income Postpartum Women
Phelan, S., Hagobian, T. A., Brannen, A., Hatley, K. E., Schaffner, A. A., Muñoz‐Christian, K., & Tate, D. F. (2017) · JAMA · doi:10.1001/jama.2017.7119 · Cited by 126
On‐Road Driving with Moderate Visual Field Loss
Bowers, A. R., Eli Peli, A., Elgin, J. M., McGWIN, G., & Owsley, C. J. (2005) · Optometry and Vision Science · doi:10.1097/01.opx.0000175558.33268.b5 · Cited by 127
Efficacy of 8- and 4-Session Mindfulness-Based Interventions in a Non-clinical Population: A Controlled Study
Demarzo, M., Montero-Marin, J., Puebla-Guedea, M., Navarro-Gil, M., Herrera-Mercadal, P., Moreno-González, S., Calvo-Carrión, S., Bafaluy-Franch, L., & Garcia-Campayo, J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01343 · Cited by 121
Gut metabolites and bacterial community networks during a pilot intervention study with flaxseeds in healthy adult men
Lagkouvardos, I., Kläring, K., Heinzmann, S. S., Platz, S., Scholz, B., Engel, K., Schmitt‐Kopplin, P., Haller, D., Rohn, S., Skurk, T., et al. (2015) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.201500125 · Cited by 127
Mindfulness-based stress reduction for residents: A randomized controlled trial
Verweij, H., van Ravesteijn, H., van Hooff, M. L. M., Lagro-Janssen, A. L. M., & Speckens, A. E. M. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-017-4249-x · Cited by 122
Clarifying Associations between Childhood Adversity, Social Support, Behavioral Factors, and Mental Health, Health, and Well-Being in Adulthood: A Population-Based Study
Sheikh, M. A., Abelsen, B., & Olsen, J. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00727 · Cited by 129
Effectiveness of robotic assisted rehabilitation for mobility and functional ability in adult stroke patients: a systematic review
Lo, K., Stephenson, M., & Lockwood, C. S. (2017) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2017-003456 · Cited by 126
A sustained hypothalamic–pituitary–adrenal axis response to acute psychosocial stress in irritable bowel syndrome
Kennedy, P. J., Cryan, J. F., Quigley, E. M. M., Dinan, T. G., & Clarke, G. (2014) · Psychological Medicine · doi:10.1017/s003329171400052x · Cited by 120
Youth Empowerment Programs for Improving Adolescents’ Self-Efficacy and Self-Esteem
Morton, M., & Montgomery, P. (2012) · Research on Social Work Practice · doi:10.1177/1049731512459967 · Cited by 146
Evidence of a complex association between dose, pattern and timing of prenatal alcohol exposure and child behaviour problems
O’Leary, C., Nassar, N., Zubrick, S. R., Kurinczuk, J. J., Stanley, F. J., & Bower, C. I. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02756.x · Cited by 117
A Survey of American Psychiatrists' Attitudes Toward Classic Hallucinogens
Barnett, B. S., Siu, W. O., & Pope, H. G. (2018) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000828 · Cited by 116
Pathological tendons maintain sufficient aligned fibrillar structure on ultrasound tissue characterization ( UTC )
Docking, S., & Cook, J. L. (2015) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.12491 · Cited by 117
Residual neurocognitive features of long‐term ecstasy users with minimal exposure to other drugs
Halpern, J. H., Sherwood, A. R., Hudson, J. I., Gruber, S. A., Kozin, D., & Pope, H. G. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.03252.x · Cited by 118
Use of Antidepressants During Pregnancy and Risk of Attention-Deficit/Hyperactivity Disorder in the Offspring
Figueroa, R. (2010) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/dbp.0b013e3181e5ac93 · Cited by 116
Narcissistic leaders: An asset or a liability? Leader visibility, follower responses, and group-level absenteeism.
Nevicka, B., Vianen, A. E. M. V., Hoogh, A. H. B. D., & Voorn, B. (2018) · Journal of Applied Psychology · doi:10.1037/apl0000298 · Cited by 131
An MRI and proton spectroscopy study of the thalamus in children with autism
Hardan, A. Y., Minshew, N. J., Melhem, N., Srihari, S., Jo, B., Bansal, R., Keshavan, M. S., & Stanley, J. A. (2008) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2007.12.002 · Cited by 118
Prevalence and Prognostic Significance of Left Ventricular Noncompaction in Patients Referred for Cardiac Magnetic Resonance Imaging
Ivanov, A. V., Dabiesingh, D. S., Bhumireddy, G. P., Mohamed, A., Asfour, A. M. S., Briggs, W. M., Ho, J., Khan, S., Grossman, A., Klem, I., et al. (2017) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.117.006174 · Cited by 114
Association between urban environment and mental health in Brussels, Belgium
Pelgrims, I., Devleesschauwer, B., Guyot, M., Keune, H., Nawrot, T. S., Remmen, R., Saenen, N. D., Trabelsi, S., Thomas, I., Aerts, R., et al. (2021) · BMC Public Health · doi:10.1186/s12889-021-10557-7 · Cited by 124
Corpus Callosum Volume and Neurocognition in Autism
Keary, C. J., Minshew, N. J., Bansal, R., Goradia, D. D., Fedorov, S., Keshavan, M. S., & Hardan, A. Y. (2009) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0689-4 · Cited by 119
Contribution of prepregnancy body mass index and gestational weight gain to adverse neonatal outcomes: population attributable fractions for Canada
Dzakpasu, S., Fahey, J., Kirby, R. S., Tough, S., CHALMERS, B. E., Heaman, M. I., Bartholomew, S., Biringer, A. B., Darling, E., Lee, L. S., et al. (2015) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-015-0452-0 · Cited by 113
MetaboLyzer: A Novel Statistical Workflow for Analyzing Postprocessed LC–MS Metabolomics Data
Mak, T. D., Laiakis, E. C., Goudarzi, M., & Fornace, A. J. (2013) · Analytical Chemistry · doi:10.1021/ac402477z · Cited by 110
Consideration of smoothing techniques for hyperspectral remote sensing
Vaiphasa, C. (2005) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2005.11.002 · Cited by 109
Treatment motivation in drug users: A theory-based analysis
Longshore, D. L., & Teruya, C. (2005) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2005.06.011 · Cited by 109
The Effects of Thoracic Manipulation on Heart Rate Variability: A Controlled Crossover Trial
Budgell, B., & Polus, B. (2006) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2006.08.011 · Cited by 108
Loneliness in Adults on the Autism Spectrum
Ee, D., Hwang, Y. I., Reppermund, S., Srasuebkul, P., Trollor, J. N., Foley, K., & Arnold, S. R. C. (2019) · Autism in Adulthood · doi:10.1089/aut.2018.0038 · Cited by 123
Cognitive performance in irritable bowel syndrome: evidence of a stress-related impairment in visuospatial memory
Kennedy, P. J., Clarke, G., O‘Neill, A., Groeger, J. A., Quigley, E. M. M., Shanahan, F., Cryan, J. F., & Dinan, T. G. (2014) · Psychological Medicine · doi:10.1017/s0033291713002171 · Cited by 106
Influence of Bolus Consistency on Lingual Behaviors in Sequential Swallowing
Steele, C. M., & Lieshout, P. H. H. M. V. (2004) · Dysphagia · doi:10.1007/s00455-004-0006-5 · Cited by 106
Interictal quantitative EEG in migraine: a blinded controlled study
Bjørk, M., Stovner, L. J., Engstrøm, M., Stjern, M., Hagen, K., & Sand, T. (2009) · The Journal of Headache and Pain · doi:10.1007/s10194-009-0140-4 · Cited by 106
Retinal nerve fibre layer thickness measurements using optical coherence tomography in migraine patients
Martinez, A., Proupim, N., & Sánchez, M. (2008) · British Journal of Ophthalmology · doi:10.1136/bjo.2008.137471 · Cited by 105
A Randomized Controlled Trial of a Web-Based Early Intervention for Children and their Parents Following Unintentional Injury
Cox, C. M., Kenardy, J. A., & Hendrikz, J. K. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp095 · Cited by 103
Changes in Attentional Performance of Children and Young Adults With Localized Primary Brain Tumors After Conformal Radiation Therapy
Kiehna, E. N., Mulhern, R. K., Li, C., Xiong, X., & Merchant, T. E. (2006) · Journal of Clinical Oncology · doi:10.1200/jco.2005.03.8547 · Cited by 103
Volumetric alterations of the orbitofrontal cortex in autism
Girgis, R. R., Minshew, N. J., Melhem, N., Nutche, J. J., Keshavan, M. S., & Hardan, A. Y. (2006) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2006.06.007 · Cited by 108
Polymorphisms in the chemokine (C-X-C motif) ligand 10 are associated with invasive aspergillosis after allogeneic stem-cell transplantation and influence CXCL10 epression in monocyte-derived dendritic cells
Mezger, M., Steffens, M., Beyer, M., Manger, C., Eberle, J., Toliat, M. R., Wienker, T. F., Ljungman, P. T., Hebart, H. F., Dornbusch, H. J., et al. (2007) · Blood · doi:10.1182/blood-2007-05-090928 · Cited by 101
A diagnostic interview module for anabolic-androgenic steroid dependence: Preliminary evidence of reliability and validity.
Pope, H. G., Kean, J., Nash, A., Kanayama, G., Samuel, D. B., Bickel, W. K., & Hudson, J. I. (2010) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0019370 · Cited by 100
Airborne particulate metals in the New York City subway: A pilot study to assess the potential for health impacts
Grass, D. S., Ross, J., Family, F., Barbour, J. R., Simpson, H. J., Coulibaly, D. M., Hernandez, J., Chen, Y., Slavkovich, V. N., Li, Y., et al. (2009) · Environmental Research · doi:10.1016/j.envres.2009.10.006 · Cited by 99
Effect of tailored practice and patient care plans on secondary prevention of heart disease in general practice: cluster randomised controlled trial
Murphy, A. W., Cupples, M. E., Smith, S. M., Byrne, M., Byrne, M. C., Newell, J., & for the SPHERE study team (2009) · BMJ · doi:10.1136/bmj.b4220 · Cited by 99
The Effect of an Apparent Change to a Branded or Generic Medication on Drug Effectiveness and Side Effects
Faasse, K., Cundy, T., Gamble, G. D., & Petrie, K. J. (2012) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3182738826 · Cited by 95
Effects of an Innovative Telerehabilitation Intervention for People With Parkinson's Disease on Quality of Life, Motor, and Non-motor Abilities
Isernia, S., Tella, S. D., Pagliari, C., Jonsdottir, J., Castiglioni, C., Gindri, P., Salza, M., Gramigna, C., Palumbo, G., Molteni, F., et al. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.00846 · Cited by 101
Catechol O-Methyltransferase Haplotype Predicts Immediate Musculoskeletal Neck Pain and Psychological Symptoms After Motor Vehicle Collision
McLean, S. A., Diatchenko, L. B., Lee, Y. M., Swor, R. A., Domeier, R. M., Jones, J. S., Jones, C. W., Reed, C., Harris, R. E., Maixner, W. D., et al. (2010) · Journal of Pain · doi:10.1016/j.jpain.2010.05.008 · Cited by 96
Prevalence, patterns and self-perceived effects of pornography consumption in polish university students: A cross-sectional study
Dwulit, A. D., & Rzymski, P. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16101861 · Cited by 95
AP-1 Transcription Factors Mediate BDNF-Positive Feedback Loop in Cortical Neurons
Tuvikene, J., Pruunsild, P., Orav, E., Esvald, E., & Timmusk, T. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.3360-15.2016 · Cited by 98

Authors: Feise, R. J.
Corresponding author: Feise, Ronald J
ORCID: Feise, Ronald J
Venue: BMC Medical Research Methodology
Publisher: Springer Science and Business Media LLC
Published: 2002-06-17
Volume: 2
Issue: 1
Pages: 8-8
ISSN: 1471-2288 (ISSN-L)
DOI: 10.1186/1471-2288-2-8
PMC: PMC117123
OpenAlex: W2139498473
Cited by: 1,299
References: 42
Citations by year: 2026: 55 · 2025: 67 · 2024: 75 · 2023: 101 · 2022: 79 · 2021: 133 · 2020: 95 · 2019: 115 · 2018: 83 · 2017: 98 · 2016: 72 · 2015: 45 · 2014: 47 · 2013: 33 · 2012: 32
FWCI: 5.75
Type: journal article
Language: en
Open access: gold
doi.org
Licence: www.springer.com/tdm (unspecified)
Locations: BMC Medical Research Methodology (publishedVersion)
Europe PMC (PubMed Central) (publishedVersion, other-oa)
PubMed Central (publishedVersion, other-oa)
PubMed (publishedVersion)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: p-value adjustment, type I error, multiple comparisons, clinical trials, primary outcomes, statistical significance, sample size
MeSH terms: Clinical Trials as Topic, Data Interpretation, Statistical, Humans, Confidence Intervals, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Do multiple outcome measures require p-value adjustment?

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks