The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Excess Significance Bias in the Literature on Brain Volume Abnormalities
Abstract
CONTEXT: Many studies report volume abnormalities in diverse brain structures in patients with various mental health conditions. OBJECTIVE: To evaluate whether there is evidence for an excess number of statistically significant results in studies of brain volume abnormalities that suggest the presence of bias in the literature. DATA SOURCES: PubMed (articles published from January 2006 to December 2009). STUDY SELECTION: Recent meta-analyses of brain volume abnormalities in participants with various mental health conditions vs control participants with 6 or more data sets included, excluding voxel-based morphometry. DATA EXTRACTION: Standardized effect sizes were extracted in each data set, and it was noted whether the results were "positive" (P < .05) or not. For each data set in each meta-analysis, I estimated the power to detect at α = .05 an effect equal to the summary effect of the respective meta-analysis. The sum of the power estimates gives the number of expected positive data sets. The expected number of positive data sets can then be compared against the observed number. DATA SYNTHESIS: From 8 articles, 41 meta-analyses with 461 data sets were evaluated (median, 10 data sets per meta-analysis) pertaining to 7 conditions. Twenty-one of the 41 meta-analyses had found statistically significant associations, and 142 of 461 (31%) data sets had positive results. Even if the summary effect sizes of the meta-analyses were unbiased, the expected number of positive results would have been only 78.5 compared with the observed number of 142 (P < .001). CONCLUSION: There are too many studies with statistically significant results in the literature on brain volume abnormalities. This pattern suggests strong biases in the literature, with selective outcome reporting and selective analyses reporting being possible explanations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Our results indicated that the median statistical power of these studies was 8% across 461 individual studies contributing to 41 separate meta-analyses, which were drawn from eight articles that were published between 2006 and 2009.”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [73]
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Self-citationThe Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Quantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517 · cited 1×
“05, but it should be interpreted with caution owing to the possibility of both false positives and false negatives.(28,29) For I(2), as a rough guide, values exceeding 50% are considered as large heterogeneity beyond chance, and values exceeding 75% are considered very large heterogeneity.”
BackgroundSelf-citationSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267 · cited 1×
“Many meta-analyses in this field have applied asymmetry (funnelplot) tests thatdeterminewhethersmall studiesgive differentresults fromlargerstudies.(19) If so, suchsmall-study effectsmaybeduetopublicationbiasorotherreportingbias.”
MethodThe case of the misleading funnel plot
Lau, J., Ioannidis, J. P. A., Terrin, N., Schmid, C. H., & Olkin, I. (2006) · BMJ · doi:10.1136/bmj.333.7568.597 · Cited by 1,766
Self-citation
Cited by
Sorted by citations
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citationBrain Volumes in Schizophrenia: A Meta-Analysis in Over 18 000 Subjects
Haijma, S. V., Van Haren, N., Cahn, W., Koolschijn, P. C. M. P., Hulshoff Pol, H. E., & Kahn, R. S. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs118 · Cited by 1,012
Theodoratou, E., Tzoulaki, I., Zgaga, L., & Ioannidis, J. P. A. (2014) · BMJ · doi:10.1136/bmj.g2035 · Cited by 956
Self-citationThe neuroscience of socioeconomic status: Correlates, causes, and consequences
Farah, M. J. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.034 · Cited by 653
Fusar-Poli, P., Smieskova, R., Kempton, M. J., Ho, B. C., Andreasen, N. C., & Borgwardt, S. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.06.001 · Cited by 512
Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Self-citationConnor, J. P., Gullo, M. J., White, A., & Kelly, A. B. (2014) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000069 · Cited by 462
The secret lives of experiments: Methods reporting in the fMRI literature
Carp, J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.07.004 · Cited by 463
Systematic meta-review and quality assessment of the structural brain alterations in schizophrenia
Shepherd, A. M., Laurens, K. R., Matheson, S. L., Carr, V. J., & Green, M. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.12.015 · Cited by 412
Li, X., Meng, X., Timofeeva, M. N., Tzoulaki, I., Tsilidis, K. K., Ioannidis, J. P. A., Campbell, H. J., & Τheodoratou, E. (2017) · BMJ · doi:10.1136/bmj.j2376 · Cited by 402
Self-citationNeuroimaging of the periaqueductal gray: State of the field
Linnman, C., Moulton, E. A., Barmettler, G., Becerra, L. R., & Borsook, D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.095 · Cited by 426
On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI Experiments
Carp, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00149 · Cited by 402
Scientific Utopia: I. Opening Scientific Communication
Nosek, B. A., & Bar‐Anan, Y. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.692215 · Cited by 387
Eliot, L., Ahmed, A., Khan, H., & Patel, J. Y. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.026 · Cited by 379
Pietschnig, J., Penke, L., Wicherts, J. M., Zeiler, M., & Voracek, M. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.09.017 · Cited by 316
Sucksmith, E., Roth, I., & Hoekstra, R. A. (2011) · Neuropsychology Review · doi:10.1007/s11065-011-9183-9 · Cited by 336
Evaluation of excess significance bias in animal studies of neurological diseases
Tsilidis, K. K., Panagiotou, O. A., Sena, E. S., Aretouli, E., Evangelou, E., Howells, D. W., Salman, R. A.-S., Macleod, M. R., & Ioannidis, J. P. A. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001609 · Cited by 295
Self-citationMackey, S., Allgaier, N. A., Chaarani, B., Spechler, P. A., Orr, C., Bunn, J., Allen, N. B., Alia‐Klein, N., Batalla, A., Blaine, S. K., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17040415 · Cited by 281
Meta-analytic methods for neuroimaging data explained
Raduà, J., & Mataix‐Cols, D. (2012) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-2-6 · Cited by 250
Lack of evidence to favor specific preventive interventions in psychosis: a network meta‐analysis
Davies, C., Cipriani, A., Ioannidis, J. P. A., Radua, J., Stahl, D., Provenzani, U., McGuire, P., & Fusar‐Poli, P. (2018) · World Psychiatry · doi:10.1002/wps.20526 · Cited by 229
Self-citationHall, W., Carter, A., & Forlini, C. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)00126-6 · Cited by 259
The Antisocial Brain: Psychopathy Matters
Gregory, S. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2012.222 · Cited by 250
Hippocampal volume across age: Nomograms derived from over 19,700 people in UK Biobank
Nobis, L., Manohar, S. G., Smith, S. M., Alfaro-Almagro, F., Jenkinson, M., Mackay, C. E., & Husain, M. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2019.101904 · Cited by 236
p-Curve and p-Hacking in Observational Research
Bruns, S. B., & Ioannidis, J. P. A. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149144 · Cited by 210
Self-citationMullane, K., & Williams, M. J. (2012) · Biochemical Pharmacology · doi:10.1016/j.bcp.2012.11.014 · Cited by 219
Clinical Outcome Prediction by MicroRNAs in Human Cancer: A Systematic Review
Nair, V. S., Maeda, L. S., & Ioannidis, J. P. A. (2012) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djs027 · Cited by 220
Self-citationPublication bias in meta‐analyses from the Cochrane Database of Systematic Reviews
Kiciński, M., Springate, D. A., & Kontopantelis, E. (2015) · Statistics in Medicine · doi:10.1002/sim.6525 · Cited by 232
Systematic Meta-Analysis of Insula Volume in Schizophrenia
Shepherd, A. M., Matheson, S. L., Laurens, K. R., Carr, V. J., & Green, M. J. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.04.020 · Cited by 207
Murphy, S. E., Norbury, R., Godlewska, B. R., Cowen, P. J., Mannie, Z. M., Harmer, C. J., & Munafo, M. R. (2012) · Molecular Psychiatry · doi:10.1038/mp.2012.19 · Cited by 205
The challenges and promise of neuroimaging in psychiatry.
Linden, D. (2012) · Neuron · doi:10.1016/j.neuron.2011.12.014 · Cited by 207
Umbrella reviews: what they are and why we need them
Papatheodorou, S. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00505-6 · Cited by 201
Daniels, J. K., Lamke, J.-P., Gaebler, M., Walter, H., & Scheel, M. (2013) · Depression and Anxiety · doi:10.1002/da.22044 · Cited by 190
Neuroanatomy of developmental dyslexia: Pitfalls and promise
Ramus, F., Altarelli, I., Jednoróg, K., Zhao, J., & di Covella, L. S. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.08.001 · Cited by 210
The human hippocampus is not sexually-dimorphic: Meta-analysis of structural MRI volumes
Tan, A., Ma, W., Vira, A., Marwha, D., & Eliot, L. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.08.050 · Cited by 180
Li, D., Lu, Y., Yuan, S., Cai, X., He, Y., Chen, J., Wu, Q., He, D., Fang, A., Bo, Y., et al. (2022) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqac074 · Cited by 193
The Neurobiology of “Food Addiction” and Its Implications for Obesity Treatment and Policy
Carter, A., Hendrikse, J. J., Lee, N., Yücel, M., Verdejo‐García, A., Andrews, Z. B., & Hall, W. (2016) · Annual Review of Nutrition · doi:10.1146/annurev-nutr-071715-050909 · Cited by 186
Objective and subjective cognitive enhancing effects of mixed amphetamine salts in healthy people
Ilieva, I. P., Boland, J. R., & Farah, M. J. (2012) · Neuropharmacology · doi:10.1016/j.neuropharm.2012.07.021 · Cited by 171
Power Posing: P- Curving the Evidence
Simmons, J. P., & Simonsohn, U. (2017) · Psychological Science · doi:10.1177/0956797616658563 · Cited by 179
Acar, F., Seurinck, R., Eickhoff, S. B., & Moerkerke, B. (2018) · PLOS ONE · doi:10.1371/journal.pone.0208177 · Cited by 154
“In neuroimaging literature, it has been shown that there is an excess of positive findings in literature [24, 25].”
BackgroundDai, S., Wellens, J., Yang, N., Li, D., Wang, J., Wang, L., Yuan, S., He, Y., Song, P., Munger, R., et al. (2024) · Clinical Nutrition · doi:10.1016/j.clnu.2024.04.016 · Cited by 161
Ioannidis, J. P. A. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.03.002 · Cited by 149
Self-citationReproducible and replicable pain research: a critical review
Lee, H., Lamb, S. E., Bagg, M. K., Toomey, E., Cashin, A. G., & Moseley, G. L. (2018) · Pain · doi:10.1097/j.pain.0000000000001254 · Cited by 150
Ching, C. R. K., Hibar, D. P., Gurholt, T. P., Nunes, A., Thomopoulos, S. I., Abé, C., Agartz, I., Brouwer, R. M., Cannon, D. M., de Zwarte, S. M. C., et al. (2020) · Human Brain Mapping · doi:10.1002/hbm.25098 · Cited by 150
Neuroanatomical abnormalities in chronic tinnitus in the human brain
Adjamian, P., Hall, D. A., Palmer, A., Allan, T. W., & Langers, D. (2014) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.05.013 · Cited by 100
Potential Reporting Bias in Neuroimaging Studies of Sex Differences
David, S. P., Naudet, F., Laude, J. R., Raduà, J., Fusar‐Poli, P., Chu, I. M., Stefanick, M. L., & Ioannidis, J. P. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-23976-1 · Cited by 140
Self-citationPotential Reporting Bias in fMRI Studies of the Brain
David, S. P., Ware, J. J., Chu, I. M., Loftus, P. D., Fusar-Poli, P., Radua, J., Munafò, M. R., & Ioannidis, J. P. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070104 · Cited by 130
Self-citationThe Cambridge Handbook of Personality Psychology
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822 · Cited by 148
Lessons of ALS imaging: Pitfalls and future directions — A critical review
Bede, P., & Hardiman, O. M. (2014) · NeuroImage Clinical · doi:10.1016/j.nicl.2014.02.011 · Cited by 126
Liu, D., Meng, X., Tian, Q., Cao, W., Fan, X., Wu, L., Song, M., Meng, Q., Wang, W., & Wang, Y. (2021) · Advances in Nutrition · doi:10.1093/advances/nmab142 · Cited by 132
RDoC: Translating promise into progress.
Patrick, C. J., & Hajcak, G. (2016) · Psychophysiology · doi:10.1111/psyp.12612 · Cited by 105
Quantifying Inhibitory Control as Externalizing Proneness: A Cross-Domain Model
Venables, N. C., Foell, J., Yancey, J. R., Kane, M. J., Engle, R. W., & Patrick, C. J. (2018) · Clinical Psychological Science · doi:10.1177/2167702618757690 · Cited by 121
Focal abnormalities in idiopathic generalized epilepsy: A critical review of the literature
Seneviratne, U. K., Cook, M. J., & D'Souza, W. J. (2014) · Epilepsia · doi:10.1111/epi.12688 · Cited by 116
Everything Matters: The ReproNim Perspective on Reproducible Neuroimaging
Kennedy, D. N., Abraham, S. A., Bates, J. F., Crowley, A., Ghosh, S., Gillespie, T., Goncalves, M., Grethe, J. S., Halchenko, Y. O., Hanke, M., et al. (2019) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2019.00001 · Cited by 113
Does psychotherapy work? An umbrella review of meta‐analyses of randomized controlled trials
Dragioti, E., Karathanos, V. T., Gerdle, B. U. C., & Εvangelou, Ε. (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12713 · Cited by 120
Coronado-Montoya, S., Levis, A. W., Kwakkenbos, L., Steele, R. J., Turner, E. H., & Thombs, B. D. (2016) · PLOS ONE · doi:10.1371/journal.pone.0153220 · Cited by 107
Bias in Associations of Emerging Biomarkers With Cardiovascular Disease
Tzoulaki, I., Siontis, K., Εvangelou, Ε., & Ioannidis, J. P. A. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.3018 · Cited by 108
Self-citationvan Assen, M. A. L. M., van Aert, R. C. M., Nuijten, M. B., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084896 · Cited by 113
Gray Matter Abnormalities in Social Anxiety Disorder: Primary, Replication, and Specificity Studies
Talati, A., Pantazatos, S. P., Schneier, F. R., Weissman, M. M., & Joy Hirsch, C. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.05.022 · Cited by 108
Molendijk, M. L., Bus, B. A. A., Spinhoven, P., Kaimatzoglou, A., Voshaar, R. C. O., Penninx, B. W. J. H., van IJzendoorn, M. H., & Elzinga, B. M. (2012) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32078 · Cited by 107
Kok, M. G. M., de Ronde, M. W. J., Moerland, P. D., Ruijter, J. M., Creemers, E. E., & Pinto-Sietsma, S. J. (2018) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2017.11.002 · Cited by 105
Clinically meaningful biomarkers for psychosis: A systematic and quantitative review
Prata, D. P., Mechelli, A., & Kapur, S. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.05.010 · Cited by 100
Statins and Multiple Noncardiovascular Outcomes
He, Y., Li, X., Gašević, D., Brunt, E., McLachlan, F., Millenson, M. E., Timofeeva, M. N., Ioannidis, J. P. A., Campbell, H. J., & Τheodoratou, E. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0808 · Cited by 97
Self-citationTsilidis, K. K., Papatheodorou, S., Εvangelou, Ε., & Ioannidis, J. P. A. (2012) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djs437 · Cited by 92
Self-citationTemperament and brain networks of attention
Posner, M. I., & Rothbart, M. K. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0254 · Cited by 95
Candidate and non-candidate genes in behavior genetics
Flint, J., & Munafo, M. R. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.07.005 · Cited by 85
Mathur, M. B., & VanderWeele, T. J. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1464 · Cited by 92
Detecting publication selection bias through excess statistical significance
Stanley, T. D., Doucouliagos, H., Ioannidis, J. P. A., & Carter, E. C. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1512 · Cited by 83
Self-citationJednoróg, K., Marchewka, A., Altarelli, I., Lopez, A. K. M., van Ermingen‐Marbach, M., Grande, M., Grabowska, A., Heim, S., & Ramus, F. (2015) · Human Brain Mapping · doi:10.1002/hbm.22734 · Cited by 82
The impact of sample size on the reproducibility of voxel-based lesion-deficit mappings
Lorca‐Puls, D. L., Gajardo‐Vidal, A., White, J., Seghier, M. L., Leff, A. P., Green, D. W., Crinion, J., Ludersdorfer, P., Hope, T. M. H., Bowman, H., et al. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.03.014 · Cited by 86
Patrick, C. J., Iacono, W. G., & Venables, N. C. (2019) · Psychological Assessment · doi:10.1037/pas0000713 · Cited by 85
Umbrella Reviews: What They Are and Why We Need Them
Papatheodorou, S., & Εvangelou, Ε. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1566-9_8 · Cited by 81
McGrath, L. M., & Stoodley, C. J. (2019) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-019-9287-8 · Cited by 87
Voxel-based morphometry multi-center mega-analysis of brain structure in social anxiety disorder
Bas‐Hoogendam, J. M., van Steenbergen, H., Pannekoek, J. N., Fouché, J., Löchner, C., Hattingh, C. J., Cremers, H. R., Furmark, T., Månsson, K. N. T., Frick, A., et al. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.08.001 · Cited by 78
Bernanke, J., Luna, A., Chang, L., Bruno, E., Dworkin, J., & Posner, J. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00505-8 · Cited by 75
Association of Hormonal Contraceptive Use With Adverse Health Outcomes
Brabaharan, S., Veettil, S. K., Kaiser, J. E., Rao, V. R. R., Wattanayingcharoenchai, R., Maharajan, M. K., Insin, P., Talungchit, P., Anothaisintawee, T., Thakkinstian, A., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.43730 · Cited by 77
The Replication Paradox: Combining Studies can Decrease Accuracy of Effect Size Estimates
Nuijten, M. B., van Assen, M. A. L. M., Veldkamp, C. L. S., & Wicherts, J. M. (2015) · Review of General Psychology · doi:10.1037/gpr0000034 · Cited by 73
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Positive results receive more citations, but only in some disciplines
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-012-0757-y · Cited by 69
Basing psychiatric classification on scientific foundation: Problems and prospects
Uher, R., & Rutter, M. L. (2012) · International Review of Psychiatry · doi:10.3109/09540261.2012.721346 · Cited by 69
The neuroanatomy of psychotic diathesis: A meta-analytic review
Palaniyappan, L. K., Balain, V., & Liddle, P. F. (2012) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.06.007 · Cited by 68
Neuroimaging distinction between neurological and psychiatric disorders
Crossley, N. A., Scott, J., Ellison-Wright, I., & Mechelli, A. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.114.154393 · Cited by 63
Bartos̆, F., Maier, M., Wagenmakers, E., Nippold, F., Doucouliagos, H., Ioannidis, J. P. A., Otte, W. M., Sladekova, M., Deresssa, T. K., Bruns, S. B., et al. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1703 · Cited by 76
Self-citationthe EU-AIMS LEAP group, Moessnang, C., Baumeister, S., Tillmann, J., Goyard, D., Charman, T., Ambrosino, S., Baron‐Cohen, S., Beckmann, C. F., Bölte, S., et al. (2020) · Molecular Autism · doi:10.1186/s13229-020-0317-x · Cited by 65
Bite-size science and its undesired side effects
Bertamini, M., & Munafò, M. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611429353 · Cited by 62
Sex is a defining feature of neuroimaging phenotypes in major brain disorders
Salminen, L. E., Tubi, M. A., Bright, J. K., Thomopoulos, S. I., Wieand, A., & Thompson, P. M. (2021) · Human Brain Mapping · doi:10.1002/hbm.25438 · Cited by 61
Rapid eye movement sleep behavior disorder in Parkinson's disease: Magnetic resonance imaging study
Ford, A. H., Duncan, G. W., Firbank, M., Yarnall, A. J., Khoo, T. K., Burn, D. J., & O'Brien, J. T. (2013) · Movement Disorders · doi:10.1002/mds.25367 · Cited by 59
Markozannes, G., Aretouli, E., Rintou, E., Dragioti, E., Damigos, D., Ntzani, E., Εvangelou, Ε., & Tsilidis, K. K. (2017) · BMC Psychology · doi:10.1186/s40359-017-0200-5 · Cited by 59
Klauser, P., Xin, L., Fournier, M., Griffa, A., Cleusix, M., Jenni, R., Cuénod, M., Rolf Gruetter, A., Hagmann, P., Conus, P., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0266-8 · Cited by 61
Fusar-Poli, P., Radua, J., Frascarelli, M., Mechelli, A., Borgwardt, S., Di Fabio, F., Biondi, M., Ioannidis, J. P. A., & David, S. P. (2014) · Human Brain Mapping · doi:10.1002/hbm.22384 · Cited by 56
“However, it is unclear whether the current VBM literature can still be affected by biases, in particular publication and other selective reporting biases, where investigators selectively report statistically significant results and under-report non-significant findings – as noted for sMRI studies [Ioannidis, 2011].”
BackgroundMethodResultInfluentialSelf-citationIs there an excess of significant findings in published studies of psychotherapy for depression?
Flint, J., Cuijpers, P. J., Horder, J., Koole, S. L., & Munafo, M. R. (2014) · Psychological Medicine · doi:10.1017/s0033291714001421 · Cited by 58
Neural underpinnings of individual differences in emotion regulation: A systematic review
Morawetz, C., & Basten, U. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105727 · Cited by 62
Wang, L., Zhang, R., Yu, L., Xiao, J., Zhou, X., Li, X., Song, P., & Li, X. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.690219 · Cited by 54
Impact of Reporting Bias in Network Meta-Analysis of Antidepressant Placebo-Controlled Trials
Trinquart, L., Abbé, A., & Ravaud, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035219 · Cited by 56
Klauser, P., Zhou, J. H., Lim, J. K. W., Poh, J. S., Zheng, H., Tng, H. Y., Krishnan, R. K. R., Lee, J., Keefe, R. S. E., Adcock, R. A., et al. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv012 · Cited by 54
Bias in Peripheral Depression Biomarkers
Carvalho, A. F., Köhler, C. A., Brunoni, A. R., Miskowiak, K. W., Herrmann, N., Lanctôt, K. L., Hyphantis, T. N., Quevedo, J., Fernandes, B. S., & Berk, M. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000441457 · Cited by 52
Voxel-based morphometry: current perspectives
Scarpazza, C., & Simone, M. S. D. (2016) · Neuroscience and Neuroeconomics · doi:10.2147/nan.s66439 · Cited by 55
Forty years of structural imaging in psychosis: promises and truth
Fusar‐Poli, P., & Meyer‐Lindenberg, A. (2016) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12619 · Cited by 57
de Goede, J., Reeuwijk, K. G., Braun, K. P. J., le Cessie, S., Durston, S., Engels, R. C. M. E., Goudriaan, A. E., Moons, K. G. M., Vollebergh, W., Vries, T. J. D., et al. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa170 · Cited by 56
Clinical Psychological Science
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.001 · Cited by 47
Genetic psychophysiology: Advances, problems, and future directions
Anokhin, A. P. (2014) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2014.04.003 · Cited by 49
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- Archives of General Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2011-08-01
- Volume
- 68
- Issue
- 8
- Pages
- 773
- ISSN
- 0003-990X (ISSN-L)
- OpenAlex
- W2169662981
- Cited by
- 299
- References
- 48
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 8 · 2023: 5 · 2022: 5 · 2021: 25 · 2020: 55 · 2019: 17 · 2018: 23 · 2017: 19 · 2016: 17 · 2015: 27 · 2014: 26 · 2013: 19 · 2012: 36
- FWCI
- 29.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Archives of General Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- publication bias, selective outcome reporting, meta-analysis, mental illness, statistical power, standardized effect size, neuroimaging
- MeSH terms
- Mental Disorders, Brain, Humans, Meta-Analysis as Topic, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
