Bias in Peripheral Depression Biomarkers
The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Background: To aid in the differentiation of individuals with major depressive disorder (MDD) from healthy controls, numerous peripheral biomarkers have been proposed. To date, no comprehensive evaluation of the existence of bias favoring the publication of significant results or inflating effect sizes has been conducted. Methods: Here, we performed a comprehensive review of meta-analyses of peripheral nongenetic biomarkers that could discriminate individuals with MDD from nondepressed controls. PubMed/MEDLINE, EMBASE, and PsycINFO databases were searched through April 10, 2015. Results: From 15 references, we obtained 31 eligible meta-analyses evaluating biomarkers in MDD (21,201 cases and 78,363 controls). Twenty meta-analyses reported statistically significant effect size estimates. Heterogeneity was high (I2 ≥50%) in 29 meta-analyses. We plausibly assumed that the true effect size for a meta-analysis would equal the one of its largest study. A significant summary effect size estimate was observed for 20 biomarkers. We observed an excess of statistically significant studies in 21 meta-analyses. The summary effect size of the meta-analysis was higher than the effect of its largest study in 25 meta-analyses, while 11 meta-analyses had evidence of small-study effects. Conclusions: Our findings suggest that there is an excess of studies with statistically significant results in the literature of peripheral biomarkers for MDD. The selective publication of ‘positive studies' and the selective reporting of outcomes are possible mechanisms. Effect size estimates of meta-analyses may be inflated in this literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“although evidence of bias may limit inferences derived from the literature on peripheral biomarkers for MDD (14).”
From Peripheral cytokine and chemokine alterations in depression: a meta‐analysis of 82 studies (2017) · cites this paper as [14]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
A Meta-Analysis of Cytokines in Major Depression
Dowlati, Y., Herrmann, N., Swardfager, W., Liu, H., Sham, L., Reim, E. K., & Lanctôt, K. L. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.09.033 · Cited by 4,729
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Associations of depression with C-reactive protein, IL-1, and IL-6: a meta-analysis.
Howren, M. B., Lamkin, D. M., & Suls, J. (2009) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181907c1b · Cited by 2,766
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Power and sample size calculations
Dupont, W. D., & Plummer, W. D. (1990) · Controlled Clinical Trials · doi:10.1016/0197-2456(90)90005-m · Cited by 2,092
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group (2013) · PLoS ONE · doi:10.1371/journal.pone.0066844 · Cited by 1,127
Commentary: Heterogeneity in meta-analysis should be expected and appropriately quantified
Higgins, J. P. T. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dyn204 · Cited by 995
Liu, Y., Ho, R. C.-M., & Mak, A. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.08.003 · Cited by 948
An exploratory test for an excess of significant findings
Ioannidis, J. P., & Trikalinos, T. A. (2007) · Clinical Trials · doi:10.1177/1740774507079441 · Cited by 751
Is depression associated with increased oxidative stress? A systematic review and meta-analysis
Black, C. N., Bot, M., Scheffer, P. G., Cuijpers, P., & Penninx, B. W. J. H. (2015) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2014.09.025 · Cited by 711
Molendijk, M. L., Spinhoven, P., Polak, M., Bus, B. A. A., Penninx, B. W. J. H., & Elzinga, B. M. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.105 · Cited by 702
Belbasis, L., Bellou, V., Evangelou, E., Ioannidis, J. P. A., & Tzoulaki, I. (2015) · The Lancet Neurology · doi:10.1016/s1474-4422(14)70267-4 · Cited by 671
The organization of the stress system and its dysregulation in depressive illness
Gold, P. W. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.163 · Cited by 654
Multiplex bead array assays: Performance evaluation and comparison of sensitivity to ELISA☆
ELSHAL, M., & MCCOY, J. (2006) · Methods · doi:10.1016/j.ymeth.2005.11.010 · Cited by 568
A meta-analytic review of polyunsaturated fatty acid compositions in patients with depression
Lin, P.-Y., Huang, S.-Y., & Su, K.-P. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.03.018 · Cited by 530
Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Review and meta-analysis of antidepressant pharmacogenetic findings in major depressive disorder
Kato, M., & Serretti, A. (2010) · Molecular Psychiatry · doi:10.1038/mp.2008.116 · Cited by 450
Lopresti, A. L., Maker, G. L., Hood, S. D., & Drummond, P. D. (2014) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2013.09.017 · Cited by 371
HPA axis and aging in depression: Systematic review and meta-analysis
Belvederi Murri, M., Pariante, C., Mondelli, V., Masotti, M., Atti, A. R., Mellacqua, Z., Antonioli, M., Ghio, L., Menchetti, M., Zanetidou, S., et al. (2014) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.12.004 · Cited by 367
Khan, S. S., Smith, M. S., Reda, D., Suffredini, A. F., & McCoy, J. P. (2004) · Cytometry Part B: Clinical Cytometry · doi:10.1002/cyto.b.20021 · Cited by 354
The False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321
Excess Significance Bias in the Literature on Brain Volume Abnormalities
Ioannidis, J. P. A. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.28 · Cited by 299
Depression and Oxidative Stress: Results From a Meta-Analysis of Observational Studies
Palta, P., Samuel, L. J., Miller, E. R., & Szanton, S. L. (2014) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000009 · Cited by 277
Phillips, M. L., Chase, H. W., Sheline, Y. I., Etkin, A., Almeida, J. R. C., Deckersbach, T., & Trivedi, M. H. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14010076 · Cited by 267
Ioannidis, J. P. A. (2011) · JAMA · doi:10.1001/jama.2011.713 · Cited by 252
Zinc in depression: a meta-analysis
Swardfager, W., Herrmann, N., Mazereeuw, G., Goldberger, K., Harimoto, T., & Lanctôt, K. L. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.05.008 · Cited by 246
Self-citationJanes, H., & Pepe, M. S. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn099 · Cited by 212
Plasma L -Tryptophan Concentration in Major Depressive Disorder: New Data and Meta-Analysis
Ogawa, S., Fujii, T., Koga, N., Hori, H., Teraishi, T., Hattori, K., Noda, T., Higuchi, T., Motohashi, N., & Kunugi, H. (2014) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.13r08908 · Cited by 183
Papakostas, G. I., Shelton, R. C., Kinrys, G., Henry, M. E., Bakow, B. R., Lipkin, S. H., Pi, B., Thurmond, L., & Bilello, J. A. (2013) · Molecular Psychiatry · doi:10.1038/mp.2011.166 · Cited by 180
Ioannidis, J. P. A. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.03.002 · Cited by 158
Ciufolini, S., Dazzan, P., Kempton, M. J., Pariante, C. M., & Mondelli, V. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.09.004 · Cited by 145
The Clinical Process in Psychiatry: A Clinimetric Approach
Fava, G. A., Rafanelli, C., & Tomba, E. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.10r06444 · Cited by 143
Adipokines as emerging depression biomarkers: A systematic review and meta-analysis
Carvalho, A. F., Rocha, D. Q. C., McIntyre, R. S., Mesquita, L. M., Köhler, C. A., Hyphantis, T. N., Sales, P. M. G., Machado-Vieira, R., & Berk, M. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2014.08.002 · Cited by 138
Self-citationClinimetrics and Clinical Psychometrics: Macro- and Micro-Analysis
Tomba, E., & Bech, P. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000341757 · Cited by 124
Towards a classification of biomarkers of neuropsychiatric disease: from encompass to compass
Davis, J., Maes, M., Andreazza, A., McGrath, J. J., Tye, S. J., & Berk, M. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.139 · Cited by 123
Self-citationBiomarker studies: a call for a comprehensive biomarker study registry
André, F., McShane, L. M., Michiels, S., Ransohoff, D. F., Altman, D. G., Reis-Filho, J. S., Hayes, D. F., & Pusztai, L. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.4 · Cited by 118
Diniz, B. S., Sibille, E., Ding, Y., Tseng, G., Aizenstein, H. J., Lotrich, F., Becker, J. T., Lopez, O. L., Lotze, M. T., Klunk, W. E., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.76 · Cited by 116
Biochemical markers subtyping major depressive disorder
Kunugi, H., Hori, H., & Ogawa, S. (2015) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12299 · Cited by 114
Subtyping Major Depressive Disorder
Lichtenberg, P., & Belmaker, R. H. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000286957 · Cited by 109
Bias in Associations of Emerging Biomarkers With Cardiovascular Disease
Tzoulaki, I., Siontis, K. C., Evangelou, E., & Ioannidis, J. P. A. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.3018 · Cited by 108
Roest, A. M., de Jonge, P., Williams, C. D., de Vries, Y. A., Schoevers, R. A., & Turner, E. H. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.15 · Cited by 101
Applications of blood-based protein biomarker strategies in the study of psychiatric disorders
Chan, M. K., Gottschalk, M. G., Haenisch, F., Tomasik, J., Ruland, T., Rahmoune, H., Guest, P. C., & Bahn, S. (2014) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2014.08.002 · Cited by 101
Lin, P., & Tseng, P. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.02.004 · Cited by 95
Twenty-Five Years of Progress: The View from NIMH and NINDS
Insel, T. R., & Landis, S. C. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.041 · Cited by 85
The DEX/CRH test for major depression: A potentially useful diagnostic test
Mokhtari, M., Arfken, C., & Boutros, N. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2012.09.032 · Cited by 79
Altered Chemokine Levels in the Cerebrospinal Fluid and Plasma of Suicide Attempters
Janelidze, S., Ventorp, F., Erhardt, S., Hansson, O., Minthon, L., Flax, J., Samuelsson, M., Traskman-Bendz, L., & Brundin, L. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.09.010 · Cited by 69
Schroeter, M. L., Steiner, J., & Mueller, K. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.11.008 · Cited by 68
Bias in genetic association studies and impact factor
Munafò, M. R., Stothart, G., & Flint, J. (2009) · Molecular Psychiatry · doi:10.1038/mp.2008.77 · Cited by 60
Bech, P. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000320118 · Cited by 56
Fusar-Poli, P., Radua, J., Frascarelli, M., Mechelli, A., Borgwardt, S., Di Fabio, F., Biondi, M., Ioannidis, J. P. A., & David, S. P. (2014) · Human Brain Mapping · doi:10.1002/hbm.22384 · Cited by 56
Heterogeneous views on heterogeneity
Patsopoulos, N. A., Evangelou, E., & Ioannidis, J. P. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn235 · Cited by 35
The Missing Link between Clinical States and Biomarkers in Mental Disorders
Fava, G. A., Guidi, J., Grandi, S., & Hasler, G. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000360348 · Cited by 35
The File-Drawer Problem, Revisited
Young, S. S., & Bang, H. (2004) · Science · doi:10.1126/science.306.5699.1133d · Cited by 22
Cited by
Peripheral cytokine and chemokine alterations in depression: a meta‐analysis of 82 studies
Köhler, C. A., Freitas, T. H., Maes, M., de Andrade, N. Q., Liu, C. S., Fernandes, B. S., Stubbs, B., Solmi, M., Veronese, N., Herrmann, N., et al. (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12698 · Cited by 1,443
“1, and the ES of the largest study was more conservative or changed direction when compared with the overall ES estimate (funnel plots of ES estimates in which evidence of publication bias was observed are illustrated in Figs S10–S14) (14).”
BackgroundResultSelf-citationThe new field of ‘precision psychiatry’
Fernandes, B. S., Williams, L. M., Steiner, J., Leboyer, M., Carvalho, A. F., & Berk, M. (2017) · BMC Medicine · doi:10.1186/s12916-017-0849-x · Cited by 549
“Considering that no single biomarker will probably define any psychiatric disorder as defined by traditional diagnostic boundaries [13, 20, 21], it will be essential to pursue in parallel theory- and data-driven discovery approaches to delineate the multivariate and combinatorial profiles of biomarkers (across units o…”
Self-citationDietary fiber and health outcomes: an umbrella review of systematic reviews and meta-analyses
Veronese, N., Solmi, M., Caruso, M. G., Giannelli, G., Osella, A. R., Evangelou, E., Maggi, S., Fontana, L., Stubbs, B., & Tzoulaki, I. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqx082 · Cited by 536
Köhler, C. A., Freitas, T. H., Stubbs, B., Maes, M., Solmi, M., Veronese, N., de Andrade, N. Q., Morris, G., Fernandes, B. S., Brunoni, A. R., et al. (2017) · Molecular Neurobiology · doi:10.1007/s12035-017-0632-1 · Cited by 449
Self-citationKöhler, C. A., Evangelou, E., Stubbs, B., Solmi, M., Veronese, N., Belbasis, L., Bortolato, B., Melo, M. C. A., Coelho, C. A., Fernandes, B. S., et al. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.05.020 · Cited by 302
Self-citation
Metadata
- Authors
- Carvalho, A. F., Köhler, C. A., Brunoni, A. R., Miskowiak, K. W., Herrmann, N., Lanctôt, K. L., Hyphantis, T. N., Quevedo, J., Fernandes, B. S., & Berk, M.
- Affiliations
- Universidade Federal do Ceará (BR)
- Universidade de São Paulo (BR)
- Copenhagen University Hospital (DK)
- Sunnybrook Health Science Centre (CA)
- University of Ioannina (GR)
- Barwon Health (AU)
- ORCID
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2016
- Volume
- 85
- Issue
- 2
- Pages
- 81-90
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W2258842160
- Cited by
- 52
- References
- 61
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 5 · 2020: 10 · 2019: 10 · 2018: 9 · 2017: 11 · 2016: 1
- FWCI
- 3.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.karger.com/Services/SiteLicenses (vor)
- www.karger.com/Services/SiteLicenses (tdm)
- Locations
- Psychotherapy and Psychosomatics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- major depressive disorder, peripheral biomarkers, publication bias, small-study effects, effect size inflation, selective reporting, meta-analysis, depression diagnosis, heterogeneity
- MeSH terms
- Major Depressive Disorder, Depressive Disorder, Major, Diagnosis, Differential, Female, Humans, Biomarkers, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.