The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
False alarm? A comprehensive reanalysis of “Evidence that psychopathology symptom networks have limited replicability” by Forbes, Wright, Markon, and Krueger (2017).
Open accessAbstract
Forbes, Wright, Markon, and Krueger (2017) stated that "psychopathology networks have limited replicability" (p. 1011) and that "popular network analysis methods produce unreliable results" (p. 1011). These conclusions are based on an assessment of the replicability of four different network models for symptoms of major depression and generalized anxiety across two samples; in addition, Forbes et al. analyzed the stability of the network models within the samples using split-halves. Our reanalysis of the same data with the same methods led to results directly opposed to theirs: All network models replicated very well across the two data sets and across the split-halves. We trace the differences between Forbes et al.'s results and our own to the fact that they did not appear to accurately implement all network models and used debatable metrics to assess replicability. In particular, they deviated from existing estimation routines for relative importance networks, did not acknowledge the fact that the skip structure used in the interviews strongly distorted correlations between symptoms, and incorrectly assumed that network structures and metrics should be the same not only across the different samples but also across the different network models used. In addition to a comprehensive reanalysis of the data, we end with a discussion of best practices concerning future research into the replicability of psychometric networks. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Estimating psychological networks and their accuracy: A tutorial paper
Epskamp, S., Borsboom, D., & Fried, E. I. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0862-1 · Cited by 5,715
Self-citationKessler, R. C., & Üstün, T. B. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.168 · Cited by 4,771
Network analysis: An integrative approach to the structure of psychopathology
Borsboom, D., & Cramer, A. O. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185608 · Cited by 4,359
Self-citationHigh-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521 · cited 1×
“More generally, one can prove that every latent variable structure implies a specific network structure, as Molenaar (2003) already suspected and as Maris and his coworkers have been recently able to formally prove (Epskamp et al.”
BackgroundComorbidity: a network perspective
Cramer, A. O. J., Waldorp, L. J., van der Maas, H. L. J., & Borsboom, D. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991567 · Cited by 1,575
Self-citationCan network analysis transform psychopathology?
McNally, R. J. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.06.006 · Cited by 1,072
Network analysis of depression and anxiety symptom relationships in a psychiatric sample
Beard, C., Millner, A. J., Forgeard, M. J. C., Fried, E. I., Hsu, K. J., Treadway, M. T., Leonard, C. V., Kertz, S. J., & Björgvinsson, T. (2016) · Psychological Medicine · doi:10.1017/s0033291716002300 · Cited by 929
Self-citationMental Disorders as Causal Systems: A Network Approach to Posttraumatic Stress Disorder
McNally, R. J., Robinaugh, D. J., Wu, G. W. Y., Wang, L., Deserno, M. K., & Borsboom, D. (2015) · Clinical Psychological Science · doi:10.1177/2167702614553230 · Cited by 592
Self-citationCo-morbid obsessive–compulsive disorder and depression: A bayesian network approach
McNally, R. J., Mair, P., Mugno, B. L., & Riemann, B. C. (2017) · Psychological Medicine · doi:10.1017/s0033291716003287 · Cited by 308
Cited by
Network analysis: a brief overview and tutorial
Hevey, D. (2018) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2018.1521283 · Cited by 1,058
All for One and One for All: Mental Disorders in One Dimension
Caspi, A., & Moffitt, T. E. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17121383 · Cited by 918
Robinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861
Self-citationReporting standards for psychological network analyses in cross-sectional data.
Burger, J., Isvoranu, A.-M., Lunansky, G., Haslbeck, J. M. B., Epskamp, S., Hoekstra, R. H. A., Fried, E. I., Borsboom, D., & Blanken, T. F. (2023) · Psychological Methods · doi:10.1037/met0000471 · Cited by 516
Self-citationNetwork Analysis of Psychopathology: Controversies and Challenges
McNally, R. J. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-092850 · Cited by 463
Fried, E. I., Eidhof, M. B., Palic, S., Costantini, G., Huisman-van Dijk, H. M., Bockting, C. L. H., Engelhard, I., Armour, C., Nielsen, A. B. S., & Karstoft, K.-I. (2018) · Clinical Psychological Science · doi:10.1177/2167702617745092 · Cited by 454
Self-citationA network perspective on suicidal behavior: understanding suicidality as a complex system
de Beurs, D., Bockting, C., Kerkhof, A., Scheepers, F., O’Connor, R., Penninx, B., & van de Leemput, I. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12676 · Cited by 119
The replicability of ICD-11 complex post-traumatic stress disorder symptom networks in adults
Knefel, M., Karatzias, T., Ben-Ezra, M., Cloitre, M., Lueger-Schuster, B., & Maercker, A. (2019) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.286 · Cited by 82
Buelens, T., Costantini, G., Luyckx, K., & Claes, L. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.580922 · Cited by 45
Does mindfulness change the mind? A novel psychonectome perspective based on Network Analysis
Roca, P., Diez, G. G., Castellanos, N., & Vazquez, C. (2019) · PLOS ONE · doi:10.1371/journal.pone.0219793 · Cited by 37
Metadata
- Authors
- Borsboom, D., Fried, E. I., Epskamp, S., Waldorp, L. J., van Borkulo, C. D., van der Maas, H. L. J., & Cramer, A. O. J.
- Venue
- Journal of Abnormal Psychology
- Published
- 2017-10
- Volume
- 126
- Issue
- 7
- Pages
- 989-999
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- OpenAlex
- W2768067512
- Cited by
- 212
- References
- 15
- FWCI
- 34.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.