The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Which estimation method to choose in network psychometrics? Deriving guidelines for applied researchers.
Open accessAbstract
The Gaussian graphical model (GGM) has recently grown popular in psychological research, with a large body of estimation methods being proposed and discussed across various fields of study, and several algorithms being identified and recommend as applicable to psychological data sets. Such high-dimensional model estimation, however, is not trivial, and algorithms tend to perform differently in different settings. In addition, psychological research poses unique challenges, including placing a strong focus on weak edges (e.g., bridge edges), handling data measured on ordered scales, and relatively limited sample sizes. As a result, there is currently no consensus regarding which estimation procedure performs best in which setting. In this large-scale simulation study, we aimed to overcome this gap in the literature by comparing the performance of several estimation algorithms suitable for Gaussian and skewed ordered categorical data across a multitude of settings, as to arrive at concrete guidelines from applied researchers. In total, we investigated 60 different metrics across 564,000 simulated data sets. We summarized our findings through a platform that allows for manually exploring simulation results. Overall, we found that an exchange between discovery (e.g., sensitivity, edge weight correlation) and caution (e.g., specificity, precision) should always be expected, and achieving both-which is a requirement for perfect replicability-is difficult. Further, we identified that the estimation method is best chosen in light of each research question and have highlighted, alongside desirable asymptotic properties and low sample size discovery, results according to most common research questions in the field. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2010) · Intellectum (Universidad de La Sabana) · doi:10.1111/j.1467- · Cited by 16,131
An alternative "description of personality": The Big-Five factor structure.
Goldberg, L. R. (1990) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.59.6.1216 · Cited by 6,652
Sparse inverse covariance estimation with the graphical lasso
Friedman, J., Hastie, T., & Tibshirani, R. (2008) · Biostatistics · doi:10.1093/biostatistics/kxm045 · Cited by 6,355
Estimating psychological networks and their accuracy: A tutorial paper
Epskamp, S., Borsboom, D., & Fried, E. I. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0862-1 · Cited by 5,715
Self-citationqgraph: Network Visualizations of Relationships in Psychometric Data
Epskamp, S., Cramer, A. O. J., Waldorp, L. J., Schmittmann, V. D., & Borsboom, D. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i04 · Cited by 4,856
Self-citationThe structure of phenotypic personality traits.
Goldberg, L. R. (1993) · American Psychologist · doi:10.1037/0003-066x.48.1.26 · Cited by 4,816
Personality trait structure as a human universal.
McCrae, R. R., & Costa, P. T. (1997) · American Psychologist · doi:10.1037/0003-066x.52.5.509 · Cited by 4,234
A tutorial on regularized partial correlation networks
Epskamp, S., & Fried, E. I. (2018) · Psychological Methods · doi:10.1037/met0000167 · Cited by 2,918
Self-citationExtended Bayesian information criteria for model selection with large model spaces
Chen, J., & Chen, Z. (2008) · Biometrika · doi:10.1093/biomet/asn034 · Cited by 2,011
Identifying highly influential nodes in the complicated grief network.
Robinaugh, D. J., Millner, A. J., & McNally, R. J. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000181 · Cited by 1,787
Muthén, B. (1984) · Psychometrika · doi:10.1007/bf02294210 · Cited by 1,544
The Gaussian Graphical Model in Cross-Sectional and Time-Series Data
Epskamp, S., Waldorp, L. J., Mõttus, R., & Borsboom, D. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1454823 · Cited by 1,134
Self-citationMaximum Likelihood Estimation of the Polychoric Correlation Coefficient
Olsson, U. (1979) · Psychometrika · doi:10.1007/bf02296207 · Cited by 1,127
Fried, E. I., & Nesse, R. M. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.010 · Cited by 1,043
State of the aRt personality research: A tutorial on network analysis of personality data in R
Costantini, G., Epskamp, S., Borsboom, D., Perugini, M., Mõttus, R., Waldorp, L. J., & Cramer, A. O. J. (2015) · Journal of Research in Personality · doi:10.1016/j.jrp.2014.07.003 · Cited by 982
Self-citationRobinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861
mgm: Estimating Time-Varying Mixed Graphical Models in High-Dimensional Data
Haslbeck, J. M. B., & Waldorp, L. J. (2020) · Journal of Statistical Software · doi:10.18637/jss.v093.i08 · Cited by 746
Extended Bayesian Information Criteria for Gaussian Graphical Models
Foygel, R., & Drton, M. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1011.6640 · Cited by 659
Mental Disorders as Causal Systems: A Network Approach to Posttraumatic Stress Disorder
McNally, R. J., Robinaugh, D. J., Wu, G. W. Y., Wang, L., Deserno, M. K., & Borsboom, D. (2015) · Clinical Psychological Science · doi:10.1177/2167702614553230 · Cited by 592
Fried, E. I., Eidhof, M. B., Palic, S., Costantini, G., Huisman-van Dijk, H. M., Bockting, C. L. H., Engelhard, I., Armour, C., Nielsen, A. B. S., & Karstoft, K.-I. (2018) · Clinical Psychological Science · doi:10.1177/2167702617745092 · Cited by 454
p-Values for High-Dimensional Regression
Meinshausen, N., Meier, L., & Bühlmann, P. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08647 · Cited by 442
A Network Approach to Psychosis: Pathways Between Childhood Trauma and Psychotic Symptoms
Isvoranu, A.-M., van Borkulo, C. D., Boyette, L.-L., Wigman, J. T. W., Vinkers, C. H., Borsboom, D., & Group Investigators (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw055 · Cited by 397
Self-citationEvidence that psychopathology symptom networks have limited replicability.
Forbes, M. K., Wright, A. G. C., Markon, K. E., & Krueger, R. F. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000276 · Cited by 354
Psychometric Network Models from Time-Series and Panel Data
Epskamp, S. (2020) · Psychometrika · doi:10.1007/s11336-020-09697-3 · Cited by 345
Self-citationEstimating psychopathological networks: Be careful what you wish for
Epskamp, S., Kruis, J., & Marsman, M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0179891 · Cited by 315
Self-citationFrom loss to loneliness: The relationship between bereavement and depressive symptoms.
Fried, E. I., Bockting, C., Arjadi, R., Borsboom, D., Amshoff, M., Cramer, A. O. J., Epskamp, S., Tuerlinckx, F., Carr, D., & Stroebe, M. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000028 · Cited by 314
Self-citationExtending the rank likelihood for semiparametric copula estimation
D. Hoff, P. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas107 · Cited by 297
Model selection for Gaussian concentration graphs
Drton, M., & Perlman, M. D. (2004) · Biometrika · doi:10.1093/biomet/91.3.591 · Cited by 179
On Nonregularized Estimation of Psychological Networks
Williams, D. R., Rhemtulla, M., Wysocki, A. C., & Rast, P. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1575716 · Cited by 177
A Network Approach to Environmental Impact in Psychotic Disorder: Brief Theoretical Framework
Isvoranu, A.-M., Borsboom, D., van Os, J., & Guloksuz, S. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw049 · Cited by 162
Self-citationRobustness and replicability of psychopathology networks
Borsboom, D., Robinaugh, D. J., The Psychosystems Group, Rhemtulla, M., & Cramer, A. O. J. (2018) · World Psychiatry · doi:10.1002/wps.20515 · Cited by 154
Investigating the feasibility of idiographic network models.
Mansueto, A. C., Wiers, R. W., van Weert, J. C. M., Schouten, B. C., & Epskamp, S. (2023) · Psychological Methods · doi:10.1037/met0000466 · Cited by 147
Self-citationLazarov, A., Suarez‐Jimenez, B., Levi, O., Coppersmith, D. D. L., Lubin, G., Pine, D. S., Bar‐Haim, Y., Abend, R., & Neria, Y. (2019) · Psychological Medicine · doi:10.1017/s0033291719002034 · Cited by 143
Williams, D. R. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1894412 · Cited by 138
Extending psychometric network analysis: Empirical evidence against g in favor of mutualism?
Kan, K., van der Maas, H. L. J., & Levine, S. Z. (2019) · Intelligence · doi:10.1016/j.intell.2018.12.004 · Cited by 124
Malgaroli, M., Maccallum, F., & Bonanno, G. A. (2018) · Psychological Medicine · doi:10.1017/s0033291718001769 · Cited by 116
BGGM: Bayesian Gaussian Graphical Models in R
Williams, D., & Mulder, J. (2020) · Journal of Open Source Software · doi:10.21105/joss.02111 · Cited by 112
Network models of posttraumatic stress disorder: A meta-analysis.
Isvoranu, A., Epskamp, S., & Cheung, M. W. ‐. (2021) · Journal of Abnormal Psychology · doi:10.1037/abn0000704 · Cited by 103
Self-citationVanzhula, I. A., Calebs, B., Fewell, L., & Levinson, C. A. (2019) · European Eating Disorders Review · doi:10.1002/erv.2634 · Cited by 101
Choi, K. W., Batchelder, A., Ehlinger, P. P., Safren, S. A., & O’Cleirigh, C. M. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000241 · Cited by 98
The Network Structure of Schizotypal Personality Traits
Fonseca‐Pedrero, E., Sierra, J. O., Debbané, M., Chan, R. C. K., Cicero, D. C., Zhang, L. C., Brenner, C. A., Barkus, E., Linscott, R. J., Kwapil, T. R., et al. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby044 · Cited by 86
Self-citationToward incorporating genetic risk scores into symptom networks of psychosis
Isvoranu, A., Gülöksüz, S., Epskamp, S., van Os, J., Borsboom, D., & GROUP Investigators (2019) · Psychological Medicine · doi:10.1017/s003329171900045x · Cited by 79
Self-citationBayesian model choice and information criteria in sparse generalized linear modelsPreprint
Foygel, R., & Drton, M. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1112.5635 · Cited by 77
Reproducibility and Replicability in a Fast-Paced Methodological World
Epskamp, S. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847421 · Cited by 67
Self-citationThe network approach to psychopathology: promise versus reality
Forbes, M. K., Wright, A. G. C., Markon, K. E., & Krueger, R. F. (2019) · World Psychiatry · doi:10.1002/wps.20659 · Cited by 67
The Matrix-F Prior for Estimating and Testing Covariance Matrices
Mulder, J., & Pericchi, L. R. (2018) · Bayesian Analysis · doi:10.1214/17-ba1092 · Cited by 45
Beyond Lasso: A Survey of Nonconvex Regularization in Gaussian Graphical ModelsPreprint
Williams, D. R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ad57p · Cited by 42
Learning to live with sampling variability: Expected replicability in partial correlation networks.
Williams, D. R. (2022) · Psychological Methods · doi:10.1037/met0000417 · Cited by 33
BGGM: A R Package for Bayesian Gaussian Graphical ModelsPreprint
Williams, D. R., & Mulder, J. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3b5hf · Cited by 27
Lafit, G., Tuerlinckx, F., Myin‐Germeys, I., & Ceulemans, E. (2019) · Scientific Reports · doi:10.1038/s41598-019-53795-x · Cited by 25
Meta-analytic Gaussian Network AggregationPreprint
Epskamp, S., Isvoranu, A., & Cheung, M. W. ‐. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/236w8 · Cited by 22
Self-citationBoyette, L., Isvoranu, A., Schirmbeck, F. N., Velthorst, E., Simons, C. J. P., Neus Barrantes-vidal, A., Bressan, R. A., Kempton, M. J., Krebs, M., McGuire, P. K., et al. (2020) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgaa025 · Cited by 5
Self-citation
Cited by
Network analysis of multivariate data in psychological science
Borsboom, D., Deserno, M. K., Rhemtulla, M., Epskamp, S., Fried, E. I., McNally, R. J., Robinaugh, D. J., Perugini, M., Dalege, J., Costantini, G., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-021-00055-w · Cited by 1,371
Self-citationReporting standards for psychological network analyses in cross-sectional data.
Burger, J., Isvoranu, A.-M., Lunansky, G., Haslbeck, J. M. B., Epskamp, S., Hoekstra, R. H. A., Fried, E. I., Borsboom, D., & Blanken, T. F. (2023) · Psychological Methods · doi:10.1037/met0000471 · Cited by 516
Self-citationFournier, L., Schimmenti, A., Musetti, A., Boursier, V., Flayelle, M., Cataldo, I., Starcevic, V., & Billieux, J. (2023) · Addictive Behaviors · doi:10.1016/j.addbeh.2023.107694 · Cited by 112
A network approach to climate change anxiety and its key related features
Heeren, A., Mouguiama-Daouda, C., & McNally, R. J. (2023) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2022.102625 · Cited by 88
Panayiotou, M., Black, L., Carmichael-Murphy, P., Qualter, P., & Humphrey, N. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00063-7 · Cited by 62
Metadata
- Authors
- Isvoranu, A.-M., & Epskamp, S.
- Venue
- Psychological Methods
- Published
- 2023-08
- Volume
- 28
- Issue
- 4
- Pages
- 925-946
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W3215074047
- Cited by
- 401
- References
- 52
- FWCI
- 47.60
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.