The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Estimating psychological networks and their accuracy: A tutorial paper
Open accessPublished version of a preprint
Abstract
The usage of psychological networks that conceptualize behavior as a complex interplay of psychological and other components has gained increasing popularity in various research fields. While prior publications have tackled the topics of estimating and interpreting such networks, little work has been conducted to check how accurate (i.e., prone to sampling variation) networks are estimated, and how stable (i.e., interpretation remains similar with less observations) inferences from the network structure (such as centrality indices) are. In this tutorial paper, we aim to introduce the reader to this field and tackle the problem of accuracy under sampling variation. We first introduce the current state-of-the-art of network estimation. Second, we provide a rationale why researchers should investigate the accuracy of psychological networks. Third, we describe how bootstrap routines can be used to (A) assess the accuracy of estimated network connections, (B) investigate the stability of centrality indices, and (C) test whether network connections and centrality estimates for different variables differ from each other. We introduce two novel statistical methods: for (B) the correlation stability coefficient, and for (C) the bootstrapped difference test for edge-weights and centrality indices. We conducted and present simulation studies to assess the performance of both methods. Finally, we developed the free R-package bootnet that allows for estimating psychological networks in a generalized framework in addition to the proposed bootstrap methods. We showcase bootnet in a tutorial, accompanied by R syntax, in which we analyze a dataset of 359 women with posttraumatic stress disorder available online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, it is possible to study a network structure at various time points and determine the changes following an intervention when using longitudinal data (Epskamp et al., 2018; McNally, 2016).”
From Psychometric properties of the engaged living scale (ELS) Spanish version in a large sample of Spanish pilgrims (2023) · cites this paper as Epskamp et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Second, the accuracy of edge weights was evaluated by calculating 95% confidence intervals based on non-parametric bootstrapping (n = 1.000 boots) which is recommended for LASSO regularized edges [43].”
From Psychopathological symptoms and well-being in overweight and underweight adolescents: A network analysis (2021) · cites this paper as [43]
The cited source says what the claim attributes to it.
In the citing paper
“Ideally, the CS-coefficients should be above 0.5 [43].”
From Psychopathological symptoms and well-being in overweight and underweight adolescents: A network analysis (2021) · cites this paper as [43]
The cited source says what the claim attributes to it.
In the citing paper
“Currently, there is no established method for a formal power analysis available for psychological network analyses, nor is there a minimal sample size required for this type of analysis [43].”
From Psychopathological symptoms and well-being in overweight and underweight adolescents: A network analysis (2021) · cites this paper as [43]
The cited source says what the claim attributes to it.
In the citing paper
“However, to tackle this potential limitation, we used the LASSO estimation which is particularly suitable for smaller samples as it returns a sparse network model where the number of parameters that need to be estimated is reduced [43].”
From Psychopathological symptoms and well-being in overweight and underweight adolescents: A network analysis (2021) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Collective dynamics of ‘small-world’ networks
Watts, D. J., & Strogatz, S. H. (1998) · Nature · doi:10.1038/30918 · Cited by 43,060
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Social Network Analysis: Methods and Applications
Wasserman, S. S., & Faust, K. (1994) · Cited by 17,983
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Social Network Analysis: Methods and Applications
Wasserman, S., & Faust, K. (1994) · doi:10.1017/cbo9780511815478 · Cited by 17,557 · cited 1×
“…networks strikingly different from network structures typically used in graph theory, such as power grids (Watts & Strogatz, 1998), social networks (Wasserman & Faust, 1994) or ecological networks (Barzel & Biham,2009), in which nodes represent entities (e.g., airports, people, organisms) and…”
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · cited 1×
“The current replication crisis in psychology (Open Science Collaboration, 2015) stresses the crucial importance of obtaining robust results, and we want the emerging field of psychopathological networks to start off on the right foot.”
Research works printed but not linked: 1
- Gumbel, E.J. (1939). La probabilité des hypotheses. Comptes Rendus de l’Academie des Sciences (Paris), 209, 645–647.
Cited by
A tutorial on regularized partial correlation networks
Epskamp, S., & Fried, E. I. (2018) · Psychological Methods · doi:10.1037/met0000167 · Cited by 2,918
Self-citationBridge Centrality: A Network Approach to Understanding Comorbidity
Jones, P. J., Ma, R., & McNally, R. J. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1614898 · Cited by 1,741
Network analysis of multivariate data in psychological science
Borsboom, D., Deserno, M. K., Rhemtulla, M., Epskamp, S., Fried, E. I., McNally, R. J., Robinaugh, D. J., Perugini, M., Dalege, J., Costantini, G., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-021-00055-w · Cited by 1,371
Self-citationWhat do centrality measures measure in psychological networks?
Bringmann, L. F., Elmer, T., Epskamp, S., Krause, R. W., Schoch, D., Wichers, M., Wigman, J. T. W., & Snippe, E. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000446 · Cited by 1,345
Self-citationThe Gaussian Graphical Model in Cross-Sectional and Time-Series Data
Epskamp, S., Waldorp, L. J., Mõttus, R., & Borsboom, D. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1454823 · Cited by 1,134
Self-citation
Metadata
- Authors
- Epskamp, S., Borsboom, D., & Fried, E. I.
- Affiliations
- University of Amsterdam (NL)
- Corresponding author
- Epskamp, Sacha
- Venue
- Behavior Research Methods
- Published
- 2017-03-24
- Volume
- 50
- Issue
- 1
- Pages
- 195-212
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- PMC
- PMC5809547
- OpenAlex
- W2530237102
- Cited by
- 5,715
- References
- 78
- Citations by year
- 2026: 1331 · 2025: 1249 · 2024: 855 · 2023: 674 · 2022: 509 · 2021: 451 · 2020: 287 · 2019: 181 · 2018: 111 · 2017: 48
- FWCI
- 220.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Behavior Research Methods (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- NWO "research talent" (406-11-066)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Keywords
- psychological networks, network estimation, sampling variability, bootstrapping, centrality indices, edge weights, post-traumatic stress disorder, network stability
- MeSH terms
- Female, Humans, Psychophysiology, Stress Disorders, Post-Traumatic, Neural Networks, Computer, Dimensional Measurement Accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Estimating psychological networks and their accuracy: A tutorial paper. https://app.cochat.ai/papers/10.3758/s13428-017-0862-1
- The paper
- Epskamp, S., Borsboom, D., & Fried, E. I. (2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods. https://doi.org/10.3758/s13428-017-0862-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.