The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Back to the basics: Rethinking partial correlation network methodology
Open accessAbstract
The Gaussian graphical model (GGM) is an increasingly popular technique used in psychology to characterize relationships among observed variables. These relationships are represented as elements in the precision matrix. Standardizing the precision matrix and reversing the sign yields corresponding partial correlations that imply pairwise dependencies in which the effects of all other variables have been controlled for. The graphical lasso (glasso) has emerged as the default estimation method, which uses ℓ 1 ‐based regularization. The glasso was developed and optimized for high‐dimensional settings where the number of variables ( p ) exceeds the number of observations ( n ), which is uncommon in psychological applications. Here we propose to go ‘back to the basics’, wherein the precision matrix is first estimated with non‐regularized maximum likelihood and then Fisher Z transformed confidence intervals are used to determine non‐zero relationships. We first show the exact correspondence between the confidence level and specificity, which is due to 1 minus specificity denoting the false positive rate (i.e., α). With simulations in low‐dimensional settings ( p ≪ n ), we then demonstrate superior performance compared to the glasso for detecting the non‐zero effects. Further, our results indicate that the glasso is inconsistent for the purpose of model selection and does not control the false discovery rate, whereas the proposed method converges on the true model and directly controls error rates. We end by discussing implications for estimating GGMs in psychology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
Network analysis: An integrative approach to the structure of psychopathology
Borsboom, D., & Cramer, A. O. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185608 · Cited by 4,359
A well-conditioned estimator for large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2004) · Journal of Multivariate Analysis · doi:10.1016/s0047-259x(03)00096-4 · Cited by 3,046 · cited 2×
“First, the covariance matrix can be inverted in low-dimensional settings (p n), but there can still be increased estimation errors when p approaches n (Ledoit & Wolf, 2004b).”
BackgroundEquivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 3,001 · cited 1×
“Rather than attempting to overcome the biased estimates of ℓ1-regularization, a non regularized bootstrap could be applied directly on the maximum likelihood estimator (equation 6), from which differences as well as equivalence can be tested (Lakens, 2017).”
MethodA tutorial on regularized partial correlation networks
Epskamp, S., & Fried, E. I. (2018) · Psychological Methods · doi:10.1037/met0000167 · Cited by 2,918
High-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521
Mental Disorders as Causal Systems: A Network Approach to Posttraumatic Stress Disorder
McNally, R. J., Robinaugh, D. J., Wu, G. W. Y., Wang, L., Deserno, M. K., & Borsboom, D. (2015) · Clinical Psychological Science · doi:10.1177/2167702614553230 · Cited by 592
A significance test for the lasso
Lockhart, R., Taylor, J., Tibshirani, R. J., & Tibshirani, R. (2014) · The Annals of Statistics · doi:10.1214/13-aos1175 · Cited by 541
Review on statistical methods for gene network reconstruction using expression data
Wang, Y. X. R., & Huang, H. (2014) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2014.03.040 · Cited by 182
Research works printed but not linked: 60
- 10.1093/biomet/asr054 · DOI · Paper page
- 10.1146/annurev-statistics-022513-115545 · DOI · Paper page
- 10.1214/08-AOS606 · DOI
- 10.1198/jasa.2011.tm10159 · DOI · Paper page
- 10.1016/j.jrp.2014.07.003 · DOI · Paper page
- 10.3150/15-BEJ756 · DOI · Paper page
- 10.2307/2528966 · DOI · Paper page
- 10.1016/j.schres.2019.01.046 · DOI
- 10.1080/01621459.2013.823775 · DOI · Paper page
- Epskamp S.(2016).Regularized Gaussian psychological networks: Brief report on the performance of extended BIC model selection.arXiv 1606:05771v1.
- 10.18637/jss.v048.i04 · DOI · Paper page
- 10.1371/journal.pone.0179891 · DOI · Paper page
- 10.1080/00273171.2018.1454823 · DOI · Paper page
- 10.1198/016214501753382273 · DOI · Paper page
- 10.1111/ectj.12061 · DOI · Paper page
- Fisher R. A., 1915, Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population, Biometrika, 10, 507
- Fisher R. A., 1924, The distribution of the partial correlation coefficient, Metron, 3, 329
- 10.1037/abn0000276 · DOI · Paper page
- Foygel R., 2010, Extended Bayesian information criteria for Gaussian graphical models, Advances in Neural Information Processing Systems, 604
- 10.1177/2167702617745092 · DOI · Paper page
- 10.1093/biostatistics/kxm045 · DOI · Paper page
- Gao X. Pu D. Q. Wu Y. &Xu H.(2009).Tuning parameter selection for penalized likelihood estimation of inverse covariance matrix.arXiv.https://doi.org/10.5705/ss.2009.210 · doi:10.5705/ss.2009.210
- 10.1111/biom.12186 · DOI
- 10.1051/0004-6361:20066170 · DOI · Paper page
- 10.1201/b18401 · DOI · Paper page
- 10.1214/15-EJS1031 · DOI
- 10.1007/s11749-016-0503-5 · DOI
- Javanmard A. &Montanari A.(2015).De‐biasing the Lasso: Optimal sample size for Gaussian designs.arXiv.
- 10.1371/journal.pone.0148171 · DOI
- 10.1002/wics.1415 · DOI
- 10.3905/jpm.2004.110 · DOI · Paper page
- 10.1214/15-AOS1371 · DOI · Paper page
- Leng C., 2006, A note on the lasso and related procedures in model selection, Statistica Sinica, 16, 1273
- 10.1016/j.ijar.2017.01.001 · DOI
- 10.1080/10618600.2019.1575744 · DOI
- 10.1214/13-AOS1169 · DOI · Paper page
- Liu H. Roeder K. &Wasserman L.(2010).Stability approach to regularization selection (StARS) for High dimensional graphical models.arXiv 1–14.
- 10.1146/annurev.psych.51.1.201 · DOI · Paper page
- Mazumder R., 2012, Exact covariance thresholding into connected components for large‐scale graphical lasso, Journal of Machine Learning Research, 13, 781
- 10.1080/00273171.2015.1036965 · DOI · Paper page
- 10.1214/14-BA889 · DOI
- Norouzi M. Fleet D. J. &Salakhutdinov R. R.(2012).Hamming distance metric learning. InAdvances in neural information processing systems Lake Tahoe NV pp.1061–1069.
- 10.1198/jasa.2009.0126 · DOI · Paper page
- 10.1214/14-AOS1286 · DOI · Paper page
- 10.1016/j.drugalcdep.2016.02.005 · DOI · Paper page
- 10.1093/bioinformatics/bti062 · DOI · Paper page
- 10.2202/1544-6115.1175 · DOI · Paper page
- Shao J., 1997, An asymptotic theory for linear model selection, Statistica Sinica, 7, 221
- 10.1037/abn0000308 · DOI
- 10.1002/cjs.11313 · DOI · Paper page
- Tibshirani R., 1996, Regression selection and shrinkage via the lasso, Journal of the Royal Statistical Society Series B, 58, 267, 10.1111/j.2517-6161.1996.tb02080.x · DOI · Paper page
- Van Borkulo C. D., 2014, A new method for constructing networks from binary data, Scientific Reports, 4, 1, 10.1038/srep05918 · DOI · Paper page
- 10.1371/journal.pcbi.1004755 · DOI
- Whittaker J., 1990, Graphical models in applied multivariate statistics
- 10.1098/rspa.1907.0028 · DOI
- Zhao T., 2012, The huge package for high‐dimensional undirected graph estimation in R, Journal of Machine Learning Research, 13, 1059
- Zhao S. Shojaie A. &Witten D.(2017).In defense of the indefensible: A very naive approach to high‐dimensional inference.arXiv(1) 1–61.
- Zhao P., 2006, On model selection consistency of lasso, Journal of Machine Learning Research, 7, 2541
- 10.1371/journal.pcbi.1006369 · DOI
- 10.1089/brain.2017.0511 · DOI
Cited by
Network analysis of multivariate data in psychological science
Borsboom, D., Deserno, M. K., Rhemtulla, M., Epskamp, S., Fried, E. I., McNally, R. J., Robinaugh, D. J., Perugini, M., Dalege, J., Costantini, G., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-021-00055-w · Cited by 1,371
Robinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861
Golino, H., Shi, D., Christensen, A. P., Garrido, L. E., Nieto, M. D., Sadana, R., Thiyagarajan, J. A., & Martinez-Molina, A. (2020) · Psychological Methods · doi:10.1037/met0000255 · Cited by 532
Network Analysis of Psychopathology: Controversies and Challenges
McNally, R. J. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-092850 · Cited by 463
Psychometric Network Models from Time-Series and Panel Data
Epskamp, S. (2020) · Psychometrika · doi:10.1007/s11336-020-09697-3 · Cited by 345
Kaiser, T., Herzog, P., Voderholzer, U., & Brakemeier, E. (2021) · Depression and Anxiety · doi:10.1002/da.23136 · Cited by 296
“Instead, the correction of significance levels and a forward‐search procedure is employed (Williams & Rast, 2019).”
MethodA network perspective on suicidal behavior: understanding suicidality as a complex system
de Beurs, D., Bockting, C., Kerkhof, A., Scheepers, F., O’Connor, R., Penninx, B., & van de Leemput, I. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12676 · Cited by 119
A network approach to climate change anxiety and its key related features
Heeren, A., Mouguiama-Daouda, C., & McNally, R. J. (2023) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2022.102625 · Cited by 88
Does mindfulness change the mind? A novel psychonectome perspective based on Network Analysis
Roca, P., Diez, G. G., Castellanos, N., & Vazquez, C. (2019) · PLOS ONE · doi:10.1371/journal.pone.0219793 · Cited by 37
Metadata
- Authors
- Williams, D. R., & Rast, P.
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 2019-06-17
- Volume
- 73
- Issue
- 2
- Pages
- 187-212
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W2900770950
- Cited by
- 205
- References
- 11
- FWCI
- 18.59
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- National Academies of Sciences, Engineering, and Medicine FORD foundation pre-doctoral fellowship
- National Science Foundation Graduate Research Fellowship
- National Institute on Aging of the National Institutes of Health (R01AG050720)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.