The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
The (in)stability of functional brain network measures across thresholds
Open accessAbstract
The large-scale organization of the brain has features of complex networks that can be quantified using network measures from graph theory. However, many network measures were designed to be calculated on binary graphs, whereas functional brain organization is typically inferred from a continuous measure of correlations in temporal signal between brain regions. Thresholding is a necessary step to use binary graphs derived from functional connectivity data. However, there is no current consensus on what threshold to use, and network measures and group contrasts may be unstable across thresholds. Nevertheless, whole-brain network analyses are being applied widely with findings typically reported at an arbitrary threshold or range of thresholds. This study sought to evaluate the stability of network measures across thresholds in a large resting state functional connectivity dataset. Network measures were evaluated across absolute (correlation-based) and proportional (sparsity-based) thresholds, and compared between sex and age groups. Overall, network measures were found to be unstable across absolute thresholds. For example, the direction of group differences in a given network measure may change depending on the threshold. Network measures were found to be more stable across proportional thresholds. These results demonstrate that caution should be used when applying thresholds to functional connectivity data and when interpreting results from binary graph models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proceedings of the National Academy of Sciences of the United States of America
Dowling, J. E., & Wald, G. (2009) · Nutrition Reviews · doi:10.1111/j.1753-4887.1981.tb06752.x · Cited by 17,893
Complex brain networks: graph theoretical analysis of structural and functional systems
Bullmore, E., & Sporns, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2575 · Cited by 11,820
Complex network measures of brain connectivity: Uses and interpretations
Rubinov, M., & Sporns, O. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.003 · Cited by 11,522
A component based noise correction method (CompCor) for BOLD and perfusion based fMRI
Behzadi, Y., Restom, K., Liau, J., & Liu, T. T. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.042 · Cited by 4,502
Buckner, R. L., Sepulcre, J., Talukdar, T., Krienen, F. M., Liu, H., Hedden, T., Andrews-Hanna, J. R., Sperling, R. A., & Johnson, K. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5062-08.2009 · Cited by 2,862
Distinct brain networks for adaptive and stable task control in humans
Dosenbach, N. U. F., Fair, D. A., Miezin, F. M., Cohen, A. L., Wenger, K. K., Dosenbach, R. A. T., Fox, M. D., Snyder, A. Z., Vincent, J. L., Raichle, M. E., et al. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704320104 · Cited by 2,632
Bassett, D. S., & Bullmore, E. (2006) · The Neuroscientist · doi:10.1177/1073858406293182 · Cited by 2,600 · cited 1×
“…al., 2011), age (Meunier et al., 2009), and cognition (Dosenbach et al., 2007), as well as in conditions such as addiction (Chanraud et al., 2011), Alzheimer‟s disease (Supekar et al., 2008), schizophrenia (AlexanderBloch et al., 2013; Bassett et al., 2008), and others (Bassett and Bullmore, 2006).”
Efficiency and Cost of Economical Brain Functional Networks
Achard, S., & Bullmore, E. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030017 · Cited by 2,553 · cited 1×
“The application of proportional thresholds has become more common in graph theoretical analyses of human brain networks (e.g., Achard and Bullmore, 2007; Zhang et al., 2011).”
Murphy, K., Birn, R. M., Handwerker, D. A., Jones, T. B., & Bandettini, P. A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.036 · Cited by 2,387 · cited 2×
“Lastly, even if a canonical threshold was determined and agreed upon, different preprocessing decisions such as whether to use global signal regression (GSR) may shift the distribution of correlations (Murphy et al., 2009), leading to binary graphs that are not comparable across studies.”
The global signal and observed anticorrelated resting state brain networks
Fox, M. D., Zhang, D., Snyder, A. Z., & Raichle, M. E. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90777.2008 · Cited by 1,877
Van Dijk, K. R. A., Hedden, T., Venkataraman, A., Evans, K. C., Lazar, S. W., & Buckner, R. L. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00783.2009 · Cited by 1,844 · cited 1×
“As there is no biologically principled way to set a threshold for AC C EP TE D M AN U SC R IP T a brain network, thresholds remain an „educated guess‟ (Van Dijk et al., 2010).”
Multi-task connectivity reveals flexible hubs for adaptive task control
Cole, M. W., Reynolds, J. R., Power, J. D., Repovs, G., Anticevic, A., & Braver, T. S. (2013) · Nature Neuroscience · doi:10.1038/nn.3470 · Cited by 1,704
Sporns, O. (2010) · The MIT Press eBooks · doi:10.7551/mitpress/8476.001.0001 · Cited by 1,580
Yan, C.-G., Cheung, B., Kelly, C., Colcombe, S., Craddock, R. C., Di Martino, A., Li, Q., Zuo, X.-N., Castellanos, F. X., & Milham, M. P. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.03.004 · Cited by 1,461
Griffanti, L., Salimi-Khorshidi, G., Beckmann, C. F., Auerbach, E. J., Douaud, G., Sexton, C. E., Zsoldos, E., Ebmeier, K. P., Filippini, N., Mackay, C. E., et al. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.034 · Cited by 1,262
Hierarchical Organization of Human Cortical Networks in Health and Schizophrenia
Bassett, D. S., Bullmore, E., Verchinski, B. A., Mattay, V. S., Weinberger, D. R., & Meyer-Lindenberg, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1929-08.2008 · Cited by 1,229
Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory
van Wijk, B. C. M., Stam, C. J., & Daffertshofer, A. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013701 · Cited by 1,161
Network Analysis of Intrinsic Functional Brain Connectivity in Alzheimer's Disease
Supekar, K., Menon, V., Rubin, D., Musen, M., & Greicius, M. D. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000100 · Cited by 1,148 · cited 2×
“, 2011), Alzheimer's disease (Supekar et al., 2008), schizophrenia (Alexander-Bloch et al.”
Efficiency of Functional Brain Networks and Intellectual Performance
van den Heuvel, M. P., Stam, C. J., Kahn, R. S., & Hulshoff Pol, H. E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1443-09.2009 · Cited by 1,078
Groupwise whole-brain parcellation from resting-state fMRI data for network node identification
Shen, X., Tokoglu, F., Papademetris, X., & Constable, R. T. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.081 · Cited by 1,015
Self-citationvan den Heuvel, M. P., Mandl, R. C. W., Kahn, R. S., & Hulshoff Pol, H. E. (2009) · Human Brain Mapping · doi:10.1002/hbm.20737 · Cited by 987 · cited 2×
“In attempts to show that results are not sensitive to the choice of threshold, findings are often reported across a narrow range of thresholds (e.g., Cole et al., 2013, top 2-10%; van den Heuvel et al., 2009a, r=0.3-0.5).”
InfluentialDisrupted brain connectivity networks in drug-naive, first-episode major depressive disorder
Zhang, J., Wang, J., Wu, Q., Kuang, W., Huang, X., He, Y., & Gong, Q. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.05.018 · Cited by 951
Opportunities and limitations of intrinsic functional connectivity MRI
Buckner, R. L., Krienen, F. M., & Yeo, B. T. T. (2013) · Nature Neuroscience · doi:10.1038/nn.3423 · Cited by 912 · cited 2×
“…to reflect direct connections, functional connectivity measures reflect both direct (monosynaptic) and indirect (polysynaptic) connections (Buckner et al., 2013), and therefore weighted graphs in which all nodes are connected may still reflect a reasonable representation of brain networks.”
Graph theoretical analysis of magnetoencephalographic functional connectivity in Alzheimer's disease
Stam, C. J., de Haan, W., Daffertshofer, A., Jones, B. F., Manshanden, I., van Cappellen van Walsum, A. M., Montez, T., Verbunt, J. P. A., de Munck, J. C., van Dijk, B. W., et al. (2009) · Brain · doi:10.1093/brain/awn262 · Cited by 906
Extracting the multiscale backbone of complex weighted networks
Serrano, M. Á., Boguñá, M., & Vespignani, A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0808904106 · Cited by 892
Economic small-world behavior in weighted networks
Latora, V., & Marchiori, M. (2003) · The European Physical Journal B - Condensed Matter and Complex Systems · doi:10.1140/epjb/e2003-00095-5 · Cited by 772
Age-related changes in modular organization of human brain functional networks
Meunier, D., Achard, S., Morcom, A., & Bullmore, E. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.062 · Cited by 756
Wise, R. G., Ide, K., Poulin, M. J., & Tracey, I. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.025 · Cited by 664 · cited 2×
“GSR may facilitate observations of true physiological relationships in the brain (Fox et al., 2009) and can help mitigate artifacts due to motion (Yan et al., 2013) or variations in carbon dioxide (Wise et al., 2004).”
Functional connectivity density mapping
Tomasi, D., & Volkow, N. D. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1001414107 · Cited by 643
Age- and Gender-Related Differences in the Cortical Anatomical Network
Gong, G., Rosa-Neto, P., Carbonell, F., Chen, Z. J., He, Y., & Evans, A. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2308-09.2009 · Cited by 632
The application of graph theoretical analysis to complex networks in the brain
Reijneveld, J. C., Ponten, S. C., Berendse, H. W., & Stam, C. J. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.08.010 · Cited by 522
Alexander-Bloch, A. F., Gogtay, N., Meunier, D., Birn, R., Clasen, L., Lalonde, F., Lenroot, R., Giedd, J., & Bullmore, E. T. (2010) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2010.00147 · Cited by 480
Network scaling effects in graph analytic studies of human resting-state fMRI data
Fornito (2010) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2010.00022 · Cited by 436
Tian, L., Wang, J., Yan, C., & He, Y. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.066 · Cited by 364
Alexander-Bloch, A. F., Vértes, P. E., Stidd, R., Lalonde, F., Clasen, L., Rapoport, J., Giedd, J., Bullmore, E. T., & Gogtay, N. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhr388 · Cited by 315
The Brain as a Complex System: Using Network Science as a Tool for Understanding the Brain
Telesford, Q. K., Simpson, S. L., Burdette, J. H., Hayasaka, S., & Laurienti, P. J. (2011) · Brain Connectivity · doi:10.1089/brain.2011.0055 · Cited by 285
Sex differences in normal age trajectories of functional brain networks
Scheinost, D., Finn, E. S., Tokoglu, F., Shen, X., Papademetris, X., Hampson, M., & Constable, R. T. (2015) · Human Brain Mapping · doi:10.1002/hbm.22720 · Cited by 236
Self-citationUnified Framework for Development, Deployment and Robust Testing of Neuroimaging Algorithms
Joshi, A., Scheinost, D., Okuda, H., Belhachemi, D., Murphy, I., Staib, L. H., & Papademetris, X. (2011) · Neuroinformatics · doi:10.1007/s12021-010-9092-8 · Cited by 227
Self-citationGraph-theory based parcellation of functional subunits in the brain from resting-state fMRI data
Shen, X., Papademetris, X., & Constable, R. T. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.119 · Cited by 203
Self-citationDisruption of Functional Connectivity of the Default-Mode Network in Alcoholism
Chanraud, S., Pitel, A.-L., Pfefferbaum, A., & Sullivan, E. V. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq297 · Cited by 202
Brain Network Analysis: Separating Cost from Topology Using Cost-Integration
Ginestet, C. E., Nichols, T. E., Bullmore, E. T., & Simmons, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021570 · Cited by 188
Simpson, S. L., Bowman, F. D., & Laurienti, P. J. (2013) · Statistics Surveys · doi:10.1214/13-ss103 · Cited by 175
Scheinost, D., Benjamin, J., Lacadie, C., Vohr, B. R., Schneider, K. C., Ment, L. R., Papademetris, X., & Constable, R. T. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.05.073 · Cited by 108
Self-citationBOLD signal and functional connectivity associated with loving kindness meditation
Garrison, K. A., Scheinost, D., Constable, R. T., & Brewer, J. A. (2014) · Brain and Behavior · doi:10.1002/brb3.219 · Cited by 89
Self-citationMitchell, M. R., Balodis, I. M., DeVito, E. E., Lacadie, C., Yeston, J., Scheinost, D., Constable, R. T., Carroll, K. M., & Potenza, M. N. (2013) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2013.841711 · Cited by 72
Self-citation
Cited by
The Segregation and Integration of Distinct Brain Networks and Their Relationship to Cognition
Cohen, J. R., & D'Esposito, M. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2965-15.2016 · Cited by 765
van den Heuvel, M. P., de Lange, S. C., Zalesky, A., Seguin, C., Yeo, B. T. T., & Schmidt, R. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.02.005 · Cited by 471
Giusti, C., Ghrist, R., & Bassett, D. S. (2016) · Journal of Computational Neuroscience · doi:10.1007/s10827-016-0608-6 · Cited by 424
Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex
Arslan, S., Ktena, S. I., Makropoulos, A., Robinson, E. C., Rueckert, D., & Parisot, S. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.014 · Cited by 374
“Proportional thresholding is applied after this step, to595 preserve the top 20% of the edges and reduce threshold effects on the network measures Garrison et al. (2015); Alexander-Bloch et al. (2010).”
MethodNetwork analysis for a network disorder: The emerging role of graph theory in the study of epilepsy
Bernhardt, B. C., Bonilha, L., & Gross, D. W. (2015) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2015.06.005 · Cited by 288
Metadata
- Authors
- Garrison, K. A., Scheinost, D., Finn, E. S., Shen, X., & Constable, R. T.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2015-09
- Volume
- 118
- Pages
- 651-661
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W371353707
- Cited by
- 292
- References
- 45
- FWCI
- 10.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.