Individual Variability and Test-Retest Reliability Revealed by Ten Repeated Resting-State Brain Scans over One Month
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Individual differences in mind and behavior are believed to reflect the functional variability of the human brain. Due to the lack of a large-scale longitudinal dataset, the full landscape of variability within and between individual functional connectomes is largely unknown. We collected 300 resting-state functional magnetic resonance imaging (rfMRI) datasets from 30 healthy participants who were scanned every three days for one month. With these data, both intra- and inter-individual variability of six common rfMRI metrics, as well as their test-retest reliability, were estimated across multiple spatial scales. Global metrics were more dynamic than local regional metrics. Cognitive components involving working memory, inhibition, attention, language and related neural networks exhibited high intra-individual variability. In contrast, inter-individual variability demonstrated a more complex picture across the multiple scales of metrics. Limbic, default, frontoparietal and visual networks and their related cognitive components were more differentiable than somatomotor and attention networks across the participants. Analyzing both intra- and inter-individual variability revealed a set of high-resolution maps on test-retest reliability of the multi-scale connectomic metrics. These findings represent the first collection of individual differences in multi-scale and multi-metric characterization of the human functional connectomes in-vivo, serving as normal references for the field to guide the use of common functional metrics in rfMRI-based applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
The organization of the human cerebral cortex estimated by intrinsic functional connectivity
Thomas Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zöllei, L., Polimeni, J. R., et al. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00338.2011 · Cited by 9,182
Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.018 · Cited by 7,429
The organization of the human cerebellum estimated by intrinsic functional connectivity
Buckner, R. L., Krienen, F. M., Castellanos, A., Diaz, J. C., & Yeo, B. T. T. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00339.2011 · Cited by 7,304
Cortical Surface-Based Analysis
Fischl, B., Sereno, M. I., & Dale, A. M. (1999) · NeuroImage · doi:10.1006/nimg.1998.0396 · Cited by 6,147
Tracking whole-brain connectivity dynamics in the resting state
Allen, E. A., Damaraju, E., Plis, S. M., Erhardt, E. B., Eichele, T., & Calhoun, V. D. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs352 · Cited by 2,992
Toward discovery science of human brain function
Biswal, B. B., Mennes, M., Zuo, X.-N., Gohel, S., Kelly, C., Smith, S. M., Beckmann, C. F., Adelstein, J. S., Buckner, R. L., Colcombe, S., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0911855107 · Cited by 2,970
Self-citationBuckner, R. L., Sepulcre, J., Talukdar, T., Krienen, F. M., Liu, H., Hedden, T., Andrews-Hanna, J. R., Sperling, R. A., & Johnson, K. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5062-08.2009 · Cited by 2,862
Di Martino, A., Yan, C.-G., Li, Q., Denio, E., Castellanos, F. X., Alaerts, K., Anderson, J. S., Assaf, M., Bookheimer, S. Y., Dapretto, M., et al. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.78 · Cited by 2,780
Altered baseline brain activity in children with ADHD revealed by resting-state functional MRI
Yu-Feng, Z., Yong, H., Chao-Zhe, Z., Qing-Jiu, C., Man-Qiu, S., Meng, L., Li-Xia, T., Tian-Zi, J., & Yu-Feng, W. (2007) · Brain and Development · doi:10.1016/j.braindev.2006.07.002 · Cited by 2,660 · cited 8×
“ALFF measures the strength or intensity of the low-frequency O = [0.01,0.1] (Hz) oscillations whereas fALFF is the relative amplitude contribution of the specific frequency to the whole detectable frequency range O0 = (0,1/(2Δt)] (Hz) where Δt is the sampling rate Eq (1). viðtÞ ¼ XT=2 l¼1 fal cos ðoltÞ þ bl sin ðoltÞg…”
BackgroundInfluentialRegional homogeneity approach to fMRI data analysis.
Zang, Y., Jiang, T., Lu, Y., He, Y., & Tian, L. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.030 · Cited by 2,614
Self-citationStructural and Functional Brain Networks: From Connections to Cognition
Park, H.-J., & Friston, K. (2013) · Science · doi:10.1126/science.1238411 · Cited by 2,106
Resting-state fMRI in the human connectome project
Smith, S. M., Beckmann, C. F., Andersson, J., Auerbach, E. J., Bijsterbosch, J., Douaud, G., Duff, E., Feinberg, D. A., Griffanti, L., Harms, M. P., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.039 · Cited by 1,502
Functional connectomics from resting-state fMRI
Smith, S. M., Vidaurre, D., Beckmann, C. F., Glasser, M. F., Jenkinson, M., Miller, K. L., Nichols, T. E., Robinson, E. C., Salimi-Khorshidi, G., Woolrich, M. W., et al. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.016 · Cited by 952
Opportunities and limitations of intrinsic functional connectivity MRI
Buckner, R. L., Krienen, F. M., & Yeo, B. T. T. (2013) · Nature Neuroscience · doi:10.1038/nn.3423 · Cited by 912
Functional system and areal organization of a highly sampled individual human brain
Laumann, T. O., Gordon, E. M., Adeyemo, B., Snyder, A. Z., Joo, S. J., Chen, M.-Y., Gilmore, A. W., McDermott, K. B., Nelson, S. M., Dosenbach, N. U. F., et al. (2015) · Neuron · doi:10.1016/j.neuron.2015.06.037 · Cited by 911
Saad, Z. S., Gotts, S. J., Murphy, K., Chen, G., Jo, H. J., Martin, A., & Cox, R. W. (2012) · Brain Connectivity · doi:10.1089/brain.2012.0080 · Cited by 859 · cited 1×
“Methodological issues such as smoothing, filtering and global signal regression could disturb individual variability [99, 100].”
BackgroundBetzel, R. F., Byrge, L., He, Y., Goñi, J., Zuo, X.-N., & Sporns, O. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.067 · Cited by 807
Self-citationTime-resolved resting-state brain networks
Zalesky, A., Fornito, A., Cocchi, L., Gollo, L. L., & Breakspear, M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1400181111 · Cited by 753 · cited 1×
“However, the spatial distribution of the most variable functional connectivity has been a controversy [45, 75, 76].”
BackgroundZuo, X.-N., Kelly, C., Adelstein, J. S., Klein, D. F., Castellanos, F. X., & Milham, M. P. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.080 · Cited by 744
Self-citationSignature of consciousness in the dynamics of resting-state brain activity
Barttfeld, P., Uhrig, L., Sitt, J. D., Sigman, M., Jarraya, B., & Dehaene, S. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418031112 · Cited by 670
Resting-state fMRI confounds and cleanup
Murphy, K., Birn, R. M., & Bandettini, P. A. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.001 · Cited by 666 · cited 1×
“Functional connectivity between brain areas can be defined in a relatively straightforward manner with temporal correlations [7, 8]; other measures of connectivity can be used, but may be difficult hard to interpret, partly because there are many confounds [9] that can affect these metrics [10–13].”
BackgroundDeco, G., Ponce-Alvarez, A., Mantini, D., Romani, G. L., Hagmann, P., & Corbetta, M. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1091-13.2013 · Cited by 576 · cited 1×
“This presents a resource for understanding how individual stable structural connectomes generate their vast functional repertoire [79, 80] and related dynamics [81–83] in enabling action, perception and cognition [73], as well as their alterations, under disease conditions [84].”
BackgroundUnderstanding complexity in the human brain
Bassett, D. S., & Gazzaniga, M. S. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.03.006 · Cited by 572 · cited 1×
“Together with vertex-wise high-resolution maps of this variability, the present work delineates a more completed picture of inter-individual variability in functional connectomes, indicating the complexity of different aspects of information processing through connectomes and their individual differences reflected in…”
BackgroundParcellating cortical functional networks in individuals
Wang, D., Buckner, R. L., Fox, M. D., Holt, D. J., Holmes, A. J., Stoecklein, S., Langs, G., Pan, R., Qian, T., Li, K., et al. (2015) · Nature Neuroscience · doi:10.1038/nn.4164 · Cited by 527
Topological organization of the human brain functional connectome across the lifespan
Cao, M., Wang, J.-H., Dai, Z.-J., Cao, X.-Y., Jiang, L.-L., Fan, F.-M., Song, X.-W., Xia, M.-R., Shu, N., Dong, Q., et al. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.11.004 · Cited by 440
Self-citationDisrupted Functional Brain Connectome in Individuals at Risk for Alzheimer's Disease
Wang, J., Zuo, X., Dai, Z., Xia, M., Zhao, Z., Zhao, X., Jia, J., Han, Y., & He, Y. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.03.026 · Cited by 432
Self-citationWang, J.-H., Zuo, X.-N., Gohel, S., Milham, M. P., Biswal, B. B., & He, Y. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021976 · Cited by 416
Self-citationEmergence of system roles in normative neurodevelopment
Gu, S., Satterthwaite, T. D., Medaglia, J. D., Yang, M., Gur, R. E., Gur, R. C., & Bassett, D. S. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502829112 · Cited by 338
Generative models of the human connectome
Betzel, R. F., Avena-Koenigsberger, A., Goñi, J., He, Y., de Reus, M. A., Griffa, A., Vértes, P. E., Mišic, B., Thiran, J.-P., Hagmann, P., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.041 · Cited by 303
Self-citationOne-year test-retest reliability of intrinsic connectivity network fMRI in older adults
Guo, C. C., Kurth, F., Zhou, J., Mayer, E. A., Eickhoff, S. B., Kramer, J. H., & Seeley, W. W. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.027 · Cited by 252
Betzel, R. F., Fukushima, M., He, Y., Zuo, X.-N., & Sporns, O. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.12.001 · Cited by 249 · cited 1×
“These parallel to those recent observations at scales of years (development or aging) [77, 78].”
ResultSelf-citationMessé, A., Rudrauf, D., Benali, H., & Marrelec, G. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003530 · Cited by 215 · cited 1×
“Previous studies have demonstrated that these intra-individual differences could be primarily dominated by the non-stationary components in the rfMRI signals [72].”
BackgroundZhao, T., Cao, M., Niu, H., Zuo, X., Evans, A., He, Y., Dong, Q., & Shu, N. (2015) · Human Brain Mapping · doi:10.1002/hbm.22877 · Cited by 209
Self-citationHellyer, P. J., Scott, G., Shanahan, M., Sharp, D. J., & Leech, R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4648-14.2015 · Cited by 187 · cited 1×
“This presents a resource for understanding how individual stable structural connectomes generate their vast functional repertoire [79, 80] and related dynamics [81–83] in enabling action, perception and cognition [73], as well as their alterations, under disease conditions [84].”
BackgroundNetwork structure shapes spontaneous functional connectivity dynamics
Shen, K., Hutchison, R. M., Bezgin, G., Everling, S., & McIntosh, A. R. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4903-14.2015 · Cited by 171
Identification of optimal structural connectivity using functional connectivity and neural modeling
Deco, G., McIntosh, A. R., Shen, K., Hutchison, R. M., Menon, R. S., Everling, S., Hagmann, P., & Jirsa, V. K. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4423-13.2014 · Cited by 162
Gao, W., Elton, A., Zhu, H., Alcauter, S., Smith, J. K., Gilmore, J. H., & Lin, W. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.5072-13.2014 · Cited by 131
The spatial structure of resting state connectivity stability on the scale of minutes
Gonzalez-Castillo, J., Handwerker, D. A., Robinson, M. E., Hoy, C. W., Buchanan, L. C., Saad, Z. S., & Bandettini, P. A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00138 · Cited by 116 · cited 2×
“Specifically, at the scale of minutes, high intra-individual variability was mainly presented in homotopic functional connectivity as well as non-homotopic between-network connectivity [41].”
BackgroundAllocating structure to function: the strong links between neuroplasticity and natural selection
Anderson, M. L., & Finlay, B. L. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00918 · Cited by 115 · cited 1×
“Driving forces behind the inter-individual variability of brain structure and function are related to both genetic and environmental factors [85].”
BackgroundThe Reliability of Clinical Diagnoses: State of the Art
Kraemer, H. C. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153739 · Cited by 39 · cited 3×
“High test-retest reliability is a necessary requirement for developing a biomarker of functional connectomics for clinical application [17].”
BackgroundInfluential
Cited by
Precision Functional Mapping of Individual Human Brains
Gordon, E. M., Laumann, T. O., Gilmore, A. W., Newbold, D. J., Greene, D. J., Berg, J. J., Ortega, M., Hoyt-Drazen, C., Gratton, C., Sun, H., et al. (2017) · Neuron · doi:10.1016/j.neuron.2017.07.011 · Cited by 1,335
Kong, R., Li, J., Orban, C., Sabuncu, M. R., Liu, H., Schaefer, A., Sun, N., Zuo, X.-N., Holmes, A. J., Eickhoff, S. B., et al. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhy123 · Cited by 593
Self-citationNoble, S., Scheinost, D., & Constable, R. T. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116157 · Cited by 580
On the stability of BOLD fMRI correlations
Laumann, T. O., Snyder, A. Z., Mitra, A., Gordon, E. M., Gratton, C., Adeyemo, B., Gilmore, A. W., Nelson, S. M., Berg, J. J., Greene, D. J., et al. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw265 · Cited by 516
Individual-Specific Areal-Level Parcellations Improve Functional Connectivity Prediction of Behavior
Kong, R., Yang, Q., Gordon, E., Xue, A., Yan, X., Orban, C., Zuo, X.-N., Spreng, N., Ge, T., Holmes, A., et al. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab101 · Cited by 254
Self-citation
Metadata
- Authors
- Chen, B., Xu, T., Zhou, C., Wang, L., Yang, N., Wang, Z., Dong, H.-M., Yang, Z., Zang, Y.-F., Zuo, X.-N., & Weng, X.-C.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-12-29
- Volume
- 10
- Issue
- 12
- Pages
- e0144963
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2199404514
- Cited by
- 136
- References
- 42
- FWCI
- 8.11
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.