The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Toward a connectivity gradient-based framework for reproducible biomarker discovery
Open accessAbstract
A bstract Despite myriad demonstrations of feasibility, the high dimensionality of fMRI data remains a critical barrier to its utility for reproducible biomarker discovery. Recent studies applying dimensionality reduction techniques to resting-state fMRI (R-fMRI) have unveiled neurocognitively meaningful connectivity gradients that are present in both human and primate brains, and appear to differ meaningfully among individuals and clinical populations. Here, we provide a critical assessment of the suitability of connectivity gradients for biomarker discovery. Using the Human Connectome Project (discovery subsample=209; two replication subsamples= 209×2) and the Midnight scan club (n=9), we tested the following key biomarker traits – reliability, reproducibility and predictive validity – of functional gradients. In doing so, we systematically assessed the effects of three analytical settings, including i ) dimensionality reduction algorithms ( i.e ., linear vs . non-linear methods), ii ) input data types ( i.e ., raw time series, [un-]thresholded functional connectivity), and iii ) amount of the data (R-fMRI time-series lengths). We found that the reproducibility of functional gradients across algorithms and subsamples is generally higher for those explaining more variances of whole-brain connectivity data, as well as those having higher reliability. Notably, among different analytical settings, a linear dimensionality reduction (principal component analysis in our study), more conservatively thresholded functional connectivity ( e.g ., 95-97%) and longer time-series data (at least ≥20mins) was found to be preferential conditions to obtain higher reliability. Those gradients with higher reliability were able to predict unseen phenotypic scores with a higher accuracy, highlighting reliability as a critical prerequisite for validity. Importantly, prediction accuracy with connectivity gradients exceeded that observed with more traditional edge-based connectivity measures, suggesting the added value of a low-dimensional gradient approach. Finally, the present work highlights the importance and benefits of systematically exploring the parameter space for new imaging methods before widespread deployment. H ighlights - There is a growing need to identify benchmark parameters in advancing functional connectivity gradients into a reliable biomarker. - Here, we explored multidimensional parameter space in calculating functional gradients to improve their reproducibility, reliability and predictive validity. - We demonstrated that more reproducible and reliable gradient markers tend to have higher predictive power for unseen phenotypic scores across various cognitive domains. - We showed that the low-dimensional connectivity gradient approach could outperform raw edge-based analyses in terms of predicting phenotypic scores. - We highlight the necessity of optimizing parameters for new imaging methods before their widespread deployment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Complex brain networks: graph theoretical analysis of structural and functional systems
Bullmore, E., & Sporns, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2575 · Cited by 11,820
The human brain is intrinsically organized into dynamic, anticorrelated functional networks
Fox, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen, D. C., & Raichle, M. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504136102 · Cited by 8,553
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
The organization of the human cerebellum estimated by intrinsic functional connectivity
Buckner, R. L., Krienen, F. M., Castellanos, A., Diaz, J. C., & Yeo, B. T. T. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00339.2011 · Cited by 7,304
Large-scale brain networks and psychopathology: a unifying triple network model
Menon, V. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.08.003 · Cited by 4,168
Local-global parcellation of the human cerebral cortex from intrinsic functional connectivity MRI
Schaefer, A., Kong, R., Gordon, E. M., Laumann, T. O., Zuo, X.-N., Holmes, A. J., Eickhoff, S. B., & Yeo, B. T. T. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhx179 · Cited by 3,657
Mesulam, M. (1998) · Brain · doi:10.1093/brain/121.6.1013 · Cited by 3,072
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772
Rich-club organization of the human connectome
van den Heuvel, M. P., & Sporns, O. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3539-11.2011 · Cited by 2,354
Situating the default-mode network along a principal gradient of macroscale cortical organization
Margulies, D. S., Ghosh, S. S., Goulas, A., Falkiewicz, M., Huntenburg, J. M., Langs, G., Bezgin, G., Eickhoff, S. B., Castellanos, F. X., Petrides, M., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1608282113 · Cited by 2,321
Self-citationGreicius, M. D., Flores, B. H., Menon, V., Glover, G. H., Solvason, H. B., Kenna, H., Reiss, A. L., & Schatzberg, A. F. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.09.020 · Cited by 2,214
The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour
Duncan, J. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.004 · Cited by 1,846
Salimi-Khorshidi, G., Douaud, G., Beckmann, C. F., Glasser, M. F., Griffanti, L., & Smith, S. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.046 · Cited by 1,770
A whole brain fMRI atlas generated via spatially constrained spectral clustering
Craddock, R. C., James, G. A., Holtzheimer, P. E., Hu, X. P., & Mayberg, H. S. (2012) · Human Brain Mapping · doi:10.1002/hbm.21333 · Cited by 1,636
Function in the human connectome: task-fMRI and individual differences in behavior
Barch, D. M., Burgess, G. C., Harms, M. P., Petersen, S. E., Schlaggar, B. L., Corbetta, M., Glasser, M. F., Curtiss, S., Dixit, S., Feldt, C., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.033 · Cited by 1,529
Resting-state fMRI in the human connectome project
Smith, S. M., Beckmann, C. F., Andersson, J., Auerbach, E. J., Bijsterbosch, J., Douaud, G., Duff, E., Feinberg, D. A., Griffanti, L., Harms, M. P., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.039 · Cited by 1,502
The effect of scan length on the reliability of resting-state fMRI connectivity estimates
Birn, R. M., Molloy, E. K., Patriat, R., Parker, T., Meier, T. B., Kirk, G. R., Nair, V. A., Meyerand, M. E., & Prabhakaran, V. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.099 · Cited by 875
Smith, S. M., Nichols, T. E., Vidaurre, D., Winkler, A. M., Behrens, T. E. J., Glasser, M. F., Ugurbil, K., Barch, D. M., Van Essen, D. C., & Miller, K. L. (2015) · Nature Neuroscience · doi:10.1038/nn.4125 · Cited by 859
Defining functional areas in individual human brains using resting functional connectivity MRI
Cohen, A. L., Fair, D. A., Dosenbach, N. U. F., Miezin, F. M., Dierker, D., Van Essen, D. C., Schlaggar, B. L., & Petersen, S. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.01.066 · Cited by 582
A cross-disorder connectome landscape of brain dysconnectivity
van den Heuvel, M. P., & Sporns, O. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0177-6 · Cited by 462
Harnessing reliability for neuroscience research
Zuo, X.-N., Xu, T., & Milham, M. P. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0655-x · Cited by 310
Self-citationDefault mode network can support the level of detail in experience during active task states
Sormaz, M., Murphy, C., Wang, H.-T., Hymers, M., Karapanagiotidis, T., Poerio, G., Margulies, D. S., Jefferies, E., & Smallwood, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1721259115 · Cited by 262
Self-citation
Cited by
Katsumi, Y., Kamona, N., Zhang, J., Bunce, J. G., Hutchinson, J. B., Yarossi, M., Tunik, E., Quigley, K. S., Dickerson, B. C., & Barrett, L. F. (2021) · doi:10.1101/2021.09.01.456844 · Cited by 89
(2023) · doi:10.1038/s42003-023-04796-0 · Cited by 89
Metadata
- Authors
- Hong, S.-J., Xu, T., Nikolaidis, A., Smallwood, J., Margulies, D. S., Bernhardt, B., Vogelstein, J., & Milham, M. P.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 223
- Pages
- 117322
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W3083634137
- Cited by
- 181
- References
- 24
- FWCI
- 8.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.