Validation of structural brain connectivity networks: The impact of scanning parameters
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Evaluation of the structural connectivity (SC) of the brain based on tractography has mainly focused on the choice of diffusion model, tractography algorithm, and their respective parameter settings. Here, we systematically validate SC derived from a post mortem monkey brain, while varying key acquisition parameters such as the b-value, gradient angular resolution and image resolution. As gold standard we use the connectivity matrix obtained invasively with histological tracers by Markov et al. (2014). As performance metric, we use cross entropy as a measure that enables comparison of the relative tracer labeled neuron counts to the streamline counts from tractography. We find that high angular resolution and high signal-to-noise ratio are important to estimate SC, and that SC derived from low image resolution (1.03 mm3) are in better agreement with the tracer network, than those derived from high image resolution (0.53 mm3) or at an even lower image resolution (2.03 mm3). In contradiction, sensitivity and specificity analyses suggest that if the angular resolution is sufficient, the balanced compromise in which sensitivity and specificity are identical remains 60–64% regardless of the other scanning parameters. Interestingly, the tracer graph is assumed to be the gold standard but by thresholding, the balanced compromise increases to 70–75%. Hence, by using performance metrics based on binarized tracer graphs, one risks losing important information, changing the performance of SC graphs derived by tractography and their dependence of different scanning parameters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Human Connectome: A Structural Description of the Human Brain
Sporns, O., Tononi, G., & Kötter, R. (2005) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0010042 · Cited by 3,260
Network-based statistic: identifying differences in brain networks
Zalesky, A., Fornito, A., & Bullmore, E. T. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.041 · Cited by 2,750 · cited 1×
“…are affected (Bastiani et al., 2012), or by studying the variations between the SC based upon by tractography (Gigandet et al., 2013; Jones, 2004; Zalesky et al., 2012, 2010; Zhan et al., 2012) and in the individual estimated WM tracts (Berman et al., 2013; Gigandet et al., 2013; Vos et al.,…”
BackgroundWhite matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI
Jones, D. K., Knösche, T. R., & Turner, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.06.081 · Cited by 2,402
Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging
Behrens, T. E. J., Johansen-Berg, H., Woolrich, M. W., Smith, S. M., Wheeler-Kingshott, C. A. M., Boulby, P. A., Barker, G. J., Sillery, E. L., Sheehan, K., Ciccarelli, O., et al. (2003) · Nature Neuroscience · doi:10.1038/nn1075 · Cited by 2,330 · cited 1×
“Furthermore, tractography enables parcellation of the cortex (Ambrosen et al., 2014; Anwander et al., 2007; Baldassano et al., 2015; Fan et al., 2016; Parisot et al., 2016) or subcortical structures based on SC (Behrens et al., 2003a; Wiegell et al., 2003).”
BackgroundMicrostructural maturation of the human brain from childhood to adulthood
Lebel, C., Walker, L., Leemans, A., Phillips, L., & Beaulieu, C. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.12.053 · Cited by 1,398
Tractography-based connectomes are dominated by false-positive connections
Maier-Hein, K. H., Neher, P., Houde, J.-C., Côté, M.-A., Garyfallidis, E., Zhong, J., Chamberland, M., Yeh, F.-C., Lin, Y.-C., Ji, Q., et al. (2016) · doi:10.1101/084137 · Cited by 1,376
Self-citationMRtrix: Diffusion tractography in crossing fiber regions
Tournier, J., Calamante, F., & Connelly, A. (2012) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.22005 · Cited by 1,370 · cited 1×
“This agrees with the results by (Tournier et al., 2012), who recommends using as high an angular resolution as scan time allows.”
ResultSchmahmann, J. D., & Pandya, D. N. (2006) · doi:10.1093/acprof:oso/9780195104233.001.0001 · Cited by 1,157 · cited 1×
“, 2017), so the actual question is how larger axonal bundles are organised, into which tracers provide insights (Schmahmann and Pandya, 2009).”
BackgroundA Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex
Markov, N. T., Ercsey-Ravasz, M. M., Ribeiro Gomes, A. R., Lamy, C., Magrou, L., Vezoli, J., Misery, P., Falchier, A., Quilodran, R., Gariel, M. A., et al. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs270 · Cited by 857
Twenty‐five pitfalls in the analysis of diffusion MRI data
Jones, D. K., & Cercignani, M. (2010) · NMR in Biomedicine · doi:10.1002/nbm.1543 · Cited by 827 · cited 1×
“The estimation of the brain’s structural organisation consists of a comprehensive data processing pipeline (Jones et al., 2013; Jones and Cercignani, 2010; Qi et al., 2015).”
BackgroundGraph analysis of the human connectome: Promise, progress, and pitfalls
Fornito, A., Zalesky, A., & Breakspear, M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.087 · Cited by 743 · cited 1×
“Thus, validation of the derived SC is of great importance (Fornito et al., 2013).”
BackgroundThomas, C., Ye, F. Q., Irfanoglu, M. O., Modi, P., Saleem, K. S., Leopold, D. A., & Pierpaoli, C. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1405672111 · Cited by 725 · cited 3×
“03 mm3 respectively, was used as is common practice (Jbabdi et al., 2013; Thomas et al., 2014) along with a curvature constraint of 80 .”
BackgroundMethodConnectivity-Based Parcellation of Broca's Area
Anwander, A., Tittgemeyer, M., von Cramon, D., Friederici, A., & Knosche, T. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhk034 · Cited by 531
Diffusion MRI at 25: exploring brain tissue structure and function
Le Bihan, D., & Johansen-Berg, H. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.006 · Cited by 498
Disrupted axonal fiber connectivity in schizophrenia
Zalesky, A., Fornito, A., Seal, M. L., Cocchi, L., Westin, C.-F., Bullmore, E. T., Egan, G. F., & Pantelis, C. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.08.022 · Cited by 439
Imaging human connectomes at the macroscale
Craddock, R. C., Jbabdi, S., Yan, C.-G., Vogelstein, J. T., Castellanos, F. X., Di Martino, A., Kelly, C., Heberlein, K., Colcombe, S., & Milham, M. P. (2013) · Nature Methods · doi:10.1038/nmeth.2482 · Cited by 419 · cited 1×
“, 2005) and to the brain’s structural organisation (Craddock et al., 2013; Le Bihan and Johansen-Berg, 2012; Toga et al., 2006; Van Essen et al., 2014).”
BackgroundAnisotropy in high angular resolution diffusion-weighted MRI
Frank, L. R. (2001) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1125 · Cited by 389
Weight consistency specifies regularities of macaque cortical networks
Markov, N. T., Misery, P., Falchier, A., Lamy, C., Vezoli, J., Quilodran, R., Gariel, M. A., Giroud, P., Ercsey-Ravasz, M., Pilaz, L. J., et al. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq201 · Cited by 386
Donahue, C. J., Sotiropoulos, S. N., Jbabdi, S., Hernandez-Fernandez, M., Behrens, T. E., Dyrby, T. B., Coalson, T., Kennedy, H., Knoblauch, K., Van Essen, D. C., et al. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.0493-16.2016 · Cited by 380
Self-citationLimits to anatomical accuracy of diffusion tractography using modern approaches
Schilling, K. G., Nath, V., Hansen, C., Parvathaneni, P., Blaber, J., Gao, Y., Neher, P., Aydogan, D. B., Shi, Y., Ocampo-Pineda, M., et al. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.029 · Cited by 260
Self-citationConnectivity differences in brain networks
Zalesky, A., Cocchi, L., Fornito, A., Murray, M. M., & Bullmore, E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.068 · Cited by 260
Evaluation and statistical inference for human connectomes
Pestilli, F., Yeatman, J. D., Rokem, A., Kay, K. N., & Wandell, B. A. (2014) · Nature Methods · doi:10.1038/nmeth.3098 · Cited by 259
Validation of in vitro probabilistic tractography
Dyrby, T. B., Søgaard, L. V., Parker, G. J., Alexander, D. C., Lind, N. M., Baaré, W. F. C., Hay-Schmidt, A., Eriksen, N., Pakkenberg, B., Paulson, O. B., et al. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.022 · Cited by 236 · cited 2×
“Until now, validation studies of SC have focused on the tractography methods and their cross-comparison, both for extracting specific tracts, their exact projections and for networks (Bastiani et al., 2012; Caiafa and Pestilli, 2017; Dyrby et al., 2007; Thomas et al., 2014; Villalon-Reina et al., 2016), as well as the…”
BackgroundMethodSelf-citationDauguet, J., Peled, S., Berezovskii, V., Delzescaux, T., Warfield, S. K., Born, R., & Westin, C.-F. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.067 · Cited by 233 · cited 3×
“, 2016), as well as the influence of tractography-specific parameters, such as FA threshold (Azadbakht et al., 2015; Bastiani et al., 2012; Dauguet et al., 2007), curvature threshold (Azadbakht et al.”
BackgroundA diffusion MRI tractography connectome of the mouse brain and comparison with neuronal tracer data
Calabrese, E., Badea, A., Cofer, G., Qi, Y., & Johnson, G. A. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv121 · Cited by 221
Jbabdi, S., Lehman, J. F., Haber, S. N., & Behrens, T. E. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2457-12.2013 · Cited by 213
Formalin fixation alters water diffusion coefficient magnitude but not anisotropy in infarcted brain
Sun, S., Neil, J. J., Liang, H., He, Y. Y., Schmidt, R. E., Hsu, C. Y., & Song, S. (2005) · Magnetic Resonance in Medicine · doi:10.1002/mrm.20488 · Cited by 204 · cited 2×
“Estimation of SC in post mortem brains has been shown to be a good model for human brain SC, as long as the b-value is adjusted to the lower diffusivity ex vivo (D’Arceuil et al., 2007; Dyrby et al., 2011; Sun et al., 2005).”
MethodDiscrete neuroanatomical networks are associated with specific cognitive abilities in old age
Wen, W., Zhu, W., He, Y., Kochan, N. A., Reppermund, S., Slavin, M. J., Brodaty, H., Crawford, J., Xia, A., & Sachdev, P. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4085-10.2011 · Cited by 204 · cited 1×
“Nevertheless, a vast amount of tractography studies demonstrate its potential for studying the structural organisation of both the healthy (Gong et al., 2009; Robinson et al., 2010; Wen et al., 2011) and the diseased brain (Jahanshad et al.”
BackgroundBastiani, M., Shah, N. J., Goebel, R., & Roebroeck, A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.06.002 · Cited by 192 · cited 9×
“…have focused on the tractography methods and their cross-comparison, both for extracting specific tracts, their exact projections and for networks (Bastiani et al., 2012; Caiafa and Pestilli, 2017; Dyrby et al., 2007; Thomas et al., 2014; Villalon-Reina et al., 2016), as well as the influence of…”
BackgroundMethodInfluentialMicrostructure informed tractography: pitfalls and open challenges
Daducci, A., Dal Palú, A., Descoteaux, M., & Thiran, J.-P. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00247 · Cited by 138 · cited 1×
“, 2019) and multimodal microstructure informed tracking (Daducci et al., 2016).”
Backgroundvan den Heuvel, M. P., de Reus, M. A., Feldman Barrett, L., Scholtens, L. H., Coopmans, F. M. T., Schmidt, R., Preuss, T. M., Rilling, J. K., & Li, L. (2015) · Human Brain Mapping · doi:10.1002/hbm.22828 · Cited by 131
Validation of tractography: Comparison with manganese tracing
Knösche, T. R., Anwander, A., Liptrot, M., & Dyrby, T. B. (2015) · Human Brain Mapping · doi:10.1002/hbm.22902 · Cited by 127
Self-citationValidation of High-Resolution Tractography Against In Vivo Tracing in the Macaque Visual Cortex
Azadbakht, H., Parkes, L. M., Haroon, H. A., Augath, M., Logothetis, N. K., de Crespigny, A., D'Arceuil, H. E., & Parker, G. J. M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu326 · Cited by 103 · cited 5×
“accuracy (percentage of correctly determined binary connections) (Azadbakht et al., 2015), correlation between FLNe and FSe (fraction of streamlines connecting two areas relative to the number of streamlines extrinsic to those areas) (Donahue et al.”
BackgroundMethodInfluentialCan increased spatial resolution solve the crossing fiber problem for diffusion MRI?
Schilling, K., Gao, Y., Janve, V., Stepniewska, I., Landman, B. A., & Anderson, A. W. (2017) · NMR in Biomedicine · doi:10.1002/nbm.3787 · Cited by 102 · cited 3×
“The image resolution, obtainable with MRI, may not easily solve the complexity of fiber organisation (Schilling et al., 2017), so the actual question is how larger axonal bundles are organised, into which tracers provide insights (Schmahmann and Pandya, 2009).”
BackgroundHow does angular resolution affect diffusion imaging measures?
Zhan, L., Leow, A. D., Jahanshad, N., Chiang, M.-C., Barysheva, M., Lee, A. D., Toga, A. W., McMahon, K. L., de Zubicaray, G. I., Wright, M. J., et al. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.057 · Cited by 79
Cited by
Schilling, K. G., Rheault, F., Petit, L., Hansen, C. B., Nath, V., Yeh, F.-C., Girard, G., Barakovic, M., Rafael-Patino, J., Yu, T., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118502 · Cited by 182
Girard, G., Caminiti, R., Battaglia-Mayer, A., St-Onge, E., Ambrosen, K. S., Eskildsen, S. F., Krug, K., Dyrby, T. B., Descoteaux, M., Thiran, J.-P., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117201 · Cited by 83
Self-citationTowards reliable reconstruction of the mouse brain corticothalamic connectivity using diffusion MRI
Arefin, T. M., Lee, C. H., Liang, Z., Rallapalli, H., Wadghiri, Y. Z., Turnbull, D. H., & Zhang, J. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120111 · Cited by 17
Metadata
- Authors
- Ambrosen, K. S., Eskildsen, S. F., Hinne, M., Krug, K., Lundell, H., Schmidt, M. N., van Gerven, M. A. J., Mørup, M., & Dyrby, T. B.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 204
- Pages
- 116207
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2973480403
- Cited by
- 41
- References
- 35
- FWCI
- 3.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.