Multi-parametric neuroimaging reproducibility: A 3-T resource study
Open accessThe DOI matches its Crossref record; 135 of the 135 references it cites were found in a registry or an index.
Abstract
Modern MRI image processing methods have yielded quantitative, morphometric, functional, and structural assessments of the human brain. These analyses typically exploit carefully optimized protocols for specific imaging targets. Algorithm investigators have several excellent public data resources to use to test, develop, and optimize their methods. Recently, there has been an increasing focus on combining MRI protocols in multi-parametric studies. Notably, these have included innovative approaches for fusing connectivity inferences with functional and/or anatomical characterizations. Yet, validation of the reproducibility of these interesting and novel methods has been severely hampered by the limited availability of appropriate multi-parametric data. We present an imaging protocol optimized to include state-of-the-art assessment of brain function, structure, micro-architecture, and quantitative parameters within a clinically feasible 60 minute protocol on a 3T MRI scanner. We present scan-rescan reproducibility of these imaging contrasts based on 21 healthy volunteers (11 M/10 F, 22–61 y/o). The cortical gray matter, cortical white matter, ventricular cerebrospinal fluid, thalamus, putamen, caudate, cerebellar gray matter, cerebellar white matter, and brainstem were identified with mean volume-wise reproducibility of 3.5%. We tabulate the mean intensity, variability and reproducibility of each contrast in a region of interest approach, which is essential for prospective study planning and retrospective power analysis considerations. Anatomy was highly consistent on structural acquisition (~1–5% variability), while variation on diffusion and several other quantitative scans was higher (~<10%). Some sequences are particularly variable in specific structures (ASL exhibited variation of 28% in the cerebral white matter) or in thin structures (quantitative T2 varied by up to 73% in the caudate) due, in large part, to variability in automated ROI placement. The richness of the joint distribution of intensities across imaging methods can be best assessed within the context of a particular analysis approach as opposed to a summary table. As such, all imaging data and analysis routines have been made publicly and freely available. This effort provides the neuroimaging community with a resource for optimization of algorithms that exploit the diversity of modern MRI modalities. Additionally, it establishes a baseline for continuing development and optimization of multi-parametric imaging protocols.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
A default mode of brain function
Raichle, M. E., MacLeod, A. M., Snyder, A. Z., Powers, W. J., Gusnard, D. A., & Shulman, G. L. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.2.676 · Cited by 12,190
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Functional connectivity in the motor cortex of resting human brain using echo‐planar mri
Biswal, B., Zerrin Yetkin, F., Haughton, V. M., & Hyde, J. S. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910340409 · Cited by 9,812
The human brain is intrinsically organized into dynamic, anticorrelated functional networks
Fox, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen, D. C., & Raichle, M. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504136102 · Cited by 8,553
Co-planar stereotaxic atlas of the human brain
Laitinen, L. (1989) · Clinical Neurology and Neurosurgery · doi:10.1016/0303-8467(89)90128-5 · Cited by 7,565
Ashburner, J., & Friston, K. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.018 · Cited by 7,507 · cited 1×
“• Resting state fMRI analysis includes slice time correction, realignment, and spatial normalization preprocessing steps (Ashburner and Friston, 2005) followed by advanced modeling to reduce physiological noise (Behzadi et al., 2007).”
Dissociable intrinsic connectivity networks for salience processing and executive control
Seeley, W. W., Menon, V., Schatzberg, A. F., Keller, J., Glover, G. H., Kenna, H., Reiss, A. L., & Greicius, M. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5587-06.2007 · Cited by 7,426 · cited 1×
“In recent years, BOLD fMRI has been widely used to evaluate FC revealing several neurobiologically relevant intrinsically connected networks (ICNs) (Greicius et al., 2003; Raichle et al., 2001; Seeley et al., 2007; Vincent et al., 2004).”
MethodForming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Functional connectivity in the resting brain: a network analysis of the default mode hypothesis
Greicius, M. D., Krasnow, B., Reiss, A. L., & Menon, V. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0135058100 · Cited by 6,358 · cited 1×
“In recent years, BOLD fMRI has been widely used to evaluate FC revealing several neurobiologically relevant intrinsically connected networks (ICNs) (Greicius et al., 2003; Raichle et al., 2001; Seeley et al., 2007; Vincent et al., 2004).”
Method
Cited by
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
101 Labeled Brain Images and a Consistent Human Cortical Labeling Protocol
Klein, A., & Tourville, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00171 · Cited by 1,202
Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements
Tustison, N. J., Cook, P. A., Klein, A., Song, G., Das, S. R., Duda, J. T., Kandel, B. M., van Strien, N., Stone, J. R., Gee, J. C., et al. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.044 · Cited by 670
FastSurfer - A fast and accurate deep learning based neuroimaging pipeline
Henschel, L., Conjeti, S., Estrada, S., Diers, K., Fischl, B., & Reuter, M. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117012 · Cited by 660
Marcus, D. S., Fotenos, A. F., Csernansky, J. G., Morris, J. C., & Buckner, R. L. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21407 · Cited by 631
The ANTsX ecosystem for quantitative biological and medical imaging
Tustison, N. J., Cook, P. A., Holbrook, A. J., Johnson, H. J., Muschelli, J., Devenyi, G. A., Duda, J. T., Das, S. R., Cullen, N. C., Gillen, D. L., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-87564-6 · Cited by 440
Lindquist, M. A., Xu, Y., Nebel, M. B., & Caffo, B. S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.052 · Cited by 369
Tustison, N. J., Shrinidhi, K. L., Wintermark, M., Durst, C. R., Kandel, B. M., Gee, J. C., Grossman, M. C., & Avants, B. B. (2015) · Neuroinformatics · doi:10.1007/s12021-014-9245-2 · Cited by 277
Vision Transformers in medical computer vision—A contemplative retrospection
Parvaiz, A., Khalid, M. A., Zafar, R., Ameer, H., Ali, M., & Fraz, M. M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106126 · Cited by 276
Brain MRI super-resolution using deep 3D convolutional networks
Pham, C.-H., Ducournau, A., Fablet, R., & Rousseau, F. (2017) · 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) · doi:10.1109/isbi.2017.7950500 · Cited by 227
Whole brain myelin mapping using T1- and T2-weighted MR imaging data.
Ganzetti, M., Wenderoth, N., & Mantini, D. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00671 · Cited by 225
“Dante Mantini holds a Sir Henry Dale Fellowship jointly funded by the Wellcome Trust and the Royal Society (101253/Z/13/Z).”
MethodDisruption of functional organization within the primary motor cortex in children with autism
Nebel, M. B., Joel, S. E., Muschelli, J., Barber, A. D., Caffo, B. S., Pekar, J. J., & Mostofsky, S. H. (2014) · Human Brain Mapping · doi:10.1002/hbm.22188 · Cited by 213
“An ascending slice order was used to minimize motion-induced artifacts [Landman et al., 2011].”
MethodInfluentialSelf-citationRandom forest regression for magnetic resonance image synthesis
Jog, A., Carass, A., Roy, S., Pham, D. L., & Prince, J. L. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.009 · Cited by 212
Schilling, K. G., Rheault, F., Petit, L., Hansen, C. B., Nath, V., Yeh, F.-C., Girard, G., Barakovic, M., Rafael-Patino, J., Yu, T., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118502 · Cited by 182
Self-citationCetin Karayumak, S., Bouix, S., Ning, L., James, A., Crow, T., Shenton, M., Kubicki, M., & Rathi, Y. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.08.073 · Cited by 164
“Several methods have characterized both intra-scanner and inter-scanner variability in structural and dMRI data (Landman et al., 2011, 2007).”
Brain Network Modularity Predicts Exercise-Related Executive Function Gains in Older Adults
Baniqued, P. L., Gallen, C. L., Voss, M. W., Burzynska, A. Z., Wong, C. N., Cooke, G. E., Duffy, K., Fanning, J., Ehlers, D. K., Salerno, E. A., et al. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00426 · Cited by 112
Metadata
- Authors
- Landman, B. A., Huang, A. J., Gifford, A., Vikram, D. S., Lim, I. A. L., Farrell, J. A. D., Bogovic, J. A., Hua, J., Chen, M., Jarso, S., Smith, S. A., Joel, S., Mori, S., Pekar, J. J., Barker, P. B., Prince, J. L., & van Zijl, P. C. M.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-02
- Volume
- 54
- Issue
- 4
- Pages
- 2854-2866
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2140854449
- Cited by
- 299
- References
- 135
- FWCI
- 7.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.