The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths
Open accessAbstract
Automated MRI-derived measurements of in-vivo human brain volumes provide novel insights into normal and abnormal neuroanatomy, but little is known about measurement reliability. Here we assess the impact of image acquisition variables (scan session, MRI sequence, scanner upgrade, vendor and field strengths), Freesurfer segmentation preprocessing variables (image averaging, B1 field inhomogeneity correction) and segmentation analysis variables (probabilistic atlas) on resultant image segmentation volumes from older (n=15, mean age 69.5) and younger (both n=5, mean ages 34 and 36.5) healthy subjects. The variability between hippocampal, thalamic, caudate, putamen, lateral ventricular and total intracranial volume measures across sessions on the same scanner on different days is less than 4.3% for the older group and less than 2.3% for the younger group. Within-scanner measurements are remarkably reliable across scan sessions, being minimally affected by averaging of multiple acquisitions, B1 correction, acquisition sequence (MPRAGE vs. multi-echo-FLASH), major scanner upgrades (Sonata-Avanto, Trio-TrioTIM), and segmentation atlas (MPRAGE or multi-echo-FLASH). Volume measurements across platforms (Siemens Sonata vs. GE Signa) and field strengths (1.5T vs. 3T) result in a volume difference bias but with a comparable variance as that measured within-scanner, implying that multi-site studies may not necessarily require a much larger sample to detect a specific effect. These results suggest that volumes derived from automated segmentation of T1-weighted structural images are reliable measures within the same scanner platform, even after upgrades; however, combining data across platform and across field-strength introduces a bias that should be considered in the design of multi-site studies, such as clinical drug trials. The results derived from the young groups (scanner upgrade effects and B1 inhomogeneity correction effects) should be considered as preliminary and in need for further validation with a larger dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Voxel-Based Morphometry—The Methods
Ashburner, J., & Friston, K. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0582 · Cited by 8,676
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., et al. (2002) · Neuron · doi:10.1016/s0896-6273(02)00569-x · Cited by 8,610
Self-citationMeasuring the thickness of the human cerebral cortex from magnetic resonance images
Fischl, B., & Dale, A. M. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.200033797 · Cited by 5,818
Statistical methods for assessing agreement between two methods of clinical measurement
Bland, J. M., & Altman, D. G. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.10.001 · Cited by 5,220
The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347
A review of MRI findings in schizophrenia
Shenton, M. E., Dickey, C. C., Frumin, M., & McCarley, R. W. (2001) · Schizophrenia Research · doi:10.1016/s0920-9964(01)00163-3 · Cited by 2,346
A hybrid approach to the skull stripping problem in MRI
Ségonne, F., Dale, A. M., Busa, E., Glessner, M., Salat, D., Hahn, H. K., & Fischl, B. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.032 · Cited by 2,212
Self-citationSequence-independent segmentation of magnetic resonance images
Fischl, B., Salat, D. H., van der Kouwe, A. J. W., Makris, N., Ségonne, F., Quinn, B. T., & Dale, A. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.016 · Cited by 2,109
Self-citation
Cited by
for the ENIGMA Schizophrenia Working Group, van Erp, T. G. M., Hibar, D. P., Rasmussen, J. M., Glahn, D. C., Pearlson, G. D., Andreassen, O. A., Agartz, I., Westlye, L. T., Haukvik, U. K., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.63 · Cited by 1,135
The structural basis of inter-individual differences in human behaviour and cognition
Kanai, R., & Rees, G. (2011) · Nature reviews. Neuroscience · doi:10.1038/nrn3000 · Cited by 1,055
Ewert, S., Plettig, P., Li, N., Chakravarty, M. M., Collins, D. L., Herrington, T. M., Kühn, A. A., & Horn, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.05.015 · Cited by 602
Maier, O., Menze, B. H., von der Gablentz, J., Häni, L., Heinrich, M. P., Liebrand, M., Winzeck, S., Basit, A., Bentley, P., Chen, L., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.07.009 · Cited by 524
Consistent neuroanatomical age-related volume differences across multiple samples
Walhovd, K. B., Westlye, L. T., Amlien, I., Espeseth, T., Reinvang, I., Raz, N., Agartz, I., Salat, D. H., Greve, D. N., Fischl, B., et al. (2011) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2009.05.013 · Cited by 506
Self-citationØstby, Y., Tamnes, C. K., Fjell, A. M., Westlye, L. T., Due-Tønnessen, P., & Walhovd, K. B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1242-09.2009 · Cited by 480
“Reproducibility errors between scan sessions have been shown to be up to 2.3% in young adults, with higher error estimates for the smallest structures (Jovicich et al., 2009).”
BackgroundInfluentialMorris, J. C., Roe, C. M., Grant, E. A., Head, D., Storandt, M., Goate, A. M., Fagan, A. M., Holtzman, D. M., & Mintun, M. A. (2009) · Archives of Neurology · doi:10.1001/archneurol.2009.269 · Cited by 476
Holmes, A. J., Hollinshead, M. O., O’Keefe, T. M., Petrov, V. I., Fariello, G. R., Wald, L. L., Fischl, B., Rosen, B. R., Mair, R. W., Roffman, J. L., et al. (2015) · Scientific Data · doi:10.1038/sdata.2015.31 · Cited by 444
Variation in neural development as a result of exposure to institutionalization early in childhood
Sheridan, M. A., Fox, N. A., Zeanah, C. H., McLaughlin, K. A., & Nelson, C. A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1200041109 · Cited by 432
Automated MRI measures identify individuals with mild cognitive impairment and Alzheimer's disease
Desikan, R. S., Cabral, H. J., Hess, C. P., Dillon, W. P., Glastonbury, C. M., Weiner, M. W., Schmansky, N. J., Greve, D. N., Salat, D. H., Buckner, R. L., et al. (2009) · Brain · doi:10.1093/brain/awp123 · Cited by 405
Self-citationGronenschild, E. H. B. M., Habets, P., Jacobs, H. I. L., Mengelers, R., Rozendaal, N., van Os, J., & Marcelis, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038234 · Cited by 364
Effects of memory training on cortical thickness in the elderly
Engvig, A., Fjell, A. M., Westlye, L. T., Moberget, T., Sundseth, Ø., Larsen, V. A., & Walhovd, K. B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.041 · Cited by 364
Cognitive-behavioral therapy increases prefrontal cortex gray matter in patients with chronic pain
Seminowicz, D. A., Shpaner, M., Keaser, M. L., Krauthamer, G. M., Mantegna, J., Dumas, J. A., Newhouse, P. A., Filippi, C. G., Keefe, F. J., & Naylor, M. R. (2013) · The Journal of Pain · doi:10.1016/j.jpain.2013.07.020 · Cited by 305
Anatomical Abnormalities in Autism?
Haar, S., Berman, S., Behrmann, M., & Dinstein, I. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhu242 · Cited by 292
Brain development and aging: Overlapping and unique patterns of change
Tamnes, C. K., Walhovd, K. B., Dale, A. M., Østby, Y., Grydeland, H., Richardson, G., Westlye, L. T., Roddey, J. C., Hagler, D. J., Due-Tønnessen, P., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.11.039 · Cited by 287
Shaw, P., Malek, M., Watson, B., Greenstein, D., de Rossi, P., & Sharp, W. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.04.007 · Cited by 303
Storandt, M., Mintun, M. A., Head, D., & Morris, J. C. (2009) · Archives of Neurology · doi:10.1001/archneurol.2009.272 · Cited by 304
Holmes, A. J., Lee, P. H., Hollinshead, M. O., Bakst, L., Roffman, J. L., Smoller, J. W., & Buckner, R. L. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2531-12.2012 · Cited by 293
Multi-parametric neuroimaging reproducibility: A 3-T resource study
Landman, B. A., Huang, A. J., Gifford, A., Vikram, D. S., Lim, I. A. L., Farrell, J. A. D., Bogovic, J. A., Hua, J., Chen, M., Jarso, S., et al. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.047 · Cited by 299
Jacobs, H. I. L., Van Boxtel, M. P. J., Jolles, J., Verhey, F. R. J., & Uylings, H. B. M. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.06.009 · Cited by 293
Salat, D. H., Lee, S. Y., van der Kouwe, A. J., Greve, D. N., Fischl, B., & Rosas, H. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.074 · Cited by 293
Self-citationIntrinsic Amygdala–Cortical Functional Connectivity Predicts Social Network Size in Humans
Bickart, K. C., Hollenbeck, M. C., Barrett, L. F., & Dickerson, B. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1599-12.2012 · Cited by 272
EEG sleep slow-wave activity as a mirror of cortical maturation
Buchmann, A., Ringli, M., Kurth, S., Schaerer, M., Geiger, A., Jenni, O. G., & Huber, R. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq129 · Cited by 273
on behalf of the MAGNIMS study group, Sastre-Garriga, J., Pareto, D., Battaglini, M., Rocca, M. A., Ciccarelli, O., Enzinger, C., Wuerfel, J., Sormani, M. P., Barkhof, F., et al. (2020) · Nature Reviews Neurology · doi:10.1038/s41582-020-0314-x · Cited by 273
Methods and considerations for longitudinal structural brain imaging analysis across development
Mills, K. L., & Tamnes, C. K. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.04.004 · Cited by 266
Quantitative Analysis of PiB-PET with FreeSurfer ROIs
Su, Y., D'Angelo, G. M., Vlassenko, A. G., Zhou, G., Snyder, A. Z., Marcus, D. S., Blazey, T. M., Christensen, J. J., Vora, S., Morris, J. C., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073377 · Cited by 246
“In addition, since FreeSurfer is widely used in AD research [29,30,51], a FreeSurferbased amyloid imaging analysis protocol would allow integration of amyloid deposition measurements with cortical thickness, volume and other anatomical measurements.”
MethodPfefferbaum, A., Rohlfing, T., Rosenbloom, M. J., Chu, W., Colrain, I. M., & Sullivan, E. V. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.10.008 · Cited by 256
Age-related temporal and parietal cortical thinning in autism spectrum disorders
Wallace, G. L., Dankner, N., Kenworthy, L., Giedd, J. N., & Martin, A. (2010) · Brain · doi:10.1093/brain/awq279 · Cited by 256
Partial volume correction in quantitative amyloid imaging
Su, Y., Blazey, T. M., Snyder, A. Z., Raichle, M. E., Marcus, D. S., Ances, B. M., Bateman, R. J., Cairns, N. J., Aldea, P., Cash, L., et al. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.11.058 · Cited by 247
Blokland, G. A. M., de Zubicaray, G. I., McMahon, K. L., & Wright, M. J. (2012) · Twin Research and Human Genetics · doi:10.1017/thg.2012.11 · Cited by 221
“…have shown that reproducibility for structural and DTI measures appears to be quite good (e.g. Bonekamp et al., 2007; Dickerson et al., 2008; Jovicich et al., 2009); but Quiggle et al. (2011), for example, report a wide range of test-retest reliabilities for CT. Reliability is likely to…”
Prediction error associated with the perceptual segmentation of naturalistic events
Zacks, J. M., Kurby, C. A., Eisenberg, M. L., & Haroutunian, N. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00078 · Cited by 202
Stress-induced changes in human decision-making are reversible
Soares, J. M., Sampaio, A., Ferreira, L. M., Santos, N. C., Marques, F., Palha, J. A., Cerqueira, J. J., & Sousa, N. (2012) · Translational Psychiatry · doi:10.1038/tp.2012.59 · Cited by 183
Messina, D., Cerasa, A., Condino, F., Arabia, G., Novellino, F., Nicoletti, G., Salsone, M., Morelli, M., Lanza, P. L., & Quattrone, A. (2011) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2010.12.010 · Cited by 163
Dennison, M., Whittle, S., Yücel, M., Vijayakumar, N., Kline, A., Simmons, J., & Allen, N. B. (2013) · Developmental Science · doi:10.1111/desc.12057 · Cited by 146
Prenatal tobacco exposure and brain morphology: a prospective study in young children
El Marroun, H., Schmidt, M. N., Franken, I. H. A., Jaddoe, V. W. V., Hofman, A., van der Lugt, A., Verhulst, F. C., Tiemeier, H., & White, T. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2013.273 · Cited by 136
Zhang, A., Leow, A., Ajilore, O., Lamar, M., Yang, S., Joseph, J., Medina, J., Zhan, L., & Kumar, A. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.279 · Cited by 121
Detect and correct bias in multi-site neuroimaging datasets
Wachinger, C., Rieckmann, A., & Pölsterl, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101879 · Cited by 115
Structural brain development: A review of methodological approaches and best practices
(2017) · doi:10.1016/j.dcn.2017.11.008 · Cited by 124
Sleep slow-wave activity reveals developmental changes in experience-dependent plasticity
Wilhelm, I., Kurth, S., Ringli, M., Mouthon, A.-L., Buchmann, A., Geiger, A., Jenni, O. G., & Huber, R. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0962-14.2014 · Cited by 108
Janiri, D., Sani, G., Rossi, P. D., Piras, F., Iorio, M., Banaj, N., Giuseppin, G., Spinazzola, E., Maggiora, M., Ambrosi, E., et al. (2017) · Bipolar Disorders · doi:10.1111/bdi.12516 · Cited by 99
Van Schuerbeek, P., Baeken, C., De Raedt, R., De Mey, J., & Luypaert, R. (2011) · Brain Research · doi:10.1016/j.brainres.2010.11.073 · Cited by 94
Dynamics of the human structural connectome underlying working memory training
Caeyenberghs, K., Metzler-Baddeley, C., Foley, S., & Jones, D. K. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.1973-15.2016 · Cited by 91
Treatment Course With Antidepressant Therapy in Late-Life Depression
Sheline, Y. I., Disabato, B. M., Hranilovich, J., Morris, C., D’Angelo, G., Pieper, C., Toffanin, T., Taylor, W. D., MacFall, J. R., Wilkins, C., et al. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12010122 · Cited by 86
“FreeSurfer morphometric procedures have been demonstrated to show good test-retest reliability and good spatial reproducibility across scanners (30, 31).”
Early deprivation alters structural brain development from middle childhood to adolescence
Sheridan, M. A., Mukerji, C. E., Wade, M., Humphreys, K. L., Garrisi, K., Goel, S., Patel, K., Fox, N. A., Zeanah, C. H., Nelson, C. A., et al. (2022) · Science Advances · doi:10.1126/sciadv.abn4316 · Cited by 84
Volume estimation of the thalamus using freesurfer and stereology: consistency between methods
Keller, S. S., Gerdes, J. S., Mohammadi, S., Kellinghaus, C., Kugel, H., Deppe, K., Ringelstein, E. B., Evers, S., Schwindt, W., & Deppe, M. (2012) · Neuroinformatics · doi:10.1007/s12021-012-9147-0 · Cited by 84
Hippocampal Size and Memory Functioning in Children and Adolescents with Congenital Hypothyroidism
Wheeler, S. M., Willoughby, K. A., McAndrews, M. P., & Rovet, J. F. (2011) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-0119 · Cited by 75
MacQueen, G. M., Hassel, S., Arnott, S. R., Addington, J., Bowie, C. R., Bray, S. L., Davis, A. D., Downar, J., Foster, J. A., Frey, B. N., et al. (2019) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.180036 · Cited by 57
Amorim, L., Magalhães, R., Coelho, A., Moreira, P. S., Portugal-Nunes, C., Castanho, T. C., Marques, P., Sousa, N., & Santos, N. C. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00375 · Cited by 47
Pituitary volume, stress reactivity and genetic risk for psychotic disorder
Habets, P., Collip, D., Myin-Germeys, I., Gronenschild, E., van Bronswijk, S., Hofman, P., Lataster, T., Lardinois, M., Nicolson, N. A., van Os, J., et al. (2012) · Psychological Medicine · doi:10.1017/s0033291711002728 · Cited by 46
Madole, J. W., Ritchie, S. J., Cox, S. R., Buchanan, C. R., Hernández, M. V., Maniega, S. M., Wardlaw, J. M., Harris, M. A., Bastin, M. E., Deary, I. J., et al. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.06.010 · Cited by 45
“It is potentially nontrivial to 376 compare brain indices across scanners of different magnetic strengths (75,76), and future 377 research would benefit from assessing whether these differences bias cross-sample prediction.”
BackgroundFava, M., Johe, K., Ereshefsky, L., Gertsik, L. G., English, B. A., Bilello, J. A., Thurmond, L. M., Johnstone, J., Dickerson, B. C., Makris, N., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.178 · Cited by 45
Test-retest reliability and sample size estimates after MRI scanner relocation
Melzer, T. R., Keenan, R. J., Leeper, G. J., Kingston-Smith, S., Felton, S. A., Green, S. K., Henderson, K. J., Palmer, N. J., Shoorangiz, R., Almuqbel, M. M., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116608 · Cited by 43
5-HTTLPR, anxiety and gender interaction moderates right amygdala volume in healthy subjects
Cerasa, A., Quattrone, A., Piras, F., Mangone, G., Magariello, A., Fagioli, S., Girardi, P., Muglia, M., Caltagirone, C., & Spalletta, G. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst144 · Cited by 35
Hoogenboom, W. S., Perlis, R. H., Smoller, J. W., Zeng-Treitler, Q., Gainer, V. S., Murphy, S. N., Churchill, S. E., Kohane, I. S., Shenton, M. E., & Iosifescu, D. V. (2013) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2012.07.007 · Cited by 13
Metadata
- Authors
- Jovicich, J., Czanner, S., Han, X., Salat, D., van der Kouwe, A., Quinn, B., Pacheco, J., Albert, M., Killiany, R., & Blacker, D.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2009-05-15
- Volume
- 46
- Issue
- 1
- Pages
- 177-192
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2157885417
- Cited by
- 559
- References
- 60
- FWCI
- 27.25
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.