The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Hippocampal volume change measurement: Quantitative assessment of the reproducibility of expert manual outlining and the automated methods FreeSurfer and FIRST
Abstract
Background To measure hippocampal volume change in Alzheimer's disease (AD) or mild cognitive impairment (MCI), expert manual delineation is often used because of its supposed accuracy. It has been suggested that expert outlining yields poorer reproducibility as compared to automated methods, but this has not been investigated. Aim To determine the reproducibilities of expert manual outlining and two common automated methods for measuring hippocampal atrophy rates in healthy aging, MCI and AD. Methods From the Alzheimer's Disease Neuroimaging Initiative (ADNI), 80 subjects were selected: 20 patients with AD, 40 patients with mild cognitive impairment (MCI) and 20 healthy controls (HCs). Left and right hippocampal volume change between baseline and month-12 visit was assessed by using expert manual delineation, and by the automated software packages FreeSurfer (longitudinal processing stream) and FIRST. To assess reproducibility of the measured hippocampal volume change, both back-to-back (BTB) MPRAGE scans available for each visit were analyzed. Hippocampal volume change was expressed in μL, and as a percentage of baseline volume. Reproducibility of the 1-year hippocampal volume change was estimated from the BTB measurements by using linear mixed model to calculate the limits of agreement (LoA) of each method, reflecting its measurement uncertainty. Using the delta method, approximate p-values were calculated for the pairwise comparisons between methods. Statistical analyses…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, various evaluations have also revealed limitations of that approach (Mccarthy 2015; Keller et al., 2012; Mulder et al., 2014), which might be critical in aging and multi-site studies.”
From A comparison of Freesurfer and multi-atlas MUSE for brain anatomy segmentation: Findings about size and age bias, and inter-scanner stability in multi-site aging studies (2020) · cites this paper as Mulder et al., 2014
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Beckett, A. H., Rowland, M., & TURNER, P. (1965) · The Lancet · doi:10.1016/s0140-6736(65)91037-8 · Cited by 16,917
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., et al. (2002) · Neuron · doi:10.1016/s0896-6273(02)00569-x · Cited by 8,610
Zhang, Y., Brady, M., & Smith, S. M. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 7,628
The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347
Automatically Parcellating the Human Cerebral Cortex
Fischl, B. R. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg087 · Cited by 4,208
Within-subject template estimation for unbiased longitudinal image analysis
Reuter, M., Schmansky, N. J., Rosas, H. D., & Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.084 · Cited by 2,356
A Bayesian model of shape and appearance for subcortical brain segmentation
Patenaude, B., Smith, S. M., Kennedy, D. N., & Jenkinson, M. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.02.046 · Cited by 2,287
Warfield, S. K., Zou, K. H., & Wells, W. M. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.828354 · Cited by 2,072
Cited by
Sorted by citations
Brain atrophy in Alzheimer’s Disease and aging
Pini, L., Pievani, M., Bocchetta, M., Altomare, D., Bosco, P., Cavedo, E., Galluzzi, S., Marizzoni, M., & Frisoni, G. B. (2016) · Ageing Research Reviews · doi:10.1016/j.arr.2016.01.002 · Cited by 836
Weiner, M. W., Veitch, D. P., Aisen, P. S. S., Beckett, L. A., Cairns, N. J., Green, R. C., Harvey, D. J., Jack, C. R., Jagust, W. J., Morris, J. C., et al. (2017) · Alzheimer s & Dementia · doi:10.1016/j.jalz.2016.11.007 · Cited by 325
Hippocampal volume across age: Nomograms derived from over 19,700 people in UK Biobank
Nobis, L., Manohar, S. G., Smith, S. M., Alfaro-Almagro, F., Jenkinson, M., Mackay, C. E., & Husain, M. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2019.101904 · Cited by 236
Yamanakkanavar, N., Choi, J. Y., & Lee, B. (2020) · Sensors · doi:10.3390/s20113243 · Cited by 235
A systematic review and meta-analysis of longitudinal hippocampal atrophy in healthy human ageing
Fraser, M. A., Shaw, M. E., & Cherbuin, N. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.03.035 · Cited by 175
Metadata
- Authors
- Mulder, E. R., de Jong, R. A., Knol, D. L., van Schijndel, R. A., Cover, K. S., Visser, P. J., Barkhof, F., & Vrenken, H.
- Affiliations
- Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
- Gemeente Amsterdam (NL)
- Corresponding author
- Vrenken, Hugo
- ORCID
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2014-05
- Volume
- 92
- Pages
- 169-181
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W1981789870
- Cited by
- 122
- References
- 52
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 4 · 2023: 8 · 2022: 9 · 2021: 8 · 2020: 14 · 2019: 12 · 2018: 11 · 2017: 18 · 2016: 16 · 2015: 14 · 2014: 2
- FWCI
- 12.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- NeuroImage (publishedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Pure Amsterdam UMC (submittedVersion)
- VU Research Portal (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Bristol-Myers Squibb
- Seventh Framework Programme (283562)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Keywords
- hippocampal atrophy, reproducibility, FreeSurfer, FIRST, Alzheimer's disease, mild cognitive impairment, healthy aging, limits of agreement, longitudinal MRI, MPRAGE, segmentation errors, measurement uncertainty, ADNI cohort
- MeSH terms
- Aged, Algorithms, Alzheimer Disease, Artificial Intelligence, Atrophy, Female, Hippocampus, Humans, Image Enhancement, Image Interpretation, Computer-Assisted, Magnetic Resonance Imaging, Male, Organ Size, Pattern Recognition, Automated, Sensitivity and Specificity, Software, Software Validation, Reproducibility of Results, Observer Variation, Imaging, Three-Dimensional, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review