Test-retest reliability of FreeSurfer automated hippocampal subfield segmentation within and across scanners
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
The human hippocampus is vulnerable to a range of degenerative conditions and as such, accurate in vivo measurement of the hippocampus and hippocampal substructures via neuroimaging is of great interest for understanding mechanisms of disease as well as for use as a biomarker in clinical trials of novel therapeutics. Although total hippocampal volume can be measured relatively reliably, it is critical to understand how this reliability is affected by acquisition on different scanners, as multiple scanning platforms would likely be utilized in large-scale clinical trials. This is particularly true for hippocampal subregional measurements, which have only relatively recently been measurable through common image processing platforms such as FreeSurfer. Accurate segmentation of these subregions is challenging due to their small size, magnetic resonance imaging (MRI) signal loss in medial temporal regions of the brain, and lack of contrast for delineation from standard neuroimaging procedures. Here, we assess the test-retest reliability of the FreeSurfer automated hippocampal subfield segmentation procedure using two Siemens model scanners (a Siemens Trio and Prismafit Trio upgrade). T1-weighted images were acquired for 11 generally healthy younger participants (two scans on the Trio and one scan on the Prismafit). Each scan was processed through the standard cross-sectional stream and the recently released longitudinal pipeline in FreeSurfer v6.0 for hippocampal segmentation. Test-retest reliability of the volumetric measures was examined for individual subfields as well as percent volume difference and Dice overlap among scans and intra-class correlation coefficients (ICC). Reliability was high in the molecular layer, dentate gyrus, and whole hippocampus with the inclusion of three time points with mean volume differences among scans less than 3%, overlap greater than 80%, and ICC >0.95. The parasubiculum and hippocampal fissure showed the least improvement in reliability with mean volume difference greater than 5%, overlap less than 70%, and ICC scores ranging from 0.78 to 0.89. Other subregions, including the CA regions, were stable in their mean volume difference and overlap (<5% difference and >75% respectively) and showed improvement in reliability with the inclusion of three scans (ICC > 0.9). Reliability was generally higher within scanner (Trio-Trio), however, Trio-Prismafit reliability was also high and did not exhibit an obvious bias. These results suggest that the FreeSurfer automated segmentation procedure is a reliable method to measure total as well as hippocampal subregional volumes and may be useful in clinical applications including as an endpoint for future clinical trials of conditions affecting the hippocampus.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., et al. (2002) · Neuron · doi:10.1016/s0896-6273(02)00569-x · Cited by 8,610
Self-citationA nonparametric method for automatic correction of intensity nonuniformity in MRI data
Sled, J. G., Zijdenbos, A. P., & Evans, A. C. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.668698 · Cited by 4,731 · cited 1×
“…matter volumetric structures (including hippocampus, amygdala, caudate, putamen, ventricles) (Fischl et al., 2002; 2004), intensity normalization (Sled et al., 1998), tessellation of the gray matter white matter boundary, automated topology correction (Fischl et al., 2001; S egonne et al.,…”
BackgroundWithin-subject template estimation for unbiased longitudinal image analysis
Reuter, M., Schmansky, N. J., Rosas, H. D., & Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.084 · Cited by 2,356
Self-citationSTRESS AND HIPPOCAMPAL PLASTICITY
McEwen, B. S. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.105 · Cited by 2,087 · cited 3×
“…distinct functional properties and vulnerabilities of the substructures, including the dentate gyrus where neurogenesis has been shown to persist into adulthood, and therapies such as exercise and drug intervention have shown to increase neurogenesis (Leuner and Gould, 2010; Mcewen, 1999).”
BackgroundDale, A. M., & Sereno, M. I. (1993) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1993.5.2.162 · Cited by 2,003 · cited 4×
“The technical details of these procedures are described in prior publications (Dale et al., 1999; Dale and Sereno, 1993; Fischl and Dale, 2000; Fischl et al., 2001; Fischl et al., 1999; Fischl et al., 2002, 2004; Han et al., 2006; Jovicich et al., 2006; Reuter et al., 2010; Reuter et al., 2012; S…”
BackgroundMethodInfluentialHan, X., Jovicich, J., Salat, D., van der Kouwe, A., Quinn, B., Czanner, S., Busa, E., Pacheco, J., Albert, M., Killiany, R., et al. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.02.051 · Cited by 1,508
Self-citationCritical role of the hippocampus in memory for sequences of events
Fortin, N. J., Agster, K. L., & Eichenbaum, H. B. (2002) · Nature Neuroscience · doi:10.1038/nn834 · Cited by 881
Teicher, M. H., Anderson, C. M., & Polcari, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1115396109 · Cited by 639 · cited 2×
“…across several neuropsychiatric and degenerative disorders, including Schizophrenia (SZD), posttraumatic stress disorders (PTSD), and Alzheimer’s disease (de Flores et al., 2015; La Joie et al., 2013; Leuner and Gould, 2010; Scoville and Milner, 1957; Teicher et al., 2012; Winocur et al., 2006).”
BackgroundThe Hippocampus and Memory for “What,” “Where,” and “When”
Ergorul, C., & Eichenbaum, H. (2004) · Learning & Memory · doi:10.1101/lm.73304 · Cited by 294
Cited by
Höflich, A., Kraus, C., Pfeiffer, R. M., Seiger, R., Rujescu, D., Zarate, C. A., Kasper, S., Winkler, D., & Lanzenberger, R. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01318-6 · Cited by 34
Neurobiological and genetic correlates of the dissociative subtype of posttraumatic stress disorder.
Wolf, E. J., Hawn, S. E., Sullivan, D. R., Miller, M. W., Sanborn, V., Brown, E., Neale, Z., Fein-Schaffer, D., Zhao, X., Logue, M. W., et al. (2023) · Journal of Psychopathology and Clinical Science · doi:10.1037/abn0000795 · Cited by 23
Self-citation
Metadata
- Authors
- Brown, E. M., Pierce, M. E., Clark, D. C., Fischl, B. R., Iglesias, J. E., Milberg, W. P., McGlinchey, R. E., & Salat, D. H.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 210
- Pages
- 116563
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W3001520180
- Cited by
- 115
- References
- 13
- FWCI
- 7.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Test-retest reliability of FreeSurfer automated hippocampal subfield segmentation within and across scanners. https://app.cochat.ai/papers/10.1016/j.neuroimage.2020.116563
- The paper
- Brown, E. M., Pierce, M. E., Clark, D. C., Fischl, B. R., Iglesias, J. E., Milberg, W. P., McGlinchey, R. E., & Salat, D. H. (2020). Test-retest reliability of FreeSurfer automated hippocampal subfield segmentation within and across scanners. NeuroImage. https://doi.org/10.1016/j.neuroimage.2020.116563
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.