Cited by 310Medical Image Segmentation TechniquesMedical Imaging and AnalysisBrain Tumor Detection and Classification

The DOI matches its Crossref record; 55 of the 56 references it cites were found in a registry or an index; 2 of the 9 sources its claims cite were checked for support.

MUSE: MUlti-atlas region Segmentation utilizing Ensembles of registration algorithms and parameters, and locally optimal atlas selection

Open access

Abstract

Atlas-based automated anatomical labeling is a fundamental tool in medical image segmentation, as it defines regions of interest for subsequent analysis of structural and functional image data. The extensive investigation of multi-atlas warping and fusion techniques over the past 5 or more years has clearly demonstrated the advantages of consensus-based segmentation. However, the common approach is to use multiple atlases with a single registration method and parameter set, which is not necessarily optimal for every individual scan, anatomical region, and problem/data-type. Different registration criteria and parameter sets yield different solutions, each providing complementary information. Herein, we present a consensus labeling framework that generates a broad ensemble of labeled atlases in target image space via the use of several warping algorithms, regularization parameters, and atlases. The label fusion integrates two complementary sources of information: a local similarity ranking to select locally optimal atlases and a boundary modulation term to refine the segmentation consistently with the target image's intensity profile. The ensemble approach consistently outperforms segmentations using individual warping methods alone, achieving high accuracy on several benchmark datasets. The MUSE methodology has been used for processing thousands of scans from various datasets, producing robust and consistent results. MUSE is publicly available both as a downloadable software package, and as an application that can be run on the CBICA Image Processing Portal (https://ipp.cbica.upenn.edu), a web based platform for remote processing of medical images.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

MUSE is a multi-atlas segmentation framework that builds a broad ensemble of warped atlas labels using multiple atlases, registration algorithms, and regularization parameters, then fuses them with local similarity ranking and boundary modulation. It consistently outperformed single registration method/parameter ensembles and achieved the highest average Dice score in the MICCAI 2013 mid-brain segmentation challenge.

Key findings

  • The complete ensemble of warps consistently outperformed ensembles from a single registration algorithm on each dataset, with significant differences (p < 0.01, paired t-test); adding local similarity ranking significantly increased performance over simple majority voting (p < 0.01 for all datasets).
  • Full MUSE with boundary modulation improved segmentation accuracy for all datasets except NIREP; differences were significant except for OASIS (p = 0.06185). In the MICCAI 2013 challenge, MUSE obtained the highest average Dice score (d = 0.8686) in the mid-brain segmentation category.
  • Segmentation accuracy consistently increased with more atlases until reaching a stable value around 7 atlases. On a pooled multi-site dataset of clinically normal subjects (n = 1029, age range 8 to 94), MUSE obtained the highest brain-age prediction accuracy among MUSE, STAPLE, and Joint Label Fusion in terms of Pearson’s r, concordance correlation coefficient, and mean absolute error.
  • MUSE has been used for processing thousands of scans from various datasets, producing robust and consistent results, and is publicly available as a downloadable package and via the CBICA Image Processing Portal.

Methods

  • MUSE constructs an ensemble of k warped atlas label maps by varying the atlas, deformable registration algorithm, and smoothness/regularization parameter. The paper used DRAMMS with g = {0.1, 0.2} and ANTS with s = {0.25, 0.5}; label fusion integrates a local similarity rank score based on a Gabor-filter attribute descriptor and boundary modulation terms b1 and b2.
  • Internal validation used four public benchmark datasets with expert reference labels: BrainWeb, IBSR, NIREP, and OASIS. Leave-one-out cross-validation was applied independently per dataset, and Dice similarity coefficient was used for quantitative evaluation. The MICCAI 2013 challenge evaluation used the OASIS dataset for mid-brain structures.
  • Multi-site experiments pooled clinically normal subjects from BLSA, ADNI-1, PNC, BBL-NC, and NiCK (n = 1029). For each subject, ROI segmentation was performed with MUSE, STAPLE, and Joint Label Fusion using 11 atlases selected from 35 OASIS atlases; ROI volumes were then used in a supervised learning framework to predict brain age with leave-one-out cross-validation, reporting Pearson’s r, concordance correlation coefficient, and mean absolute error.

Limitations

  • The paper states that one limitation of MUSE is its high computational requirement, a general problem for multi-atlas segmentation methods; this is mitigated by parallelizable registrations, multi-scale registration implementations, and user control over the number of registrations.
  • The paper states that for NIREP, the boundary modulation term did not improve quantitative results, which the authors attribute to low accuracy of the reference ROI masks, particularly under-segmented deep brain structures.
  • Evident from the text: direct quantitative evaluation of multi-site segmentation accuracy was not possible because common reference labels for multiple datasets were unavailable, so multi-site robustness was assessed indirectly through brain-age prediction.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.neuroimage.2015.11.073

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

13 Own result · 11 Own interpretation · 11 No basis given · 5 Own method · 4 No full text of the sources · 2 Sources not found · 1 Supported · 1 Partly supported · 1 Not checked yet · accuracy not yet measured

Show all 23 claims

  • It may state two separate claims as one. 18
  • Probably not a substantial claim. 13
26 of 26
  • The authors state this as an assumption.

    ROIs belong to a single tissue type with a smooth intensity variation.

    “with the assumption that the ROIs belong to a single tissue type with a smooth intensity variation.”
  • The authors state this as an assumption.

    The intensity distribution of each ROI can be modeled as a normal distribution.

    “The intensity distribution of each ROI is modeled as a normal distribution”
  • The paper relies on this without support.

    Different registration methods provide complementary information about the anatomy.

    “Different registration methods, which generally use notably different image features, energy formulations and optimization algorithms, provide complementary information about the anatomy.”
  • The paper relies on this without support.

    Each method and parameter set can be relatively less or more accurate in certain areas of the brain.

    “Each method and parameter set can be relatively less or more accurate in certain areas of the brain”
4 of 4

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 56 references

Cited by

Sorted by citations

Items 301–310 of 310

Metadata

Authors
Doshi, J., Erus, G., Ou, Y., Resnick, S. M., Gur, R. C., Gur, R. E., Satterthwaite, T. D., Furth, S., & Davatzikos, C.
Affiliations
  • University of Pennsylvania (US)
  • Harvard University (US)
  • National Institute on Aging (US)
  • Children's Hospital of Philadelphia (US)
Venue
NeuroImage
Publisher
Elsevier BV
Published
2016-02
Volume
127
Pages
186-195
ISSN
1053-8119 (ISSN-L)
OpenAlex
W2196038229
Cited by
309
References
56
Citations by year
2026: 26 · 2025: 45 · 2024: 35 · 2023: 41 · 2022: 39 · 2021: 34 · 2020: 27 · 2019: 25 · 2018: 15 · 2017: 12 · 2016: 10
FWCI
10.62
Type
journal article
Language
en
Open access
Locations
  • NeuroImage (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (submittedVersion)
Funders
  • Intramural Research Program, National Institute on Aging, NIH
  • National Institutes of Health (R01-AG014971)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
  • Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
Keywords
multi-atlas segmentation, anatomical labeling, atlas selection, label fusion, brain segmentation, medical image segmentation, web-based image processing
MeSH terms
Algorithms, Anatomy, Artistic, Atlases as Topic, Brain, Brain Mapping, Humans, Image Processing, Computer-Assisted, Pattern Recognition, Automated

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review