The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods
Abstract
Automatic whole-brain extraction from magnetic resonance images (MRI), also known as skull stripping, is a key component in most neuroimage pipelines. As the first element in the chain, its robustness is critical for the overall performance of the system. Many skull stripping methods have been proposed, but the problem is not considered to be completely solved yet. Many systems in the literature have good performance on certain datasets (mostly the datasets they were trained/tuned on), but fail to produce satisfactory results when the acquisition conditions or study populations are different. In this paper we introduce a robust, learning-based brain extraction system (ROBEX). The method combines a discriminative and a generative model to achieve the final result. The discriminative model is a Random Forest classifier trained to detect the brain boundary; the generative model is a point distribution model that ensures that the result is plausible. When a new image is presented to the system, the generative model is explored to find the contour with highest likelihood according to the discriminative model. Because the target shape is in general not perfectly represented by the generative model, the contour is refined using graph cuts to obtain the final segmentation. Both models were trained using 92 scans from a proprietary dataset but they achieve a high degree of robustness on a variety of other datasets. ROBEX was compared with six other popular, publicly available methods (BET, BSE, FreeSurfer, AFNI, BridgeBurner, and GCUT) on three publicly available datasets (IBSR, LPBA40, and OASIS, 137 scans in total) that include a wide range of acquisition hardware and a highly variable population (different age groups, healthy/diseased). The results show that ROBEX provides significantly improved performance measures for almost every method/dataset combination.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
The Varimax Criterion for Analytic Rotation in Factor Analysis
Kaiser, H. F. (1958) · Psychometrika · doi:10.1007/bf02289233 · Cited by 7,580
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
A nonparametric method for automatic correction of intensity nonuniformity in MRI data
Sled, J. G., Zijdenbos, A. P., & Evans, A. C. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.668698 · Cited by 4,731 · cited 1×
“First, the scan is fed to an implementation [29] of the N3 bias field correction algorithm [30].”
MethodAn experimental comparison of min-cut/max- flow algorithms for energy minimization in vision
Boykov, Y., & Kolmogorov, V. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.60 · Cited by 4,577
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311
Bias in random forest variable importance measures: Illustrations, sources and a solution
Strobl, C., Boulesteix, A.-L., Zeileis, A., & Hothorn, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-25 · Cited by 3,688
Research works printed but not linked: 4
- yi, 2009, Discriminative, semantic segmentation of brain tissue in MR images, Proc MICCAI, 558
- 10.1109/ICPR.2004.1334630 · doi:10.1109/icpr.2004.1334630
- deng, 2008, 3D liver tumor segmentation challenge, Proc MICCAIOncol Workshop
- metz, 2008, Editorial: 3D segmentation in the clinic: A grand challenge II—Coronary artery tracking, Proc MICCAIOncol Workshop
Cited by
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498
Deep learning for brain MRI segmentation: state of the art and future directions
Akkus, Z., Galimzianova, A., Hoogi, A., Rubin, D. L., & Erickson, B. J. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9983-4 · Cited by 1,129
Automated brain extraction of multisequence MRI using artificial neural networks
Isensee, F., Schell, M., Pflueger, I., Brugnara, G., Bonekamp, D., Neuberger, U., Wick, A., Schlemmer, H., Heiland, S., Wick, W., et al. (2019) · Human Brain Mapping · doi:10.1002/hbm.24750 · Cited by 722
Shin, H.-C., Tenenholtz, N. A., Rogers, J. K., Schwarz, C. G., Senjem, M. L., Gunter, J. L., Andriole, K. P., & Michalski, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00536-8_1 · Cited by 638
Deep MRI brain extraction: A 3D convolutional neural network for skull stripping
Kleesiek, J., Urban, G., Hubert, A., Schwarz, D., Maier-Hein, K., Bendszus, M., & Biller, A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.024 · Cited by 505
SynthStrip: skull-stripping for any brain image
Hoopes, A., Mora, J. S., Dalca, A. V., Fischl, B., & Hoffmann, M. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119474 · Cited by 488
BEaST: Brain extraction based on nonlocal segmentation technique
Eskildsen, S. F., Coupé, P., Fonov, V., Manjón, J. V., Leung, K. K., Guizard, N., Wassef, S. N., Østergaard, L. R., & Collins, D. L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.012 · Cited by 472
Random forest-based similarity measures for multi-modal classification of Alzheimer's disease
Gray, K. R., Aljabar, P., Heckemann, R. A., Hammers, A., & Rueckert, D. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.065 · Cited by 456
Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images
Baur, C., Wiestler, B., Albarqouni, S., & Navab, N. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_16 · Cited by 432
Autoencoders for unsupervised anomaly segmentation in brain MR images: A comparative study
Baur, C., Denner, S., Wiestler, B., Navab, N., & Albarqouni, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101952 · Cited by 390
Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review
Bernal, J., Kushibar, K., Asfaw, D. S., Valverde, S., Oliver, A., Martí, R., & Lladó, X. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.08.008 · Cited by 368
Effectiveness of regional DTI measures in distinguishing Alzheimer’s disease, MCI, and normal aging
Nir, T. M., Jahanshad, N., Villalon-Reina, J. E., Toga, A. W., Jack, C. R., Weiner, M. W., & Thompson, P. M. (2013) · NeuroImage: Clinical · doi:10.1016/j.nicl.2013.07.006 · Cited by 348
“All extra-cerebral tissue was roughly removed from the T1-weighted anatomical scans using a number of software packages, primarily ROBEX, a robust automated brain extraction program trained on manually “skull-stripped” MRI data (Iglesias et al., 2011) and FreeSurfer (Fischl et al., 2004).”
Self-citationDoshi, J., Erus, G., Ou, Y., Gaonkar, B., & Davatzikos, C. (2013) · Academic Radiology · doi:10.1016/j.acra.2013.09.010 · Cited by 257
Brain Development in Heavy-Drinking Adolescents
Squeglia, L. M., Tapert, S. F., Sullivan, E. V., Jacobus, J., Meloy, M. J., Rohlfing, T., & Pfefferbaum, A. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14101249 · Cited by 245
A comparison of FreeSurfer-generated data with and without manual intervention
McCarthy, C. S., Ramprashad, A., Thompson, C., Botti, J.-A., Coman, I. L., & Kates, W. R. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00379 · Cited by 122
Thakur, S., Doshi, J., Pati, S., Rathore, S., Sako, C., Bilello, M., Ha, S. M., Shukla, G., Flanders, A., Kotrotsou, A., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117081 · Cited by 84
Pohl, K. M., Sullivan, E. V., Rohlfing, T., Chu, W., Kwon, D., Nichols, B. N., Zhang, Y., Brown, S. A., Tapert, S. F., Cummins, K., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.061 · Cited by 85
Encoding atlases by randomized classification forests for efficient multi-atlas label propagation
Zikic, D., Glocker, B., & Criminisi, A. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.06.010 · Cited by 81
Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effects
Glocker, B., Robinson, R., Castro, D. C., Dou, Q., & Konukoglu, E. (2019) · arXiv · doi:10.48550/arxiv.1910.04597 · Cited by 74
Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
Zhao, G., Liu, F., Oler, J. A., Meyerand, M. E., Kalin, N. H., & Birn, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.065 · Cited by 68
Sikka, A., Peri, S., Virk, J. S., Niyaz, U., & Bathula, D. R. (2025) · The Journal of Precision Medicine: Health and Disease · doi:10.1016/j.premed.2025.100004 · Cited by 58
Ding, Y., Pereira, F., Hoehne, A., Beaulieu, M.-M., Lepage, M., Turecki, G., & Jollant, F. (2017) · Molecular Psychiatry · doi:10.1038/mp.2016.221 · Cited by 55
Jollant, F., Wagner, G., Richard-Devantoy, S., Köhler, S., Bär, K.-J., Turecki, G., & Pereira, F. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0170-2 · Cited by 54
Intelligent labeling based on fisher information for medical image segmentation using deep learning
Sourati, J., Gholipour, A., Dy, J. G., Tomas-Fernandez, X., Kurugol, S., & Warfield, S. K. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2907805 · Cited by 50
Lopez, J. P., Pereira, F., Richard-Devantoy, S., Berlim, M., Chachamovich, E., Fiori, L. M., Niola, P., Turecki, G., & Jollant, F. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.9 · Cited by 50
Mapping fetal brain development based on automated segmentation and 4D brain atlasing
Li, H., Yan, G., Luo, W., Liu, T., Wang, Y., Liu, R., Zheng, W., Zhang, Y., Li, K., Zhao, L., et al. (2021) · Brain Structure and Function · doi:10.1007/s00429-021-02303-x · Cited by 41
Tractography density and network measures in Alzheimer’s disease
Prasad, G., Nir, T. M., Toga, A. W., & Thompson, P. M. (2013) · 2013 IEEE 10th International Symposium on Biomedical Imaging · doi:10.1109/isbi.2013.6556569 · Cited by 35
Self-citationDetection of white matter lesion regions in MRI using SLIC0 and convolutional neural network
Diniz, P. H. B., Valente, T. L. A., Diniz, J. O. B., Silva, A. C., Gattass, M., Ventura, N., Muniz, B. C., & Gasparetto, E. L. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.04.011 · Cited by 34
Harnett, N. G., Stevens, J. S., Rooij, S. J. H., Ely, T. D., Michopoulos, V., Hudak, L., Jovanovic, T., Rothbaum, B. O., Ressler, K. J., & Fani, N. (2021) · Depression and Anxiety · doi:10.1002/da.23104 · Cited by 31
Liang, Z., Guo, X., Xu, W., Ibrahim, Y., Voets, N., Pretorius, P. M., Noble, J. A., & Kamnitsas, K. (2026) · Medical Image Analysis · doi:10.1016/j.media.2025.103763 · Cited by 3
Parker, C., Weston, P., Zhang, H., Oxtoby, N., & Initiative, T. A. D. N. (2022) · doi:10.1101/2022.07.12.499784 · Cited by 2
Liang, Z., Guo, X., Xu, W., Ibrahim, Y., Voets, N., Pretorius, P. M., Noble, J. A., & Kamnitsas, K. (2025) · arXiv
Metadata
- Authors
- Iglesias, J. E., Liu, C.-Y., Thompson, P. M., & Tu, Z.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2011-09
- Volume
- 30
- Issue
- 9
- Pages
- 1617-1634
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2145661921
- Cited by
- 570
- References
- 47
- FWCI
- 21.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.