The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Automated brain extraction of multisequence MRI using artificial neural networks
Open accessAbstract
Brain extraction is a critical preprocessing step in the analysis of neuroimaging studies conducted with magnetic resonance imaging (MRI) and influences the accuracy of downstream analyses. The majority of brain extraction algorithms are, however, optimized for processing healthy brains and thus frequently fail in the presence of pathologically altered brain or when applied to heterogeneous MRI datasets. Here we introduce a new, rigorously validated algorithm (termed HD‐BET) relying on artificial neural networks that aim to overcome these limitations. We demonstrate that HD‐BET outperforms six popular, publicly available brain extraction algorithms in several large‐scale neuroimaging datasets, including one from a prospective multicentric trial in neuro‐oncology, yielding state‐of‐the‐art performance with median improvements of +1.16 to +2.50 points for the Dice coefficient and −0.66 to −2.51 mm for the Hausdorff distance. Importantly, the HD‐BET algorithm, which shows robust performance in the presence of pathology or treatment‐induced tissue alterations, is applicable to a broad range of MRI sequence types and is not influenced by variations in MRI hardware and acquisition parameters encountered in both research and clinical practice. For broader accessibility, the HD‐BET prediction algorithm is made freely available (www.neuroAI-HD.org) and may become an essential component for robust, automated, high‐throughput processing of MRI neuroimaging data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868 · cited 1×
“For each brain mask, visual inspection and corrections were performed using ITK-SNAP (by applying the different capabilities of this tool, including region-growing segmentation and manual corrections (www.itksnap.org; Yushkevich et al., 2006)).”
Method3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Zhang, Y., Brady, M., & Smith, S. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.906424 · Cited by 6,982
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,872
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Accurate and robust brain image alignment using boundary-based registration
Greve, D. N., & Fischl, B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.060 · Cited by 3,596
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498
Brain tumor segmentation with Deep Neural Networks
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., & Larochelle, H. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.05.004 · Cited by 3,278
Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations
Sudre, C. H., Li, W., Vercauteren, T., Ourselin, S., & Jorge Cardoso, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9_28 · Cited by 2,829
Bayesian analysis of neuroimaging data in FSL
Woolrich, M. W., Jbabdi, S., Patenaude, B., Chappell, M., Makni, S., Behrens, T., Beckmann, C., Jenkinson, M., & Smith, S. M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.055 · Cited by 2,385
The clinical use of structural MRI in Alzheimer disease
Frisoni, G. B., Fox, N. C., Jack, C. R., Scheltens, P., & Thompson, P. M. (2010) · Nature Reviews Neurology · doi:10.1038/nrneurol.2009.215 · Cited by 2,113
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
Construction of a 3D probabilistic atlas of human cortical structures
Shattuck, D. W., Mirza, M., Adisetiyo, V., Hojatkashani, C., Salamon, G., Narr, K. L., Poldrack, R. A., Bilder, R. M., & Toga, A. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.031 · Cited by 1,203
The Importance of Skip Connections in Biomedical Image Segmentation
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., & Pal, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_19 · Cited by 984
Lomustine and Bevacizumab in Progressive Glioblastoma
Wick, W., Gorlia, T., Bendszus, M., Taphoorn, M., Sahm, F., Harting, I., Brandes, A. A., Taal, W., Domont, J., Idbaih, A., et al. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1707358 · Cited by 970
Self-citationMagnetic Resonance Image Tissue Classification Using a Partial Volume Model
Shattuck, D. W., Sandor-Leahy, S. R., Schaper, K. A., Rottenberg, D. A., & Leahy, R. M. (2001) · NeuroImage · doi:10.1006/nimg.2000.0730 · Cited by 950
BrainSuite: An automated cortical surface identification tool
Shattuck, D. W., & Leahy, R. M. (2002) · Medical Image Analysis · doi:10.1016/s1361-8415(02)00054-3 · Cited by 859
Automated 3-D Extraction of Inner and Outer Surfaces of Cerebral Cortex from MRI
MacDonald, D., Kabani, N., Avis, D., & Evans, A. C. (2000) · NeuroImage · doi:10.1006/nimg.1999.0534 · Cited by 850
CNN-based Segmentation of Medical Imaging DataPreprint
Kayalibay, B., Jensen, G. W., & van der Smagt, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03056 · Cited by 659
Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods
Iglesias, J. E., Liu, C.-Y., Thompson, P. M., & Tu, Z. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2138152 · Cited by 570
Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge
Isensee, F., Kickingereder, P., Wick, W., Bendszus, M., & Maier-Hein, K. H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_25 · Cited by 527
Self-citationDeep MRI brain extraction: A 3D convolutional neural network for skull stripping
Kleesiek, J., Urban, G., Hubert, A., Schwarz, D., Maier-Hein, K., Bendszus, M., & Biller, A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.024 · Cited by 505 · cited 5×
“However, this approach is not only very labor-intensive and time-consuming, but also shows a strong interindividual and intraindividual variability (Kleesiek et al., 2016; Smith, 2002; Souza et al., 2018) that could ultimately bias the analysis and consequently hamper the reproducibility of clinical studies.”
BackgroundInfluentialSelf-citationBEaST: Brain extraction based on nonlocal segmentation technique
Eskildsen, S. F., Coupé, P., Fonov, V., Manjón, J. V., Leung, K. K., Guizard, N., Wassef, S. N., Østergaard, L. R., & Collins, D. L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.012 · Cited by 472
Kickingereder, P., Isensee, F., Tursunova, I., Petersen, J., Neuberger, U., Bonekamp, D., Brugnara, G., Schell, M., Kessler, T., Foltyn, M., et al. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30098-1 · Cited by 454
Self-citationElastic model-based segmentation of 3-D neuroradiological data sets
Kelemen, A., Szekely, G., & Gerig, G. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.811260 · Cited by 434
An Efficient Algorithm for Calculating the Exact Hausdorff Distance
Taha, A. A., & Hanbury, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2408351 · Cited by 411
Interactive 3D Segmentation of MRI and CT Volumes using Morphological Operations
Höhne, K. H., & Hanson, W. A. (1992) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199203000-00019 · Cited by 259
Evaluation of volume-based and surface-based brain image registration methods
Klein, A., Ghosh, S. S., Avants, B., Yeo, B. T. T., Fischl, B., Ardekani, B., Gee, J. C., Mann, J. J., & Parsey, R. V. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.091 · Cited by 255
Methods on Skull Stripping of MRI Head Scan Images—a Review
Kalavathi, P., & Prasath, V. B. S. (2016) · Journal of Digital Imaging · doi:10.1007/s10278-015-9847-8 · Cited by 246
Souza, R., Lucena, O., Garrafa, J., Gobbi, D., Saluzzi, M., Appenzeller, S., Rittner, L., Frayne, R., & Lotufo, R. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.021 · Cited by 239
Mohseni Salehi, S. S., Erdogmus, D., & Gholipour, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2721362 · Cited by 232
Optimized Brain Extraction for Pathological Brains (optiBET)
Lutkenhoff, E. S., Rosenberg, M., Chiang, J., Zhang, K., Pickard, J. D., Owen, A. M., & Monti, M. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115551 · Cited by 226
Data augmentation instead of explicit regularizationPreprint
Hernández-García, Á., & Peter König, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03852 · Cited by 200
Fennema‐Notestine, C., Ozyurt, I. B., Clark, C. P., Morris, S., Bischoff‐Grethe, A., Bondi, M. W., Jernigan, T. L., Fischl, B., Segonne, F., Shattuck, D. W., et al. (2006) · Human Brain Mapping · doi:10.1002/hbm.20161 · Cited by 189
Popescu, V., Battaglini, M., Hoogstrate, W. S., Verfaillie, S. C. J., Sluimer, I. C., van Schijndel, R. A., van Dijk, B. W., Cover, K. S., Knol, D. L., Jenkinson, M., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.074 · Cited by 166
The Skull Stripping Problem in MRI Solved by a Single 3D Watershed Transform
Hahn, H. K., & Peitgen, H. (2000) · Lecture notes in computer science · doi:10.1007/978-3-540-40899-4_14 · Cited by 153
Accuracy and reproducibility study of automatic MRI brain tissue segmentation methods
de Boer, R., Vrooman, H. A., Ikram, M. A., Vernooij, M. W., Breteler, M. M. B., van der Lugt, A., & Niessen, W. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.03.012 · Cited by 150
Correlation between brain volume loss and clinical and MRI outcomes in multiple sclerosis
Radue, E. W., Barkhof, F., Kappos, L., Sprenger, T., Häring, D. A., de Vera, A., von Rosenstiel, P., Bright, J. R., Francis, G., & Cohen, J. A. (2015) · Neurology · doi:10.1212/wnl.0000000000001281 · Cited by 144
Robust skull stripping using multiple MR image contrasts insensitive to pathology
Roy, S., Butman, J. A., & Pham, D. L. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.11.017 · Cited by 119
Puccio, B., Pooley, J. P., Pellman, J., Taverna, E. C., & Craddock, R. C. (2016) · GigaScience · doi:10.1186/s13742-016-0150-5 · Cited by 81
Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
Zhao, G., Liu, F., Oler, J. A., Meyerand, M. E., Kalin, N. H., & Birn, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.065 · Cited by 68
Wang, L., Chen, Y., Pan, X., Hong, X., & Xia, D. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2010.03.004 · Cited by 64
DeepNeuro: an open-source deep learning toolbox for neuroimaging
Beers, A. L., Brown, J. M., Chang, K., Hoebel, K., Patel, J., Ly, K. I., Tolaney, S. M., Brastianos, P. K., Rosen, B. R., Gerstner, E. R., et al. (2020) · Neuroinformatics · doi:10.1007/s12021-020-09477-5 · Cited by 52
Measurement of Cortical Thickness in 3D Brain MRI Data: Validation of the Laplacian Method
Haidar, H., & Soul, J. S. (2006) · Journal of Neuroimaging · doi:10.1111/j.1552-6569.2006.00036.x · Cited by 51
CompNet: Complementary Segmentation Network for Brain MRI Extraction
Dey, R., & Hong, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00931-1_72 · Cited by 51
Cortical reconstruction using implicit surface evolution: Accuracy and precision analysis
Tosun, D., Rettmann, M. E., Naiman, D. Q., Resnick, S. M., Kraut, M. A., & Prince, J. L. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.08.061 · Cited by 40
Imperfect Segmentation Labels: How Much Do They Matter?
Heller, N. E., Dean, J., & Papanikolopoulos, N. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01364-6_13 · Cited by 34
Brain extraction from normal and pathological images: A joint PCA/Image-Reconstruction approach
Han, X., Kwitt, R., Aylward, S., Bakas, S., Menze, B. H., Asturias, A., Vespa, P. M., Horn, J. D. V., & Niethammer, M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.04.073 · Cited by 32
Zhao, L., Ruotsalainen, U., Hirvonen, J., Hietala, J. A., & Tohka, J. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.02.001 · Cited by 30
Leote, J., Nunes, R. G., Cerqueira, L. M. G., Loução, R., & Ferreira, H. A. (2018) · European Journal of Radiology Open · doi:10.1016/j.ejro.2018.01.002 · Cited by 13
Novosad, P., Collins, D. L., & Initiative, A. D. N. (2018) · Human Brain Mapping · doi:10.1002/hbm.24243 · Cited by 6
Cited by
M3T: three-dimensional Medical image classifier using Multi-plane and Multi-slice Transformer
Jang, J., & Hwang, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02006 · Cited by 133
Thakur, S., Doshi, J., Pati, S., Rathore, S., Sako, C., Bilello, M., Ha, S. M., Shukla, G., Flanders, A., Kotrotsou, A., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117081 · Cited by 84
Omega-3 fatty acids are associated with blood-brain barrier integrity in a healthy aging population
Barnes, S., Chowdhury, S., Gatto, N. M., Fraser, G. E., & Lee, G. J. (2021) · Brain and Behavior · doi:10.1002/brb3.2273 · Cited by 47
Lee, W.-K., Wu, C.-C., Lee, C.-C., Lu, C.-F., Yang, H.-C., Huang, T.-H., Lin, C.-Y., Chung, W.-Y., Wang, P.-S., Wu, H.-M., et al. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101911 · Cited by 35
2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data
Ottesen, J. A., Yi, D., Tong, E., Iv, M., Latysheva, A., Saxhaug, C., Jacobsen, K. D., Helland, Å., Emblem, K. E., Rubin, D. L., et al. (2023) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2022.1056068 · Cited by 32
Metadata
- Authors
- Isensee, F., Schell, M., Pflueger, I., Brugnara, G., Bonekamp, D., Neuberger, U., Wick, A., Schlemmer, H., Heiland, S., Wick, W., Bendszus, M., Maier‐Hein, K. H., & Kickingereder, P.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2019-08-12
- Volume
- 40
- Issue
- 17
- Pages
- 4952-4964
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W2968446587
- Cited by
- 722
- References
- 61
- FWCI
- 16.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.