The DOI matches its Crossref record; 45 of the 50 references it cites were found in a registry or an index.
Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation
Abstract
We propose a novel segmentation approach based on deep 3D convolutional encoder networks with shortcut connections and apply it to the segmentation of multiple sclerosis (MS) lesions in magnetic resonance images. Our model is a neural network that consists of two interconnected pathways, a convolutional pathway, which learns increasingly more abstract and higher-level image features, and a deconvolutional pathway, which predicts the final segmentation at the voxel level. The joint training of the feature extraction and prediction pathways allows for the automatic learning of features at different scales that are optimized for accuracy for any given combination of image types and segmentation task. In addition, shortcut connections between the two pathways allow high- and low-level features to be integrated, which enables the segmentation of lesions across a wide range of sizes. We have evaluated our method on two publicly available data sets (MICCAI 2008 and ISBI 2015 challenges) with the results showing that our method performs comparably to the top-ranked state-of-the-art methods, even when only relatively small data sets are available for training. In addition, we have compared our method with five freely available and widely used MS lesion segmentation methods (EMS, LST-LPA, LST-LGA, Lesion-TOADS, and SLS) on a large data set from an MS clinical trial. The results show that our method consistently outperforms these other methods across a wide range of lesion sizes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent techniques are proposed using 3D CNN to fully benefit from the available information [89] [90].”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [89]
In the citing paper
“Semantic-wise architectures also are more susceptible to class imbalance but this can be solved by weighting the classes in the loss function [31].”
From Deep learning for brain MRI segmentation: state of the art and future directions (2017) · cites this paper as [31]
In the citing paper
“They reported performance comparable to the state of the art methods and superior to the publicly available MS segmentation methods.”
From Deep learning for brain MRI segmentation: state of the art and future directions (2017) · cites this paper as [31]
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2010) · International Conference on Machine Learning · Cited by 13,995
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 12,187
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
(2010) · Cited by 8,261
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 5,299
(2013) · Cited by 3,740
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
cuDNN: Efficient Primitives for Deep LearningPreprint
Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J. J., Catanzaro, B., & Shelhamer, E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.0759 · Cited by 2,058
Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition
Scherer, D., Müller, A., & Behnke, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15825-4_10 · Cited by 1,603
Adaptive deconvolutional networks for mid and high level feature learning
Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126474 · Cited by 1,293
(2012) · neural information processing systems · Cited by 1,291
Torch7: A Matlab-like Environment for Machine Learning
Collobert, R., Kavukcuoglu, K., & Farabet, C. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,241
An automated tool for detection of FLAIR-hyperintense white-matter lesions in Multiple Sclerosis
Schmidt, P. J., Christian Gaser, B., Arsić, M., Buck, D., Förschler, A., Berthele, A., Hoshi, M., Ilg, R., Schmid, V. J., Zimmer, C., et al. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.032 · Cited by 1,219
Theano: new features and speed improvements
Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005
Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation
Coupé, P., Manjón, J. V., Fonov, V., Pruessner, J. C., Robles, M., & Collins, D. L. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.018 · Cited by 704
Automated segmentation of multiple sclerosis lesions by model outlier detection
Leemput, K. V., Maes, F., Vandermeulen, D., Colchester, A. C. F., & Suetens, P. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.938237 · Cited by 487
García-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D. L., & Collins, D. L. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.09.004 · Cited by 364
A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions
Shiee, N., Bazin, P., Ozturk, A., Reich, D., Calabresi, P., & Pham, D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.005 · Cited by 355
BET2 : MR-Based Estimation of Brain, Skull and Scalp Surfaces
Jenkinson, M. (2005) · Medical Entomology and Zoology · Cited by 348
Long-term subcutaneous interferon beta-1a therapy in patients with relapsing-remitting MS
Kappos, L., Traboulsee, A. L., Constantinescu, C. S., Erälinna, J.-P., Forrestal, F., Jongen, P. J. H., Pollard, J. D., Sandberg‐Wollheim, M., Sindic, C. J. M., Stubinski, B., et al. (2006) · Neurology · doi:10.1212/01.wnl.0000237994.95410.ce · Cited by 257
Self-citation(2015) · arXiv (Cornell University) · Cited by 182
3D Segmentation in the Clinic: A Grand Challenge II: MS lesion segmentation
Styner, M. A., Lee, J., Chin, B., Chin, M., Commowick, O., Tran, H.-H., Markovic‐Plese, S., Jewells, V. L., & Warfield, S. K. (2008) · doi:10.54294/lmkqvm · Cited by 180
Sudre, C. H., Cardoso, M. J., Bouvy, W. H., Biessels, G. J., Barnes, J., & Sebastien Ourselin, A. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2419072 · Cited by 165
Fully Convolutional Neural Networks for Crowd SegmentationPreprint
Kang, K., & Wang, X. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4464 · Cited by 130
Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation
Brosch, T., Yoo, Y., Tang, L. Y. W., Li, D. K. B., Traboulsee, A. L., & Tam, R. C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_1 · Cited by 127
Self-citationSpatial Decision Forests for MS Lesion Segmentation in Multi-Channel MR Images
Geremia, E., Menze, B. H., Olivier Clatz, A., Ender Konukoglu, A., Criminisi, A., & Ayache, N. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15705-9_14 · Cited by 99
A toolbox for multiple sclerosis lesion segmentation
Roura, E., Oliver, A., Cabezas, M., Valverde, S., Pareto, D., Vilanova, J. C., Ramió‐Torrentà, L., Rovira, À., & Lladó, X. (2015) · Neuroradiology · doi:10.1007/s00234-015-1552-2 · Cited by 95
Multiple Sclerosis Lesion Segmentation Using Dictionary Learning and Sparse Coding
Weiss, N., Rueckert, D., & Rao, A. W. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_92 · Cited by 84
Rotation-invariant multi-contrast non-local means for MS lesion segmentation
Guizard, N., Pierrick Coupé, A., Fonov, V., Manjón, J. V., Arnold, D. L., & Collins, D. L. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.05.001 · Cited by 73
Tomas-Fernandez, X., & Warfield, S. K. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2393853 · Cited by 73
Deep Learning of Image Features from Unlabeled Data for Multiple Sclerosis Lesion Segmentation
Yoo, Y., Brosch, T., Traboulsee, A. L., Li, D. K. B., & Tam, R. C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10581-9_15 · Cited by 61
Self-citationBrosch, T., & Tam, R. C. (2014) · Neural Computation · doi:10.1162/neco_a_00682 · Cited by 55
Self-citationCombining Unsupervised and Supervised Methods for Lesion Segmentation
Jerman, T., Galimzianova, A., Pernuš, F., Likar, B., & Špiclin, Ž. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-30858-6_5 · Cited by 18
Subbanna, N. K., Precup, D., Arnold, D. L., & Arbel, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19992-4_40 · Cited by 17
Traboulsee, A. L., AL-Sabbagh, A., Bennett, R. M., Chang, P., & Li, D. (2008) · BMC Neurology · doi:10.1186/1471-2377-8-11 · Cited by 10
Self-citation
Flagged first, then by citations
5 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- subbanna, 2009, MS lesion segmentation using Markov random fields, Proc MICCAI 2009 Workshop Med Image Anal Multiple Sclerosis, 1
- hochreiter, 1991, Untersuchungen zu dynamischen neuronalen Netzen
- maier, 2015, MS lesion segmentation in MRI with random forests, Proc 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, 1
- jesson, 2015, Hierarchical MRF and random forest segmentation of MS lesions and healthy tissues in brain MRI, Proc 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, 1
Cited by
Sorted by citations
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
Greenspan, H. K., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,725
Deep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J. P., & Lim, C. C. T. (2017) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,574
Metadata
- Authors
- Brosch, T., Tang, L. Y. W., Yoo, Y., Li, D. K. B., Traboulsee, A., & Tam, R.
- Affiliations
- University of British Columbia (CA)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-05
- Volume
- 35
- Issue
- 5
- Pages
- 1229-1239
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2342591535
- Cited by
- 460
- References
- 50
- Citations by year
- 2026: 4 · 2025: 24 · 2024: 32 · 2023: 42 · 2022: 50 · 2021: 63 · 2020: 63 · 2019: 67 · 2018: 54 · 2017: 46 · 2016: 14
- FWCI
- 40.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- multiple sclerosis lesion segmentation, skip connections, magnetic resonance imaging, lesion size
- MeSH terms
- Machine Learning, Algorithms, Brain, Humans, Image Interpretation, Computer-Assisted, Magnetic Resonance Imaging, Multiple Sclerosis, Neural Networks, Computer, Imaging, Three-Dimensional
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
