The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation
Open accessAbstract
Recently, dense connections have attracted substantial attention in computer vision because they facilitate gradient flow and implicit deep supervision during training. Particularly, DenseNet that connects each layer to every other layer in a feed-forward fashion and has shown impressive performances in natural image classification tasks. We propose HyperDenseNet, a 3-D fully convolutional neural network that extends the definition of dense connectivity to multi-modal segmentation problems. Each imaging modality has a path, and dense connections occur not only between the pairs of layers within the same path but also between those across different paths. This contrasts with the existing multi-modal CNN approaches, in which modeling several modalities relies entirely on a single joint layer (or level of abstraction) for fusion, typically either at the input or at the output of the network. Therefore, the proposed network has total freedom to learn more complex combinations between the modalities, within and in-between all the levels of abstraction, which increases significantly the learning representation. We report extensive evaluations over two different and highly competitive multi-modal brain tissue segmentation challenges, iSEG 2017 and MRBrainS 2013, with the former focusing on six month infant data and the latter on adult images. HyperDenseNet yielded significant improvements over many state-of-the-art segmentation networks, ranking at the top on both benchmarks. We further provide a comprehensive experimental analysis of features re-use, which confirms the importance of hyper-dense connections in multi-modal representation learning. Our code is publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311
Statistical Parametric Mapping: The Analysis of Functional Brain Images
Penny, W. D., Friston, K. J., Ashburner, J., Kiebel, S. J., & Thomas, N. (2007) · UCL Discovery (University College London) · Cited by 3,656
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 4×
“inference, as in [5] and [26].”
BackgroundMethodInfluentialDeep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104
Multimodal Learning with Deep Boltzmann Machines
Srivastava, N., & Salakhutdinov, R. (2012) · Journal of Machine Learning Research · doi:10.5555/2627435.2697059 · Cited by 1,806
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Automatic Segmentation of MR Brain Images With a Convolutional Neural Network
Moeskops, P., Viergever, M. A., Mendrik, A. M., de Vries, L. S., Benders, M. J. N. L., & Isgum, I. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2548501 · Cited by 861
Deep convolutional neural networks for multi-modality isointense infant brain image segmentation
Zhang, W., Li, R., Deng, H., Wang, L., Lin, W., Ji, S., & Shen, D. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.061 · Cited by 817
VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images
Chen, H., Dou, Q., Yu, L., Qin, J., & Heng, P.-A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.041 · Cited by 768
FractalNet: Ultra-Deep Neural Networks without Residuals
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07648 · Cited by 586
Understanding intermediate layers using linear classifier probes
Alain, G., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1610.01644 · Cited by 581
Unsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks
Kamnitsas, K., Baumgartner, C., Ledig, C., Newcombe, V., Simpson, J., Kane, A., Menon, D., Nori, A., Criminisi, A., Rueckert, D., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_47 · Cited by 468
3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study
Dolz, J., Desrosiers, C., & Ben Ayed, I. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.039 · Cited by 414
Self-citationValverde, S., Cabezas, M., Roura, E., González-Villà, S., Pareto, D., Vilanova, J. C., Ramió-Torrentà, L., Rovira, À., Oliver, A., & Lladó, X. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.034 · Cited by 392
HeMIS: Hetero-Modal Image Segmentation
Havaei, M., Guizard, N., Chapados, N., & Bengio, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_54 · Cited by 332 · cited 2×
“They achieved state-of-the-art performances in a broad range of medical image segmentation problems [36], [37], including multimodal tasks [14]–[16], [25]–[27], [29], [32], [33], [38], [39].”
BackgroundAutomatic segmentation of MR images of the developing newborn brain
Prastawa, M., Gilmore, J. H., Lin, W., & Gerig, G. (2005) · Medical Image Analysis · doi:10.1016/j.media.2005.05.007 · Cited by 332
Interleaved Group Convolutions
Zhang, T., Qi, G.-J., Xiao, B., & Wang, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.469 · Cited by 323
Fully convolutional networks for multi-modality isointense infant brain image segmentation
Nie, D., Wang, L., Gao, Y., & Shen, D. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493515 · Cited by 304
MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans
Mendrik, A. M., Vincken, K. L., Kuijf, H. J., Breeuwer, M., Bouvy, W. H., de Bresser, J., Alansary, A., de Bruijne, M., Carass, A., El-Baz, A., et al. (2015) · Computational Intelligence and Neuroscience · doi:10.1155/2015/813696 · Cited by 261
Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation
Stollenga, M. F., Byeon, W., Liwicki, M., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1506.07452 · Cited by 244
Segmentation of multiple sclerosis lesions in brain MRI: A review of automated approaches
Lladó, X., Oliver, A., Cabezas, M., Freixenet, J., Vilanova, J. C., Quiles, A., Valls, L., Ramió-Torrentà, L., & Rovira, À. (2012) · Information Sciences · doi:10.1016/j.ins.2011.10.011 · Cited by 240
Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets
Yu, L., Cheng, J.-Z., Dou, Q., Yang, X., Chen, H., Qin, J., & Heng, P.-A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8_33 · Cited by 215
Automatic segmentation of newborn brain MRI
Weisenfeld, N. I., & Warfield, S. K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.068 · Cited by 200
Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge
Wang, L., Nie, D., Li, G., Puybareau, E., Dolz, J., Zhang, Q., Wang, F., Xia, J., Wu, Z., Chen, J.-W., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901712 · Cited by 196
Self-citationA review on automatic fetal and neonatal brain MRI segmentation
Makropoulos, A., Counsell, S. J., & Rueckert, D. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.06.074 · Cited by 189
Yu, H., Caldwell, C., Mah, K., & Mozeg, D. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.2004425 · Cited by 184
Segmentation of neonatal brain MR images using patch-driven level sets
Wang, L., Shi, F., Li, G., Gao, Y., Lin, W., Gilmore, J. H., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.008 · Cited by 174
Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images
Ju, W., Xiang, D., Zhang, B., Wang, L., Kopriva, I., & Chen, X. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2488902 · Cited by 168
Optimal Co-Segmentation of Tumor in PET-CT Images With Context Information
Song, Q., Bai, J., Han, D., Bhatia, S. K., Sun, W., Rockey, W. M., Bayouth, J. E., Buatti, J. M., & Wu, X. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2263388 · Cited by 156
Reijmer, Y. D., Leemans, A., Brundel, M., Kappelle, L. J., Biessels, G. J., & on behalf of the Utrecht Vascular Cognitive Impairment (VCI) Study Group (2013) · Diabetes · doi:10.2337/db12-1644 · Cited by 150
A review on brain structures segmentation in magnetic resonance imaging
González-Villà, S., Oliver, A., Valverde, S., Wang, L., Reyer Zwiggelaar, A., & Lladó, X. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.09.001 · Cited by 142
Hybrid Imaging (SPECT/CT and PET/CT): Improving Therapeutic Decisions
Delbeke, D., Schöder, H. M., Martin, W. H., & Wahl, R. L. (2009) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2009.03.002 · Cited by 138
Automatic segmentation of neonatal images using convex optimization and coupled level sets
Wang, L., Shi, F., Lin, W., Gilmore, J. H., & Shen, D. G. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.064 · Cited by 132
Concurrent multimodality image segmentation by active contours for radiotherapy treatment planninga)
Naqa, I. E., Yang, D., Apte, A., Khullar, D., Mutic, S., Zheng, J., Bradley, J. D., Grigsby, P. W., & Deasy, J. O. (2007) · Medical Physics · doi:10.1118/1.2799886 · Cited by 123
Multi-scale 3D convolutional neural networks for lesion segmentation in brain MRI
Kamnitsas, K., Chen, L., Ledig, C., Rueckert, D., & Glocker, B. (2015) · Spiral (Imperial College London) · Cited by 108
Wang, L., Shi, F., Gao, Y., Li, G., Gilmore, J. H., Lin, W., & Shen, D. G. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.040 · Cited by 107
Globally Optimal Tumor Segmentation in PET-CT Images: A Graph-Based Co-segmentation Method
Han, D., Bayouth, J., Song, Q., Taurani, A., Sonka, M., Buatti, J., & Wu, X. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-22092-0_21 · Cited by 99
Esophagus segmentation in CT via 3D fully convolutional neural network and random walk
Fechter, T., Adebahr, S., Baltas, D., Ayed, I. B., Desrosiers, C., & Dolz, J. (2017) · Medical Physics · doi:10.1002/mp.12593 · Cited by 83
Self-citationAdaPT: An adaptive preterm segmentation algorithm for neonatal brain MRI
Cardoso, M. J., Melbourne, A., Kendall, G. S., Marc Modat, A., Robertson, N. J., Marlow, N., & Sebastien Ourselin, A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.009 · Cited by 80
H-DenseUNet: Hybrid Densely Connected UNet for Liver and Liver Tumor Segmentation from CT VolumesPreprint
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C., & Heng, P. (2017) · arXiv (Cornell University) · Cited by 78
Probabilistic Brain Tissue Segmentation in Neonatal Magnetic Resonance Imaging
Anbeek, P., Vincken, K. L., Groenendaal, F., Koeman, A., van Osch, M. J. P., & van der Grond, J. (2008) · Pediatric Research · doi:10.1203/pdr.0b013e31815ed071 · Cited by 70
DLTK: State of the Art Reference Implementations for Deep Learning on Medical ImagesPreprint
Pawlowski, N., Ktena, S. I., Lee, M. C. H., Kainz, B., Rueckert, D., Glocker, B., & Rajchl, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.06853 · Cited by 65
Deoni, S., Rutt, B. K., Parrent, A. G., & Peters, T. M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.016 · Cited by 64
Scalable Multimodal Convolutional Networks for Brain Tumour Segmentation
Fidon, L., Li, W., Garcia-Peraza-Herrera, L. C., Ekanayake, J., Kitchen, N., Ourselin, S., & Vercauteren, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_33 · Cited by 60
Isointense infant brain segmentation with a hyper-dense connected convolutional neural network
Dolz, J., Ayed, I. B., Yuan, J. Y., & Desrosiers, C. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363651 · Cited by 30
Self-citationSegmentation of Newborn Brain MRI
Weisenfeld, N., Mewes, A. U. J., & Warfield, S. K. (2006) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2006.1625029 · Cited by 25
MRI Tumor Segmentation with Densely Connected 3D CNNPreprint
Chen, L., Wu, Y., DSouza, A. M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.02427 · Cited by 20
Regularization of convolutional neural networks using ShuffleNode
Chen, Y., Wang, H., & Long, Y. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019402 · Cited by 8
Cited by
A review: Deep learning for medical image segmentation using multi-modality fusion
Zhou, T., Ruan, S., & Canu, S. (2019) · Array · doi:10.1016/j.array.2019.100004 · Cited by 656
Zhu, Z., He, X., Qi, G., Li, Y., Cong, B., & Liu, Y. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.10.022 · Cited by 592
Multi-Scale Self-Guided Attention for Medical Image Segmentation
Sinha, A., & Dolz, J. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2986926 · Cited by 570
Self-citationTransMed: Transformers Advance Multi-Modal Medical Image Classification
Dai, Y., Gao, Y., & Liu, F. (2021) · Diagnostics · doi:10.3390/diagnostics11081384 · Cited by 467
A survey of the vision transformers and their CNN-transformer based variants
Khan, A., Rauf, Z., Sohail, A., Khan, A. R., Asif, H., Asif, A., & Farooq, U. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10595-0 · Cited by 451
Metadata
- Authors
- Dolz, J., Gopinath, K., Yuan, J., Lombaert, H., Desrosiers, C., & Ben Ayed, I.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-05
- Volume
- 38
- Issue
- 5
- Pages
- 1116-1126
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2766785165
- Cited by
- 580
- References
- 61
- FWCI
- 25.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.