Cross-modality deep feature learning for brain tumor segmentation
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Abstract Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from the RGB image data that are very widespread, the medical image data used in brain tumor segmentation are relatively scarce in terms of the data scale but contain the richer information in terms of the modality property. To this end, this paper proposes a novel cross-modality deep feature learning framework to segment brain tumors from the multi-modality MRI data. The core idea is to mine rich patterns across the multi-modality data to make up for the insufficient data scale. The proposed cross-modality deep feature learning framework consists of two learning processes: the cross-modality feature transition (CMFT) process and the cross-modality feature fusion (CMFF) process, which aims at learning rich feature representations by transiting knowledge across different modality data and fusing knowledge from different modality data, respectively. Comprehensive experiments are conducted on the BraTS benchmarks, which show that the proposed cross-modality deep feature learning framework can effectively improve the brain tumor segmentation performance when compared with the baseline methods and state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 1×
“…the input data from modality A and B , the cross-modality feature fusion To prevent the model from being heavily affected by the unbalance among different types of tumor areas, we follow [18] to calculate L seg ( S A ) , L seg ( S B ) , and L seg ( S F ) by the Dice Similarity Coefficient (DSC).”
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · arXiv · doi:10.48550/arxiv.1807.06521 · Cited by 6,261 · cited 1×
“Then, we compare our approach with the baseline models “Ours w/o MG” and “Ours w CA” which adopt the proposed cross-modality feature fusion branch but without using the mask-guided attention block or directly using the conventional attention block [21].”
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498
3D MRI Brain Tumor Segmentation Using Autoencoder Regularization
Myronenko, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11726-9_28 · Cited by 1,283
PiCANet: Learning Pixel-Wise Contextual Attention for Saliency Detection
Liu, N., Han, J., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00326 · Cited by 863
Self-citation2016 Fourth International Conference on 3D Vision (3DV)
(2016) · doi:10.1109/3dv40526.2016 · Cited by 855
On the Efficacy of Knowledge Distillation
Cho, J. H., & Hariharan, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00489 · Cited by 637
Recalibrating Fully Convolutional Networks With Spatial and Channel “Squeeze and Excitation” Blocks
Roy, A. G., Navab, N., & Wachinger, C. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2867261 · Cited by 534
Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge
Isensee, F., Kickingereder, P., Wick, W., Bendszus, M., & Maier-Hein, K. H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_25 · Cited by 527
Automatic Brain Tumor Segmentation Using Cascaded Anisotropic Convolutional Neural Networks
Wang, G., Li, W., Ourselin, S., & Vercauteren, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_16 · Cited by 517
Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentation
Kamnitsas, K., Bai, W., Ferrante, E., McDonagh, S., Sinclair, M., Pawlowski, N., Rajchl, M., Lee, M., Kainz, B., Rueckert, D., et al. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_38 · Cited by 434
Perceptual Adversarial Networks for Image-to-Image Transformation
Wang, C., Xu, C., Wang, C., & Tao, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2836316 · Cited by 381
Li, W., Wang, G., Fidon, L., Ourselin, S., Cardoso, M. J., & Vercauteren, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_28 · Cited by 336
Segmentation labels and radiomic features for the pre-operative scans of the TCGA-LGG collection
Bakas, S. (2024) · TIB Data Manager · doi:10.57702/9am8buow · Cited by 244
S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation
Chen, W., Liu, B., Peng, S., Sun, J., & Qiao, X. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11726-9_32 · Cited by 242
Large-Margin Multi-Modal Deep Learning for RGB-D Object Recognition
Wang, A., Lu, J., Cai, J., Cham, T.-J., & Wang, G. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2476655 · Cited by 153 · cited 1×
“In [15], Wang et al. proposed a large-margin multi-modal deep learning framework to discover the most discriminative features for each modality and harness the complementary relationship between different modalities.”
A Conditional Adversarial Network for Semantic Segmentation of Brain Tumor
Rezaei, M., Harmuth, K., Gierke, W., Kellermeier, T., Fischer, M., Yang, H., & Meinel, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_21 · Cited by 148
Deep Correlational Learning for Survival Prediction from Multi-modality Data
Yao, J., Zhu, X., Zhu, F., & Huang, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66185-8_46 · Cited by 124
Multi-modal deep feature learning for RGB-D object detection
Xu, X., Li, Y., Wu, G., & Luo, J. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.07.026 · Cited by 108
Pereira, S., Pinto, A. B., Amorim, J., Ribeiro, A., Alves, V., & Silva, C. A. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2918096 · Cited by 106
Deep Learning Based Multimodal Brain Tumor Diagnosis
Li, Y., & Shen, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_13 · Cited by 85
Attentive Linear Transformation for Image Captioning
Ye, S., Han, J., & Liu, N. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2855406 · Cited by 82
Self-citationTowards Uncertainty-Assisted Brain Tumor Segmentation and Survival Prediction
Jungo, A., McKinley, R., Meier, R., Knecht, U., Vera, L., Pérez-Beteta, J., Molina-García, D., Pérez-García, V. M., Wiest, R., & Reyes, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-75238-9_40 · Cited by 69
Brain Tumor Segmentation Using Dense Fully Convolutional Neural Network
Shaikh, M., Anand, G., Acharya, G., Amrutkar, A., Alex, V., & Krishnamurthi, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_27 · Cited by 68
Xu, T.-B., Yang, P., Zhang, X.-Y., & Liu, C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.10.029 · Cited by 66
Scalable Multimodal Convolutional Networks for Brain Tumour Segmentation
Fidon, L., Li, W., Garcia-Peraza-Herrera, L. C., Ekanayake, J., Kitchen, N., Ourselin, S., & Vercauteren, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_33 · Cited by 60 · cited 1×
“Realizing this issue, Fidon et al. [10] proposed a multi-modal convolutional network for brain tumor segmentation, where nested network structure was designed to explicitly leverage deep features within or across modalities.”
Cascaded V-Net Using ROI Masks for Brain Tumor Segmentation
Casamitjana, A., Catà, M., Sánchez, I., Combalia, M., & Vilaplana, V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_33 · Cited by 58
Brain Tumor Segmentation Using a 3D FCN with Multi-scale Loss
Jesson, A., & Arbel, T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_34 · Cited by 57
Dilated Convolutions for Brain Tumor Segmentation in MRI Scans
López, M. M., & Ventura, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_22 · Cited by 55
Spatiotemporal distilled dense-connectivity network for video action recognition
Hao, W., & Zhang, Z. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.03.005 · Cited by 55
3D shape recognition and retrieval based on multi-modality deep learning
Bu, S., Wang, L., Han, P., Liu, Z., & Li, K. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.06.088 · Cited by 49
Context Aware 3D CNNs for Brain Tumor Segmentation
Chandra, S., Vakalopoulou, M., Fidon, L., Battistella, E., Estienne, T., Sun, R., Robert, C., Deutsch, É., & Paragios, N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11726-9_27 · Cited by 49
Conditional Adversarial Network for Semantic Segmentation of Brain TumorPreprint
Rezaei, M., Harmuth, K., Gierke, W., Kellermeier, T., Fischer, M., Yang, H., & Meinel, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05227 · Cited by 41
No New-NetPreprint
Isensee, F., Kickingereder, P., Wick, W., et al. (2018) · arXiv (Cornell University) · Cited by 39
Hu, Y., & Xia, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_36 · Cited by 37
Multimodal Brain Tumor Segmentation Using Cascaded V-Nets
Hua, R., Huo, Q., Gao, Y., Sun, Y., & Shi, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11726-9_5 · Cited by 37
Multi-modal PixelNet for Brain Tumor Segmentation
Islam, M., & Ren, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_26 · Cited by 32
Volumetric multimodality neural network for brain tumor segmentation
Monroy, L. C. R., Castillo, L. S., Daza, L. A., & Arbeláez, P. (2017) · International Symposium on Medical Information Processing and Analysis (SIPAIM) · doi:10.1117/12.2285942 · Cited by 29
Ma, J., & Yang, X. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11726-9_3 · Cited by 22
Global Planar Convolutions for Improved Context Aggregation in Brain Tumor Segmentation
Puch, S., Sánchez, I., Hernández-Sabaté, A., Piella, G., & Prčkovska, V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11726-9_35 · Cited by 15
Brain Tumor Segmentation and Parsing on MRIs Using Multiresolution Neural Networks
Castillo, L. S., Daza, L. A., Monroy, L. C. R., & Arbeláez, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75238-9_29 · Cited by 13
Cited by
nnFormer: Volumetric Medical Image Segmentation via a 3D Transformer
Zhou, H.-Y., Guo, J., Zhang, Y., Han, X., Yu, L., Wang, L., & Yu, Y. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3293771 · Cited by 735
Self-citationRanjbarzadeh, R., Bagherian Kasgari, A., Jafarzadeh Ghoushchi, S., Anari, S., Naseri, M., & Bendechache, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-90428-8 · Cited by 634
Deep Industrial Image Anomaly Detection: A Survey
Liu, J., Xie, G., Wang, J., Li, S., Wang, C., Zheng, F., & Jin, Y. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1459-z · Cited by 463
Deep learning based brain tumor segmentation: a survey
Liu, Z., Tong, L., Chen, L., Jiang, Z., Zhou, F., Zhang, Q., Zhang, X., Jin, Y., & Zhou, H. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-022-00815-5 · Cited by 402
Self-citationCross-level Feature Aggregation Network for Polyp Segmentation
Zhou, T., Zhou, Y., He, K., Gong, C., Yang, J., Fu, H., & Shen, D. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109555 · Cited by 347
Metadata
- Authors
- Zhang, D., Huang, G., Zhang, Q., Han, J., Han, J., & Yu, Y.
- Venue
- Pattern Recognition
- Publisher
- Elsevier BV
- Published
- 2021-02
- Volume
- 110
- Pages
- 107562
- ISSN
- 0031-3203 (ISSN-L)
- OpenAlex
- W3044256341
- Cited by
- 292
- References
- 47
- FWCI
- 13.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.