The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentation
Open accessAbstract
Methods based on convolutional neural networks have improved the performance of biomedical image segmentation. However, most of these methods cannot efficiently segment objects of variable sizes and train on small and biased datasets, which are common for biomedical use cases. While methods exist that incorporate multi-scale fusion approaches to address the challenges arising with variable sizes, they usually use complex models that are more suitable for general semantic segmentation problems. In this paper, we propose a novel architecture called Multi-Scale Residual Fusion Network (MSRF-Net), which is specially designed for medical image segmentation. The proposed MSRF-Net is able to exchange multi-scale features of varying receptive fields using a Dual-Scale Dense Fusion (DSDF) block. Our DSDF block can exchange information rigorously across two different resolution scales, and our MSRF sub-network uses multiple DSDF blocks in sequence to perform multi-scale fusion. This allows the preservation of resolution, improved information flow and propagation of both high- and low-level features to obtain accurate segmentation maps. The proposed MSRF-Net allows to capture object variabilities and provides improved results on different biomedical datasets. Extensive experiments on MSRF-Net demonstrate that the proposed method outperforms the cutting-edge medical image segmentation methods on four publicly available datasets. We achieve the Dice Coefficient (DSC) of 0.9217, 0.9420, and 0.9224, 0.8824 on Kvasir-SEG, CVC-ClinicDB, 2018 Data Science Bowl dataset, and ISIC-2018 skin lesion segmentation challenge dataset respectively. We further conducted generalizability tests and achieved DSC of 0.7921 and 0.7575 on CVC-ClinicDB and Kvasir-SEG, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
UNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Deep High-Resolution Representation Learning for Visual Recognition
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2983686 · Cited by 4,894
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation
Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., & Liang, J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2959609 · Cited by 4,402
Residual Dense Network for Image Super-Resolution
Zhang, Y., Tian, Y., Kong, Y., Zhong, B., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00262 · Cited by 4,168
Tschandl, P., Rosendahl, C., & Kittler, H. (2018) · Scientific Data · doi:10.1038/sdata.2018.161 · Cited by 3,628
Road Extraction by Deep Residual U-Net
Zhang, Z., Liu, Q., & Wang, Y. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2802944 · Cited by 3,179 · cited 4×
“We report a mIoU of 0.9043 ± 0.1009 and a recall of 0.9567 ± 0.0620, which is 1.44% improvement in mIoU and 2.82% improvement in recall over SOTA combination of ResUNet++ and conditional random field [57] and UACANet-S [35], respectively.”
MethodInfluentialLevin, B., Lieberman, D. A., McFarland, B., Andrews, K. S., Brooks, D., Bond, J., Dash, C., Giardiello, F. M., Glick, S., Johnson, D., et al. (2008) · Gastroenterology · doi:10.1053/j.gastro.2008.02.002 · Cited by 2,990
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentation
Ibtehaz, N., & Rahman, M. S. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.08.025 · Cited by 2,311
Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., & Vilariño, F. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.02.007 · Cited by 2,191
DenseASPP for Semantic Segmentation in Street Scenes
Yang, M., Yu, K., Zhang, C., Li, Z., & Yang, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00388 · Cited by 1,674
Kvasir-SEG: A Segmented Polyp Dataset
Jha, D., Smedsrud, P. H., Riegler, M. A., Halvorsen, P., de Lange, T., Johansen, D., & Johansen, H. D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-37734-2_37 · Cited by 1,661
Self-citationDeep Learning Techniques for Medical Image Segmentation: Achievements and Challenges
Hesamian, M. H., Jia, W., He, X., & Kennedy, P. (2019) · Journal of Digital Imaging · doi:10.1007/s10278-019-00227-x · Cited by 1,631
PraNet: Parallel Reverse Attention Network for Polyp Segmentation
Fan, D.-P., Ji, G.-P., Zhou, T., Chen, G., Fu, H., Shen, J., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59725-2_26 · Cited by 1,499
ResUNet++: An Advanced Architecture for Medical Image Segmentation
Jha, D., Smedsrud, P. H., Riegler, M. A., Johansen, D., Lange, T. D., Halvorsen, P., & D. Johansen, H. (2019) · 2019 IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism46123.2019.00049 · Cited by 1,330
Self-citationThe Importance of Skip Connections in Biomedical Image Segmentation
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., & Pal, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_19 · Cited by 984
Convolutional neural networks in medical image understanding: a survey
Sarvamangala, D. R., & Kulkarni, R. V. (2022) · Evolutionary Intelligence · doi:10.1007/s12065-020-00540-3 · Cited by 917
DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentation
Jha, D., Riegler, M. A., Johansen, D., Halvorsen, P., & Johansen, H. D. (2020) · 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms49503.2020.00111 · Cited by 819
Self-citationGated-SCNN: Gated Shape CNNs for Semantic Segmentation
Takikawa, T., Acuna, D., Jampani, V., & Fidler, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00533 · Cited by 813
Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl
Caicedo, J. C., Goodman, A., Karhohs, K. W., Cimini, B. A., Ackerman, J., Haghighi, M., Heng, C., Becker, T., Doan, M., McQuin, C., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0612-7 · Cited by 809
HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation
Dolz, J., Gopinath, K., Yuan, J., Lombaert, H., Desrosiers, C., & Ben Ayed, I. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2878669 · Cited by 580
Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal
Guan, S., Khan, A. A., Sikdar, S., & Chitnis, P. V. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2912935 · Cited by 538
Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning
Jha, D., Ali, S., Tomar, N. K., Johansen, H. D., Johansen, D., Rittscher, J., Riegler, M. A., & Halvorsen, P. (2021) · IEEE Access · doi:10.1109/access.2021.3063716 · Cited by 399
Self-citationJha, D., Smedsrud, P. H., Johansen, D., de Lange, T., Johansen, H. D., Halvorsen, P., & Riegler, M. A. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3049304 · Cited by 345
Self-citationInterleaved Group Convolutions
Zhang, T., Qi, G.-J., Xiao, B., & Wang, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.469 · Cited by 323
UACANet: Uncertainty Augmented Context Attention for Polyp Segmentation
Kim, T., Lee, H., & Kim, D. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475375 · Cited by 309
A survey on U-shaped networks in medical image segmentations
Liu, L., Cheng, J., Quan, Q., Wu, F.-X., Wang, Y.-P., & Wang, J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.070 · Cited by 286
SAUNet: Shape Attentive U-Net for Interpretable Medical Image Segmentation
Sun, J., Darbehani, F., Zaidi, M., & Wang, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59719-1_77 · Cited by 207
Focusnet: An Attention-Based Fully Convolutional Network for Medical Image Segmentation
Kaul, C., Manandhar, S., & Pears, N. E. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759477 · Cited by 206
Dermoscopy Image Analysis: Overview and Future Directions
Celebi, M. E., Codella, N., & Halpern, A. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2895803 · Cited by 201
Ali, S., Dmitrieva, M., Ghatwary, N., Bano, S., Polat, G., Temizel, A., Krenzer, A., Hekalo, A., Guo, Y. B., Matuszewski, B., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102002 · Cited by 169
Self-citationA multi-centre polyp detection and segmentation dataset for generalisability assessment
Ali, S., Jha, D., Ghatwary, N., Realdon, S., Cannizzaro, R., Salem, O. E., Lamarque, D., Daul, C., Riegler, M. A., Anonsen, K. V., et al. (2023) · Scientific Data · doi:10.1038/s41597-023-01981-y · Cited by 167
Self-citationXu, Z., Zhang, W., Zhang, T., & Li, J. (2020) · Remote Sensing · doi:10.3390/rs13010071 · Cited by 142
DDANet: Dual Decoder Attention Network for Automatic Polyp Segmentation
Tomar, N. K., Jha, D., Ali, S., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68793-9_23 · Cited by 137
Self-citationFeature Fusion Encoder Decoder Network for Automatic Liver Lesion Segmentation
Chen, X., Zhang, R., & Yan, P. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759555 · Cited by 94
The Missing Pieces of Artificial Intelligence in Medicine
Gilvary, C. M., Madhukar, N. S., Elkhader, J. A., & Elemento, O. (2019) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2019.06.001 · Cited by 92
ZigZagNet: Fusing Top-Down and Bottom-Up Context for Object Segmentation
Lin, D., Shen, D., Shen, S., Ji, Y., Lischinski, D., Cohen‐Or, D., & Huang, H. F. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00767 · Cited by 81
Polyp Segmentation with Fully Convolutional Deep Neural Networks—Extended Evaluation Study
Guo, Y., Bernal, J., & Matuszewski, B. J. (2020) · Journal of Imaging · doi:10.3390/jimaging6070069 · Cited by 72
Deep residual dense U-Net for resolution enhancement in accelerated MRI acquisition
Ding, P. L. K., Li, Z., Zhou, Y., & Li, B. (2019) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.2513158 · Cited by 42
Rad, R. M., Saeedi, P., Au, J., & Havelock, J. C. (2019) · IEEE Access · doi:10.1109/access.2019.2920933 · Cited by 38
Road Detection via Deep Residual Dense U-Net
Yang, X.-F., Li, X.-T., Ye, Y.-M., Zhang, X.-F., Zhang, H.-J., Huang, X., & Zhang, B. (2019) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn.2019.8851728 · Cited by 25
Metadata
- Authors
- Srivastava, A., Jha, D., Chanda, S., Pal, U., Johansen, H., Johansen, D., Riegler, M., Ali, S., & Halvorsen, P.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2022-05
- Volume
- 26
- Issue
- 5
- Pages
- 2252-2263
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W3162386519
- Cited by
- 318
- References
- 55
- FWCI
- 16.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.