The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation
Open accessAbstract
Unsupervised domain adaptation has increasingly gained interest in medical image computing, aiming to tackle the performance degradation of deep neural networks when being deployed to unseen data with heterogeneous characteristics. In this work, we present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA), to effectively adapt a segmentation network to an unlabeled target domain. Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives. In particular, we simultaneously transform the appearance of images across domains and enhance domain-invariance of the extracted features by leveraging adversarial learning in multiple aspects and with a deeply supervised mechanism. The feature encoder is shared between both adaptive perspectives to leverage their mutual benefits via end-to-end learning. We have extensively evaluated our method with cardiac substructure segmentation and abdominal multi-organ segmentation for bidirectional cross-modality adaptation between MRI and CT images. Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images, and outperforms the state-of-the-art domain adaptation approaches by a large margin.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 1×
“DEEP neural networks have achieved great success, when a large amount of labelled data are available and the training and testing data are drawn from the same distribution [1]–[3].”
BackgroundDomain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
Deep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656 · cited 9×
“Compared with CyCADA, our method achieved superior performance, demonstrating the effectiveness of our synergistic learning framework in unleashing the mutual bene-fits of image and feature alignments.”
BackgroundMethodInfluentialLearning from Simulated and Unsupervised Images through Adversarial Training
Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.241 · Cited by 1,814
Yu, F., Koltun, V., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.75 · Cited by 1,804
Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
Bousmalis, K., Silberman, N., Dohan, D., Erhan, D., & Krishnan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.18 · Cited by 1,603 · cited 2×
“at the input level to networks, by transforming the source images to appear like the target ones or vice versa [9], [11],”
BackgroundMethodLearning to Adapt Structured Output Space for Semantic Segmentation
Tsai, Y.-H., Hung, W.-C., Schulter, S., Sohn, K., Yang, M.-H., & Chandraker, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00780 · Cited by 1,430
Domain-adversarial training of neural networks
GaninYaroslav, UstinovaEvgeniya, AjakanHana, GermainPascal, LarochelleHugo, LavioletteFrançois, MarchandMario, & LempitskyVictor (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.2946704 · Cited by 1,201
On standardizing the MR image intensity scale
Ny�l, L. G., & Udupa, J. K. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199912)42:6<1072::aid-mrm11>3.0.co;2-m · Cited by 583
Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI
Zhuang, X., & Shen, J. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.02.006 · Cited by 502
Learning from Synthetic Data: Addressing Domain Shift for Semantic Segmentation
Sankaranarayanan, S., Balaji, Y., Jain, A., Lim, S. N., & Chellappa, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00395 · Cited by 472
Unsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks
Kamnitsas, K., Baumgartner, C., Ledig, C., Newcombe, V., Simpson, J., Kane, A., Menon, D., Nori, A., Criminisi, A., Rueckert, D., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_47 · Cited by 468
Zhang, Z., Yang, L., & Zheng, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00963 · Cited by 423
Domain Generalization via Model-Agnostic Learning of Semantic Features
Dou, Q., Castro, D. C., Kamnitsas, K., & Glocker, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13580 · Cited by 381
Self-citationFully Convolutional Adaptation Networks for Semantic Segmentation
Zhang, Y., Qiu, Z., Yao, T., Liu, D., & Mei, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00712 · Cited by 356
Chen, C., Dou, Q., Chen, H., Qin, J., & Heng, P.-A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301865 · Cited by 336
Self-citationDou, Q., Ouyang, C., Chen, C., Chen, H., & Heng, P.-A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/96 · Cited by 326
Self-citationPatch-Based Output Space Adversarial Learning for Joint Optic Disc and Cup Segmentation
Wang, S., Yu, L., Yang, X., Fu, C.-W., & Heng, P.-A. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2899910 · Cited by 293
Self-citationTransfer Learning Improves Supervised Image Segmentation Across Imaging Protocols
van Opbroek, A., Ikram, M. A., Vernooij, M. W., & de Bruijne, M. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2366792 · Cited by 253
Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation
Ghafoorian, M., Mehrtash, A., Kapur, T., Karssemeijer, N., Marchiori, E., Pesteie, M., Guttmann, C. R. G., de Leeuw, F.-E., Tempany, C. M., van Ginneken, B., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_59 · Cited by 253
SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth
Huo, Y., Xu, Z., Moon, H., Bao, S., Assad, A., Moyo, T. K., Savona, M. R., Abramson, R. G., & Landman, B. A. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2876633 · Cited by 237
From Source to Target and Back: Symmetric Bi-Directional Adaptive GAN
Russo, P., Carlucci, F. M., Tommasi, T., & Caputo, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00845 · Cited by 233
Unsupervised domain adaptation for medical imaging segmentation with self-ensembling
Perone, C. S., Ballester, P., Barros, R. C., & Cohen-Adad, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.03.026 · Cited by 221
Hiasa, Y., Otake, Y., Takao, M., Matsuoka, T., Takashima, K., Carass, A., Prince, J. L., Sugano, N., & Sato, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00536-8_4 · Cited by 221
Multi-label Whole Heart Segmentation Using CNNs and Anatomical Label Configurations
Payer, C., Štern, D., Bischof, H., & Urschler, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75541-0_20 · Cited by 213
Dou, Q., Ouyang, C., Chen, C., Chen, H., Glocker, B., Zhuang, X., & Heng, P.-A. (2019) · IEEE Access · doi:10.1109/access.2019.2929258 · Cited by 209
Self-citationZhang, Y., Miao, S., Mansi, T., & Liao, R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_67 · Cited by 204
Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation
Ghafoorian, M., Mehrtash, A., Kapur, T., Karssemeijer, N., Marchiori, E., Pesteie, M., Guttmann, C. R. G., Leeuw, F.-E. D., Tempany, C. M., van Ginneken, B., et al. (2017) · Radboud Repository (Radboud University) · Cited by 192
Tumor-Aware, Adversarial Domain Adaptation from CT to MRI for Lung Cancer Segmentation
Jiang, J., Hu, Y.-C., Tyagi, N., Zhang, P., Rimner, A., Mageras, G. S., Deasy, J. O., & Veeraraghavan, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_86 · Cited by 185
Adversarial Image Synthesis for Unpaired Multi-modal Cardiac Data
Chartsias, A., Joyce, T., Dharmakumar, R., & Tsaftaris, S. A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68127-6_1 · Cited by 172
Chen, C., Dou, Q., Chen, H., & Heng, P.-A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00919-9_17 · Cited by 159
Self-citationA Lifelong Learning Approach to Brain MR Segmentation Across Scanners and Protocols
Karani, N., Chaitanya, K., Baumgartner, C. F., & Konukoğlu, E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00928-1_54 · Cited by 151
Simulation and Synthesis in Medical Imaging
Frangi, A. F., Tsaftaris, S. A., & Prince, J. L. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2800298 · Cited by 125
Supervised Segmentation of Un-Annotated Retinal Fundus Images by Synthesis
Zhao, H., Li, H., Maurer‐Stroh, S., Guo, Y., Deng, Q., & Cheng, L. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2854886 · Cited by 119
Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images
Ren, J., Hacihaliloglu, I., Singer, E. A., Foran, D. J., & Qi, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_23 · Cited by 118
Unsupervised Domain Adaptation for Automatic Estimation of Cardiothoracic Ratio
Dong, N., Kampffmeyer, M., Liang, X., Wang, Z., Dai, W., & Xing, E. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_61 · Cited by 84
Inter-site Variability in Prostate Segmentation Accuracy Using Deep Learning
Gibson, E., Hu, Y., Ghavami, N., Ahmed, H. U., Moore, C. M., Emberton, M., Huisman, H. J., & Barratt, D. C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_58 · Cited by 81
Dual-core steered non-rigid registration for multi-modal images via bi-directional image synthesis
Cao, X., Yang, J., Gao, Y., Guo, Y., Guorong Wu, A., & Shen, D. G. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.05.004 · Cited by 78
Learning Cross-Modality Representations From Multi-Modal Images
van Tulder, G., & de Bruijne, M. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2868977 · Cited by 70
Learning without Labeling: Domain Adaptation for Ultrasound Transducer Localization
Heimann, T., Mountney, P., John, M., & Ionasec, R. I. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40760-4_7 · Cited by 48
Domain and Geometry Agnostic CNNs for Left Atrium Segmentation in 3D Ultrasound
Degel, M., Navab, N., & Albarqouni, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_72 · Cited by 47
Generalizing Deep Models for Ultrasound Image Segmentation
Yang, X., Dou, H., Li, R., Wang, X., Bian, C., Li, S., Ni, D., & Heng, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_57 · Cited by 37
Self-citationDeep Multi-Class Segmentation Without Ground-Truth Labels
Joyce, T. A., Chartsias, A., & Tsaftaris, S. A. (2018) · Cited by 37
Scalable Unsupervised Domain Adaptation for Electron Microscopy
Bermúdez-Chacón, R., Becker, C., Salzmann, M., & Fua, P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_38 · Cited by 27
Zhang, L., Pereañez, M., Piechnik, S. K., Neubauer, S., Petersen, S. E., & Frangi, A. F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_54 · Cited by 20
Cited by
Domain adaptation for medical image analysis: A survey
Guan, H., & Liu, M. (2022) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2021.3117407 · Cited by 1,057
Artificial intelligence and machine learning for medical imaging: A technology review
Barragán-Montero, A., Javaid, U., Valdés, G., Nguyen, D., Desbordes, P., Macq, B., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.016 · Cited by 450
Annotation-efficient deep learning for automatic medical image segmentation
Wang, S., Li, C., Wang, R., Liu, Z., Wang, M., Tan, H., Wu, Y., Liu, X., Sun, H., Yang, R., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-26216-9 · Cited by 312
A survey on incorporating domain knowledge into deep learning for medical image analysis
Xie, X., Niu, J., Liu, X., Chen, Z., Tang, S., & Yu, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101985 · Cited by 311
Toward data‐efficient learning: A benchmark for COVID‐19 CT lung and infection segmentation
Ma, J., Wang, Y., An, X., Ge, C., Yu, Z., Chen, J., Zhu, Q., Dong, G., He, J., He, Z., et al. (2021) · Medical Physics · doi:10.1002/mp.14676 · Cited by 261
Metadata
- Authors
- Chen, C., Dou, Q., Chen, H., Qin, J., & Heng, P. A.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-07
- Volume
- 39
- Issue
- 7
- Pages
- 2494-2505
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W3006040295
- Cited by
- 441
- References
- 54
- FWCI
- 23.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.