The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Causality-Inspired Single-Source Domain Generalization for Medical Image Segmentation
Open accessAbstract
Deep learning models usually suffer from the domain shift issue, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a deep network that is robust to unseen domains, under the condition that training data are only available from one source domain, which is common in medical imaging applications. We tackle this problem in the context of cross-domain medical image segmentation. In this scenario, domain shifts are mainly caused by different acquisition processes. We propose a simple causality-inspired data augmentation approach to expose a segmentation model to synthesized domain-shifted training examples. Specifically, 1) to make the deep model robust to discrepancies in image intensities and textures, we employ a family of randomly-weighted shallow networks. They augment training images using diverse appearance transformations. 2) Further we show that spurious correlations among objects in an image are detrimental to domain robustness. These correlations might be taken by the network as domain-specific clues for making predictions, and they may break on unseen domains. We remove these spurious correlations via causal intervention. This is achieved by resampling the appearances of potentially correlated objects independently. The proposed approach is validated on three cross-domain segmentation scenarios: cross-modality (CT-MRI) abdominal image segmentation, cross-sequence (bSSFP-LGE) cardiac MRI segmentation, and cross-site prostate MRI segmentation. The proposed approach yields consistent performance gains compared with competitive methods when tested on unseen domains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
de Boor, C. (1978) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-6333-3 · Cited by 11,944
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
UNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
Self-citationArbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Supervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569 · cited 1×
“Some most recent works such as [39] employ multiple techniques: data augmentation [40], adversarial training [41] and contrastive learning [42].”
BackgroundA theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515 · cited 2×
“Unsupervised domain adaptation (UDA) transfers a model trained on a source domain to a target domain using unlabeled target-domain data [9].”
BackgroundVirtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
Miyato, T., Maeda, S.-I., Koyama, M., & Ishii, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858821 · Cited by 2,843
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719 · cited 3×
“1Image adapted from [12] under the terms of Creative Commons Attribution License.”
BackgroundMethodUnsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-training
Zou, Y., Yu, Z., Vijaya Kumar, B. V. K., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_18 · Cited by 1,464 · cited 2×
“Existing techniques are mainly based on distribution alignment [16], [19], or self-training [20].”
BackgroundThe Medical Segmentation Decathlon
Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B. A., Litjens, G., Menze, B., Ronneberger, O., Summers, R. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30695-9 · Cited by 1,384 · cited 1×
“DEEP learning based medical image segmentation approaches [1], [2], [3], [4], [5], [6] usually achieve state-of-the-art performance when being trained and tested on datasets from a single domain, i.”
BackgroundArjovsky, M., Bottou, L., Gulrajani, I., & Lopez-Paz, D. (2019) · arXiv · doi:10.48550/arxiv.1907.02893 · Cited by 927
Evaluation of prostate segmentation algorithms for mri: The promise12 challenge
Litjens, G., Toth, R., van de Ven, W., Hoeks, C., Kerkstra, S., van Ginneken, B., Vincent, G., Guillard, G., Birbeck, N., Zhang, J., et al. (2014) · Medical Image Analysis · doi:10.1016/j.media.2013.12.002 · Cited by 857
CHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation
Kavur, A. E., Gezer, N. S., Barış, M., Aslan, S., Conze, P.-H., Groza, V., Pham, D. D., Chatterjee, S., Ernst, P., Özkan, S., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101950 · Cited by 815
Domain Generalization by Solving Jigsaw Puzzles
Carlucci, F. M., D'Innocente, A., Bucci, S., Caputo, B., & Tommasi, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00233 · Cited by 813
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771
Zhang, L., Wang, X., Yang, D., Sanford, T., Harmon, S., Turkbey, B., Wood, B. J., Roth, H., Myronenko, A., Xu, D., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2973595 · Cited by 542
Self-challenging Improves Cross-Domain Generalization
Huang, Z., Wang, H., Xing, E. P., & Huang, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_8 · Cited by 530
Unsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks
Kamnitsas, K., Baumgartner, C., Ledig, C., Newcombe, V., Simpson, J., Kane, A., Menon, D., Nori, A., Criminisi, A., Rueckert, D., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_47 · Cited by 468
Self-citationLearning to Learn Single Domain Generalization
Qiao, F., Zhao, L., & Peng, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01257 · Cited by 455
Episodic Training for Domain Generalization
Li, D., Zhang, J., Yang, Y., Liu, C., Song, Y.-Z., & Hospedales, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00153 · Cited by 435
Causality matters in medical imaging
Castro, D. C., Walker, I., & Glocker, B. (2020) · Nature Communications · doi:10.1038/s41467-020-17478-w · Cited by 364
Causal Intervention for Weakly-Supervised Semantic Segmentation
Zhang, D., Zhang, H., Tang, J., Hua, X., & Sun, Q. (2020) · arXiv · doi:10.48550/arxiv.2009.12547 · Cited by 353 · cited 4×
“[15], as both works study the adverse effect of confoundings among objects in image segmentation.”
BackgroundInfluentialLemaître, G., Martí, R., Freixenet, J., Vilanova, J. C., Walker, P. M., & Meriaudeau, F. (2015) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2015.02.009 · Cited by 348
Multimodal MR Synthesis via Modality-Invariant Latent Representation
Chartsias, A., Joyce, T., Giuffrida, M. V., & Tsaftaris, S. A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2764326 · Cited by 341
Dou, Q., Ouyang, C., Chen, C., Chen, H., & Heng, P.-A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/96 · Cited by 326
Self-citationLearning to Diversify for Single Domain Generalization
Wang, Z., Luo, Y., Qiu, R., Huang, Z., & Baktashmotlagh, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00087 · Cited by 284
Segmentation Outside the Cranial Vault Challenge
harrigr (2015) · Synapse · doi:10.7303/syn3193805 · Cited by 259
Self-supervision with Superpixels: Training Few-Shot Medical Image Segmentation Without Annotation
Ouyang, C., Biffi, C., Chen, C., Kart, T., Qiu, H., & Rueckert, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58526-6_45 · Cited by 248
Self-citationShape-Aware Meta-learning for Generalizing Prostate MRI Segmentation to Unseen Domains
Liu, Q., Dou, Q., & Heng, P.-A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59713-9_46 · Cited by 209
Progressive Domain Expansion Network for Single Domain Generalization
Li, L., Gao, K., Cao, J., Huang, Z., Weng, Y., Mi, X., Yu, Z., Li, X., & Xia, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00029 · Cited by 197
Test-time adaptable neural networks for robust medical image segmentation
Karani, N., Erdil, E., Chaitanya, K., & Konukoglu, E. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101907 · Cited by 185
Learning to Balance Specificity and Invariance for In and Out of Domain Generalization
Chattopadhyay, P., Balaji, Y., & Hoffman, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_18 · Cited by 168
Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?
Giryes, R., Sapiro, G., & Bronstein, A. M. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2546221 · Cited by 161
Realistic Adversarial Data Augmentation for MR Image Segmentation
Chen, C., Qin, C., Qiu, H., Ouyang, C., Wang, S., Chen, L., Tarroni, G., Bai, W., & Rueckert, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_65 · Cited by 141
Self-citationZhuang, X., Xu, J., Luo, X., Chen, C., Ouyang, C., Rueckert, D., Campello, V. M., Lekadir, K., Vesal, S., Ravikumar, N., et al. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102528 · Cited by 135
Self-citationSource-free domain adaptation for image segmentation
Bateson, M., Kervadec, H., Dolz, J., Lombaert, H., & Ayed, I. B. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102617 · Cited by 131
Data Efficient Unsupervised Domain Adaptation For Cross-modality Image Segmentation
Ouyang, C., Kamnitsas, K., Biffi, C., Duan, J., & Rueckert, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32245-8_74 · Cited by 113
Self-citationSemi-supervised Meta-learning with Disentanglement for Domain-Generalised Medical Image Segmentation
Liu, X., Thermos, S., O’Neil, A. Q., & Tsaftaris, S. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87196-3_29 · Cited by 87
AirLab: Autograd Image Registration LaboratoryPreprint
Sandkühler, R., Jud, C., Andermatt, S., & Cattin, P. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09907 · Cited by 84
Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effects
Glocker, B., Robinson, R., Castro, D. C., Dou, Q., & Konukoglu, E. (2019) · arXiv · doi:10.48550/arxiv.1910.04597 · Cited by 74
Cooperative Training and Latent Space Data Augmentation for Robust Medical Image Segmentation
Chen, C., Hammernik, K., Ouyang, C., Qin, C., Bai, W., & Rueckert, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87199-4_14 · Cited by 43
Self-citationDomain Composition and Attention for Unseen-Domain Generalizable Medical Image Segmentation
Gu, R., Zhang, J., Huang, R., Lei, W., Wang, G., & Zhang, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87199-4_23 · Cited by 37
Limitations of Post-Hoc Feature Alignment for Robustness
Burns, C., & Steinhardt, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00255 · Cited by 15
Generalize Ultrasound Image Segmentation Via Instant And Plug & Play Style Transfer
Liu, Z., Huang, X., Yang, X., et al. (2021) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9433930 · Cited by 9
Cited by
Generalizing to unseen domains: A survey on domain generalization
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178128 · Cited by 1,046
Data drift in medical machine learning: implications and potential remedies
Sahiner, B., Chen, W., Samala, R. K., & Petrick, N. (2023) · The British Journal of Radiology · doi:10.1259/bjr.20220878 · Cited by 279
Metadata
- Authors
- Ouyang, C., Chen, C., Li, S., Li, Z., Qin, C., Bai, W., & Rueckert, D.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2023-04
- Volume
- 42
- Issue
- 4
- Pages
- 1095-1106
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W4225673956
- Cited by
- 260
- References
- 53
- FWCI
- 16.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.