The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
End-to-End Adversarial Retinal Image Synthesis
Open accessAbstract
In medical image analysis applications, the availability of the large amounts of annotated data is becoming increasingly critical. However, annotated medical data is often scarce and costly to obtain. In this paper, we address the problem of synthesizing retinal color images by applying recent techniques based on adversarial learning. In this setting, a generative model is trained to maximize a loss function provided by a second model attempting to classify its output into real or synthetic. In particular, we propose to implement an adversarial autoencoder for the task of retinal vessel network synthesis. We use the generated vessel trees as an intermediate stage for the generation of color retinal images, which is accomplished with a generative adversarial network. Both models require the optimization of almost everywhere differentiable loss functions, which allows us to train them jointly. The resulting model offers an end-to-end retinal image synthesis system capable of generating as many retinal images as the user requires, with their corresponding vessel networks, by sampling from a simple probability distribution that we impose to the associated latent space. We show that the learned latent space contains a well-defined semantic structure, implying that we can perform calculations in the space of retinal images, e.g., smoothly interpolating new data points between two retinal images. Visual and quantitative results demonstrate that the synthesized images are substantially different from those in the training set, while being also anatomically consistent and displaying a reasonable visual quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Ridge-based vessel segmentation in color images of the retina
Staal, J., Abramoff, M. D., Niemeijer, M., Viergever, M. A., & van Ginneken, B. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.825627 · Cited by 4,202
Self-citationMutual-information-based registration of medical images: a survey
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815867 · Cited by 2,890
Design and construction of a realistic digital brain phantom
Collins, D. L., Zijdenbos, A. P., Kollokian, V., Sled, J. G., Kabani, N. J., Holmes, C. J., & Evans, A. C. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.712135 · Cited by 1,822
Learning from Simulated and Unsupervised Images through Adversarial Training
Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.241 · Cited by 1,814
FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE
Decencière, E., Zhang, X., Cazuguel, G., Lay, B., Cochener, B., Trone, C., Gain, P., Ordonez, R., Massin, P., Erginay, A., et al. (2014) · Image Analysis & Stereology · doi:10.5566/ias.1155 · Cited by 1,424
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106
A note on the evaluation of generative models
Theis, L., Oord, A. V. D., & Bethge, M. (2015) · arXiv · doi:10.48550/arxiv.1511.01844 · Cited by 1,026
Segmenting Retinal Blood Vessels WithDeep Neural Networks
Liskowski, P., & Krawiec, K. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2546227 · Cited by 890
Why is image quality assessment so difficult?
Wang, Z., Bovik, & Lu, L. (2002) · IIEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.1004620 · Cited by 786
THE PHYSIOLOGICAL PRINCIPLE OF MINIMUM WORK APPLIED TO THE ANGLE OF BRANCHING OF ARTERIES
Murray, C. D. (1926) · Journal of General Physiology · doi:10.1085/jgp.9.6.835 · Cited by 750
Medical Image Synthesis with Context-Aware Generative Adversarial Networks
Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_48 · Cited by 691
A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images
Li, Q., Feng, B., Xie, L., Liang, P., Zhang, H., & Wang, T. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2457891 · Cited by 571
Unsupervised Domain Adaptation in Brain Lesion Segmentation with Adversarial Networks
Kamnitsas, K., Baumgartner, C., Ledig, C., Newcombe, V., Simpson, J., Kane, A., Menon, D., Nori, A., Criminisi, A., Rueckert, D., et al. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_47 · Cited by 468
DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field
Fu, H., Xu, Y., Lin, S., Kee Wong, D. W., & Liu, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_16 · Cited by 453
Deep Retinal Image Understanding
Maninis, K.-K., Pont-Tuset, J., Arbeláez, P., & Van Gool, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_17 · Cited by 305
Sampling Generative NetworksPreprint
White, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.04468 · Cited by 218
Reed, S., Zhang, Y., Zhang, Y., & Lee, H. (2015) · neural information processing systems · Cited by 198
Niemeijer, M., Abràmoff, M. D., & van Ginneken, B. (2006) · Medical Image Analysis · doi:10.1016/j.media.2006.09.006 · Cited by 146
Self-citationUnsupervised Learning of Visual Structure using Predictive Generative NetworksPreprint
Lotter, W. E., Kreiman, G., & Cox, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06380 · Cited by 131
Why Does Synthesized Data Improve Multi-sequence Classification?
van Tulder, G., & de Bruijne, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_65 · Cited by 111
Towards Adversarial Retinal Image SynthesisPreprint
Costa, P., Galdrán, A., Meyer, M. I., Abràmoff, M. D., Niemeijer, M., Mendonça, A. M., & Campilho, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08974 · Cited by 101
Self-citationWhite, T. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.12585362.v1 · Cited by 94
Automatic Generation of Synthetic Retinal Fundus Images
Fiorini, S., Biasi, M. D., Ballerini, L., et al. (2014) · doi:10.2312/stag.20141238 · Cited by 22
Cited by
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00917 · Cited by 4,332
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
Medical Image Segmentation Review: The Success of U-Net
Azad, R., Aghdam, E. K., Rauland, A., Jia, Y., Avval, A. H., Bozorgpour, A., Karimijafarbigloo, S., Cohen, J. P., Adeli, E., & Merhof, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3435571 · Cited by 1,022
Synthetic data in machine learning for medicine and healthcare
Chen, R. J., Lu, M. Y., Chen, T. Y., Williamson, D. F. K., & Mahmood, F. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00751-8 · Cited by 728
Deep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2019) · Medical Physics · doi:10.1002/mp.13264 · Cited by 740
Metadata
- Authors
- Costa, P., Galdran, A., Meyer, M. I., Niemeijer, M., Abramoff, M., Mendonca, A. M., & Campilho, A.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2018-03
- Volume
- 37
- Issue
- 3
- Pages
- 781-791
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2761299546
- Cited by
- 432
- References
- 31
- FWCI
- 27.26
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.