The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification
Open accessAbstract
Abstract Deep learning methods, and in particular convolutional neural networks (CNNs), have led to an enormous breakthrough in a wide range of computer vision tasks, primarily by using large-scale annotated datasets. However, obtaining such datasets in the medical domain remains a challenge. In this paper, we present methods for generating synthetic medical images using recently presented deep learning Generative Adversarial Networks (GANs). Furthermore, we show that generated medical images can be used for synthetic data augmentation, and improve the performance of CNN for medical image classification. Our novel method is demonstrated on a limited dataset of computed tomography (CT) images of 182 liver lesions (53 cysts, 64 metastases and 65 hemangiomas). We first exploit GAN architectures for synthesizing high quality liver lesion ROIs. Then we present a novel scheme for liver lesion classification using CNN. Finally, we train the CNN using classic data augmentation and our synthetic data augmentation and compare performance. In addition, we explore the quality of our synthesized examples using visualization and expert assessment. The classification performance using only classic data augmentation yielded 78.6% sensitivity and 88.4% specificity. By adding the synthetic data augmentation the results increased to 85.7% sensitivity and 92.4% specificity. We believe that this approach to synthetic data augmentation can generalize to other medical classification applications and thus support radiologists’ efforts to improve diagnosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
(2008) · Journal of Machine Learning Research · Cited by 33,051
Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012
Ferlay, J., Soerjomataram, I., Dikshit, R., Eser, S., Mathers, C., Rebelo, M., Parkin, D. M., Forman, D., & Bray, F. (2015) · International Journal of Cancer · doi:10.1002/ijc.29210 · Cited by 28,766
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Textural Features for Image Classification
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309314 · Cited by 22,886
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277
Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627
Conditional Image Synthesis With Auxiliary Classifier GANs
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 1,837
Greenspan, H., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,700
Self-citationDeep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
Denton, E., Chintala, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05751 · Cited by 1,541
Setio, A. A. A., Ciompi, F., Litjens, G., Gerke, P., Jacobs, C., van Riel, S. J., Wille, M. M. W., Naqibullah, M., Sanchez, C. I., & van Ginneken, B. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2536809 · Cited by 1,258
Semantic Image Inpainting with Deep Generative Models
Yeh, R. A., Chen, C., Lim, T. Y., Schwing, A. G., Hasegawa-Johnson, M., & Do, M. N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.728 · Cited by 1,206
A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2)
Nesterov, Y. E. (1983) · Medical Entomology and Zoology · Cited by 865
Medical Image Synthesis with Context-Aware Generative Adversarial Networks
Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_48 · Cited by 691
Improving Computer-Aided Detection UsingConvolutional Neural Networks and Random View Aggregation
Roth, H. R., Lu, L., Liu, J., Yao, J., Seff, A., Cherry, K., Kim, L., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2482920 · Cited by 608 · cited 3×
“T HE greatest challenge in the medical imaging domain is how to cope with the small datasets and limited amount of annotated samples [1]–[5], especially when employing supervised machine learning algorithms that require labeled data and larger training examples.”
BackgroundMethodSegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation
Xue, Y., Xu, T., Zhang, H., Long, L. R., & Huang, X. (2018) · Neuroinformatics · doi:10.1007/s12021-018-9377-x · Cited by 605
Semantic Image Inpainting with Perceptual and Contextual Losses.Preprint
Yeh, R. A., Chen, C., Lim, T.-Y., Hasegawa‐Johnson, M., & Do, M. N. (2016) · arXiv (Cornell University) · Cited by 298
Gletsos, M., Mougiakakou, S. G., Matsopoulos, G. K., Nikita, K. S., Nikita, A. S., & Kelekis, D. (2003) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2003.813793 · Cited by 248
SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-Rays
Dai, W., Dong, N., Wang, Z., Liang, X., Zhang, H., & Xing, E. P. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_30 · Cited by 193
Shi, J., Zhou, S., Liu, X., Zhang, Q., Lu, M., & Wang, T. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.01.074 · Cited by 166
Generative adversarial networks for brain lesion detection
Alex, V., Safwan, M., Chennamsetty, S. S., & Krishnamurthi, G. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2254487 · Cited by 112
Classification of hepatic lesions using the matching metric
Adcock, A., Rubin, D. L., & Carlsson, G. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.10.014 · Cited by 107
Mougiakakou, S. G., Valavanis, I. K., Nikita, A. S., & Nikita, K. S. (2007) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2007.05.002 · Cited by 104
Napel, S. A., Beaulieu, C. F., Rodríguez, C., Cui, J., Xu, J., Gupta, A. R., Korenblum, D., Greenspan, H. K., Ma, Y., & Rubin, D. L. (2010) · Radiology · doi:10.1148/radiol.10091694 · Cited by 103
Self-citationVirtual PET Images from CT Data Using Deep Convolutional Networks: Initial Results
Ben-Cohen, A., Klang, E., Raskin, S. P., Amitai, M. M., & Greenspan, H. K. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68127-6_6 · Cited by 102
Self-citationTowards Adversarial Retinal Image SynthesisPreprint
Costa, P., Galdrán, A., Meyer, M. I., Abràmoff, M. D., Niemeijer, M., Mendonça, A. M., & Campilho, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08974 · Cited by 101
Murakami, T., Imai, Y., Okada, M., et al. (2011) · Oncology · doi:10.1159/000333267 · Cited by 61
Diamant, I., Hoogi, A., Beaulieu, C. F., Safdari, M., Klang, E., Amitai, M., Greenspan, H. K., & Rubin, D. L. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2478255 · Cited by 48
Self-citationTask-Driven Dictionary Learning Based on Mutual Information for Medical Image Classification
Diamant, I., Klang, E., Amitai, M., Konen, E., Goldberger, J., & Greenspan, H. K. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2605627 · Cited by 36
Self-citation
Cited by
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231
Zhou, S. K., Greenspan, H., Davatzikos, C., Duncan, J. S., Van Ginneken, B., Madabhushi, A., Prince, J. L., Rueckert, D., & Summers, R. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054390 · Cited by 1,118
Self-citationDeep convolutional neural network based medical image classification for disease diagnosis
Yadav, S. S., & Jadhav, S. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0276-2 · Cited by 1,069
Metadata
- Authors
- Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 321
- Pages
- 321-331
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W2794022343
- Cited by
- 1,938
- References
- 39
- FWCI
- 30.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.