The DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index, and 1 are not checked yet.
Ultrasound image analysis using deep neural networks for discriminating between benign and malignant ovarian tumors: comparison with expert subjective assessment
Open accessAbstract
OBJECTIVES: To develop and test the performance of computerized ultrasound image analysis using deep neural networks (DNNs) in discriminating between benign and malignant ovarian tumors and to compare its diagnostic accuracy with that of subjective assessment (SA) by an ultrasound expert. METHODS: We included 3077 (grayscale, n = 1927; power Doppler, n = 1150) ultrasound images from 758 women with ovarian tumors, who were classified prospectively by expert ultrasound examiners according to IOTA (International Ovarian Tumor Analysis) terms and definitions. Histological outcome from surgery (n = 634) or long-term (≥ 3 years) follow-up (n = 124) served as the gold standard. The dataset was split into a training set (n = 508; 314 benign and 194 malignant), a validation set (n = 100; 60 benign and 40 malignant) and a test set (n = 150; 75 benign and 75 malignant). We used transfer learning on three pre-trained DNNs: VGG16, ResNet50 and MobileNet. Each model was trained, and the outputs calibrated, using temperature scaling. An ensemble of the three models was then used to estimate the probability of malignancy based on all images from a given case. The DNN ensemble classified the tumors as benign or malignant (Ovry-Dx1 model); or as benign, inconclusive or malignant (Ovry-Dx2 model). The diagnostic performance of the DNN models, in terms of sensitivity and specificity, was compared to that of SA for classifying ovarian tumors in the test set. RESULTS: At a sensitivity of 96.0%, Ovry-Dx1 had a specificity similar to that of SA (86.7% vs 88.0%; P = 1.0). Ovry-Dx2 had a sensitivity of 97.1% and a specificity of 93.7%, when designating 12.7% of the lesions as inconclusive. By complimenting Ovry-Dx2 with SA in inconclusive cases, the overall sensitivity (96.0%) and specificity (89.3%) were not significantly different from using SA in all cases (P = 1.0). CONCLUSION: Ultrasound image analysis using DNNs can predict ovarian malignancy with a diagnostic accuracy comparable to that of human expert examiners, indicating that these models may have a role in the triage of women with an ovarian tumor. © 2020 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“there were also studies with smaller sample sizes that showed a level of performance reaching those of human experts [188,191,192].”
The cited source says what the claim attributes to it.
In the citing paper
“Frequent described limitations of studies on AI applications in US imaging were homogeneity of data due to a single examiner or single center study [188,192]”
The cited source says what the claim attributes to it.
In the citing paper
“clinicians using AI image analyzing algorithms must still take clinical aspects into account [188,189].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Interval Estimation for a Binomial Proportion
Brown, L. D., Cai, T., & Dasgupta, A. (2001) · Statistical Science · doi:10.1214/ss/1009213286 · Cited by 3,746
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287
Flagged first, then by citations
Research works printed but not linked: 1
- Nesterov Y., 1983, A method of solving a convex programming problem with convergence rate O(1/k2), Sov Math Dokl, 27, 372
Cited by
Sorted by citations
Items 101–147 of 147
Wu, Y., Dai, W., Li, X., Zhang, S., Gong, L., Wang, J., Cui, A., Li, S., Zhu, M., Dong, S., et al. (2026) · npj Precision Oncology · doi:10.1038/s41698-026-01320-5 · Cited by 2
Dhar, M. K., Vitis, L. A. D., Gregory, A., Ainio, C., Schivardi, G., Lembo, A., Dave, J. K., Laughlin-Tommaso, S. K., Cliby, B. A., Mariani, A., et al. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-01860-z · Cited by 2
Artificial Intelligence in Ultrasound-Based Diagnoses of Gynecological Tumors: A Systematic Review
Mohammed, F. S. A., Eisa, S. M. A., Madani, A. M. A., Alrowili, N. M. F., Ghaythan, A. M. K. A., Ali, I. M. M., Elamin, L., & Salad, N. A. (2025) · Cureus · doi:10.7759/cureus.85884 · Cited by 2
Diagnostic Use of the Combination of CA72 ‐4 and Tumor Volume in Mucinous Ovarian Tumors
Araki, H., Yokoi, A., Kuroda, K., Suzuki, K., Yoshida, K., Yoshihara, M., Tamauchi, S., Yoshikawa, N., Niimi, K., & Kajiyama, H. (2025) · Journal of obstetrics and gynaecology research · doi:10.1111/jog.70177 · Cited by 1
Odibo, A. O. (2021) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.23567 · Cited by 1
A scoping review on the use of Artificial Intelligence applications in women’s health (MARIE WP1)
Delanerolle, G., Jouaiti, M., Pathiraja, V., Mudalige, T., Eleje, G. U., Mbwele, B., Cavalini, H. F. S., Kurmi, O., Tweneboah-Koduah, F., Mintah-Afful, N., et al. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01280-6 · Cited by 1
Wang, X., Zhu, L., Tao, G., & Ma, X. (2023) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3594315.3594650 · Cited by 1
Sai, A. G. V., & Puviarasi, R. (2024) · AIP conference proceedings · doi:10.1063/5.0186150 · Cited by 1
An opportunity for using artificial intelligence in modern gynecology
Ларсеновна, Ш. Ш., Mamchueva, D. K., Vishnevskaya, A. P., Dzhalaeva, K. S., Ramazanova, E. G., Kokaeva, Y. R., Eloeva, Z. M., Aisanova, D. R., Vinogradova, A. S., Tuko, R. R., et al. (2024) · Obstetrics Gynecology and Reproduction · doi:10.17749/2313-7347/ob.gyn.rep.2024.511 · Cited by 1
Hybrid artificial intelligence echogenic components‐based diagnosis of adnexal masses on ultrasound
Yoeli‐Bik, R., Whitney, H. M., Li, H., Bilecz, A. J., Abramowicz, J. S., Li, L., Longman, R. E., Giger, M. L., & Lengyel, E. R. (2025) · Medical Physics · doi:10.1002/mp.17983 · Cited by 1
Aktuelle Aspekte zur künstlichen Intelligenz in der gynäkologischen Diagnostik
Scharf, J. L., Dracopoulos, C., Gembicki, M., Welp, A., & Weichert, J. (2022) · Die Gynäkologie · doi:10.1007/s00129-022-04993-8
Wang, Z., Luo, S., Chen, J., Jiao, Y., Cui, C., Shi, S., Yang, Y., Zhao, J., Jiang, Y., Zhang, Y., et al. (2023) · doi:10.2196/preprints.50499
Lourenço, M., Arrufat, T., Satorres-Pérez, E., Maderuelo, S., Álamo, B. N.-D., Guerriero, S., Orozco, R., & Alcázar, J. L. (2024) · Applied Sciences · doi:10.3390/app14072998
Nair, S. G., Benny, S., Jose, W. M., & Aneesh, T. P. (2024) · Life Sciences · doi:10.1016/j.lfs.2024.123167
Research on the Prediction of Benign and Malignant Ovarian Tumors Using Improved ResNet
Lang, Y., Yu, Q., Sun, X., & Cheng, Y. (2024) · Asia Symposium on Image Processing (ASIP) · doi:10.1109/asip63198.2024.00024
ALTUNAY, F. K. (2024) · Bidge Yayınları eBooks · doi:10.70269/10.70269/5786955648
Prenatal Diagnosis and Surgical Approach in Placenta Accreta Spectrum
Karabay, G. (2024) · Bidge Yayınları eBooks · doi:10.70269/10.70269/9739972682
Postpartum Kanamalarda İnternal İliak Arter Ligasyonu
KAYA, H. (2024) · Bidge Yayınları eBooks · doi:10.70269/10.70269/2268974953
EROĞLU, H. (2024) · Bidge Yayınları eBooks · doi:10.70269/10.70269/5828872562
Turan, Z. (2024) · Bidge Yayınları eBooks · doi:10.70269/10.70269/9826164186
Will radiomics or visual assessment prevail?
Testa, A. C. (2025) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.29168
Du, Y., Xiao, Y., Guo, W., Yao, J., Lan, T., Li, S., Wen, H., Zhu, W., He, G., Zheng, H., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26704227
Du, Y., Xiao, Y., Guo, W., Yao, J., Lan, T., Li, S., Wen, H., Zhu, W., He, G., Zheng, H., et al. (2024) · Figshare · doi:10.6084/m9.figshare.25572533
Du, Y., Xiao, Y., Guo, W., Yao, J., Lan, T., Li, S., Wen, H., Zhu, W., He, G., Zheng, H., et al. (2024) · Figshare · doi:10.6084/m9.figshare.25572654
Du, Y., Xiao, Y., Guo, W., Yao, J., Lan, T., Li, S., Wen, H., Zhu, W., He, G., Zheng, H., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26704233
Wan, F., He, W., Zhang, W., Zhang, Y., Zhang, H., & Guang, Y. (2023) · Figshare · doi:10.6084/m9.figshare.23722231
Du, Y., Xiao, Y., Guo, W., Yao, J., Lan, T., Li, S., Wen, H., Zhu, W., He, G., Zheng, H., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26704224
Wan, F., He, W., Zhang, W., Zhang, Y., Zhang, H., & Guang, Y. (2023) · Figshare · doi:10.6084/m9.figshare.23722234
Du, Y., Xiao, Y., Guo, W., Yao, J., Lan, T., Li, S., Wen, H., Zhu, W., He, G., Zheng, H., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26704230
Du, Y., Guo, W., Xiao, Y., Chen, H., Yao, J., & Wu, J. (2024) · Figshare · doi:10.6084/m9.figshare.25608756
The value of diagnostic experience in O-RADS MRI score for ovarian-adnexal lesions
Jin, M., Huang, T., Wang, D., Cui, H., & Xu, X. (2025) · Open Medicine · doi:10.1515/med-2025-1316
Angeline, J., Janney, J. B., & Arvind, N. (2026) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2026.105298
Lai, L., Chen, C., Zhou, Y., Wang, V. Y., Zhu, M., Jin, Z., Wu, Y., Ma, C., Zhang, Q., Chen, Q., et al. (2026) · BMC Medical Imaging · doi:10.1186/s12880-026-02312-4
Deep Learning and Explainable AI for Ovarian Cancer Detection: A Comprehensive Literature Review
Sandhya, M., Shanmugam, L., & Selvan, C. P. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10590-y
Clemency, C. A. D. D., & Grace, L. K. J. (2026) · IEEE International Conference on Emerging Computing and Intelligent Technologies (ICoECIT) · doi:10.1109/icoecit68303.2026.11497532
Chiu, P.-C., Lee, C., Hsu, H., Tai, Y., Chiang, Y., & Lu, T. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag224
Artificial intelligence in ovarian cancer: advancing in precision diagnosis and clinical management
Shao, M., Wang, T., Ji, L., Xu, L., Zhang, Y., Wang, D. Q., Jia, C., Chen, L., Zhang, H., Yan, W., et al. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1795144
Saravanan.M.S, Kartheesan, L., & Bhavanam, S. N. (2025) · International Conference on Sustainable Computing and Smart Systems (ICSCSS) · doi:10.1109/icscss64956.2025.11500736
The value of artificial intelligence in the diagnosis of precancerous cervical lesions
Dzhibladze, T. A., Koryagina, A. D., Zuev, V. M., Ostroumova, M., Chistogov, M., Leonidova, T. N., Maksimova, T., Дмитриевна, Х. И., Ishchenko, A. I., Svidinskaya, E. A., et al. (2026) · V F Snegirev Archives of Obstetrics and Gynecology · doi:10.17816/aog701962
Deeparani, M., & Kalamani, M. (2026) · Diagnostics · doi:10.3390/diagnostics16162617
RetractedChapman, G. C., Fedorenko, O., Sheyn, D., Reid, A., Taylor, L. J., Ray, S., & Lynam, S. K. (2026) · Gynecologic Oncology · doi:10.1016/j.ygyno.2026.08.012
Alvarez, M., Herrera, S., Cruz, D., & Castro, A. (2026) · Interdisciplinary Research in Medical Sciences Specialty · doi:10.51847/csbeqzi731
Doostparast, A., Alami, Z., Sadeghpour, S., Ghandhari, M., Bakhshali, M. A., & Layegh, P. (2026) · European Journal of Radiology Open · doi:10.1016/j.ejro.2026.100818
CystNet-73 a Novel Deep Learning Network for Ovarian Cyst Classification
Sood, M., Puthooran, E., & Jain, N. (2026) · Indian Journal of Gynecologic Oncology · doi:10.1007/s40944-026-01153-x
Advances and Prospects of Artificial Intelligence in the Diagnosis and Management of Ovarian Cancer
Al-Musawi, J. M., AlMehdi, S., Majeed, S. A., & Al-Obaidi, R. Q. (2026) · Middle Eastern Cancer and Oncology Journal · doi:10.61706/mecoj160203
Classification of Ovarian Cyst Ultrasound Images Using Fasterr-CNN and a Hybrid Architecture
Montes-Martínez, I. T., Anzueto-Ríos, Á., & Martínez-Pérez, L. (2026) · International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE) · doi:10.1109/cce72160.2026.11734977
Sun, Y., Shen, H., Gu, Y., Sun, R., Dai, Y., Zheng, Q., Du, L., He, M., Zhang, L., Jiang, Y., et al. (2026) · Academic Radiology · doi:10.1016/j.acra.2026.09.071
Metadata
- Authors
- Christiansen, F., Epstein, E. L., Smedberg, E., Åkerlund, M., Smith, K., & Epstein, E.
- Affiliations
- KTH Royal Institute of Technology (SE)
- Karolinska Institutet (SE)
- Harvard University (US)
- Science for Life Laboratory (SE)
- Corresponding author
- Epstein, E.
- Venue
- Ultrasound in Obstetrics & Gynecology
- Publisher
- Wiley
- Published
- 2021-01
- Volume
- 57
- Issue
- 1
- Pages
- 155-163
- ISSN
- 0960-7692 (ISSN-L)
- 1469-0705
- PMC
- PMC7839489
- OpenAlex
- W3096898300
- Cited by
- 142
- References
- 34
- Citations by year
- 2026: 17 · 2025: 27 · 2024: 46 · 2023: 31 · 2022: 13 · 2021: 8
- FWCI
- 5.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Ultrasound in Obstetrics and Gynecology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Radiumhemmets Forskningsfonder (181115)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- ovarian neoplasms, benign versus malignant differentiation, computer-aided diagnosis, deep neural network, transfer learning, ensemble learning, temperature scaling, subjective evaluation, power Doppler, B-mode ultrasound, ovarian cancer, diagnostic accuracy, histological outcomes, expert comparison, VGG16, ResNet50, MobileNet
- MeSH terms
- Deep Learning, Adnexal Diseases, Diagnosis, Differential, Female, Humans, Image Processing, Computer-Assisted, Ovarian Neoplasms, Retrospective Studies, Sensitivity and Specificity, Reproducibility of Results, Ultrasonography, Doppler
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
