Application of Deep Learning Model in the Sonographic Diagnosis of Uterine Adenomyosis
Open accessAbstract
Background: This study aims to evaluate the diagnostic performance of Deep Learning (DL) machine for the detection of adenomyosis on uterine ultrasonographic images and compare it to intermediate ultrasound skilled trainees. Methods: Prospective observational study were conducted between 1 and 30 April 2022. Transvaginal ultrasound (TVUS) diagnosis of adenomyosis was investigated by an experienced sonographer on 100 fertile-age patients. Videoclips of the uterine corpus were recorded and sequential ultrasound images were extracted. Intermediate ultrasound-skilled trainees and DL machine were asked to make a diagnosis reviewing uterine images. We evaluated and compared the accuracy, sensitivity, positive predictive value, F1-score, specificity and negative predictive value of the DL model and the trainees for adenomyosis diagnosis. Results: Accuracy of DL and intermediate ultrasound-skilled trainees for the diagnosis of adenomyosis were 0.51 (95% CI, 0.48–0.54) and 0.70 (95% CI, 0.60–0.79), respectively. Sensitivity, specificity and F1-score of DL were 0.43 (95% CI, 0.38–0.48), 0.82 (95% CI, 0.79–0.85) and 0.46 (0.42–0.50), respectively, whereas intermediate ultrasound-skilled trainees had sensitivity of 0.72 (95% CI, 0.52–0.86), specificity of 0.69 (95% CI, 0.58–0.79) and F1-score of 0.55 (95% CI, 0.43–0.66). Conclusions: In this preliminary study DL model showed a lower accuracy but a higher specificity in diagnosing adenomyosis on ultrasonographic images compared to intermediate-skilled trainees.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In total, 11 articles were summarized in the other applications in gynecology section, including endometriosis, premature ovarian failure, uterine fibroids, follicle tracking, and ectopic pregnancies.
“In total, 11 articles were summarized in this section, including the topics of endometriosis [216,217], premature ovarian failure [218,219], uterine fibroids [220,221], follicle tracking [222,223], and ectopic pregnancies [224,225].”
The AI model of Raimondo et al. is useful to exclude rather than detect adenomyosis.
“interpreted as a useful tool to rather exclude than detect adenomyosis [217].”
Raimondo et al. showed a low sensitivity of the AI model to detect adenomyosis, but a high specificity.
“the results of Raimondo et al. showed a low sensitivity of the AI model to detect adenomyosis, but a high specificity”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796 · see citing works
Assessment of menstrual blood loss using a pictorial chart
HIGHAM, J. M., O'BRIEN, P. M. S., & SHAW, R. W. (1990) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.1990.tb16249.x · Cited by 1,116 · see citing works
Guerriero, S., Condous, G., van den Bosch, T., Valentin, L., Leone, F. P. G., Van Schoubroeck, D., Exacoustos, C., Installé, A. J. F., Martins, W. P., Abrao, M. S., et al. (2016) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.15955 · Cited by 900 · see citing works
den Bosch, T. V., Dueholm, M., Leone, F. P., Valentin, L., Rasmussen, C. K., Votino, A., Schoubroeck, D. V., Landolfo, C., Installé, A., Guerriero, S., et al. (2015) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.14806 · Cited by 776 · see citing works
Systematic review of endometriosis pain assessment: how to choose a scale?
Bourdel, N., Alves, J., Pickering, G. P., Ramilo, I. D. T. M., Roman, H., & Canis, M. J. (2014) · Human Reproduction Update · doi:10.1093/humupd/dmu046 · Cited by 378 · see citing works
Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review
Shen, J., Zhang, C. J. P., Jiang, B., Chen, J., Song, J., Liu, Z., He, Z., Wong, S. Y., Fang, P.-H., & Ming, W.-K. (2019) · JMIR Medical Informatics · doi:10.2196/10010 · Cited by 373 · see citing works
Harmsen, M. J., den Bosch, T. V., de Leeuw, R. A., Dueholm, M., Exacoustós, C., Valentin, L., Hehenkamp, W. J. K., Groenman, F. A., Bruyn, C. D., Rasmussen, C. K., et al. (2021) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.24786 · Cited by 340 · see citing works
Self-citationNaftalin, J., Hoo, W., Pateman, K., Mavrelos, D., Holland, T., & Jurkovic, D. (2012) · Human Reproduction · doi:10.1093/humrep/des332 · Cited by 337 · see citing works
Akkus, Z., Cai, J. C., Boonrod, A., Zeinoddini, A., Weston, A. D., Philbrick, K. A., & Erickson, B. J. (2019) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2019.06.004 · Cited by 324 · see citing works
Sonographic classification and reporting system for diagnosing adenomyosis
den Bosch, T. V., de Bruijn, A. M., de Leeuw, R. A., Dueholm, M., Exacoustós, C., Valentin, L., Bourne, T., Timmerman, D., & Huirne, J. A. F. (2018) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.19096 · Cited by 293 · see citing works
The Impact of Adenomyosis on Women's Fertility
Harada, T., Khine, Y. M., Kaponis, A. I., Nikellis, T., Decavalas, G., & Taniguchi, F. (2016) · Obstetrical & Gynecological Survey · doi:10.1097/ogx.0000000000000346 · Cited by 258 · see citing works
Transvaginal Ultrasound for the Diagnosis of Adenomyosis: Systematic Review and Meta-Analysis
Andres, M. P., Borrelli, G. M., Ribeiro, J., Baracat, E. C., Abrão, M. S., & Kho, R. M. (2017) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2017.08.653 · Cited by 187 · see citing works
Prevalence of adenomyosis in women undergoing surgery for endometriosis
Donato, N. D., Montanari, G., Benfenati, A., Leonardi, D., Bertoldo, V., Monti, G., Raimondo, D., & Seracchioli, R. (2014) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2014.08.016 · Cited by 157 · see citing works
Self-citationAdenomyosis: A Sonographic Diagnosis
Cunningham, R. K., Horrow, M. M., Smith, R. J., & Springer, J. (2018) · Radiographics · doi:10.1148/rg.2018180080 · Cited by 151 · see citing works
Tellum, T., Nygaard, S., & Lieng, M. (2019) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2019.11.001 · Cited by 150 · see citing works
Christiansen, F., Epstein, E. L., Smedberg, E., Åkerlund, M., Smith, K., & Epstein, E. (2021) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.23530 · Cited by 142 · see citing works
Exacoustós, C., Morosetti, G., Conway, F., Camilli, S., Martire, F. G., Lazzeri, L., Piccione, E., & Zupi, E. (2019) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2019.09.788 · Cited by 135 · see citing works
Self-citationUterine Fibroids and Infertility
Freytag, D., Günther, V., Maass, N., & Alkatout, İ. (2021) · Diagnostics · doi:10.3390/diagnostics11081455 · Cited by 109 · see citing works
Lazzeri, L., Morosetti, G., Centini, G., Monti, G., Zupi, E., Piccione, E., & Exacoustós, C. (2018) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.06.031 · Cited by 108 · see citing works
Self-citationIsolated Ovarian Endometrioma: A History Between Myth and Reality
Exacoustós, C., Felice, G. D., Pizzo, A., Morosetti, G., Lazzeri, L., Centini, G., Piccione, E., & Zupi, E. (2018) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2017.12.026 · Cited by 65 · see citing works
Self-citationArtificial intelligence (AI) in the detection of rectosigmoid deep endometriosis
Guerriero, S., Pascual, M. A., AJOSSA, S., Neri, M., Musa, E., Graupera, B., Rodríguez, I., & Alcázar, J. L. (2021) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2021.04.012 · Cited by 62 · see citing works
Diagnostic Accuracy of Transvaginal Ultrasound and Magnetic Resonance Imaging for Adenomyosis
Liu, L., Li, W., Leonardi, M., Condous, G. S., Costa, F. D. S., Mol, B. W., & Wong, L. (2021) · Journal of Ultrasound in Medicine · doi:10.1002/jum.15635 · Cited by 59 · see citing works
Application of artificial intelligence in gynecologic malignancies: A review
Sone, K., Toyohara, Y., Taguchi, A., et al. (2021) · Journal of obstetrics and gynaecology research · doi:10.1111/jog.14818 · Cited by 46 · see citing works
Question Mark Sign and Transvaginal Ultrasound Uterine Tenderness for the Diagnosis of Adenomyosis
Zannoni, L., Ambrosio, M., Raimondo, D., Arena, A., Forno, S. D., Borghese, G., Paradisi, R., & Seracchioli, R. (2020) · Journal of Ultrasound in Medicine · doi:10.1002/jum.15237 · Cited by 42 · see citing works
Self-citationIndrielle-Kelly, T., Fischerová, D., Hanuš, P., et al. (2020) · BioMed Research International · doi:10.1155/2020/8757281 · Cited by 31 · see citing works
Rasmussen, C. K., den Bosch, T. V., Exacoustós, C., et al. (2019) · Journal of Ultrasound in Medicine · doi:10.1002/jum.14971 · Cited by 27 · see citing works
A new era in diagnosing adenomyosis is coming
Exacoustós, C., & Zupi, E. (2018) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.07.005 · Cited by 23 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Jost, E., Kosian, P., Jimenez Cruz, J., Albarqouni, S., Gembruch, U., Strizek, B., & Recker, F. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12216833 · Cited by 44 · see citing works
“In total, 11 articles were summarized in this section, including the topics of endometriosis [216,217], premature ovarian failure [218,219], uterine fibroids [220,221], follicle tracking [222,223], and ectopic pregnancies [224,225].”
BackgroundResult
- Authors
- Raimondo, D., Raffone, A., Aru, A. C., Giorgi, M., Giaquinto, I., Spagnolo, E., Travaglino, A., Galatolo, F. A., Cimino, M. G. C. A., Lenzi, J., Centini, G., Lazzeri, L., Mollo, A., Seracchioli, R., & Casadio, P.
- Affiliations
- IRCCS Azienda Ospedliero-Universitaria di Bologna Policlinico di Sant'Orsola (IT)
- University of Siena (IT)
- Ospedale G.B. Morgagni - L.Pierantoni (IT)
- Hospital Universitario La Paz (ES)
- Agostino Gemelli University Polyclinic (IT)
- University of Pisa (IT)
- University of Bologna (IT)
- University of Salerno (IT)
- Corresponding author
- Raffone, Antonio
- ORCID
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2023-01-18
- Volume
- 20
- Issue
- 3
- Pages
- 1724
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC9914280
- OpenAlex
- W4317107488
- Cited by
- 44
- References
- 27
- Citations by year
- 2026: 14 · 2025: 11 · 2024: 11 · 2023: 8
- FWCI
- 1.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion, cc-by)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, cc-by)
- IrInSubria (University of Insubria) (submittedVersion, cc-by)
- Use Siena air (University of Siena) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Archivio Istituzionale della Ricerca - Università degli Studi della Campania "Luigi Vanvitelli" (submittedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- adenomyosis, uterine adenomyosis, deep learning, transvaginal ultrasound, computer-aided diagnosis, diagnostic accuracy, uterine imaging
- MeSH terms
- Deep Learning, Endometriosis, Female, Humans, Sensitivity and Specificity, Ultrasonography, Uterus, Adenomyosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review