Detection of Cardiac Structural Abnormalities in Fetal Ultrasound Videos Using Deep Learning
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) technologies have recently been applied to medical imaging for diagnostic support. With respect to fetal ultrasound screening of congenital heart disease (CHD), it is still challenging to achieve consistently accurate diagnoses owing to its manual operation and the technical differences among examiners. Hence, we proposed an architecture of Supervised Object detection with Normal data Only (SONO), based on a convolutional neural network (CNN), to detect cardiac substructures and structural abnormalities in fetal ultrasound videos. We used a barcode-like timeline to visualize the probability of detection and calculated an abnormality score of each video. Performance evaluations of detecting cardiac structural abnormalities utilized videos of sequential cross-sections around a four-chamber view (Heart) and three-vessel trachea view (Vessels). The mean value of abnormality scores in CHD cases was significantly higher than normal cases (p < 0.001). The areas under the receiver operating characteristic curve in Heart and Vessels produced by SONO were 0.787 and 0.891, respectively, higher than the other conventional algorithms. SONO achieves an automatic detection of each cardiac substructure in fetal ultrasound videos, and shows an applicability to detect cardiac structural abnormalities. The barcode-like timeline is informative for examiners to capture the clinical characteristic of each case, and it is also expected to acquire one of the important features in the field of medical AI: the development of “explainable AI.”
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139 · cited 2×
“To eval ate the detection accuracy, the mean average precision (mAP) was calculated in IoU > 0 [20].”
MethodClinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627
Donofrio, M. T., Moon-Grady, A. J., Hornberger, L. K., Copel, J. A., Sklansky, M. S., Abuhamad, A., Cuneo, B. F., Huhta, J. C., Jonas, R. A., Krishnan, A., et al. (2014) · Circulation · doi:10.1161/01.cir.0000437597.44550.5d · Cited by 1,275 · cited 3×
“Fetal ultrasound screening of every pregnancy at risk for CHD is generally recommended at 18 to 22 weeks of gestation worldwide [8,9].”
BackgroundISUOG Practice Guidelines (updated): sonographic screening examination of the fetal heart
Carvalho, J., Allan, L., Chaoui, R., Copel, J., DeVore, G., Hecher, K., Lee, W., Munoz, H., Paladini, D., Tutschek, B., et al. (2013) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.12403 · Cited by 681
SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound
Baumgartner, C. F., Kamnitsas, K., Matthew, J., Fletcher, T. P., Smith, S., Koch, L. M., Kainz, B., & Rueckert, D. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2712367 · Cited by 416 · cited 1×
“SonoNet could detect the fetal structures via bounding boxes in fetal ultrasound videos, such as the brain, spine, abdomen, and also the four standardized transverse scanning planes of fetal heart, which were the four-chamber view (4CV), three-vessel view (3VV), right ventricular outflow tract (ROVT), and left ventric…”
Arnaout, R., Curran, L., Zhao, Y., Levine, J. C., Chinn, E., & Moon-Grady, A. J. (2020) · doi:10.1101/2020.06.22.20137786 · Cited by 315
Prenatal detection of congenital heart disease
Friedberg, M. K., Silverman, N. H., Moon-Grady, A. J., Tong, E., Nourse, J., Sorenson, B., Lee, J., & Hornberger, L. K. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2009.01.050 · Cited by 299
Cited by
A Review of Explainable Artificial Intelligence in Healthcare
Sadeghi, Z., Alizadehsani, R., CIFCI, M. A., Kausar, S., Rehman, R., Mahanta, P., Bora, P. K., Almasri, A., Alkhawaldeh, R. S., Hussain, S., et al. (2024) · Computers and Electrical Engineering · doi:10.1016/j.compeleceng.2024.109370 · Cited by 598
Takahashi, S., Sakaguchi, Y., Kouno, N., Takasawa, K., Ishizu, K., Akagi, Y., Aoyama, R., Teraya, N., Bolatkan, A., Shinkai, N., et al. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02105-8 · Cited by 343
Self-citationNazir, S., Dickson, D. M., & Akram, M. U. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106668 · Cited by 283
“The video data was converted to a bar-code type timeline to aid the explainability which made it easier to identify the substructures [243].”
MethodUse of artificial intelligence and deep learning in fetal ultrasound imaging
Ramirez Zegarra, R., & Ghi, T. (2023) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.26130 · Cited by 102
“To date, DL models that are able to detect hypoplastic left heart syndrome and ventricular septal defects have been built using object detection 85,98,99 or segmentation 84,100,101 .”
MethodNurmaini, S., Rachmatullah, M. N., Sapitri, A. I., Darmawahyuni, A., Tutuko, B., Firdaus, F., Partan, R. U., & Bernolian, N. (2021) · Sensors · doi:10.3390/s21238007 · Cited by 81
Sakai, A., Komatsu, M., Komatsu, R., Matsuoka, R., Yasutomi, S., Dozen, A., Shozu, K., Arakaki, T., Machino, H., Asada, K., et al. (2022) · Biomedicines · doi:10.3390/biomedicines10030551 · Cited by 68
“The network weights and hyperparameters used to calculate the barcode-like timeline are the same as those in Komatsu et al. [46] Window size w , stride size s , learning rate, and accumulator value were determined using a validation set introduced in the data preparation section.”
BackgroundMethodResultInfluentialSelf-citationA survey on deep learning in medical ultrasound imaging
Song, K., Feng, J., & Chen, D. (2024) · Frontiers in Physics · doi:10.3389/fphy.2024.1398393 · Cited by 59
Sendra-Balcells, C., Campello, V. M., Torrents-Barrena, J., Ahmed, Y. A., Elattar, M., Ohene-Botwe, B., Nyangulu, P., Stones, W., Ammar, M., Benamer, L. N., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-29490-3 · Cited by 57
Unsupervised deep learning to detect agitation from videos in people with dementia
Khan, S. S., Mishra, P. K., Javed, N., Ye, B., Newman, K., Mihailidis, A., & Iaboni, A. (2022) · IEEE Access · doi:10.1109/access.2022.3143990 · Cited by 44
“…abnormal breathing events with 3D cameras [22], CNN and its variants and LSTM for fetal anomaly detection in ultrasound video scans [23], [24], CNN and LSTM method for aberrant epileptic seizures from videos [25], ResNet-based contrastive representation for abnormal otoscopy video…”
MethodDeep learning-based real time detection for cardiac objects with fetal ultrasound video
Iriani Sapitri, A., Nurmaini, S., Naufal Rachmatullah, M., Tutuko, B., Darmawahyuni, A., Firdaus, F., Rini, D. P., & Islami, A. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2022.101150 · Cited by 42
Artificial intelligence in perinatal diagnosis and management of congenital heart disease
Reddy, C. D., Van den Eynde, J., & Kutty, S. (2022) · Seminars in Perinatology · doi:10.1016/j.semperi.2022.151588 · Cited by 32
Metadata
- Authors
- Komatsu, M., Sakai, A., Komatsu, R., Matsuoka, R., Yasutomi, S., Shozu, K., Dozen, A., Machino, H., Hidaka, H., Arakaki, T., Asada, K., Kaneko, S., Sekizawa, A., & Hamamoto, R.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2021-01-02
- Volume
- 11
- Issue
- 1
- Pages
- 371
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3119836372
- Cited by
- 142
- References
- 14
- FWCI
- 5.61
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.