Towards Automated Semantic Segmentation in Prenatal Volumetric Ultrasound
The DOI matches its Crossref record; 61 of the 62 references it cites were found in a registry or an index.
Abstract
Volumetric ultrasound is rapidly emerging as a viable imaging modality for routine prenatal examinations. Biometrics obtained from the volumetric segmentation shed light on the reformation of precise maternal and fetal health monitoring. However, the poor image quality, low contrast, boundary ambiguity, and complex anatomy shapes conspire toward a great lack of efficient tools for the segmentation. It makes 3-D ultrasound difficult to interpret and hinders the widespread of 3-D ultrasound in obstetrics. In this paper, we are looking at the problem of semantic segmentation in prenatal ultrasound volumes. Our contribution is threefold: 1) we propose the first and fully automatic framework to simultaneously segment multiple anatomical structures with intensive clinical interest, including fetus, gestational sac, and placenta, which remains a rarely studied and arduous challenge; 2) we propose a composite architecture for dense labeling, in which a customized 3-D fully convolutional network explores spatial intensity concurrency for initial labeling, while a multi-directional recurrent neural network (RNN) encodes spatial sequentiality to combat boundary ambiguity for significant refinement; and 3) we introduce a hierarchical deep supervision mechanism to boost the information flow within RNN and fit the latent sequence hierarchy in fine scales, and further improve the segmentation results. Extensively verified on in-house large data sets, our method illustrates a superior segmentation performance, decent agreements with expert measurements and high reproducibilities against scanning variations, and thus is promising in advancing the prenatal ultrasound examinations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Yang et al. used a CNN to perform automatic segmentation of placenta, amniotic fluid, and fetus8.”
From Multi-centre deep learning for placenta segmentation in obstetric ultrasound with multi-observer and cross-country generalization (2023) · cites this paper as [8]
In the citing paper
“For placental volume estimation, semi-automatic 3D placenta segmentation has been successfully performed in previous studies.”
From Multi-centre deep learning for placenta segmentation in obstetric ultrasound with multi-observer and cross-country generalization (2023) · cites this paper as [8]
In the citing paper
“and missing real-time application for clinical applicability [133,134,138].”
In the citing paper
“and Ryou et al. and Yang et al. proposed a model for the assessment of the whole fetus in 3D volumes [137,138].”
In the citing paper
“Limitations could be uncovered when assessing fetal limbs due to its small anatomy and close surroundings [136,137,138]”
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2010) · Cited by 14,134
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868 · cited 1×
“Being proficient in using the annotation software ITK-SNAP [53], a sonographer needs about 4 hours to delineate the three anatomies in one volume.”
MethodConvolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709 · cited 1×
“As an advanced mixture of FCN and RNN, ConvLSTM [57] is a promising design which can seamlessly blend concurrency and sequentiality for inference.”
MethodLong-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 1×
“Balancing unary intensity features and pairwise diversity to determine pixel clustering, DenseCRF 2 with high efficiency becomes a popular module to achieve structure-refined segmentation [33], [56].”
BackgroundEfficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks
Qiu, Z., Yao, T., & Mei, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.590 · Cited by 1,874
Hybrid speech recognition with Deep Bidirectional LSTM
Graves, A., Jaitly, N., & Mohamed, A.-R. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707742 · Cited by 1,736
Statistical shape models for 3D medical image segmentation: A review
Heimann, T., & Meinzer, H.-P. (2009) · Medical Image Analysis · doi:10.1016/j.media.2009.05.004 · Cited by 1,417
Ultrasound image segmentation: a survey
Noble, J. A., & Boukerroui, D. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.877092 · Cited by 1,157
Theano: A CPU and GPU Math Compiler in Python
Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., & Bengio, Y. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-003 · Cited by 1,052
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Zhuowen Tu, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5185 · Cited by 993
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
Kiserud, T., Piaggio, G., Carroli, G., Widmer, M., Carvalho, J., Neerup Jensen, L., Giordano, D., Cecatti, J. G., Abdel Aleem, H., Talegawkar, S. A., et al. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002220 · Cited by 729
3D deeply supervised network for automated segmentation of volumetric medical images
Dou, Q., Yu, L., Chen, H., Jin, Y., Yang, X., Qin, J., & Heng, P.-A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.05.001 · Cited by 613
Self-citationStandard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks
Chen, H., Ni, D., Qin, J., Li, S., Yang, X., Wang, T., & Heng, P. A. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2425041 · Cited by 379
Self-citationScene labeling with LSTM recurrent neural networks
Byeon, W., Breuel, T. M., Raue, F., & Liwicki, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298977 · Cited by 375
Performance measure characterization for evaluating neuroimage segmentation algorithms
Chang, H.-H., Zhuang, A. H., Valentino, D. J., & Chu, W.-C. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.068 · Cited by 262
Auto-context and its application to high-level vision tasks
Tu, Z. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587436 · Cited by 234
Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets
Yu, L., Cheng, J.-Z., Dou, Q., Yang, X., Chen, H., Qin, J., & Heng, P.-A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8_33 · Cited by 215
Self-citationCombining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation
Chen, J., Yang, L., Zhang, Y., Alber, M., & Chen, D. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.01006 · Cited by 212
Structured class-labels in random forests for semantic image labelling
Kontschieder, P., Rota Bulo, S., Bischof, H., & Pelillo, M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126496 · Cited by 206
SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-Rays
Dai, W., Dong, N., Wang, Z., Liang, X., Zhang, H., & Xing, E. P. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_30 · Cited by 193
Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation
Tseng, K.-L., Lin, Y.-L., Hsu, W., & Huang, C.-Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.398 · Cited by 190
Rueda, S., Fathima, S., Knight, C. L., Yaqub, M., Papageorghiou, A. T., Rahmatullah, B., Foi, A., Maggioni, M., Pepe, A., Tohka, J., et al. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2276943 · Cited by 179
Li, K., & Malik, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_42 · Cited by 139
Accuracy of fetal lung volume assessed by three‐dimensional sonography
Ruano, R., Martinovic, J., Dommergues, M., Aubry, M. C., Dumez, Y., & Benachi, A. (2005) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.2624 · Cited by 124
Cascaded Fully Convolutional Networks for automatic prenatal ultrasound image segmentation
Wu, L., Xin, Y., Li, S., Wang, T., Heng, P.-A., & Ni, D. (2017) · 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) · doi:10.1109/isbi.2017.7950607 · Cited by 111
Self-citationLearning-based prediction of gestational age from ultrasound images of the fetal brain
Namburete, A. I. L., Stebbing, R. V., Kemp, B., Yaqub, M., Papageorghiou, A. T., & Alison Noble, J. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.12.006 · Cited by 97 · cited 2×
“Localizing fetus also facilitates plenty of automated applications, such as key plane detection, volume stitching and longitudinal analysis [3], [13], [14].”
MethodFast Fully Automatic Segmentation of the Human Placenta from Motion Corrupted MRI
Alansary, A., Kamnitsas, K., Davidson, A., Khlebnikov, R., Rajchl, M., Malamateniou, C., Rutherford, M., Hajnal, J. V., Glocker, B., Rueckert, D., et al. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_68 · Cited by 77
Three-dimensional first trimester fetal volumetry: comparison with crown rump length
Aviram, R., Shpan, D. K., Markovitch, O., Fishman, A., & Tepper, R. (2004) · Early Human Development · doi:10.1016/j.earlhumdev.2004.02.005 · Cited by 75
Fine-Grained Recurrent Neural Networks for Automatic Prostate Segmentation in Ultrasound Images
Yang, X., Yu, L., Wu, L., Wang, Y., Ni, D., Qin, J., & Heng, P.-A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10761 · Cited by 73
Self-citationStandard Plane Localization in Ultrasound by Radial Component Model and Selective Search
Ni, D., Yang, X., Chen, X., Chin, C.-T., Chen, S., Heng, P. A., Li, S., Qin, J., & Wang, T. (2014) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2014.06.006 · Cited by 65 · cited 3×
“Localizing fetus also facilitates plenty of automated applications, such as key plane detection, volume stitching and longitudinal analysis [3], [13], [14].”
BackgroundMethodSelf-citationYaqub, M., Javaid, M. K., Cooper, C., & Noble, J. A. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2284025 · Cited by 61
Towards Automatic Semantic Segmentation in Volumetric Ultrasound
Yang, X., Yu, L., Li, S., Wang, X., Wang, N., Qin, J., Ni, D., & Heng, P.-A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_81 · Cited by 61
Self-citationStevenson, G. N., Collins, S. L., Ding, J., Impey, L., & Noble, J. A. (2015) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2015.07.021 · Cited by 46
Barel, O., Maymon, R., Vaknin, Z., Tovbin, J., & Smorgick, N. (2013) · Prenatal Diagnosis · doi:10.1002/pd.4250 · Cited by 45
Automatic Segmentation of Antenatal 3-D Ultrasound Images
Anquez, J., Angelini, E. D., Grange, G., & Bloch, I. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2237400 · Cited by 42
Three‐dimensional ultrasound imaging of the fetal skull and face
Tutschek, B., Blaas, H. ‐. K., Abramowicz, J. S., Baba, K., Deng, J., Lee, W., Merz, E., Platt, L. D., Pretorius, D. H., Timor‐Tritsch, I. E., et al. (2017) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.17436 · Cited by 41
Dahdouh, S., Angelini, E. D., Grangé, G., & Isabelle Bloch, A. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.12.005 · Cited by 39
Martins, W. P., Ferriani, R. A., Nastri, C. O., & Filho, F. M. (2008) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2008.02.005 · Cited by 32
Microvascular imaging of thick placenta with fetal growth restriction
Hata, T., Kanenishi, K., Yamamoto, K., AboEllail, M. A. M., Mashima, M., & Mori, N. (2018) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.18837 · Cited by 30
SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-raysPreprint
Dai, W., Doyle, J. C., Liang, X., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.08770 · Cited by 27
Odeh, M., Hirsh, Y., Degani, S., Grinin, V., Ophir, E., & Bornstein, J. (2008) · Journal of Ultrasound in Medicine · doi:10.7863/jum.2008.27.3.373 · Cited by 26
Dall’Asta, A., Schievano, S., Bruse, J. L., Paramasivam, G., Kaihura, C. T., Dunaway, D., & Lees, C. C. (2017) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.02.007 · Cited by 26
Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical SegmentationPreprint
Tseng, K.-L., Lin, Y.-L., Hsu, W. H., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.07754 · Cited by 26
Volumetric Segmentation of Key Fetal Brain Structures in 3D Ultrasound
Yaqub, M. K., Cuingnet, R., Napolitano, R., Roundhill, D. N., Papageorghiou, A. T., Ardon, R., & Noble, J. A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-319-02267-3_4 · Cited by 20
Fast Registration of 3D Fetal Ultrasound Images Using Learned Corresponding Salient Points
Gómez, A., Bhatia, K. K., Tharin, S., Housden, R. J., Toussaint, N., & Schnabel, J. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67561-9_4 · Cited by 18
The predictive value of first trimester fetal volume measurements, a prospective cohort study
Smeets, N. A. C., Winkens, B., Prudon, M., van de Ven, J., Gondrie, V. P. J., van Deursen, F., & Oei, S. G. (2012) · Early Human Development · doi:10.1016/j.earlhumdev.2012.11.001 · Cited by 12
Meengeonthong, D., Luewan, S., Sirichotiyakul, S., & Tongsong, T. (2017) · Journal of Clinical Ultrasound · doi:10.1002/jcu.22441 · Cited by 12
Simcox, L. E., Higgins, L. E., Myers, J., & Johnstone, E. (2017) · Journal of Ultrasound in Medicine · doi:10.7863/ultra.16.03045 · Cited by 12
3D Ultrasound image segmentation: A SurveyPreprint
Mozaffari, M. H., & Lee, W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09811 · Cited by 11
Automatic fetal weight estimation using 3D ultrasonography
Feng, S., Zhou, K. S., & Lee, W. (2012) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.911736 · Cited by 9
Research works printed but not linked: 1
- callen, 2011, Ultrasonography in Obstetrics and Gynecology E-Book
Cited by
Breast cancer detection using deep learning: Datasets, methods, and challenges ahead
din, N. M. U., Dar, R. A., Rasool, M., & Assad, A. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106073 · Cited by 363
Deep reinforcement learning in medical imaging: A literature review
Zhou, S. K., Le, H. N., Luu, K., V Nguyen, H., & Ayache, N. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102193 · Cited by 215
A review on deep-learning algorithms for fetal ultrasound-image analysis
Fiorentino, M. C., Villani, F. P., Di Cosmo, M., Frontoni, E., & Moccia, S. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102629 · Cited by 200
Zhang, Y., Liao, Q., Ding, L., & Zhang, J. (2022) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2022.102088 · Cited by 197
AUNet: attention-guided dense-upsampling networks for breast mass segmentation in whole mammograms
Sun, H., Li, C., Liu, B., Liu, Z., Wang, M., Zheng, H., Feng, D. D., & Wang, S. (2019) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab5745 · Cited by 172
Metadata
- Authors
- Yang, X., Yu, L., Li, S., Wen, H., Luo, D., Bian, C., Qin, J., Ni, D., & Heng, P.-A.
- Affiliations
- Chinese University of Hong Kong (HK)
- Shenzhen Maternity and Child Healthcare Hospital (CN)
- Shenzhen University (CN)
- Hong Kong Polytechnic University (HK)
- ORCID
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-01
- Volume
- 38
- Issue
- 1
- Pages
- 180-193
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2884034690
- Cited by
- 115
- References
- 62
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 16 · 2023: 16 · 2022: 26 · 2021: 13 · 2020: 14 · 2019: 11
- FWCI
- 5.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61571304, 81771598)
- Shenzhen Peacock Plan (KQTD2016053112051497)
- Research Grants Council of the Hong Kong Special Administrative Region (14225616)
- Hong Kong Innovation and Technology Commission (GHP/002/13SZ)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Keywords
- semantic segmentation, volumetric ultrasound imaging, prenatal ultrasound, 3D ultrasound, placenta segmentation, recurrent neural networks, boundary ambiguity
- MeSH terms
- Algorithms, Female, Fetus, Humans, Pregnancy, Ultrasonography, Prenatal, Neural Networks, Computer, Imaging, Three-Dimensional
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.