Convolutional Neural Networks for Automated Fetal Cardiac Assessment using 4D B-Mode Ultrasound
Open accessAbstract
Structural and functional assessment of the fetal heart is currently performed using ultrasound-based imaging biomarkers that require annotation by a trained observer. This requires experience and expertise and is subject to observer variability. In this work, a Convolutional Neural Network (CNN) was implemented for segmentation of the fetal annulus in 250 cases to provide automated measurements of the excursion of the mitral and tricuspid valve annular planes (TAPSE/MAPSE). These were evaluated against manual annotation. After training, the CNN achieved a Dice score of 0.78 (±0.02;σ) and the excursion measures had an RMSE of <; 0.16 cm. Results show the feasibility of using a CNN to detect the fetal annuli and measure TAPSE/MAPSE for cardiac functional assessment.
AI snapshot
Written from the paper’s full text.
TL;DR
This paper implements a U-net CNN to segment fetal mitral and tricuspid annuli from 4D STIC B-mode ultrasound and automatically compute TAPSE/MAPSE. It reports feasibility, with good segmentation for high-quality data but weaker automated MAPSE correlation than expert agreement.
Key findings
- The CNN achieved Dice scores of 0.78 for tricuspid annulus (TA) segmentation and 0.77 for mitral annulus (MA) segmentation; for volumes with quality score ≥ 8, Dice was 0.85 for both TA and MA.
- Automated TAPSE measurement had correlation coefficient r = 0.61 with reference and RMSE = 0.14 cm; expert-to-expert TAPSE correlation was r = 0.89.
- Automated MAPSE measurement had correlation coefficient r = 0.30 with reference and RMSE = 0.18 cm; expert-to-expert MAPSE correlation was r = 0.77.
- TAPSE/MAPSE were calculated for 24 randomly chosen volumes; outliers were removed using median absolute deviation × 2.5, discarding measurements greater than 1.13 cm for TAPSE and 0.74 cm for MAPSE, removing 2 and 5 volumes respectively.
Methods
- Prospective observational study approved by ethics committees; participants > 18 years old with singleton, healthy pregnancy were recruited. A total of 295 fetal heart 4D STIC volumes were acquired at 4-chamber view from 95 participants on a GE Voluson E8 with a RAB 6-D 3D transducer; mean gestational age was 30.7 weeks (range 22.9–38.0).
- Volumes were quality-scored out of 10; only scores ≥ 6 were used, yielding 150 4D volumes. Manual labelling was performed on 250 3D volumes: the first frame of the 150 chosen volumes plus the 20th frame of a randomly chosen 100 of those 150. Data were split 80:10:10 for training, test, and validation, with augmentation including flips, rotation at ±5° and ±10° in the y-direction, and added speckle noise.
- A U-net architecture was implemented in Keras with TensorFlow, trained on two NVIDIA GeForce GTX 1080 GPUs, using Adam, Dice loss, 100 epochs, batch size 5, and 10% validation split. Two separate networks were used for MA and TA segmentation. TAPSE/MAPSE were computed from the z-plane centroid displacement of the annulus segmentation, without manually identifying end-systolic and end-diastolic frames; Bland-Altman plots, correlation coefficients, and RMSE were used for evaluation.
Limitations
- The paper states that fetal movements can shift valve orientation over the cardiac cycle, and the naïve method does not account for this when computing planar excursion. It also states that some outliers came from five-chamber-view acquisitions including the aorta, causing large segmentation error, and that fetal position/apex rotation is another source of error.
- The paper states that limited pre- and post-processing was performed, that the clinical acquisition system has since been superseded, and that temporal information in the 4D data was not used; it suggests LSTM exploration and a multi-class CNN instead of two separate binary segmentation networks.
- The text makes evident that frames from a single patient may appear in both training and test sets, though the authors state bias chances were reduced because first and 20th frames were ensured to be at different cardiac phases. The dataset was also considered small enough that data augmentation was needed to train the network.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 8 cited sources checked · 0 supported · 0 flagged
- Findingown data
The root mean squared error between automated and reference MAPSE measurements was 0.18 cm.
“The r for automated MAPSE measurement and reference was 0.30 and between experts was 0.77 and the RMSE was 0.18.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Findingreasoning
For some subjects, the automated method over-estimates displacement compared to human measurement.
“Results show for some subjects the method over-estimates displacement compared to human measurement.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Findingown data
The CNN achieved a Dice similarity coefficient of 0.78 for tricuspid annulus (TA) segmentation.
“Dice Similarity Co-efficient values of 0.78 for TA segmentation and 0.77 for MA segmentation were achieved.”
Quote in the paperSubstantial claim - Findingown data
The automated TAPSE measurement had a correlation coefficient r = 0.61 with the reference measurement.
“For the automated TAPSE measurement we obtained a correlation coefficient r = 0.61, while that between experts was r = 0.89.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Findingnone given
TAPSE/MAPSE values for good quality data were better than those with low quality scores.
“The TAPSE/MAPSE values for good quality data were better than those that had low quality scores.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Findingown data
The root mean squared error between automated and reference TAPSE measurements was 0.14 cm.
“The root mean squared error (RMSE) between the automated and reference measurements was 0.14cm.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Findingown data
For samples with a quality score of 8 or above, Dice similarity was 0.85 for both TA and MA segmentation.
“For samples with a quality score of ≥ 8, Dice Similarity was 0.85 for both TA and MA segmentation.”
Quote in the paperNot a substantial claim - Findingown data
The automated MAPSE measurement had a correlation coefficient r = 0.30 with the reference measurement.
“The r for automated MAPSE measurement and reference was 0.30 and between experts was 0.77 and the RMSE was 0.18.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Findingreasoning
Some outliers were excluded because they were acquired in a five chamber view of the heart (including the aorta), which caused a large segmentation error.
“This meant that some outliers were excluded as described as these were acquired in a five chamber view of the heart (including the aorta) which caused a large segmentation error.”
Quote in the paperNot a substantial claim - Findingown data
The correlation coefficient between two experts for TAPSE measurement was r = 0.89.
“For the automated TAPSE measurement we obtained a correlation coefficient r = 0.61, while that between experts was r = 0.89.”
Quote in the paperNot a substantial claim - Findingown data
The CNN achieved a Dice similarity coefficient of 0.77 for mitral annulus (MA) segmentation.
“Dice Similarity Co-efficient values of 0.78 for TA segmentation and 0.77 for MA segmentation were achieved.”
Quote in the paperSubstantial claim - Findingown data
The correlation coefficient between two experts for MAPSE measurement was r = 0.77.
“The r for automated MAPSE measurement and reference was 0.30 and between experts was 0.77 and the RMSE was 0.18.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The automated tool can potentially provide functional cardiac measurements where training is limited and skills lacking.
“As such, this tool can potentially provide functional cardiac measurements where training is limited and skills lacking.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Interpretationown data
The feasibility of using a CNN to detect the fetal annuli and measure TAPSE/MAPSE for cardiac functional assessment is shown.
“Results show the feasibility of using a CNN to detect the fetal annuli and measure TAPSE/MAPSE for cardiac functional assessment.”
- Also stated in: § 4. DISCUSSION · boosted
“This work has demonstrated the feasibility of automation of TAPSE/MAPSE measurement using 4D fetal cardiac ultrasound.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Also stated in: § 4. DISCUSSION · boosted
- Interpretationown data
The method's performance is promising and strong for high quality data.
“The performance of the method is promising and strong for high quality data, pointing towards the feasibility of the work.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
- Classified as probably not a substantial claim. 13
- May combine two claims. 8
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenBatch normalization and dropout were added to avoid over-fitting.
“The only changes were addition of the 3D layers to 2D and the addition of batch normalization and dropout to avoid over-fitting.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenManual labelling was performed on 250 3D volumes based on an annulus segmentation protocol designed by experts to ensure labelling uniformity.
“Manual labelling was performed on 250 3D volumes based on an annulus segmentation protocol designed by experts to ensure labelling uniformity.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThe automated tool can potentially reduce operator variability and reduce the time required to measure TAPSE/MAPSE.
“This work has shown that automation of TAPSE and MAPSE measurements is possible which is important as it points to augmentation of this method to develop a tool that can reduce operator variability and reduce the time required to measure TAPSE/MAPSE.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationCNNs have found success in many computer vision tasks and are now being applied by research groups for segmentation of the heart.
“CNN have found success in many computer vision tasks and are now being applied by research groups for segmentation of the heart.”
Quote in the paperNot a substantial claim0 of 3 sources checkedClassified as probably not a substantial claim.
Study design and conductreasoningA quality assurance scoring system was designed in consultation with experts to reduce the performance influence of differing operators.
“To reduce performance influence of differing operators, a quality assurance scoring system was designed in consultation with the experts.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe correlation coefficient for MAPSE is lower than that for TAPSE for both experts and the proposed automated method, mainly owing to rotational movement of the mitral annulus due to circular fiber orientation in the left ventricle.
“It is observed that the correlation coefficient for experts as well as proposed method for MAPSE is lower than those for TAPSE, mainly owing to the rotational movement of the MA due to the circular fiber orientation in left ventricle, in addition to the planar excursion which makes the MAPSE measurement more challenging than TAPSE.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
- The authors state this as an assumption: The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationOutliers were removed using a median absolute deviation (MAD) * 2.5 cut-off, discarding measurements greater than 1.13 cm for TAPSE and 0.74 cm for MAPSE.
“Of these, outliers were removed using the median absolute deviation (MAD) * 2.5 to provide a cut-off as previously described [12].Measurements greater than 1.13cm and 0.74cm for TAPSE and MAPSE were discarded, which removed 2 and 5 data volumes, from each group respectively.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [12] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenLimited pre- and post-processing was performed on the data.
“Limited pre-and post-processing was performed to the data which shows the potential for this technique with technical improvements and improved testing.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenOnly volumes with a quality score of 6 or above were considered for this study, and 150 4D volumes satisfied this criterion.
“Only volumes with a score ≥ of 6 and above were considered for this study.150 4D volumes satisfied the above criteria.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenThe study did not take into account the temporal information available in the 4D data.
“In this study, we do not take into account the temporal information available in the 4D data, which can be explored using LSTM's to possibly improve performance.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningFrames from a single patient may be in both training and test sets, but chances of bias were reduced because the first and the 20th frame were ensured to be at different phases of the cardiac cycle.
“Frames from a single patient may be in both training and test sets, but chances of bias were reduced as the first and the 20 th frame were ensured to be at different phases of the cardiac cycle.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningData augmentation methods were used because the data set was considered small to train a network from scratch.
“As the size of the data set was considered small to train a network from scratch, data augmentation methods were used to create more samples, using flip up/down, flip left/right and rotation at ±5 • and ±10 • in the y-direction.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationTAPSE reflects longitudinal function and is an indicator of disease progression.
“This distance has been shown to reflect longitudinal function and be an indicator of disease progression [2].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [2] source
Not checked in the free run.
May combine two claims.
PremisereasoningManual TAPSE/MAPSE measurement stages introduce potential error and require time, pointing to the need for automation of the measurement of these imaging biomarkers.
“All these stages introduce potential error and require time, which points to the need for automation of the measurement of these imaging biomarkers.”
Quote in the paperSubstantial claim- Rests on an assumption: Manual TAPSE/MAPSE measurement is subject to observer variability.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA semi-automated algorithm based on cross correlation to track the tricuspid annulus points has been proposed to obtain TAPSE.
“A semi-automated algorithm has been proposed [9], based on cross correlation to track the tricuspid annulus (TA) points to obtain the TAPSE.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [9] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAutomated mitral and tricuspid annular excursion have been explored in adult hearts using additional M-mode and ECG information.
“Automated mitral and tricuspid annular excursion have been explored in adult hearts by Storve et al. [7,8] using additional M-mode and ECG information to obtain the results.”
Quote in the paperNot a substantial claim0 of 2 sources checked
The paper relies on this without support.
Manual TAPSE/MAPSE measurement is subject to observer variability.
“This requires experience and expertise and is subject to observer variability.”
The authors state this as an assumption.
The two frames with the largest displacement from the centroid of the first frame in the positive/negative direction correspond to the end-diastolic and end-systolic frames.
“The two frames with the largest displacement from the centroid of the first frame in the positive / negative direction were considered to correspond to the ED / ES frame.”
The authors state this as an assumption.
The displacement in the z-plane of the centroid (cm) is the annular excursion value (TAPSE/MAPSE).
“The displacement in the z-plane of the centroid (cm) was considered the particular annular excursion value (TAPSE/MAPSE).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Reported training and test counts do not match the stated split
MajorAn 80:10:10 split of the 250 labelled volumes would give 200 training, 25 test and 25 validation volumes. The results instead say 150 manually annotated samples were used for training and 100 volumes for testing.
“The labelled data set was divided into training, test and validation sets in the proportion 80:10:10 respectively.”
“The U-net CNN took approximately 8 hours to train, on TA/MA samples obtained using data augmentation techniques on 150 of the manually annotated samples and tested on 100 volumes.”
Abstract RMSE bound excludes the reported MAPSE result
MinorThe abstract says the excursion measurements had an RMSE below 0.16 cm, but the reported MAPSE RMSE is 0.18 cm.
“the excursion measures had an RMSE of < 0.16 cm”
“The r for automated MAPSE measurement and reference was 0.30 and between experts was 0.77 and the RMSE was 0.18.”
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.03.013 · Cited by 4,147 · see citing works
Spatio‐temporal image correlation (STIC): new technology for evaluation of the fetal heart
DeVore, G. R., Falkensammer, P., Sklansky, M. S., & Platt, L. D. (2003) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.217 · Cited by 362 · see citing works
Looney, P., Stevenson, G. N., Nicolaides, K. H., Plasencia, W., Molloholli, M., Natsis, S., & Collins, S. L. (2018) · JCI Insight · doi:10.1172/jci.insight.120178 · Cited by 111 · cited 1× · see citing works
“mented and successfully applied in 3D ultrasound with good performance compared to manual segmentation [5, 6].”
MethodSelf-citationUltrasound assessment of fetal cardiac function
Crispi, F., Valenzuela‐Alcaraz, B., Cruz‐Lemini, M., & Gratacós, E. (2013) · Australasian Journal of Ultrasound in Medicine · doi:10.1002/j.2205-0140.2013.tb00242.x · Cited by 70 · see citing works
Messing, B., Gilboa, Y., Lipschuetz, M., et al. (2013) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.12375 · Cited by 62 · see citing works
Towards Automatic Semantic Segmentation in Volumetric Ultrasound
Yang, X., Yu, L., Li, S., Wang, X., Wang, N., Qin, J., Ni, D., & Heng, P.-A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_81 · Cited by 61 · see citing works
Stevenson, G. N., Collins, S. L., Welsh, A. W., Impey, L. W., & Noble, J. A. (2015) · Radiology · doi:10.1148/radiol.14132363 · Cited by 38 · see citing works
Self-citationRealtime Automatic Assessment of Cardiac Function in Echocardiography
Storve, S., Grue, J. F., Samstad, S., Dalen, H., Haugen, B. O., & Torp, H. (2016) · IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control · doi:10.1109/tuffc.2016.2518306 · Cited by 23 · see citing works
Mitral Valve Leaflets Segmentation in Echocardiography using Convolutional Neural Networks
Costa, E., Martins, N., Sultan, M. S., et al. (2019) · IEEE Portuguese Meeting on Bioengineering · doi:10.1109/enbeng.2019.8692573 · Cited by 23 · see citing works
Realtime automatic detection of heart failure in echocardiography
Storve, S., Grue, J. F., Samstad, S., Dalen, H., Haugen, B. O., & Torp, H. (2014) · 2014 IEEE International Ultrasonics Symposium · doi:10.1109/ultsym.2014.0262 · Cited by 3 · see citing works
Maffessanti, F., Gripari, P., Pontone, G., et al. (2011) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep Learning Strategies for Ultrasound in Pregnancy
Diniz, P. H. B., Yin, Y., & Collins, S. (2020) · EMJ Reproductive Health · doi:10.33590/emjreprohealth/20-00100 · Cited by 32 · see citing works
- Authors
- Philip, M. E., Sowmya, A., Avnet, H., Ferreira, A., Stevenson, G., & Welsh, A.
- Affiliations
- UNSW Sydney (AU)
- Sheba Medical Center (IL)
- Royal Hospital for Women (AU)
- Venue
- 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019)
- Publisher
- IEEE
- Published
- 2019-04
- Pages
- 824-828
- OpenAlex
- W2958958034
- Cited by
- 18
- References
- 12
- Citations by year
- 2025: 2 · 2024: 6 · 2023: 4 · 2022: 3 · 2021: 1 · 2020: 2
- FWCI
- 0.48
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- IEEE International Symposium on Biomedical Imaging (ISBI) (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Epidemiology › Congenital Heart Disease Studies
- Keywords
- convolutional neural networks, tricuspid annular plane systolic excursion, mitral annulus, tricuspid annulus, observer variability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review