Spatio-temporal visual attention modelling of standard biometry plane-finding navigation
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
We present a novel multi-task neural network called Temporal SonoEyeNet (TSEN) with a primary task to describe the visual navigation process of sonographers by learning to generate visual attention maps of ultrasound images around standard biometry planes of the fetal abdomen, head (trans-ventricular plane) and femur. TSEN has three components: a feature extractor, a temporal attention module (TAM), and an auxiliary video classification module (VCM). A soft dynamic time warping (sDTW) loss function is used to improve visual attention modelling. Variants of the model are trained on a dataset of 280 video clips, each containing one of the three biometry planes and lasting 3-7 seconds, with corresponding real-time recorded gaze tracking data of an experienced sonographer. We report the performances of the different variants of TSEN for visual attention prediction at standard biometry plane detection. The best model performance is achieved using bi-directional convolutional long-short term memory (biCLSTM) in both TAM and VCM, and it outperforms a previous spatial model on all static and dynamic saliency metrics. As an auxiliary task to validate the clinical relevance of the visual attention modelling, the predicted visual attention maps were used to guide standard biometry plane detection in consecutive US video frames. All spatio-temporal TSEN models achieve higher scores compared to a spatial-only baseline; the best performing TSEN model achieves F1 scores on these standard biometry planes of 83.7%, 89.9% and 81.1%, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
4 million neonatal deaths: When? Where? Why?
Lawn, J. E., Cousens, S., & Zupan, J. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71048-5 · Cited by 3,670
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollár, P. (2017) · arXiv · doi:10.48550/arxiv.1708.02002 · Cited by 1,227
On the theory of dynamic programming
Bellman, R. (1952) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.38.8.716 · Cited by 998
Papageorghiou, A. T., Ohuma, E. O., Altman, D. G., Todros, T., Ismail, L. C., Lambert, A., Jaffer, Y. A., Bertino, E., Gravett, M. G., Purwar, M., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(14)61490-2 · Cited by 870
Self-citationSonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound
Baumgartner, C. F., Kamnitsas, K., Matthew, J., Fletcher, T. P., Smith, S., Koch, L. M., Kainz, B., & Rueckert, D. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2712367 · Cited by 416
Intra‐ and interobserver variability in fetal ultrasound measurements
Sarris, I., Ioannou, C., Chamberlain, P., Ohuma, E., Roseman, F., Hoch, L., Altman, D. G., Papageorghiou, A. T., & for the International Fetal and Newborn Growth Consortium for the 21 Century (INTERGROWTH‐21) (2012) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.10082 · Cited by 195
Self-citationYaqub, M., Kelly, B., Papageorghiou, A. T., & Noble, J. A. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24574-4_82 · Cited by 56
Self-citation
Cited by
Use of artificial intelligence and deep learning in fetal ultrasound imaging
Ramirez Zegarra, R., & Ghi, T. (2023) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.26130 · Cited by 102
Drukker, L., Sharma, H., Droste, R., Alsharid, M., Chatelain, P., Noble, J. A., & Papageorghiou, A. T. (2021) · Scientific Reports · doi:10.1038/s41598-021-92829-1 · Cited by 59
Self-citationDeep learning fetal ultrasound video model match human observers in biometric measurements
Płotka, S., Klasa, A., Lisowska, A., Seliga-Siwecka, J., Lipa, M., Trzciński, T., & Sitek, A. (2022) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac4d85 · Cited by 57
Sharma, H., Drukker, L., Chatelain, P., Droste, R., Papageorghiou, A. T., & Noble, J. A. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101973 · Cited by 48
Self-citationAlsharid, M., Cai, Y., Sharma, H., Drukker, L., Papageorghiou, A. T., & Noble, J. A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102630 · Cited by 25
Self-citation
Metadata
- Authors
- Cai, Y., Droste, R., Sharma, H., Chatelain, P., Drukker, L., Papageorghiou, A. T., & Noble, J. A.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 65
- Pages
- 101762
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W3036634920
- Cited by
- 41
- References
- 10
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Spatio-temporal visual attention modelling of standard biometry plane-finding navigation. https://app.cochat.ai/papers/10.1016/j.media.2020.101762
- The paper
- Cai, Y., Droste, R., Sharma, H., Chatelain, P., Drukker, L., Papageorghiou, A. T., & Noble, J. A. (2020). Spatio-temporal visual attention modelling of standard biometry plane-finding navigation. Medical Image Analysis. https://doi.org/10.1016/j.media.2020.101762
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.