Automatic hyoid bone detection in fluoroscopic images using deep learning
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The displacement of the hyoid bone is one of the key components evaluated in the swallow study, as its motion during swallowing is related to overall swallowing integrity. In daily research settings, experts visually detect the hyoid bone in the video frames and manually plot hyoid bone position frame by frame. This study aims to develop an automatic method to localize the location of the hyoid bone in the video sequence. To automatically detect the location of the hyoid bone in a frame, we proposed a single shot multibox detector, a deep convolutional neural network, which is employed to detect and classify the location of the hyoid bone. We also evaluated the performance of two other state-of-art detection methods for comparison. The experimental results clearly showed that the single shot multibox detector can detect the hyoid bone with an average precision of 89.14% and outperform other auto-detection algorithms. We conclude that this automatic hyoid bone tracking system is accurate enough to be widely applied as a pre-processing step for image processing in dysphagia research, as well as a promising development that may be useful in the diagnosis of dysphagia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 1×
“Prior 290 research [43] indicated that Faster-RCNN with inception ResNet v2 has the best object detection 291 results when compared to other modern object detection methods.”
ResultDeformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587 · cited 1×
“Traditional methods usually use sliding windows for region proposal, histograms of gradient orientation (HoG) or scale-invariant feature transform (SIFT) as feature extraction 28,29 , and support vector machine (SVM) and Boosting methods as classifiers 30,31 .”
MethodHandwritten digit recognition: applications of neural network chips and automatic learning
Le Cun, Y., Jackel, L. D., Boser, B., Denker, J. S., Graf, H. P., Guyon, I., Henderson, D., Howard, R. E., & Hubbard, W. (1989) · IEEE Communications Magazine · doi:10.1109/35.41400 · Cited by 480
Clinical Utility of the Modified Barium Swallow
Martin-Harris, B., Logemann, J. A., McMahon, S., Schleicher, M., & Sandidge, J. (2000) · Dysphagia · doi:10.1007/s004550010015 · Cited by 178
The End of Radiology? Three Threats to the Future Practice of Radiology
Chockley, K., & Emanuel, E. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2016.07.010 · Cited by 139
A comparative analysis of swallowing accelerometry and sounds during saliva swallows
Dudik, J. M., Jestrović, I., Luan, B., Coyle, J. L., & Sejdić, E. (2015) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-14-3 · Cited by 72
Self-citation
Research works printed but not linked: 35
- Sura, L., Madhavan, A., Carnaby, G. & Crary, M. A. Dysphagia in the elderly: management and nutritional considerations. Clinical Interventions in Aging 7, 287 (2012).
- Mann, G., Hankey, G. J. & Cameron, D. Swallowing disorders following acute stroke: prevalence and diagnostic accuracy. Cerebrovascular Diseases 10, 380–386 (2000). · DOI · Paper page
- Nguyen, N. P. et al. Aspiration rate following chemoradiation for head and neck cancer: an underreported occurrence. Radiotherapy and Oncology 80, 302–306 (2006). · DOI · Paper page
- Smithard, D. G. et al. The natural history of dysphagia following a stroke. Dysphagia 12, 188–193 (1997). · DOI · Paper page
- Bhattacharyya, N. The prevalence of dysphagia among adults in the united states. Otolaryngology–Head and Neck Surgery 151, 765–769 (2014). · DOI · Paper page
- Clavé, P., Terré, R., De Kraa, M. & Serra, M. Approaching oropharyngeal dysphagia. Revista Espanola de Enfermedades Digestivas 96, 119–131 (2004).
- Rofes, L. et al. Diagnosis and management of oropharyngeal dysphagia and its nutritional and respiratory complications in the elderly. Gastroenterology Research and Practice 2011 (2010). · DOI · Paper page
- Harrington, O. B. et al. Silent aspiration after coronary artery bypass grafting. The Annals of Thoracic Durgery 65, 1599–1603 (1998). · DOI
- Hinchey, J. A. et al. Formal dysphagia screening protocols prevent pneumonia. Stroke 36, 1972–1976 (2005). · DOI · Paper page
- Costa, M. M. B. Videofluoroscopy: the gold standard exam for studying swallowing and its dysfunction. Arquivos de Gastroenterologia 47, 327–328 (2010). · DOI
- O’Donoghue, S. & Bagnall, A. Videofluoroscopic evaluation in the assessment of swallowing disorders in paediatric and adult populations. Folia Phoniatrica et Logopaedica 51, 158–171 (1999). · DOI
- Hazelwood, R. J., Armeson, K. E., Hill, E. G., Bonilha, H. S. & Martin-Harris, B. Identification of swallowing tasks from a modified barium swallow study that optimize the detection of physiological impairment. Journal of Speech, Language, and Hearing Research 60, 1855–1863 (2017). · DOI
- Logemann, J. A. & Logemann, J. A. Evaluation and treatment of swallowing disorders (1983). · DOI · Paper page
- McCullough, G. H. et al. Inter-and intrajudge reliability for videofluoroscopic swallowing evaluation measures. Dysphagia 16, 110–118 (2001). · DOI
- Kellen, P. M., Becker, D. L., Reinhardt, J. M. & Van Daele, D. J. Computer-assisted assessment of hyoid bone motion from videofluoroscopic swallow studies. Dysphagia 25, 298–306 (2010). · DOI
- Hossain, I., Roberts-South, A., Jog, M. & El-Sakka, M. R. Semi-automatic assessment of hyoid bone motion in digital videofluoroscopic images. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 2, 25–37 (2014).
- Lee, J. C. et al. A supporting platform for semi-automatic hyoid bone tracking and parameter extraction from videofluoroscopic images for the diagnosis of dysphagia patients. Dysphagia 32, 315–326 (2017). · DOI
- Kim, W.-S., Zeng, P., Shi, J. Q., Lee, Y. & Paik, N.-J. Semi-automatic tracking, smoothing and segmentation of hyoid bone motion from videofluoroscopic swallowing study. PloS one 12, e0188684 (2017). · DOI
- Wang, S. & Summers, R. M. Machine learning and radiology. Medical Image Analysis 16, 933–951 (2012). · DOI · Paper page
- Sun, W., Tseng, T.-L. B., Zhang, J. & Qian, W. Enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data. Computerized Medical Imaging and Graphics 57, 4–9 (2017). · DOI · Paper page
- Le, M. H. et al. Automated diagnosis of prostate cancer in multi-parametric mri based on multimodal convolutional neural networks. Physics in Medicine & Biology 62, 6497 (2017). · DOI · Paper page
- Dong, Y., Pan, Y., Zhang, J. & Xu, W. Learning to read chest x-ray images from 16000+ examples using CNN. In 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), 51–57 (IEEE, 2017). · DOI · Paper page
- Girshick, R., Donahue, J., Darrell, T. & Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 580–587 (2014). · DOI · Paper page
- Keraudren, K., Kyriakopoulou, V., Rutherford, M., Hajnal, J. V. & Rueckert, D. Localisation of the brain in fetal mri using bundled sift features. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 582–589 (Springer, 2013). · DOI
- Tang, J., Rangayyan, R. M., Xu, J., El Naqa, I. & Yang, Y. Computer-aided detection and diagnosis of breast cancer with mammography: recent advances. IEEE Transactions on Information Technology in Biomedicine 13, 236–251 (2009). · DOI · Paper page
- Acharya, T. & Ray, A. K. Image processing: principles and applications (John Wiley & Sons, 2005). · DOI
- Girshick, R. Fast R-CNN. In Proceedings of the IEEE International Conference on Computer Vision, 1440–1448 (2015). · DOI · Paper page
- Ren, S., He, K., Girshick, R. & Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems, 91–99 (2015).
- Liu, W. et al. Ssd: Single shot multibox detector. In European Conference on Computer Vision, 21–37 (Springer, 2016). · DOI · Paper page
- Fisher, E. et al. Hyoid bone fusion and bone density across the lifespan: prediction of age and sex. Forensic science, medicine, and pathology 12, 146–157 (2016). · DOI
- Wang, G., Kalra, M. & Orton, C. G. Machine learning will transform radiology significantly within the next 5 years. Medical Physics (2017). · DOI
- Szegedy, C. et al. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–9 (2015). · DOI · Paper page
- Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014). · arXiv
- Long, J., Shelhamer, E. & Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3431–3440 (2015). · DOI · Paper page
- Lin, T.-Y. et al. Feature pyramid networks for object detection. arXiv preprint arXiv:1612.03144 (2016). · arXiv
Cited by
New Generation Deep Learning for Video Object Detection: A Survey
Jiao, L., Zhang, R., Liu, F., Yang, S., Hou, B., Li, L., & Tang, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3053249 · Cited by 259
Lee, J. T., Park, E., Hwang, J.-M., Jung, T.-D., & Park, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-71713-4 · Cited by 49
Donohue, C., Khalifa, Y., Perera, S., Sejdić, E., & Coyle, J. L. (2021) · Dysphagia · doi:10.1007/s00455-020-10177-0 · Cited by 41
Self-citationLee, J. T., Park, E., & Jung, T.-D. (2019) · Sensors · doi:10.3390/s19183873 · Cited by 30
Automatic detection of airway invasion from videofluoroscopy via deep learning technology
Lee, S. J., Ko, J. Y., Kim, H. I., & Choi, S.-I. (2020) · Applied Sciences · doi:10.3390/app10186179 · Cited by 28
“One of those studies investigated the accuracy of a deep learning model for the automatic identification of the hyoid bone [16].”
BackgroundMethod
Metadata
- Authors
- Zhang, Z., Coyle, J. L., & Sejdić, E.
- Venue
- Scientific Reports
- Published
- 2018-08-17
- Volume
- 8
- Issue
- 1
- Pages
- 12310-12310
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2886531606
- Cited by
- 64
- References
- 10
- FWCI
- 10.78
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic hyoid bone detection in fluoroscopic images using deep learning. https://app.cochat.ai/papers/10.1038/s41598-018-30182-6
- The paper
- Zhang, Z., Coyle, J. L., & Sejdić, E. (2018). Automatic hyoid bone detection in fluoroscopic images using deep learning. Scientific Reports. https://doi.org/10.1038/s41598-018-30182-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.