Artificial Intelligence in Videofluoroscopy Swallow Study Analysis: A Comprehensive Review
The DOI matches its Crossref record; 62 of the 64 references it cites were found in a registry or an index.
Abstract
Videofluoroscopic Swallowing Study (VFSS) is considered the gold standard for diagnosing swallowing disorders, or dysphagia. However, the interpretation of VFSS is susceptible to human bias and subjectivity, resulting in significant inter- and intra-patient variability. In this context, artificial intelligence (AI) has emerged as a potentially valuable tool for physicians. This study reviews state-of-the-art research utilizing AI to analyze VFSS for the assessment of swallowing disorders and to support clinical decision-making. Our comprehensive analysis highlights substantial progress in areas such as pharyngeal phase detection, segmentation and identification of the bolus and hyoid bone, and penetration-aspiration detection. Despite these advancements, an end-to-end automated AI tool for VFSS analysis has yet to be developed. However, there is considerable potential for AI applications in areas like exploring the clinical relevance of segmented or tracked components and expanding the scope to include more upper aerodigestive components in the analysis. Additionally, we discuss the limitations of current research, including the lack of publicly available datasets, the need to address the generalizability of AI models, the integration of cutting-edge AI techniques, and the clinical implications for speech-language pathologists.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“such as the fact that AI models often operate under specific assumptions”
From Artificial intelligence in assessment and intervention of speech and language disorders: A literature review (2025) · cites this paper as [13]
In the citing paper
“and the absence of comprehensive and publicly accessible datasets [13].”
From Artificial intelligence in assessment and intervention of speech and language disorders: A literature review (2025) · cites this paper as [13]
In the citing paper
“the lack of transparency and interpretability”
From Artificial intelligence in assessment and intervention of speech and language disorders: A literature review (2025) · cites this paper as [13]
In the citing paper
“researchers have highlighted that AI models used in swallowing disorders often operate under specific assumptions and lack transparency and interpretability.”
From Artificial intelligence in assessment and intervention of speech and language disorders: A literature review (2025) · cites this paper as [13]
In the citing paper
“Concurrently, the absence of comprehensive and publicly available datasets has been identified as a substantial shortcoming [13].”
From Artificial intelligence in assessment and intervention of speech and language disorders: A literature review (2025) · cites this paper as [13]
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · International Journal of Surgery · doi:10.1016/j.ijsu.2021.105906 · Cited by 11,748
A penetration-aspiration scale
Rosenbek, J. C., Robbins, J. A., Roecker, E. B., Coyle, J. L., & Wood, J. L. (1996) · Dysphagia · doi:10.1007/bf00417897 · Cited by 2,803
Evaluation metrics and statistical tests for machine learning
Rainio, O., Teuho, J., & Klén, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-56706-x · Cited by 1,338
A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIME
Salih, A. M., Raisi‐Estabragh, Z., Galazzo, I. B., Radeva, P., Petersen, S. E., Lekadir, K., & Menegaz, G. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202400304 · Cited by 897 · cited 1×
“They also employed LIME (Local Interpretable Model-Agnostic Explanation) [55] to analyze features contributing to model decisions.”
MBS Measurement Tool for Swallow Impairment—MBSImp: Establishing a Standard
Martin-Harris, B., Brodsky, M. B., Michel, Y., Castell, D. O., Schleicher, M., Sandidge, J., Maxwell, R., & Blair, J. (2008) · Dysphagia · doi:10.1007/s00455-008-9185-9 · Cited by 685
IEEE Journal of Biomedical and Health Informatics
(2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3126038 · Cited by 525
Deep learning interpretation of echocardiograms
Ghorbani, A., Ouyang, D., Abid, A., He, B., Chen, J. H., Harrington, R. A., Liang, D. H., Ashley, E. A., & Zou, J. Y. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0216-8 · Cited by 518 · cited 1×
“For example, in echocardiography, the segmentation of the left ventricle using DL has allowed researchers to calculate the volume and ejection fraction, providing valuable insights into cardiac function [56].”
Machine learning and deep learning approach for medical image analysis: diagnosis to detection
Rana, M., & Bhushan, M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-14305-w · Cited by 365
The Videofluorographic Swallowing Study
Martin-Harris, B., & Jones, B. (2008) · Physical Medicine and Rehabilitation Clinics of North America · doi:10.1016/j.pmr.2008.06.004 · Cited by 356
Qureshi, I., Yan, J., Abbas, Q., Shaheed, K., Riaz, A. B., Wahid, A., Khan, M. W. J., & Szczuko, P. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.031 · Cited by 295
Deep reinforcement learning in medical imaging: A literature review
Zhou, S. K., Le, H. N., Luu, K., V Nguyen, H., & Ayache, N. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102193 · Cited by 215
Meta-learning Approaches for Few-Shot Learning: A Survey of Recent Advances
Gharoun, H., Momenifar, F., Chen, F., & Gandomi, A. H. (2024) · ACM Computing Surveys · doi:10.1145/3659943 · Cited by 211
Celard, P., Iglesias, E. L., Sorribes-Fdez, J. M., Romero, R., Vieira, A. S., & Borrajo, L. (2023) · Neural Computing and Applications · doi:10.1007/s00521-022-07953-4 · Cited by 188
Rajati, F., Ahmadi, N., Naghibzadeh, Z. A.-S., & Kazeminia, M. (2022) · Journal of Translational Medicine · doi:10.1186/s12967-022-03380-0 · Cited by 172
Assessment and Early Diagnosis of Dysphagia
Wieseke, A., Bantz, D. L., Siktberg, L. L., & Dillard, N. (2008) · Geriatric Nursing · doi:10.1016/j.gerinurse.2007.12.001 · Cited by 105
Rommel, N., Borgers, C., Beckevoort, D. V., Goeleven, A., Dejaeger, E. W., & Omari, T. I. (2015) · International Journal of Otolaryngology · doi:10.1155/2015/780197 · Cited by 79
Dysphagia from a neurogeriatric point of view: Pathogenesis, diagnosis and management
Warnecke, T., Dziewas, R., Wirth, R., Bauer, J. M., & Prell, T. (2019) · Zeitschrift für Gerontologie und Geriatrie · doi:10.1007/s00391-019-01563-x · Cited by 67
Automatic hyoid bone detection in fluoroscopic images using deep learning
Zhang, Z., Coyle, J. L., & Sejdić, E. (2018) · Scientific Reports · doi:10.1038/s41598-018-30182-6 · Cited by 64
Deep Learning Interpretation of EchocardiogramsPreprint
Ghorbani, A., Ouyang, D., Abid, A., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/681676 · Cited by 58
Lee, J. T., Park, E., Hwang, J.-M., Jung, T.-D., & Park, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-71713-4 · Cited by 49
Kim, J. K., Choo, Y. J., Choi, G. S., Shin, H., Chang, M. C., & Park, D. (2022) · Journal of Korean Medical Science · doi:10.3346/jkms.2022.37.e42 · Cited by 48
Sejdic, E., Malandraki, G. A., & Coyle, J. L. (2019) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2875863 · Cited by 43
Nordio, S., Stadio, A. D., Koch, I., Stritoni, P., Meneghello, F., & Palmer, K. (2019) · Acta Otorhinolaryngologica Italica · doi:10.14639/0392-100x-2136 · Cited by 42
Kim, H.-I., Kim, Y., Kim, B., Shin, D. Y., Lee, S. J., & Choi, S. (2021) · Diagnostics · doi:10.3390/diagnostics11071147 · Cited by 35
Jeong, S. Y., Kim, J. M., Park, J. E., Baek, S. J., & Yang, S. N. (2023) · Scientific Reports · doi:10.1038/s41598-023-44802-3 · Cited by 31
Lee, J. T., Park, E., & Jung, T.-D. (2019) · Sensors · doi:10.3390/s19183873 · Cited by 30 · cited 2×
“They further enhanced their research [21] by developing a custom 3D CNN from the pre-trained model.”
InfluentialGrayscale medical image segmentation method based on 2D&3D object detection with deep learning
Ge, Y., Zhang, Q., Sun, Y., Shen, Y.-D., & Wang, X. (2022) · BMC Medical Imaging · doi:10.1186/s12880-022-00760-2 · Cited by 30
Automatic detection of airway invasion from videofluoroscopy via deep learning technology
Lee, S. J., Ko, J. Y., Kim, H. I., & Choi, S.-I. (2020) · Applied Sciences · doi:10.3390/app10186179 · Cited by 28 · cited 3×
“Key research findings: ● Lee et al. [47] achieved state-of-the-art results in their study on penetration-aspiration detection (Accuracy: 97.2%).”
InfluentialDeep Learning for Automatic Hyoid Tracking in Videofluoroscopic Swallow Studies
Hsiao, M., Weng, C.-H., Wang, Y.-C., Cheng, S.-H., Wei, K., Tung, P.-Y., Chen, J., Yeh, C., & Wang, T. (2022) · Dysphagia · doi:10.1007/s00455-022-10438-0 · Cited by 27
Lee, K.-S., Lee, E., Choi, B., & Pyun, S.-B. (2021) · Diagnostics · doi:10.3390/diagnostics11020300 · Cited by 25 · cited 1×
“Expanding on this, Lee et al. [22] employed a transfer learning approach classifying the VFSS frames into pharyngeal and non-pharyngeal frames (see Fig.”
Lee, D., Lee, W. H., Seo, H. G., Oh, B.-M., Lee, J. C., & Kim, H. C. (2020) · IEEE Access · doi:10.1109/access.2020.3019532 · Cited by 22
Detection of aspiration from images of a videofluoroscopic swallowing study adopting deep learning
Iida, Y., Näppi, J. J., Kitano, T., Hironaka, T., Katsumata, A., & Yoshida, H. (2023) · Oral Radiology · doi:10.1007/s11282-023-00669-8 · Cited by 22
Automated Bolus Detection in Videofluoroscopic Images of Swallowing Using Mask-RCNN
Caliskan, H., Mahoney, A. S., Coyle, J. L., & Sejdic, E. (2020) · 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) · doi:10.1109/embc44109.2020.9176664 · Cited by 19
Ariji, Y., Gotoh, M., Fukuda, M., Watanabe, S., Nagao, T., Katsumata, A., & Ariji, E. (2022) · Scientific Reports · doi:10.1038/s41598-022-21530-8 · Cited by 19
Automatic annotation of cervical vertebrae in videofluoroscopy images via deep learning
Zhang, Z., Mao, S., Coyle, J., & Sejdić, E. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102218 · Cited by 18 · cited 1×
“Similarly, Zhang et al. [46] proposed a two-stage CNN to localize and measure the cervical vertebral bodies.”
Bandini, A., Smaoui, S., & Steele, C. M. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107058 · Cited by 16
Girardi, A. M., Cardell, E. A., & Bird, S. P. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7040178 · Cited by 16
Park, D., Kim, Y., Kang, H., Lee, J., Choi, J. R., Kim, T., Lee, S.-E., Son, S., Kim, M., & Kim, I. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108241 · Cited by 16
Jeong, C., Lee, C.-S., Lim, D.-W., Noh, S.-H., Moon, H. K., Park, C., & Kim, M.-S. (2024) · Brain Sciences · doi:10.3390/brainsci14060546 · Cited by 16
Artificial intelligence and dysphagia: novel solutions to old problems
SEJDIĆ, E., KHALIFA, Y., MAHONEY, A. S., & COYLE, J. L. (2020) · Arquivos de Gastroenterologia · doi:10.1590/s0004-2803.202000000-66 · Cited by 15
Deep learning models for bolus segmentation in videofluoroscopic swallow studies
Li, W., Mao, S., Mahoney, A. S., Petković, S., Coyle, J. L., & Sejdić, E. (2024) · Journal of Real-Time Image Processing · doi:10.1007/s11554-023-01398-1 · Cited by 15
Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance Segmentation
Zeng, C., Yang, X., Smithard, D. G., Mirmehdi, M., Gambaruto, A. M., & Burghardt, T. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222212 · Cited by 14
Video-TransUNet: temporally blended vision transformer for CT VFSS instance segmentation
Zeng, C., Yang, X.-Y., Mirmehdi, M., Gambaruto, A., & Burghardt, T. (2022) · International Conference on Machine Vision · doi:10.1117/12.2679409 · Cited by 13
A Deep Learning Approach to Video Fluoroscopic Swallowing Exam Classification
Wilhelm, P., Reinhardt, J. M., & Daele, D. J. V. (2020) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi45749.2020.9098510 · Cited by 12
Kim, Y., Kim, H.-I., Park, G. S., Kim, S. Y., Choi, S.-I., & Lee, S. J. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10122681 · Cited by 12
Bandini, A., & Steele, C. M. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9629562 · Cited by 12
Reddy, C. S., Park, E., & Lee, J. T. (2023) · IEEE Access · doi:10.1109/access.2023.3315342 · Cited by 11
Li, W., Mao, S., Mahoney, A. S., Coyle, J. L., & Sejdić, E. (2024) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-024-01039-4 · Cited by 11
Temporal Micro-Action Localization for Videofluoroscopic Swallowing Study
Ruan, X., Dai, M., Chen, Z., You, Z., Zhang, Y., Li, Y., Dou, Z., & Tan, M. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3313255 · Cited by 10
Nam, K., Lee, C., Lee, T., Shin, M., Kim, B. H., & Park, J. (2024) · Diagnostics · doi:10.3390/diagnostics14131444 · Cited by 10
Use of deep learning to segment bolus during videofluoroscopic swallow studies
Shaheen, N., Burdick, R., Peña-Chávez, R., Ulmschneider, C., Yee, J., Kurosu, A., Rogus-Pulia, N., & Bednarz, B. (2024) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/ad0bb3 · Cited by 10 · cited 2×
“The constantly shifting perceptual features of the bolus during transit contribute to this challenge [32, 33].”
Measurement of laryngeal elevation by automated segmentation using Mask R-CNN
Lee, H. H., Kwon, B. M., Yang, C.-K., Yeh, C.-Y., & Lee, J. (2021) · Medicine · doi:10.1097/md.0000000000028112 · Cited by 9
Lee, J. T., & Park, E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00919-9_38 · Cited by 7 · cited 1×
“Recognizing the need for an automated method, Lee et al. [20] utilized a pre-trained 3D CNN to detect the pharyngeal phase within swallowing.”
Kim, J. K., Choo, Y. J., Choi, G. S., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-884186/v1 · Cited by 6
Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance SegmentationPreprint
Zeng, C., Yang, X., Smithard, D. G., Mirmehdi, M., Gambaruto, A. M., & Burghardt, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.11325 · Cited by 6
AI-Powered Toolkit for Automated Swallowing Kinematics Analysis in X-Ray Videofluoroscopy
Abdelaziz, M. A., Galloul, M. K., Seyam, M. A., Mohamed, A. M., Basha, T., Sejdić, E., & Khalifa, Y. (2022) · Novel Intelligent and Leading Emerging Sciences Conference (NILES) · doi:10.1109/niles56402.2022.9942378 · Cited by 5
Jeong, S. Y., Kim, J. M., Park, J. E., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-2311543/v1 · Cited by 4
Rapid Detection of Penetration-Aspiration from Fluoroscopic Videos in Dysphagia Patients
Sanjeevi, G., Gopalakrishnan, U., Pathinarupothi, R. K., Arya, C. J., & Subramania Iyer, K. (2023) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe60311.2023.00073 · Cited by 2
Self-citationVideo-TransUNet: Temporally Blended Vision Transformer for CT VFSS Instance SegmentationPreprint
Zeng, C., Yang, X., Mirmehdi, M., Gambaruto, A. M., & Burghardt, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.08315 · Cited by 1
Research works printed but not linked: 2
- LeCun Y, Bengio Y, Hinton G. Deep Learn Nat. 2015;521(7553):436–44.
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 6000–6010.
Cited by
Balo, E., Ökte, B., & Selvi Balo, S. (2025) · The European Research Journal · doi:10.18621/eurj.1677704 · Cited by 6
Kwak, S., Kim, J. K., Moon, J. S., Lee, G. W., Kim, S., & Chang, M. C. (2025) · Scientific Reports · doi:10.1038/s41598-025-10397-0 · Cited by 8
Zica, G. M., & Gonçalves, M. I. R. (2025) · Revista CEFAC · doi:10.1590/1982-0216/20252767125 · Cited by 1
Mizutani, S., Nakao, S., Sato, R., Tada, A., Amano, K., Oshio, M., Otsuka, A., Iwase, Y., & Taniguchi, H. (2025) · Oral · doi:10.3390/oral5040091 · Cited by 1
“Methods such as videofluoroscopy (VF) [4,5], videoendoscopy [6,7], electromyography [8], pharyngeal and esophageal pressure measurement [9], and pharyngeal impedance [10] have been widely used to evaluate swallowing function.”
Jeong, C., Lim, D.-W., Noh, S.-H., Moon, H., Park, C., Ko, N., & Kim, M. (2025) · Diagnostics · doi:10.3390/diagnostics16010045 · Cited by 1
“In particular, checking whether food enters the airway is an important factor in determining whether a patient should receive nutrition through a tube or orally [26].”
Metadata
- Authors
- Sanjeevi, G., Gopalakrishnan, U., Pathinarupothi, R. K., & Iyer, K. S.
- Affiliations
- Amrita Vishwa Vidyapeetham (IN)
- Amrita Institute of Medical Sciences and Research Centre (IN)
- Corresponding author
- Sanjeevi, G.
- Venue
- Dysphagia
- Published
- 2025-02-17
- Volume
- 40
- Issue
- 5
- Pages
- 1035-1048
- ISSN
- 0179-051X (ISSN-L)
- 1432-0460
- OpenAlex
- W4407632212
- Cited by
- 12
- References
- 64
- Citations by year
- 2026: 6 · 2025: 6
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Dysphagia (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Speech and Hearing › Dysphagia Assessment and Management
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- artificial intelligence, videofluoroscopic swallowing study, dysphagia, clinical decision support, speech-language pathology
- MeSH terms
- Artificial Intelligence, Cineradiography, Deglutition, Deglutition Disorders, Fluoroscopy, Humans, Pharynx, Video Recording
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.