AI-enabled Parkinson's disease screening using smile videos
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Parkinson's disease (PD) diagnosis is challenging owing to insufficient access to clinical care. We present an efficient and accessible artificial intelligence-driven PD screening method leveraging the largest video dataset of facial expressions from 1452 unique participants, including 391 with PD - 300 of whom have been clinically diagnosed and 91 of whom self-reported the condition. METHODS: We recruited individuals across multiple countries - primarily North America - via social media, email outreach, and a PD research registry; patients undergoing in-person PD assessments at a U.S. clinic; clients of a U.S.-based PD wellness center and their caregivers; and individuals in Bangladesh identified as being at high risk for PD. Participants used an online tool to record themselves (either at home or in a clinical setting) mimicking three facial expressions (i.e., smile, disgust, and surprise). Facial landmarks and action unit-based features were extracted to quantify hypomimia. Machine-learning models were trained on these features to distinguish between individuals with and without PD. The model's generalizability was tested on external test datasets (from the U.S. clinic and Bangladesh). RESULTS: An ensemble of models trained on smile videos achieved an accuracy of 87.9 ± 0.1% and an area under the receiver operating characteristic curve (AUROC) of 89.3 ± 0.3% in 10-fold cross-validation, with a 76.8 ± 0.4% sensitivity, 91.4 ± 0.3% specificity, 73.3 ± 0.5% positive predictive value (PPV), and 92.7 ± 0.1% negative predictive value (NPV). On the U.S. clinic test set, it achieved an 80.3 ± 1.6% accuracy and an 83.3 ± 1.4% AUROC, with a 80.0 ± 2.5% sensitivity, and 80.5 ± 2.0% specificity. On the test set from Bangladesh, performance reached an 85.3 ± 1.4% accuracy with an 81.5 ± 1.8% AUROC. The specificity, sensitivity, and NPV remained competitive, while PPV declined to 35.7 ± 4.8%. No detectable bias was observed across sex and ethnic subgroups, except on the test dataset from Bangladesh, for which performance was significantly better for female participants. CONCLUSIONS: Smiling videos can effectively differentiate between individuals with and without PD, offering a potentially easy, accessible, and cost-efficient way to screen for PD, especially when access to clinical diagnosis is limited. (Funded by the National Institute of Neurological Disorders and Stroke of the National Institutes of Health number, P50NS108676 and others.).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Further studies show promise of AI applications in optimizing cognitive test administration and scoring across diverse cultures and health literacy levels.59,60”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [59]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Self-citationSilhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Goetz, C. G., Tilley, B. C., Shaftman, S. R., Stebbins, G. T., Fahn, S., Martinez‐Martin, P., Poewe, W., Sampaio, C., Stern, M. B., Dodel, R., et al. (2008) · Movement Disorders · doi:10.1002/mds.22340 · Cited by 7,536
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Dauer, W., & Przedborski, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00568-3 · Cited by 5,469
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
Bro, R., & Smilde, A. K. (2014) · Anal. Methods · doi:10.1039/c3ay41907j · Cited by 3,038
The Emerging Evidence of the Parkinson Pandemic
Dorsey, E. R., Sherer, T., Okun, M. S., & Bloem, B. R. (2018) · Journal of Parkinson’s Disease · doi:10.3233/jpd-181474 · Cited by 1,977
Self-citationOpenface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
OpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
The Duchenne smile: Emotional expression and brain physiology: II.
Ekman, P., Davidson, R. J., & Friesen, W. V. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.58.2.342 · Cited by 1,371
Central limit theorem: the cornerstone of modern statistics
Kwak, S. G., & Kim, J. H. (2017) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2017.70.2.144 · Cited by 1,062
Blumer, A., Ehrenfeucht, A., Haussler, D., & Warmuth, M. K. (1987) · Information Processing Letters · doi:10.1016/0020-0190(87)90114-1 · Cited by 1,054
Accuracy of clinical diagnosis of Parkinson disease: A systematic review and meta-analysis
Rizzo, G., Copetti, M., Arcuti, S., Martino, D., Fontana, A., & Logroscino, G. (2016) · Neurology · doi:10.1212/wnl.0000000000002350 · Cited by 870
Effect of Data Scaling Methods on Machine Learning Algorithms and Model Performance
Ahsan, M., Mahmud, M., Saha, P., Gupta, K., & Siddique, Z. (2021) · Technologies · doi:10.3390/technologies9030052 · Cited by 744
Upton, G. J. G. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982890 · Cited by 606
The Evolution of Boosting Algorithms: From Machine Learning to Statistical Modelling
Binder, H., Gefeller, O., Schmid, M., & Mayr, A. (2014) · Methods of Information in Medicine · doi:10.3414/me13-01-0122 · Cited by 412
Lever, J., Krzywinski, M., & Altman, N. (2016) · Nature Methods · doi:10.1038/nmeth.3945 · Cited by 395
Understanding and interpreting confidence and credible intervals around effect estimates
Hespanhol, L., Vallio, C. S., Costa, L. M., & Saragiotto, B. T. (2019) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2018.12.006 · Cited by 390
Yang, Y., Yuan, Y., Zhang, G., Wang, H., Chen, Y.-C., Liu, Y., Tarolli, C. G., Crepeau, D., Bukartyk, J., Junna, M. R., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01932-x · Cited by 296
Boosting Algorithms: A Review of Methods, Theory, and Applications
Ferreira, A. J., & Figueiredo, M. A. T. (2012) · Ensemble Machine Learning · doi:10.1007/978-1-4419-9326-7_2 · Cited by 295
Hybrid-Recursive Feature Elimination for Efficient Feature Selection
Jeon, H., & Oh, S. (2020) · Applied Sciences · doi:10.3390/app10093211 · Cited by 256
Prevalence of Parkinson's disease in the biracial population of Copiah County, Mississippi
Schoenberg, B. S., Anderson, D. W., & Haerer, A. F. (1985) · Neurology · doi:10.1212/wnl.35.6.841 · Cited by 247
The Role of LRRK2 in Neurodegeneration of Parkinson Disease
Rui, Q., Ni, H., Li, D., Gao, R., & Chen, G. (2018) · Current Neuropharmacology · doi:10.2174/1570159x16666180222165418 · Cited by 196
Dystonia in Parkinson’s disease
Tolosa, E., & Compta, Y. (2006) · Journal of Neurology · doi:10.1007/s00415-006-7003-6 · Cited by 176
Mendez, K. M., Reinke, S. N., & Broadhurst, D. I. (2019) · Metabolomics · doi:10.1007/s11306-019-1612-4 · Cited by 170
Analysis of facial expressions in parkinson's disease through video-based automatic methods
Bandini, A., Orlandi, S., Escalante, H. J., Giovannelli, F., Cincotta, M., Reyes-Garcia, C. A., Vanni, P., Zaccara, G., & Manfredi, C. (2017) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2017.02.006 · Cited by 167
Progression of Cognitive Decline in Parkinson’s Disease
Roheger, M., Kalbe, E., & Liepelt‐Scarfone, I. (2018) · Journal of Parkinson s Disease · doi:10.3233/jpd-181306 · Cited by 167
PEARSON'S OR SPEARMAN'S CORRELATION COEFFICIENT - WHICH ONE TO USE?
Rebekić, A., Lončarić, Z., Petrović, S., & Marić, S. (2015) · Poljoprivreda · doi:10.18047/poljo.21.2.8 · Cited by 148
Logistic Regression for Feature Selection and Soft Classification of Remote Sensing Data
Cheng, Q., Varshney, P. K., & Arora, M. K. (2006) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2006.877949 · Cited by 142
Network intrusion detection system based on recursive feature addition and bigram technique
Hamed, T. Y., Dara, R. A., & Kremer, S. C. (2017) · Computers & Security · doi:10.1016/j.cose.2017.10.011 · Cited by 127
A Literature Review on Supervised Machine Learning Algorithms and Boosting Process
Praveena, M., & Jaiganesh, V. (2017) · International Journal of Computer Applications · doi:10.5120/ijca2017914816 · Cited by 124
Trichloroethylene: An Invisible Cause of Parkinson’s Disease?
Dorsey, E. R., Zafar, M., Lettenberger, S. E., Pawlik, M. E., Kinel, D., Frissen, M., Schneider, R. B., Kieburtz, K. D., Tanner, C. M., Miranda, B. R. D., et al. (2023) · Journal of Parkinson s Disease · doi:10.3233/jpd-225047 · Cited by 102
Self-citationGeographic Variation in Neurologist Density and Neurologic Care in the United States
Lin, C. C., Callaghan, B. C., Burke, J. F., Skolarus, L. E., Hill, C. E., Magliocco, B., Esper, G. J., & Kerber, K. A. (2020) · Neurology · doi:10.1212/wnl.0000000000011276 · Cited by 90
Why does Africa have the lowest number of Neurologists and how to cover the Gap?
Kissani, N., Liqali, L., Hakimi, K., Mugumbate, J. R., Daniel, G. M., Ibrahim, E. A. A., Yewnetu, E., Belo, M., Wilmshurst, J. M., Mbélesso, P., et al. (2021) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2021.120119 · Cited by 79
Saberi, A. N., Belahcen, A., Sobra, J., & Vaimann, T. (2022) · IEEE Access · doi:10.1109/access.2022.3195939 · Cited by 77
The PARK Framework for Automated Analysis of Parkinson's Disease Characteristics
Langevin, R., Ali, M. R., Sen, T., Snyder, C., Myers, T. L., Dorsey, E. R., & Hoque, M. E. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328925 · Cited by 68
Self-citationAutomated video-based assessment of facial bradykinesia in de-novo Parkinson’s disease
Novotný, M., Tykalová, T., Růžičková, H., Růžička, E., Dušek, P., & Rusz, J. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00642-5 · Cited by 58
Pattern of neurological disease seen among patients admitted in tertiary care hospital
Chowdhury, R. N., Hasan, A. H., Rahman, Y. U., Khan, S. I., Hussain, A. R., & Ahsan, S. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-202 · Cited by 51
Current treatment of behavioral and cognitive symptoms of Parkinson's disease
Rektorová, I. (2019) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2019.02.042 · Cited by 50
Abrami, A., Gunzler, S. A., Kilbane, C., Ostrand, R., Ho, B. K., & Cecchi, G. (2020) · Journal of Medical Internet Research · doi:10.2196/21037 · Cited by 47
Bugalho, P., Ladeira, F. F., Barbosa, R. P., Marto, J. P., Borbinha, C., da Conceição, L., Salavisa, M., Saraiva, M., Meira, B., & Fernandes, M. (2021) · Movement Disorders Clinical Practice · doi:10.1002/mdc3.13262 · Cited by 45
Ensemble Logistic Regression for Feature Selection
Zakharov, R., & Dupont, P. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24855-9_12 · Cited by 42
Improving Parkinson Detection using Dynamic Features from Evoked Expressions in Video
Gomez, L. F., Morales, A., Orozco‐Arroyave, J. R., Daza, R., & Fiérrez, J. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00172 · Cited by 41
Detection of hypomimia in patients with Parkinson’s disease via smile videos
Su, G., Lin, B., Yin, J., Luo, W. F., Xu, R., Xu, J., & Dong, K. (2021) · Annals of Translational Medicine · doi:10.21037/atm-21-3457 · Cited by 35
Hypomimia in Parkinson's Disease: What Is It Telling Us?
Maycas-Cepeda, T., López‐Ruiz, P., Feliz, C., Vicente, L. G., Cobos, R. G., Arroyo, R., & Ruiz, P. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2020.603582 · Cited by 34
Behavioral disturbances in Parkinson's disease
Anderson, K. E. (2004) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2004.6.3/kanderson · Cited by 32
Meige's Syndrome During Long-term Dopaminergic Therapy in Parkinson's Disease
Weiner, W. J., & Nausieda, P. A. (1982) · Archives of Neurology · doi:10.1001/archneur.1982.00510190069027 · Cited by 30
Unmasking smiles: the influence of culture and intensity on interpretations of smiling expressions
Fang, X., Sauter, D. A., & Kleef, G. A. V. (2019) · Journal of Cultural Cognitive Science · doi:10.1007/s41809-019-00053-1 · Cited by 30
A Family With Parkinson Disease, Essential Tremor, Bell Palsy, and Parkin Mutations
Deng, H., Le, W., Hunter, C., Mejia, N. I., Xie, W., & Jankovic, J. J. (2007) · Archives of Neurology · doi:10.1001/archneur.64.3.421 · Cited by 25
Biophysical Basis of Alpha Rhythm Disruption in Alzheimer’s Disease
Sharma, R., & Nadkarni, S. (2020) · eNeuro · doi:10.1523/eneuro.0293-19.2020 · Cited by 25
Mäkinen, E., Joutsa, J., Jaakkola, E., Noponen, T., Johansson, J., Pitkonen, M., Levo, R., Mertsalmi, T. H., Scheperjans, F., & Kaasinen, V. (2019) · Journal of Neurology · doi:10.1007/s00415-019-09202-6 · Cited by 21
Menon, V. (2019) · Indian Journal of Psychological Medicine · doi:10.4103/ijpsym.ijpsym_12_19 · Cited by 9
Fast, scalable and geo-distributed PCA for big data analytics
Adnan, T. M. T., Tanjim, M. M., & Adnan, M. A. (2021) · Information Systems · doi:10.1016/j.is.2020.101710 · Cited by 8
Self-citationBell's palsy preceding Parkinson's disease: A case‐control study
Savica, R., Bower, J. H., Maraganore, D. M., Grossardt, B. R., & Rocca, W. A. (2009) · Movement Disorders · doi:10.1002/mds.22616 · Cited by 2
Fan, Q.-Y., Zhang, X.-D., Hu, Z.-D., Huang, S., Zhu, S.-G., Chen, C., Zhang, X., & Wang, J. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.961758 · Cited by 2
Research works printed but not linked: 5
- Simon P. The choice of ignorance: the debate on ethnic and racial statistics in France. In: Simon P, Piché V, Gagnon AA, eds. Social statistics and ethnic diversity: cross-national perspectives in classifications and identity politics. Cham, Switzerland: Springer, 2015:65-87.
- Lugaresi C Tang J Nash H et al. MediaPipe: a framework for perceiving and processing reality. In: Third Workshop on Computer Vision for AR/VR at IEEE Computer Vision and Pattern Recognition (CVPR) vol. 2019. Long Beach CA: IEEE 2019 (https://static1.squarespace.com/static/5c3f69e1cc8fedbc039ea739/t/5e130ff310a69061a71cbd7c/1578307584840/NewTitle_May1_MediaPipe_CVPR_CV4ARVR_Workshop_2019.pdf).
- Dietterich TG. Ensemble learning. In: Arbib MA, ed. The handbook of brain theory and neural networks, second edition. Cambridge, MA: The MIT Press, 2002:405-412.
- Polikar R. Ensemble learning. In: Zhang C, Ma Y, eds. Ensemble machine learning: methods and applications. New York, NY: Springer, 2012:1-34.
- Bower KM. When to use Fisher’s exact test. American Society for Quality Six Sigma Forum Magazine vol. 2 August 1 2003 (https://www.researchgate.net/publication/265026286_When_to_Use_Fisher’s_Exact_Test).
Cited by
Digital Technologies for Symptom Monitoring in Parkinson Disease
Chunga, N., Reddy, V., Barbosa, W., & Adams, J. (2026) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-026-01481-7 · Cited by 9
“The performance remained high when this method was tested on external datasets, with accuracies of 80.3% and 85.3% across two independent cohorts [31].”
InfluentialSelf-citationReview of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias
Breithaupt, A. G., Tang, A., Paolillo, E. W., Bibars, M., Johnson, E. C. B., Saloner, R., Possin, K. L., Windon, C. C., Hill-Jarrett, T. G., Giorgio, J., et al. (2026) · Seminars in Neurology · doi:10.1055/a-2744-9871 · Cited by 6
Validation of remote multimodal AI screening for Parkinson disease across diverse settings
Islam, M. S., Adnan, T., Abdelkader, A., Liu, Z., Ma, E., Park, S., Azad, A., Liu, P., Pawlik, M. E., Hartman, E., et al. (2026) · Communications Medicine · doi:10.1038/s43856-026-01606-6 · Cited by 1
Self-citationIslam, M. S., Park, S., Ma, E., Adnan, T., & Hoque, M. E. (2026) · Journal of Medical Internet Research · doi:10.2196/91756
“Facial expression analysis has enabled quantification of hypomimia from short recordings [12], while speech tasks such as pangram utterances or sustained phonation capture dysarthria and articulation deficits [14,49].”
InfluentialSelf-citationComputer vision, Parkinson’s disease, and the unfinished work of clinical translation
Alty, J., & Friedrich, M. U. (2026) · npj Parkinson s Disease · doi:10.1038/s41531-026-01577-4
Metadata
- Authors
- Adnan, T., Islam, M. S., Lee, S., Wasifur Rahman Chowdhury, E. M., Tithi, S. D., Noshin, K., Islam, M. R., Sarker, I., Rahman, M. S., Schneider, R. B., Adams, J. L., Dorsey, E. R., & Hoque, E.
- Affiliations
- Bangladesh University of Engineering and Technology (BD)
- University of Rochester (US)
- Department of Computer Science, University of Rochester, NY
- University of Rochester Medicine (US)
- National Institute of Neurosciences & Hospital (BD)
- ORCID
- Venue
- NEJM AI
- Publisher
- Massachusetts Medical Society
- Published
- 2025-06-26
- Volume
- 2
- Issue
- 7
- Pages
- AIoa2400950-AIoa2400950
- ISSN
- 2836-9386 (ISSN-L)
- OpenAlex
- W4411672446
- Cited by
- 5
- References
- 59
- Citations by year
- 2026: 4 · 2025: 1
- FWCI
- 1.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- NEJM AI (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- Parkinson's disease, screening, facial expression analysis, artificial intelligence, early detection
- MeSH terms
- Machine Learning, Aged, Artificial Intelligence, Facial Expression, Female, Humans, Male, Mass Screening, Middle Aged, Parkinson Disease, Smiling, Video Recording
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.