Interpretable video-based tracking and quantification of parkinsonism clinical motor states
Open accessPublished version of a preprint
The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
Quantification of motor symptom progression in Parkinson’s disease (PD) patients is crucial for assessing disease progression and for optimizing therapeutic interventions, such as dopaminergic medications and deep brain stimulation. Cumulative and heuristic clinical experience has identified various clinical signs associated with PD severity, but these are neither objectively quantifiable nor robustly validated. Video-based objective symptom quantification enabled by machine learning (ML) introduces a potential solution. However, video-based diagnostic tools often have implementation challenges due to expensive and inaccessible technology, and typical “black-box” ML implementations are not tailored to be clinically interpretable. Here, we address these needs by releasing a comprehensive kinematic dataset and developing an interpretable video-based framework that predicts high versus low PD motor symptom severity according to MDS-UPDRS Part III metrics. This data driven approach validated and robustly quantified canonical movement features and identified new clinical insights, not previously appreciated as related to clinical severity, including pinkie finger movements and lower limb and axial features of gait. Our framework is enabled by retrospective, single-view, seconds-long videos recorded on consumer-grade devices such as smartphones, tablets, and digital cameras, thereby eliminating the requirement for specialized equipment. Following interpretable ML principles, our framework enforces robustness and interpretability by integrating (1) automatic, data-driven kinematic metric evaluation guided by pre-defined digital features of movement, (2) combination of bi-domain (body and hand) kinematic features, and (3) sparsity-inducing and stability-driven ML analysis with simple-to-interpret models. These elements ensure that the proposed framework quantifies clinically meaningful motor features useful for both ML predictions and clinical analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“PENSIEVE-AI uses an image-based deep learning model to detect mild cognitive impairment (MCI) and dementia based on touch-screen tablet drawing tasks,60”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [60]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Further studies show promise of AI applications in optimizing cognitive test administration and scoring across diverse cultures and health literacy levels.59,60”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [60]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · cited 1×
“…seven different ML algorithms: (1) linear discriminant analysis (LDA) 62 ; (2) logistic regression (LR) 63 ; (3) support vector machine (SVM) 64 ; (4) random forest (RF) 65 ; (5) adaptive-boosted trees (AdaBoost; AB) 66 ; (6) K-nearestneighbors(KNN) 67 ; and, (7) Gaussian naive Bayes (GNB) 68 .”
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · cited 1×
“For the “ on ” state, participants were given a standard morning dose of Levodopa medication and evaluated one hour later.”
BackgroundData Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032 · cited 1×
“For the gait task, participantswere instructed to walk towardand away from the camera fora minimum of 10 meters (30 feet) each way.”
MethodFrom local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551 · cited 1×
“Weperforma comprehensivekinematicfeaturestabilityanalysistoidentifyconserved featuresacrossensembleofmodels 32 – 34 and feature contributions to model outputs via tree SHAP (Shapley Additive exPlanations) analysis 35 .”
MethodGoetz, C. G., Tilley, B. C., Shaftman, S. R., Stebbins, G. T., Fahn, S., Martinez‐Martin, P., Poewe, W., Sampaio, C., Stern, M. B., Dodel, R., et al. (2008) · Movement Disorders · doi:10.1002/mds.22340 · Cited by 7,536 · cited 1×
“Clinical signs such as fi nger tapping slowness and decrement(bradykinesia)withintheMDS-UPDRShavebeendiscoveredby clinicalheuristicsandcodi fi ed by expert consensus, precluding well-vali-dated, objective, data-driven and quanti fi able assessment of patients.”
BackgroundHearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243 · cited 8×
“In terms of classi fi cation accuracy, SVM and LR achieved an average accuracy of 72%, with LDA, KNN, and GNB following closely at 68%.”
InfluentialOpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
DeepLabCut: markerless pose estimation of user-defined body parts with deep learning
Mathis, A., Mamidanna, P., Cury, K. M., Abe, T., Murthy, V. N., Mathis, M. W., & Bethge, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0209-y · Cited by 5,187
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Research works printed but not linked: 1
- Hand, D. J. & Yu, K. Idiot’s Bayes? Not so stupid after all? Int Stat. Rev. 69, 385–398 (2001).
Cited by
Computer Vision in Clinical Neurology: A Review
Friedrich, M. U., Relton, S. D., Wong, D., & Alty, J. (2025) · JAMA Neurology · doi:10.1001/jamaneurol.2024.5326 · Cited by 34
Video‐Based Data‐Driven Models for Diagnosing Movement Disorders: Review and Future Directions
Martínez‐García‐Peña, R., Koens, L. H., Azzopardi, G., & Tijssen, M. A. J. (2025) · Movement Disorders · doi:10.1002/mds.30327 · Cited by 26
“Separate cameras can target speci fi c body regions (such as hands in PD 23 and head in dystonia) 58 for focused analysis.”
di Biase, L., Pecoraro, P. M., & Bugamelli, F. (2025) · Sensors · doi:10.3390/s25206373 · Cited by 24
“Deng and colleagues [132] analyzed smartphone/tablet videos to quantify motor severity and treatment state in parkinsonism.”
Virameteekul, S., Shin, C., Hirczy, S. S., Sarva, H., Paul, S. S., Maetzler, W., Mirelman, A., Schneider, R. B., Hausdorff, J. M., Vizcarra, J. A., et al. (2025) · Movement Disorders · doi:10.1002/mds.70097 · Cited by 14
Digital Technologies for Symptom Monitoring in Parkinson Disease
Chunga, N., Reddy, V., Barbosa, W., & Adams, J. (2026) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-026-01481-7 · Cited by 9
“Novel machine learning frameworks are also being developed to assess single-view and seconds-long videos (e.g., finger tap - ping) captured on consumer-grade devices—like tablets and smartphones—to classify motor severity in PD [41].”
Metadata
- Authors
- Deng, D., Ostrem, J. L., Nguyen, V., Cummins, D. D., Sun, J., Pathak, A., Little, S., & Abbasi-Asl, R.
- Affiliations
- University of California, San Francisco (US)
- Google (United States) (US)
- Corresponding author
- Little, Simon
- Abbasi-Asl, Reza
- ORCID
- Venue
- npj Parkinson's Disease
- Published
- 2024-06-25
- Volume
- 10
- Issue
- 1
- Pages
- 122-122
- ISSN
- 2373-8057 (ISSN-L)
- PMC
- PMC11199701
- OpenAlex
- W4399999456
- Cited by
- 25
- References
- 70
- Citations by year
- 2026: 11 · 2025: 13 · 2024: 1
- FWCI
- 6.69
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Parkinson s Disease (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- UCSF Innovation Ventures
- Topics
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Balance, Gait, and Falls Prevention
- Keywords
- Parkinson's disease, parkinsonism, motor impairment severity, model interpretability, kinematic parameters, MDS-UPDRS III, gait, axial symptoms, smartphone-based assessment, disease progression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interpretable video-based tracking and quantification of parkinsonism clinical motor states. https://app.cochat.ai/papers/10.1038/s41531-024-00742-x
- The paper
- Deng, D., Ostrem, J. L., Nguyen, V., Cummins, D. D., Sun, J., Pathak, A., Little, S., & Abbasi-Asl, R. (2024). Interpretable video-based tracking and quantification of parkinsonism clinical motor states. npj Parkinson's Disease. https://doi.org/10.1038/s41531-024-00742-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.