The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Clinician versus machine: Reliability and responsiveness of motor endpoints in Parkinson's disease
Open accessAbstract
Background Enhancing the reliability and responsiveness of motor assessments required to demonstrate therapeutic efficacy is a priority for Parkinson's disease (PD) clinical trials. The objective of this study is to determine the reliability and responsiveness of a portable kinematic system for quantifying PD motor deficits as compared to clinical ratings.Methods Eighteen PD patients with subthalamic nucleus deep-brain stimulation (DBS) performed three tasks for evaluating resting tremor, postural tremor, and finger-tapping speed, amplitude, and rhythm while wearing a wireless motion-sensor unit (Kinesia) on the more-affected index finger. These tasks were repeated three times with DBS turned off and at each of 10 different stimulation amplitudes chosen to yield small changes in treatment response. Each task performance was video-recorded for subsequent clinician rating in blinded, randomized order. Test-retest reliability was calculated as intraclass correlation (ICC) and sensitivity was calculated as minimal detectable change (MDC) for each DBS amplitude.Results ICCs for Kinesia were significantly higher than those for clinician ratings of finger-tapping speed (p < 0.0001), amplitude (p < 0.0001), and rhythm (p < 0.05), but were not significantly different for evaluations of resting or postural tremor. Similarly, Kinesia scores yielded a lower MDC as compared with clinician scores across all finger-tapping subscores (p < 0.0001), but did not differ significantly for resting and postural tremor.Conclusions The Kinesia portable kinematic system can provide greater test-retest reliability and sensitivity to change than conventional clinical ratings for measuring bradykinesia, hypokinesia, and dysrhythmia in PD patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This clinical assessment is subject to bias from placebo effects, anxiety, or the opposite “white coat syndrome,” where patients apply an extra effort, resulting in a performance that does not fully reflect patients' abilities (107, 108).”
From A Review on Wearable Technologies for Tremor Suppression (2021) · cites this paper as [108]
Experimental — accuracy not yet measuredIn the citing paper
“In PD, wearables were used to detect and quantify cardinal motor symptoms including bradykinesia [19], tremor [20, 21], and postural sway [22, 23] as well as medication-evoked adverse symptoms such as dyskinesia [24–27] and motor fluctuations [28, 29].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Experimental Design and Data Analysis for Biologists
Quinn, G. P., & Keough, M. J. (2002) · doi:10.1017/cbo9780511806384 · Cited by 10,674 · cited 1×
“Tukey's HSD test was chosen to correct for the experiment-wise error rate from making multiple comparisons [30].”
MethodGoetz, C. G., Tilley, B. C., Shaftman, S. R., Stebbins, G. T., Fahn, S., Martinez‐Martin, P., Poewe, W., Sampaio, C., Stern, M. B., Dodel, R., et al. (2008) · Movement Disorders · doi:10.1002/mds.22340 · Cited by 7,536
Self-citationQUANTIFYING TEST-RETEST RELIABILITY USING THE INTRACLASS CORRELATION COEFFICIENT AND THE SEM
Weir, J. P. (2005) · The Journal of Strength and Conditioning Research · doi:10.1519/15184.1 · Cited by 4,864
Measurement in Medicine: The Analysis of Method Comparison Studies
Altman, D. G., & Bland, J. M. (1983) · The Statistician · doi:10.2307/2987937 · Cited by 4,300
Experimental Design and Data Analysis for Biologists
Reid, J. R. W. (2003) · Austral Ecology · doi:10.1046/j.1442-9993.2003.01318.x · Cited by 1,542
Interpreting Change Scores of Tests and Measures Used in Physical Therapy
Haley, S. M., & Fragala-Pinkham, M. A. (2006) · Physical Therapy · doi:10.1093/ptj/86.5.735 · Cited by 940
Steffen, T. M., & Seney, M. (2008) · Physical Therapy · doi:10.2522/ptj.20070214 · Cited by 898
Monitoring Motor Fluctuations in Patients With Parkinson's Disease Using Wearable Sensors
Patel, S., Lorincz, K., Hughes, R., Huggins, N., Growdon, J., Standaert, D., Akay, M., Dy, J., Welsh, M., & Bonato, P. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2033471 · Cited by 623
Cited by
Sorted by citations
Items 101–155 of 155
Kinematic Metrics from a Wireless Stylus Quantify Tremor and Bradykinesia in Parkinson’s Disease
Maldonado-Naranjo, A. L., Koop, M. M., Hogue, O., Alberts, J. L., & Machado, A. G. (2019) · Parkinson s Disease · doi:10.1155/2019/6850478 · Cited by 10
Biomechanical System Versus Observational Rating Scale for Parkinson’s Disease Tremor Assessment
Chan, P.-Y., Ripin, Z. M., Halim, S. A., Kamarudin, M., Ng, K., Eow, G., Tan, K., Chun, F.-C.-A., Then, L., Soong, N., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-44142-1 · Cited by 11
Yu, N., Yu, Y., Lin, J., Yang, Y., Wu, J., Liang, S., Wu, J., & Han, J. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107005 · Cited by 10
Effects of Age and Gender on Hand Motion Tasks
Au, W. L., Seah, I. S. H., Li, W., & Tan, L. C. S. (2015) · Parkinson s Disease · doi:10.1155/2015/862427 · Cited by 10
Rate control deficits during pinch grip and ankle dorsiflexion in early-stage Parkinson’s disease
Chung, J. W., Knight, C. A., Bower, A. E., Martello, J. P., Jeka, J. J., & Burciu, R. G. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282203 · Cited by 9
Objective assessment of the effects of opicapone in Parkinson’s disease through kinematic analysis
Bologna, M., Guerra, A., Colella, D., Birreci, D., Costa, D. D., Cannavacciuolo, A., Angelini, L., Paparella, G., Antonini, A., Berardelli, A., et al. (2023) · Neurological Sciences · doi:10.1007/s10072-023-07233-6 · Cited by 9
Lee, P., Chen, T., Lin, H., Yeh, L.-R., Liu, C.-H., & Chen, Y. (2024) · Bioengineering · doi:10.3390/bioengineering11060548 · Cited by 9
Evaluation of a sensor algorithm for motor state rating in Parkinson's disease
Buvarp, D., Thomas, I., Ericsson, A. B., Johansson, A., Medvedev, A. V., Memedi, M., Nyholm, D., Ohlsson, F., Senek, M., Spira, J., et al. (2019) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2019.03.022 · Cited by 9
Bradykinesia in motoneuron diseases
Paparella, G., Ceccanti, M., Colella, D., Cannavacciuolo, A., Guerra, A., Inghilleri, M., Berardelli, A., & Bologna, M. (2021) · Clinical Neurophysiology · doi:10.1016/j.clinph.2021.08.006 · Cited by 9
Touchscreen-based finger tapping: Repeatability and configuration effects on tapping performance
Makai‐Bölöni, S., Thijssen, E., van Brummelen, E. M. J., Groeneveld, G. J., & Doll, R. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0260783 · Cited by 8
Electrophysiological correlates of dynamic cycling in Parkinson’s disease
Joshi, P., Shigo, L. M., Smith, B. M., Kilbane, C., Guha, A., Loparo, K. A., Ridgel, A. L., & Shaikh, A. G. (2025) · Clinical Neurophysiology · doi:10.1016/j.clinph.2025.03.018 · Cited by 8
Proposal of a health care network based on big data analytics for PDs
Carnimeo, L., Trotta, G. F., Brunetti, A., Cascarano, G. D., Buongiorno, D., Loconsole, C., Sciascio, E. D., & Bevilacqua, V. (2019) · The Journal of Engineering · doi:10.1049/joe.2018.5142 · Cited by 8
Gaprielian, P., Scott, S. H., Lowrey, C. R., Reid, S., Pari, G., & Levy, R. (2019) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-019-0598-5 · Cited by 8
Quantification of discrete behavioral components of the MDS-UPDRS
Brooks, C., Eden, G., Chang, A., Demanuele, C., Erb, M. K., Kabiri, N. S., Moss, M. B., Bhangu, J. S., & Thomas, K. C. (2018) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2018.10.043 · Cited by 8
Kilinçalp, G., Sjöström, A.-C., Eriksson, B., Holmberg, B., Constantinescu, R., & Bergquist, F. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12010027 · Cited by 8
Current perspectives on the role of telemedicine in the management of Parkinson’s disease
Eisenberg, J. L., Hou, J. G., & Barbour, P. J. (2018) · Smart Homecare Technology and TeleHealth · doi:10.2147/shtt.s152018 · Cited by 7
Fundarò, C., Cavalieri, C., Pinna, G. D., Giardini, A., Mancini, F., & Casale, R. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.00040 · Cited by 7
Mishra, A., Bajaj, V., Fitzpatrick, T., Watts, J., Khojandi, A., & Ramdhani, R. (2024) · Sensors · doi:10.3390/s24134296 · Cited by 6
Konzepte zu Diagnose, Verlaufs- und Sturzrisikobeurteilung bei neurologischen Gangstörungen
Wuehr, M., Jooshani, N., & Schniepp, R. (2021) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/a-1418-8476 · Cited by 6
Zhai, S., Liaw, A. I., Shen, J., Xu, Y., Svetnik, V., FitzGerald, J. J., Antoniades, C. A., Holder, D., Dockendorf, M. F., Ren, J., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1500811 · Cited by 5
Wearable Wireless Sensors for Rehabilitation
Dorsch, A. K., King, C., & Dobkin, B. H. (2016) · Springer eBooks · doi:10.1007/978-3-319-28603-7_29 · Cited by 4
Kim, Y., Smith, B. M., Shigo, L. M., Shaikh, A. G., Loparo, K. A., & Ridgel, A. L. (2024) · Sensors · doi:10.3390/s24227364 · Cited by 5
Clinical Whole-Body Gait Characterization Using a Single RGB-D Sensor
Boborzi, L., Bertram, J., Schniepp, R., Decker, J., & Wuehr, M. (2025) · Sensors · doi:10.3390/s25020333 · Cited by 4
Mobile health technologies for the management of Parkinson’s disease
Bougea, A. M. (2025) · Expert Review of Neurotherapeutics · doi:10.1080/14737175.2025.2580468 · Cited by 4
Future Perspectives: Assessment Tools and Rehabilitation in the New Age
Gilmore, G., & Jog, M. (2017) · Springer eBooks · doi:10.1007/978-3-319-46062-8_10 · Cited by 4
A Multi-modal Tool Suite for Parkinson’s Disease Evaluation and Grading
Cascarano, G. D., Brunetti, A., Buongiorno, D., Trotta, G. F., Loconsole, C., Bortone, I., & Bevilacqua, V. (2019) · Smart innovation, systems and technologies · doi:10.1007/978-981-13-8950-4_24 · Cited by 4
Tang, P., Hou, C., Liu, Y., Liu, P., Zhang, X., Zhang, L., Li, C., & Li, R. (2019) · Journal of Parkinson s Disease · doi:10.3233/jpd-191695 · Cited by 3
A Rapid Motor Task-Based Screening Tool for Parkinsonism in Community-Based Studies
Dlamini, W. W., Nielsen, S., Ushe, M., Nelson, G., & Racette, B. A. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.653066 · Cited by 3
Austin, D. S., Dixon, M. J., Tulimieri, D. T., Cashaback, J. G. A., & Semrau, J. A. (2023) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-023-01240-6 · Cited by 3
Kim, Y., Smith, B. E., Shigo, L. M., Shaikh, A. G., Loparo, K. A., & Ridgel, A. L. (2024) · Neurorehabilitation and neural repair · doi:10.1177/15459683241268556 · Cited by 3
Lee, P., Chen, T., Liu, C.-H., Wang, C.-Y., Huang, G., & Lu, N. (2022) · Biosensors · doi:10.3390/bios12050295 · Cited by 3
Task independent identification of sensor location on upper limb from orientation data
Lambrecht, S., Romero, J. P., Benito‐León, J., Rocón, E., & Pons, J. L. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6945147 · Cited by 3
Zindashti, N. J., Rahmati, Z., Mohebbi, A., & Behzadipour, S. (2024) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-024-01321-0 · Cited by 2
Motor segmentation: a key neuromuscular impairment in people with parkinson’s disease
Daniels, R. J., & Knight, C. A. (2025) · Experimental Brain Research · doi:10.1007/s00221-025-07189-3 · Cited by 2
Closed-Loop Deep Brain Stimulation for Parkinson’s Disease
Eitan, R., Bergman, H., & Israel, Z. H. (2018) · Springer eBooks · doi:10.1007/978-3-319-23693-3_10 · Cited by 3
Ruonala, V., Pekkonen, E., Airaksinen, O., Kankaanpaa, M. J., Karjalainen, P. A., & Rissanen, S. M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0266936 · Cited by 2
Toward Quantitative Neurology: Sensors to Assess Motor Deficits in Dementia
Hamedani, M., Caneva, S., Mancardi, G., Alì, P. A., Fiaschi, P., Massa, F., Schenone, A. E., & Pardini, M. (2024) · Journal of Alzheimer s Disease · doi:10.3233/jad-240559 · Cited by 2
Instrumental assessment of Sit-to-Stand in Parkinson's disease: a scoping review
Trucco, M., Ditella, R., Dhimitriadhi, A., Occhetto, B., Ballesio, M., Job, M., & Testa, M. (2026) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-026-02023-5 · Cited by 1
Lefaivre, S. C. (2016) · Scholars Commons (Wilfrid Laurier University) · Cited by 1
Research and Implementation of Parkinson’s Dyskinesia Monitoring Service System
Wang, J., Yao, Z., Li, B., Wang, S., Wu, Q., & Wang, P. (2020) · International Symposium on Computational Intelligence and Design · doi:10.1109/iscid51228.2020.00028 · Cited by 1
Ward, rehabilitation, and clinic-based wearable devices
Parrington, L., Wilhelm, J., Pettigrew, N. C., Scanlan, K. T., & King, L. A. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818914-6.00004-1 · Cited by 1
Lima, V., Vieira, M. F., Pereira, A. A., & Andrade, A. D. O. (2022) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-030-70601-2_51 · Cited by 1
Ranking of Dystonia Severity by Pairwise Video Comparison
Ellermeyer, T., Otte, K., Heinrich, F., Mansow‐Model, S., Kayser, B., Lipp, A., Seidel, A., Krause, P., Lauritsch, K., Gusho, E., et al. (2016) · Movement Disorders Clinical Practice · doi:10.1002/mdc3.12340
Ault, D. L. (2016) · OhioLink ETD Center (Ohio Library and Information Network)
Technologies for the management of hyperkinetic movement disorders
Schönberg, L., Bouça‐Machado, R., Kauppila, L. A., Leitão, M., Cacho, R., & Ferreira, J. J. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-99494-1.00003-4
Thilak, K. D., Kalaiselvi, K., Bhuvaneswari, R., Prakash, U. M., Kumaresan, K., & Matheen, M. A. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-1115-8.ch012
Exercise‐Induced Modulation of Subthalamic Activity and Intra‐Nuclear Connectivity
Joshi, P., Shigo, L. M., Smith, B., Kilbane, C., Guha, A., Raina, M. S., Sinha, A. K., Loparo, K. A., Ridgel, A. L., & Shaikh, A. G. (2026) · European Journal of Neuroscience · doi:10.1111/ejn.70388
Smid, A., Elting, J. W. J., van Laar, T., ten Kate, J. M., Oterdoom, D. L. M., Tamási, K., van Dijk, J. M. C., & Drost, G. (2026) · Journal of Neural Transmission · doi:10.1007/s00702-026-03132-0
Virbel-Fleischman, C. (2021) · theses.fr (ABES) · doi:10.70675/21583008z772az4c86z822dza5cca46513d5
Accuracy and reliability of the Kinect Version 2 for clinical measurement of motor functionPreprint
Kayser, B., Otte, K., & Mansow‐Model, S. (2016) · OSF Preprints (OSF Preprints)
Maheswari, K., Sundaresan, U., Manivannan, K., & Periyasamy, C. (2026) · Futurity Medicine. · doi:10.57125/fem.2026.03.30.05
Babakhani, A. A., Papp, A. K., Halász, L., Erőss, L., Szilágyi, A., Miklós, G., Fekete, G., Bognár, L., Barsi, P., Muthuraman, M., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-10321079/v1
Clinical Validity of Wrist‐ and Trunk‐Worn Sensor‐Derived Data Models in Parkinson’s Disease
Sun, Y., Day, S. E., Walters, K. R., & Schrag, A. E. (2026) · Parkinson s Disease · doi:10.1155/padi/8598501
Smartwatch-Based Screening to Identify Candidates for Deep Brain Stimulation in Parkinson’s Disease
Fadil, R., Walter, B. L., Kuhlman, G. D., Zaidi, S. A., & Heldman, D. A. (2026) · Digital Biomarkers · doi:10.1159/000553397
Self-citation
Metadata
- Authors
- Heldman, D. A., Espay, A. J., LeWitt, P. A., & Giuffrida, J. P.
- Affiliations
- Great Lakes NeuroTechnologies (United States) (US)
- University of Cincinnati (US)
- Wayne State University (US)
- Corresponding author
- Heldman, Dustin A.
- Venue
- Parkinsonism & Related Disorders
- Publisher
- Elsevier BV
- Published
- 2014-06
- Volume
- 20
- Issue
- 6
- Pages
- 590-595
- ISSN
- 1353-8020 (ISSN-L)
- PMC
- PMC4028404
- OpenAlex
- W2020188512
- Cited by
- 156
- References
- 44
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 14 · 2023: 13 · 2022: 13 · 2021: 16 · 2020: 11 · 2019: 18 · 2018: 18 · 2017: 10 · 2016: 21 · 2015: 7 · 2014: 1
- FWCI
- 8.43
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Parkinsonism & Related Disorders (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (1r43ns074627-01a1)
- National Institute of Mental Health (K23MH092735)
- National Institute of Neurological Disorders and Stroke (1R43NS074627-01A1, R44NS065554, R43 NS074627, R43NS081902)
- Topics
- Health Sciences › Medicine › Clinical Neurology › Deep Brain Stimulation and Movement Disorders
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Health Sciences › Medicine › Clinical Neurology › Parkinson's Disease Mechanisms and Treatments
- Keywords
- Parkinson's disease, motor function assessment
- MeSH terms
- Adult, Aged, Biomechanical Phenomena, Double-Blind Method, Female, Humans, Male, Middle Aged, Parkinson Disease, Psychomotor Disorders, Severity of Illness Index, Tremor, Video Recording, Reproducibility of Results, Hypokinesia, Subthalamic Nucleus, Deep Brain Stimulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
