The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Unified Parkinson's disease rating scale motor examination: Are ratings of nurses, residents in neurology, and movement disorders specialists interchangeable?
Abstract
The Unified Parkinson's Disease Rating Scale (UPDRS) is widely used for the clinical evaluation of Parkinson's disease (PD). We assessed the rater variability of the UPDRS Motor examination (UPDRS‐ME) of nurse practitioners, residents in neurology, and a movement disorders specialist (MDS) compared to a senior MDS. We assessed the videotaped UPDRS‐ME of 50 PD patients. Inter‐rater and intra‐rater variability were estimated using weighted kappa (κ w) and intraclass correlation coefficients (ICC). Additionally, inter‐rater agreement was quantified by calculation of the mean difference between 2 raters and its 95% limits of agreement. Intra‐rater agreement was also estimated by calculation of a 95% repeatability limits. The κ w and ICC statistics indicated good to very good inter‐rater and intra‐rater reliability for the majority of individual UPDRS items and the sum score of the UPDRS‐ME in all raters. However, for inter‐rater agreement, it appeared that both nurses, residents, and the MDS consistently assigned higher scores than the senior MDS. Mean differences ranged between 1.7 and 5.4 (all differences P < 0.05), with rather wide 95% limits of agreement. The intra‐rater 95% repeatability limits were rather wide. We found considerable rater difference for the whole range of UPDRS‐ME scores between a senior MDS and nurse practitioners, residents in neurology, and the MDS. This finding suggests that the amount by which raters may disagree should be quantified before starting longitudinal studies of disease progression or clinical trials. Finally, evaluation of rater agreement should always include the assessment of the extent of bias between different raters. © 2005 Movement Disorder Society
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Diagnostic Criteria for Parkinson Disease
Gelb, D. J., Oliver, E., & Gilman, S. (1999) · Archives of Neurology · doi:10.1001/archneur.56.1.33 · Cited by 2,822
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
Health Measurement Scales: A Practical Guide to Their Development and Use
Vogelzang, J. L. (2015) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2015.03.007 · Cited by 2,337
The Unified Parkinson's Disease Rating Scale (UPDRS): Status and recommendations
Movement Disorder Society Task Force on Rating Scales for Parkinson's Disease (2003) · Movement Disorders · doi:10.1002/mds.10473 · Cited by 1,810
Unified Parkinson's disease rating scale characteristics and structure
Martínez‐Martín, P., Gil‐Nagel, A., Gracia, L. M., Gómez, J. B., Martínez‐Sarriés, J., Bermejo, F., & The Cooperative Multicentric Group (1994) · Movement Disorders · doi:10.1002/mds.870090112 · Cited by 796
Systematic evaluation of rating scales for impairment and disability in Parkinson's disease
Ramaker, C., Marinus, J., Stiggelbout, A. M., & van Hilten, B. J. (2002) · Movement Disorders · doi:10.1002/mds.10248 · Cited by 666
Irreversible motor impairment in young addicts ? ephedrone, manganism or both?
Sikk, K., Taba, P., Haldre, S., Bergquist, J., Nyholm, D., Zjablov, G., Asser, T., & Aquilonius, S.-M. (2007) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.2007.00818.x · Cited by 665
Statistical Techniques For Comparing Measurers And Methods Of Measurement: A Critical Review
Ludbrook, J. (2002) · Clinical and Experimental Pharmacology and Physiology · doi:10.1046/j.1440-1681.2002.03686.x · Cited by 455
Interrater reliability of the unified Parkinson's disease rating scale motor examination
Richards, M., Marder, K., Cote, L., & Mayeux, R. (1994) · Movement Disorders · doi:10.1002/mds.870090114 · Cited by 318
Siderowf, A., McDermott, M., Kieburtz, K., Blindauer, K., Plumb, S., Shoulson, I., & the Parkinson Study Group (2002) · Movement Disorders · doi:10.1002/mds.10011 · Cited by 234
Factor structure of the unified Parkinson's disease rating scale: Motor examination section
Stebbins, G. T., & Goetz, C. G. (1998) · Movement Disorders · doi:10.1002/mds.870130404 · Cited by 201
Unilateral pallidotomy in Parkinson's disease: a randomised, single-blind, multicentre trial
de Bie, R. M., de Haan, R. J., Nijssen, P. C., Rutgers, A. W. F., Beute, G. N., Bosch, D. A., Haaxma, R., Schmand, B., Schuurman, P. R., Staal, M. J., et al. (1999) · The Lancet · doi:10.1016/s0140-6736(99)03556-4 · Cited by 177
Self-citationBennett, D. A., Shannon, K. M., Beckett, L. A., Goetz, C. G., & Wilson, R. S. (1997) · Neurology · doi:10.1212/wnl.49.6.1580 · Cited by 163
Teaching tape for the motor section of the unified Parkinson's disease rating scale
Goetz, C. G., Stebbins, G. T., Chmura, T. A., Fahn, S., Klawans, H. L., & MARSDEN, C. D. (1995) · Movement Disorders · doi:10.1002/mds.870100305 · Cited by 154
van Hilten, J. J., van der Zwan, A. D., Zwinderman, A. H., & Roos, R. A. C. (1994) · Movement Disorders · doi:10.1002/mds.870090113 · Cited by 136
Test-Retest Reliability of the GO-QOL
Terwee, C. B., Gerding, M. N., Dekker, F. W., Prummel, M. F., van der Pol, J. P., & Wiersinga, W. M. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00069-4 · Cited by 97
Assuring interrater reliability for the UPDRS motor section: Utility of the UPDRS teaching tape
Goetz, C. G., & Stebbins, G. T. (2004) · Movement Disorders · doi:10.1002/mds.20220 · Cited by 95
Discriminating mild parkinsonism: Methods for epidemiological research
Camicioli, R. M., Grossmann, S. J., Spencer, P. S., Hudnell, K., & Anger, W. K. (2001) · Movement Disorders · doi:10.1002/1531-8257(200101)16:1<33::aid-mds1014>3.0.co;2-w · Cited by 60
Geminiani, G. C., Cesana, B. M., Tamma, F., Contri, P., Pacchetti, C., Carella, F., Piolti, R., Martignoni, E., Giovannini, P., Girotti, F., et al. (1991) · Movement Disorders · doi:10.1002/mds.870060411 · Cited by 47
Cited by
Neurostimulation for Parkinson's Disease with Early Motor Complications
Schuepbach, W. M. M., Rau, J., Knudsen, K., Volkmann, J., Krack, P., Timmermann, L., Hälbig, T. D., Hesekamp, H., Navarro, S. M., Meier, N., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1205158 · Cited by 1,430
Self-citationMonitoring Motor Fluctuations in Patients With Parkinson's Disease Using Wearable Sensors
Patel, S., Lorincz, K., Hughes, R., Huggins, N., Growdon, J., Standaert, D., Akay, M., Dy, J., Welsh, M., & Bonato, P. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2033471 · Cited by 623
Detecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study
Arora, S., Venkataraman, V., Zhan, A., Donohue, S., Biglan, K. M., Dorsey, E. R., & Little, M. A. (2015) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2015.02.026 · Cited by 387
Tsanas, A., Little, M. A., McSharry, P. E., & Ramig, L. O. (2011) · Journal of The Royal Society Interface · doi:10.1098/rsif.2010.0456 · Cited by 323
Walton, M. K., Powers, J. H., Hobart, J., Patrick, D., Marquis, P., Vamvakas, S., Isaac, M., Molsen, E., Cano, S., & Burke, L. B. (2015) · Value in Health · doi:10.1016/j.jval.2015.08.006 · Cited by 307
Metadata
- Authors
- Post, B., Merkus, M. P., de Bie, R. M. A., de Haan, R. J., & Speelman, J. D.
- Venue
- Movement Disorders
- Publisher
- Wiley
- Published
- 2005-08-22
- Volume
- 20
- Issue
- 12
- Pages
- 1577-1584
- ISSN
- 0885-3185 (ISSN-L)
- 1531-8257
- OpenAlex
- W1985386089
- Cited by
- 266
- References
- 25
- FWCI
- 3.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.