The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Validity of Observer-Based Aggregate Scoring Systems as Descriptors of Elbow Pain, Function, and Disability*
Abstract
Current elbow-scoring systems are based on the observer-derived assessment of a variety of clinical and functional criteria, which are scored separately and then aggregated. The aggregate score then is assigned a categorical ranking that ranges from excellent to poor. The developers of different elbow-scoring systems have chosen different outcome criteria, assigned different weights to each criterion, and accorded different ranges of values to each categorical ranking. Five different elbow-scoring systems (the Mayo elbow-performance index and the systems of Broberg and Morrey, Ewald et al., The Hospital for Special Surgery, and Pritchard) were used to evaluate the same group of patients. The validity of the scoring systems was determined with use of visual-analog scales for the assessment of pain and function, patient and physician-derived ratings of the severity of impairment of the elbow, and two functional questionnaires completed by the patient (the Disabilities of the Arm, Shoulder and Hand questionnaire and the Modified American Shoulder and Elbow Surgeons patient self-evaluation form). The study sample consisted of sixty-nine patients who had sought treatment at one of two tertiary referral clinics because of problems related to the elbow. Pearson product-moment correlation coefficients were used to compare the raw aggregate scores, and kappa statistics were used to determine the level of agreement among the categorical rankings (excellent, good, fair, and poor).Examination of the five scoring systems revealed a remarkable lack of concordance with regard to the aspects of elbow function that were assessed. Good correlation was observed when the systems were compared on the basis of raw scores (Pearson product-moment correlation coefficients, 0.79 to 0.90), but only slight-to-moderate correlation was noted when the systems were compared on the basis of categorical rankings (quadratic weighted kappa coefficients, 0.18 to 0.49). Validity testing showed the system of Ewald et al. and the Mayo elbow-performance index to be the most discriminating, the system of Pritchard to be the least discriminating, and the system of The Hospital for Special Surgery and the system of Broberg and Morrey to be intermediate. The scores determined with the elbow-scoring systems demonstrated only moderate correlation with the score for function on the visual analog scale (Pearson product-moment correlation coefficients, 0.44 to 0.66), whereas those derived from the functional questionnaires completed by the patient demonstrated moderate-to-good correlation with the score for function (Pearson product-moment correlation coefficients, 0.72 and 0.80).CLINICAL RELEVANCE: We observed a remarkable lack of agreement when five different elbow-scoring systems were used to determine categorical rankings for the same cohort of patients. The correlations between the raw aggregate scores were better. On the basis of these findings, we believe that outcomes should be expressed as raw scores rather than as categorical rankings. We also found that scores derived from patient-completed functional questionnaires correlated more closely with perceived functional loss than did those determined with aggregate elbow-scoring systems. It must be recognized that comparisons between studies that are based on different scoring systems are not valid and that the categorical rankings of different systems are not interchangeable. The outcome of therapies designed for the treatment of the elbow should be determined on the basis of a patient-derived assessment of function, a clinical examination, and an assessment of pain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Hudak, P. L., Amadio, P. C., Bombardier, C., Beaton, D., Cole, D., Davis, A., Hawker, G., Katz, J. N., Makela, M., Marx, R. G., et al. (1996) · American Journal of Industrial Medicine · doi:10.1002/(sici)1097-0274(199606)29:6<602::aid-ajim4>3.0.co;2-l · Cited by 5,025
Self-citationGraphic representation of pain
Scott, J., & Huskisson, E. C. (1976) · Pain · doi:10.1016/0304-3959(76)90113-5 · Cited by 2,706
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,299
A standardized method for the assessment of shoulder function
Richards, R. R., An, K.-N., Bigliani, L. U., Friedman, R. J., Gartsman, G. M., Gristina, A. G., Iannotti, J. P., Mow, V. C., Sidles, J. A., & Zuckerman, J. D. (1994) · Journal of Shoulder and Elbow Surgery · doi:10.1016/s1058-2746(09)80019-0 · Cited by 1,726
Self-citationA methodological framework for assessing health indices
Kirshner, B., & Guyatt, G. (1985) · Journal of Chronic Diseases · doi:10.1016/0021-9681(85)90005-0 · Cited by 1,538
Introduction to sample size determination and power analysis for clinical trials
Lachin, J. M. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90001-5 · Cited by 1,012
Clinical Measurement of Range of Motion
Gajdosik, R. L., & Bohannon, R. W. (1987) · Physical Therapy · doi:10.1093/ptj/67.12.1867 · Cited by 898
Results of delayed excision of the radial head after fracture.
Broberg, M. A., & Morrey, B. F. (1986) · The Journal of Bone & Joint Surgery · doi:10.2106/00004623-198668050-00005 · Cited by 784
Cited by
Measuring the whole or the parts?
Beaton, D. E., Katz, J. N., Fossel, A. H., Wright, J. G., Tarasuk, V., & Bombardier, C. (2001) · Journal of Hand Therapy · doi:10.1016/s0894-1130(01)80043-0 · Cited by 1,306
Self-citationAngst, F., Schwyzer, H., Aeschlimann, A., Simmen, B. R., & Goldhahn, J. (2011) · Arthritis Care & Research · doi:10.1002/acr.20630 · Cited by 592
Schmitt, J. S., & Di Fabio, R. P. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.007 · Cited by 487
Atroshi, I., Gummesson, C., Andersson, B., Dahlgren, E., & Johansson, A. (2000) · Acta Orthopaedica Scandinavica · doi:10.1080/000164700317362262 · Cited by 433
Lower Extremity-Specific Measures of Disability and Outcomes in Orthopaedic Surgery
Smith, M. V., Klein, S. E., Clohisy, J. C., Baca, G. R., Brophy, R. H., & Wright, R. W. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.j.01822 · Cited by 270
Metadata
- Authors
- TURCHIN, D. C., BEATON, D. E., & RICHARDS, R. R.
- Venue
- The Journal of Bone and Joint Surgery (American Volume)
- Published
- 1998-02
- Volume
- 80
- Issue
- 2
- Pages
- 154-162
- ISSN
- 0021-9355 (ISSN-L)
- OpenAlex
- W2102427790
- Cited by
- 271
- References
- 15
- FWCI
- 6.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Validity of Observer-Based Aggregate Scoring Systems as Descriptors of Elbow Pain, Function, and Disability*. https://app.cochat.ai/papers/10.2106/00004623-199802000-00002
- The paper
- TURCHIN, D. C., BEATON, D. E., & RICHARDS, R. R. (1998). Validity of Observer-Based Aggregate Scoring Systems as Descriptors of Elbow Pain, Function, and Disability*. The Journal of Bone and Joint Surgery (American Volume). https://doi.org/10.2106/00004623-199802000-00002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.