The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Reliability of the Modified Rankin Scale Across Multiple Raters: Benefits of a Structured Interview
Abstract
Background and Purpose— The modified Rankin Scale (mRS) is widely used to assess global outcome after stroke. The aim of the study was to examine rater variability in assessing functional outcomes using the conventional mRS, and to investigate whether use of a structured interview (mRS-SI) reduced this variability. Methods— Inter-rater agreement was studied among raters from 3 stroke centers. Fifteen raters were recruited who were experienced in stroke care but came from a variety of professional backgrounds. Patients at least 6 months after stroke were first assessed using conventional mRS definitions. After completion of initial mRS assessments, raters underwent training in the use of a structured interview, and patients were re-assessed. In a separate component of the study, intrarater variability was studied using 2 raters who performed repeat assessments using the mRS and the mRS-SI. The design of the latter part of the study also allowed investigation of possible improvement in rater agreement caused by repetition of the assessments. Agreement was measured using the κ statistic (unweighted and weighted using quadratic weights). Results— Inter-rater reliability: Pairs of raters assessed a total of 113 patients on the mRS and mRS-SI. For the mRS, overall agreement between raters was 43% (κ=0.25, κ w =0.71), and for the structured interview overall agreement was 81% (κ=0.74, κ w =0.91). Agreement between raters was significantly greater on the mRS-SI than the mRS ( P <0.001). Intrarater reliability: Repeatability of both the mRS and mRS-SI was excellent (κ=0.81, κ w ≥0.94). Conclusions— Although individual raters are consistent in their use of the mRS, inter-rater variability is nonetheless substantial. Rater variability on the mRS is thus particularly problematic for studies involving multiple raters. There was no evidence that improvement in inter-rater agreement occurred simply with repetition of the assessment. Use of a structured interview improves agreement between raters in the assessment of global outcome after stroke.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Interobserver agreement for the assessment of handicap in stroke patients
van Swieten, J. C., Koudstaal, P. J., Visser, M. C., Schouten, H. J., & van Gijn, J. (1988) · Stroke · doi:10.1161/01.str.19.5.604 · Cited by 6,512
Hacke, W., Bluhmki, E., Steiner, T., Tatlisumak, T., Mahagne, M.-H., Sacchetti, M.-L., & Meier, D. (1998) · Stroke · doi:10.1161/01.str.29.10.2073 · Cited by 109
Cited by
Banks, J. L., & Marotta, C. A. (2007) · Stroke · doi:10.1161/01.str.0000258355.23810.c6 · Cited by 2,253
Clinical interpretation and use of stroke scales
Kasner, S. E. (2006) · The Lancet Neurology · doi:10.1016/s1474-4422(06)70495-1 · Cited by 934
Hill, M. D., Goyal, M., Menon, B. K., Nogueira, R. G., McTaggart, R. A., Demchuk, A. M., Poppe, A. Y., Buck, B. H., Field, T. S., Dowlatshahi, D., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30258-0 · Cited by 647
Hobart, J. C., Cano, S. J., Zajicek, J. P., & Thompson, A. J. (2007) · The Lancet Neurology · doi:10.1016/s1474-4422(07)70290-9 · Cited by 495
Tilson, J. K., Sullivan, K. J., Cen, S. Y., Rose, D. K., Koradia, C. H., Azen, S. P., Duncan, P. W., & for the Locomotor Experience Applied Post Stroke (LEAPS) Investigative Team (2010) · Physical Therapy · doi:10.2522/ptj.20090079 · Cited by 494
Metadata
- Authors
- Wilson, J. T. L., Hareendran, A., Hendry, A., Potter, J., Bone, I., & Muir, K. W.
- Venue
- Stroke
- Published
- 2005-04
- Volume
- 36
- Issue
- 4
- Pages
- 777-781
- ISSN
- 0039-2499 (ISSN-L)
- 1524-4628
- OpenAlex
- W2051777375
- Cited by
- 409
- References
- 2
- FWCI
- 10.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reliability of the Modified Rankin Scale Across Multiple Raters: Benefits of a Structured Interview. https://app.cochat.ai/papers/10.1161/01.str.0000157596.13234.95
- The paper
- Wilson, J. T. L., Hareendran, A., Hendry, A., Potter, J., Bone, I., & Muir, K. W. (2005). Reliability of the Modified Rankin Scale Across Multiple Raters: Benefits of a Structured Interview. Stroke. https://doi.org/10.1161/01.str.0000157596.13234.95
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.