The DOI matches its Crossref record, with a small difference in title or year; 23 of the 23 references it cites were found in a registry or an index.
Excellent inter‐rater, intra‐rater, and telephone‐administered reliability of the ALSFRS‐R in a multicenter clinical trial
Abstract
We wished to determine whether the Amyotrophic Lateral Sclerosis Functional Rating Scale-revised (ALSFRS-R) is reliable when used as primary outcome measure in a multicenter clinical trial. To establish inter-rater reliability, we randomly assigned 19 primary raters and 11 back-up raters to score nine amyotrophic lateral sclerosis (ALS) patients using the ALSFRS-R. To assess intra-rater reliability and reliability of telephone administration, we randomly assigned consecutive participants of the Clinical Trial of High Dose Coenzyme Q10 in ALS (QALS) to have in-person ALSFRS-R interviews at both screening and baseline visits (n=41 patients) or to have the ALSFRS-R interview by telephone at screening and in person at the baseline visit (n=27). An intraclass correlation coefficient (ICC) of reliability was calculated using a one-way random effects analysis of variance model. In the inter-rater reliability assessment, the primary raters performed 54 ratings on nine patients with ICC=0.93 (95% CI 0.84-0.98). For back-up raters, 32 ratings on nine patients resulted in ICC=0.93 (95% CI 0.82-0.98). The intra-rater reliability for in-person interviews was ICC = 0.95 (95% CI 0.92-0.98). The reliability of telephone administration compared to in-person interviews was ICC=0.97 (95% CI 0.93-0.98). We conclude that the ALSFRS-R shows excellent inter- and intra-rater reliability, and reliability of telephone administration when used as primary outcome measure in a multicenter ALS trial.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The administration of the ALSFRS-R by trained non-clinicians has been demonstrated to have exemplary inter-rater, intra-rater, and telephone-administered reliability (21).”
From Chronic Traumatic Encephalopathy Within an Amyotrophic Lateral Sclerosis Brain Bank Cohort (2018) · cites this paper as [21]
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
The Design and Analysis of Clinical Experiments
Fleiss, J. L. (1999) · Wiley eBooks · doi:10.1002/9781118032923 · Cited by 4,819
Cedarbaum, J. M., Stambler, N., Malta, E., Fuller, C., Hilt, D., Thurmond, B., & Nakanishi, A. (1999) · Journal of the Neurological Sciences · doi:10.1016/s0022-510x(99)00210-5 · Cited by 3,307
A Controlled Trial of Riluzole in Amyotrophic Lateral Sclerosis
Bensimon, G., Lacomblez, L., & Meininger, V. (1994) · New England Journal of Medicine · doi:10.1056/nejm199403033300901 · Cited by 2,239
Dose-ranging study of riluzole in amyotrophic lateral sclerosis
Amyotrophic Lateral Sclerosis/Riluzole Study Group II, Lacomblez, L., Bensimon, G., Meininger, V., Leigh, P. N., & Guillet, P. (1996) · The Lancet · doi:10.1016/s0140-6736(96)91680-3 · Cited by 1,303
A controlled trial of recombinant methionyl human BDNF in ALS
The BDNF Study Group (Phase III) (1999) · Neurology · doi:10.1212/wnl.52.7.1427 · Cited by 453
ALS CNTF Treatment Study Group (1996) · Neurology · doi:10.1212/wnl.46.5.1244 · Cited by 405
Effect of recombinant human insulin-like growth factor-I on progression of ALS
Lai, E. C., Felice, K. J., Festoff, B. W., Gawel, M. J., Gelinas, D. F., Kratz, R., Murphy, M. F., Natter, H. M., Norris, F. H., Rudnicki, S. A., et al. (1997) · Neurology · doi:10.1212/wnl.49.6.1621 · Cited by 361
A placebo-controlled trial of insulin-like growth factor-I in amyotrophic lateral sclerosis
Borasio, G. D., Robberecht, W., Leigh, P. N., Emile, J., Guiloff, R. J., Jerusalem, F., Silani, V., Vos, P. E., Wokke, J. H. J., Dobbins, T., et al. (1998) · Neurology · doi:10.1212/wnl.51.2.583 · Cited by 339
A clinical trial of creatine in ALS
Shefner, J. M., Cudkowicz, M., Schoenfeld, D., Conrad, T. M., Taft, J., Chilton, M., Urbinelli, L., Qureshi, M., Zhang, H., Pestronk, A., et al. (2004) · Neurology · doi:10.1212/01.wnl.0000142992.81995.f0 · Cited by 293
Self-citation
Research works printed but not linked: 3
- Moore D. H., 2003, Amyotroph Lateral Scler Other Motor Neuron Disord, 4, 42
- Traynor B. J., 2003, Amyotroph Lateral Scler Other Motor Neuron Disord, 4, 42
- Levy G., Neurology
Cited by
Sorted by citations
Items 101–144 of 144
Pedde, M., Adar, S. D., D’Souza, J. C., Feldman, E. L., & Goutman, S. A. (2025) · Environmental Research · doi:10.1016/j.envres.2025.123398 · Cited by 5
Rofail, D., Chladek, M. R., Williams, B., Patel, N., Nowell, W. B., Karantzoulis, S., & Levy, O. (2025) · Neurology and Therapy · doi:10.1007/s40120-025-00740-y · Cited by 5
Maksymowicz, S., Kukołowicz, P., Siwek, T., & Rakowska, A. (2020) · Neurological Sciences · doi:10.1007/s10072-020-04565-5 · Cited by 5
Clinimetrics: Amyotrophic Lateral Sclerosis Functional Rating Scale-revised (ALSFRS-R)
Lee, M., & McCambridge, A. B. (2018) · Journal of physiotherapy · doi:10.1016/j.jphys.2018.07.005 · Cited by 5
Brylev, L., Demeshonok, V. S., Ataulina, A., Kovalchuk, M. O., Сергеевич, Д. Д., & Guekht, A. B. (2023) · Neurological Sciences · doi:10.1007/s10072-023-06979-3 · Cited by 4
Yanagihashi, M., Hirayama, T., Shibukawa, M., Nagasawa, J., Fujita, K., Izumi, Y., Morita, M., Bokuda, K., Takahashi, K., Kanai, K., et al. (2024) · BMC Neurology · doi:10.1186/s12883-024-03729-6 · Cited by 4
Self-citationMehdipour, A., Teshler, L., Bello-Haas, V. P. M. D., Richardson, J. A., Beauchamp, M. K., Turnbull, J., Chum, M., Johnston, W. S. W., O’Connell, C. M., Luth, W., et al. (2023) · Physical Therapy · doi:10.1093/ptj/pzad109 · Cited by 4
Impact of mode of training and recertification on ALSFRS-R rater performance
Hamilton, J. A., Mohan, P., Kittle, G., & Shefner, J. M. (2022) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.1080/21678421.2022.2149344 · Cited by 3
Bhushan, N. L., DeMuro, C., Gras-Najjar, J., Reno, J. E., Rockwood, N., Quattrone, W., Adams, E. T., Kelly, B., McLeod, L., Bhavnani, S. P., et al. (2024) · Value in Health · doi:10.1016/j.jval.2024.05.005 · Cited by 3
Sanfilippo, M. J., Layshock, M. E., & Keniston, L. (2022) · Journal of Physical Therapy Science · doi:10.1589/jpts.34.532 · Cited by 2
Boddy, S. L., Simpson, R. M., Walters, S. J., Walsh, T., McDermott, C. J., PROSEC3 STUDY GROUP, McDermott, C. J., Chhetri, S. K., Turner, M. R., Crawley, F., et al. (2025) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.1080/21678421.2025.2469721 · Cited by 2
Hayes, H., Hu, N., Wang, X., Gibson, S. B., Mathy, P., Berggren, K. N., & Bromberg, M. B. (2020) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2020.116741 · Cited by 2
Imaging Biomarkers in Amyotrophic Lateral Sclerosis
Alberich, L. C., Vazquez-Costa, J. F., Ten‐Esteve, A., Mazón, M., & Martí‐Bonmatí, L. (2021) · Neuromethods · doi:10.1007/978-1-0716-1712-0_20 · Cited by 2
Ng, L., & Khan, F. (2013) · Social Care and Neurodisability · doi:10.1108/20420911311302290 · Cited by 2
Trad, G., Lenglet, T., Ledoux, I., Querin, G., Blancho, S., Marchand‐Pauvert, V., Hogrel, J., & Pradat, P. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-109620 · Cited by 1
Advances in diffusion MRI in motor neuron diseases
Ferraro, P. M., & Christidi, F. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-23812-3.00012-6 · Cited by 1
Ives, C. T. (2012) · Scholarship@Western (Western University) · Cited by 1
Failure of a minocycline trial in patients with amyotrophic lateral sclerosis
Kelly, J. (2008) · The Journal of the Royal College of Physicians of Edinburgh · doi:10.1177/1478271520083801016 · Cited by 1
ALSUntangled 56: “ten red flags”-things to be wary of in alternative or off-label products
The ALSUntangled Group (2020) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.1080/21678421.2020.1765518 · Cited by 1
Modification of the ALSFRS-R for Utilization in Individuals Not Using Noninvasive Ventilation
Vlok, L., Rossouw, L., & Henning, F. (2022) · Respiratory Care · doi:10.4187/respcare.09452 · Cited by 1
A National Study of Amyotrophic Lateral Sclerosis Multidisciplinary Clinic Utilization
Young, J. (2011) · Digital Commons - PCOM (Philadelphia College of Osteopathic Medicine) · Cited by 1
ARTICULATORY COMPENSATION IN AMYOTROPHIC LATERAL SCLEROSIS: TONGUE AND JAW IN SPEECH
Shellikeri, S. (2014) · TSpace (University of Toronto) · Cited by 1
Ng, L. (2011) · Minerva Access (University of Melbourne)
Síndrome pós-poliomielite: aspectos epidemiológicos e prognósticos
Conde, M. T. R. P. (2007) · doi:10.11606/d.6.2007.tde-06112007-205024
Maier, A. (2014) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-11751
Outcomes of Enteral Feeding in Motor Neurone Disease
Chhetri, S. K. (2015) · CLOK (University of Central Lancashire)
Assessing for Sensorimotor and Cognitive Impairments in ALS Patients
Atalla, G. (2017) · QSpace (Queen's University Library)
Associating the Bulbar and Respiratory Dysfunctions in Patients with Amyotrophic Lateral Sclerosis
Wasylyk, N. A. (2018) · TSpace (University of Toronto)
한국의 근위축측삭경화증: 임상 특징 및 예후 예측 인자
백원기, 박아람, Kim, H., & Kim, S. H. (2011) · Journal of the Korean Neurological Association
Maier, A., Münch, C., & Meyer, T. (2023) · Klinische Neurophysiologie · doi:10.1055/a-2019-3500
La asistencia telefónica de las enfermedades neurológicas: una revisión sistemática
Trejo-Gabriel-Galan, J. M., & Delgado, E. C. (2023) · Revista de Neurología · doi:10.33588/rn.7703.2022284
Determining the Significance Weights of ALSFRS-R Items Using Analytic Hierarchy Process
Koç, G. G., Eranay, F. S., Kokangül, A., & Koç, F. (2023) · Neurological Sciences and Neurophysiology · doi:10.4103/nsn.nsn_4_23
Yanagihashi, M., Hirayama, T., Shibukawa, M., Nagasawa, J., Fujita, K., Izumi, Y., Morita, M., Bokuda, K., Takahashi, K., Kanai, K., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-4295513/v1
Self-citationYanagihashi, M., Hirayama, T., Shibukawa, M., Nagasawa, J., Fujita, K., Izumi, Y., Morita, M., Bokuda, K., Takahashi, K., Kanai, K., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26759666
Self-citationRomano, C., Johar, L., Hundhausen, K., & Kimonis, V. E. (2026) · Neuromuscular Disorders · doi:10.1016/j.nmd.2026.106469
DNL343 and Disease Progression in Amyotrophic Lateral Sclerosis
Paganoni, S., Chibnik, L. B., Quintana, M., Macklin, E. A., Detry, M. A., Vestrucci, M., Paulon, G., McGlothlin, A., Wang, J., Walk, D., et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.34809
Metadata
- Authors
- Kaufmann, P., Levy, G., Montes, J., Buchsbaum, R., Barsdorf, A. I., Battista, V., Arbing, R., Gordon, P. H., Mitsumoto, H., Levin, B., Thompson, J. L. P., Kaufmann, P., Levy, G., Montes, J., Buchsbaum, R., Barsdorf, A. I., Battista, V., Arbing, R., Gordon, P. H., Mitsumoto, H., Levin, B., & Thompson, J. L. P.
- Venue
- Amyotrophic Lateral Sclerosis
- Publisher
- Informa UK Limited
- Published
- 2007-01
- Volume
- 8
- Issue
- 1
- Pages
- 42-46
- ISSN
- 1471-180X (ISSN-L)
- 1748-2968
- OpenAlex
- W2022387525
- Cited by
- 145
- References
- 23
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 6 · 2023: 7 · 2022: 13 · 2021: 2 · 2020: 10 · 2019: 7 · 2018: 13 · 2017: 5 · 2016: 4 · 2015: 9 · 2014: 7 · 2013: 8 · 2012: 7
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Amyotrophic Lateral Sclerosis (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Neurological Disorders and Stroke (R01 NS48555, R01 NS 48125, R01NS048125, R01NS048555)
- National Center for Research Resources (M01 RR00109, M01RR001066, M01RR000109, K12RR017648, M01-RR01066)
- Topics
- Health Sciences › Medicine › Clinical Neurology › Amyotrophic Lateral Sclerosis Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- ALSFRS-R, functional rating scale, inter-rater reliability, intra-rater reliability, telephone administration, outcome measure reliability
- MeSH terms
- Activities of Daily Living, Amyotrophic Lateral Sclerosis, Coenzymes, Double-Blind Method, Humans, Retrospective Studies, Severity of Illness Index, Telephone, Ubiquinone, Vitamins, Reproducibility of Results, Caregivers, Sickness Impact Profile
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review