The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Improved reliability of the NIH Stroke Scale using video training. NINDS TPA Stroke Study Group.
Open accessAbstract
Despite the frequent use of clinical rating scales in multicenter therapeutic stroke trials, no generally acceptable method exists to train and certify investigators to use the instrument consistently. We desired to train investigators to use the National Institutes of Health Stroke Scale in a study of acute stroke therapy so that all examiners rated patients comparably. We devised a two-camera videotape method that optimizes the visual presentation of examination findings. We then measured the effectiveness of the training by asking each investigator to evaluate a set of 11 patients, also on videotape. We tabulated the evaluations, devised a scoring system, and calculated measures of interobserver agreement among the participants in this study. We trained and certified 162 investigators. We found moderate to excellent agreement on most Stroke Scale items (unweighted kappa > 0.60). Two items, facial paresis and ataxia, exhibited poor agreement (unweighted kappa < 0.40) and should be revised in future editions of the scale. Performance improved with video training compared with previous studies. Inclusion of the motor rating of the unaffected limbs in the total score did not affect reliability. Video training and certification is a practical and effective method to standardize the use of examination scales. Two cameras must be used during the taping of patients to accurately present the clinical findings. This method is easily adapted to any study in which a large number of investigators will be enrolling patients at multiple clinical centers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
Statistical Methods for Rates and Proportions.
Everitt, B. S., & Fleiss, J. L. (1981) · Biometrics · doi:10.2307/2530193 · Cited by 8,990
Measurements of acute cerebral infarction: a clinical examination scale.
Brott, T., Adams, H. P., Olinger, C. P., Marler, J. R., Barsan, W. G., Biller, J., Spilker, J., Holleran, R., Eberle, R., & Hertzberg, V (1989) · Stroke · doi:10.1161/01.str.20.7.864 · Cited by 5,911
Self-citationStatistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,748
Nonparametric Statistics for the Behavioral Sciences
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n273 · Cited by 1,414
Interrater Reliability of the NIH Stroke Scale
Goldstein, L. B., Bertels, C., & Davis, J. N. (1989) · Archives of Neurology · doi:10.1001/archneur.1989.00520420080026 · Cited by 986
Brott, T. G., Haley, E. C., Levy, D. E., Barsan, W., Broderick, J., Sheppard, G. L., Spilker, J., Kongable, G. L., Massey, S., & Reed, R. (1992) · Stroke · doi:10.1161/01.str.23.5.632 · Cited by 545
Self-citationIntravenous recombinant tissue plasminogen activator in acute carotid artery territory stroke
Mori, E., Yoneda, Y., Tabuchi, M., Yoshida, T., Ohkawa, S., Ohsumi, Y., Kitano, K., Tsutsumi, A., & Yamadori, A. (1992) · Neurology · doi:10.1212/wnl.42.5.976 · Cited by 472
The Canadian Neurological Scale: Validation and reliability assessment
Côté, R., Battista, R. N., Wolfson, C., Boucher, J., Adam, J., & Hachinski, V. (1989) · Neurology · doi:10.1212/wnl.39.5.638 · Cited by 461
Ringelstein, E. B., Biniek, R., Weiller, C., Ammeling, B., Nolte, P. N., & Thron, A. (1992) · Neurology · doi:10.1212/wnl.42.2.289 · Cited by 393
Cited by
Tissue Plasminogen Activator for Acute Ischemic Stroke
(1995) · New England Journal of Medicine · doi:10.1056/nejm199512143332401 · Cited by 11,654
Jauch, E. C., Saver, J. L., Adams, H. P., Bruno, A., Connors, J. J. (., Demaerschalk, B. M., Khatri, P., McMullan, P. W., Qureshi, A. I., Rosenfield, K., et al. (2013) · Stroke · doi:10.1161/str.0b013e318284056a · Cited by 7,634
Powers, W. J., Rabinstein, A. A., Ackerson, T., Adeoye, O. M., Bambakidis, N. C., Becker, K., Biller, J., Brown, M., Demaerschalk, B. M., Hoh, B., et al. (2019) · Stroke · doi:10.1161/str.0000000000000211 · Cited by 7,468
Powers, W. J., Rabinstein, A. A., Ackerson, T., Adeoye, O. M., Bambakidis, N. C., Becker, K., Biller, J., Brown, M., Demaerschalk, B. M., Hoh, B., et al. (2018) · Stroke · doi:10.1161/str.0000000000000158 · Cited by 5,446
Guidelines for Management of Ischaemic Stroke and Transient Ischaemic Attack 2008
(2008) · Cerebrovascular Diseases · doi:10.1159/000131083 · Cited by 2,489
Early Hemorrhage Growth in Patients With Intracerebral Hemorrhage
Brott, T., Broderick, J., Kothari, R., Barsan, W., Tomsick, T., Sauerbeck, L., Spilker, J., Duldner, J., & Khoury, J. (1997) · Stroke · doi:10.1161/01.str.28.1.1 · Cited by 1,477
Self-citationClark, W. M., Wissman, S., Albers, G. W., Jhamandas, J. H., Madden, K. P., Hamilton, S., & for the ATLANTIS Study Investigators (1999) · JAMA · doi:10.1001/jama.282.21.2019 · Cited by 1,186
Management of Adult Stroke Rehabilitation Care: A Clinical Practice Guideline
Duncan, P. W., Zorowitz, R., Bates, B., Choi, J. Y., Glasberg, J. J., Graham, G. D., Katz, R. C., Lamberty, K., & Reker, D. (2005) · Stroke · doi:10.1161/01.str.0000180861.54180.ff · Cited by 1,046
Sex Differences in Stroke Epidemiology: A Systematic Review
Appelros, P., Stegmayr, B., & Terént, A. (2009) · Stroke · doi:10.1161/strokeaha.108.540781 · Cited by 1,027
Clinical interpretation and use of stroke scales
Kasner, S. E. (2006) · The Lancet Neurology · doi:10.1016/s1474-4422(06)70495-1 · Cited by 934
Endovascular Therapy for Acute Stroke with a Large Ischemic Region
Yoshimura, S., Sakai, N., Yamagami, H., Uchida, K., Beppu, M., Toyoda, K., Matsumaru, Y., Matsumoto, Y., Kimura, K., Takeuchi, M., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2118191 · Cited by 873
Albers, G. W., Bates, V. E., Clark, W. M., Bell, R., Verro, P., & Hamilton, S. A. (2000) · JAMA · doi:10.1001/jama.283.9.1145 · Cited by 700
Engelter, S. T., Gostynski, M., Papa, S., Frei, M., Born, C., Ajdacic-Gross, V., Gutzwiller, F., & Lyrer, P. A. (2006) · Stroke · doi:10.1161/01.str.0000221815.64093.8c · Cited by 688
Demaerschalk, B. M., Kleindorfer, D. O., Adeoye, O. M., Demchuk, A. M., Fugate, J. E., Grotta, J. C., Khalessi, A. A., Levy, E. I., Palesch, Y. Y., Prabhakaran, S., et al. (2016) · Stroke · doi:10.1161/str.0000000000000086 · Cited by 670
Self-citationCincinnati Prehospital Stroke Scale: Reproducibility and Validity
KOTHARI, R., PANCIOLI, A., LIU, T., BROTT, T., & BRODERICK, J. (1999) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(99)70299-4 · Cited by 666
Self-citationEffects of Tissue Plasminogen Activator for Acute Ischemic Stroke at One Year
Kwiatkowski, T. G., Libman, R. B., Frankel, M., Tilley, B. C., Morgenstern, L. B., Lu, M., Broderick, J. P., Lewandowski, C. A., Marler, J. R., Levine, S. R., et al. (1999) · New England Journal of Medicine · doi:10.1056/nejm199906103402302 · Cited by 647
Self-citationEuropean Stroke Initiative Recommendations for Stroke Management – Update 2003
(2003) · Cerebrovascular Diseases · doi:10.1159/000072554 · Cited by 635
Lewandowski, C. A., Frankel, M., Tomsick, T. A., Broderick, J., Frey, J., Clark, W., Starkman, S., Grotta, J., Spilker, J., Khoury, J., et al. (1999) · Stroke · doi:10.1161/01.str.30.12.2598 · Cited by 628
Self-citationGeneralized Efficacy of t-PA for Acute Stroke: Subgroup Analysis of the NINDS t-PA Stroke Trial
The NINDS t-PA Stroke Study Group (1997) · Stroke · doi:10.1161/01.str.28.11.2119 · Cited by 559
Duncan, P. W., Jorgensen, H. S., & Wade, D. T. (2000) · Stroke · doi:10.1161/01.str.31.6.1429 · Cited by 484
Using the National Institutes of Health Stroke Scale: A Cautionary Tale
Lyden, P. (2017) · Stroke · doi:10.1161/strokeaha.116.015434 · Cited by 484
Self-citationSmith, C. J., Emsley, H. C., Gavin, C. M., Georgiou, R. F., Vail, A., Barberan, E. M., del Zoppo, G. J., Hallenbeck, J. M., Rothwell, N. J., Hopkins, S. J., et al. (2004) · BMC Neurology · doi:10.1186/1471-2377-4-2 · Cited by 480
Lyden, P. D., Lu, M., Levine, S. R., Brott, T. G., & Broderick, J. (2001) · Stroke · doi:10.1161/01.str.32.6.1310 · Cited by 468
Self-citationDiffusion-Weighted Magnetic Resonance Imaging in Acute Stroke
van Everdingen, K. J., van der Grond, J., Kappelle, L. J., Ramos, L. M. P., & Mali, W. P. T. M. (1998) · Stroke · doi:10.1161/01.str.29.9.1783 · Cited by 459
Molina, C. A., Ribo, M., Rubiera, M., Montaner, J., Santamarina, E., Delgado-Mederos, R., Arenillas, J. F., Huertas, R., Purroy, F., Delgado, P., et al. (2006) · Stroke · doi:10.1161/01.str.0000199064.94588.39 · Cited by 452
Schwamm, L. H., Holloway, R. G., Amarenco, P., Audebert, H. J., Bakas, T., Chumbler, N. R., Handschu, R., Jauch, E. C., Knight, W. A., Levine, S. R., et al. (2009) · Stroke · doi:10.1161/strokeaha.109.192360 · Cited by 449
Self-citationA randomised phase II study of interleukin-1 receptor antagonist in acute stroke patients
Emsley, H. C. A. (2005) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2004.054882 · Cited by 445
Tong, D. C., Yenari, M. A., Albers, G. W., O'Brien, M., Marks, M. P., & Moseley, M. E. (1998) · Neurology · doi:10.1212/wnl.50.4.864 · Cited by 444
Comparison of Neurological Scales and Scoring Systems for Acute Stroke Prognosis
Muir, K. W., Weir, C. J., Murray, G. D., Povey, C., & Lees, K. R. (1996) · Stroke · doi:10.1161/01.str.27.10.1817 · Cited by 441
Medical and Neurological Complications of Ischemic Stroke: Experience From the RANTTAS Trial
Johnston, K. C., Li, J. Y., Lyden, P. D., Hanson, S. K., Feasby, T. E., Adams, R. J., Faught, R. E., & Haley, E. C. (1998) · Stroke · doi:10.1161/01.str.29.2.447 · Cited by 424
Self-citationRubiera, M., Ribo, M., Delgado-Mederos, R., Santamarina, E., Delgado, P., Montaner, J., Alvarez-Sabín, J., & Molina, C. A. (2006) · Stroke · doi:10.1161/01.str.0000237070.80133.1d · Cited by 421
“Telestroke”: The Application of Telemedicine for Stroke
Levine, S. R., & Gorman, M. (1999) · Stroke · doi:10.1161/01.str.30.2.464 · Cited by 419
Self-citationClark, W. M., Albers, G. W., Madden, K. P., & Hamilton, S. (2000) · Stroke · doi:10.1161/01.str.31.4.811 · Cited by 416
(2006) · Cerebrovascular Diseases · doi:10.1159/000094831 · Cited by 411
Reliability and Validity of Estimating the NIH Stroke Scale Score from Medical Records
Kasner, S. E., Chalela, J. A., Luciano, J. M., Cucchiara, B. L., Raps, E. C., McGarvey, M. L., Conroy, M. B., & Localio, A. R. (1999) · Stroke · doi:10.1161/01.str.30.8.1534 · Cited by 405
Treatment of Acute Ischemic Stroke
Brott, T., & Bogousslavsky, J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200009073431007 · Cited by 398
Self-citationKassell, N. F., Haley, E. C., Apperson-Hansen, C., Alves, W. M., & _, _. (1996) · Journal of Neurosurgery · doi:10.3171/jns.1996.84.2.0221 · Cited by 394
Self-citationReliability of the National Institutes of Health Stroke Scale
McLoughlin, A., Olive, P., & Lightbody, C. E. (2022) · British Journal of Neuroscience Nursing · doi:10.12968/bjnn.2022.18.sup5.s3 · Cited by 383
Lack of Clinical Significance of Early Ischemic Changes on Computed Tomography in Acute Stroke
Patel, S. C. (2001) · JAMA · doi:10.1001/jama.286.22.2830 · Cited by 378
Utility of the NIH Stroke Scale as a Predictor of Hospital Disposition
Schlegel, D., Kolb, S. J., Luciano, J. M., Tovar, J. M., Cucchiara, B. L., Liebeskind, D. S., & Kasner, S. E. (2003) · Stroke · doi:10.1161/01.str.0000048217.44714.02 · Cited by 362
Underlying Structure of the National Institutes of Health Stroke Scale: Results of a Factor Analysis
Lyden, P., Lu, M., Jackson, C., Marler, J., Kothari, R., Brott, T., & Zivin, J. (1999) · Stroke · doi:10.1161/01.str.30.11.2347 · Cited by 354
Self-citationNIHSS Score and Arteriographic Findings in Acute Ischemic Stroke
Fischer, U., Arnold, M., Nedeltchev, K., Brekenfeld, C., Ballinari, P., Remonda, L., Schroth, G., & Mattle, H. P. (2005) · Stroke · doi:10.1161/01.str.0000182099.04994.fc · Cited by 343
Corticospinal tract lesion load: An imaging biomarker for stroke motor outcomes
Feng, W., Wang, J., Chhatbar, P. Y., Doughty, C., Landsittel, D., Lioutas, V., Kautz, S. A., & Schlaug, G. (2015) · Annals of Neurology · doi:10.1002/ana.24510 · Cited by 333
Huang, X., Cheripelli, B. K., Lloyd, S. M., Kalladka, D., Moreton, F. C., Siddiqui, A., Ford, I., & Muir, K. W. (2015) · The Lancet Neurology · doi:10.1016/s1474-4422(15)70017-7 · Cited by 331
Effect of Intravenous Thrombolysis on MRI Parameters and Functional Outcome in Acute Stroke <6 Hours
Röther, J., Schellinger, P. D., Gass, A., Siebler, M., Villringer, A., Fiebach, J. B., Fiehler, J., Jansen, O., Kucinski, T., Schoder, V., et al. (2002) · Stroke · doi:10.1161/01.str.0000030109.12281.23 · Cited by 326
Lees, K. R., Asplund, K., Carolei, A., Davis, S. M., Diener, H.-C., Kaste, M., Orgogozo, J.-M., & Whitehead, J. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02326-6 · Cited by 309
Emsley, H. (2003) · Journal of Neuroimmunology · doi:10.1016/s0165-5728(03)00134-6 · Cited by 301
Haley, E. C., Kassell, N. F., Apperson-Hansen, C., Maile, M. H., Alves, W. M., & _, _. (1997) · Journal of Neurosurgery · doi:10.3171/jns.1997.86.3.0467 · Cited by 294
Self-citationBaseline NIH Stroke Scale Score predicting outcome in anterior and posterior circulation strokes
Sato, S., Toyoda, K., Uehara, T., Toratani, N., Yokota, C., Moriwaki, H., Naritomi, H., & Minematsu, K. (2008) · Neurology · doi:10.1212/01.wnl.0000304346.14354.0b · Cited by 292
Powers, W. J. (2020) · New England Journal of Medicine · doi:10.1056/nejmcp1917030 · Cited by 287
Sacco, R. L., DeRosa, J. T., Haley, Jr., Levin, B., Ordronneau, P., Phillips, S. J., Rundek, T., Snipes, R. G., Thompson, J. L. P., & for the GAIN Americas Investigators (2001) · JAMA · doi:10.1001/jama.285.13.1719 · Cited by 283
Duffy, L., Gajree, S., Langhorne, P., Stott, D. J., & Quinn, T. J. (2013) · Stroke · doi:10.1161/strokeaha.112.678615 · Cited by 271
Molina, C. A., Montaner, J., Abilleira, S., Ibarra, B., Romero, F., Arenillas, J. F., & Alvarez-Sabín, J. (2001) · Stroke · doi:10.1161/01.str.32.5.1079 · Cited by 266
Alvarez-Sabín, J., Molina, C. A., Montaner, J., Arenillas, J. F., Huertas, R., Ribo, M., Codina, A., & Quintana, M. (2003) · Stroke · doi:10.1161/01.str.0000068406.30514.31 · Cited by 266
Prevalence of disabling spasticity 1 year after first‐ever stroke
Lundström, E., Terént, A., & Borg, J. (2008) · European Journal of Neurology · doi:10.1111/j.1468-1331.2008.02114.x · Cited by 264
Frankel, M. R., Morgenstern, L. B., Kwiatkowski, T., Lu, M., Tilley, B. C., Broderick, J. P., Libman, R., Levine, S. R., & Brott, T. (2000) · Neurology · doi:10.1212/wnl.55.7.952 · Cited by 258
Self-citationNXY-059 for the Treatment of Acute Stroke: Pooled Analysis of the SAINT I and II Trials
Diener, H.-C., Lees, K. R., Lyden, P., Grotta, J., Davalos, A., Davis, S. M., Shuaib, A., Ashwood, T., Wasiewski, W., Alderfer, V., et al. (2008) · Stroke · doi:10.1161/strokeaha.107.503334 · Cited by 255
Self-citationHOW TO IDENTIFY POTENTIAL FALLERS IN A STROKE UNIT: VALIDITY INDEXES OF 4 TEST METHODS
Andersson, Å., Kamwendo, K., Seiger, Å., & Appelros, P. (2006) · Journal of Rehabilitation Medicine · doi:10.1080/16501970500478023 · Cited by 254
Molina, C. A., Alvarez-Sabín, J., Montaner, J., Abilleira, S., Arenillas, J. F., Coscojuela, P., Romero, F., & Codina, A. (2002) · Stroke · doi:10.1161/01.str.0000016323.13456.e5 · Cited by 254
Contemporary Outcome Measures in Acute Stroke Research: Choice of Primary Outcome Measure
Lees, K. R., Bath, P. M. W., Schellinger, P. D., Kerr, D. M., Fulton, R., Hacke, W., Matchar, D., Sehra, R., & Toni, D. (2012) · Stroke · doi:10.1161/strokeaha.111.641423 · Cited by 242
Grond, M., Jauss, M., Hamann, G., Stark, E., Veltkamp, R., Nabavi, D., Horn, M., Weimar, C., Köhrmann, M., Wachter, R., et al. (2013) · Stroke · doi:10.1161/strokeaha.113.001884 · Cited by 229
Mitchell, P. H., Veith, R. C., Becker, K. J., Buzaitis, A., Cain, K. C., Fruin, M., Tirschwell, D., & Teri, L. (2009) · Stroke · doi:10.1161/strokeaha.109.549808 · Cited by 177
Peters, N., Opherk, C., Danek, A., Ballard, C., Herzog, J., & Dichgans, M. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.11.2078 · Cited by 178
Acler, M., Robol, E., Fiaschi, A., & Manganotti, P. (2009) · Journal of Neurology · doi:10.1007/s00415-009-5093-7 · Cited by 139
Rangaraju, S., Frankel, M., & Jovin, T. G. (2015) · Interventional Neurology · doi:10.1159/000443801 · Cited by 69
Validity and Reliability of a Korean Version of the National Institutes of Health Stroke Scale
Oh, M. S., Yu, K.-H., Lee, J.-H., Jung, S., Ko, I.-S., Shin, J.-H., Cho, S.-J., Choi, H.-C., Kim, H. H., & Lee, B.-C. (2012) · Journal of Clinical Neurology · doi:10.3988/jcn.2012.8.3.177 · Cited by 60
Bang, O. Y., Joo, S. Y., Lee, P. H., Joo, U. S., Lee, J. H., Joo, I. S., & Huh, K. (2004) · Archives of Neurology · doi:10.1001/archneur.61.4.514 · Cited by 53
Saxena, S. K., Ng, T. P., Yong, D., Fong, N. P., & Koh, G. (2007) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.2007.00922.x · Cited by 48
Mikulik, R., Ribo, M., Hill, M. D., Grotta, J. C., Malkoff, M., Molina, C., Rubiera, M., Delgado-Mederos, R., Alvarez-Sabin, J., & Alexandrov, A. V. (2007) · Circulation · doi:10.1161/circulationaha.106.651026 · Cited by 43
Self-citation
Metadata
- Authors
- Lyden, P., Brott, T., Tilley, B., Welch, K. M., Mascha, E. J., Levine, S., Haley, E. C., Grotta, J., & Marler, J.
- Venue
- Stroke
- Published
- 1994-11
- Volume
- 25
- Issue
- 11
- Pages
- 2220-2226
- ISSN
- 0039-2499 (ISSN-L)
- 1524-4628
- OpenAlex
- W2027123157
- Cited by
- 1,285
- References
- 16
- FWCI
- 9.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.