The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Improving the Reliability of Stroke Subgroup Classification Using the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) Criteria
Open accessAbstract
Background and Purpose —We sought to improve the reliability of the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) classification of stroke subtype for retrospective use in clinical, health services, and quality of care outcome studies. The TOAST investigators devised a series of 11 definitions to classify patients with ischemic stroke into 5 major etiologic/pathophysiological groupings. Interrater agreement was reported to be substantial in a series of patients who were independently assessed by pairs of physicians. However, the investigators cautioned that disagreements in subtype assignment remain despite the use of these explicit criteria and that trials should include measures to ensure the most uniform diagnosis possible. Methods —In preparation for a study of outcomes and management practices for patients with ischemic stroke within Department of Veterans Affairs hospitals, 2 neurologists and 2 internists first retrospectively classified a series of 14 randomly selected stroke patients on the basis of the TOAST definitions to provide a baseline assessment of interrater agreement. A 2-phase process was then used to improve the reliability of subtype assignment. In the first phase, a computerized algorithm was developed to assign the TOAST diagnostic category. The reliability of the computerized algorithm was tested with a series of synthetic cases designed to provide data fitting each of the 11 definitions. In the second phase, critical disagreements in the data abstraction process were identified and remaining variability was reduced by the development of standardized procedures for retrieving relevant information from the medical record. Results —The 4 physicians agreed in subtype diagnosis for only 2 of the 14 baseline cases (14%) using all 11 TOAST definitions and for 4 of the 14 cases (29%) when the classifications were collapsed into the 5 major etiologic/pathophysiological groupings (κ=0.42; 95% CI, 0.32 to 0.53). There was 100% agreement between classifications generated by the computerized algorithm and the intended diagnostic groups for the 11 synthetic cases. The algorithm was then applied to the original 14 cases, and the diagnostic categorization was compared with each of the 4 physicians’ baseline assignments. For the 5 collapsed subtypes, the algorithm-based and physician-assigned diagnoses disagreed for 29% to 50% of the cases, reflecting variation in the abstracted data and/or its interpretation. The use of an operations manual designed to guide data abstraction improved the reliability subtype assignment (κ=0.54; 95% CI, 0.26 to 0.82). Critical disagreements in the abstracted data were identified, and the manual was revised accordingly. Reliability with the use of the 5 collapsed groupings then improved for both interrater (κ=0.68; 95% CI, 0.44 to 0.91) and intrarater (κ=0.74; 95% CI, 0.61 to 0.87) agreement. Examining each remaining disagreement revealed that half were due to ambiguities in the medical record and half were related to otherwise unexplained errors in data abstraction. Conclusions —Ischemic stroke subtype based on published TOAST classification criteria can be reliably assigned with the use of a computerized algorithm with data obtained through standardized medical record abstraction procedures. Some variability in stroke subtype classification will remain because of inconsistencies in the medical record and errors in data abstraction. This residual variability can be addressed by having 2 raters classify each case and then identifying and resolving the reason(s) for the disagreement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adams, H. P., Bendixen, B. H., Kappelle, L. J., Biller, J., Love, B. B., Gordon, D. L., & Marsh, E. E. (1993) · Stroke · doi:10.1161/01.str.24.1.35 · Cited by 12,335
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Classification and natural history of clinically identifiable subtypes of cerebral infarction
Bamford, J., Sandercock, P., Dennis, M., Warlow, C., & Burn, J. (1991) · The Lancet · doi:10.1016/0140-6736(91)93206-o · Cited by 3,294
The Lausanne Stroke Registry: analysis of 1,000 consecutive patients with first stroke.
Bogousslavsky, J., Van Melle, G., & Regli, F. (1988) · Stroke · doi:10.1161/01.str.19.9.1083 · Cited by 1,350
Clinical biostatistics: LIV. The biostatistics of concordance
Kramer, M. S., & Feinstein, A. R. (1981) · Clinical Pharmacology and Therapeutics · doi:10.1038/clpt.1981.18 · Cited by 1,087
The Stroke Data Bank: design, methods, and baseline characteristics.
Foulkes, M. A., Wolf, P. A., Price, T. R., Mohr, J. P., & Hier, D. B. (1988) · Stroke · doi:10.1161/01.str.19.5.547 · Cited by 946
The Publications Committee for the Trial of ORG 10172 in Acute Stroke Treatment Investigators (1998) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.279.16.1265 · Cited by 530
A Classification and Outline of Cerebrovascular Diseases II
(1975) · Stroke · doi:10.1161/01.str.6.5.564 · Cited by 375
MATSUMOTO, N., WHISNANT, J. P., KURLAND, L. T., & OKAZAKI, H. (1973) · Stroke · doi:10.1161/01.str.4.1.20 · Cited by 366
Interrater Reliability of an Etiologic Classification of Ischemic Stroke
Johnson, C. J., Kittner, S. J., McCarter, R. J., Sloan, M. A., Stern, B. J., Buchholz, D., & Price, T. R. (1995) · Stroke · doi:10.1161/01.str.26.1.46 · Cited by 197
Accuracy of initial stroke subtype diagnosis in the TOAST study
Madden, K. P., Karanjia, P. N., Adams, H. P., & Clarke, W. R. (1995) · Neurology · doi:10.1212/wnl.45.11.1975 · Cited by 193
Interphysician agreement in the diagnosis of subtypes of acute ischemic stroke
Gordon, D., Bendixen, B. H., Adams, H. P., Clarke, W. R., Kappelle, L. J., Woolson, R. F., & TOAST Investigators (1993) · Neurology · doi:10.1212/wnl.43.5.1021 · Cited by 150
A CLASSIFICATION and outline of cerebrovascular diseases.
(1958) · PubMed · Cited by 58
Cited by
Atrial fibrillation in patients with cryptogenic stroke
Gladstone, D. J., Spring, M., Dorian, P., Panzov, V., Thorpe, K. E., Hall, J., Vaid, H., O'Donnell, M., Laupacis, A., Côté, R., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1311376 · Cited by 1,276
Wassertheil-Smoller, S., Hendrix, S., Limacher, M., Heiss, G., Kooperberg, C., Baird, A., Kotchen, T., Curb, J. D., Black, H., Rossouw, J. E., et al. (2003) · JAMA · doi:10.1001/jama.289.20.2673 · Cited by 1,159
Measuring Diagnoses: ICD Code Accuracy
O'Malley, K. J., Cook, K. F., Price, M. D., Wildes, K. R., Hurdle, J. F., & Ashton, C. M. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00444.x · Cited by 1,116
Early risk of recurrence by subtype of ischemic stroke in population-based incidence studies
Lovett, J. K., Coull, A. J., & Rothwell, P. M. (2004) · Neurology · doi:10.1212/01.wnl.0000110311.09970.83 · Cited by 741
An evidence‐based causative classification system for acute ischemic stroke
Ay, H., Furie, K. L., Singhal, A., Smith, W. S., Sorensen, A. G., & Koroshetz, W. J. (2005) · Annals of Neurology · doi:10.1002/ana.20617 · Cited by 675
Metadata
- Authors
- Goldstein, L. B., Jones, M. R., Matchar, D. B., Edwards, L. J., Hoff, J., Chilukuri, V., Armstrong, S. B., & Horner, R. D.
- Venue
- Stroke
- Published
- 2001-05
- Volume
- 32
- Issue
- 5
- Pages
- 1091-1097
- ISSN
- 0039-2499 (ISSN-L)
- 1524-4628
- OpenAlex
- W1901234763
- Cited by
- 308
- References
- 13
- FWCI
- 5.94
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.