JURaSSiC: Accuracy of clinician vs risk score prediction of ischemic stroke outcomes
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: We compared the accuracy of clinicians and a risk score (iScore) to predict observed outcomes following an acute ischemic stroke. METHODS: The JURaSSiC (Clinician JUdgment vs Risk Score to predict Stroke outComes) study assigned 111 clinicians with expertise in acute stroke care to predict the probability of outcomes of 5 ischemic stroke case scenarios. Cases (n = 1,415) were selected as being representative of the 10 most common clinical presentations from a pool of more than 12,000 stroke patients admitted to 12 stroke centers. The primary outcome was prediction of death or disability (modified Rankin Scale [mRS] ≥3) at discharge within the 95% confidence interval (CI) of observed outcomes. Secondary outcomes included 30-day mortality and death or institutionalization at discharge. RESULTS: Clinicians made 1,661 predictions with overall accuracy of 16.9% for death or disability at discharge, 46.9% for 30-day mortality, and 33.1% for death or institutionalization at discharge. In contrast, 90% of the iScore-based estimates were within the 95% CI of observed outcomes. Nearly half (n = 53 of 111; 48%) of participants were unable to accurately predict the probability of the primary outcome in any of the 5 rated cases. Less than 1% (n = 1) provided accurate predictions in 4 of the 5 cases and none accurately predicted all 5 case outcomes. In multivariable analyses, the presence of patient characteristics associated with poor outcomes (mRS ≥3 or death) in previous studies (older age, high NIH Stroke Scale score, and nonlacunar subtype) were associated with more accurate clinician predictions of death at 30 days (odds ratio [OR] 2.40, 95% CI 1.57-3.67) and with a trend for more accurate predictions of death or disability at discharge (OR 1.85, 95% CI 0.99-3.46). CONCLUSIONS: Clinicians with expertise in stroke performed poorly compared to a validated tool in predicting the outcomes of patients with an acute ischemic stroke. Use of the risk stroke outcome tool may be superior for decision-making following an acute ischemic stroke.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them
Croskerry, P. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00003 · Cited by 1,675
Adams, H. P., Davis, P. H., Leira, E. C., Chang, K.-C., Bendixen, B. H., Clarke, W. R., Woolson, R. F., & Hansen, M. D. (1999) · Neurology · doi:10.1212/wnl.53.1.126 · Cited by 1,456
Risk factors, outcome, and treatment in subtypes of ischemic stroke: the German stroke data bank
Grau, A. J., Weimar, C., Buggle, F., Heinrich, A., Goertler, M., Neumaier, S., Glahn, J., Brandt, T., Hacke, W., & Diener, H.-C. (2001) · Stroke · doi:10.1161/hs1101.098524 · Cited by 998
Friberg, J., Scharling, H., Gadsbøll, N., Truelsen, T., & Jensen, G. B. (2004) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2004.06.023 · Cited by 257
Dipaola, F., Costantino, G., Perego, F., Borella, M., Galli, A., Cantoni, G., Barbic, F., Casella, F., Duca, P. G., & Furlan, R. (2010) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2008.12.039 · Cited by 69
Cited by
Cognitive biases associated with medical decisions: a systematic review
Saposnik, G., Redelmeier, D., Ruff, C. C., & Tobler, P. N. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0377-1 · Cited by 1,001
Self-citationHolloway, R. G., Arnold, R. M., Creutzfeldt, C. J., Lewis, E. F., Lutz, B. J., McCann, R. M., Rabinstein, A. A., Saposnik, G., Sheth, K. N., Zahuranec, D. B., et al. (2014) · Stroke · doi:10.1161/str.0000000000000015 · Cited by 286
Self-citationJaja, B. N. R., Saposnik, G., Lingsma, H. F., Macdonald, E., Thorpe, K. E., Mamdani, M., Steyerberg, E. W., Molyneux, A., Manoel, A. L. D. O., Schatlo, B., et al. (2018) · BMJ · doi:10.1136/bmj.j5745 · Cited by 268
Self-citationRangaraju, S., Frankel, M., & Jovin, T. G. (2015) · Interventional Neurology · doi:10.1159/000443801 · Cited by 69
Beldhuis, I. E., Marapin, R. S., Jiang, Y. Y., Simões de Souza, N. F., Georgiou, A., Kaufmann, T., Castela Forte, J., & van der Horst, I. C. C. (2021) · Journal of Critical Care · doi:10.1016/j.jcrc.2021.04.012 · Cited by 58
Metadata
- Authors
- Saposnik, G., Cote, R., Mamdani, M., Raptis, S., Thorpe, K. E., Fang, J., Redelmeier, D. A., & Goldstein, L. B.
- Venue
- Neurology
- Published
- 2013-07-30
- Volume
- 81
- Issue
- 5
- Pages
- 448-455
- ISSN
- 0028-3878 (ISSN-L)
- 1526-632X
- OpenAlex
- W1975612088
- Cited by
- 100
- References
- 5
- FWCI
- 6.92
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: JURaSSiC: Accuracy of clinician vs risk score prediction of ischemic stroke outcomes. https://app.cochat.ai/papers/10.1212/wnl.0b013e31829d874e
- The paper
- Saposnik, G., Cote, R., Mamdani, M., Raptis, S., Thorpe, K. E., Fang, J., Redelmeier, D. A., & Goldstein, L. B. (2013). JURaSSiC: Accuracy of clinician vs risk score prediction of ischemic stroke outcomes. Neurology. https://doi.org/10.1212/wnl.0b013e31829d874e
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.