The Stroke Riskometer™ App: Validation of a Data Collection Tool and Stroke Risk Predictor
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Background: The greatest potential to reduce the burden of stroke is by primary prevention of first-ever stroke, which constitutes three quarters of all stroke. In addition to population-wide prevention strategies (the ‘mass’ approach), the ‘high risk’ approach aims to identify individuals at risk of stroke and to modify their risk factors, and risk, accordingly. Current methods of assessing and modifying stroke risk are difficult to access and implement by the general population, amongst whom most future strokes will arise. To help reduce the burden of stroke on individuals and the population a new app, the Stroke Riskometer™, has been developed. We aim to explore the validity of the app for predicting the risk of stroke compared with current best methods. Methods: 752 stroke outcomes from a sample of 9501 individuals across three countries (New Zealand, Russia and the Netherlands) were utilized to investigate the performance of a novel stroke risk prediction tool algorithm (Stroke Riskometer™) compared with two established stroke risk score prediction algorithms (Framingham Stroke Risk Score [FSRS] and QStroke). We calculated the receiver operating characteristics (ROC) curves and area under the ROC curve (AUROC) with 95% confidence intervals, Harrels C-statistic and D-statistics for measure of discrimination, R 2 statistics to indicate level of variability accounted for by each prediction algorithm, the Hosmer-Lemeshow statistic for calibration, and the sensitivity and specificity of each algorithm. Results: The Stroke Riskometer™ performed well against the FSRS five-year AUROC for both males (FSRS = 75·0% (95% CI 72·3%–77·6%), Stroke Riskometer™ = 74·0(95% CI 71·3%–76·7%) and females [FSRS = 70·3% (95% CI 67·9%–72·8%, Stroke Riskometer™ = 71·5% (95% CI 69·0%–73·9%)], and better than QStroke [males–59·7% (95% CI 57·3%–62·0%) and comparable to females = 71·1% (95% CI 69·0%–73·1%)]. Discriminative ability of all algorithms was low (C-statistic ranging from 0·51–0·56, D-statistic ranging from 0·01–0·12). Hosmer-Lemeshow illustrated that all of the predicted risk scores were not well calibrated with the observed event data ( P < 0·006). Conclusions: The Stroke Riskometer™ is comparable in performance for stroke prediction with FSRS and QStroke. All three algorithms performed equally poorly in predicting stroke events. The Stroke Riskometer™ will be continually developed and validated to address the need to improve the current stroke risk scoring systems to more accurately predict stroke, particularly by identifying robust ethnic/race ethnicity group and country specific risk factors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., Abraham, J., Adair, T., Aggarwal, R., Ahn, S. Y., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61728-0 · Cited by 14,070
Self-citationNg, M., Fleming, T., Robinson, M., Thomson, B., Graetz, N., Margono, C., Mullany, E. C., Biryukov, S., Abbafati, C., Abera, S. F., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(14)60460-8 · Cited by 11,952
Self-citationEuropean Guidelines on cardiovascular disease prevention in clinical practice (version 2012)
Authors/Task Force Members:, Perk, J., De Backer, G., Gohlke, H., Graham, I., Reiner, Ž., Verschuren, M., Albus, C., Benlian, P., Boysen, G., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs092 · Cited by 8,490
Heart Disease and Stroke Statistics—2023 Update: A Report From the American Heart Association
Tsao, C. W., Aday, A. W., Almarzooq, Z. I., Anderson, C. A. M., Arora, P., Avery, C. L., Baker-Smith, C. M., Beaton, A. Z., Boehme, A. K., Buxton, A. E., et al. (2023) · Circulation · doi:10.1161/cir.0000000000001123 · Cited by 8,300
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Kernan, W. N., Ovbiagele, B., Black, H. R., Bravata, D. M., Chimowitz, M. I., Ezekowitz, M. D., Fang, M. C., Fisher, M., Furie, K. L., Heck, D. V., et al. (2014) · Stroke · doi:10.1161/str.0000000000000024 · Cited by 5,170
Feigin, V. L., Forouzanfar, M. H., Krishnamurthi, R., Mensah, G. A., Connor, M., Bennett, D. A., Moran, A. E., Sacco, R. L., Anderson, L., Truelsen, T., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(13)61953-4 · Cited by 3,899
Self-citationDanaei, G., Finucane, M. M., Lu, Y., Singh, G. M., Cowan, M. J., Paciorek, C. J., Lin, J. K., Farzadfar, F., Khang, Y.-H., Stevens, G. A., et al. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60679-x · Cited by 3,568
O'Donnell, M. J., Xavier, D., Liu, L., Zhang, H., Chin, S. L., Rao-Melacini, P., Rangarajan, S., Islam, S., Pais, P., McQueen, M. J., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60834-3 · Cited by 3,448
Self-citationMeschia, J. F., Bushnell, C., Boden-Albala, B., Braun, L. T., Bravata, D. M., Chaturvedi, S., Creager, M. A., Eckel, R. H., Elkind, M. S. V., Fornage, M., et al. (2014) · Stroke · doi:10.1161/str.0000000000000046 · Cited by 2,650
Research works printed but not linked: 40
- 10.1371/journal.pmed.1001634 · DOI · Paper page
- 10.1136/bmj.f2573 · DOI · Paper page
- 10.1136/bmj.282.6279.1847 · DOI · Paper page
- 10.1136/bmj.327.7426.1267 · DOI · Paper page
- 10.1097/HJR.0b013e32832b38a1 · DOI · Paper page
- 10.1177/1741826711428797 · DOI
- 10.1093/ageing/afp196 · DOI · Paper page
- 10.1186/1471-2318-9-35 · DOI
- 10.1161/CIR.0b013e3182009701 · DOI · Paper page
- 10.1007/978-3-642-40498-6_44 · DOI
- 10.1186/1471-2458-10-108 · DOI
- 10.1093/jnci/djr318 · DOI · Paper page
- 10.1161/STR.0b013e3181f7d043 · DOI · Paper page
- 10.1093/eurheartj/ehm316 · DOI · Paper page
- 10.1111/ijs.12300 · DOI
- 10.1111/ijs.12108 · DOI
- 10.1007/s10654-013-9866-z · DOI · Paper page
- 10.1016/S0140-6736(02)08272-7 · DOI · Paper page
- Hatano S, 1976, Bull World Health Organ, 54, 541
- WHO, 2013, Global Action Plan for Prevention and Control of Noncommunicable Diseases 2013–2020
- 10.1016/S1474-4422(09)70340-0 · DOI · Paper page
- 10.1136/jnnp.56.5.458 · DOI
- 10.1002/ana.21194 · DOI · Paper page
- 10.1159/000209879 · DOI
- 10.1161/01.STR.28.10.1908 · DOI · Paper page
- 10.1291/hypres.31.1489 · doi:10.1291/hypres.31.1489
- 10.1161/CIRCULATIONAHA.111.075929 · DOI · Paper page
- 10.1159/000209260 · DOI · Paper page
- 10.1111/j.1532-5415.1996.tb00908.x · DOI · Paper page
- 10.1161/STROKEAHA.111.620112 · DOI · Paper page
- 10.1093/eurheartj/ehm026 · DOI · Paper page
- 10.1161/STROKEAHA.109.547869 · DOI · Paper page
- 10.1016/S0895-4356(00)00343-7 · DOI
- 10.1093/aje/kwt298 · DOI · Paper page
- R Development Core Team 2013, 2013, R: A Language and Environment for Statistical Computing
- 10.1161/STROKEAHA.108.532325 · DOI
- 10.1016/j.ypmed.2013.04.003 · DOI
- 10.1161/STROKEAHA.114.004915 · DOI
- Arts EE, 2014, Ann Rheum Dis, 0, 1
- 10.1136/bmj.c2442 · DOI · Paper page
Cited by
Feigin, V. L., Norrving, B., & Mensah, G. A. (2017) · Circulation Research · doi:10.1161/circresaha.116.308413 · Cited by 2,184
Self-citationFeigin, V. L., Owolabi, M. O., Feigin, V. L., Abd-Allah, F., Akinyemi, R. O., Bhattacharjee, N. V., Brainin, M., Cao, J., Caso, V., Dalton, B., et al. (2023) · The Lancet Neurology · doi:10.1016/s1474-4422(23)00277-6 · Cited by 804
Self-citationPrimary stroke prevention worldwide: translating evidence into action
Owolabi, M. O., Thrift, A. G., Mahal, A., Ishida, M., Martins, S., Johnson, W. D., Pandian, J., Abd-Allah, F., Yaria, J., Phan, H. T., et al. (2022) · The Lancet Public Health · doi:10.1016/s2468-2667(21)00230-9 · Cited by 511
Self-citationPrevention of stroke: a global perspective
Pandian, J. D., Gall, S. L., Kate, M. P., Silva, G. S., Akinyemi, R. O., Ovbiagele, B. I., Lavados, P. M., Gandhi, D. B. C., & Thrift, A. G. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31269-8 · Cited by 450
Self-citationEpidemiology of stroke and transient ischemic attacks: Current knowledge and perspectives
Béjot, Y., Daubail, B., & Giroud, M. (2016) · Revue Neurologique · doi:10.1016/j.neurol.2015.07.013 · Cited by 270
Self-citationMoving Towards Equity With Digital Health Innovations for Stroke Care
Verma, A., Towfighi, A., Brown, A., Abhat, A., & Casillas, A. (2022) · Stroke · doi:10.1161/strokeaha.121.035307 · Cited by 65
Reps, J. M., Williams, R. D., You, S. C., Falconer, T., Minty, E., Callahan, A., Ryan, P. B., Park, R. W., Lim, H.-S., & Rijnbeek, P. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00991-3 · Cited by 40
Metadata
- Authors
- Parmar, P., Krishnamurthi, R., Ikram, M. A., Hofman, A., Mirza, S. S., Varakin, Y., Kravchenko, M., Piradov, M., Thrift, A. G., Norrving, B., Wang, W., Mandal, D. K., Barker-Collo, S., Sahathevan, R., Davis, S., Saposnik, G., Kivipelto, M., Sindi, S., Bornstein, N. M., Giroud, M., Béjot, Y., Brainin, M., Poulton, R., Narayan, K. M. V., Correia, M., Freire, A., Kokubo, Y., Wiebers, D., Mensah, G., BinDhim, N. F., Barber, P. A., Pandian, J. D., Hankey, G. J., Mehndiratta, M. M., Azhagammal, S., Ibrahim, N. M., Abbott, M., Rush, E., Hume, P., Hussein, T., Bhattacharjee, R., Purohit, M., Feigin, V. L., & for the Stroke Riskometer™ Collaboration Writing Group†
- Venue
- International Journal of Stroke
- Publisher
- SAGE Publications
- Published
- 2014-12-10
- Volume
- 10
- Issue
- 2
- Pages
- 231-244
- ISSN
- 1747-4930 (ISSN-L)
- 1747-4949
- OpenAlex
- W1966628631
- Cited by
- 138
- References
- 17
- FWCI
- 6.07
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Funders
- Faculty of Health and Environmental Sciences, AUT University
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.