The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score
Open accessAbstract
Objective: To develop and validate a pragmatic risk score to predict mortality in patients admitted to hospital with coronavirus disease 2019 (covid-19). Design: Prospective observational cohort study. Setting: International Severe Acute Respiratory and emerging Infections Consortium (ISARIC) World Health Organization (WHO) Clinical Characterisation Protocol UK (CCP-UK) study (performed by the ISARIC Coronavirus Clinical Characterisation Consortium—ISARIC-4C) in 260 hospitals across England, Scotland, and Wales. Model training was performed on a cohort of patients recruited between 6 February and 20 May 2020, with validation conducted on a second cohort of patients recruited after model development between 21 May and 29 June 2020 . Participants: Adults (age ≥18 years) admitted to hospital with covid-19 at least four weeks before final data extraction. Main outcome measure: In-hospital mortality. Results: 35 463 patients were included in the derivation dataset (mortality rate 32.2%) and 22 361 in the validation dataset (mortality rate 30.1%). The final 4C Mortality Score included eight variables readily available at initial hospital assessment: age, sex, number of comorbidities, respiratory rate, peripheral oxygen saturation, level of consciousness, urea level, and C reactive protein (score range 0-21 points). The 4C Score showed high discrimination for mortality (derivation cohort: area under the receiver operating characteristic curve 0.79, 95% confidence interval 0.78 to 0.79; validation cohort: 0.77, 0.76 to 0.77) with excellent calibration (validation: calibration-in-the-large=0, slope=1.0). Patients with a score of at least 15 (n=4158, 19%) had a 62% mortality (positive predictive value 62%) compared with 1% mortality for those with a score of 3 or less (n=1650, 7%; negative predictive value 99%). Discriminatory performance was higher than 15 pre-existing risk stratification scores (area under the receiver operating characteristic curve range 0.61-0.76), with scores developed in other covid-19 cohorts often performing poorly (range 0.63-0.73). Conclusions: An easy-to-use risk stratification score has been developed and validated based on commonly available parameters at hospital presentation. The 4C Mortality Score outperformed existing scores, showed utility to directly inform clinical decision making, and can be used to stratify patients admitted to hospital with covid-19 into different management groups. The score should be further validated to determine its applicability in other populations. Study registration: ISRCTN66726260
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
APACHE II-A Severity of Disease Classification System: Reply
Knaus, W. A., Draper, E. A., Wagner, D. P., & Zimmerman, J. E. (1986) · Critical Care Medicine · doi:10.1097/00003246-198608000-00028 · Cited by 13,376
Vincent, J. L., Moreno, R., Takala, J., Willatts, S., De Mendonça, A., Bruining, H., Reinhart, C. K., Suter, P. M., & Thijs, L. G. (1996) · Intensive Care Medicine · doi:10.1007/bf01709751 · Cited by 11,674
Yang, X., Yu, Y., Xu, J., Shu, H., Xia, J., Liu, H., Wu, Y., Zhang, L., Yu, Z., Fang, M., et al. (2020) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(20)30079-5 · Cited by 10,066
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Decision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341
APACHE II: a severity of disease classification system.
Knaus, W. A., Draper, E. S., Wagner, D. P., & Zimmerman, J. E. (1985) · PubMed · Cited by 6,034
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Cited by
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Effect of Hydroxychloroquine in Hospitalized Patients with Covid-19
The RECOVERY Collaborative Group (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2022926 · Cited by 1,265
Booth, A., Reed, A. B., Ponzo, S., Yassaee, A., Aral, M., Plans, D., Labrique, A., & Mohan, D. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247461 · Cited by 551
Comorbidities, multimorbidity and COVID-19
Russell, C. D., Lone, N. I., & Baillie, J. K. (2023) · Nature Medicine · doi:10.1038/s41591-022-02156-9 · Cited by 368
Self-citationSigfrid, L., Drake, T. M., Pauley, E., Jesudason, E. C., Olliaro, P., Lim, W. S., Gillesen, A., Berry, C., Lowe, D. J., McPeake, J., et al. (2021) · The Lancet Regional Health - Europe · doi:10.1016/j.lanepe.2021.100186 · Cited by 336
Self-citationAdeloye, D., Elneima, O., Daines, L., Poinasamy, K., Quint, J. K., Walker, S., Brightling, C. E., Siddiqui, S., Hurst, J. R., Chalmers, J. D., et al. (2021) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(21)00286-1 · Cited by 126
Self-citationMoore, S. C., Penrice-Randal, R., Alruwaili, M., Dong, X., Pullan, S. T., Carter, D. P., Bewley, K., Zhao, Q., Sun, Y., Hartley, C., et al. (2020) · doi:10.1101/2020.03.05.20032011 · Cited by 121
Self-citationGoodacre, S., Thomas, B., Sutton, L., Burnsall, M., Lee, E., Bradburn, M., Loban, A., Waterhouse, S., Simmonds, R., Biggs, K., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245840 · Cited by 89
Kamran, F., Tang, S., Otles, E., McEvoy, D. S., Saleh, S. N., Gong, J., Li, B. Y., Dutta, S., Liu, X., Medford, R. J., et al. (2022) · BMJ · doi:10.1136/bmj-2021-068576 · Cited by 60
Rinderknecht, M. D., & Klopfenstein, Y. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00482-9 · Cited by 23
Laxar, D., Eitenberger, M., Maleczek, M., Kaider, A., Hammerle, F. P., & Kimberger, O. (2023) · BMC Medicine · doi:10.1186/s12916-023-03068-2 · Cited by 19
“This was achieved by showing the most influential factors in the scoring formula which was based on the 4C score by Knight et al. [16] and is shown in Fig.”
MethodCOVID-19 emergency department discharges: an outcome study
Lanham, D., Roe, J., Chauhan, A., Evans, R., Hillman, T., Logan, S., & Heightman, M. (2021) · Clinical Medicine · doi:10.7861/clinmed.2020-0817 · Cited by 14
Abdulaal, A., Patel, A., Al-Hindawi, A., Charani, E., Alqahtani, S. A., Davies, G. W., Mughal, N., & Moore, L. S. P. (2021) · JMIR Formative Research · doi:10.2196/27992 · Cited by 13
Metadata
- Authors
- Knight, S. R., Ho, A., Pius, R., Buchan, I., Carson, G., Drake, T. M., Dunning, J., Fairfield, C. J., Gamble, C., Green, C. A., Gupta, R., Halpin, S., Hardwick, H. E., Holden, K. A., Horby, P. W., Jackson, C., Mclean, K. A., Merson, L., Nguyen-Van-Tam, J. S., Norman, L., Noursadeghi, M., Olliaro, P. L., Pritchard, M. G., Russell, C. D., Shaw, C. A., Sheikh, A., Solomon, T., Sudlow, C., Swann, O. V., Turtle, L. C., Openshaw, P. J., Baillie, J. K., Semple, M. G., Docherty, A. B., & Harrison, E. M.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2020-09-09
- Volume
- 370
- Pages
- m3339
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W3046629770
- Cited by
- 1,029
- References
- 43
- FWCI
- 24.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.