The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score
Open accessAbstract
Objective: To develop and validate a pragmatic risk score to predict mortality in patients admitted to hospital with coronavirus disease 2019 (covid-19). Design: Prospective observational cohort study. Setting: International Severe Acute Respiratory and emerging Infections Consortium (ISARIC) World Health Organization (WHO) Clinical Characterisation Protocol UK (CCP-UK) study (performed by the ISARIC Coronavirus Clinical Characterisation Consortium—ISARIC-4C) in 260 hospitals across England, Scotland, and Wales. Model training was performed on a cohort of patients recruited between 6 February and 20 May 2020, with validation conducted on a second cohort of patients recruited after model development between 21 May and 29 June 2020 . Participants: Adults (age ≥18 years) admitted to hospital with covid-19 at least four weeks before final data extraction. Main outcome measure: In-hospital mortality. Results: 35 463 patients were included in the derivation dataset (mortality rate 32.2%) and 22 361 in the validation dataset (mortality rate 30.1%). The final 4C Mortality Score included eight variables readily available at initial hospital assessment: age, sex, number of comorbidities, respiratory rate, peripheral oxygen saturation, level of consciousness, urea level, and C reactive protein (score range 0-21 points). The 4C Score showed high discrimination for mortality (derivation cohort: area under the receiver operating characteristic curve 0.79, 95% confidence interval 0.78 to 0.79; validation cohort: 0.77, 0.76 to 0.77) with excellent calibration (validation: calibration-in-the-large=0, slope=1.0). Patients with a score of at least 15 (n=4158, 19%) had a 62% mortality (positive predictive value 62%) compared with 1% mortality for those with a score of 3 or less (n=1650, 7%; negative predictive value 99%). Discriminatory performance was higher than 15 pre-existing risk stratification scores (area under the receiver operating characteristic curve range 0.61-0.76), with scores developed in other covid-19 cohorts often performing poorly (range 0.63-0.73). Conclusions: An easy-to-use risk stratification score has been developed and validated based on commonly available parameters at hospital presentation. The 4C Mortality Score outperformed existing scores, showed utility to directly inform clinical decision making, and can be used to stratify patients admitted to hospital with covid-19 into different management groups. The score should be further validated to determine its applicability in other populations. Study registration: ISRCTN66726260
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
APACHE II-A Severity of Disease Classification System: Reply
Knaus, W. A., Draper, E. A., Wagner, D. P., & Zimmerman, J. E. (1986) · Critical Care Medicine · doi:10.1097/00003246-198608000-00028 · Cited by 13,376
Vincent, J. L., Moreno, R., Takala, J., Willatts, S., De Mendonça, A., Bruining, H., Reinhart, C. K., Suter, P. M., & Thijs, L. G. (1996) · Intensive Care Medicine · doi:10.1007/bf01709751 · Cited by 11,674
Yang, X., Yu, Y., Xu, J., Shu, H., Xia, J., Liu, H., Wu, Y., Zhang, L., Yu, Z., Fang, M., et al. (2020) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(20)30079-5 · Cited by 10,066
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Decision curve analysis: a novel method for evaluating prediction models
Vickers, A. J., & Elkin, E. B. (2006) · Medical Decision Making · doi:10.1177/0272989x06295361 · Cited by 6,341
APACHE II: a severity of disease classification system.
Knaus, W. A., Draper, E. S., Wagner, D. P., & Zimmerman, J. E. (1985) · PubMed · Cited by 6,034
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
A Prediction Rule to Identify Low-Risk Patients with Community-Acquired Pneumonia
Fine, M. J., Auble, T. E., Yealy, D. M., Hanusa, B. H., Weissfeld, L. A., Singer, D. E., Coley, C. M., Marrie, T. J., & Kapoor, W. N. (1997) · New England Journal of Medicine · doi:10.1056/nejm199701233360402 · Cited by 4,582
Receiver Operating Characteristic Curve in Diagnostic Test Assessment
Mandrekar, J. N. (2010) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e3181ec173d · Cited by 4,506
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
Comorbidity and its impact on 1590 patients with covid-19 in China: a nationwide analysis
Guan, W.-J., Liang, W.-H., Zhao, Y., Liang, H.-R., Chen, Z.-S., Li, Y.-M., Liu, X.-Q., Chen, R.-C., Tang, C.-L., Wang, T., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.00547-2020 · Cited by 3,680
Docherty, A. B., Harrison, E. M., Green, C. A., Hardwick, H. E., Pius, R., Norman, L., Holden, K. A., Read, J. M., Dondelinger, F., Carson, G., et al. (2020) · BMJ · doi:10.1136/bmj.m1985 · Cited by 3,481
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Lim, W. S. (2003) · Thorax · doi:10.1136/thorax.58.5.377 · Cited by 3,070
Calculating the sample size required for developing a clinical prediction model
Riley, R. D., Ensor, J., Snell, K. I. E., Harrell, F. E., Martin, G. P., Reitsma, J. B., Moons, K. G. M., Collins, G., & van Smeden, M. (2020) · BMJ · doi:10.1136/bmj.m441 · Cited by 2,917
Peduzzi, P., Concato, J., Feinstein, A. R., & Holford, T. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00048-8 · Cited by 2,154
Simonnet, A., Chetboun, M., Poissy, J., Raverdy, V., Noulette, J., Duhamel, A., Labreuche, J., Mathieu, D., Pattou, F., Jourdain, M., et al. (2020) · Obesity · doi:10.1002/oby.22831 · Cited by 2,079
Liang, W., Liang, H., Ou, L., Chen, B., Chen, A., Li, C., Li, Y., Guan, W., Sang, L., Lu, J., et al. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.2033 · Cited by 1,387
Deep Learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) With CT Images
Song, Y., Zheng, S., Li, L., Zhang, X., Zhang, X., Huang, Z., Chen, J., Wang, R., Zhao, H., Chong, Y., et al. (2021) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3065361 · Cited by 957
Obesity Is a Risk Factor for Severe COVID-19 Infection: Multiple Potential Mechanisms
Sattar, N., McInnes, I. B., & McMurray, J. J. V. (2020) · Circulation · doi:10.1161/circulationaha.120.047659 · Cited by 704
How to develop a more accurate risk prediction model when there are few events
Pavlou, M., Ambler, G., Seaman, S. R., Guttmann, O., Elliott, P., King, M., & Omar, R. Z. (2015) · BMJ · doi:10.1136/bmj.h3868 · Cited by 664
Cardiovascular comorbidity and its impact on patients with COVID-19
Guan, W.-J., Liang, W.-H., He, J.-X., & Zhong, N.-S. (2020) · European Respiratory Journal · doi:10.1183/13993003.01227-2020 · Cited by 618
Charles, P. G. P., Wolfe, R., Whitby, M., Fine, M. J., Fuller, A. J., Stirling, R., Wright, A. A., Ramirez, J. A., Christiansen, K. J., Waterer, G. W., et al. (2008) · Clinical Infectious Diseases · doi:10.1086/589754 · Cited by 536
Prognostic Value of C-Reactive Protein in Patients With Coronavirus 2019
Luo, X., Zhou, W., Yan, X., Guo, T., Wang, B., Xia, H., Ye, L., Xiong, J., Jiang, Z., Liu, Y., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa641 · Cited by 481
Estimation of risk factors for COVID-19 mortality - preliminary results
Caramelo, F., Ferreira, N., & Oliveiros, B. (2020) · medRxiv · doi:10.1101/2020.02.24.20027268 · Cited by 236
Gupta, R. K., Marks, M., Samuels, T. H. A., Luintel, A., Rampling, T., Chowdhury, H., Quartagno, M., Nair, A., Lipman, M., Abubakar, I., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.03498-2020 · Cited by 199
Self-citationXie, J., Hungerford, D., Chen, H., Abrams, S. T., Li, S., Wang, G., Wang, Y., Kang, H., Bonnett, L. J., Zheng, R., et al. (2020) · SSRN Electronic Journal · doi:10.1101/2020.03.28.20045997 · Cited by 164
España, P. P., Capelastegui, A., Quintana, J. M., Díez, R., Gorordo, I., Bilbao, A., Zalacaín, R., Menéndez, R., & Torres, A. (2009) · CHEST Journal · doi:10.1378/chest.08-2179 · Cited by 119
Hacking, J., Müller, S., & Buchan, I. E. (2011) · BMJ · doi:10.1136/bmj.d508 · Cited by 102
Self-citationLiu, J.-L., Xu, F., Zhou, H., Wu, X.-J., Shi, L.-X., Lu, R.-Q., Farcomeni, A., Venditti, M., Zhao, Y.-L., Luo, S.-Y., et al. (2016) · Scientific Reports · doi:10.1038/srep22911 · Cited by 89
Open source clinical science for emerging infections
Dunning, J. W., Merson, L., Rohde, G. G. U., Gao, Z., Semple, M. G., Tran, D., Gordon, A. C., Olliaro, P., Khoo, S., Bruzzone, R., et al. (2013) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(13)70327-x · Cited by 84
Self-citationNorth-South disparities in English mortality1965–2015: longitudinal population study
Buchan, I. E., Kontopantelis, E., Sperrin, M., Chandola, T., & Doran, T. (2017) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2017-209195 · Cited by 81
Self-citationHarrison, E. M., Docherty, A. B., Barr, B., Buchan, I. E., Carson, G., Drake, T. M., Dunning, J. W., Fairfield, C. J., Gamble, C. L., Green, C., et al. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3618215 · Cited by 68
Self-citationInfluenza-associated pneumonia as reference to assess seriousness of coronavirus disease (COVID-19)
Tolksdorf, K., Buda, S., Schuler, E., Wieler, L. H., & Haas, W. (2020) · Eurosurveillance · doi:10.2807/1560-7917.es.2020.25.11.2000258 · Cited by 59
Zhang, H., Shi, T., Wu, X., Zhang, X., Wang, K., Bean, D. M., Dobson, R., Teo, J., Sun, J., Zhao, P., et al. (2020) · SSRN Electronic Journal · doi:10.1101/2020.04.28.20082222 · Cited by 45
Improvement of CRB-65 as a prognostic tool in adult patients with community-acquired pneumonia
Dwyer, R. C., Hedlund, J., Henriques‐Normark, B., & Kalin, M. (2014) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2014-000038 · Cited by 43
Williams, R. D., Markus, A. F., Yang, C. B., Duarte‐Salles, T., DuVall, S. L., Falconer, T., Jonnagaddala, J., Kim, C., Rho, Y., Williams, A. E., et al. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01505-z · Cited by 43
Use of generalised additive models to categorise continuous variables in clinical prediction
Barrio, I., Aróstegui, I., Quintana, J. M., et al. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-83 · Cited by 36
Cited by
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Effect of Hydroxychloroquine in Hospitalized Patients with Covid-19
The RECOVERY Collaborative Group (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2022926 · Cited by 1,265
Booth, A., Reed, A. B., Ponzo, S., Yassaee, A., Aral, M., Plans, D., Labrique, A., & Mohan, D. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247461 · Cited by 551
Comorbidities, multimorbidity and COVID-19
Russell, C. D., Lone, N. I., & Baillie, J. K. (2023) · Nature Medicine · doi:10.1038/s41591-022-02156-9 · Cited by 368
Self-citationSigfrid, L., Drake, T. M., Pauley, E., Jesudason, E. C., Olliaro, P., Lim, W. S., Gillesen, A., Berry, C., Lowe, D. J., McPeake, J., et al. (2021) · The Lancet Regional Health - Europe · doi:10.1016/j.lanepe.2021.100186 · Cited by 336
Self-citation
Metadata
- Authors
- Knight, S. R., Ho, A., Pius, R., Buchan, I., Carson, G., Drake, T. M., Dunning, J., Fairfield, C. J., Gamble, C., Green, C. A., Gupta, R., Halpin, S., Hardwick, H. E., Holden, K. A., Horby, P. W., Jackson, C., Mclean, K. A., Merson, L., Nguyen-Van-Tam, J. S., Norman, L., Noursadeghi, M., Olliaro, P. L., Pritchard, M. G., Russell, C. D., Shaw, C. A., Sheikh, A., Solomon, T., Sudlow, C., Swann, O. V., Turtle, L. C., Openshaw, P. J., Baillie, J. K., Semple, M. G., Docherty, A. B., & Harrison, E. M.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2020-09-09
- Volume
- 370
- Pages
- m3339
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W3046629770
- Cited by
- 1,029
- References
- 43
- FWCI
- 24.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.