The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Strengths and limitations of early warning scores: A systematic review and narrative synthesis
Abstract
BACKGROUND Early warning scores are widely used to identify deteriorating patients. Whilst their ability to predict clinical outcomes has been extensively reviewed, there has been no attempt to summarise the overall strengths and limitations of these scores for patients, staff and systems. This review aims to address this gap in the literature to guide improvements for the optimization of patient safety. METHODS A systematic review was conducted of MEDLINE®, PubMed, CINAHL and The Cochrane Library in September 2016. The citations and reference lists of selected studies were reviewed for completeness. Studies were included if they evaluated vital signs monitoring in adult human subjects. Studies regarding the paediatric population were excluded, as were studies describing the development or validation of monitoring models. A narrative synthesis of qualitative, quantitative and mixed- methods studies was undertaken. FINDINGS 232 studies met the inclusion criteria. Twelve themes were identified from synthesis of the data: Strengths of early warning scores included their prediction value, influence on clinical outcomes, cross-specialty application, international relevance, interaction with other variables, impact on communication and opportunity for automation. Limitations included their sensitivity, the need for practitioner engagement, the need for reaction to escalation and the need for clinical judgment, and the intermittent nature of recording. Early warning scores are known to have good predictive value for patient deterioration and have been shown to improve patient outcomes across a variety of specialties and international settings. This is partly due to their facilitation of communication between healthcare workers. There is evidence that the prediction value of generic early warning scores suffers in comparison to specialty-specific scores, and that their sensitivity can be improved by the addition of other variables. They are also prone to inaccurate recording and user error, which can be partly overcome by automation. CONCLUSIONS Early warning scores provide the right language and environment for the timely escalation of patient care. They are limited by their intermittent and user-dependent nature, which can be partially overcome by automation and new continuous monitoring technologies, although clinical judgment remains paramount.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
Subbe, C. P., Davies, R. G., Williams, E., Rutherford, P., & Gemmell, L. (2003) · Anaesthesia · doi:10.1046/j.1365-2044.2003.03258.x · Cited by 446
Gardner-Thorpe, J., Love, N., Wrightson, J., Walsh, S., & Keeling, N. (2006) · The Annals of The Royal College of Surgeons of England · doi:10.1308/003588406x130615 · Cited by 375
Physiological abnormalities in early warning scores are related to mortality in adult inpatients †
Goldhill, D. R., & McNarry, A. F. (2004) · British Journal of Anaesthesia · doi:10.1093/bja/aeh113 · Cited by 325
Goldhill, D. R., McNarry, A. F., Mandersloot, G., & McGinley, A. (2005) · Anaesthesia · doi:10.1111/j.1365-2044.2005.04186.x · Cited by 304
Ludikhuize, J., Smorenburg, S. M., de Rooij, S. E., & de Jonge, E. (2012) · Journal of Critical Care · doi:10.1016/j.jcrc.2012.01.003 · Cited by 250
Bellomo, R., Ackerman, M., Bailey, M., Beale, R., Clancy, G., Danesh, V., Hvarfner, A., Jimenez, E., Konrad, D., Lecardo, M., et al. (2012) · Critical Care Medicine · doi:10.1097/ccm.0b013e318255d9a0 · Cited by 228
Modified early warning score predicts the need for hospital admission and inhospital mortality
Burch, V. C., Tarr, G., & Morroni, C. (2008) · Emergency Medicine Journal · doi:10.1136/emj.2007.057661 · Cited by 215
Paterson, R., MacLeod, D., Thetford, D., Beattie, A., Graham, C., Lam, S., & Bell, D. (2006) · Clinical Medicine · doi:10.7861/clinmedicine.6-3-281 · Cited by 212
Packaging: a grounded theory of how to report physiological deterioration effectively
Andrews, T., & Waterman, H. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03615.x · Cited by 189
Validation of the National Early Warning Score in the prehospital setting
Silcock, D. J., Corfield, A. R., Gowens, P. A., & Rooney, K. D. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2014.12.029 · Cited by 187
Predicting Cardiac Arrest on the Wards
Churpek, M. M., Yuen, T. C., Huber, M. T., Park, S. Y., Hall, J. B., & Edelson, D. P. (2012) · Chest · doi:10.1378/chest.11-1301 · Cited by 185
Longitudinal analysis of one million vital signs in patients in an academic medical center
Bleyer, A. J., Vidya, S., Russell, G. B., Jones, C. M., Sujata, L., Daeihagh, P., & Hire, D. (2011) · Resuscitation · doi:10.1016/j.resuscitation.2011.06.033 · Cited by 178
Cuthbertson, B. H., Boroujerdi, M., McKie, L., Aucott, L., & Prescott, G. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000254826.10520.87 · Cited by 165
Edwards, S. E., Grobman, W. A., Lappen, J. R., Winter, C., Fox, R., Lenguerrand, E., & Draycott, T. (2015) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2014.11.007 · Cited by 164
Long-term effect of introducing an early warning score on respiratory rate charting on general wards
McBride, J., Knight, D., Piper, J., & Smith, G. B. (2005) · Resuscitation · doi:10.1016/j.resuscitation.2004.10.015 · Cited by 160
Barlow, G. D., Nathwani, D., & Davey, P. (2006) · Thorax · doi:10.1136/thx.2006.067371 · Cited by 157
Hands, C., Reid, E., Meredith, P., Smith, G. B., Prytherch, D. R., Schmidt, P. E., & Featherstone, P. I. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001954 · Cited by 156
A national early warning score for acutely ill patients
McGinley, A., & Pearse, R. M. (2012) · BMJ · doi:10.1136/bmj.e5310 · Cited by 156
Prytherch, D. R., Smith, G. B., Schmidt, P. E., Featherstone, P. I., Stewart, K., Knight, D., & Higgins, B. (2006) · Resuscitation · doi:10.1016/j.resuscitation.2005.12.002 · Cited by 139
Fullerton, J. N., Price, C., Silvey, N., Brace, S. J., & Perkins, G. D. (2012) · Resuscitation · doi:10.1016/j.resuscitation.2012.01.004 · Cited by 139
Moon, A., Cosgrove, J. F., Lea, D., Fairs, A., & Cressey, D. M. (2010) · Resuscitation · doi:10.1016/j.resuscitation.2010.09.480 · Cited by 122
Impact of introducing an electronic physiological surveillance system on hospital mortality
Schmidt, P. E., Meredith, P., Prytherch, D. R., Watson, D., Watson, V., Killen, R. M., Greengross, P., Mohammed, M. A., & Smith, G. B. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003073 · Cited by 117
Jones, S., Mullally, M., Ingleby, S., Buist, M., Bailey, M., & EDDLESTON, J. M. (2011) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01850-1 · Cited by 115
Bayer, O., Schwarzkopf, D., Stumme, C., Stacke, A., Hartog, C. S., Hohenstein, C., Kabisch, B., Reichel, J., Reinhart, K., & Winning, J. (2015) · Academic Emergency Medicine · doi:10.1111/acem.12707 · Cited by 111
Detection and management of the deteriorating ward patient: an evaluation of nursing practice
Odell, M. (2014) · Journal of Clinical Nursing · doi:10.1111/jocn.12655 · Cited by 105
Cei, M., Bartolomei, C., & Mumoli, N. (2009) · International Journal of Clinical Practice · doi:10.1111/j.1742-1241.2008.01986.x · Cited by 104
Differences in Vital Signs Between Elderly and Nonelderly Patients Prior to Ward Cardiac Arrest
Churpek, M. M., Yuen, T. C., Winslow, C. J., Hall, J. B., & Edelson, D. P. (2015) · Critical Care Medicine · doi:10.1097/ccm.0000000000000818 · Cited by 100
Existing models fail to predict sepsis in an obstetric population with intrauterine infection
Lappen, J. R., Keene, M., Lore, M., Grobman, W. A., & Gossett, D. R. (2010) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2010.07.040 · Cited by 96
Kellett, J. G., & Kim, A. (2011) · Resuscitation · doi:10.1016/j.resuscitation.2011.08.022 · Cited by 92
Kyriacos, U., Jelsma, J. M., James, M. F., & Jordan, S. E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087073 · Cited by 84
Clifton, D. A., Clifton, L., Sandu, D.-M., Smith, G. B., Tarassenko, L., Vollam, S., & Watkinson, P. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007376 · Cited by 83
Smith, A. F., & Oakey, R. J. (2006) · Anaesthesia · doi:10.1111/j.1365-2044.2005.04513.x · Cited by 83
Factors affecting response to National Early Warning Score (NEWS)
Kolić, I., Crane, S., McCartney, S., Perkins, Z., & Taylor, A. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2015.02.009 · Cited by 80
Serious adverse events in a hospital using early warning score – What went wrong?
Petersen, J. A., Mackel, R., Antonsen, K., & Rasmussen, L. S. (2014) · Resuscitation · doi:10.1016/j.resuscitation.2014.08.037 · Cited by 79
The prognostic value of the Modified Early Warning Score in critically ill patients
Reini, K., Fredrikson, M. G., & Oscarsson, A. (2012) · European Journal of Anaesthesiology · doi:10.1097/eja.0b013e32835032d8 · Cited by 78
Comparison of the National Early Warning Score in non‐elective medical and surgical patients
Kovacs, C., Jarvis, S. W., Prytherch, D., Meredith, P., Schmidt, P., Briggs, J., & Smith, G. B. (2016) · British Journal of Surgery · doi:10.1002/bjs.10267 · Cited by 72
The recognition and early management of critical illness
Ridley, S. (2005) · Annals of The Royal College of Surgeons of England · doi:10.1308/003588405x60669 · Cited by 70
Nursing documentation prior to emergency admissions to the intensive care unit
Jónsson, Þ., Jónsdóttir, H., Möller, A. D., et al. (2011) · Nursing in Critical Care · doi:10.1111/j.1478-5153.2011.00427.x · Cited by 62
Improving accuracy and efficiency of early warning scores in acute care
Mohammed, M. A., Hayton, R., Clements, G., Smith, G. B., & Prytherch, D. R. (2009) · British Journal of Nursing · doi:10.12968/bjon.2009.18.1.32072 · Cited by 62
Badriyah, T., Briggs, J. S., Meredith, P., Jarvis, S. W., Schmidt, P. E., Featherstone, P. I., Prytherch, D. R., & Smith, G. B. (2013) · Resuscitation · doi:10.1016/j.resuscitation.2013.12.011 · Cited by 61
Simmes, F. M., Schoonhoven, L., Mintjes, J., Fikkers, B., & van der Hoeven, J. G. (2012) · Annals of Intensive Care · doi:10.1186/2110-5820-2-20 · Cited by 60
Single Deranged Physiologic Parameters Are Associated With Mortality in a Low-Income Country
Baker, T., Blixt, J., Lugazia, E., Schell, C. O., Mulungu, M., Milton, A., Castegren, M., Eriksen, J., & Konrad, D. (2015) · Critical Care Medicine · doi:10.1097/ccm.0000000000001194 · Cited by 57
Stevenson, J. E., Israelsson, J., Nilsson, G. C., Petersson, G., & Bath, P. A. (2014) · Health Informatics Journal · doi:10.1177/1460458214530136 · Cited by 55
Opio, M. O., Nansubuga, G., & Kellett, J. G. (2013) · Resuscitation · doi:10.1016/j.resuscitation.2013.02.007 · Cited by 48
O'Dell, M. L., Rechner, I., Kapila, A., Even, T., Oliver, D., Davies, C. W. H., Milsom, L., Forster, A. J., & Rudman, K. (2007) · Resuscitation · doi:10.1016/j.resuscitation.2007.01.035 · Cited by 48
Garcea, G., Ganga, R., Neal, C. P., Ong, S. L., Dennison, A. R., & Berry, D. P. (2008) · Journal of Surgical Research · doi:10.1016/j.jss.2008.08.013 · Cited by 45
Intensive Care Unit without walls: Seeking patient safety by improving the efficiency of the system
Vidal, F. G., & Abella, A. (2014) · Medicina Intensiva · doi:10.1016/j.medin.2014.02.001 · Cited by 43
Bonnici, T., Tarassenko, L., Clifton, D. A., & Watkinson, P. (2013) · Clinical Medicine · doi:10.7861/clinmedicine.13-3-252 · Cited by 40
Asiimwe, S. B., Mbonde, A. A., & Ssekitoleko, R. (2015) · Critical Care · doi:10.1186/s13054-015-0826-8 · Cited by 33
Bunkenborg, G., Samuelson, K. A. M., Poulsen, I., Ladelund, S., & Åkeson, J. (2013) · Resuscitation · doi:10.1016/j.resuscitation.2013.11.023 · Cited by 33
Kellett, J. G., Fei, W., Woodworth, S., & Huang, W. (2012) · Resuscitation · doi:10.1016/j.resuscitation.2012.12.002 · Cited by 30
Peris, A., Zagli, G., Maccarrone, N., et al. (2012) · PubMed · Cited by 26
Early warning score predicts acute mortality in stroke patients
Liljehult, J., & Christensen, T. (2015) · Acta Neurologica Scandinavica · doi:10.1111/ane.12452 · Cited by 24
Cuthbertson, B. H., Boroujerdi, M. A., & Prescott, G. J. (2010) · The Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2010.105 · Cited by 24
Physiological Scoring: An Aid to Emergency Medical Services Transport Decisions?
Challen, K., & Walter, D. (2010) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x00008268 · Cited by 23
The National Early Warning Score in practice: a reflection
Day, T. L., & Oxton, J. (2014) · British Journal of Nursing · doi:10.12968/bjon.2014.23.19.1036 · Cited by 20
Huggan, P. J., Akram, F., Er, B., Christen, L. S. J., Weixian, L., Lim, V. J., Huang, Y., & Merchant, R. A. (2015) · Internal Medicine Journal · doi:10.1111/imj.12795 · Cited by 20
Lee, J., & Choi, H. R. (2014) · Journal of Korean Academy of Nursing · doi:10.4040/jkan.2014.44.2.219 · Cited by 20
Yiu, C. J., Khan, S., Subbe, C. P., Tofeec, K., Madge, R. A., & Midcentral DHB, P. N. (2014) · Acute Medicine Journal · doi:10.52964/amja.0343 · Cited by 16
Stark, A. P., Maciel, R. C., Sheppard, W. L., Sacks, G. D., & Hines, O. J. (2015) · The American Surgeon · doi:10.1177/000313481508101001 · Cited by 14
Smith, M. A. C., Smith, P. A., & Crow, R. A. (2013) · Journal of Clinical Nursing · doi:10.1111/jocn.12463 · Cited by 13
Cited by
The myth of generalisability in clinical research and machine learning in health care
Futoma, J., Simons, M., Panch, T., Doshi-Velez, F., & Celi, L. A. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30186-2 · Cited by 467
Machine learning in clinical decision making
Adlung, L., Cohen, Y., Mor, U., & Elinav, E. (2021) · Med · doi:10.1016/j.medj.2021.04.006 · Cited by 282
Aquino, Y. S. J., Rogers, W. A., Braunack-Mayer, A., Frazer, H., Win, K. T., Houssami, N., Degeling, C., Semsarian, C., & Carter, S. M. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104903 · Cited by 131
Lin, C.-S., Liu, W.-T., Tsai, D.-J., Lou, Y.-S., Chang, C.-H., Lee, C.-C., Fang, W.-H., Wang, C.-C., Chen, Y.-Y., Lin, W.-S., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-02961-4 · Cited by 115
Tarabichi, Y., Cheng, A., Bar-Shain, D., McCrate, B. M., Reese, L. H., Emerman, C., Siff, J., Wang, C., Kaelber, D. C., Watts, B., et al. (2022) · Critical Care Medicine · doi:10.1097/ccm.0000000000005267 · Cited by 76
Metadata
- Authors
- Downey, C. L., Tahir, W., Randell, R., Brown, J. M., & Jayne, D. G.
- Venue
- International Journal of Nursing Studies
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 76
- Pages
- 106-119
- ISSN
- 0020-7489 (ISSN-L)
- OpenAlex
- W2755061600
- Cited by
- 258
- References
- 62
- FWCI
- 5.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.