The Kaiser Permanente Northern California Advance Alert Monitor Program: An Automated Early Warning System for Adults at Risk for In-Hospital Clinical Deterioration
Abstract
Background In-hospital deterioration among ward patients is associated with substantially increased adverse outcome rates. In 2013 Kaiser Permanente Northern California (KPNC) developed and implemented a predictive analytics-driven program, Advance Alert Monitor (AAM), to improve early detection and intervention for in-hospital deterioration. The AAM predictive model is designed to give clinicians 12 hours of lead time before clinical deterioration, permitting early detection and a patient goals-concordant response to prevent worsening. Design of the aam intervention Across the 21 hospitals of the KPNC integrated health care delivery system, AAM analyzes electronic health record (EHR) data for patients in medical/surgical and telemetry units 24 hours a day, 7 days a week. Patients identified as high risk by the AAM algorithm trigger an alert for a regional team of experienced critical care virtual quality nurse consultants (VQNCs), who then cascade validated, actionable information to rapid response team (RRT) nurses at local hospitals. RRT nurses conduct bedside assessments of at-risk patients and formulate interdisciplinary clinical responses with hospital-based physicians, bedside nurses, and supportive care teams to ensure a well-defined escalation plan that includes clarification of the patients' goals of care. Success of the intervention Since 2019 the AAM program has been implemented at all 21 KPNC hospitals. The use of predictive modeling embedded within the EHR to identify high-risk patients has produced the standardization of monitoring workflows, clinical rescue protocols, and coordination to ensure that care is consistent with patients' individual goals of care. An evaluation of the program, using a staggered deployment sequence over 19 hospitals, demonstrates that the AAM program is associated with statistically significant decreases in mortality (9.8% vs. 14.4%), hospital length of stay, and ICU length of stay. Statistical analyses estimated that more than 500 deaths were prevented each year with the AAM program. Lessons learned Unlocking the potential of predictive modeling in the EHR is the first step toward realizing the promise of artificial intelligence/machine learning (AI/ML) to improve health outcomes. The AAM program leveraged predictive analytics to produce highly reliable care by identifying at-risk patients, preventing deterioration, and reducing adverse outcomes and can be used as a model for how clinical decision support and inpatient population management can effectively improve care.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration
Escobar, G. J., Liu, V. X., Schuler, A., Lawson, B., Greene, J. D., & Kipnis, P. (2020) · New England Journal of Medicine · doi:10.1056/nejmsa2001090 · Cited by 314 · see citing works
Self-citationLiu, V. X., Kipnis, P., Rizk, N. W., & Escobar, G. J. (2011) · Journal of Hospital Medicine · doi:10.1002/jhm.964 · Cited by 137 · see citing works
Self-citationEscobar, G. J., Greene, J., Gardner, M. N., Marelich, G. P., Quick, B., & Kipnis, P. (2010) · Journal of Hospital Medicine · doi:10.1002/jhm.817 · Cited by 113 · see citing works
Bapoje, S. R., Gaudiani, J. L., Narayanan, V., & Albert, R. K. (2010) · Journal of Hospital Medicine · doi:10.1002/jhm.812 · Cited by 89 · see citing works
Linnen, D. T., Escobar, G. J., Hu, X., Scruth, E. A., Liu, V. X., & Stephens, C. E. (2019) · Journal of Hospital Medicine · doi:10.12788/jhm.3151 · Cited by 52 · see citing works
Self-citationKim, Y. S., Escobar, G. J., Halpern, S. D., Greene, J., Kipnis, P., & Liu, V. X. (2016) · Journal of the American Geriatrics Society · doi:10.1111/jgs.14048 · Cited by 41 · see citing works
Self-citationIncorporating an Early Detection System Into Routine Clinical Practice in Two Community Hospitals
Dummett, B. A., Adams, C. L., Scruth, E. A., Liu, V. X., Guo, M., & Escobar, G. J. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2661 · Cited by 32 · see citing works
Self-citationWhat Do We Do After the Pilot Is Done? Implementation of a Hospital Early Warning System at Scale
Paulson, S. S., Dummett, B. A., Green, J., Scruth, E. A., Reyes, V., & Escobar, G. J. (2020) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2020.01.003 · Cited by 24 · see citing works
Self-citationDeveloping a Virtual Nursing Team to Support Predictive Analytics and Gaps in Patient Care
Lisk, L. E., Buckley, J. D., Wilson, K., et al. (2019) · Clinical Nurse Specialist · doi:10.1097/nur.0000000000000496 · Cited by 18 · see citing works
Self-citationGranich, R., Sutton, Z., Kim, Y. S., Anderson, M. L., Wood, H. A., Scharf, J., Ragins, A. I., & Escobar, G. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2660 · Cited by 15 · see citing works
Flagged first, then by citations
Cited by
Still being checked.
- Authors
- Martinez, V. A., Betts, R. K., Scruth, E. A., Buckley, J. D., Cadiz, V. R., Bertrand, L. D., Paulson, S. S., Dummett, B. A., Abhyankar, S. S., Reyes, V. M., Hatton, J. R., Sulit, R., & Liu, V. X.
- Venue
- The Joint Commission Journal on Quality and Patient Safety
- Publisher
- Elsevier BV
- Published
- 2022-08
- Volume
- 48
- Issue
- 8
- Pages
- 370-375
- ISSN
- 1553-7250 (ISSN-L)
- OpenAlex
- W4287831445
- Cited by
- 21
- References
- 10
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 5 · 2023: 4
- FWCI
- 3.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Joint Commission Journal on Quality and Patient Safety (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Kaiser Permanente
- Topics
- Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- early warning systems, predictive analytics, electronic health record alerts, rapid response teams, goals of care, mortality reduction, length of hospital stay, clinical decision support, artificial intelligence in healthcare, Kaiser Permanente Northern California
- MeSH terms
- Clinical Deterioration, Adult, Artificial Intelligence, Hospitals, Humans, Inpatients, Monitoring, Physiologic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review