Cited by 21Healthcare Technology and Patient MonitoringMachine Learning in HealthcareElectronic Health Records Systems

The Kaiser Permanente Northern California Advance Alert Monitor Program: An Automated Early Warning System for Adults at Risk for In-Hospital Clinical Deterioration

Martinez, Vanessa A., Betts, Robin K., Scruth, Elizabeth A., Buckley, Jacqueline D., Cadiz, Vilma R., Bertrand, Linda D., Paulson, Shirley S., Dummett, Brian Alex +5 more·2022·The Joint Commission Journal on Quality and Patient Safety

Abstract

Background In-hospital deterioration among ward patients is associated with substantially increased adverse outcome rates. In 2013 Kaiser Permanente Northern California (KPNC) developed and implemented a predictive analytics-driven program, Advance Alert Monitor (AAM), to improve early detection and intervention for in-hospital deterioration. The AAM predictive model is designed to give clinicians 12 hours of lead time before clinical deterioration, permitting early detection and a patient goals-concordant response to prevent worsening. Design of the aam intervention Across the 21 hospitals of the KPNC integrated health care delivery system, AAM analyzes electronic health record (EHR) data for patients in medical/surgical and telemetry units 24 hours a day, 7 days a week. Patients identified as high risk by the AAM algorithm trigger an alert for a regional team of experienced critical care virtual quality nurse consultants (VQNCs), who then cascade validated, actionable information to rapid response team (RRT) nurses at local hospitals. RRT nurses conduct bedside assessments of at-risk patients and formulate interdisciplinary clinical responses with hospital-based physicians, bedside nurses, and supportive care teams to ensure a well-defined escalation plan that includes clarification of the patients' goals of care. Success of the intervention Since 2019 the AAM program has been implemented at all 21 KPNC hospitals. The use of predictive modeling embedded within the EHR to identify high-risk patients has produced the standardization of monitoring workflows, clinical rescue protocols, and coordination to ensure that care is consistent with patients' individual goals of care. An evaluation of the program, using a staggered deployment sequence over 19 hospitals, demonstrates that the AAM program is associated with statistically significant decreases in mortality (9.8% vs. 14.4%), hospital length of stay, and ICU length of stay. Statistical analyses estimated that more than 500 deaths were prevented each year with the AAM program. Lessons learned Unlocking the potential of predictive modeling in the EHR is the first step toward realizing the promise of artificial intelligence/machine learning (AI/ML) to improve health outcomes. The AAM program leveraged predictive analytics to produce highly reliable care by identifying at-risk patients, preventing deterioration, and reducing adverse outcomes and can be used as a model for how clinical decision support and inpatient population management can effectively improve care.

Integrity signals

Registry

Crossref · 10.1016/j.jcjq.2022.05.005

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

Cited by

Still being checked.

Authors
Martinez, V. A., Betts, R. K., Scruth, E. A., Buckley, J. D., Cadiz, V. R., Bertrand, L. D., Paulson, S. S., Dummett, B. A., Abhyankar, S. S., Reyes, V. M., Hatton, J. R., Sulit, R., & Liu, V. X.
Venue
The Joint Commission Journal on Quality and Patient Safety
Publisher
Elsevier BV
Published
2022-08
Volume
48
Issue
8
Pages
370-375
ISSN
1553-7250 (ISSN-L)
OpenAlex
W4287831445
Cited by
21
References
10
Citations by year
2026: 4 · 2025: 8 · 2024: 5 · 2023: 4
FWCI
3.59
Type
journal article
Language
en
Open access
closed
Locations
  • The Joint Commission Journal on Quality and Patient Safety (publishedVersion)
  • PubMed (publishedVersion)
Funders
Kaiser Permanente
Topics
  • Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
early warning systems, predictive analytics, electronic health record alerts, rapid response teams, goals of care, mortality reduction, length of hospital stay, clinical decision support, artificial intelligence in healthcare, Kaiser Permanente Northern California
MeSH terms
Clinical Deterioration, Adult, Artificial Intelligence, Hospitals, Humans, Inpatients, Monitoring, Physiologic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review