The AI Hospital Formulary: A Practical Governance Framework for Prescribing, Monitoring, and Deprescribing Artificial Intelligence in Hospitals
Open accessAbstract
Background: Artificial intelligence (AI) is increasingly entering hospital practice through diagnostic, predictive, workflow, operational, and generative applications. Hospitals often govern these systems as procurement or information-technology projects rather than as clinical–organizational interventions requiring indication, evaluation, monitoring, accountability, and withdrawal. Objective: To refine the concept of an “AI Hospital Formulary” as an operational, proportional, and accountable framework for the safe, equitable, and sustainable adoption of hospital AI. Design and Methods: This is a perspective article using a structured, non-systematic narrative synthesis and conceptual framework development. Targeted literature and policy sources were identified through purposive searches and citation chaining through 20 July 2026. The synthesis compares the formulary with existing oversight approaches, maps its lifecycle gates to regulatory and risk management duties, and applies the framework to a worked example based on published evaluations of the Epic Sepsis Model. The EQUATOR reporting-guideline selection tool was consulted, and SANRA was used to strengthen the narrative synthesis component. Framework: The revised framework combines a hospital-wide AI register, a standardized formulary monograph, six lifecycle gates, proportional review pathways, governance-of-governance safeguards, cloud and data-sovereignty controls, continuous monitoring of technical and behavioral feedback loops, and explicit renewal or deprescribing criteria. The worked example shows how version-specific evidence can lead to local validation, controlled implementation, restriction, suspension, or renewal rather than automatic adoption. Conclusions: Hospitals should not merely purchase, install, and update AI systems. They should prescribe, monitor, audit, renew, restrict, and, when necessary, deprescribe them. The AI Hospital Formulary is proposed as a complementary institutional layer that converts external standards and existing governance approaches into documented portfolio decisions at the hospital level.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes an “AI Hospital Formulary” as a hospital-level governance framework for prescribing, monitoring, renewing, restricting, and deprescribing AI systems. It combines a hospital-wide AI register, standardized monograph, six lifecycle gates, proportional review, governance safeguards, cloud/data-sovereignty controls, algorithmovigilance, and explicit deprescribing criteria, illustrated with published evaluations of the Epic Sepsis Model.
Key findings
- The revised framework includes a hospital-wide AI register, a standardized formulary monograph, six lifecycle gates, proportional review pathways, governance-of-governance safeguards, cloud and data-sovereignty controls, continuous monitoring of technical and behavioral feedback loops, and explicit renewal or deprescribing criteria.
- In the worked example, a published external evaluation of the original Epic Sepsis Model reported an AUC of 0.63, sensitivity of 33%, specificity of 83%, and positive predictive value of 12% at a commonly used threshold, with substantial alert burden.
- A multicenter prospective validation of version 2 in 227,091 encounters across four health systems reported encounter-level discrimination of 0.82 to 0.92, but positive predictive value remained 0.13 to 0.26, alert burden was high, and thresholds and performance varied across institutions.
- The paper argues that authorization must be version-specific, indication-specific, time-limited, locally validated, and paired with an exit plan rather than automatic adoption.
Methods
- Perspective article using a structured, non-systematic narrative synthesis and conceptual framework development; the paper states it is not a systematic review, scoping review, consensus study, empirical validation study, or legal analysis.
- Targeted literature and policy sources were identified through purposive searches and citation chaining through 20 July 2026; the EQUATOR reporting-guideline selection tool was consulted, and SANRA was used to strengthen the narrative synthesis component.
- The framework is applied to a worked example based on published evaluations of the Epic Sepsis Model; no new data were created or analyzed.
Limitations
- Stated by the paper: it is a conceptual Perspective based on a purposive, non-systematic narrative synthesis and does not provide exhaustive evidence identification, formal risk-of-bias assessment, consensus validation, or prospective testing of the complete framework.
- Stated by the paper: the sepsis example uses published data and is not a new empirical evaluation or local implementation study; the regulatory mapping is illustrative and cannot replace jurisdiction-specific legal analysis; the framework may require adaptation for national health systems, hospital networks, and smaller institutions.
- Evident from the text: the framework has not been piloted or prospectively tested; the paper states future research should pilot the formulary, measure feasibility and decision time, assess effects on procurement quality and incident detection, and compare implementation and deprescribing outcomes with existing fragmented governance.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
12 of 21 cited sources checked · 8 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Translation of AI from technical performance to measurable clinical and organizational benefit remains difficult.
“Yet the translation of AI from technical performance to measurable clinical and organizational benefit remains difficult [4].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [4] Kelly, C.J., Karthikesalingam, A., Suleyman, M., Corrado, G., and King, D. (2019). Key challenges for delivering clinical impact with artificial intelligence. BMC Med., 17. source
- Interpretationcitation
Evidence for Epic Sepsis Model version 1 must not be assumed to apply to version 2 or later versions.
“Evidence for version 1 must not be assumed to apply to version 2 or later versions [52,53].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [52] Wong, 2021, External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients, JAMA Intern. Med. source
The Introduction warns that proprietary models are difficult to assess and may decline in performance over time, and the Discussion’s Limitations confines this validation to one medical center. That supports caution about transferring the study’s findings, but our copy does not identify the model as version 1 or discuss version 2 or later versions. (LLM, conf=0.75)
Experimental — accuracy not yet measured - cites [53] Wong, 2026, Multicenter prospective validation of an updated proprietary sepsis prediction model, JAMA Netw. Open source
- Premisecitation
A multicenter prospective validation published in 2026 evaluated version 2 of the Epic Sepsis Model in 227,091 encounters across four health systems.
“A multicenter prospective validation published in 2026 evaluated version 2 in 227,091 encounters across four health systems.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [53] Wong, 2026, Multicenter prospective validation of an updated proprietary sepsis prediction model, JAMA Netw. Open source
- Premisecitation
Existing hospital governance models, model-documentation tools, patient-safety approaches, and reporting standards provide important components for institutional oversight.
“Existing hospital governance models, model-documentation tools, patient-safety approaches, and reporting standards also provide important components for institutional oversight [15][16][17][18][19][20][21][22][23][24].”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [15] Bedoya, 2022, A framework for the oversight and local deployment of safe and high-quality prediction models, J. Am. Med. Inform. Assoc. source
- cites [16] Reddy, 2020, A governance model for the application of AI in health care, J. Am. Med. Inform. Assoc. source
- cites [17] Collins, 2024, TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods, BMJ source
- Premisecitation
A published external evaluation of the original Epic Sepsis Model reported limited performance in one health system: an area under the receiver operating characteristic curve of 0.63, sensitivity of 33%, specificity of 83%, and a positive predictive value of 12% at a commonly used threshold, with a substantial alert burden.
“A published external evaluation of the original Epic Sepsis Model reported limited performance in one health system: an area under the receiver operating characteristic curve of 0.63, sensitivity of 33%, specificity of 83%, and a positive predictive value of 12% at a commonly used threshold, with a substantial alert burden [52].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [52] Wong, 2021, External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients, JAMA Intern. Med. source
- Premisecitation
Sudden changes in epidemiology or care delivery may invalidate assumptions and require temporary suspension or revalidation of an AI system.
“Sudden changes in epidemiology or care delivery may also invalidate assumptions and require temporary suspension or revalidation [40].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [40] Misra, 2025, COVID-19 pandemic: A worldwide critical review with the machine learning model-based prediction, J. Inst. Eng. India Ser. B source
- Premisenone given
AI outputs can create feedback loops by changing clinician behavior and consequently the future data used to evaluate the system.
“Fourth, outputs can create feedback loops by changing clinician behavior and, consequently, the future data used to evaluate the system.”
Quote in the paperNot a substantial claim - Premisenone given
AI performance is context-dependent; a model trained in one health system may perform differently in another because of differences in population, clinical practice, measurement, coding, infrastructure, or workflow.
“First, AI performance is context-dependent.A model trained in one health system may perform differently in another because of differences in population, clinical practice, measurement, coding, infrastructure, or workflow.”
Quote in the paperNot a substantial claim - Premisenone given
A statistically strong model may create operational harm by increasing workload, unnecessary testing, or inequitable prioritization.
“Conversely, a statistically strong model may create operational harm by increasing workload, unnecessary testing, or inequitable prioritization.”
Quote in the paperNot a substantial claim - Premisereasoning
A hospital system can fail even when accuracy appears stable.
“A hospital system can fail even when accuracy appears stable.”
Quote in the paperSubstantial claim - Interpretationreasoning
Existing sources do not fully resolve hospital-specific portfolio questions of which system and version should be authorized, for which indication and users, under what local restrictions, for how long, and with what documented exit plan.
“However, these sources do not fully resolve the hospitalspecific portfolio questions of which system and version should be authorized, for which indication and users, under what local restrictions, for how long, and with what documented exit plan.”
Quote in the paperSubstantial claim - Premisecitation
AI systems are socio-technical: their impact depends on how clinicians interpret, trust, ignore, override, or overuse their outputs.
“Third, AI systems are socio-technical: their impact depends on how clinicians interpret, trust, ignore, override, or overuse their outputs [41].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [41] Bates, 2003, Ten commandments for effective clinical decision support: Making the practice of evidence-based medicine a reality, J. Am. Med. Inform. Assoc. source
- Premisecitation
AI systems may be dynamic even when model weights are static because the surrounding data environment and clinical pathways change.
“Second, AI systems may be dynamic even when the model weights are static because the surrounding data environment and clinical pathways change.Sudden systemic shifts, such as the COVID-19 pandemic, illustrate how rapidly data-generating processes and predictive assumptions can change [40].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [40] Misra, 2025, COVID-19 pandemic: A worldwide critical review with the machine learning model-based prediction, J. Inst. Eng. India Ser. B source
- Premisecitation
Provider post-market monitoring and serious-incident reporting remain distinct legal duties under the EU AI Act.
“Provider post-market monitoring and serious-incident reporting remain distinct legal duties [10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10] European Parliament, Council of the European Union (2026, July 20). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 Laying Down Harmonised Rules on Artificial Intelligence. Available online: http://data.europa.eu/eli/reg/2024/1689/oj.
Not checked in the free run.
- May combine two claims. 12
- Classified as probably not a substantial claim. 23
- The quote only partly states this claim. 1
May combine two claims.
PremisecitationClinicians may ignore alerts, over-trust outputs, misunderstand scores, or use the tool outside its intended scope.
“Clinicians may ignore alerts, over-trust outputs, misunderstand scores, or use the tool outside its intended scope.”
Quote in the paperSubstantial claim3 of 3 sources checked- cites [24] Ratwani, 2024, Patient safety and artificial intelligence in clinical care, JAMA Health Forum source
The safe-implementation discussion (page not available in our copy) identifies a tendency to overly trust AI and health care professional complacency. It does not specifically describe clinicians ignoring alerts, misunderstanding scores, or using tools outside their intended scope. (LLM, conf=0.87)
Experimental — accuracy not yet measured - cites [31] Embi, 2021, Algorithmovigilance—Advancing methods to analyze and monitor artificial intelligence-driven health care for effectiveness and equity, JAMA Netw. Open source
The JAMA Network section (page not specified) discusses users interpreting algorithmic outputs differently, lacking trust, and becoming overly reliant on outputs. It also describes variation in deployment and application. It does not specifically address clinicians ignoring alerts, misunderstanding scores, or using a tool outside its intended scope. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [32] Balendran, 2024, Algorithmovigilance, lessons from pharmacovigilance, npj Digit. Med. source
The Post-approval evaluation section (page unavailable) says human factors, including how clinicians make decisions based on model predictions, matter to AI safety. Causality assessment also identifies operators’ skills and experience as possible contributors to errors. The paper does not specifically describe clinicians ignoring alerts, over-trusting outputs, misunderstanding scores, or using a tool outside its intended scope. (LLM, conf=0.78)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationIn the multicenter prospective validation of Epic Sepsis Model version 2, encounter-level discrimination ranged from 0.82 to 0.92, but the positive predictive value remained 0.13 to 0.26, the alert burden was high, and thresholds and performance varied across institutions.
“Encounter-level discrimination ranged from 0.82 to 0.92, but the positive predictive value remained 0.13 to 0.26, the alert burden was high, and thresholds and performance varied across institutions [53].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [53] Wong, 2026, Multicenter prospective validation of an updated proprietary sepsis prediction model, JAMA Netw. Open source
May combine two claims.
PremisecitationThe diagnostic AI literature has documented limitations in study design, reporting standards, risk of bias, and claims about performance compared with clinicians.
“The diagnostic AI literature illustrates this gap: systematic reviews have documented limitations in study design, reporting standards, risk of bias, and claims about performance compared with clinicians [5,6].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [5] Nagendran, 2020, Artificial intelligence versus clinicians: Systematic review of design, reporting standards, and claims of deep learning studies, BMJ source
- cites [6] Liu, 2019, A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: A systematic review and meta-analysis, Lancet Digit. Health source
Classified as probably not a substantial claim.
Findingnone givenThe worked example shows how version-specific evidence can lead to local validation, controlled implementation, restriction, suspension, or renewal rather than automatic adoption.
“The worked example shows how version-specific evidence can lead to local validation, controlled implementation, restriction, suspension, or renewal rather than automatic adoption.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenThe AI Hospital Formulary framework may require adaptation for national health systems, hospital networks, and smaller institutions.
“The framework may also require adaptation for national health systems, hospital networks, and smaller institutions.”
Quote in the paperNot a substantial claim- Rests on an assumption: Smaller hospitals may lack the expertise to operate a full committee.
Classified as probably not a substantial claim.
Interpretationnone givenThe AI Hospital Formulary translates governance principles into a hospital authorization and portfolio management process.
“The AI Hospital Formulary translates governance principles into a hospital authorization and portfolio management process.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenThis article is a conceptual Perspective based on a purposive, non-systematic narrative synthesis; it does not provide exhaustive evidence identification, formal risk-of-bias assessment, consensus validation, or prospective testing of the complete framework.
“It is a conceptual Perspective based on a purposive, non-systematic narrative synthesis; it does not provide exhaustive evidence identification, formal risk-of-bias assessment, consensus validation, or prospective testing of the complete framework.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe AI Hospital Formulary has economic value.
“The AI Hospital Formulary also has economic value.”
Quote in the paperNot a substantial claim- Rests on an assumption: Purchase price is only one component of the total cost of an AI system.
- Rests on an assumption: A nominally inexpensive AI system may be costly if it generates unnecessary work or creates vendor lock-in.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenSANRA was used to strengthen the narrative synthesis component.
“SANRA was used to strengthen the narrative synthesis component.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenGovernance-of-governance safeguards reduce the risk that the committee itself becomes opaque, commercially captured, or inaccessible to patients and professionals.
“Governance-of-governance safe-guards reduce the risk that the committee itself becomes opaque, commercially captured, or inaccessible to patients and professionals.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe AI Hospital Formulary provides a familiar institutional container in which local predictive-model governance, model documentation, patient-safety infrastructure, cybersecurity, procurement, regulatory duties, ethics, and implementation science can produce one traceable decision about whether a system may be used, under which restrictions, and for how long.
“Rather, it provides a familiar institutional container in which local predictive-model governance, model documentation, patient-safety infrastructure, cybersecurity, procurement, regulatory duties, ethics, and implementation science can produce one traceable decision about whether a system may be used, under which restrictions, and for how long.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe AI Hospital Formulary creates institutional memory of what is in use, why it was approved, how it is performing, and when it should be reconsidered.
“The formulary also creates institutional memory of what is in use, why it was approved, how it is performing, and when it should be reconsidered.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThe AI Hospital Formulary strengthens accountability by assigning named ownership, creating a decision record, and linking monitoring to the authority for restriction or suspension.
“A formulary assigns named ownership, creates a decision record, and links monitoring to the authority for restriction or suspension.”
Quote in the paperSubstantial claim- Rests on an assumption: Without a formulary, responsibility can be diffused among vendors, clinicians, information technology teams, innovation units, and executives.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
Premisenone givenPre-implementation studies cannot capture all future contexts, workflow adaptations, or population shifts.
“Pre-implementation studies cannot capture all future contexts, workflow adaptations, or population shifts.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe AI Hospital Formulary makes deprescribing planned, evidence-based, and accountable by defining triggers, authority, evidence, communication, and transition steps before deployment.
“The formulary makes deprescribing planned, evidence-based, and accountable by defining triggers, authority, evidence, communication, and transition steps before deployment.”
Quote in the paperSubstantial claim- Rests on an assumption: Hospitals often accumulate digital tools without systematic retirement.
- Rests on an assumption: Accumulation of digital tools without systematic retirement leads to alert fatigue, redundant systems, hidden costs, outdated models, and unclear accountability.
- Rests on an assumption: Withdrawal of an AI system may be technically, commercially, clinically, and politically difficult, particularly after users and workflows become dependent on a tool.
- Rests on an assumption: Sudden removal of an AI system may itself create risk.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThe AI Hospital Formulary becomes both a safety instrument and a strategic portfolio management tool.
“The formulary thus becomes both a safety instrument and a strategic portfolio management tool.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenMany AI systems are opaque or dependent on vendor-controlled updates, making subtle failure difficult to detect.
“Fifth, many AI systems are opaque or dependent on vendor-controlled updates, making subtle failure difficult to detect.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe AI Hospital Formulary offers a practical institutional layer for safe, equitable, secure, and sustainable adoption of AI in hospitals.
“The AI Hospital Formulary offers a practical institutional layer for safe, equitable, secure, and sustainable adoption.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe sepsis example uses published data and does not constitute a new empirical evaluation or local implementation study.
“The sepsis example uses published data and does not constitute a new empirical evaluation or local implementation study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningHospitals need an operational mechanism that brings existing contributions together in an enforceable institutional authorization and renewal process.
“Hospitals nevertheless need an operational mechanism that brings these contributions together in an enforceable institutional authorization and renewal process.”
Quote in the paperNot a substantial claim- Rests on an assumption: Hospitals often govern AI systems as procurement or information-technology projects rather than as clinical-organizational interventions requiring indication, evaluation, monitoring, accountability, and withdrawal.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe regulatory mapping in this article is illustrative and cannot replace jurisdiction-specific legal analysis.
“The regulatory mapping is illustrative and cannot replace jurisdiction-specific legal analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe AI Hospital Formulary approach can avoid two extremes: uncritical enthusiasm and regulatory paralysis.
“This approach can avoid two extremes: uncritical enthusiasm, in which tools are adopted because they are innovative or commercially attractive, and regulatory paralysis, in which uncertainty prevents potentially useful innovation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
PremisereasoningStatistical subgroup evaluation is necessary but insufficient: similar performance can still lead to unfair consequences if outputs alter access to beds, specialist review, diagnostic testing, discharge planning, or follow-up.
“Statistical subgroup evaluation is necessary but insufficient: similar performance can still lead to unfair consequences if outputs alter access to beds, specialist review, diagnostic testing, discharge planning, or follow-up.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe EQUATOR reporting-guideline selection tool was consulted.
“The EQUATOR reporting-guideline selection tool was consulted”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
InterpretationreasoningThe formulary can create the local evidence trail and assignments needed to operationalize many duties under the EU AI Act and other regulatory and risk management frameworks.
“Nevertheless, the formulary can create the local evidence trail and assignments needed to operationalize many duties.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe distinctive contribution of the AI Hospital Formulary is the combination of existing governance elements in a hospital-wide authorization and portfolio management process modeled on a familiar clinical institution.
“The distinctive contribution of the formulary is the combination of these elements in a hospital-wide authorization and portfolio management process modeled on a familiar clinical institution.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationExisting regulations and guidance emphasize risk management, transparency, post-market monitoring, human oversight, lifecycle evaluation, and trustworthy AI governance.
“Existing regulations and guidance increasingly emphasize risk management, transparency, post-market monitoring, human oversight, lifecycle evaluation, and trustworthy AI governance [7][8][9][10][11][12][13][14].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [7] World Health Organization (2021). Ethics and Governance of Artificial Intelligence for Health: WHO Guidance, World Health Organization. Available online: https://www.who.int/publications/i/item/9789240029200.
Not checked in the free run.
- cites [8] World Health Organization (2023). Regulatory Considerations on Artificial Intelligence for Health, World Health Organization. Available online: https://www.who.int/publications/i/item/9789240078871.
Not checked in the free run.
- cites [9] World Health Organization (2025). Ethics and Governance of Artificial Intelligence for Health: Guidance on Large Multi-Modal Models, World Health Organization. Available online: https://www.who.int/publications/i/item/9789240084759.
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe AI Hospital Formulary can strengthen procurement.
“The formulary can strengthen procurement.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe evidence supports version-specific local validation for the Epic Sepsis Model; mixed evidence and low positive predictive value justify caution rather than automatic rejection or adoption.
“The evidence supports version-specific local validation; mixed evidence and low PPV justify caution rather than automatic rejection or adoption.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe Epic Sepsis Model findings demonstrate why an authorization must identify the version and why improved external evidence still does not remove the need for local validation and workflow evaluation.
“These findings demonstrate why an authorization must identify the version and why improved external evidence still does not remove the need for local validation and workflow evaluation.”
Quote in the paperSubstantial claim
The paper relies on this without support.
AI is increasingly entering hospital practice through diagnostic, predictive, workflow, operational, and generative applications.
“Artificial intelligence (AI) is increasingly entering hospital practice through diagnostic, predictive, workflow, operational, and generative applications.”
The paper relies on this without support.
Hospitals often govern AI systems as procurement or information-technology projects rather than as clinical-organizational interventions requiring indication, evaluation, monitoring, accountability, and withdrawal.
“Hospitals often govern these systems as procurement or information-technology projects rather than as clinical-organizational interventions requiring indication, evaluation, monitoring, accountability, and withdrawal.”
The paper relies on this without support.
Hospitals increasingly use AI in domains that may fall outside classic medical device regulation but still affect care quality, safety, equity, professional work, resource allocation, or institutional decisions.
“Hospitals increasingly use AI in domains that may fall outside classic medical device regulation but still affect care quality, safety, equity, professional work, resource allocation, or institutional decisions.”
The paper relies on this without support.
Many professionals already use public tools for summarization, translation, drafting, coding, teaching, literature review, and administrative tasks.
“Many professionals already use public tools for summarization, translation, drafting, coding, teaching, literature review, and administrative tasks.”
The paper relies on this without support.
Hospitals often accumulate digital tools without systematic retirement.
“hospitals often accumulate digital tools without systematic retirement”
The paper relies on this without support.
Accumulation of digital tools without systematic retirement leads to alert fatigue, redundant systems, hidden costs, outdated models, and unclear accountability.
“This leads to alert fatigue, redundant systems, hidden costs, outdated models, and unclear accountability.”
The paper relies on this without support.
Withdrawal of an AI system may be technically, commercially, clinically, and politically difficult, particularly after users and workflows become dependent on a tool.
“Withdrawal may be technically, commercially, clinically, and politically difficult, particularly after users and workflows become dependent on a tool.”
The paper relies on this without support.
Sudden removal of an AI system may itself create risk.
“Sudden removal may itself create risk.”
The paper relies on this without support.
Purchase price is only one component of the total cost of an AI system.
“Purchase price is only one component of the total cost.”
The paper relies on this without support.
A nominally inexpensive AI system may be costly if it generates unnecessary work or creates vendor lock-in.
“A nominally inexpensive system may be costly if it generates unnecessary work or creates vendor lock-in.”
The paper relies on this without support.
Without a formulary, responsibility can be diffused among vendors, clinicians, information technology teams, innovation units, and executives.
“Without a formulary, responsibility can be diffused among vendors, clinicians, information technology teams, innovation units, and executives.”
The paper relies on this without support.
Smaller hospitals may lack the expertise to operate a full committee.
“Smaller hospitals may lack the expertise to operate a full committee”
The paper relies on this without support.
Vendors may resist transparency.
“Vendors may resist transparency.”
The paper relies on this without support.
Clinicians may perceive review as bureaucracy unless timelines and requirements are proportional.
“Clinicians may perceive review as bureaucracy unless timelines and requirements are proportional.”
The paper relies on this without support.
Monitoring may be constrained by weak data infrastructure, delayed outcomes, and incomplete demographic data.
“Monitoring may be constrained by weak data infrastructure, delayed outcomes, and incomplete demographic data.”
The paper relies on this without support.
Cloud concentration and vendor lock-in can limit institutional leverage.
“Cloud concentration and vendor lock-in can limit institutional leverage.”
The paper relies on this without support.
Hospitals already maintain governance mechanisms for medicines, devices, infection control, transfusion, radiation safety, clinical pathways, and patient safety.
“hospitals already maintain governance mechanisms for medicines, devices, infection control, transfusion, radiation safety, clinical pathways, and patient safety.”
The paper relies on this without support.
Cloud-based AI can distribute data and control across hospitals, vendors, hyperscale cloud providers, and sub-processors.
“Cloud-based AI can distribute data and control across hospitals, vendors, hyperscale cloud providers, and sub-processors.”
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1× · see citing works
“Implementation science frameworks can distinguish adoption, acceptability, fidelity, feasibility, penetration, sustainability, and cost [42–44].”
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,174 · see citing works
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · see citing works
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718 · see citing works
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579 · see citing works
SANRA—a scale for the quality assessment of narrative review articles
Baethge, C., Goldbeck-Wood, S., & Mertens, S. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0064-8 · Cited by 3,469 · cited 1× · see citing works
“No dedicated EQUATOR checklist was identified for a Perspective or conceptual framework article; therefore, SANRA was used as a quality and structural aid for the narrative synthesis component, without claiming that the article is a systematic review [39].”
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136 · see citing works
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 1× · see citing works
“Implementation science frameworks can distinguish adoption, acceptability, fidelity, feasibility, penetration, sustainability, and cost [42–44].”
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817 · see citing works
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · see citing works
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203 · cited 1× · see citing works
“Governance cannot be reduced to model performance, regulatory status, or procurement compliance; it must address beneficence, non-maleficence, justice, autonomy, transparency, privacy, accountability, and public trust [48–51].”
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883 · see citing works
Implementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857 · see citing works
Liu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Chan, A.-W., Darzi, A., Holmes, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1034-x · Cited by 1,421 · see citing works
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · see citing works
Bates, D. W., Kuperman, G. J., Wang, S., Gandhi, T., Kittler, A., Volk, L., Spurr, C., Khorasani, R., Tanasijevic, M., & Middleton, B. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1370 · Cited by 1,346 · see citing works
Ensuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341 · see citing works
Nagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152 · see citing works
Artificial Intelligence Risk Management Framework (AI RMF 1.0)
Tabassi, E. (2023) · doi:10.6028/nist.ai.100-1 · Cited by 1,136 · see citing works
Adversarial attacks on medical machine learning
Finlayson, S. G., Bowers, J. D., Ito, J., Zittrain, J. L., Beam, A. L., & Kohane, I. S. (2019) · Science · doi:10.1126/science.aaw4399 · Cited by 1,088 · see citing works
Moons, K. G. M., Damen, J. A. A., Kaul, T., Hooft, L., Andaur Navarro, C., Dhiman, P., Beam, A. L., Van Calster, B., Celi, L. A., Denaxas, S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-082505 · Cited by 1,069 · see citing works
Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995 · cited 3× · see citing works
“Evidence for version 1 must not be assumed to apply to version 2 or later versions [52,53].”
InfluentialA governance model for the application of AI in health care
Reddy, S., Allan, S., Coghlan, S., & Cooper, P. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz192 · Cited by 979 · cited 1× · see citing works
“Reddy et al. provide a broad governance model for healthcare AI [16].”
Artificial intelligence, bias and clinical safety
Challen, R., Denny, J., Pitt, M., Gompels, L., Edwards, T., & Tsaneva-Atanasova, K. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-008370 · Cited by 956 · see citing works
Machine learning in medicine: Addressing ethical challenges
Vayena, E., Blasimme, A., & Cohen, I. G. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002689 · Cited by 912 · cited 1× · see citing works
“Governance cannot be reduced to model performance, regulatory status, or procurement compliance; it must address beneficence, non-maleficence, justice, autonomy, transparency, privacy, accountability, and public trust [48–51].”
Institute of Medicine (2001) · National Academies Press eBooks · doi:10.17226/10027 · Cited by 778 · see citing works
Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Darzi, A., Holmes, C., Yau, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1037-7 · Cited by 748 · see citing works
Vasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070904 · Cited by 665 · see citing works
Ethical and regulatory challenges of large language models in medicine
Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., et al. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00061-x · Cited by 342 · see citing works
The Morbidity and Mortality Conference
Orlander, J. D., Barber, T. W., & Fincke, B. G. (2002) · Academic Medicine · doi:10.1097/00001888-200210000-00011 · Cited by 308 · cited 1× · see citing works
““Algorithmic morbidity and mortality rounds” could review cases involving harm, delay, inequity, confusion, or missed opportunity and link lessons to training, restrictions, monitoring, and renewal [47].”
Large Language Models for Chatbot Health Advice Studies: A Systematic Review
Huo, B., Boyle, A., Marfo, N., Tangamornsuksan, W., Steen, J. P., McKechnie, T., Lee, Y., Mayol, J., Antoniou, S. A., Thirunavukarasu, A. J., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.57879 · Cited by 283 · cited 3× · see citing works
“Ap-https proved systems should specify whether prompts and outputs enter the clinical record, how human verification is documented, and how prompt injection, retrieval poisoning, unauthorized data exfiltration, or vendor-side model changes are detected and managed [9,33–36].”
From development to deployment: dataset shift, causality, and shift-stable models in health AI
Subbaswamy, A., & Saria, S. (2019) · Biostatistics · doi:10.1093/biostatistics/kxz041 · Cited by 276 · see citing works
Artificial intelligence risk management framework :
National Institute of Standards and Technology (US) (2024) · NIST Trustworthy and Responsible AI · doi:10.6028/nist.ai.600-1 · Cited by 274 · cited 3× · see citing works
“Ap-https proved systems should specify whether prompts and outputs enter the clinical record, how human verification is documented, and how prompt injection, retrieval poisoning, unauthorized data exfiltration, or vendor-side model changes are detected and managed [9,33–36].”
Freyer, O., Wiest, I. C., Kather, J. N., & Gilbert, S. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00124-9 · Cited by 162 · see citing works
Detection of calibration drift in clinical prediction models to inform model updating
Davis, S. E., Greevy, R. A., Lasko, T. A., Walsh, C. G., & Matheny, M. E. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103611 · Cited by 160 · see citing works
A framework for the oversight and local deployment of safe and high-quality prediction models
Bedoya, A. D., Economou-Zavlanos, N. J., Goldstein, B. A., Young, A., Jelovsek, J. E., O’Brien, C., Parrish, A. B., Elengold, S., Lytle, K., Balu, S., et al. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac078 · Cited by 119 · see citing works
Embi, P. J. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.4622 · Cited by 99 · cited 1× · see citing works
“Algorithmovigilance therefore combines technical surveillance with process, outcome, equity, cybersecurity, and human-factors monitoring [24,31,32].”
Patient safety and artificial intelligence in clinical care
Ratwani, R. M., Bates, D. W., & Classen, D. C. (2024) · JAMA Health Forum · doi:10.1001/jamahealthforum.2023.5514 · Cited by 63 · cited 3× · see citing works
“Other proposals show how current patient-safety infrastructure can be extended to AI and how clinical organizations can monitor AI-related hazards [23,24].”
Algorithmovigilance, lessons from pharmacovigilance
Balendran, A., Benchoufi, M., Evgeniou, T., & Ravaud, P. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01237-y · Cited by 34 · cited 1× · see citing works
“Algorithmovigilance therefore combines technical surveillance with process, outcome, equity, cybersecurity, and human-factors monitoring [24,31,32].”
Uptake of Generative AI Integrated With Electronic Health Records in US Hospitals
Everson, J., Nong, P., & Richwine, C. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.49463 · Cited by 33 · see citing works
Multicenter Prospective Validation of an Updated Proprietary Sepsis Prediction Model
Wong, A., Currey, D., Schwinne, M., Park-Egan, B., Meyer, S., Gutting, A., Cao, J., Khan, S., Dantes, R., Pan, T., et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.0181 · Cited by 21 · cited 4× · see citing works
“Evidence for version 1 must not be assumed to apply to version 2 or later versions [52,53].”
InfluentialFleisher, L. A., & Economou-Zavlanos, N. (2024) · JAMA Health Forum · doi:10.1001/jamahealthforum.2024.1369 · Cited by 18 · cited 2× · see citing works
“Other proposals show how current patient-safety infrastructure can be extended to AI and how clinical organizations can monitor AI-related hazards [23,24].”
COVID-19 pandemic: A worldwide critical review with the machine learning model-based prediction
Misra, N. K., Das, S., Satpathy, S., Addula, S. R., & Trivedi, M. C. (2025) · Journal of The Institution of Engineers (India): Series B · doi:10.1007/s40031-024-01155-3 · Cited by 11 · see citing works
Flagged first, then by citations
- Authors
- Epelde, F.
- Affiliations
- Universitat Autònoma de Barcelona (ES)
- Corresponding author
- Epelde, Francisco
- ORCID
- Epelde, Francisco
- Venue
- Hospitals
- Publisher
- MDPI AG
- Published
- 2026-07-22
- Volume
- 3
- Issue
- 3
- Pages
- 15
- ISSN
- 2813-4524 (ISSN-L)
- OpenAlex
- W7170037529
- Cited by
- 0
- References
- 39
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Hospitals (publishedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Health Sciences › Health Professions › Health Information Management › Healthcare Regulation
- Keywords
- AI governance, AI lifecycle management, data sovereignty, cloud security, AI risk management, generative AI in healthcare
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-27.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-27.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review