Risk-Tiered Governance for Hospital Artificial Intelligence: A Framework Synthesis and Implementation Pathway
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Hospital artificial intelligence (AI) is increasingly embedded in electronic health record workflows, cloud inference pipelines, imaging, medication review, triage, early warning, documentation, and operational management. This paper proposes a risk-tiered governance framework and implementation pathway for hospital AI applications that are integrated into clinical and operational workflows. We conducted a narrative review and framework synthesis of peer-reviewed evidence, reporting guidelines, regulatory and policy sources, implementation studies, and applied governance case reports relevant to hospital AI. Sources were used according to their evidence type: systematic and scoping reviews identified recurring risks and barriers; empirical studies and trials illustrated bounded implementation patterns; case reports informed organizational design; and reporting or regulatory frameworks informed documentation, validation, change control, and oversight elements. The proposed framework has four components. First, a use-case inventory tags AI applications by decision influence and workflow coupling. Second, a six-domain risk taxonomy addresses clinical safety, privacy and data security, ethics and fairness, transparency and explainability, system stability and resilience, and compliance and accountability. Third, a four-tier risk scheme links the level of oversight to potential harm, automation, reversibility, and operational coupling. Fourth, a governance architecture assigns responsibilities to an AI governance committee, clinical owners, risk control functions, and independent assurance. A patient safety-oriented lifecycle pathway is proposed across initiation, local validation, shadow mode, controlled go-live, monitoring, change control, retirement, and organizational learning. To support feasible adoption, we also provide barriers, first steps, and a maturity-based ramp-up model. Hospital AI governance is best framed as proportional lifecycle control rather than one-time go-live approval. The proposed framework is an adaptable scaffold, not a universal mandate. It is intended to help clinical informatics leaders, quality and safety teams, and hospital executives prioritize oversight according to risk, resources, and organizational maturity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
Moons, K. G. M., Damen, J. A. A., Kaul, T., Hooft, L., Andaur Navarro, C., Dhiman, P., Beam, A. L., Van Calster, B., Celi, L. A., Denaxas, S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-082505 · Cited by 1,069
Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995
Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Darzi, A., Holmes, C., Yau, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1037-7 · Cited by 933
A Review of the Role of Artificial Intelligence in Healthcare
Al Kuwaiti, A., Nazer, K., Al-Reedy, A., Al-Shehri, S., Al-Muhanna, A., Subbarayalu, A. V., Al Muhanna, D., & Al-Muhanna, F. A. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13060951 · Cited by 915
Fleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755
Algorithmic fairness in artificial intelligence for medicine and healthcare
Chen, R. J., Wang, J. J., Williamson, D. F. K., Chen, T. Y., Lipkova, J., Lu, M. Y., Sahai, S., & Mahmood, F. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01056-8 · Cited by 750
Vasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070904 · Cited by 665
Lång, K., Josefsson, V., Larsson, A.-M., Larsson, S., Högberg, C., Sartor, H., Hofvind, S., Andersson, I., & Rosso, A. (2023) · The Lancet Oncology · doi:10.1016/s1470-2045(23)00298-x · Cited by 598
Liu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., Ashrafian, H., Beam, A. L., Chan, A.-W., Collins, G. S., Deeks, A. D. J., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30218-1 · Cited by 555
Research works printed but not linked: 37
- K Ouanes, 2024, Effectiveness of artificial intelligence (AI) in clinical decision support systems and care delivery, J Med Syst, 48, 74, 10.1007/s10916-024-02098-4 · DOI
- S Tyler, 2024, Use of artificial intelligence in triage in hospital emergency departments: a scoping review, Cureus, 16, e59906
- K J Cho, 2020, Detecting patient deterioration using artificial intelligence in a rapid response system, Crit Care Med, 48, e285, 10.1097/CCM.0000000000004236 · DOI · Paper page
- S Murthi, 2024, Evaluating EHR-integrated digital technologies for medication-related outcomes and health equity in hospitalised adults: a scoping review, J Med Syst, 48, 79, 10.1007/s10916-024-02097-5 · DOI
- S H Chalasani, 2023, Artificial intelligence in the field of pharmacy practice: a literature review, Explor Res Clin Soc Pharm, 12, 100346
- M Hassan, 2025, Artificial intelligence governance framework for healthcare, Healthc Manage Forum, 38, 125, 10.1177/08404704241291226 · DOI · Paper page
- M Ferrara, 2024, Risk management and patient safety in the artificial intelligence era: a systematic review, Healthcare (Basel), 12, 549, 10.3390/healthcare12050549 · DOI
- F Liao, 2022, Governance of clinical AI applications to facilitate safe and equitable deployment in a large health system: key elements and early successes, Front Digit Health, 4, 931439, 10.3389/fdgth.2022.931439 · DOI · Paper page
- P D Stetson, 2025, Responsible artificial intelligence governance in oncology, NPJ Digit Med, 8, 407, 10.1038/s41746-025-01794-w · DOI
- J Schuett, 2025, Frontier AI developers need an internal audit function, Risk Anal, 45, 1332, 10.1111/risa.17665 · DOI
- J Amann, 2020, Explainability for artificial intelligence in healthcare: a multidisciplinary perspective, BMC Med Inform Decis Mak, 20, 310, 10.1186/s12911-020-01332-6 · DOI · Paper page
- M Nair, 2025, Critical activities for successful implementation and adoption of AI in healthcare: towards a process framework for healthcare organizations, Front Digit Health, 7, 1550459, 10.3389/fdgth.2025.1550459 · DOI
- B Allen, 2021, Evaluation and real-world performance monitoring of artificial intelligence models in clinical practice: try it, buy it, check it, J Am Coll Radiol, 18, 1489, 10.1016/j.jacr.2021.08.022 · DOI
- T A Brereton, 2023, The role of artificial intelligence model documentation in translational science: scoping review, Interact J Med Res, 12, e45903, 10.2196/45903 · DOI
- J M García-Gómez, 2024, Proposing an AI Passport as a mitigating action of risk associated to artificial intelligence in healthcare, Stud Health Technol Inform, 316, 547
- M Schreier, 2025, User-centered delivery of AI-powered health care technologies in clinical settings: mixed methods case study, JMIR Hum Factors, 12, e76241, 10.2196/76241 · DOI
- Y Liu, 2025, Improving explainability and integrability of medical AI to promote health care professional acceptance and use: mixed systematic review, J Med Internet Res, 27, e73374, 10.2196/73374 · DOI
- M Schinkel, 2023, Detecting changes in the performance of a clinical machine learning tool over time, EBioMedicine, 97, 104823, 10.1016/j.ebiom.2023.104823 · DOI
- D J Hekman, 2024, Dashboarding to monitor machine-learning-based clinical decision support interventions, Appl Clin Inform, 15, 164, 10.1055/a-2219-5175 · DOI
- J Y Lam, 2024, Development, deployment, and continuous monitoring of a machine learning model to predict respiratory failure in critically ill patients, JAMIA Open, 7, ooae141, 10.1093/jamiaopen/ooae141 · DOI
- E Carvalho, 2025, Predetermined change control plans: guiding principles for advancing safe, effective, and high-quality AI-ML technologies, JMIR AI, 4, e76854, 10.2196/76854 · DOI
- T Johnson, 2024, New methods for deprecating artificial intelligence systems will preserve history and facilitate research, Nat Commun, 15, 10254, 10.1038/s41467-024-54758-1 · DOI
- R F Bento, 2025, Key performance indicators applied in medicine, Int Arch Otorhinolaryngol, 29, 1
- T Apfelbacher, 2024, A governance framework for the implementation and operation of AI applications in a university hospital, Stud Health Technol Inform, 316, 776
- J Morley, 2022, Governing data and artificial intelligence for health care: developing an international understanding, JMIR Form Res, 6, e31623, 10.2196/31623 · DOI · Paper page
- A Arora, 2023, The value of standards for health datasets in artificial intelligence-based applications, Nat Med, 29, 2929, 10.1038/s41591-023-02608-w · DOI · Paper page
- M J Sembay, 2023, Provenance data management in health information systems: A systematic literature review, J Pers Med, 13, 991, 10.3390/jpm13060991 · DOI
- B Negash, 2023, De-identification of free text data containing personal health information: a scoping review of reviews, Int J Popul Data Sci, 8, 2153
- S Pati, 2024, Privacy preservation for federated learning in health care, Patterns (N Y), 5, 100974, 10.1016/j.patter.2024.100974 · DOI · Paper page
- M Mehrtak, 2021, Security challenges and solutions using healthcare cloud computing, J Med Life, 14, 448, 10.25122/jml-2021-0100 · DOI
- T Kannampallil, 2022, Using electronic health record audit log data for research: insights from early efforts, J Am Med Inform Assoc, 30, 167, 10.1093/jamia/ocac173 · DOI · Paper page
- P Tabari, 2024, State-of-the-art Fast Healthcare Interoperability Resources (FHIR)-based data model and structure implementations: systematic scoping review, JMIR Med Inform, 12, e58445, 10.2196/58445 · DOI
- M Aboy, 2024, Navigating the EU AI Act: implications for regulated digital medical products, NPJ Digit Med, 7, 237, 10.1038/s41746-024-01232-3 · DOI · Paper page
- H B van Kolfschooten, 2024, A health-conformant reading of the GDPR's right not to be subject to automated decision-making, Med Law Rev, 32, 373, 10.1093/medlaw/fwae029 · DOI
- Y Han, 2024, Regulatory frameworks for AI-enabled medical device software in China: Comparative analysis and review of implications for global manufacturer, JMIR AI, 3, e46871, 10.2196/46871 · DOI
- V Singh, 2025, United States Food and Drug Administration regulation of clinical software in the era of artificial intelligence and machine learning, Mayo Clin Proc Digit Health, 3, 100231, 10.1016/j.mcpdig.2025.100231 · DOI
- L M Meijerink, 2025, Updating methods for artificial intelligence-based clinical prediction models: a scoping review, J Clin Epidemiol, 178, 111636, 10.1016/j.jclinepi.2024.111636 · DOI
Metadata
- Authors
- Zhu, M., Luo, B., Wu, X., Zhao, Y., Wang, S., Hu, Y., Liu, R., Zhang, C., Li, J., Wang, H., Wang, D., Liu, L., & Li, Y.
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2026-05
- Volume
- 17
- Issue
- 03
- Pages
- 668-679
- ISSN
- 1869-0327
- Cited by
- 0
- References
- 26
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Risk-Tiered Governance for Hospital Artificial Intelligence: A Framework Synthesis and Implementation Pathway. https://app.cochat.ai/papers/10.1055/a-2921-5990
- The paper
- Zhu, M., Luo, B., Wu, X., Zhao, Y., Wang, S., Hu, Y., Liu, R., Zhang, C., Li, J., Wang, H., Wang, D., Liu, L., & Li, Y. (2026). Risk-Tiered Governance for Hospital Artificial Intelligence: A Framework Synthesis and Implementation Pathway. Applied Clinical Informatics. https://doi.org/10.1055/a-2921-5990
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.