Clinical use of artificial intelligence requires AI-capable organizations
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Artificial intelligence-based algorithms are being widely implemented in health care, even as evidence is emerging of bias in their design, problems with implementation, and potential harm to patients. To achieve the promise of using of AI-based tools to improve health, healthcare organizations will need to be AI-capable, with internal and external systems functioning in tandem to ensure the safe, ethical, and effective use of AI-based tools. Ideas are starting to emerge about the organizational routines, competencies, resources, and infrastructures that will be required for safe and effective deployment of AI in health care, but there has been little empirical research. Infrastructures that provide legal and regulatory guidance for managers, clinician competencies for the safe and effective use of AI-based tools, and learner-centric resources such as clear AI documentation and local health ecosystem impact reviews can help drive continuous improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Regular maintenance is also necessary to update the model as new data becomes available and to retrain it if its performance drops [56, 62].”
From Generative AI in healthcare: an implementation science informed translational path on application, integration and governance (2024) · cites this paper as [56]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“A related study highlighted that successful implementation of AI in healthcare requires organizations to be “AI-capable”, with appropriate infrastructures, resource allocation, and competency-building for health professionals [178].”
From Opportunities, challenges, and requirements for Artificial Intelligence (AI) implementation in Primary Health Care (PHC): a systematic review (2025) · cites this paper as [178]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Evolutionary Theory of Economic Change.
Loasby, B. J., Nelson, R. R., & Winter, S. G. (1983) · The Economic Journal · doi:10.2307/2232409 · Cited by 21,366
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Understanding dynamic capabilities
Winter, S. G. (2003) · Strategic Management Journal · doi:10.1002/smj.318 · Cited by 5,315 · cited 1×
“Scholarship in organizational sciences has framed organizational capabilities in terms of management’s ability to leverage resources and competencies to create routines(6) that can accomplish the work required to produce the desired outcome.(7) In addition, infrastructures(8) exist beyond the organization that can bot…”
BackgroundStructural racism and health inequities in the USA: evidence and interventions
Bailey, Z. D., Krieger, N., Agénor, M., Graves, J., Linos, N., & Bassett, M. T. (2017) · The Lancet · doi:10.1016/s0140-6736(17)30569-x · Cited by 5,203
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Reconceptualizing Organizational Routines as a Source of Flexibility and Change
Feldman, M. S., & Pentland, B. T. (2003) · Administrative Science Quarterly · doi:10.2307/3556620 · Cited by 4,020 · cited 1×
“They also serve as a vehicle for change, providing pathways for changes to propagate across an organization.(31) Routines standardize practices, reducing uncertainty and enabling measurement.”
BackgroundPredicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Research works printed but not linked: 3
- Davis, 1993, User acceptance of information technology: system characteristics, user perceptions and behavioural impacts, Int J Hum Comput Stud, 38, 475
- Coalition for Health AI, 2022, Blueprint for Trustworthy AI: Implementation Guidance and Assurance for Healthcare
- March, 1958, Organizations
Cited by
Reddy, S. (2024) · Implementation Science · doi:10.1186/s13012-024-01357-9 · Cited by 554
“It requires careful planning and execution [56].”
BackgroundMethodInfluentialYim, D., Khuntia, J., Parameswaran, V., & Meyers, A. (2024) · JMIR Medical Informatics · doi:10.2196/52073 · Cited by 118
“GenAI is costly to implement and integrate across all aspects of a health system [174].”
BackgroundZaleski, A. L., Berkowsky, R. S., Craig, K. J. T., & Pescatello, L. S. (2024) · JMIR Medical Education · doi:10.2196/51308 · Cited by 95
“As AI technologies have the potential to impact health disparities, it is essential to carefully evaluate their use to ensure inclusivity and appropriate messaging across demographics [27,52-54].”
BackgroundFazakarley, C.-A., Breen, M. A., Leeson, P., Thompson, B. T., & Williamson, V. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076950 · Cited by 75
“31 34 When discussing approaches to improve the acceptability of AI tools, participating professionals highlighted the importance of transparency between AI developers and their intended users.”
BackgroundYousefi, F., Dehnavieh, R., Laberge, M., Gagnon, M.-P., Ghaemi, M. M., Nadali, M., & Azizi, N. (2025) · BMC Primary Care · doi:10.1186/s12875-025-02785-2 · Cited by 70
“A related study highlighted that successful implementation of AI in healthcare requires organizations to be “AI-capable”, with appropriate infrastructures, resource allocation, and competency-building for health professionals [178].”
Metadata
- Authors
- Novak, L. L., Russell, R. G., Garvey, K., Patel, M., Thomas Craig, K. J., Snowdon, J., & Miller, B.
- Affiliations
- Vanderbilt University Medical Center (US)
- Vanderbilt University (US)
- Western Reserve Hospital (US)
- Clinical Evidence Development, Aetna®, Medical Affairs CVS Health® , Wellesley, Massachusetts, USA
- IBM (United States) (US)
- Corresponding author
- Novak, Laurie Lovett
- ORCID
- Venue
- JAMIA Open
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-04-06
- Volume
- 6
- Issue
- 2
- Pages
- ooad028-ooad028
- ISSN
- 2574-2531 (ISSN-L)
- PMC
- PMC10155810
- OpenAlex
- W4368377190
- Cited by
- 43
- References
- 64
- Citations by year
- 2026: 14 · 2025: 16 · 2024: 12 · 2023: 1
- FWCI
- 0.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- JAMIA Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- IBM Watson Health
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- artificial intelligence in healthcare, organizational capabilities, AI implementation, algorithmic bias, patient safety, AI ethics, clinician competence, AI governance, regulatory guidelines, AI documentation, organizational infrastructure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
