CoChat

The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.

Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals

Russell, Regina G, Lovett Novak, Laurie, Patel, Mehool, Garvey, Kim V, Craig, Kelly Jean Thomas, Jackson, Gretchen P, Moore, Don, Miller, Bonnie M · 2023 · Academic Medicine

Abstract

Purpose: The expanded use of clinical tools that incorporate artificial intelligence (AI) methods has generated calls for specific competencies for effective and ethical use. This qualitative study used expert interviews to define AI-related clinical competencies for health care professionals. Method: In 2021, a multidisciplinary team interviewed 15 experts in the use of AI-based tools in health care settings about the clinical competencies health care professionals need to work effectively with such tools. Transcripts of the semistructured interviews were coded and thematically analyzed. Draft competency statements were developed and provided to the experts for feedback. The competencies were finalized using a consensus process across the research team. Results: Six competency domain statements and 25 subcompetencies were formulated from the thematic analysis. The competency domain statements are: (1) basic knowledge of AI: explain what AI is and describe its health care applications; (2) social and ethical implications of AI: explain how social, economic, and political systems influence AI-based tools and how these relationships impact justice, equity, and ethics; (3) AI-enhanced clinical encounters: carry out AI-enhanced clinical encounters that integrate diverse sources of information in creating patient-centered care plans; (4) evidence-based evaluation of AI-based tools: evaluate the quality, accuracy, safety, contextual appropriateness, and biases of AI-based tools and their underlying data sets in providing care to patients and populations; (5) workflow analysis for AI-based tools: analyze and adapt to changes in teams, roles, responsibilities, and workflows resulting from implementation of AI-based tools; and (6) practice-based learning and improvement regarding AI-based tools: participate in continuing professional development and practice-based improvement activities related to use of AI tools in health care. Conclusions: The 6 clinical competencies identified can be used to guide future teaching and learning programs to maximize the potential benefits of AI-based tools and diminish potential harms.

Overview

Integrity signals

Registry

Crossref · 10.1097/acm.0000000000004963

Cites

38 of 39 references verified0 citation errors · 1 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 39 references

Research works printed but not linked: 2

  1. World Health Organization, 2021, Ethics and Governance of Artificial Intelligence for Health: WHO Guidance
  2. Saldana, 2011, Fundamentals of Qualitative Research

Cited by

See all 332

Metadata

Authors
Russell, R. G., Lovett Novak, L., Patel, M., Garvey, K. V., Craig, K. J. T., Jackson, G. P., Moore, D., & Miller, B. M.
Affiliations
  • Vanderbilt University (US)
  • L.L. Novak is director, Center of Excellence in Applied Artificial Intelligence, Vanderbilt University Medical Center, and associate professor of biomedical informatics, Vanderbilt University School of Medicine, Nashville, Tennessee
  • Northeast Ohio Medical University (US)
  • K.J.T. Craig is lead director, Clinical Evidence Development, Aetna Medical Affairs, CVS Health. At the time this work was completed, the author was deputy chief science officer of evidence-based practice, Center for AI, Research, and Evaluation, IBM Watson Health, Cambridge, Massachusetts
  • D. Moore is emeritus professor of medical education and administration, Vanderbilt University School of Medicine, Nashville, Tennessee
Corresponding author
Miller, Bonnie M
Venue
Academic Medicine
Published
2022-09-06
Volume
98
Issue
3
Pages
348-356
ISSN
  • 1040-2446 (ISSN-L)
  • 1938-808X
OpenAlex
W4318966368
Cited by
320
References
36
Citations by year
2026: 131 · 2025: 103 · 2024: 68 · 2023: 17
FWCI
14.17
Type
journal article
Language
en
Open access
closed
Locations
  • Academic Medicine (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Innovations in Medical Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Keywords
artificial intelligence in healthcare, clinical competence, healthcare workers, AI ethics, algorithmic bias, AI evaluation, clinical workflow, patient-centered care, continuing professional development, competency framework, AI tools
MeSH terms
Artificial Intelligence, Clinical Competence, Delivery of Health Care, Health Personnel, Humans, Learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals. https://app.cochat.ai/papers/10.1097/acm.0000000000004963
The paper
Russell, R. G., Lovett Novak, L., Patel, M., Garvey, K. V., Craig, K. J. T., Jackson, G. P., Moore, D., & Miller, B. M. (2023). Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals. Academic Medicine. https://doi.org/10.1097/acm.0000000000004963

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.