The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals
Abstract
Purpose: The expanded use of clinical tools that incorporate artificial intelligence (AI) methods has generated calls for specific competencies for effective and ethical use. This qualitative study used expert interviews to define AI-related clinical competencies for health care professionals. Method: In 2021, a multidisciplinary team interviewed 15 experts in the use of AI-based tools in health care settings about the clinical competencies health care professionals need to work effectively with such tools. Transcripts of the semistructured interviews were coded and thematically analyzed. Draft competency statements were developed and provided to the experts for feedback. The competencies were finalized using a consensus process across the research team. Results: Six competency domain statements and 25 subcompetencies were formulated from the thematic analysis. The competency domain statements are: (1) basic knowledge of AI: explain what AI is and describe its health care applications; (2) social and ethical implications of AI: explain how social, economic, and political systems influence AI-based tools and how these relationships impact justice, equity, and ethics; (3) AI-enhanced clinical encounters: carry out AI-enhanced clinical encounters that integrate diverse sources of information in creating patient-centered care plans; (4) evidence-based evaluation of AI-based tools: evaluate the quality, accuracy, safety, contextual appropriateness, and biases of AI-based tools and their underlying data sets in providing care to patients and populations; (5) workflow analysis for AI-based tools: analyze and adapt to changes in teams, roles, responsibilities, and workflows resulting from implementation of AI-based tools; and (6) practice-based learning and improvement regarding AI-based tools: participate in continuing professional development and practice-based improvement activities related to use of AI tools in health care. Conclusions: The 6 clinical competencies identified can be used to guide future teaching and learning programs to maximize the potential benefits of AI-based tools and diminish potential harms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These advancements shift not only technological paradigms but also the fundamental roles and competencies expected of healthcare professionals.”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [2]
In the citing paper
“Medical professionals face the challenge of understanding AI and applying it responsibly in clinical contexts [2].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [2]
In the citing paper
“Existing frameworks offer valuable multilevel and system-based guidance but are less often organized around healthcare professionals’ functional responsibilities in AI-enabled practice [2,6-8,11,13].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [2]
In the citing paper
“Across these studies, the most consistent emphasis is on competencies U-3 and U-4, reflecting a broad consensus that clinicians must interpret and apply AI outputs responsibly, communicate their implications, and maintain professional and ethical accountability for clinical decision-making.”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [2]
In the citing paper
“Figure 2 shows that recent literature has largely prioritized user-level competencies for medical students and practicing health professionals [2,6-8].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [2]
Citations
Cites
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Competency-based medical education: Theory to practice.
Frank, J. R., Snell, L. S., Cate, O. T., Holmboe, E. S., Carraccio, C., Swing, S. R., Harris, P., Glasgow, N. J., Campbell, C., Dath, D., et al. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.501190 · Cited by 2,883
Analyzing Qualitative Data: Systematic Approaches
Bernard, H. R., & Ryan, G. W. (2009) · Cited by 2,373
Qualitative Interviewing (2nd ed.): The Art of Hearing Data
Rubin, H., & Rubin, I. (2005) · Sage eBooks · doi:10.4135/9781452226651 · Cited by 1,947
Qualitative interviewing the art of hearing data
Rubin, H. J., & Rubin, I. S. (1995) · Cited by 1,450
Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
Crawford, K. (2021) · doi:10.12987/9780300252392 · Cited by 1,361
Varpio, L., Ajjawi, R., Monrouxe, L. V., O'Brien, B. C., & Rees, C. E. (2017) · Medical Education · doi:10.1111/medu.13124 · Cited by 1,028
The Clinician and Dataset Shift in Artificial Intelligence
Finlayson, S. G., Subbaswamy, A., Singh, K., Bowers, J., Kupke, A., Zittrain, J., Kohane, I. S., & Saria, S. (2021) · New England Journal of Medicine · doi:10.1056/nejmc2104626 · Cited by 855
Research works printed but not linked: 2
- World Health Organization, 2021, Ethics and Governance of Artificial Intelligence for Health: WHO Guidance
- Saldana, 2011, Fundamentals of Qualitative Research
Cited by
Boscardin, C. K., Gin, B., Golde, P. B., & Hauer, K. E. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005439 · Cited by 620
Esmaeilzadeh, P. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102861 · Cited by 377
Toward a responsible future: recommendations for AI-enabled clinical decision support
Labkoff, S., Oladimeji, B., Kannry, J., Solomonides, A., Leftwich, R., Koski, E., Joseph, A. L., Lopez-Gonzalez, M., Fleisher, L. A., Nolen, K., et al. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae209 · Cited by 252
“54 We propose that, as part of the UAII process, developers, manufacturers, and content authors specify appropriate training requirements for users.”
BackgroundSelf-citationHuman-Centered Design to Address Biases in Artificial Intelligence
Chen, Y., Clayton, E. W., Novak, L. L., Anders, S., & Malin, B. (2023) · Journal of Medical Internet Research · doi:10.2196/43251 · Cited by 199
“• AI education or outreach specialists design and deliver education and outreach programs about AI for a variety of audiences [35-37].”
Educational Strategies for Clinical Supervision of Artificial Intelligence Use
Abdulnour, R.-E. E., Gin, B., & Boscardin, C. K. (2025) · New England Journal of Medicine · doi:10.1056/nejmra2503232 · Cited by 209
Metadata
- Authors
- Russell, R. G., Lovett Novak, L., Patel, M., Garvey, K. V., Craig, K. J. T., Jackson, G. P., Moore, D., & Miller, B. M.
- Affiliations
- Vanderbilt University (US)
- L.L. Novak is director, Center of Excellence in Applied Artificial Intelligence, Vanderbilt University Medical Center, and associate professor of biomedical informatics, Vanderbilt University School of Medicine, Nashville, Tennessee
- Northeast Ohio Medical University (US)
- K.J.T. Craig is lead director, Clinical Evidence Development, Aetna Medical Affairs, CVS Health. At the time this work was completed, the author was deputy chief science officer of evidence-based practice, Center for AI, Research, and Evaluation, IBM Watson Health, Cambridge, Massachusetts
- D. Moore is emeritus professor of medical education and administration, Vanderbilt University School of Medicine, Nashville, Tennessee
- Corresponding author
- Miller, Bonnie M
- ORCID
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-09-06
- Volume
- 98
- Issue
- 3
- Pages
- 348-356
- ISSN
- 1040-2446 (ISSN-L)
- 1938-808X
- OpenAlex
- W4318966368
- Semantic Scholar
- 148501b8e16fdd9c183cb2bda1a6dde2b4b5161b
- Cited by
- 320
- References
- 36
- Citations by year
- 2026: 131 · 2025: 103 · 2024: 68 · 2023: 17
- FWCI
- 14.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- artificial intelligence in healthcare, clinical competence, healthcare workers, AI ethics, algorithmic bias, AI evaluation, clinical workflow, patient-centered care, continuing professional development, competency framework, AI tools
- MeSH terms
- Artificial Intelligence, Clinical Competence, Delivery of Health Care, Health Personnel, Humans, Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals. https://app.cochat.ai/papers/10.1097/acm.0000000000004963
- The paper
- Russell, R. G., Lovett Novak, L., Patel, M., Garvey, K. V., Craig, K. J. T., Jackson, G. P., Moore, D., & Miller, B. M. (2023). Competencies for the Use of Artificial Intelligence–Based Tools by Health Care Professionals. Academic Medicine. https://doi.org/10.1097/acm.0000000000004963
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.