CoChat

Enhancing trust in AI through industry self-governance.

Open access
Roski, Joachim, Maier, Ezekiel J, Vigilante, Kevin, Kane, Elizabeth A, Matheny, Michael E · 2021 · Journal of the American Medical Informatics Association

The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) is critical to harnessing value from exponentially growing health and healthcare data. Expectations are high for AI solutions to effectively address current health challenges. However, there have been prior periods of enthusiasm for AI followed by periods of disillusionment, reduced investments, and progress, known as “AI Winters.” We are now at risk of another AI Winter in health/healthcare due to increasing publicity of AI solutions that are not representing touted breakthroughs, and thereby decreasing trust of users in AI. In this article, we first highlight recently published literature on AI risks and mitigation strategies that would be relevant for groups considering designing, implementing, and promoting self-governance. We then describe a process for how a diverse group of stakeholders could develop and define standards for promoting trust, as well as AI risk-mitigating practices through greater industry self-governance. We also describe how adherence to such standards could be verified, specifically through certification/accreditation. Self-governance could be encouraged by governments to complement existing regulatory schema or legislative efforts to mitigate AI risks. Greater adoption of industry self-governance could fill a critical gap to construct a more comprehensive approach to the governance of AI solutions than US legislation/regulations currently encompass. In this more comprehensive approach, AI developers, AI users, and government/legislators all have critical roles to play to advance practices that maintain trust in AI and prevent another AI Winter.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamia/ocab065

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. NAM AI/ML implementation life cycle. Adapted and reproduced from: National Academy of Medicine. 2020. NAM Special Publication: Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril. Reproduced with permission from the National Academy of Sciences, Courtesy of the National Academies Press, Washington, DC.
Figure 1. NAM AI/ML implementation life cycle. Adapted and reproduced from: National Academy of Medicine. 2020. NAM Special Publication: Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril. Reproduced with permission from the National Academy of Sciences, Courtesy of the National Academies Press, Washington, DC.CC BY-NC-ND · PubMed Central
Figure 2. Steps to implement an accreditation/certification program.
Figure 2. Steps to implement an accreditation/certification program.CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. Roski, 2019, Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril

Cited by

See all 104

Metadata

Authors
Roski, J., Maier, E. J., Vigilante, K., Kane, E. A., & Matheny, M. E.
Affiliations
  • Booz Allen Hamilton (United States) (US)
  • VA Tennessee Valley Healthcare System (US)
Corresponding author
Roski, Joachim
Venue
Journal of the American Medical Informatics Association
Published
2021-04-25
Volume
28
Issue
7
Pages
1582-1590
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W3157735681
Cited by
83
References
59
Citations by year
2026: 17 · 2025: 19 · 2024: 24 · 2023: 17 · 2022: 5 · 2021: 1
FWCI
3.40
Type
journal article
Language
en
Open access
Locations
  • Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
Keywords
AI governance, trust in AI, AI risk mitigation, AI winter, artificial intelligence in healthcare, AI standards, certification and accreditation, stakeholder engagement, AI regulation, health data
MeSH terms
Accreditation, Artificial Intelligence, Delivery of Health Care, Health Facilities, Trust

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.