CoChat

Trust and medical AI: the challenges we face and the expertise needed to overcome them

Open access
Quinn, Thomas P, Senadeera, Manisha, Jacobs, Stephan, Coghlan, Simon, Le, Vuong · 2021 · Journal of the American Medical Informatics Association

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) is increasingly of tremendous interest in the medical field. How-ever, failures of medical AI could have serious consequences for both clinical outcomes and the patient experience. These consequences could erode public trust in AI, which could in turn undermine trust in our healthcare institutions. This article makes 2 contributions. First, it describes the major conceptual, technical, and humanistic challenges in medical AI. Second, it proposes a solution that hinges on the education and accreditation of new expert groups who specialize in the development, verification, and operation of medical AI technologies. These groups will be required to maintain trust in our healthcare institutions.

Overview

Integrity signals

Registry

Crossref · 10.1093/jamia/ocaa268

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 349

Metadata

Authors
Quinn, T. P., Senadeera, M., Jacobs, S., Coghlan, S., & Le, V.
Affiliations
  • Deakin University (AU)
  • The University of Melbourne (AU)
Corresponding author
Quinn, Thomas P
Venue
Journal of the American Medical Informatics Association
Published
2020-12-19
Volume
28
Issue
4
Pages
890-894
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W3117511502
Cited by
287
References
32
Citations by year
2026: 66 · 2025: 83 · 2024: 72 · 2023: 37 · 2022: 20 · 2021: 9
FWCI
4.86
Type
journal article
Language
en
Open access
Locations
  • Journal of the American Medical Informatics Association (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • Minerva Access (University of Melbourne) (submittedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
artificial intelligence in healthcare, public trust in AI, AI failure, clinical outcomes, patient experience, professional accreditation, artificial intelligence in education
MeSH terms
Accreditation, Algorithms, Artificial Intelligence, Attitude to Computers, Attitude to Health, Humans, Medical Informatics, Trust

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.