CoChat
Sign Up
Cited by 123Artificial Intelligence in Healthcare and EducationEthics and Social Impacts of AISafety Systems Engineering in Autonomy

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

Governing the safety of artificial intelligence in healthcare

Open access
Macrae, Carl·2019·BMJ Quality & Safety
DOI 10.1136/bmjqs-2019-009484
Open this paper in CoChat — free account

Abstract

Artificial intelligence (AI) has enormous potential to improve the safety of healthcare, from increasing diagnostic accuracy,1 to optimising treatment planning,2 to forecasting outcomes of care.3 However, integrating AI technologies into the delivery of healthcare is likely to introduce a range of new risks and amplify existing ones. For instance, failures in widely used software have the potential to quickly affect large numbers of patients4; hidden assumptions in underlying data and models can lead to AI systems delivering dangerous recommendations that are insensitive to local care processes,5 6 and opaque AI techniques such as deep learning can make explaining and learning from failure extremely difficult.7 8 To maximise the benefits of AI in healthcare and to build trust among patients and practitioners, it will therefore be essential to robustly govern the risks that AI poses to patient safety. In a recent review in this journal, Challen and colleagues present an important and timely analysis of some of the key technological risks associated with the application of machine learning in clinical settings.9 Machine learning is a subfield of AI that focuses on the development of algorithms that are automatically derived and optimised through exposure to large quantities of exemplar ‘training’ data.10 The outputs of machine learning algorithms are essentially classifications of patterns that provide some sort of prediction—for instance, predicting whether an image shows a malignant melanoma or a benign mole.11 Some of the basic techniques of machine learning have existed for half a century or more, but progress in the field has accelerated rapidly due to advances in the development of ‘deep’ artificial neural networks12 combined with huge increases in computational power and the availability of enormous quantities of data. These techniques have underpinned recent public demonstrations of AI systems …

Overview

Integrity signals

Registry

Crossref · 10.1136/bmjqs-2019-009484

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 3

  1. Lehr, 2017, Playing with the data: what legal scholars should learn about machine learning, UC Davis L Rev, 51, 653
  2. Marcus G . Deep learning: a critical appraisal. arXiv [cs.AI], 2018. Available: https://arxiv.org/abs/1801.00631 · arXiv
  3. Cummings, 2017, The Brave new world of Driverless cars, TR News, 308, 34

Cited by

Sorted by citations

See all 123

Related

See all

Metadata

Authors
Macrae, C.
Affiliations
University of Nottingham (GB)
Corresponding author
Macrae, Carl
ORCID
Macrae, Carl
Venue
BMJ Quality & Safety
Publisher
BMJ
Published
2019-04-12
Volume
28
Issue
6
Pages
495-498
ISSN
  • 1475-3898 (ISSN-L)
  • 2044-5415
  • 2044-5423
DOI
10.1136/bmjqs-2019-009484
OpenAlex
W2938286792
Cited by
123
References
23
Citations by year
2026: 12 · 2025: 23 · 2024: 18 · 2023: 16 · 2022: 23 · 2021: 17 · 2020: 11 · 2019: 3
FWCI
4.27
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • BMJ Quality & Safety (publishedVersion)
  • PubMed (publishedVersion)
  • Repository@Nottingham (University of Nottingham) (acceptedVersion, other-oa)
  • Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by-nc)
  • HighWire Press Open Archive (submittedVersion)
Funders
Wellcome Trust (213632/Z/18/Z)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
artificial intelligence in healthcare, patient safety, AI governance, deep learning, algorithmic bias, explainability, clinical decision support
MeSH terms
Artificial Intelligence, Delivery of Health Care, Bias

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review