Cited by 274Artificial Intelligence in Healthcare and EducationEthics and bioethics in healthcareEthics and Social Impacts of AI

Artificial Intelligence and Patient-Centered Decision-Making

Open access
Bjerring, Jens Christian, Busch, Jacob·2021·Philosophy & Technology

Abstract

Advanced AI systems are rapidly making their way into medical research and practice, and, arguably, it is only a matter of time before they will surpass human practitioners in terms of accuracy, reliability, and knowledge. If this is true, practitioners will have a prima facie epistemic and professional obligation to align their medical verdicts with those of advanced AI systems. However, in light of their complexity, these AI systems will often function as black boxes: the details of their contents, calculations, and procedures cannot be meaningfully understood by human practitioners. When AI systems reach this level of complexity, we can also speak of black-box medicine. In this paper, we want to argue that black-box medicine conflicts with core ideals of patient-centered medicine. In particular, we claim, black-box medicine is not conducive for supporting informed decision-making based on shared information, shared deliberation, and shared mind between practitioner and patient.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s13347-019-00391-6

Cites

78 of 78 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Many AI systems used in medicine are highly reliable and sometimes have greater precision than human doctors.

    “studies show that many AI systems used in medicine are highly reliable, and sometimes have greater precision than human doctors.”

    From The Epistemic Cost of Opacity: How the Use of Artificial Intelligence Undermines the Knowledge of Medical Doctors in High-Stakes Contexts (2025) · cites this paper as Bjerring and Busch (2021, 350)

    The Introduction reports indications that some medical AI systems match experts’ diagnostic accuracy, and §2, “Black-box medicine,” gives examples that outperform specialists on particular tasks. But the paper cautions that evidence of reliability is preliminary and difficult to reproduce; it does not establish that many systems used in medicine are highly reliable. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • For specific medical treatments, the studies establishing their effectiveness are available in journals or online, so doctors can use that information to justify their belief that a treatment is effective.

    “For specific medical treatments, the studies establishing their effec -tiveness are available in journals, or online. So, as Bjerring and Busch ( 2021 , 364) point out, there is indeed some information made available that can be used by medi -cal doctors to justify their belief that a certain treatment is effective.”
  • AI can help patients with diabetes manage their blood glucose levels, diet, and exercise using a chatbot that provides education and coaching based on natural language processing and machine learning.

    “Similarly, AI can help patients with diabetes to manage their blood glucose levels, diet, and exercise using a chatbot that provides education and coaching based on natural language processing and machine learning. 66”

    From Artificial Intelligence and Decision-Making in Healthcare: A Thematic Analysis of a Systematic Review of Reviews (2024) · cites this paper as [66]

    The Introduction (page unavailable) mentions machine learning, natural-language processing, and an AI device for diabetic-retinopathy screening. Neither it nor the searched passages addresses a chatbot that coaches patients with diabetes on blood glucose, diet, or exercise (searched: diabetes chatbot, self-management, education, and coaching). (LLM, conf=0.76)

    Experimental — accuracy not yet measured
  • Because clinicians cannot fully comprehend inner workings of opaque decision aids, they cannot explain to patients how outcomes or recommendations were derived.

    “Since clinicians are no longer able to fully comprehend the inner workings and calculations of the decision aid they are not able to explain to the patient how certain outcomes or recommendations were derived [33].”
  • Black-box medicine conflicts with core ideals of patient-centered medicine.

    “Seeking to address these questions, it was recently argued that so-called ‘black-box medicine’ conflicts with core ideals of patient-centered medicine [33].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. [23]23. Hall, D. E., Prochazka, A. V., & Fink, A. S. (2012). Informed consent for clinical treatment. CMAJ , 184 (5), pp. 533-540.
  2. [51]51. Price, W. N., II (2017). Artificial Intelligence in Healthcare: Applications and Legal Implications. The SciTech Lawyer 14 (1), pp. 10-13.

Cited by

Sorted by citations

Authors
Bjerring, J. C., & Busch, J.
Affiliations
Aarhus University (DK)
Corresponding author
  • Bjerring, Jens Christian
  • Busch, Jacob
Venue
Philosophy & Technology
Published
2020-01-08
Volume
34
Issue
2
Pages
349-371
ISSN
  • 2210-5433 (ISSN-L)
  • 2210-5441
OpenAlex
W2999885075
Cited by
274
References
77
Citations by year
2026: 47 · 2025: 66 · 2024: 65 · 2023: 34 · 2022: 36 · 2021: 22 · 2020: 4
FWCI
7.04
Type
journal article
Language
en
Open access
Locations
  • Philosophy & Technology (publishedVersion)
  • PhilPapers (PhilPapers Foundation) (submittedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics and bioethics in healthcare
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
artificial intelligence in healthcare, patient-centered medicine, shared decision-making, informed consent, clinical judgment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review