Cited by 342Explainable Artificial Intelligence (XAI)Artificial Intelligence in Healthcare and EducationDecision-Making and Behavioral Economics

The DOI matches its Crossref record; 46 of the 48 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.

Understanding, explaining, and utilizing medical artificial intelligence

Open access
Cadario, Romain, Longoni, Chiara, Morewedge, Carey K.·2021·Nature Human Behaviour

Abstract

Medical artificial intelligence is cost-effective and scalable and often outperforms human providers, yet people are reluctant to use it. We show that resistance to the utilization of medical artificial intelligence is driven by both the subjective difficulty of understanding algorithms (the perception that they are a 'black box') and by an illusory subjective understanding of human medical decision-making. In five pre-registered experiments (1-3B: N = 2,699), we find that people exhibit an illusory understanding of human medical decision-making (study 1). This leads people to believe they better understand decisions made by human than algorithmic healthcare providers (studies 2A,B), which makes them more reluctant to utilize algorithmic than human providers (studies 3A,B). Fortunately, brief interventions that increase subjective understanding of algorithmic decision processes increase willingness to utilize algorithmic healthcare providers (studies 3A,B). A sixth study on Google Ads for an algorithmic skin cancer detection app finds that the effectiveness of such interventions generalizes to field settings (study 4: N = 14,013).

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

People report greater subjective understanding of medical decisions made by human than algorithmic providers, but their objective understanding is similarly poor; this illusory understanding contributes to algorithm aversion. Brief explanations of how medical AI works increase subjective understanding and willingness to use algorithmic providers, including in a Google Ads field study.

Key findings

  • In study 1 (N = 297), making people explain provider decision processes reduced subjective understanding for human providers (Mpre = 5.08 vs Mpost = 4.52, ΔH = −0.56, P < 0.001) but not for algorithmic providers (Mpre = 3.99 vs Mpost = 3.83, ΔA = −0.16, P = 0.14); the interaction was significant (ΔH − ΔA = −0.40, P = 0.009).
  • In studies 2A/B, participants claimed greater subjective understanding of human than algorithmic providers (2A: β = −0.82, P < 0.001; 2B: β = −0.46, P = 0.001), while objective understanding did not differ by provider (2A: β = 0.02, P = 0.91; 2B: β = 0.11, P = 0.43).
  • In studies 3A/B, interventions explaining decision processes increased subjective understanding and reduced algorithm aversion; utilization intentions increased more for algorithmic providers (3A: β = 0.83, P < 0.001; 3B: β = 0.70, P < 0.001) than for human providers (3A: β = 0.34, P = 0.008; 3B: β = 0.14, P = 0.41).
  • In study 4 (N = 14,013 impressions), the intervention advertisement had a higher click-through rate (6.36%) than the control advertisement (3.29%; β = 0.69, z = 8.17, P < 0.001, d = 0.38).

Methods

  • Five pre-registered online experiments (studies 1, 2A/B, 3A/B; N = 2,699) plus a sixth pre-registered online field study on Google Ads (study 4; N = 14,013). Participants were US residents recruited from Lucid, Amazon Mechanical Turk, and Google Ads, in a skin cancer detection context.
  • Designs included: study 1, 2 (provider: human vs algorithm) × 2 (rating order: pre- vs post-intervention) mixed design; studies 2A/B, 2 (provider) × 2 (understanding type: subjective vs objective) between-subjects; studies 3A/B, 2 (provider) × 2 (intervention: control vs intervention) between-subjects; study 4, intervention vs control advertisement.
  • Analyses used regressions, moderated mediation with 5,000 bootstrap samples, and logistic regression for click-through rate. Pre-registrations, raw data, and Stata syntax are available at https://osf.io/taqp8/.

Limitations

  • The paper states that mediation analysis has limitations and invites replication with alternative manipulations, designs, and measures; it also notes that the ancillary objective understanding measure may have been sensitive, and that wider-range questions might detect subtle changes. For study 4, the authors state that ad assignment was not random because Google Ads optimized for clicks, which may have generated unintended variance, though they believe replication in studies 3A/B makes it unlikely the results are solely due to ad optimization.
  • Evident from the text: studies 1–3B measure subjective understanding and healthcare utilization intentions rather than actual clinical uptake, and study 4 measures ad click-through rather than real patient utilization; the samples are online panels and Google Ads users, not a clinical patient population.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41562-021-01146-0

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

22 Own method · 20 Own result · 16 Not checked yet · 15 Own interpretation · 2 No basis given

Verify all 28 references — free account

Show all 37 claims

  • It may state two separate claims as one. 22
  • Probably not a substantial claim. 24
  • The quote only partly states this claim. 3
38 of 38
  • The paper relies on this without support.

    Healthcare utilization intentions are a valid proxy for actual healthcare utilization.

    “Healthcare utilization intentions were measured in study 3A with the item”
    “they reported their healthcare utilization intentions.”
  • The paper relies on this without support.

    The skin cancer detection context is representative of medical AI decision-making generally.

    “In the same skin cancer detection context as study 1”
    “medical AI”
  • The paper relies on this without support.

    Human and algorithmic providers in the studies are comparable in quality or accuracy.

    “comparable human providers”
  • The paper relies on this without support.

    Participants' self-reported subjective understanding accurately reflects their subjective understanding.

    “participants reported their subjective understanding”
    “Subjective understanding was measured in study 3A with the item used in study 2A.”
  • The paper relies on this without support.

    Click-through rate on Google Ads is a valid measure of healthcare utilization.

    “tested the impact of that intervention on ad click-through rates.”
  • The paper relies on this without support.

    The Google Ads platform serves ads according to the campaign goal (maximizing clicks), so the frequency of appearance of different ads was not random.

    “The frequency of appearance of the different ads was not random, because the Google Ads platform serves ads according to the goal of the campaign (maximizing clicks, in our case).”
  • The paper relies on this without support.

    Providers tend to present AI provider decisions as a 'black box' because the technologies used in algorithmic-based medical applications are complex.

    “Because the technologies used in algorithmic-based medical applications are complex, providers tend to present AI provider decisions as a 'black box' .”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentz = -2.61reported p = .009 · recomputed p = .009

    “,z = -2.61,p = .009”

  • Consistentz = 5.02reported p < .001 · recomputed p < .001

    “z = 5.02, p < .001”

  • Consistentz = 3.19reported p = .001 · recomputed p = .001

    “z = 3.19, p = .001”

  • Consistentz = -5.27reported p < .001 · recomputed p < .001

    “,z = -5.27,p < .001”

  • Consistentz = -1.47reported p = .14 · recomputed p = .142

    “,z = -1.47,p = .14”

  • Consistentz = 8.17reported p < .001 · recomputed p < .001

    “z = 8.17, p < .001”

6 of 6

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 48 references

Research works printed but not linked: 2

  1. Hao, K. Doctors are using AI to triage covid-19 patients. The tools may be here to stay. MIT Technology Review (23 April 2020).
  2. Kroll, J. A. et al. Accountable algorithms. Univ. Pa. Law Rev. 165, 633 (2016).

Cited by

Sorted by citations

Items 101–200 of 338

Metadata

Authors
Cadario, R., Longoni, C., & Morewedge, C. K.
Affiliations
  • Erasmus University Rotterdam (NL)
  • Boston University (US)
Corresponding author
Cadario, Romain
Venue
Nature Human Behaviour
Published
2021-06-28
Volume
5
Issue
12
Pages
1636-1642
ISSN
2397-3374 (ISSN-L)
OpenAlex
W3095202475
Cited by
342
References
48
Citations by year
2026: 74 · 2025: 93 · 2024: 87 · 2023: 54 · 2022: 23 · 2021: 11
FWCI
15.46
Type
journal article
Language
en
Open access
Locations
  • Nature Human Behaviour (publishedVersion, public-domain)
  • PubMed (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (acceptedVersion, public-domain)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Archivio istituzionale della Ricerca - Bocconi (submittedVersion)
  • PsyArXiv (OSF Preprints) (submittedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion)
Funders
Erasmus Research Institute of Management
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Keywords
artificial intelligence in healthcare, algorithmic decision-making, trust in AI, resistance to AI adoption, algorithmic transparency, brief intervention, skin cancer detection, Google AdWords
MeSH terms
Clinical Decision-Making, Adult, Algorithms, Artificial Intelligence, Delivery of Health Care, Female, Humans, Male, Middle Aged

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review