The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.
On the ethics of algorithmic decision-making in healthcare
Open accessAbstract
In recent years, a plethora of high-profile scientific publications has been reporting about machine learning algorithms outperforming clinicians in medical diagnosis or treatment recommendations. This has spiked interest in deploying relevant algorithms with the aim of enhancing decision-making in healthcare. In this paper, we argue that instead of straightforwardly enhancing the decision-making capabilities of clinicians and healthcare institutions, deploying machines learning algorithms entails trade-offs at the epistemic and the normative level. Whereas involving machine learning might improve the accuracy of medical diagnosis, it comes at the expense of opacity when trying to assess the reliability of given diagnosis. Drawing on literature in social epistemology and moral responsibility, we argue that the uncertainty in question potentially undermines the epistemic authority of clinicians. Furthermore, we elucidate potential pitfalls of involving machine learning in healthcare with respect to paternalism, moral responsibility and fairness. At last, we discuss how the deployment of machine learning algorithms might shift the evidentiary norms of medical diagnosis. In this regard, we hope to lay the grounds for further ethical reflection of the opportunities and pitfalls of machine learning for enhancing decision-making in healthcare.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The inherent statistical and predictive architecture combined with the intransparency of LLMs presents significant hurdles in validating the clinical accuracy and reliability of their outputs91–93.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [91]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Grote and Berens ( 2020) have argued that optimising for compliance efficiency in high-stakes automated systems may systematically undermine the human judgement that regulation assumes is present.”
From From Oracles to Productive Friction: Designing for Meaningful Human Oversight in Clinical AI (2026) · cites this paper as Grote and Berens ( 2020)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This can lead field experts, such as clinicians, to avoid questioning the suggestion of an algorithm even when it may seem odd to them.”
From The ethics of algorithms: key problems and solutions (2022) · cites this paper as Grote and Berens 2020
In the citing paper
“Grote et al. [42] argue that in the case of opaque AI there is not enough epistemic support for deference.”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [42]
In the citing paper
“Here, physicians might be forced into “defensive medicine” where they dogmatically follow the output of the machine to avoid being questioned or held accountable [42].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Stanford encyclopedia of philosophy
(1998) · Choice Reviews Online · doi:10.5860/choice.35-4860 · Cited by 3,398
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Health as a Theoretical Concept
Boorse, C. (1977) · Philosophy of Science · doi:10.1086/288768 · Cited by 1,780
Research works printed but not linked: 1
- Wolff J , Avner D-S . Disadvantage. Oxford: Oxford University Press, 2007.
Cited by
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
Ethical and regulatory challenges of AI technologies in healthcare: A narrative review
Mennella, C., Maniscalco, U., De Pietro, G., & Esposito, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26297 · Cited by 1,229
Xu, L., Sanders, L., Li, K., & Chow, J. C. L. (2021) · JMIR Cancer · doi:10.2196/27850 · Cited by 571
Ethics and governance of trustworthy medical artificial intelligence
Zhang, J., & Zhang, Z.-M. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02103-9 · Cited by 507
“People cannot explain how the machine makes judgments [38].”
BackgroundThe Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Metadata
- Authors
- Grote, T., & Berens, P.
- Affiliations
- University of Tübingen (DE)
- Corresponding author
- Grote, Thomas
- Venue
- Journal of Medical Ethics
- Publisher
- BMJ
- Published
- 2019-11-20
- Volume
- 46
- Issue
- 3
- Pages
- 205-211
- ISSN
- 0306-6800 (ISSN-L)
- 1473-4257
- PMC
- PMC7042960
- OpenAlex
- W2991542819
- Cited by
- 551
- References
- 43
- Citations by year
- 2026: 91 · 2025: 113 · 2024: 94 · 2023: 94 · 2022: 78 · 2021: 60 · 2020: 21
- FWCI
- 12.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Medical Ethics (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Deutsche Forschungsgemeinschaft (EXC 2064/1 – Project number 390727645)
- Bundesministerium für Bildung und Forschung (FKZ 01GQ1601)
- Heisenberg Professur (BE 5601/4-1)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics and bioethics in healthcare
- Keywords
- algorithmic decision-making, machine learning in healthcare, diagnosis, algorithmic opacity, uncertainty, moral responsibility, paternalism, fairness, social epistemology, clinical decision-making
- MeSH terms
- Decision Making, Delivery of Health Care, Ethics, Medical, Humans, Morals, Reproducibility of Results, Paternalism, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the ethics of algorithmic decision-making in healthcare. https://app.cochat.ai/papers/10.1136/medethics-2019-105586
- The paper
- Grote, T., & Berens, P. (2020). On the ethics of algorithmic decision-making in healthcare. Journal of Medical Ethics. https://doi.org/10.1136/medethics-2019-105586
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.