Is the Algorithm Good in a Bad World, or Has It Learned to be Bad? The Ethical Challenges of “Locked” Versus “Continuously Learning” and “Autonomous” Versus “Assistive” AI Tools in Healthcare
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
What happens when a patient-interfacing conversational artificial intelligence system (CAI)—AI that combines natural language understanding, processing, and machine-learning models to autonomously ...
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT and other large language models are double-edged swords
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023) · Radiology · doi:10.1148/radiol.230163 · Cited by 1,008
Identifying Ethical Considerations for Machine Learning Healthcare Applications
Char, D. S., Abràmoff, M. D., & Feudtner, C. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1819469 · Cited by 415 · cited 1×
“…a framework for identifying ethical challenges with MLHC through considering ethical issues raised by each design decision (and the questions designers needed to answer) along the entire conceptual pipeline from initial envisioning of an MLHC through deployment and clinical use (Char et al. 2020).”
BackgroundSelf-citationAbràmoff, M. D., Tobey, D., & Char, D. S. (2020) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2020.02.022 · Cited by 140
Self-citationMarwaha, J. S., & Kvedar, J. C. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00572-2 · Cited by 46
Cited by
Large language models in health care: Development, applications, and challenges
Yang, R., Tan, T. F., Lu, W., Thirunavukarasu, A. J., Ting, D. S. W., & Liu, N. (2023) · Health Care Science · doi:10.1002/hcs2.61 · Cited by 366
“Uncertainty ‐ aware LLM applications may be another useful feature, where differential weights of input data or reporting confidence scores of generated responses can enhance the trust in proposed LLM applications [61].”
BackgroundExploring the Ethical Challenges of Conversational AI in Mental Health Care: Scoping Review
Rahsepar Meadi, M., Sillekens, T., Metselaar, S., van Balkom, A., Bernstein, J., & Batelaan, N. (2025) · JMIR Mental Health · doi:10.2196/60432 · Cited by 211
“%) articles mentioned this theme only briefly, including the article by Youssef et al [113], which does not discuss any other themes (Multimedia Appendix 3).”
ChatGPT and the rise of semi-humans
Al Lily, A. E., Ismail, A. F., Abunaser, F. M., Al-Lami, F., & Abdullatif, A. K. A. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02154-3 · Cited by 59
Incorporating Artificial Intelligence into Healthcare Workflows: Models and Insights
Dai, T., & Abràmoff, M. D. (2023) · Tutorials in Operations Research: Advancing the Frontiers of OR/MS: From Methodologies to Applications · doi:10.1287/educ.2023.0257 · Cited by 29
Self-citation
Metadata
- Authors
- Youssef, A., Abramoff, M., & Char, D.
- Venue
- The American Journal of Bioethics
- Publisher
- Informa UK Limited
- Published
- 2023-05-02
- Volume
- 23
- Issue
- 5
- Pages
- 43-45
- ISSN
- 1526-5161 (ISSN-L)
- 1536-0075
- OpenAlex
- W4367671198
- Cited by
- 20
- References
- 4
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is the Algorithm Good in a Bad World, or Has It Learned to be Bad? The Ethical Challenges of “Locked” Versus “Continuously Learning” and “Autonomous” Versus “Assistive” AI Tools in Healthcare. https://app.cochat.ai/papers/10.1080/15265161.2023.2191052
- The paper
- Youssef, A., Abramoff, M., & Char, D. (2023). Is the Algorithm Good in a Bad World, or Has It Learned to be Bad? The Ethical Challenges of “Locked” Versus “Continuously Learning” and “Autonomous” Versus “Assistive” AI Tools in Healthcare. The American Journal of Bioethics. https://doi.org/10.1080/15265161.2023.2191052
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.