The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
How Much Decision Power Should (A)I Have?: Investigating Patients’ Preferences Towards AI Autonomy in Healthcare Decision Making
Open accessAbstract
Despite the growing potential of artificial intelligence (AI) in improving clinical decision making, patients' perspectives on the use of AI for their care decision making are underexplored. In this paper, we investigate patients’ preferences towards the autonomy of AI in assisting healthcare decision making. We conducted interviews and an online survey using an interactive narrative and speculative AI prototypes to elicit participants’ preferred choices of using AI in a pregnancy care context. The analysis of the interviews and in-story responses reveals that patients’ preferences for AI autonomy vary per person and context, and may change over time. This finding suggests the need for involving patients in defining and reassessing the appropriate level of AI assistance for healthcare decision making. Departing from these varied preferences for AI autonomy, we discuss implications for incorporating patient-centeredness in designing AI-powered healthcare decision making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Regulations, the benefits of automation, and patient preferences regarding AI autonomy might vary per use case and over time,58 therefore requiring use case specific human oversight mechanisms and periodic auditing and updates (see traceability 4).”
From FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare (2025) · cites this paper as [58]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Regulations, the benefits of automation, and patient preferences regarding AI autonomy might vary per use case and over time,58 therefore requiring use case specific human oversight mechanisms and periodic auditing and updates (see traceability 4).”
From FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare (2025) · cites this paper as [58]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“This finding adds to the theoretical model of human trust in autonomous systems [23], un-derscoring these three personal factors as contributing elements influencing individuals’ inclination to trust autonomous systems, particularly within the healthcare context.”
Clarke, V., & Braun, V. (2017) · The Journal of Positive Psychology · doi:10.1080/17439760.2016.1262613 · Cited by 6,543 · cited 1×
“We first analyzed interview transcripts, using thematic analysis [8], to find any emergent patterns regarding participants’ preferences for the level of AI autonomy in healthcare decision making.”
Digital Twin in Industry: State-of-the-Art
Tao, F., Zhang, H., Liu, A., & Nee, A. Y. C. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2873186 · Cited by 5,871 · cited 1×
“The notion of a Digital Twin (DT), defined as a dynamic virtual representation of a physical system [37], originates from the field of engineering, but is now also emerging in the healthcare domain as a novel technology that uses holistic biomedical data of a person to advance personalized and…”
Shared decision making: A model for clinical practice
Elwyn, G., Frosch, D., Thomson, R., Joseph-Williams, N., Lloyd, A., Kinnersley, P., Cording, E., Tomson, D., Dodd, C., Rollnick, S., et al. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2077-6 · Cited by 4,405 · cited 1×
“This focus is motivated by the increased adoption of Shared Decision Making in healthcare which respects patients’ preferences, autonomy, and values in clinical decision-making processes [15].”
Ayers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613 · cited 1×
“For instance, AI can take over repetitive tasks of healthcare providers (HCPs) [4] and take part in more complex tasks such as clinical decision making, potentially as a new actor next to patients and healthcare providers [39, 42].”
Speculative Everything: Design, Fiction, and Social Dreaming
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5390 · Cited by 1,952 · cited 2×
“This fiction-based, speculative design approach [12] enabled us to demonstrate probable , plausible , and possible futures of AI-powered healthcare decision making with concrete design artifacts and narratives.”
Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · cited 1×
“The importance of designing the right level of computer autonomy— or technical autonomy—and human control has been noted in various domains of intelligent and autonomous systems, ranging from recommender systems to autonomous vehicles, and autonomous weapons [25, 33, 34, 38].”
The role of artificial intelligence in healthcare: a structured literature review
Secinaro, S., Calandra, D., Secinaro, A., Muthurangu, V., & Biancone, P. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01488-9 · Cited by 1,085 · cited 1×
“The integration of AI into clinical decision making is anticipated to improve diagnostic accuracy and advance the quality of personalized and preventive care for patients [32].”
In AI we trust? Perceptions about automated decision-making by artificial intelligence
Araujo, T., Helberger, N., Kruikemeier, S., & de Vreese, C. H. (2020) · AI & SOCIETY · doi:10.1007/s00146-019-00931-w · Cited by 1,038
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895 · cited 1×
“The increased transparency of AI is expected to help users balance their level of trust in AI and the actual capability of AI [44].”
Research works printed but not linked: 1
- Carla Strasser. 2021. Towards Digital Twins in Healthcare: How would a meaningful Digital Twin for the user look like? (2021). Retrieved March 8, 2022 from https://repository.tudelft.nl/islandora/object/uuid%3A0fa88eaa-ef57-43d7-9312-ed82876da5fe
Cited by
Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957
“Regulations, the benefits of automation, and patient preferences regarding AI autonomy might vary per use case and over time, 58 therefore requiring use case specific human oversight mechanisms and periodic auditing and updates (see traceability 4).”
Exploring AI Approaches for Breast Cancer Detection and Diagnosis: A Review Article
Ali, A., Alghamdi, M., Marzuki, S., Din, T. A. D. A. T., Yamin, M. S., Alrashidi, M., Alkhazi, I. S., & Ahmed, N. (2025) · Breast Cancer Targets and Therapy · doi:10.2147/bctt.s550307 · Cited by 57
“148,149 These findings highlight the complex interplay between AI, patient autonomy, and healthcare decision making.”
Detjen, H., Densky, L., von Kalckreuth, N., & Kopka, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713898 · Cited by 20
AI and shared decision-making: a systematic review
Giorgetti, C., Giorgetti, A., Pelotti, S., & Contissa, G. (2026) · AI & Society · doi:10.1007/s00146-026-02955-5 · Cited by 15
“The preferred level of autonomy, though, could change depending on various factors, such as health history, nationality (Kim et al. 2024; Huang et al. 2023) or setting, e.g., in pediatric care, parents expressed concern that AI could reduce their decision-making role on behalf of their children…”
A Quantum Probability Approach to Improving Human–AI Decision Making
Humr, S. A., Canan, M., & Demir, M. (2025) · Entropy · doi:10.3390/e27020152 · Cited by 12
“Specifically, AI DSS is on the ascent in the medical field [72], industrial control [73], strategic decision making [74], and the military on a number of different fronts [75,76].”
Metadata
- Authors
- Kim, D., Vegt, N., Visch, V., & Bos-De Vos, M.
- Affiliations
- Industrial Design Engineering, Delft University of Technology, Netherlands
- Delft University of Technology (NL)
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-17
- OpenAlex
- W4396832493
- Cited by
- 33
- References
- 40
- Citations by year
- 2026: 17 · 2025: 15 · 2024: 1
- FWCI
- 8.88
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion, cc-by)
- Funders
- 4TU Federation (4TU-UIT-346)
- Convergence Alliance
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- artificial intelligence in healthcare, patient preferences, AI autonomy, clinical decision-making, patient-centered design, obstetric care, interactive storytelling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Much Decision Power Should (A)I Have?: Investigating Patients’ Preferences Towards AI Autonomy in Healthcare Decision Making. https://app.cochat.ai/papers/10.1145/3613904.3642883
- The paper
- Kim, D., Vegt, N., Visch, V., & Bos-De Vos, M. (2024). How Much Decision Power Should (A)I Have?: Investigating Patients’ Preferences Towards AI Autonomy in Healthcare Decision Making. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3613904.3642883
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.