Medical Shared Decision Making with a Virtual Agent
Abstract
Shared decision making (SDM) is a process in which patients and clinicians work together to make medical decisions based on clinical evidence that balances risks and expected outcomes with patient preferences and values. SDM has been advocated as the ideal model for patient decision-making in healthcare. However, SDM is rarely used in practice due, in part, to limited availability of healthcare professionals trained in these techniques. In this work, we describe the design of a virtual decision coach to help women participate in SDM about prenatal testing for Down syndrome. In a quasi-experimental evaluation study, participants demonstrated significant increases in knowledge, high levels of satisfaction with their final decision and low levels of decisional conflict and regret, indicating that virtual agents can effectively perform in the role of decision coach and facilitate the implementation of SDM.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Conversational agents are a promising tool for the advancement of patient-centered care and can support users' involvement in the management of their own health.
“Due to this accessibility, conversational agents are also a promising tool for the advancement of patient-centered care and can support users’ involvement in the management of their own health [17,18].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [18]
Conversational agents are helping to provide patient-centered care by increasing patients' involvement in their health care and decision making.
“Finally, these agents are helping to provide patient-centered care by increasing the patients’ involvement in their health care and decision making [2,17,18].”
From Effectiveness of Conversational Agents (Virtual Assistants) in Health Care: Protocol for a Systematic Review (2020) · cites this paper as [18]
Cites
Decision making with the analytic hierarchy process
Saaty, T. L. (2008) · International Journal of Services Sciences · doi:10.1504/ijssci.2008.017590 · Cited by 10,301 · see citing works
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Lewis, K., Barry, M. J., Bennett, C. L., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub5 · Cited by 6,685 · see citing works
Shared decision making: A model for clinical practice
Elwyn, G., Frosch, D., Thomson, R., Joseph-Williams, N., Lloyd, A., Kinnersley, P., Cording, E., Tomson, D., Dodd, C., Rollnick, S., et al. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2077-6 · Cited by 4,405 · cited 1× · see citing works
“The design of the decision coaching conversation is based on the SDM Model developed by Elwyn et al [18] , which translates the conceptualization of SDM into a practical model that can be used to guide how to do shared decision making in clinical practice.”
MethodCharles, C., Gafni, A., & Whelan, T. (1997) · Social Science & Medicine · doi:10.1016/s0277-9536(96)00221-3 · Cited by 4,137 · cited 2× · see citing works
“Unlike other frameworks in which SDM is built upon the traditional patient-clinician dyad [2], this conceptual framework includes the role of decision coach to facilitate SDM.”
BackgroundMethodShared decision making — The pinnacle of patient-centered care
Barry, M. J., & Edgman-Levitan, S. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1109283 · Cited by 3,433 · see citing works
Development of the multidimensional health locus of control (MHLC) scales
Wallston, K. A., Strudler Wallston, B., & DeVellis, R. (1978) · Health Education Monographs · doi:10.1177/109019817800600107 · Cited by 3,373 · see citing works
Multiple Criteria Decision Analysis: An Integrated Approach
Belton, V., & Stewart, T. J. (2001) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,724 · see citing works
Multiple Criteria Decision Analysis
Belton, V., & Stewart, T. J. (2002) · doi:10.1007/978-1-4615-1495-4 · Cited by 2,659 · see citing works
Validation of a Decisional Conflict Scale
O'Connor, A. M. C. (1995) · Medical Decision Making · doi:10.1177/0272989x9501500105 · Cited by 2,462 · see citing works
Conducting Discrete Choice Experiments to Inform Healthcare Decision Making: A User??s Guide
Lancsar, E., & Louviere, J. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826080-00004 · Cited by 1,707 · see citing works
An integrative model of shared decision making in medical encounters
Makoul, G. T., & Clayman, M. L. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2005.06.010 · Cited by 1,639 · see citing works
Rapid estimate of adult literacy in medicine: a shortened screening instrument.
Davis, T. C., Long, S. W., Jackson, R. H., Mayeaux, E. J., George, R. B., Murphy, P. W., & Crouch, M. A. (1993) · PubMed · Cited by 1,597 · see citing works
General Performance on a Numeracy Scale among Highly Educated Samples
Lipkus, I. M., Samsa, G., & Rimer, B. K. (2001) · Medical Decision Making · doi:10.1177/0272989x0102100105 · Cited by 1,501 · see citing works
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Col, N. F., Bennett, C. L., Barry, M. J., Eden, K., Holmes-Rovner, M. M., Llewellyn‐Thomas, H. A., Lyddiatt, A., Thomson, R., et al. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub4 · Cited by 1,484 · see citing works
Validation of a Decision Regret Scale
Brehaut, J., O'Connor, A. M. C., Wood, T. J., Hack, T. F., Siminoff, L. A., Gordon, E. J., & Feldman‐Stewart, D. (2003) · Medical Decision Making · doi:10.1177/0272989x03256005 · Cited by 1,465 · see citing works
SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement
Edwards, W., & Barron, F. H. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1087 · Cited by 1,123 · see citing works
Implementing shared decision making in the NHS
Elwyn, G. J., Laitner, S., Coulter, A., Walker, E., Watson, P., & Thomson, R. (2010) · BMJ · doi:10.1136/bmj.c5146 · Cited by 1,101 · see citing works
Degner, L. F., Sloan, J. A., & Venkatesh, P. (1997) · PsycTESTS Dataset · doi:10.1037/t22188-000 · Cited by 919 · see citing works
Decision aids for people facing health treatment or screening decisions
Stacey, D., Bennett, C. L., Barry, M. J., Col, N. F., Eden, K., Holmes-Rovner, M. M., Llewellyn‐Thomas, H. A., Lyddiatt, A., Légaré, F., & Thomson, R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub3 · Cited by 851 · see citing works
Shared Decision Making to Improve Care and Reduce Costs
Lee, E. O., & Emanuel, E. (2013) · New England Journal of Medicine · doi:10.1056/nejmp1209500 · Cited by 753 · see citing works
Decision aids for people facing health treatment or screening decisions
Giles, K. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000031 · Cited by 747 · see citing works
BEAT: the Behavior Expression Animation Toolkit
Cassell, J., Vilhjálmsson, H. H., & Bickmore, T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383315 · Cited by 739 · see citing works
Self-citationDecision aids for people facing health treatment or screening decisions
O'Connor, A. M. C., Bennett, C. L., Stacey, D., Barry, M. J., Col, N. F., Eden, K., Entwistle, V. A., Fiset, V., Holmes-Rovner, M. M., Khangura, S. D., et al. (2003) · doi:10.1002/14651858.cd001431 · Cited by 662 · see citing works
Patient Satisfaction with Health Care Decisions
Holmes-Rovner, M. M., Kroll, J., Schmitt, N., Rovner, D. R., Breer, M. L., Rothert, M. L., Padonu, G., & Talarczyk, G. (1996) · Medical Decision Making · doi:10.1177/0272989x9601600114 · Cited by 612 · see citing works
Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents
Bickmore, T. W., Pfeifer, L. M., & Jack, B. W. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518891 · Cited by 289 · see citing works
Self-citationDecision Making in Oncology: A Review of Patient Decision Aids to Support Patient Participation
Stacey, D., Samant, R. S., & Bennett, C. L. (2008) · CA A Cancer Journal for Clinicians · doi:10.3322/ca.2008.0006 · Cited by 258 · see citing works
Bickmore, T. W., Pfeifer, L. M., Byron, D., Forsythe, S., Henault, L. E., Jack, B. W., Silliman, R., & Paasche-Orlow, M. K. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499991 · Cited by 249 · see citing works
Self-citationHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242 · see citing works
Self-citationStacey, D., Murray, M. A., Légaré, F., Dunn, S., Menard, P., & O'Connor, A. M. C. (2008) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2007.00108.x · Cited by 193 · see citing works
Decision Coaching to Prepare Patients for Making Health Decisions
Stacey, D., Kryworuchko, J., Bennett, C. L., Murray, M. A., Mullan, S., & Légaré, F. (2012) · Medical Decision Making · doi:10.1177/0272989x12443311 · Cited by 160 · see citing works
Therapeutic alliance: Its place as a process and outcome variable in dynamic psychotherapy research.
Frieswyk, S. H., Allen, J. G., Colson, D. B., Coyne, L., Gabbard, G. O., Horwitz, L., & Newsom, G. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.32 · Cited by 150 · see citing works
Multi-Criteria Decision Analysis to Support Healthcare Decisions
Baltussen, R., Thokala, P., Goetghebeur, M., et al. (2017) · Springer eBooks · doi:10.1007/978-3-319-47540-0 · Cited by 127 · see citing works
Therapeutic alliance: Its place as a process and outcome variable in dynamic psychotherapy research.
Frieswyk, S. H., Allen, J. G., Colson, D. B., et al. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.32 · Cited by 81 · see citing works
Beulen, L., van den Berg, M., Faas, B. H. W., Feenstra, I., Hageman, M., van Vugt, J. M. G., & Bekker, M. N. (2016) · European Journal of Human Genetics · doi:10.1038/ejhg.2016.39 · Cited by 78 · see citing works
Schoonen, M., Wildschut, H. I. J., Essink‐Bot, M., Peters, I. A., Steegers, E. A. P., & de Koning, H. J. (2011) · Patient Education and Counseling · doi:10.1016/j.pec.2011.10.001 · Cited by 38 · see citing works
Informed decision-making in prenatal screening for Down's syndrome: What knowledge is relevant?
Schoonen, H. M. H. J. D., van Agt, H. M. E., Essink‐Bot, M., Wildschut, H. I. J., Steegers, E. A. P., & de Koning, H. J. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.07.037 · Cited by 37 · see citing works
THE ROLE OF GESTURE IN DOCUMENT EXPLANATION BY EMBODIED CONVERSATIONAL AGENTS
Bickmore, T., Pfeifer, L. M., & Yin, L. (2008) · International Journal of Semantic Computing · doi:10.1142/s1793351x08000348 · Cited by 29 · see citing works
Self-citationRobertson, S. L., Solomon, R., Riedl, M. O., Gillespie, T. W., Chociemski, T., Master, V. A., & Mohan, A. V. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20609-7_40 · Cited by 24 · see citing works
Zhang, Z., Bickmore, T., Mainello, K., Mueller, M., Foley, M., Jenkins, L., & Edwards, R. A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-09767-1_61 · Cited by 16 · see citing works
Self-citationBreast cancer therapy planning – a novel support concept for a sequential decision making problem
Scherrer, A., Schwidde, I., Dinges, A., et al. (2014) · Health Care Management Science · doi:10.1007/s10729-014-9302-2 · Cited by 6 · see citing works
Guest Editorial: Broadening Perspectives in Knowledge about Grieving
Davies, B. I. (1997) · Canadian Journal of Nursing Research · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · see citing works
Wang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445432 · Cited by 209 · see citing works
Self-citationde Cock, C., Milne-Ives, M., van Velthoven, M. H., Alturkistani, A., Lam, C., & Meinert, E. (2020) · JMIR Research Protocols · doi:10.2196/16934 · Cited by 62 · see citing works
Kim, D., Vegt, N., Visch, V., & Bos-De Vos, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642883 · Cited by 33 · see citing works
- Authors
- Zhang, Z., & Bickmore, T.
- Affiliations
- Northeastern University (US)
- Venue
- Proceedings of the 18th International Conference on Intelligent Virtual Agents
- Publisher
- ACM
- Published
- 2018-11-05
- Pages
- 113-118
- OpenAlex
- W2901869712
- Cited by
- 28
- References
- 41
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 3 · 2023: 3 · 2022: 2 · 2021: 3 · 2020: 4 · 2019: 3
- FWCI
- 19.16
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Intelligent Virtual Agents (IVA) (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- shared decision-making, virtual agents, prenatal testing, Down syndrome, patient decision-making, decisional conflict, regret, patient knowledge, women's health, clinical decision support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review