Using computer agents to explain medical documents to patients with low health literacy
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Objective Patients are commonly presented with complex documents that they have difficulty understanding. The objective of this study was to design and evaluate an animated computer agent to explain research consent forms to potential research participants. Methods Subjects were invited to participate in a simulated consent process for a study involving a genetic repository. Explanation of the research consent form by the computer agent was compared to explanation by a human and a self-study condition in a randomized trial. Responses were compared according to level of health literacy. Results Participants were most satisfied with the consent process and most likely to sign the consent form when it was explained by the computer agent, regardless of health literacy level. Participants with adequate health literacy demonstrated the highest level of comprehension with the computer agent-based explanation compared to the other two conditions. However, participants with limited health literacy showed poor comprehension levels in all three conditions. Participants with limited health literacy reported several reasons, such as lack of time constraints, ability to re-ask questions, and lack of bias, for preferring the computer agent-based explanation over a human-based one. Conclusion Animated computer agents can perform as well as or better than humans in the administration of informed consent. Practice Implications Animated computer agents represent a viable method for explaining health documents to patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Health Literacy: A Prescription to End Confusion
Committee on Health Literacy, Board on Neuroscience and Behavioral Health, & Institute of Medicine (2004) · doi:10.17226/10883 · Cited by 3,444
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333
Self-citationBEAT: the Behavior Expression Animation Toolkit
Cassell, J., Vilhjálmsson, H. H., & Bickmore, T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383315 · Cited by 739
Self-citationEstablishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494 · cited 4×
“Dialogues are scripted, using a custom hierarchical transition network-based scripting language, in which agent utterances can be dynamically tailored based on information about the patient, information from previous conversations, and the unfolding discourse context [10].”
BackgroundMethodInfluentialSelf-citationHuman Factors Interventions for the Health Care of Older Adults
(2001) · doi:10.1201/b12459 · Cited by 117
Cited by
Nishimura, A., Carey, J., Erwin, P. J., Tilburt, J. C., Murad, M. H., & McCormick, J. B. (2013) · BMC Medical Ethics · doi:10.1186/1472-6939-14-28 · Cited by 521
Interventions for Individuals with Low Health Literacy: A Systematic Review
Sheridan, S. L., Halpern, D. J., Viera, A. J., Berkman, N. D., Donahue, K. E., & Crotty, K. (2011) · Journal of Health Communication · doi:10.1080/10810730.2011.604391 · Cited by 495
Schenker, Y., Fernandez, A., Sudore, R., & Schillinger, D. (2011) · Medical Decision Making · doi:10.1177/0272989x10364247 · Cited by 445
Out of the laboratory and into the classroom: the future of artificial intelligence in education
Schiff, D. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01033-8 · Cited by 334
Glaser, J., Nouri, S., Fernandez, A., Sudore, R. L., Schillinger, D., Klein-Fedyshin, M., & Schenker, Y. (2020) · Medical Decision Making · doi:10.1177/0272989x19896348 · Cited by 282
Bickmore, T. W., Pfeifer, L. M., Byron, D., Forsythe, S., Henault, L. E., Jack, B. W., Silliman, R., & Paasche-Orlow, M. K. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499991 · Cited by 249
“We have developed a computer interface—called an Embodied Conversational Agent (ECA)—that is usable by people with inadequate health literacy.(4) The interface uses the universal and familiar format of face-to-face conversation, not just as an interface metaphor, but as the actual model of interaction.”
BackgroundMethodSelf-citationBickmore, T. W., Utami, D., Matsuyama, R., & Paasche-Orlow, M. K. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5239 · Cited by 153
Self-citationImproving the informed consent process for research subjects with low literacy: a systematic review
Tamariz, L., Palacio, A., Robert, M., & Marcus, E. N. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2133-2 · Cited by 140
Philip, P., Micoulaud-Franchi, J.-A., Sagaspe, P., Sevin, E. D., Olive, J., Bioulac, S., & Sauteraud, A. (2017) · Scientific Reports · doi:10.1038/srep42656 · Cited by 128
Relational Agents in Clinical Psychiatry
Bickmore, T., & Gruber, A. (2010) · Harvard Review of Psychiatry · doi:10.3109/10673221003707538 · Cited by 112
Self-citationOwens, O. L., Felder, T., Tavakoli, A. S., Revels, A. A., Friedman, D. B., Hughes-Halbert, C., & Hébert, J. R. (2019) · American Journal of Health Promotion · doi:10.1177/0890117118786866 · Cited by 65
Use of an interactive computer agent to support breastfeeding
Edwards, R. A., Bickmore, T., Jenkins, L., Foley, M., & Manjourides, J. (2013) · Maternal and Child Health Journal · doi:10.1007/s10995-013-1222-0 · Cited by 63
“’’ Subjects’ overall satisfaction with and confidence in the Computer Agent after receiving the information/support were evaluated using additional scale measures [17, 18, 20].”
BackgroundMethodSelf-citationRomagnoli, K. M., Handler, S. M., Ligons, F. M., & Hochheiser, H. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001207 · Cited by 59
The Atrial Fibrillation Health Literacy Information Technology System: Pilot Assessment
Magnani, J. W., Schlusser, C. L., Kimani, E., Rollman, B. L., Paasche-Orlow, M. K., & Bickmore, T. W. (2017) · JMIR Cardio · doi:10.2196/cardio.8543 · Cited by 46
“In an additional larger application, we examined the effect of the relational agent to improve communication with patients at hospital discharge (N=764) and found that the agent was associated with reduced rates of readmission and improved patient satisfaction [19].”
BackgroundSelf-citationUsing conversational agents to explain medication instructions to older adults.
(2018) · Europe PMC (PubMed Central) · Cited by 32
Metadata
- Authors
- Bickmore, T. W., Pfeifer, L. M., & Paasche-Orlow, M. K.
- Venue
- Patient Education and Counseling
- Publisher
- Elsevier BV
- Published
- 2009-06
- Volume
- 75
- Issue
- 3
- Pages
- 315-320
- ISSN
- 0738-3991 (ISSN-L)
- OpenAlex
- W2053826017
- Cited by
- 137
- References
- 6
- FWCI
- 13.41
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.