Factors associated with patient recall of key information in ambulatory specialty care visits: Results of an innovative methodology
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
While some studies have assessed patient recall of important information from ambulatory care visits, none has done so recently. Furthermore, little is known about features of clinical interactions which are associated with patient understanding and recall, without which shared decision making, a widely shared ideal for patient care, cannot occur. Our objective was to evaluate characteristics of patients and outpatient encounters associated with patient recall of information after one week, along with observation of elements of shared decision making. This was an observational study based on coded transcripts of 189 outpatient encounters, and post-visit interviews with patients 1 week later. Coding used three previously validated systems, adopted for this study. Forty-nine percent of decisions and recommendations were recalled accurately without prompting; 36% recalled with a prompt; 15% recalled erroneously or not at all. Provider behaviors hypothesized to be associated with patient recall, such as open-questioning and "teach back," were rare. Patients with less than high school education recalled 38% of items freely and accurately, while patients with a college degree recalled 65% (p < .0001). In a multivariate model, the total number of items to be recalled per visit, and percentage of utterances in decision-making processes by the provider ("verbal dominance"), were significant predictors of poorer recall. The item count was associated with poorer recall for lower, but not higher, educated patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
Searle, J. R. (1969) · doi:10.1017/cbo9781139173438 · Cited by 11,718
Shared decision making: A model for clinical practice
Elwyn, G., Frosch, D., Thomson, R., Joseph-Williams, N., Lloyd, A., Kinnersley, P., Cording, E., Tomson, D., Dodd, C., Rollnick, S., et al. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2077-6 · Cited by 4,405
Effective physician-patient communication and health outcomes: a review.
(1995) · Europe PMC (PubMed Central) · Cited by 4,085
Doctor-patient communication: a review of the literature
Ong, L. M. L., de Haes, J. C. J. M., Hoos, A. M., & Lammes, F. B. (1995) · Social Science & Medicine · doi:10.1016/0277-9536(94)00155-m · Cited by 2,430
Assessing the Effects of Physician-Patient Interactions on the Outcomes of Chronic Disease
Kaplan, S. H., Greenfield, S., & Ware, J. E. (1989) · Medical Care · doi:10.1097/00005650-198903001-00010 · Cited by 2,043
An integrative model of shared decision making in medical encounters
Makoul, G., & Clayman, M. L. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2005.06.010 · Cited by 1,621
Patients’ Memory for Medical Information
Kessels, R. P. C. (2003) · Journal of the Royal Society of Medicine · doi:10.1177/014107680309600504 · Cited by 1,348
Joseph-Williams, N., Elwyn, G., & Edwards, A. (2014) · Patient Education and Counseling · doi:10.1016/j.pec.2013.10.031 · Cited by 1,242
Greenfield, S., Kaplan, S. H., Ware, J. E., Yano, E. M., & Frank, H. J. L. (1988) · Journal of General Internal Medicine · doi:10.1007/bf02595921 · Cited by 1,119
Meta-analysis of correlates of provider behavior in medical encounters
Hall, J. A., Roter, D. L., & Katz, N. R. (1988) · Medical Care · doi:10.1097/00005650-198807000-00002 · Cited by 1,069
Communication Patterns of Primary Care Physicians
Roter, D. L. (1997) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1997.03540280088045 · Cited by 939
Decision aids for patients facing health treatment or screening decisions: systematic review
O'Connor, A. M., Rostom, A., Fiset, V., Tetroe, J., Entwistle, V., Llewellyn-Thomas, H., Holmes-Rovner, M., Barry, M., & Jones, J. (1999) · BMJ · doi:10.1136/bmj.319.7212.731 · Cited by 873
O'Keefe, D. J., & Jensen, J. D. (2007) · Journal of Health Communication · doi:10.1080/10810730701615198 · Cited by 743
Kaplan, S. H., Gandek, B., Greenfield, S., Rogers, W., & Ware, J. E. (1995) · Medical Care · doi:10.1097/00005650-199512000-00002 · Cited by 580
Self-citationPrimary Medication Non-Adherence: Analysis of 195,930 Electronic Prescriptions
Fischer, M. A., Stedman, M. R., Lii, J., Vogeli, C., Shrank, W. H., Brookhart, M. A., & Weissman, J. S. (2010) · Journal of General Internal Medicine · doi:10.1007/s11606-010-1253-9 · Cited by 572
Shared decision making: developing the OPTION scale for measuring patient involvement
Elwyn, G. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.2.93 · Cited by 552
The relationship of physician medical interview style to patient satisfaction.
Bertakis, K. D., ROTER, D. L., & Putnam, S. M. (1991) · PubMed · Cited by 500
On the remarkable persistence of asymmetry in doctor/patient interaction: A critical review
Pilnick, A., & Dingwall, R. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.02.033 · Cited by 391
Lerman, C. E., Brody, D. S., Caputo, G. C., Smith, D. G., Lazaro, C. G., & Wolfson, H. G. (1990) · Journal of General Internal Medicine · doi:10.1007/bf02602306 · Cited by 389
King, A. (1992) · American Educational Research Journal · doi:10.2307/1163370 · Cited by 365
Memory for medical information
Ley, P. (1979) · British Journal of Social and Clinical Psychology · doi:10.1111/j.2044-8260.1979.tb00333.x · Cited by 356
Patient perception of involvement in medical care: Relationship to illness attitudes and outcomes
Brody, D. S., Miller, S. M., Lerman, C. E., Smith, D. G., & Caputo, G. C. (1989) · Journal of General Internal Medicine · doi:10.1007/bf02599549 · Cited by 339
Heisler, M., Vijan, S., Anderson, R. M., Ubel, P. A., Bernstein, S. J., & Hofer, T. P. (2003) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2003.21132.x · Cited by 300
Doctor–Patient Communication, Health-Related Beliefs, and Adherence in Glaucoma
Friedman, D. S., Hahn, S. R., Gelb, L., Tan, J., Shah, S. N., Kim, E. E., Zimmerman, T. J., & Quigley, H. A. (2008) · Ophthalmology · doi:10.1016/j.ophtha.2007.11.023 · Cited by 297
Beach, M. C. (2005) · The Annals of Family Medicine · doi:10.1370/afm.328 · Cited by 268
Bertakis, K. D. (1977) · PubMed · Cited by 251
Elwyn, G., Tsulukidze, M., Edwards, A., Légaré, F., & Newcombe, R. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.08.005 · Cited by 223
Wilson, I. B., Schoen, C., Neuman, P., Strollo, M. K., Rogers, W. H., Chang, H., & Safran, D. G. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0093-0 · Cited by 222
Self-citationThe Medical Interview: A Core Curriculum for Residencies in Internal Medicine
LIPKIN, M., QUILL, T. E., & NAPODANO, R. J. (1984) · Annals of Internal Medicine · doi:10.7326/0003-4819-100-2-277 · Cited by 199
Hoffman, R. M., Lewis, C. L., Pignone, M. P., Couper, M. P., Barry, M. J., Elmore, J. G., Levin, C. A., Van Hoewyk, J., & Zikmund-Fisher, B. J. (2010) · Medical Decision Making · doi:10.1177/0272989x10378701 · Cited by 194
PATIENT INFORMATION RECALL IN A RHEUMATOLOGY CLINIC
ANDERSON, J. L., DODMAN, S., KOPELMAN, M., & FLEMING, A. (1979) · Rheumatology · doi:10.1093/rheumatology/18.1.18 · Cited by 167
Jenkins, V. A., Solis‐Trapala, I., Langridge, C., Catt, S., Talbot, D. C., & Fallowfield, L. J. (2010) · Journal of Clinical Oncology · doi:10.1200/jco.2010.30.0814 · Cited by 147
Ford, S., Hall, A., Ratcliffe, D., & Fallowfield, L. (2000) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00308-1 · Cited by 119
Not to be taken as directed: Putting concordance for taking medicines into practice
Marinker, M., & Shaw, J. (2003) · BMJ · doi:10.1136/bmj.326.7385.348 · Cited by 116
Zikmund-Fisher, B. J., Couper, M. P., Singer, E., Ubel, P. A., Ziniel, S., Fowler, F. J., Levin, C. A., & Fagerlin, A. (2010) · Medical Decision Making · doi:10.1177/0272989x10380466 · Cited by 100
Measuring desire for control of health care processes.
Smith, R. A. P., Wallston, B. S., Wallston, K. A., Forsberg, P. R., & King, J. E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.2.415 · Cited by 82
Improving patient recall of information: Harnessing the power of structure
Langewitz, W. A., Ackermann, S., Heierle, A., Hertwig, R., Ghanim, L., & Bingisser, R. M. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.02.003 · Cited by 72
Measuring desire for control of health care processes.
Smith, R. A. P., Wallston, B. S., Wallston, K. A., et al. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.47.2.415 · Cited by 65
Evaluation of methods to improve communication in the physician-patient relationship.
Kupst, M. J., Dresser, K., Schulman, J. L., & Paul, M. H. (1975) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1975.tb02553.x · Cited by 55
Provider-patient Adherence Dialogue in HIV Care: Results of a Multisite Study
Laws, M. B., Beach, M. C., Lee, Y., Rogers, W. H., Saha, S. S., Korthuis, P. T., Sharp, V., & Wilson, I. B. (2012) · AIDS and Behavior · doi:10.1007/s10461-012-0143-z · Cited by 55
Self-citationBarry, M. J. (2012) · Journal of Ambulatory Care Management · doi:10.1097/jac.0b013e318249482f · Cited by 50
Recall-Promoting Physician Behaviors in Primary Care
Silberman, J., Tentler, A., Ramgopal, R., & Epstein, R. M. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0597-x · Cited by 40
Effect of the evaluation of recall on the rate of information recalled by patients in primary care
Bravo, B. N., Postigo, J. M. L., Segura, L. R., Selva, J. P. S., Trives, J. J. R., Córcoles, M. J. A., López, M. N., & Hidalgo, J. L.-T. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.01.022 · Cited by 34
The Effects of Absolute Risks, Relative Risks, Frequencies, and Probabilities on Decision Quality
Covey, J. A. (2011) · Journal of Health Communication · doi:10.1080/10810730.2011.561916 · Cited by 23
Informed Decision Making in Outpatient Practice: Time to Get Back to Basics
Braddock III, C. H., Edwards, K. A., Hasenberg, N. M., Laidley, T. L., & Levinson, W. (1999) · JAMA · doi:10.1001/jama.282.24.2313 · Cited by 19
Problems and processes in medical encounters: The cases method of dialogue analysis
Laws, M. B., Taubin, T., Bezreh, T., Lee, Y., Beach, M. C., & Wilson, I. B. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2012.12.012 · Cited by 15
Self-citation
Cited by
Teach-back: A systematic review of implementation and impacts
Talevski, J., Wong Shee, A., Rasmussen, B., Kemp, G., & Beauchamp, A. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231350 · Cited by 363
Horn, A., Kaneshiro, K., & Tsui, B. C. H. (2019) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004319 · Cited by 102
Cheng, G., Chen, A., Xin, Y., & Ni, Q. Q. (2023) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-05302-w · Cited by 58
New treatments and new assessment instruments for Hidradenitis suppurativa
van Straalen, K. R., Ingram, J. R., Augustin, M., & Zouboulis, C. C. (2022) · Experimental Dermatology · doi:10.1111/exd.14609 · Cited by 35
Sadigh, G., Coleman, D., Switchenko, J. M., Hopkins, J. O., & Carlos, R. C. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-022-07270-5 · Cited by 39
Metadata
- Authors
- Laws, M. B., Lee, Y., Taubin, T., Rogers, W. H., & Wilson, I. B.
- Affiliations
- Brown University (US)
- Tufts Medical Center (US)
- Corresponding author
- Laws, M. Barton
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-02-01
- Volume
- 13
- Issue
- 2
- Pages
- e0191940
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5794108
- OpenAlex
- W2789788656
- Cited by
- 118
- References
- 47
- Citations by year
- 2026: 16 · 2025: 22 · 2024: 21 · 2023: 17 · 2022: 13 · 2021: 16 · 2020: 9 · 2019: 4
- FWCI
- 11.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Patient-Centered Outcomes Research Institute
- Topics
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Keywords
- patient recall, shared decision-making, outpatient care, outpatient visits, patient understanding, teach-back, verbal dominance, patient education level, clinical communication, patient-provider interaction
- MeSH terms
- Adult, Aged, Ambulatory Care Facilities, Female, Humans, Male, Medicine, Middle Aged, Organizational Innovation, Mental Recall
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
