CoChat

A patient feedback reporting tool for OpenNotes: implications for patient-clinician safety and quality partnerships

Bell, Sigall K, Gerard, Macda, Fossa, Alan, Delbanco, Tom, Folcarelli, Patricia H, Sands, Kenneth E, Sarnoff Lee, Barbara, Walker, Jan · 2017 · BMJ Quality & Safety
Cited by 68

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

Background: OpenNotes, a national movement inviting patients to read their clinicians' notes online, may enhance safety through patient-reported documentation errors. Objective: To test an OpenNotes patient reporting tool focused on safety concerns. Methods: We invited 6225 patients through a patient portal to provide note feedback in a quality improvement pilot between August 2014 and 2015. A link at the end of the note led to a 9-question survey. Patient Relations personnel vetted responses, shared safety concerns with providers and documented whether changes were made. Results: 2736/6225(44%) of patients read notes; among these, 1 in 12 patients used the tool, submitting 260 reports. Nearly all (96%) respondents reported understanding the note. Patients and care partners documented potential safety concerns in 23% of reports; 2% did not understand the care plan and 21% reported possible mistakes, including medications, existing health problems, something important missing from the note or current symptoms. Among these, 64% were definite or possible safety concerns on clinician review, and 57% of cases confirmed with patients resulted in a change to the record or care. The feedback tool exceeded the reporting rate of our ambulatory online clinician adverse event reporting system several-fold. After a year, 99% of patients and care partners found the tool valuable, 97% wanted it to continue, 98% reported unchanged or improved relationships with their clinician, and none of the providers in the small pilot reported worsening workflow or relationships with patients. Conclusions: Patients and care partners reported potential safety concerns in about one-quarter of reports, often resulting in a change to the record or care. Early data from an OpenNotes patient reporting tool may help engage patients as safety partners without apparent negative consequences for clinician workflow or patient-clinician relationships.

Overview

Integrity signals

Registry

Crossref · 10.1136/bmjqs-2016-006020

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Research works printed but not linked: 46

  1. 10.1377/hlthaff.2012.1409 · DOI · Paper page
  2. 10.1377/hlthaff.2014.0452 · DOI · Paper page
  3. 10.1377/hlthaff.2013.0831 · DOI · Paper page
  4. Khan, 2016, Parent-reported errors and adverse events in hospitalized children, JAMA Pediatr, 170, e154608, 10.1001/jamapediatrics.2015.4608 · DOI · Paper page
  5. 10.1136/bmjqs-2012-001727 · DOI
  6. 10.1136/bmjqs-2015-003980 · DOI · Paper page
  7. Weir, 2003, Direct text entry in electronic progress notes. An evaluation of input errors, Methods Inf Med, 42, 61, 10.1055/s-0038-1634210 · DOI · Paper page
  8. 10.1016/j.ijmedinf.2007.03.001 · DOI
  9. Kaboli, 2004, Assessing the accuracy of computerized medication histories, Am J Manag Care, 10, 872
  10. 10.1056/NEJMp1310132 · DOI · Paper page
  11. Bell, 2015, Connecting patients and clinicians: the anticipated effects of Open Notes on patient safety and quality of care, Jt Comm J Qual Patient Saf, 41, 378
  12. 10.1136/bmjqs-2015-004573 · doi:10.1136/bmjqs-2015-004573
  13. Weingart, 2007, Patient-reported safety and quality of care in outpatient oncology, Jt Comm J Qual Patient Saf, 33, 83
  14. 10.1111/hex.12039 · DOI · Paper page
  15. 10.1111/j.1369-7625.2007.00450.x · DOI · Paper page
  16. 10.1016/j.ijmedinf.2006.05.021 · DOI
  17. Connock, 2007, Clinical effectiveness and cost-effectiveness of different models of managing long-term oral anticoagulation therapy: a systematic review and economic modelling, Health Technol Assess, 11, iii, 10.3310/hta11380 · DOI · Paper page
  18. 10.1136/qshc.2009.032748 · DOI · Paper page
  19. 10.1136/qshc.2006.020362 · DOI · Paper page
  20. 10.1371/journal.pone.0080759 · DOI
  21. Entwistle, 2005, Advising patients about patient safety: current initiatives risk shifting responsibility, Jt Comm J Qual Patient Saf, 31, 483
  22. 10.7326/0003-4819-155-12-201112200-00003 · DOI · Paper page
  23. 10.7326/0003-4819-157-7-201210020-00002 · DOI · Paper page
  24. 10.1136/qshc.2008.030114 · DOI · Paper page
  25. Dullabh, 2014, How patients can improve the accuracy of their medical records, EGEMS (Wash DC), 2, 1080
  26. Lesselroth, 2009, Using consumer-based kiosk technology to improve and standardize medication reconciliation in a specialty care setting, Jt Comm J Qual Patient Saf, 35, 264
  27. 10.1056/NEJMp078104 · DOI · Paper page
  28. Plews-Ogan, 2016, Wisdom in medicine: what helps physicians after a medical error?, Acad Med, 91, 233, 10.1097/ACM.0000000000000886 · DOI
  29. 10.1111/j.1468-0009.2012.00679.x · DOI
  30. 10.1056/NEJMNEJMhpr011493 · DOI · Paper page
  31. 10.1111/j.1525-1497.2005.04101.x · DOI · Paper page
  32. Singh, 2015, Improving diagnosis in health care—the next imperative for patient safety, N Engl J Med, 373, 2493, 10.1056/NEJMp1512241 · DOI · Paper page
  33. 10.7326/M13-2993 · DOI
  34. Bell, 2016, When patients teach, Acad Med, 91, 457, 10.1097/ACM.0000000000001113 · doi:10.1097/acm.0000000000001113
  35. 10.1001/jama.2015.14850 · DOI · Paper page
  36. 10.1002/pon.3317 · DOI · Paper page
  37. 10.1200/JCO.2011.38.1384 · DOI · Paper page
  38. “Health Policy Brief: Patient Engagement”, Health Affairs, February 14, 2013. http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=86 (accessed 16 Oct 2016).
  39. 10.1111/1468-0009.12166 · DOI · Paper page
  40. 10.1136/bmjqs-2013-002194 · DOI · Paper page
  41. Croskerry, 2012, Perspectives on diagnostic failure and patient safety, Healthc Q, 15, 50, 10.12927/hcq.2012.22841 · DOI
  42. Wachter R . The Digital Doctor: Hope, Hype, and Harm at the Dawn of Medicine's Computer Age . New York: McGraw-Hill, 2015.
  43. 10.1056/NEJMp1509961 · DOI · Paper page
  44. 10.1378/chest.13-0886 · DOI
  45. 10.1111/j.1525-1497.2004.30157.x · DOI · Paper page
  46. 10.1093/jamia/ocv167 · DOI

Cited by

See all 68

Metadata

Authors
Bell, S. K., Gerard, M., Fossa, A., Delbanco, T., Folcarelli, P. H., Sands, K. E., Sarnoff Lee, B., & Walker, J.
Affiliations
  • Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
  • Department of Health Care Quality, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
  • Department of Social Work and Patient/Family Engagement, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
Venue
BMJ Quality & Safety
Publisher
BMJ
Published
2016-12-13
Volume
26
Issue
4
Pages
312-322
ISSN
  • 2044-5415
  • 2044-5423
Cited by
68
References
9
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.