CoChat

Notifications Received by Primary Care Practitioners in Electronic Health Records: A Taxonomy and Time Analysis

Murphy, Daniel R., Reis, Brian, Sittig, Dean F., Singh, Hardeep · 2012 · The American Journal of Medicine
Cited by 89

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

BACKGROUND Asynchronous electronic health record (EHR)-based alerts used to notify practitioners via an inbox-like format rather than through synchronous computer "pop-up" messages are understudied. Our objective was to create an asynchronous alert taxonomy and measure the impact of different alert types on practitioner workload. METHODS We quantified and categorized asynchronous alerts according to the information they conveyed and conducted a time-motion analysis to assess practitioner workload. We reviewed alert information transmitted to all 47 primary care practitioners (PCPs) at a large, tertiary care Veterans Affairs facility over 4 evenly spaced 28-day periods. An interdisciplinary team used content analysis to categorize alerts according to their conveyed information. We then created an alert taxonomy and used it to calculate the mean number of alerts of each type PCPs received each day. We conducted a time-motion study of 26 PCPs while they processed their alerts. We used these data to estimate the uninterrupted time practitioners spend processing alerts each day. RESULTS We extracted 295,792 asynchronously generated alerts and created a taxonomy of 33 alert types categorized under 6 major categories: Test Results, Referrals, Note-Based Communication, Order Status, Patient Status Changes, and Incomplete Task Reminders. PCPs received a mean of 56.4 alerts/day containing new information. Based on 749 observed alert processing episodes, practitioners spent an estimated…

Overview

Integrity signals

Registry

Crossref · 10.1016/j.amjmed.2011.07.029

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 21

  1. Coiera, 1998, Communication behaviours in a hospital setting: an observational study, BMJ, 316, 673, 10.1136/bmj.316.7132.673 · DOI · Paper page
  2. Magnus, 2002, GPs' views on computerized drug interaction alerts: questionnaire survey, J Clin Pharm Ther, 27, 377, 10.1046/j.1365-2710.2002.00434.x · DOI · Paper page
  3. Weingart, 2003, Physicians' decisions to override computerized drug alerts in primary care, Arch Intern Med, 163, 2625, 10.1001/archinte.163.21.2625 · DOI · Paper page
  4. Taylor, 2004, Reasons for physician non-adherence to electronic drug alerts, Stud Health Technol Inform, 11, 1101
  5. Wahls, 2007, The frequency of missed test results and associated treatment delays in a highly computerized health system, BMC Fam Pract, 8, 32, 10.1186/1471-2296-8-32 · DOI · Paper page
  6. Fava, 2007, Information overload, the patient and the clinician, Psychother Psychosom, 76, 1, 10.1159/000096358 · DOI
  7. Wright, 2011, Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems, J Am Med Inform Assoc, 18, 232, 10.1136/amiajnl-2011-000113 · DOI · Paper page
  8. Bratt, 1999, A comparison of four approaches for measuring clinician time use, Health Policy Plan, 14, 374, 10.1093/heapol/14.4.374 · DOI
  9. Finkler, 1993, A comparison of work-sampling and time-and-motion techniques for studies in health services research, Health Serv Res, 28, 577
  10. Schumacher, 2010, Commentary: electronic health records and human performance, J Oncol Pract, 6, 125, 10.1200/JOP.091098 · DOI
  11. Linder, 2006, Barriers to electronic health record use during patient visits, AMIA Annu Symp Proc, 499
  12. Simon, 2008, Electronic health records: which practices have them, and how are clinicians using them?, J Eval Clin Pract, 14, 43, 10.1111/j.1365-2753.2007.00787.x · DOI · Paper page
  13. Pizziferri, 2005, Primary care physician time utilization before and after implementation of an electronic health record: a time-motion study, J Biomed Inform, 38, 176, 10.1016/j.jbi.2004.11.009 · DOI · Paper page
  14. Weingart, 2009, Clinicians' assessments of electronic medication safety alerts in ambulatory care, Arch Intern Med, 169, 1627, 10.1001/archinternmed.2009.300 · DOI · Paper page
  15. Biron, 2009, Work interruptions and their contribution to medication administration errors: an evidence review, Worldviews Evid Based Nurs, 6, 70, 10.1111/j.1741-6787.2009.00151.x · DOI · Paper page
  16. Doerr, 2010, Between-visit workload in primary care, J Gen Intern Med, 25, 1289, 10.1007/s11606-010-1470-2 · DOI · Paper page
  17. Farber, 2007, How much time do physicians spend providing care outside of office visits?, Ann Intern Med, 147, 693, 10.7326/0003-4819-147-10-200711200-00005 · DOI · Paper page
  18. Ammenwerth, 2009, The time needed for clinical documentation versus direct patient care, Methods Inf Med, 48, 84, 10.3414/ME0569 · DOI · Paper page
  19. Margolius, 2010, Transforming primary care: from past practice to the practice of the future, Health Aff (Millwood), 29, 779, 10.1377/hlthaff.2010.0045 · DOI · Paper page
  20. Sittig, 2009, Eight rights of safe electronic health record use, JAMA, 302, 1111, 10.1001/jama.2009.1311 · DOI · Paper page
  21. Singh, 2010, Ten strategies to improve management of Abnormal Test Result Alerts in the Electronic Health Record, J Patient Saf, 6, 121, 10.1097/PTS.0b013e3181ddf652 · DOI · Paper page

Cited by

See all 89

Metadata

Authors
Murphy, D. R., Reis, B., Sittig, D. F., & Singh, H.
Venue
The American Journal of Medicine
Publisher
Elsevier BV
Published
2012-02
Volume
125
Issue
2
Pages
209.e1-209.e7
ISSN
0002-9343
Cited by
89
References
13
Language
en
Licence
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.