Computerised physician order entry-related medication errors: analysis of reported errors and vulnerability testing of current systems
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Importance: Medication computerised provider order entry (CPOE) has been shown to decrease errors and is being widely adopted. However, CPOE also has potential for introducing or contributing to errors. Objectives: The objectives of this study are to (a) analyse medication error reports where CPOE was reported as a ‘contributing cause’ and (b) develop ‘use cases’ based on these reports to test vulnerability of current CPOE systems to these errors. Methods: A review of medication errors reported to United States Pharmacopeia MEDMARX reporting system was made, and a taxonomy was developed for CPOE-related errors. For each error we evaluated what went wrong and why and identified potential prevention strategies and recurring error scenarios. These scenarios were then used to test vulnerability of leading CPOE systems, asking typical users to enter these erroneous orders to assess the degree to which these problematic orders could be entered. Results: Between 2003 and 2010, 1.04 million medication errors were reported to MEDMARX, of which 63 040 were reported as CPOE related. A review of 10 060 CPOE-related cases was used to derive 101 codes describing what went wrong, 67 codes describing reasons why errors occurred, 73 codes describing potential prevention strategies and 21 codes describing recurring error scenarios. Ability to enter these erroneous order scenarios was tested on 13 CPOE systems at 16 sites. Overall, 298 (79.5%) of the erroneous orders were able to be entered including 100 (28.0%) being ‘easily’ placed, another 101 (28.3%) with only minor workarounds and no warnings. Conclusions and relevance: Medication error reports provide valuable information for understanding CPOE-related errors. Reports were useful for developing taxonomy and identifying recurring errors to which current CPOE systems are vulnerable. Enhanced monitoring, reporting and testing of CPOE systems are important to improve CPOE safety.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the larger issue is commonly the way that multiple different devices are used together, the consistency between user interfaces, and the ways they support or disrupt clinical practices in medications management”
From HCI for health and wellbeing: Challenges and opportunities (2019) · cites this paper as Schiff et al, 2015
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basics of Qualitative Research: Grounded Theory Procedures and Techniques.
Ellis, C., Strauss, A., & Corbin, J. (1992) · Contemporary Sociology · doi:10.2307/2074814 · Cited by 29,249
(1990) · Cited by 5,210
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Self-citationBates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107
Self-citationThe “Meaningful Use” Regulation for Electronic Health Records
Blumenthal, D., & Tavenner, M. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006114 · Cited by 2,059
Under-Reporting of Adverse Drug Reactions: A Systematic Review
Hazell, L., & Shakir, S. A. W. (2006) · Drug Safety · doi:10.2165/00002018-200629050-00003 · Cited by 1,931
Health IT and Patient Safety: Building Safer Systems for Better Care
Chou, D. (2012) · JAMA · doi:10.1001/jama.308.21.2282-a · Cited by 503
Improving Acceptance of Computerized Prescribing Alerts in Ambulatory Care
Shah, N. R., Seger, A. C., Seger, D. L., Fiskio, J. M., Kuperman, G. J., Blumenfeld, B., Recklet, E. G., Bates, D. W., & Gandhi, T. K. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1868 · Cited by 353
Self-citationHorsky, J., Schiff, G. D., Johnston, D., Mercincavage, L., Bell, D., & Middleton, B. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.09.002 · Cited by 289
Self-citationOutpatient prescribing errors and the impact of computerized prescribing
Gandhi, T. K., Weingart, S. N., Seger, A. C., Borus, J., Burdick, E., Poon, E. G., Leape, L. L., & Bates, D. W. (2005) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2005.0194.x · Cited by 255
Self-citationComputerized Prescribing: Building the Electronic Infrastructure for Better Medication Usage
Schiff, G. D., & Rucker, T. D. (1998) · JAMA · doi:10.1001/jama.279.13.1024 · Cited by 247
Self-citationPal, S. N., Duncombe, C., Falzon, D., & Olsson, S. (2013) · Drug Safety · doi:10.1007/s40264-012-0014-6 · Cited by 233
Phansalkar, S., Edworthy, J., Hellier, E., Seger, D. L., Schedlbauer, A., Avery, A. J., & Bates, D. W. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005264 · Cited by 226
Self-citationStrom, B. L., Schinnar, R., Aberra, F., Bilker, W., Hennessy, S., Leonard, C. E., & Pifer, E. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.324 · Cited by 217
Ash, J. S., Sittig, D. F., Dykstra, R., Campbell, E., & Guappone, K. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.07.015 · Cited by 207
Electronic health records and national patient-safety goals
Sittig, D. F., & Singh, H. (2012) · New England Journal of Medicine · doi:10.1056/nejmsb1205420 · Cited by 204
Medication Errors: Experience of the United States Pharmacopeia (USP) MEDMARX Reporting System
Santell, J. P., Hicks, R. W., McMeekin, J., & Cousins, D. D. (2003) · Journal of Clinical Pharmacology · doi:10.1177/0091270003043007011 · Cited by 170
Mixed Results In The Safety Performance Of Computerized Physician Order Entry
Metzger, J., Welebob, E., Bates, D. W., Lipsitz, S., & Classen, D. C. (2010) · Health Affairs · doi:10.1377/hlthaff.2010.0160 · Cited by 166
Self-citationDesign of decision support interventions for medication prescribing
Horsky, J., Phansalkar, S., Desai, A. A., Bell, D. S., & Middleton, B. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2013.02.003 · Cited by 119
McKibbon, K. A., Lokker, C., Handler, S. M., Dolovich, L. R., Holbrook, A. M., O'Reilly, D., Tamblyn, R., Hemens, B. J., Basu, R., Troyan, S., et al. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000304 · Cited by 102
Computerized Provider Order Entry and Patient Safety
Abramson, E. L., & Kaushal, R. (2012) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2012.08.001 · Cited by 51
Order sets in computerized physician order entry systems: an analysis of seven sites.
Wright, A. T., Sittig, D. F., Carpenter, J. D., Krall, M., Pang, J. E., & Middleton, B. (2010) · PubMed · Cited by 40
Self-citationBest Practices in Clinical Decision Support: The Case of Preventive Care Reminders
Phansalkar, S., Bloomrosen, M., Jenders, R., Bobb, A., Halamka, J., Kuperman, G., Payne, T., Teasdale, S., Vaida, A. J., Bates, D. W., et al. (2010) · Applied Clinical Informatics · doi:10.4338/aci-2010-05-ra-0031 · Cited by 37
Self-citation
Cited by
Kim, M. O., Coiera, E., & Magrabi, F. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw154 · Cited by 263
Singh, H., & Sittig, D. F. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004486 · Cited by 167
HCI for health and wellbeing: Challenges and opportunities
Blandford, A. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.06.007 · Cited by 152
“…technologies on clinical work, in terms of safety and efficiency, often highlighting their role in mitigating or provoking errors and workarounds (e.g., Koppel et al, 2008; Schiff et al, 2015; van der Veen et al, 2017). considered to have developed in the 19 th century (Malerba and Orsenigo, 2015).”
BackgroundThe Impact of Electronic Health Records on Diagnosis
Graber, M. L., Byrne, C., & Johnston, D. (2017) · Diagnosis · doi:10.1515/dx-2017-0012 · Cited by 108
Improving medication-related clinical decision support
Tolley, C. L., Slight, S. P., Husband, A. K., Watson, N., & Bates, D. W. (2018) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp160830 · Cited by 105
Self-citation
Metadata
- Authors
- Schiff, G. D., Amato, M. G., Eguale, T., Boehne, J. J., Wright, A., Koppel, R., Rashidee, A. H., Elson, R. B., Whitney, D. L., Thach, T.-T., Bates, D. W., & Seger, A. C.
- Affiliations
- Brigham and Women's Hospital (US)
- University of Pennsylvania (US)
- Quantros, San Francisco, California, USA
- MetroHealth (US)
- Baylor College of Medicine (US)
- Corresponding author
- Schiff, G D
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2015-01-16
- Volume
- 24
- Issue
- 4
- Pages
- 264-271
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- PMC
- PMC4392214
- OpenAlex
- W2117586793
- Cited by
- 138
- References
- 23
- Citations by year
- 2026: 8 · 2025: 5 · 2024: 6 · 2023: 8 · 2022: 6 · 2021: 15 · 2020: 9 · 2019: 18 · 2018: 15 · 2017: 26 · 2016: 15 · 2015: 7
- FWCI
- 40.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Quality & Safety (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Patient Safety Foundation
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- medication errors, error taxonomy, error prevention strategies, vulnerability testing, medication error reporting
- MeSH terms
- Humans, Medication Errors, Physicians, United States, Databases, Factual, Medical Order Entry Systems, Electronic Prescribing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.