The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Lessons From “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System”
Abstract
We are writing in response to the article “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System” by Han et al.1 The authors are to be congratulated for their courage in bringing their compelling account of computerized physician order entry (CPOE) implementation problems to the medical literature as they tried to interpret their results concerning mortality. Their article is as much a search for answers as it is a recitation of the shortfalls in their implementation process and computer systems. It is critically important to understand that the types of problems described by Han et al are not limited to their institution. In fact, setbacks and failures in the implementation of clinical information systems (CISs) and CPOE systems are all too common (eg, see refs 2–4). Although it is tempting to focus solely on the role of new technology in the problems highlighted by this example, there are also important lessons to be learned about related organizational and workflow factors that affect the potential for danger associated with CPOE implementation. There are many previous publications about troubled or failed implementations. The account by Han et al is unique in that an adverse change in mortality rate was associated in time with CIS and CPOE implementation. We may question the study's methodology and conclude that causality was not proven, yet the assignment of CPOE to a severity-adjusted odds ratio of 3.71 for patient death simply cannot be ignored. Regardless of what was or was not proven, if only one unnecessary death were caused by the implementation process or CIS and CPOE modules, that is one too many. The question that must be asked is how can intelligent and well-intentioned leaders at all levels of an institution make the kind of implementation … Address correspondence to Dean F. Sittig, PhD, Kaiser Permanente Center for Health Research, 3800 N Interstate Ave, Portland, OR 97227. E-mail: dean.f.sittig{at}kp.org
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A systematic review of outpatient CPOE systems found only four studies that addressed safety and concluded, “the relatively small number of evaluation studies published to date do not provide adequate evidence that CPOE systems enhance safety and reduce cost in the outpatient settings.”28”
From EHR Safety: The Way Forward to Safe and Effective Systems (2008) · cites this paper as [28]
Citations
Cites
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Self-citationHan, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149
Poissant, L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1700 · Cited by 901
Computerized Surveillance of Adverse Drug Events in Hospital Patients
Classen, D. C. (1991) · JAMA · doi:10.1001/jama.1991.03470200059035 · Cited by 643
Physicians' Decisions to Override Computerized Drug Alerts in Primary Care
Weingart, S. N., Toth, M., Sands, D. Z., Aronson, M. D., Davis, R. B., & Phillips, R. S. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.21.2625 · Cited by 487
The Regenstrief Medical Record System: a quarter century experience
McDonald, C. J., Overhage, J. M., Tierney, W. M., Dexter, P. R., Martin, D., Suico, J. G., Zafar, A., Schadow, G., Blevins, L., Glazener, T. T., et al. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00009-x · Cited by 395
High Rates of Adverse Drug Events in a Highly Computerized Hospital
(2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.10.1111 · Cited by 363
Improving Outcomes with Clinical Decision Support : An Implementer's Guide
Osheroff, J. A., Teich, J. M., Levick, D., Saldana, L., Velasco, F. T., Sittig, D. F., Rogers, K. M., & Jenders, R. A. (2012) · Cited by 297
Self-citationMassaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00003 · Cited by 287
Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study
Scott, J. T., Rundall, T. G., Vogt, T. M., & Hsu, J. (2005) · BMJ · doi:10.1136/bmj.38638.497477.68 · Cited by 266
Implementation of Physician Order Entry: User Satisfaction and Self-Reported usage Patterns
Lee, F., Teich, J. M., Spurr, C. D., & Bates, D. W. (1996) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1996.96342648 · Cited by 261
Implementing computerized physician order entry: the importance of special people
Ash, J. S. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00107-7 · Cited by 183
Self-citationLessons from a failed information systems initiative: issues for complex organisations☆
Southon, G., SAUER, C., & Dampney, K. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00018-0 · Cited by 157
Upperman, J. S., Staley, P., Friend, K., Neches, W. H., Kazimer, D., Benes, J., & Wiener, E. S. (2005) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2004.09.024 · Cited by 121
Computerized physician order entry and quality of care
Bates, D. W., Kuperman, G. J., & Teich, J. M. (1994) · Quality Management in Health Care · doi:10.1097/00019514-199402040-00005 · Cited by 112
Payne, T. H. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1090 · Cited by 107
Impact of computerized physician order entry on physician time.
Bates, D. W., Boyle, D. L., & Teich, J. M. (1994) · PubMed · Cited by 92
Sociotechnical Requirements Analysis for Clinical Systems
Pratt, W., Dourish, P., Shabot, M. M., & Reddy, M. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634346 · Cited by 91
Self-citationEmotional Aspects of Computer-based Provider Order Entry: A Qualitative Study
Sittig, D. F. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1711 · Cited by 87
Self-citationComputerized surveillance of adverse drug events in hospital patients
Classen, D. C. (1991) · JAMA · doi:10.1001/jama.266.20.2847 · Cited by 83
Ali, N. A., Mekhjian, H. S., Kuehn, P. L., Bentley, T. D., Kumar, R., Ferketich, A. K., & Hoffmann, S. P. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000150266.58668.f9 · Cited by 66
Wireless Technology Improves Nursing Workflow and Communications
BRESLIN, S., GRESKOVICH, W., & Turisco, F. (2004) · CIN Computers Informatics Nursing · doi:10.1097/00024665-200409000-00007 · Cited by 63
Termination of a Contract to Implement an Enterprise Electronic Medical Record System
Goddard, B. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070564 · Cited by 52
Life After a Disastrous Electronic Medical Record Implementation
Wagner, K. A., Lee, F. W., & White, A. W. (2011) · Cases on information technology series · doi:10.4018/978-1-61520-592-9.ch011 · Cited by 19
Research works printed but not linked: 2
- Santayana G. Life of Reason: Reason in Common Sense. New York, NY: Scribner's; 1905:284
- CPOE improves patient safety at top-ranked pediatric hospital [press release]. December 2, 2005. Available at: www.cerner.com/public/NewsReleases_1a.asp?id=257&cid=4668. Accessed June 14, 2006
Cited by
Sorted by citations
Sittig, D. F., & Singh, H. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2010.042085 · Cited by 897
Self-citationWolfstadt, J. I., Gurwitz, J. H., Field, T. S., Lee, M. M., Kalkar, S. R., Wu, W., & Rochon, P. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0504-5 · Cited by 388
Electronic health records and national patient-safety goals
Sittig, D. F., & Singh, H. (2012) · New England Journal of Medicine · doi:10.1056/nejmsb1205420 · Cited by 204
Self-citationAhmed, A., Chandra, S., Herasevich, V., Gajic, O., & Pickering, B. W. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31821858a0 · Cited by 198
Magrabi, F., Ong, M.-S., Runciman, W., & Coiera, E. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002444 · Cited by 162
Metadata
- Authors
- Sittig, D. F., Ash, J. S., Zhang, J., Osheroff, J. A., & Shabot, M. M.
- Affiliations
- Kaiser Permanente (US)
- Oregon Health & Science University (US)
- The University of Texas Health Science Center at Houston (US)
- University of Pennsylvania (US)
- Cedars-Sinai Medical Center (US)
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2006-08-01
- Volume
- 118
- Issue
- 2
- Pages
- 797-801
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2090144979
- Cited by
- 130
- References
- 24
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 3 · 2021: 4 · 2020: 2 · 2019: 4 · 2017: 1 · 2016: 5 · 2015: 9 · 2014: 10 · 2013: 15 · 2012: 11
- FWCI
- 20.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Keywords
- computerized physician order entry, CPOE implementation, clinical information systems, patient mortality, implementation failure, organizational factors, patient safety
- MeSH terms
- Child, Preschool, Female, Patient Care, Humans, Infant, Infant Mortality, Male, Causality, Child Mortality, Medical Order Entry Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review