The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Lessons From “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System”
Abstract
We are writing in response to the article “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System” by Han et al.1 The authors are to be congratulated for their courage in bringing their compelling account of computerized physician order entry (CPOE) implementation problems to the medical literature as they tried to interpret their results concerning mortality. Their article is as much a search for answers as it is a recitation of the shortfalls in their implementation process and computer systems. It is critically important to understand that the types of problems described by Han et al are not limited to their institution. In fact, setbacks and failures in the implementation of clinical information systems (CISs) and CPOE systems are all too common (eg, see refs 2–4). Although it is tempting to focus solely on the role of new technology in the problems highlighted by this example, there are also important lessons to be learned about related organizational and workflow factors that affect the potential for danger associated with CPOE implementation. There are many previous publications about troubled or failed implementations. The account by Han et al is unique in that an adverse change in mortality rate was associated in time with CIS and CPOE implementation. We may question the study's methodology and conclude that causality was not proven, yet the assignment of CPOE to a severity-adjusted odds ratio of 3.71 for patient death simply cannot be ignored. Regardless of what was or was not proven, if only one unnecessary death were caused by the implementation process or CIS and CPOE modules, that is one too many. The question that must be asked is how can intelligent and well-intentioned leaders at all levels of an institution make the kind of implementation … Address correspondence to Dean F. Sittig, PhD, Kaiser Permanente Center for Health Research, 3800 N Interstate Ave, Portland, OR 97227. E-mail: dean.f.sittig{at}kp.org
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A systematic review of outpatient CPOE systems found only four studies that addressed safety and concluded, “the relatively small number of evaluation studies published to date do not provide adequate evidence that CPOE systems enhance safety and reduce cost in the outpatient settings.”28”
From EHR Safety: The Way Forward to Safe and Effective Systems (2008) · cites this paper as [28]
Citations
Cites
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Self-citationHan, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149
Poissant, L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1700 · Cited by 901
Computerized Surveillance of Adverse Drug Events in Hospital Patients
Classen, D. C. (1991) · JAMA · doi:10.1001/jama.1991.03470200059035 · Cited by 643
Physicians' Decisions to Override Computerized Drug Alerts in Primary Care
Weingart, S. N., Toth, M., Sands, D. Z., Aronson, M. D., Davis, R. B., & Phillips, R. S. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.21.2625 · Cited by 487
The Regenstrief Medical Record System: a quarter century experience
McDonald, C. J., Overhage, J. M., Tierney, W. M., Dexter, P. R., Martin, D., Suico, J. G., Zafar, A., Schadow, G., Blevins, L., Glazener, T. T., et al. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00009-x · Cited by 395
High Rates of Adverse Drug Events in a Highly Computerized Hospital
(2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.10.1111 · Cited by 363
Improving Outcomes with Clinical Decision Support : An Implementer's Guide
Osheroff, J. A., Teich, J. M., Levick, D., Saldana, L., Velasco, F. T., Sittig, D. F., Rogers, K. M., & Jenders, R. A. (2012) · Cited by 297
Self-citationMassaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00003 · Cited by 287
Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study
Scott, J. T., Rundall, T. G., Vogt, T. M., & Hsu, J. (2005) · BMJ · doi:10.1136/bmj.38638.497477.68 · Cited by 266
Flagged first, then by citations
Research works printed but not linked: 2
- Santayana G. Life of Reason: Reason in Common Sense. New York, NY: Scribner's; 1905:284
- CPOE improves patient safety at top-ranked pediatric hospital [press release]. December 2, 2005. Available at: www.cerner.com/public/NewsReleases_1a.asp?id=257&cid=4668. Accessed June 14, 2006
Cited by
Sorted by citations
Items 101–130 of 130
de Lyra, D. P., Siqueira, J. D. S., da Silva, D. T., Almeida, L. B., da Silva, W. B., Sousa, P. J. D. S., & Guerreiro, M. P. (2010) · Revista Portuguesa de Saúde Pública · Cited by 2
de Muga, M. V., Saracho, A. A., Rodríguez, C. B., & Cubells, C. L. (2011) · Anales de Pediatría · doi:10.1016/j.anpedi.2011.10.013 · Cited by 2
Pickering, B. W., Litell, J. M., & Gajic, O. (2011) · Annual update in intensive care and emergency medicine · doi:10.1007/978-3-642-18081-1_69 · Cited by 2
Stehlik, P., Bahmanpour, A., Şekercioğlu, Y. A., Darzins, P. J., & Marriott, J. (2015) · Monash University Research Portal (Monash University) · Cited by 1
Ambulatory Computerized Provider Order Entry (ACPOE or E-Prescribing)
Johnson, K. B., & Weigle, C. G. M. (2009) · Computers in health care · doi:10.1007/978-0-387-76446-7_19 · Cited by 1
Neonatal Informatics—Dream of a Paperless NICU
Drummond, W. H. (2009) · NeoReviews · doi:10.1542/neo.10-11-e527 · Cited by 1
Thinking Together: Modeling Clinical Decision-Support as a Sociotechnical System.
Hussain, M., Reynolds, T. L., Mousavi, F. E., Chen, Y., & Zheng, K. (2017) · PubMed Central · Cited by 1
CONCEPTUAL FOUNDATION OF SAFER GUIDES
Sittig, D. F., & Singh, H. (2015) · Apple Academic Press eBooks · doi:10.1201/b18371-5 · Cited by 1
Self-citationAvoiding Adverse Consequences of E-Health
O’Hanlon, S. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-2657-7.ch002 · Cited by 1
Fraenkel, D. J. (2014) · Elsevier eBooks · doi:10.1016/b978-0-7020-4762-6.00009-6 · Cited by 1
Embedding a Simulation-Based Education Program in a Teaching Hospital
Szabo, R. A., & Forrest, K. (2023) · Springer eBooks · doi:10.1007/978-981-15-3344-0_69 · Cited by 1
Computerized physician order entry: Friend or foe?*
Hazelzet, J. A. (2007) · Pediatric Critical Care Medicine · doi:10.1097/01.pcc.0000262885.52560.b9 · Cited by 1
Kiess, C. (2013) · IUScholarWorks (Indiana University) · doi:10.7912/c2/927 · Cited by 1
Process Mining of Medication Revisions in Electronic Health Records
Rogith, D. (2015) · Digital Commons-TMC (Texas Medical Center) · Cited by 1
DOES THE MESSAGE MATTER? ENHANCING PATIENT ADHERENCE THROUGH PERSUASIVE MESSAGES
Walji, M. F. (2006) · Digital Commons-TMC (Texas Medical Center)
What Correctional Practitioners Want in an Electronic Health Record
Paris, J. E. (2013) · Journal of Correctional Health Care · doi:10.1177/1078345813486322
Reinventing the pediatric medication preference list
Stultz, J. M. (2014) · doi:10.6083/m40z721d
THE CONTEXT OF EHR SAFETY AND THE NEED FOR RISK ASSESSMENT
Sittig, D. F., Singh, H., Menon, S., Meyer, A. N. D., & Belmont, E. (2015) · Apple Academic Press eBooks · doi:10.1201/b18371-2
Self-citationCognitive Considerations for Health Information
Franklin, A., & Zhang, J. (2014)
Self-citationHerasevich, V., Dziadzko, M. A., & Pickering, B. W. (2019) · Springer eBooks · doi:10.1007/978-3-662-59307-3_8
Embedding a Simulation-Based Education Program in a Teaching Hospital
Szabo, R. A., & Forrest, K. (2021) · Springer eBooks · doi:10.1007/978-981-13-6106-7_69-1
Fraenkel, D. J. (2009) · Elsevier eBooks · doi:10.1016/b978-0-7020-3096-3.00009-9
Eight Rights of Safe Electronic Health Record Use
Singh, H. (2013) · Apple Academic Press eBooks · doi:10.1201/b16306-3
Cognitive considerations for health information technology in clinical team environments
Franklin, A., & Zhang, J. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91200-6.00024-3
Self-citationRobertson, S. T., Rosbergen, I. C. M., Burton‐Jones, A., Grimley, R., & Brauer, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4881971
Expanding the Characterization of Collaborative Workflow and Health IT
Wong, N., Kuziemsky, C. E., Abraham, J., Nambiar, K., & Reddy, M. C. (2025) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-82971-0_8
Using Human Factors and Systems Simulation to Optimize the Usability of a Code Documentation Tool
Biesbroek, S., Dubé, M. M., Arnold, J., Chan-MacRae, M., Kats, D. J., Coogle, L., Swenson, M., & Hron, J. D. (2026) · Pediatric Emergency Care · doi:10.1097/pec.0000000000003558
Conti, G. R., Bellini, M., & Lombardo, P. (2021) · Annals of Pharmacy Education Safety and Public Health Advocacy · doi:10.51847/v0a9dvru6o
L’intelligence artificielle en santé au prisme de ses enjeux éthiques
Pardoux, É. (2026) · Revue Francophone des Laboratoires · doi:10.1016/s1773-035x(26)76602-8
Metadata
- Authors
- Sittig, D. F., Ash, J. S., Zhang, J., Osheroff, J. A., & Shabot, M. M.
- Affiliations
- Kaiser Permanente (US)
- Oregon Health & Science University (US)
- The University of Texas Health Science Center at Houston (US)
- University of Pennsylvania (US)
- Cedars-Sinai Medical Center (US)
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2006-08-01
- Volume
- 118
- Issue
- 2
- Pages
- 797-801
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2090144979
- Cited by
- 130
- References
- 24
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 3 · 2021: 4 · 2020: 2 · 2019: 4 · 2017: 1 · 2016: 5 · 2015: 9 · 2014: 10 · 2013: 15 · 2012: 11
- FWCI
- 20.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Keywords
- computerized physician order entry, CPOE implementation, clinical information systems, patient mortality, implementation failure, organizational factors, patient safety
- MeSH terms
- Child, Preschool, Female, Patient Care, Humans, Infant, Infant Mortality, Male, Causality, Child Mortality, Medical Order Entry Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review