Perceived Increase in Mortality After Process and Policy Changes Implemented With Computerized Physician Order Entry
Abstract
To the Editor .— Han et al1 describe a retrospective study in which the mortality rate for interfacility transfers into an ICU was compared before and after implementation of a computerized provider order entry (CPOE) system. The authors found that the mortality rate increased from 2.8% (30 deaths of 1394 patient transfers during 13 months) before CPOE implementation to 6.6% (36 deaths of 548 transfers during 5 months) after. The authors conclude that the increased mortality was associated directly with modifications in standard clinical processes, including the following changes: (1) not allowing order communication until the patient was physically present and registered in the admitting system; (2) relocating medication dispensing to a central (rather than a satellite) pharmacy; (3) increasing the physical separation of nursing and physician staff during the time that orders were generated; (4) implementing computerized order entry; and (5) system-wide provider role changes to support the CPOE system. Perhaps the most important lesson from this study is that there exists an intimate association between care-delivery processes and health information technology. Any shift in the methods used to manage patient care (such as implementing and using a CPOE system) is associated with significant changes in clinical workflows, communication among providers, and distribution of responsibilities.2–4 Decades of research in medical informatics have underscored the importance of this observation, a message that was not lost on the authors. In this study, they note that the increased unadjusted mortality may reflect problems with the process of change, including the extremely rapid implementation plan adopted by their organization. The authors describe other major changes in workflow and patient care processes that occurred coincident with the CPOE system implementation. For example, their …
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Chaudhry et al.'s systematic review concluded that in most settings it is hard to know what benefits to expect from health information technology and how to implement it for maximum value.
“A more recent systematic review of health care information technology (largely EHRs) by Chaudhry et al. concluded that in most health care settings, it may be difficult “to determine what benefits to expect from health information technology use and how best to implement the system in order to maximize the value derived.”27”
From EHR Safety: The Way Forward to Safe and Effective Systems (2008) · cites this paper as [27]
Cites
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,174 · see citing works
Regression Modeling Strategies
Harrell, F. E. (2001) · Springer series in statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,270 · see citing works
Self-citationRole of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126 · see citing works
To Err is Human: Building a Safer Health System in 1999.
Stefl, M. E. (2001) · PubMed · Cited by 1,751 · see citing works
Bates, D. W., Kuperman, G. J., Wang, S., Gandhi, T., Kittler, A., Volk, L., Spurr, C., Khorasani, R., Tanasijevic, M., & Middleton, B. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1370 · Cited by 1,346 · see citing works
The Impact of Computerized Physician Order Entry on Medication Error Prevention
Bates, D. W., Teich, J. M., Lee, J., Seger, D., Kuperman, G. J., Ma'Luf, N., Boyle, D., & Leape, L. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.00660313 · Cited by 1,260 · see citing works
Han, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149 · see citing works
Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis
Sun, G.-W., Shook, T. L., & Kay, G. L. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00025-x · Cited by 933 · see citing works
Institute of Medicine (2004) · National Academies Press eBooks · doi:10.17226/10863 · Cited by 510 · see citing works
Computer Physician Order Entry: Benefits, Costs, and Issues
Kuperman, G. J., & Gibson, R. F. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-139-1-200307010-00010 · Cited by 438 · see citing works
Computerized Physician Order Entry and Medication Errors in a Pediatric Critical Care Unit
Potts, A. L., Barr, F. E., Gregory, D. F., Wright, L., & Patel, N. R. (2004) · Pediatrics · doi:10.1542/peds.113.1.59 · Cited by 410 · see citing works
Computer-based Physician Order Entry: The State of the Art
Sittig, D. F., & Stead, W. W. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236142 · Cited by 273 · see citing works
A Consensus Statement on Considerations for a Successful CPOE Implementation
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1204 · Cited by 239 · see citing works
Computerized Physician Order Entry: Helpful or Harmful?
Berger, R. G. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1411 · Cited by 223 · see citing works
Impact of Computerized Physician Order Entry on Clinical Practice in a Newborn Intensive Care Unit
Cordero, L., Kuehn, L., Kumar, R. R., & Mekhjian, H. S. (2004) · Journal of Perinatology · doi:10.1038/sj.jp.7211000 · Cited by 204 · see citing works
When Should Epidemiologic Regressions Use Random Coefficients?
Greenland, S. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00915.x · Cited by 161 · see citing works
Lorenzi, N. M. (2002) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00105-3 · Cited by 150 · see citing works
Upperman, J. S., Staley, P., Friend, K., Neches, W. H., Kazimer, D., Benes, J., & Wiener, E. S. (2005) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2004.09.024 · Cited by 121 · see citing works
Ahmad, A., Teater, P., Bentley, T. D., Kuehn, L., Kumar, R. R., Thomas, A., & Mekhjian, H. S. (2002) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2002.0090016 · Cited by 94 · see citing works
Patient Safety: Achieving a New Standard for Care
Aspden, P., Corrigan, J. M., Wolcott, J., & and Erickson, S. M. (2004) · Cited by 93 · see citing works
Barriers That Impede the Adoption of Pediatric Information Technology
Johnson, K. B. (2001) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.155.12.1374 · Cited by 66 · see citing works
Self-citationUnderstanding Hospital Readiness for Computerized Physician Order Entry
Stablein, D., Welebob, E. M., Johnson, E. M., Metzger, J. B., Burgess, R. J., & Classen, D. C. (2003) · The Joint Commission Journal on Quality and Safety · doi:10.1016/s1549-3741(03)29041-9 · Cited by 47 · see citing works
These Are the Technologies That Try Men's Souls: Common-Sense Health Information Technology
Gesteland, P. H., Nebeker, J. R., & Gardner, R. M. (2005) · PEDIATRICS · doi:10.1542/peds.2005-2508 · Cited by 41 · see citing works
Computerized physician order entry: challenges and opportunities
Shane, R. R. (2002) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/59.3.286 · Cited by 39 · see citing works
Utilization of evidence-based computerized order sets in pediatrics
McAlearney, A. S., Chisolm, D. J., Veneris, S., Rich, D. L., & Kelleher, K. J. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.07.040 · Cited by 39 · see citing works
Stukenborg, G. J., Wagner, D. P., Harrell, F. E., Oliver, M. N., Kilbridge, K. L., Lyman, J. A., Einbinder, J. S., & Connors, A. F. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.10.002 · Cited by 20 · see citing works
Self-citationPeople and Organizational Issues in Health Informatics
Braude, R. M. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040150 · Cited by 16 · see citing works
An Analysis of Patient Care Questions Asked by Pediatricians at an Academic Medical Center
D’Alessandro, D. M., Kreiter, C. D., Peterson, M. W., Kingsley, P., & Johnson-West, J. (2004) · Ambulatory Pediatrics · doi:10.1367/1539-4409(2004)004 · Cited by 14 · see citing works
Self-citationKnowledge and change in health care organizations.
Lorenzi, N. M., & Riley, R. T. (2000) · PubMed · Cited by 5 · see citing works
D’Agostino (1998) · doi:10.1002/(sici)1097-0258(19981015)17:19
Flagged first, then by citations
Cited by
Sorted by citations
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691 · see citing works
LUDWICK, D., & DOUCETTE, J. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.06.005 · Cited by 668 · see citing works
“These concepts contend that there is a relationship [30,32,33] between the tools that facilitate the health care processes and the interpersonal interactions needed to carry out the day-today clinical tasks of a care facility [31].”
BackgroundWolfstadt, J. I., Gurwitz, J. H., Field, T. S., Lee, M. M., Kalkar, S. R., Wu, W., & Rochon, P. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0504-5 · Cited by 384 · see citing works
Clinical decision support systems
Beeler, P. E., Bates, D. W., & Hug, B. L. (2014) · Swiss Medical Weekly · doi:10.4414/smw.2014.14073 · Cited by 157 · see citing works
Longhurst, C., Parast, L. M., Sandborg, C. I., Widen, E., Sullivan, J., Hahn, J. S., Dawes, C. G., & Sharek, P. J. (2010) · PEDIATRICS · doi:10.1542/peds.2009-3271 · Cited by 130 · see citing works
EHR Safety: The Way Forward to Safe and Effective Systems
Walker, J. M., Carayon, P., Leveson, N., Paulus, R. A., Tooker, J., Chin, H., Bothe, A., & Stewart, W. F. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2618 · Cited by 113 · see citing works
The unintended consequences of health information technology revisited
Ash, J., Berg, M., & Coiera, E. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-014 · Cited by 101 · see citing works
Ludwick, D. A., & Doucette, J. (2008) · International Journal of Telemedicine and Applications · doi:10.1155/2009/853524 · Cited by 93 · see citing works
Clinical decision support systems in the pediatric intensive care unit*
Mack, E. H., Wheeler, D. S., & Embi, P. J. (2009) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0b013e3181936b23 · Cited by 76 · see citing works
Cresswell, K. M., Bates, D. W., Williams, R., Morrison, Z., Slee, A., Coleman, J. J., Robertson, A. R. R., Sheikh, A., Avery, A. J., Blake, L., et al. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002252 · Cited by 76 · see citing works
“(50-54) Nevertheless, empirical evidence also suggests that CPOE and CDS systems can positively impact on patient outcomes and commercial systems can result in time-savings for healthcare professionals in the medium-term .”
The Incidence of Adverse Events and Medical Error in Pediatrics
Sharek, P. J., & Classen, D. C. (2006) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2006.09.011 · Cited by 74 · see citing works
An ED scribe program is able to improve throughput time and patient satisfaction
Bastani, A., Shaqiri, B., Palomba, K., Bananno, D., & Anderson, W. C. (2014) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2013.03.040 · Cited by 73 · see citing works
The Health Information Technology Workforce
Hersh, W. (2010) · Applied Clinical Informatics · doi:10.4338/aci-2009-11-r-0011 · Cited by 71 · see citing works
Abraham, J., Novak, L. L., Reynolds, T. L., Gettinger, A., & Zheng, K. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-036 · Cited by 59 · see citing works
Ludwick, D., Manca, D. P., & Doucette, J. (2010) · PubMed Central · Cited by 42 · see citing works
Hersh, W. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638595 · Cited by 39 · see citing works
Computerized Provider Order Entry and Patient Safety
Abramson, E. L., & Kaushal, R. (2012) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2012.08.001 · Cited by 38 · see citing works
Rethinking Electronic Health Records to Better Achieve Quality and Safety Goals
Stead, W. W. (2006) · Annual Review of Medicine · doi:10.1146/annurev.med.58.061705.144942 · Cited by 36 · see citing works
LAB-IN-A-BOX: semi-automatic tracking of activity in the medical office
Weibel, N., Rick, S., Emmenegger, C., Ashfaq, S., Calvitti, A., & Agha, Z. (2014) · Personal and Ubiquitous Computing · doi:10.1007/s00779-014-0821-0 · Cited by 35 · see citing works
Interventions to reduce medication prescribing errors in a paediatric cardiac intensive care unit
Burmester, M., Dionne, R. E., Thiagarajan, R. R., & Laussen, P. C. (2008) · Intensive Care Medicine · doi:10.1007/s00134-008-1054-3 · Cited by 28 · see citing works
Jones, S. S., Heaton, P., Friedberg, M. W., & Schneider, E. C. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0245 · Cited by 23 · see citing works
Jacobs, B. R. (2007) · Pediatric Critical Care Medicine · doi:10.1097/01.pcc.0000257484.86356.39 · Cited by 22 · see citing works
Computer-Related Medication Errors in Neonatal Intensive Care Units
Chuo, J., & Hicks, R. W. (2008) · Clinics in Perinatology · doi:10.1016/j.clp.2007.11.005 · Cited by 20 · see citing works
Weibel, N., Emmenegger, C., Lyons, J., Dixit, R., Hill, L. L., & Hollan, J. D. (2013) · Proceedings of the ICTs for improving Patients Rehabilitation Research Techniques · doi:10.4108/icst.pervasivehealth.2013.252026 · Cited by 17 · see citing works
Capture and classification of problems during CPOE deployment in an academic pediatric center.
Kim, G. R., Miller, M. R., Ardolino, M., Smith, J. E., Lee, D. C., & Lehmann, C. U. (2007) · PubMed Central · Cited by 16 · see citing works
Self-citationImplementing an Electronic Medical Record
Friedman, L. N., Halpern, N. A., & Fackler, J. C. (2007) · Critical Care Clinics · doi:10.1016/j.ccc.2007.05.001 · Cited by 13 · see citing works
Topics in Neonatal Informatics
Palma, J. P., Sharek, P. J., Classen, D. C., & Longhurst, C. (2011) · NeoReviews · doi:10.1542/neo.12-7-e393 · Cited by 10 · see citing works
Interactive Sociotechnical Analysis
Harrison, M. I., & Koppel, R. (2010) · IGI Global eBooks · doi:10.4018/978-1-60566-030-1.ch003 · Cited by 7 · see citing works
“…undesired consequences of implementation (Aarts, Ash, & Berg, 2007; Ash, Berg, & Coiera, 2004; Campbell, Sittig, Ash, Guappone, & Dykstra, 2006; Han et al., 2005; Koppel et al., 2005; Rosenbloom et al., 2006; Schneider & Schneider, 2006; Silverstein, 2006; Wachter, 2004, 2006; Wears & Berg, 2005).”
Stead, W. W. (2009) · Information Knowledge Systems Management · doi:10.3233/iks-2009-0140 · Cited by 5 · see citing works
Reducing Mortality Related to Adverse Events in Children
Shin, A. Y., Longhurst, C., & Sharek, P. J. (2012) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2012.09.002 · Cited by 5 · see citing works
Ludwick, D. (2009) · ElectronicHealthcare · Cited by 4 · see citing works
Deshpande, G. G., Torres, A., Buchanan, D. L., Gray, S. C. S., Brown, S. C., Hoadley, T. A., Ruppel, P. L., & Tobias, J. D. (2010) · The Journal of Pediatric Pharmacology and Therapeutics · doi:10.5863/1551-6776-15.4.274 · Cited by 2 · see citing works
Weibel, N., Emmenegger, C., Lyons, J., Dixit, R., Hill, L. L., & Hollan, J. D. (2013) · Proceedings of the ICTs for improving Patients Rehabilitation Research Techniques · doi:10.4108/pervasivehealth.2013.252026 · Cited by 2 · see citing works
The Pharmacoepidemiology of Medication Errors
Seidling, H. M., & Bates, D. W. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch41 · Cited by 2 · see citing works
Ambulatory Computerized Provider Order Entry (ACPOE or E-Prescribing)
Johnson, K. B., & Weigle, C. G. M. (2009) · Computers in health care · doi:10.1007/978-0-387-76446-7_19 · Cited by 1 · see citing works
Self-citationSynthesis of informatics literature to support institutional policy statement development
Koonce, T. Y., Sathe, N. A., Giuse, D. A., & Jirjis, J. N. (2008) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.96.1.3 · Cited by 1 · see citing works
The Pharmacoepidemiology of Medication Errors
Seidling, H. M., & Bates, D. W. (2012) · Pharmacoepidemiology · doi:10.1002/9781119959946.ch45
- Authors
- Rosenbloom, S. T., Harrell, F. E., Lehmann, C. U., Schneider, J. H., Spooner, S. A., & Johnson, K. B.
- Affiliations
- Vanderbilt University (US)
- Johns Hopkins University (US)
- Children's Medical Center (US)
- University of Tennessee Health Science Center (US)
- ORCID
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2006-04-01
- Volume
- 117
- Issue
- 4
- Pages
- 1452-1455
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2002306154
- Cited by
- 38
- References
- 30
- Citations by year
- 2019: 1 · 2016: 2 · 2014: 4 · 2013: 2 · 2012: 3
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. National Library of Medicine (K22LM008576)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Emergency Medicine › Hospital Admissions and Outcomes
- Health Sciences › Health Professions › Emergency Medical Services › Patient Safety and Medication Errors
- Keywords
- computerized physician order entry, mortality increase, interfacility transfer, intensive care unit, health information technology implementation, medication dispensing, provider communication, change processes
- MeSH terms
- Child, Hospital Information Systems, Humans, Outcome and Process Assessment, Health Care, Patient Transfer, Hospital Mortality, Child Mortality, Medical Order Entry Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review