Lessons From “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System”
Abstract
We are writing in response to the article “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System” by Han et al.1 The authors are to be congratulated for their courage in bringing their compelling account of computerized physician order entry (CPOE) implementation problems to the medical literature as they tried to interpret their results concerning mortality. Their article is as much a search for answers as it is a recitation of the shortfalls in their implementation process and computer systems. It is critically important to understand that the types of problems described by Han et al are not limited to their institution. In fact, setbacks and failures in the implementation of clinical information systems (CISs) and CPOE systems are all too common (eg, see refs 2–4). Although it is tempting to focus solely on the role of new technology in the problems highlighted by this example, there are also important lessons to be learned about related organizational and workflow factors that affect the potential for danger associated with CPOE implementation. There are many previous publications about troubled or failed implementations. The account by Han et al is unique in that an adverse change in mortality rate was associated in time with CIS and CPOE implementation. We may question the study's methodology and conclude that causality was not proven, yet the assignment of CPOE to a severity-adjusted odds ratio of 3.71 for patient death simply cannot be ignored. Regardless of what was or was not proven, if only one unnecessary death were caused by the implementation process or CIS and CPOE modules, that is one too many. The question that must be asked is how can intelligent and well-intentioned leaders at all levels of an institution make the kind of implementation … Address correspondence to Dean F. Sittig, PhD, Kaiser Permanente Center for Health Research, 3800 N Interstate Ave, Portland, OR 97227. E-mail: dean.f.sittig{at}kp.org
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A systematic review of outpatient CPOE found only four safety studies and concluded there is inadequate evidence that CPOE improves safety or reduces cost in outpatient settings.
“A systematic review of outpatient CPOE systems found only four studies that addressed safety and concluded, “the relatively small number of evaluation studies published to date do not provide adequate evidence that CPOE systems enhance safety and reduce cost in the outpatient settings.”28”
From EHR Safety: The Way Forward to Safe and Effective Systems (2008) · cites this paper as [28]
Cites
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789 · see citing works
Self-citationHan, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149 · see citing works
Poissant, L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1700 · Cited by 901 · see citing works
Computerized Surveillance of Adverse Drug Events in Hospital Patients
Classen, D. C. (1991) · JAMA · doi:10.1001/jama.1991.03470200059035 · Cited by 643 · see citing works
Physicians' Decisions to Override Computerized Drug Alerts in Primary Care
Weingart, S. N., Toth, M., Sands, D. Z., Aronson, M. D., Davis, R. B., & Phillips, R. S. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.21.2625 · Cited by 487 · see citing works
The Regenstrief Medical Record System: a quarter century experience
McDonald, C. J., Overhage, J. M., Tierney, W. M., Dexter, P. R., Martin, D., Suico, J. G., Zafar, A., Schadow, G., Blevins, L., Glazener, T. T., et al. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00009-x · Cited by 395 · see citing works
High Rates of Adverse Drug Events in a Highly Computerized Hospital
(2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.10.1111 · Cited by 363 · see citing works
Improving Outcomes with Clinical Decision Support : An Implementer's Guide
Osheroff, J. A., Teich, J. M., Levick, D., Saldana, L., Velasco, F. T., Sittig, D. F., Rogers, K. M., & Jenders, R. A. (2012) · Cited by 297 · see citing works
Self-citationMassaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00003 · Cited by 287 · see citing works
Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study
Scott, J. T., Rundall, T. G., Vogt, T. M., & Hsu, J. (2005) · BMJ · doi:10.1136/bmj.38638.497477.68 · Cited by 266 · see citing works
Implementation of Physician Order Entry: User Satisfaction and Self-Reported usage Patterns
Lee, F., Teich, J. M., Spurr, C. D., & Bates, D. W. (1996) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1996.96342648 · Cited by 261 · see citing works
Implementing computerized physician order entry: the importance of special people
Ash, J. S. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00107-7 · Cited by 183 · see citing works
Self-citationLessons from a failed information systems initiative: issues for complex organisations☆
Southon, G., SAUER, C., & Dampney, K. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00018-0 · Cited by 157 · see citing works
Upperman, J. S., Staley, P., Friend, K., Neches, W. H., Kazimer, D., Benes, J., & Wiener, E. S. (2005) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2004.09.024 · Cited by 121 · see citing works
Computerized physician order entry and quality of care
Bates, D. W., Kuperman, G. J., & Teich, J. M. (1994) · Quality Management in Health Care · doi:10.1097/00019514-199402040-00005 · Cited by 112 · see citing works
Payne, T. H. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1090 · Cited by 107 · see citing works
Impact of computerized physician order entry on physician time.
Bates, D. W., Boyle, D. L., & Teich, J. M. (1994) · PubMed · Cited by 92 · see citing works
Sociotechnical Requirements Analysis for Clinical Systems
Pratt, W., Dourish, P., Shabot, M. M., & Reddy, M. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634346 · Cited by 91 · see citing works
Self-citationEmotional Aspects of Computer-based Provider Order Entry: A Qualitative Study
Sittig, D. F. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1711 · Cited by 87 · see citing works
Self-citationComputerized surveillance of adverse drug events in hospital patients
Classen, D. C. (1991) · JAMA · doi:10.1001/jama.266.20.2847 · Cited by 83 · see citing works
Ali, N. A., Mekhjian, H. S., Kuehn, P. L., Bentley, T. D., Kumar, R., Ferketich, A. K., & Hoffmann, S. P. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000150266.58668.f9 · Cited by 66 · see citing works
Wireless Technology Improves Nursing Workflow and Communications
BRESLIN, S., GRESKOVICH, W., & Turisco, F. (2004) · CIN Computers Informatics Nursing · doi:10.1097/00024665-200409000-00007 · Cited by 63 · see citing works
Termination of a Contract to Implement an Enterprise Electronic Medical Record System
Goddard, B. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070564 · Cited by 52 · see citing works
Life After a Disastrous Electronic Medical Record Implementation
Wagner, K. A., Lee, F. W., & White, A. W. (2011) · Cases on information technology series · doi:10.4018/978-1-61520-592-9.ch011 · Cited by 19 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Sittig, D. F., & Singh, H. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2010.042085 · Cited by 897 · see citing works
Self-citationWolfstadt, J. I., Gurwitz, J. H., Field, T. S., Lee, M. M., Kalkar, S. R., Wu, W., & Rochon, P. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0504-5 · Cited by 384 · see citing works
Electronic health records and national patient-safety goals
Sittig, D. F., & Singh, H. (2012) · New England Journal of Medicine · doi:10.1056/nejmsb1205420 · Cited by 204 · see citing works
Self-citationAhmed, A., Chandra, S., Herasevich, V., Gajic, O., & Pickering, B. W. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31821858a0 · Cited by 198 · see citing works
Magrabi, F., Ong, M.-S., Runciman, W., & Coiera, E. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002444 · Cited by 162 · see citing works
Clinical decision support systems
Beeler, P. E., Bates, D. W., & Hug, B. L. (2014) · Swiss Medical Weekly · doi:10.4414/smw.2014.14073 · Cited by 157 · see citing works
Longhurst, C., Parast, L. M., Sandborg, C. I., Widen, E., Sullivan, J., Hahn, J. S., Dawes, C. G., & Sharek, P. J. (2010) · PEDIATRICS · doi:10.1542/peds.2009-3271 · Cited by 130 · see citing works
Furukawa, M. F., Raghu, T. S., & Shao, B. B. M. (2010) · Health Services Research · doi:10.1111/j.1475-6773.2010.01110.x · Cited by 122 · see citing works
EHR Safety: The Way Forward to Safe and Effective Systems
Walker, J. M., Carayon, P., Leveson, N., Paulus, R. A., Tooker, J., Chin, H., Bothe, A., & Stewart, W. F. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2618 · Cited by 113 · see citing works
Sutherland, S. M., Chawla, L. S., Kane-Gill, S. L., Hsu, R. K., Kramer, A. A., Goldstein, S. L., Kellum, J. A., Ronco, C., Bagshaw, S. M., & on behalf of the 15 ADQI Consensus Group (2016) · Canadian Journal of Kidney Health and Disease · doi:10.1186/s40697-016-0099-4 · Cited by 115 · see citing works
Swinglehurst, D., Greenhalgh, T., Russell, J., & Myall, M. (2011) · BMJ · doi:10.1136/bmj.d6788 · Cited by 109 · see citing works
Unertl, K. M., Novak, L. L., Johnson, K. B., & Lorenzi, N. M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.004333 · Cited by 107 · see citing works
Coiera, E. W., Aarts, J., & Kulikowski, C. A. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000674 · Cited by 107 · see citing works
Pickering, B. W., Dong, Y., Ahmed, A., Giri, J., Kılıçkaya, O., Gupta, A., Gajic, O., & Herasevich, V. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.01.017 · Cited by 100 · see citing works
Impact of CPOE on Mortality Rates – Contradictory Findings, Important Messages
Talmon, J. L., Ash, J. S., Bates, D. W., Beuscart-Zéphir, M.-C., Duhamel, A., Elkin, P. L., Gardner, R. M., Geissbühler, A., & Ammenwerth, E. (2006) · Methods of Information in Medicine · doi:10.1055/s-0038-1634123 · Cited by 98 · see citing works
Self-citationAncker, J. S., Kern, L. M., Abramson, E. L., & Kaushal, R. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000385 · Cited by 88 · see citing works
Novel Representation of Clinical Information in the ICU
Herasevich, V., Ahmed, A., Gajic, O., & Pickering, B. W. (2010) · Applied Clinical Informatics · doi:10.4338/aci-2009-12-cr-0027 · Cited by 89 · see citing works
Eight Rights of Safe Electronic Health Record Use
Sittig, D. F. (2009) · JAMA · doi:10.1001/jama.2009.1311 · Cited by 85 · see citing works
Self-citationSingh, H., & Sittig, D. F. (2020) · Annals of Internal Medicine · doi:10.7326/m19-0879 · Cited by 77 · see citing works
Self-citationClinical decision support systems in the pediatric intensive care unit*
Mack, E. H., Wheeler, D. S., & Embi, P. J. (2009) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0b013e3181936b23 · Cited by 76 · see citing works
Cresswell, K. M., Bates, D. W., Williams, R., Morrison, Z., Slee, A., Coleman, J. J., Robertson, A. R. R., Sheikh, A., Avery, A. J., Blake, L., et al. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002252 · Cited by 76 · see citing works
Safe Electronic Health Record Use Requires a Comprehensive Monitoring and Evaluation Framework
Sittig, D. F. (2010) · JAMA · doi:10.1001/jama.2010.61 · Cited by 76 · see citing works
Self-citationSaleem, J. J., Russ, A. L., Sanderson, P., Johnson, T. R., Zhang, J., & Sittig, D. F. (2009) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638638 · Cited by 72 · see citing works
Self-citationThe Health Information Technology Workforce
Hersh, W. (2010) · Applied Clinical Informatics · doi:10.4338/aci-2009-11-r-0011 · Cited by 71 · see citing works
March, C. A., Steiger, D., Scholl, G., Mohan, V., Hersh, W., & Gold, J. A. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-002549 · Cited by 64 · see citing works
Abraham, J., Novak, L. L., Reynolds, T. L., Gettinger, A., & Zheng, K. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-036 · Cited by 59 · see citing works
The impact of a tele-ICU on provider attitudes about teamwork and safety climate
Chu-Weininger, M. Y. L., Wueste, L., Lucke, J. F., Weavind, L. M., Mazabob, J. M., & Thomas, E. J. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2007.024992 · Cited by 58 · see citing works
Improving the Effectiveness of Electronic Health Record-Based Referral Processes
Esquivel, A., Sittig, D. F., Murphy, D. R., & Singh, H. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-107 · Cited by 57 · see citing works
Self-citationPickering, B. W., Litell, J. M., Herasevich, V., & Gajic, O. (2012) · Critical Care · doi:10.1186/cc11142 · Cited by 51 · see citing works
Hersh, W., & Wright, A. T. (2008) · PubMed Central · Cited by 52 · see citing works
Ward, M. J., Froehle, C. M., Hart, K. W., Collins, S. P., & Lindsell, C. J. (2013) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2013.08.019 · Cited by 48 · see citing works
Safety Assurance Factors for Electronic Health Record Resilience (SAFER): study protocol
Singh, H., Ash, J. S., & Sittig, D. F. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-46 · Cited by 50 · see citing works
Self-citationOrganizational Workflow and Its Impact on Work Quality
Cain, C. H., & Haque, S. N. (2008) · Europe PMC (PubMed Central) · Cited by 45 · see citing works
Creating an Oversight Infrastructure for Electronic Health Record–Related Patient Safety Hazards
Singh, H., Classen, D. C., & Sittig, D. F. (2011) · Journal of Patient Safety · doi:10.1097/pts.0b013e31823d8df0 · Cited by 45 · see citing works
Self-citationClinical decision support systems: Potential with pitfalls
Eberhardt, J. S., Bilchik, A. J., & Stojadinovic, A. (2012) · Journal of Surgical Oncology · doi:10.1002/jso.23053 · Cited by 43 · see citing works
Hersh, W. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638595 · Cited by 39 · see citing works
Connecting the dots: rule-based decision support systems in the modern EMR era
Herasevich, V., Kor, D. J., Subramanian, A., & Pickering, B. W. (2013) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-013-9445-6 · Cited by 37 · see citing works
Designing Computerized Decision Support That Works for Clinicians and Families
Fiks, A. G. (2011) · Current problems in pediatric and adolescent health care · doi:10.1016/j.cppeds.2010.10.006 · Cited by 37 · see citing works
Factors Influencing Implementation and Outcomes of a Dental Electronic Patient Record System
Walji, M. F., Taylor, D., Langabeer, J. R., & Valenza, J. A. (2009) · Journal of Dental Education · doi:10.1002/j.0022-0337.2009.73.5.tb04734.x · Cited by 36 · see citing works
Goveia, J., van Stiphout, F., Cheung, Z. J., Kamta, B., Keijsers, C. J. P. W., Valk, G. D., & ter Braak, E. W. M. T. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.806984 · Cited by 36 · see citing works
Sittig, D. F., Ash, J. S., Guappone, K. P., Campbell, E. M., & Dykstra, R. H. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.08.005 · Cited by 30 · see citing works
Self-citationVision and challenges of Evidence-Based Health Informatics: A case study of a CPOE meta-analysis
Ammenwerth, E., Schnell‐Inderst, P., & Siebert, U. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.11.003 · Cited by 30 · see citing works
Safe and Successful Implementation of CPOE for Chemotherapy at a Children's Cancer Center
Hoffman, J. M., Baker, D. K., Howard, S. C., Laver, J. H., & Shenep, J. L. (2011) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2011.0131 · Cited by 29 · see citing works
Al‐Dorzi, H. M., Tamim, H., Cherfan, A. J., Hassan, M. A., Taher, S. M., & Arabi, Y. M. (2011) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-11-71 · Cited by 28 · see citing works
Resilient practices in maintaining safety of health information technologies
Smith, M. W., Ash, J. S., Sittig, D. F., & Singh, H. (2014) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343414534242 · Cited by 26 · see citing works
Self-citationClinical data needs in the neonatal intensive care unit electronic medical record
Ellsworth, M. A., Lang, T. R., Pickering, B. W., & Herasevich, V. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-92 · Cited by 26 · see citing works
Reddy, M. C., Shabot, M. M., & Bradner, E. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.01.004 · Cited by 26 · see citing works
Self-citationHussain, M., Figueiredo, M. C., Tran, B. D., Su, Z., Molldrem, S., Eikey, E. V., & Chen, Y. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa179 · Cited by 23 · see citing works
Jones, S. S., Heaton, P., Friedberg, M. W., & Schneider, E. C. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0245 · Cited by 23 · see citing works
Mayne, S. L., Karavite, D., Grundmeier, R. W., Localio, R. A., Feemster, K. A., DeBartolo, E., Hughes, C. C., & Fiks, A. G. (2012) · PubMed Central · Cited by 22 · see citing works
Jacobs, B. R. (2007) · Pediatric Critical Care Medicine · doi:10.1097/01.pcc.0000257484.86356.39 · Cited by 22 · see citing works
State of the Art in Clinical Informatics: Evidence and Examples
McCoy, A. B., Wright, A. T., Eysenbach, G., Malin, B., Patterson, E. S., Xu, H., & Sittig, D. F. (2013) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638827 · Cited by 21 · see citing works
Self-citationEthical and Legal Issues in the Use of Health Information Technology to Improve Patient Safety
Berner, E. S. (2008) · HEC Forum · doi:10.1007/s10730-008-9074-5 · Cited by 22 · see citing works
Sociotechnical Challenges of Developing an Interoperable Personal Health Record
Longhurst, C., Slayton, R. M., Das, A. K., & Gaskin, G. (2011) · Applied Clinical Informatics · doi:10.4338/aci-2011-06-ra-0035 · Cited by 20 · see citing works
Computer-Related Medication Errors in Neonatal Intensive Care Units
Chuo, J., & Hicks, R. W. (2008) · Clinics in Perinatology · doi:10.1016/j.clp.2007.11.005 · Cited by 20 · see citing works
Human-Centered Design of Persuasive Appointment Reminders
Walji, M. F., & Zhang, J. (2008) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2008.194 · Cited by 20 · see citing works
Self-citationMohan, V., Woodcock, D., McGrath, K., Scholl, G., Pranaat, R., Doberne, J., Chase, D. A., Gold, J. A., & Ash, J. S. (2016) · PubMed Central · Cited by 19 · see citing works
Self-citationUsing electronic health record systems in diabetes care
Veinot, T. C., Zheng, K., Lowery, J. C., Souden, M., & Keith, R. E. (2010) · International Health Informatics Symposium · doi:10.1145/1882992.1883026 · Cited by 19 · see citing works
Teufel, R. J., Kazley, A. S., & Basco, W. T. (2008) · Clinical Pediatrics · doi:10.1177/0009922809331801 · Cited by 19 · see citing works
Zheng, K., Hanauer, D. A., Padman, R., Johnson, M. P., Hussain, A. A., Ye, W., Zhou, X., & Diamond, H. S. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000118 · Cited by 18 · see citing works
Medication safety and knowledge‐based functions: a stepwise approach against information overload
Patapovas, A., Dormann, H., Sedlmayr, B., Kirchner, M., Sonst, A., Müller, F., Pfistermeister, B., Plank‐Kiegele, B., Vogler, R., Maas, R., et al. (2013) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.12190 · Cited by 16 · see citing works
Sittig, D. F., Kahol, K., & Singh, H. (2013) · Studies in health technology and informatics · doi:10.3233/978-1-61499-289-9-515 · Cited by 15 · see citing works
Self-citationBenwell, N. M., Hird, K., Thomas, N. J. M., Furness, E., Fear, M. W., & Sweetman, G. M. (2016) · Australian Health Review · doi:10.1071/ah16090 · Cited by 15 · see citing works
Computerized Physician Order Entry in the Neonatal Intensive Care Unit: A Narrative Review
York, J. B., Cardoso, M. Z., Azuma, D., Beam, K., Binney, G., & Weingart, S. N. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1692475 · Cited by 14 · see citing works
Implementing an Electronic Medical Record
Friedman, L. N., Halpern, N. A., & Fackler, J. C. (2007) · Critical Care Clinics · doi:10.1016/j.ccc.2007.05.001 · Cited by 13 · see citing works
Forcing Functions: The Need for Restraint
Bisantz, A. M., & Wears, R. L. (2009) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2008.07.019 · Cited by 12 · see citing works
The way from pen and paper to electronic documentation in a German emergency department
Lucas, B., Schladitz, P., Schirrmeister, W., Pliske, G., Walcher, F., Kulla, M., & Brammen, D. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4400-y · Cited by 12 · see citing works
Moving towards efficient, safe, and meaningful healthcare: issues for automation
Falan, S., & Han, B. T. (2011) · International Journal of Electronic Healthcare · doi:10.1504/ijeh.2011.039060 · Cited by 11 · see citing works
Exploring patient perspectives on telemedicine monitoring within the operating room
Abraham, J., Meng, A., Holzer, K. J., Brawer, L., Casarella, A., Avidan, M. S., & Politi, M. C. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104595 · Cited by 11 · see citing works
Factors Affecting Acceptance of a Web-Based Self-Referral System
Kim, E.-H., Linker, D. T., Coumar, A., Dean, L. S., Matsen, F. A., & Kim, Y. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2010.2088129 · Cited by 11 · see citing works
Complexity in Healthcare Information Technology Systems
Drummond, W. H., Ferranti, J. M., Lehmann, C. U., & Lighter, D. E. (2009) · Computers in health care · doi:10.1007/978-0-387-76446-7_8 · Cited by 10 · see citing works
The Impact of Domain Knowledge on Structured Data Collection and Templated Note Design
McClay, J. C., Windle, J., & Windle, T. (2013) · Applied Clinical Informatics · doi:10.4338/aci-2013-02-cr-0008 · Cited by 10 · see citing works
Mulherin, D., Zimmerman, C. R., & Chaffee, B. W. (2012) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp120217 · Cited by 9 · see citing works
IT Governance in Acute Healthcare: A Critical Review of Current Literature
Thatcher, M. P. (2012) · Springer eBooks · doi:10.1007/978-3-642-22474-4_15 · Cited by 9 · see citing works
Characterizing Collaborative Workflow and Health Information Technology
Kuziemsky, C. E., Abraham, J., & Reddy, M. C. (2019) · Health informatics · doi:10.1007/978-3-030-16916-9_6 · Cited by 9 · see citing works
Videau, M., Charpiat, B., Vermorel, C., Bosson, J., Conort, O., & Bedouch, P. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-045778 · Cited by 9 · see citing works
Tree testing of hierarchical menu structures for health applications
Le, T., Chaudhuri, S., Chung, J., Thompson, H. J., & Demiris, G. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.02.011 · Cited by 9 · see citing works
Brunette, D., Tersteeg, J., Brown, N., Johnson, V., Dunlop, S. J., Karambay, J., & Miner, J. R. (2013) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2012.9.6601 · Cited by 8 · see citing works
New tools for high reliability healthcare
Shabot, M. M. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003492 · Cited by 8 · see citing works
Self-citationLonghurst, C., Palma, J. P., Grisim, L. M., Widen, E., Chan, M., & Sharek, P. J. (2013) · PubMed · Cited by 7 · see citing works
Avgar, A. C., Pronovost, P. J., & Litwin, A. S. (2012) · Applied Clinical Informatics · doi:10.4338/aci-2012-02-r-0004 · Cited by 7 · see citing works
Sittig, D. F., & Singh, H. (2014) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.14.46 · Cited by 6 · see citing works
Self-citationReducing Mortality Related to Adverse Events in Children
Shin, A. Y., Longhurst, C., & Sharek, P. J. (2012) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2012.09.002 · Cited by 5 · see citing works
Towards a safer healthcare system
Henriksen, K., & Albolino, S. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2010.045849 · Cited by 5 · see citing works
A Case Study in Ambulatory Practices
Zheng, K., McGrath, D., Hamilton, A., Tanner, C. L., White, M., & Pohl, J. M. (2009) · Journal of Decision System · doi:10.3166/jds.18.117-140 · Cited by 5 · see citing works
Baker, D. K., Hoffman, J. M., Hale, G. A., Spunt, S. L., Sanderlin, D., Rodman, J. H., & Shenep, J. L. (2008) · Cited by 5 · see citing works
Cognitive Considerations for Health Information Technology
Franklin, A., & Zhang, J. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-398476-0.00022-1 · Cited by 5 · see citing works
Self-citation“To Err Is Evolution”: We Need the Implementation Report to Learn
Franck, C. P., Geissbühler, A., & Lovis, C. (2023) · JMIR Medical Informatics · doi:10.2196/47695 · Cited by 5 · see citing works
Altavilla, S. A., Thornton, J. M., & Almodovar, M. C. (2011) · Progress in Pediatric Cardiology · doi:10.1016/j.ppedcard.2011.10.013 · Cited by 4 · see citing works
Beneficios y riesgos relacionados con el uso de la historia clínica electrónica
Otero, P. (2011) · Archivos Argentinos de Pediatria · doi:10.5546/aap.2011.476 · Cited by 4 · see citing works
Masci, P. M., & Curzon, P. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25364-5_10 · Cited by 4 · see citing works
Chan, J. H., Walker, S., Lim, A. S., & Stokes, E. (2025) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2025.101477 · Cited by 3 · see citing works
Khan, N. A., Díaz Rodríguez, N., Danielsson-Ojala, R., Pirinen, H., Kauhanen, L., Salanterä, S., Majors, J., rklund, S. B. O., Rautanen, K., Salakoski, T., et al. (2015) · Ambient intelligence and smart environments · doi:10.3233/978-1-61499-597-5-134 · Cited by 3 · see citing works
The Need for Expanded Educational Opportunities in Clinical Informatics for Pediatric Trainees
Yan, A. P., Yarahuan, J. W., & Hron, J. D. (2024) · Applied Clinical Informatics · doi:10.1055/a-2340-7142 · Cited by 3 · see citing works
Dubé, M. M., Hron, J. D., Biesbroek, S., Chan-MacRae, M., Shearer, A., Landi, R., Swenson, M., Kats, D. J., White, D., Birmingham, R., et al. (2025) · Advances in Simulation · doi:10.1186/s41077-025-00349-z · Cited by 3 · see citing works
Dhiman, G. J., Amber, K. T., & Goodman, K. W. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocu033 · Cited by 3 · see citing works
Arabi, Y. M., Pickering, B. W., Al‐Dorzi, H. M., Alsaawi, A., Al-Qahtani, S. M., & Hay, A. W. (2016) · Annals of Thoracic Medicine · doi:10.4103/1817-1737.176877 · Cited by 3 · see citing works
Measuring the impact of technology on nurse workflow: a mixed methods approach.
CADY, R. G. (2012) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 3 · see citing works
Neonatal Informatics—Dream of a Paperless NICU: Part Three: Complex Crashes
Drummond, W. H. (2010) · NeoReviews · doi:10.1542/neo.11-2-e55 · Cited by 2 · see citing works
Implementation and Transition to Operations
Longhurst, C., & Sharp, C. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-420217-7.00007-9 · Cited by 2 · see citing works
- Authors
- Sittig, D. F., Ash, J. S., Zhang, J., Osheroff, J. A., & Shabot, M. M.
- Affiliations
- Kaiser Permanente (US)
- Oregon Health & Science University (US)
- The University of Texas Health Science Center at Houston (US)
- University of Pennsylvania (US)
- Cedars-Sinai Medical Center (US)
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2006-08-01
- Volume
- 118
- Issue
- 2
- Pages
- 797-801
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2090144979
- Cited by
- 130
- References
- 24
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 3 · 2021: 4 · 2020: 2 · 2019: 4 · 2017: 1 · 2016: 5 · 2015: 9 · 2014: 10 · 2013: 15 · 2012: 11
- FWCI
- 20.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Emergency Medical Services › Patient Safety and Medication Errors
- Health Sciences › Medicine › Emergency Medicine › Hospital Admissions and Outcomes
- Keywords
- computerized physician order entry, CPOE implementation, clinical information systems, patient mortality, implementation failure, organizational factors, patient safety
- MeSH terms
- Child, Preschool, Female, Patient Care, Humans, Infant, Infant Mortality, Male, Causality, Child Mortality, Medical Order Entry Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review