The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry
Open accessAbstract
BACKGROUND: Computerized provider order entry (CPOE) systems can help hospitals improve health care quality, but they can also introduce new problems. The extent to which hospitals experience unintended consequences of CPOE, which include more than errors, has not been quantified in prior research. OBJECTIVE: To discover the extent and importance of unintended adverse consequences related to CPOE implementation in U.S. hospitals. DESIGN, SETTING, AND PARTICIPANTS: Building on a prior qualitative study involving fieldwork at five hospitals, we developed and then administered a telephone survey concerning the extent and importance of CPOE-related unintended adverse consequences to representatives from 176 hospitals in the U.S. that have CPOE. MEASUREMENTS: Self report by key informants of the extent and level of importance to the overall function of the hospital of eight types of unintended adverse consequences experienced by sites with inpatient CPOE. RESULTS We found that hospitals experienced all eight types of unintended adverse consequences, although respondents identified several they considered more important than others. Those related to new work/more work, workflow, system demands, communication, emotions, and dependence on the technology were ranked as most severe, with at least 72% of respondents ranking them as moderately to very important. Hospital representatives are less sure about shifts in the power structure and CPOE as a new source of errors. There is no relation between kinds of unintended consequences and number of years CPOE has been used. Despite the relatively short length of time most hospitals have had CPOE (median five years), it is highly infused, or embedded, within work practice at most of these sites. CONCLUSIONS: The unintended consequences of CPOE are widespread and important to those knowledgeable about CPOE in hospitals. They can be positive, negative, or both, depending on one's perspective, and they continue to exist over the duration of use. Aggressive detection and management of adverse unintended consequences is vital for CPOE success.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789
(2008) · Biostatistics and Microbiology: A Survival Manual · doi:10.1007/978-0-387-77282-0_6 · Cited by 17,371
Practical Nonparametric Statistics
Groggel, D. J. (2000) · Technometrics · doi:10.1080/00401706.2000.10486067 · Cited by 11,041
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
Qualitative data analysis (2nd ed)
Morse, J. M. (1996) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(96)00056-6 · Cited by 5,593
Normal Accidents: Living with High Risk Technologies
Grimes, A. J., & Perrow, C. (1985) · The Academy of Management Review · doi:10.2307/257982 · Cited by 4,960
FRENCH, J. R. P., & RAVEN, B. (1986) · Political Leadership · doi:10.2307/jj.12381759.38 · Cited by 4,542
Mail and internet surveys: The tailored design method, 2nd ed.
Dillman, D. A. (2007) · Cited by 2,991
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Medication Errors and Adverse Drug Events in Pediatric Inpatients
Kaushal, R. (2001) · JAMA · doi:10.1001/jama.285.16.2114 · Cited by 1,917
Practical Nonparametric Statistics (2nd ed).
Groeneveld, R. A., & Conover, W. J. (1981) · Journal of the American Statistical Association · doi:10.2307/2287607 · Cited by 1,849
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Self-citation(2017) · Qualitative Research Methods for Media Studies · doi:10.4324/9781315435978-2 · Cited by 1,483
The Impact of Computerized Physician Order Entry on Medication Error Prevention
Bates, D. W., Teich, J. M., Lee, J., Seger, D., Kuperman, G. J., Ma'Luf, N., Boyle, D., & Leape, L. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.00660313 · Cited by 1,260
Dillman, D. A. (1999) · Cited by 1,161
Han, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149
Group Dynamics: Research and Theory.
Lenn, T. I., Cartwright, D., & Zander, A. (1953) · Journal of Educational Sociology · doi:10.2307/2263258 · Cited by 1,110
Relationship between medication errors and adverse drug events
Bates, D. W., Boyle, D. L., Vliet, M. B. V., Schneider, J., & Leape, L. (1995) · Journal of General Internal Medicine · doi:10.1007/bf02600255 · Cited by 981
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823
Self-citationPatient care information systems and health care work: a sociotechnical approach
Berg, M. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00011-8 · Cited by 786
The Logic Of Failure: Recognizing And Avoiding Error In Complex Situations
Dörner, D. (1997) · Virtual Defense Library (Ministerio de Defensa) · Cited by 654
Why Things Bite Back: Technology and the Revenge of Unintended Consequences
Cohen, E. A., & Tenner, E. (1997) · Foreign Affairs · doi:10.2307/20047974 · Cited by 631
Stein, L. I. (1967) · Archives of General Psychiatry · doi:10.1001/archpsyc.1967.01730240055009 · Cited by 596
A Computerized Reminder System to Increase the Use of Preventive Care for Hospitalized Patients
Dexter, P. R., Perkins, S., Overhage, J. M., Maharry, K., Kohler, R. B., & McDonald, C. J. (2001) · New England Journal of Medicine · doi:10.1056/nejmsa010181 · Cited by 519
Effects of Computerized Physician Order Entry on Prescribing Practices
Teich, J. M., Merchia, P. R., Schmiz, J. L., Kuperman, G. J., Spurr, C. D., & Bates, D. W. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.18.2741 · Cited by 475
Computer Technology and Clinical Work: Still Waiting for Godot
Wears, R. L., & Berg, M. (2005) · JAMA · doi:10.1001/jama.293.10.1261 · Cited by 448
Guided Medication Dosing for Inpatients With Renal Insufficiency
Chertow, G. M. (2001) · JAMA · doi:10.1001/jama.286.22.2839 · Cited by 447
Poon, E. G., Blumenthal, D., Jaggi, T., Honour, M. M., Bates, D. W., & Kaushal, R. (2004) · Health Affairs · doi:10.1377/hlthaff.23.4.184 · Cited by 408
Self-citationHigh Rates of Adverse Drug Events in a Highly Computerized Hospital
(2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.10.1111 · Cited by 363
The Epidemiology of Prescribing Errors: The Potential Impact of Computerized Prescriber Order Entry
Bobb, A., Gleason, K., Husch, M., Feinglass, J., Yarnold, P. R., & Noskin, G. A. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.7.785 · Cited by 359
Effect of Computer-Based Alerts on the Treatment and Outcomes of Hospitalized Patients
Rind, D. M. (1994) · Archives of Internal Medicine · doi:10.1001/archinte.1994.00420130107014 · Cited by 323
Computerized Physician Order Entry in U.S. Hospitals: Results of a 2002 Survey
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1427 · Cited by 293
Self-citationBates, D. W., Kuperman, G. J., Rittenberg, E., Teich, J. M., Fiskio, J., Ma’luf, N., Onderdonk, A., Wybenga, D., Winkelman, J., Brennan, T. A., et al. (1999) · The American Journal of Medicine · doi:10.1016/s0002-9343(98)00410-0 · Cited by 292
Massaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00003 · Cited by 287
King, W. J., Paice, N., Rangrej, J., Forestell, G. J., & Swartz, R. (2003) · Pediatrics · doi:10.1542/peds.112.3.506 · Cited by 281
Computer-based Physician Order Entry: The State of the Art
Sittig, D. F., & Stead, W. W. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236142 · Cited by 271
Self-citationCategorizing the unintended sociotechnical consequences of computerized provider order entry
Ash, J. S., Sittig, D. F., Dykstra, R. H., Guappone, K., Carpenter, J. D., & Seshadri, V. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.05.017 · Cited by 267
Self-citationThe Nature and Determinants of IT Acceptance, Routinization, and Infusion
Saga, V. L., & Zmud, R. W. (1993) · Cited by 263
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2007) · Cited by 253
Overhage, J. M., Perkins, S., Tierney, W. M., & McDonald, C. J. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080361 · Cited by 232
A cognitive taxonomy of medical errors
Zhang, J., Patel, V. L., Johnson, T. R., & Shortliffe, E. H. (2004) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2004.04.004 · Cited by 224
Computerized Physician Order Entry: Helpful or Harmful?
Berger, R. G. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1411 · Cited by 223
Physician Discontent: Challenges and Opportunities
Mechanic, D. (2003) · JAMA · doi:10.1001/jama.290.7.941 · Cited by 220
Perrow, C. B. (1999) · Cited by 205
Impact of Computerized Physician Order Entry on Clinical Practice in a Newborn Intensive Care Unit
Cordero, L., Kuehn, L., Kumar, R. R., & Mekhjian, H. S. (2004) · Journal of Perinatology · doi:10.1038/sj.jp.7211000 · Cited by 204
The Long Road to Patient Safety: A Status Report on Patient Safety Systems
Longo, D. R., Hewett, J. E., Ge, B., & Schubert, S. (2005) · JAMA · doi:10.1001/jama.294.22.2858 · Cited by 200
Nightingale, P. G. (2000) · BMJ · doi:10.1136/bmj.320.7237.750 · Cited by 196
Aarts, J., Ash, J., & Berg, M. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.05.009 · Cited by 193
Self-citationU.S. Adoption Of Computerized Physician Order Entry Systems
Cutler, D., Feldman, N. E., & Horwitz, J. R. (2005) · Health Affairs · doi:10.1377/hlthaff.24.6.1654 · Cited by 162
Southon, F. C. G., Sauer, C., & Dampney, C. N. G. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040112 · Cited by 148
Medical Work and the ComputerBased Patient Record: A Sociological Perspective
Berg, M. (1998) · Methods of Information in Medicine · doi:10.1055/s-0038-1634535 · Cited by 138
Massaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00004 · Cited by 138
Expected and Unanticipated Consequences of the Quality and Information Technology Revolutions
Wachter, R. M. (2006) · JAMA · doi:10.1001/jama.295.23.2780 · Cited by 118
Computerized physician order entry and quality of care
Bates, D. W., Kuperman, G. J., & Teich, J. M. (1994) · Quality Management in Health Care · doi:10.1097/00019514-199402040-00005 · Cited by 116
Why Things Bite Back: Technology and the Revenge of Unintended Consequences
Levinson, M. H. (1996) · Choice Reviews Online · doi:10.5860/choice.34-1575 · Cited by 103
The Effects of CPOE on ICU workflow: an observational study.
Cheng, C. H., Goldstein, M. K., Geller, E., & Levitt, R. E. (2003) · Europe PMC (PubMed Central) · Cited by 91
Emotional Aspects of Computer-based Provider Order Entry: A Qualitative Study
Sittig, D. F. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1711 · Cited by 87
Self-citationAn unintended consequence of CPOE implementation: shifts in power, control, and autonomy.
Ash, J. S., Sittig, D. F., Campbell, E., Guappone, K. P., & Dykstra, R. H. (2006) · PubMed · Cited by 75
Self-citationComputer Crash — Lessons from a System Failure
Kilbridge, P. (2003) · New England Journal of Medicine · doi:10.1056/nejmp030010 · Cited by 72 · cited 1×
“and implementers must take steps to prevent or offset the altered communications created by electronic systems in this respect. As people become more and more dependent on such systems,”
BackgroundPerceptions of Physician Order Entry: Results of a Cross-Site Qualitative Study
Gorman, P., Lavelle, M., Stavri, P. Z., Lyman, J. A., Fournier, L., Carpenter, J., & Ash, J. S. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634224 · Cited by 68
Self-citationComputerized physician order entry and communication: reciprocal impacts.
Dykstra, R. H. (2002) · PubMed · Cited by 68
Self-citationStein, L. I. (1990) · PubMed · Cited by 40
Exploring the unintended consequences of computerized physician order entry.
Ash, J. S., Sittig, D. F., Dykstra, R. H., Campbell, E. M., & Guappone, K. P. (2007) · PubMed · Cited by 32
Self-citationKaushal, R., Shojania, K. G., & Bates, D. W. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.12.1409 · Cited by 30
A survey of U.S.A. acute care hospitals' computer-based provider order entry system infusion levels.
Sittig, D. F., Guappone, K. P., Campbell, E. M., Dykstra, R. H., & Ash, J. S. (2007) · PubMed · Cited by 13
Self-citationHillman, J. M., & Given, R. S. (2005) · PubMed · Cited by 12
Cited by
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691
Middleton, B., Bloomrosen, M., Dente, M. A., Hashmat, B., Koppel, R., Overhage, J. M., Payne, T. H., Rosenbloom, S. T., Weaver, C., & Zhang, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001458 · Cited by 618
GREENHALGH, T., POTTS, H. W. W., WONG, G., BARK, P., & SWINGLEHURST, D. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00578.x · Cited by 541
Clinical Decision-Support Systems
Musen, M. A., Middleton, B., & Greenes, R. A. (2014) · Biomedical Informatics · doi:10.1007/978-1-4471-4474-8_22 · Cited by 483
Prevalence, Incidence and Nature of Prescribing Errors in Hospital Inpatients: A Systematic Review
Lewis, P. J., Dornan, T., Taylor, D., Tully, M. P., Wass, V., & Ashcroft, D. M. (2009) · Drug Safety · doi:10.2165/00002018-200932050-00002 · Cited by 383
Metadata
- Authors
- Ash, J. S., Sittig, D. F., Poon, E. G., Guappone, K., Campbell, E., & Dykstra, R. H.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-07-01
- Volume
- 14
- Issue
- 4
- Pages
- 415-423
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2167549250
- Cited by
- 501
- References
- 67
- FWCI
- 74.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.