The Effect of Computerized Provider Order Entry on Medical Student Clerkship Experiences
Abstract
OBJECTIVE: To describe medical students' attitudes toward placing orders during training, and the effect of computerized provider order entry (CPOE) on their learning experiences. DESIGN: Prospective, controlled study of all 143 Johns Hopkins University School of Medicine students who began the Basic Medicine clerkship between March 2003 and April 2004 at one of three teaching hospitals: one using CPOE, one paper orders, and one that began using CPOE midway through this study. MEASUREMENTS: Survey of students at the start and after the first month of the clerkship. RESULTS: Ninety-six percent of students responded. Students expressed a desire to place 100% of orders for their patients. Ninety-five percent of students believed that placing orders helps students learn what tests and treatments patients need. Eighty-four percent reported that being unavailable due to conferences and teaching sessions was a significant barrier to participating in the ordering process. Students at hospitals using CPOE reported placing significantly fewer of their patients' follow-up orders compared to students at hospitals using paper orders (25% vs. 50%, p < 0.01) and were more likely to report that their resident or intern did not want them to enter orders (40% vs. 16%, p < 0.01). Comparisons of students at hospitals using CPOE to each other showed that these differences were attributable to one of the hospitals. Thirty-two percent of students at both hospitals using CPOE reported that the extra length of time required for housestaff to review their orders in the computer was a significant barrier. CONCLUSION: Hospitals need to ensure that the educational potential of medical students' clinical experiences is maximized when implementing CPOE.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Embedding clinical decision support within CPOE systems may increase clinician-users' access to educational material and may affect learning and retention.
“Although limited experience exists, embedding clinical decision support (CDS) within CPOE systems may increase clinician-users' access to educational material 30,31 and may affect learning and retention.32”
From Types of Unintended Consequences Related to Computerized Provider Order Entry (2006) · cites this paper as [32]
Citation 32 is attached to the claim that CPOE may affect learning and retention, not to the preceding claim about access to educational material. The Discussion reports that CPOE may affect medical students’ learning experiences, but the paper does not address retention or establish the effect for clinician-users generally. No page number is available in our copy. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,174 · see citing works
To Err is Human: Building a Safer Health System
Hendee, W. R. (2001) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(01)70072-3 · Cited by 10,122 · see citing works
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936 · see citing works
To Err Is Human : Building A Safer Health System
Kohn, L. T., Corrigan, J., & Donaldson, M. S. (2000) · Cited by 2,844 · see citing works
Bates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107 · see citing works
Hunt, D. L., Haynes, R. B., Hanna, S., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,684 · see citing works
Brennen, B. S. (2017) · Routledge eBooks · doi:10.4324/9781315435978-2 · Cited by 1,487 · see citing works
Systems Analysis of Adverse Drug Events
Leape, L. L. (1995) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1995.03530010049034 · Cited by 1,404 · see citing works
Lorentzon, M. (1993) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1993.180610057.x · Cited by 1,386 · see citing works
The Impact of Computerized Physician Order Entry on Medication Error Prevention
Bates, D. W., Teich, J. M., Lee, J., Seger, D., Kuperman, G. J., Ma'Luf, N., Boyle, D., & Leape, L. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.00660313 · Cited by 1,260 · see citing works
Relationship between medication errors and adverse drug events
Bates, D. W., Boyle, D. L., Vliet, M. B. V., Schneider, J., & Leape, L. (1995) · Journal of General Internal Medicine · doi:10.1007/bf02600255 · Cited by 981 · see citing works
Factors Related to Errors in Medication Prescribing
Lesar, T. S. (1997) · JAMA · doi:10.1001/jama.1997.03540280050033 · Cited by 734 · see citing works
Johnston, M. E., Langton, K. B., Haynes, R. B., & Mathieu, A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-120-2-199401150-00007 · Cited by 713 · see citing works
Physician inpatient order writing on microcomputer workstations. Effects on resource utilization
Tierney, W. M. (1993) · JAMA · doi:10.1001/jama.269.3.379 · Cited by 561 · see citing works
Effects of Computerized Physician Order Entry on Prescribing Practices
Teich, J. M., Merchia, P., Schmiz, J. L., Kuperman, G. J., Spurr, C. D., & Bates, D. W. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.18.2741 · Cited by 475 · see citing works
The Medical School Objectives Writing Group (1999) · Journal of the Association of American Medical Colleges · doi:10.1097/00001888-199901000-00010 · Cited by 452 · see citing works
Aequanimitas, with other Addresses to Medical Students, Nurses and Practitioners of Medicine
Osler, W. (1940) · Postgraduate Medical Journal · doi:10.1136/pgmj.16.176.216 · Cited by 404 · see citing works
Mekhjian, H. S., Kumar, R. R., Kuehn, L. A., Bentley, T. D., Teater, P., Thomas, A., Payne, B. P., & Ahmad, A. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1038 · Cited by 357 · see citing works
Computerized Physician Order Entry in U.S. Hospitals: Results of a 2002 Survey
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1427 · Cited by 295 · see citing works
Teaching in the medical setting: balancing teaching styles, learning styles and teaching methods
Vaughn, L. M., & Baker, R. C. (2001) · Medical Teacher · doi:10.1080/01421590120091000 · Cited by 255 · see citing works
A Consensus Statement on Considerations for a Successful CPOE Implementation
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1204 · Cited by 239 · see citing works
Overhage, J. M., Perkins, S., Tierney, W. M., & McDonald, C. J. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080361 · Cited by 232 · see citing works
A Cross-site Qualitative Study of Physician Order Entry
Ash, J. S., Gorman, P., Lavelle, M., Payne, T. H., Massaro, T. A., Frantz, G. L., & Lyman, J. A. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m770 · Cited by 184 · see citing works
Factors related to errors in medication prescribing
Lesar, T. S. (1997) · JAMA · doi:10.1001/jama.277.4.312 · Cited by 147 · see citing works
Introducing physician order entry at a major academic medical center
Massaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00004 · Cited by 138 · see citing works
Weiner, M., Gress, T., Thiemann, D. R., Jenckes, M. W., Reel, S., Mandell, S. F., & Bass, E. B. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.0060234 · Cited by 112 · see citing works
Comparison of Time Spent Writing Orders on Paper with Computerized Physician Order Entry
Shu, K. M., Boyle, D., Spurr, C. D., Horsky, J., Heiman, H. L., Paula, O., John, L., & Bates, D. W. (2001) · Studies in health technology and informatics · doi:10.3233/978-1-60750-928-8-1207 · Cited by 108 · see citing works
Prescribing errors involving medication dosage forms
Lesar, T. S. (2002) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2002.11056.x · Cited by 98 · see citing works
Ahmad, A., Teater, P., Bentley, T. D., Kuehn, L., Kumar, R. R., Thomas, A., & Mekhjian, H. S. (2002) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2002.0090016 · Cited by 94 · see citing works
Impact of computerized physician order entry on physician time.
Bates, D. W., Boyle, D. L., & Teich, J. M. (1994) · PubMed · Cited by 92 · see citing works
Medical Students’ Use of Information Resources: Is the Digital Age Dawning?
Peterson, M. W., Rowat, J. A., Kreiter, C. D., & Mandel, J. (2004) · Academic Medicine · doi:10.1097/00001888-200401000-00019 · Cited by 86 · see citing works
How effective is a clerkship as a learning environment?
van der Hem-Stokroos, H. H., Scherpbier, A. J. J. A., van der Vleuten, C. P. M., de Vries, H., & Haarman, H. J. T. M. (2001) · Medical Teacher · doi:10.1080/01421590127200 · Cited by 72 · see citing works
Educational technology to facilitate medical studentsʼ learning
Moberg, T. F., & Whitcomb, M. E. (1999) · Academic Medicine · doi:10.1097/00001888-199910000-00020 · Cited by 70 · see citing works
Perceptions of house officers who use physician order entry.
Ash, J. S., Gorman, P., Hersh, W., Lavelle, M., & Poulsen, S. B. (1999) · PubMed Central · Cited by 58 · see citing works
Using a decade of data on medical student computer literacy for strategic planning.
Seago, B. L., Schlesinger, J. B., & Hampton, C. L. (2002) · PubMed · Cited by 52 · see citing works
Medical studentsʼ and housestaffʼs opinions of computerized order-writing
Tierney, W. M., Overhage, J. M., McDonald, C. J., & Wolinsky, F. D. (1994) · Academic Medicine · doi:10.1097/00001888-199405000-00013 · Cited by 45 · see citing works
Use of Web-based library resources by medical students in community and ambulatory settings.
Tannery, N. H., Foust, J. E., Gregg, A., Hartman, L. M., Kuller, A. B., Worona, P. C., & Tulsky, A. A. (2002) · Europe PMC (PubMed Central) · Cited by 33 · see citing works
Learner-centered strategies in clerkship education
Curry, R. H., Hershman, W. Y., & Saizow, R. B. (1996) · The American Journal of Medicine · doi:10.1016/s0002-9343(97)89424-7 · Cited by 26 · see citing works
Bradley, F. R. (1957) · PubMed · Cited by 24 · see citing works
Time allocation of students in basic clinical clerkships in a traditional curriculum
Cook, R. L., Noecker, R. J., & Suits, G. W. (1992) · Academic Medicine · doi:10.1097/00001888-199204000-00020 · Cited by 21 · see citing works
Patterson, R. C., & Harasym, P. H. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080111 · Cited by 19 · see citing works
Studentsʼ educational activities during clerkship
O’Sullivan, P., Weinberg, E., Boll, A., & Nelson, T. R. (1997) · Academic Medicine · doi:10.1097/00001888-199704000-00018 · Cited by 18 · see citing works
The Impact of Resident Duty Hour Reform in a Medicine Core Clerkship
Kogan, J. R., Bellini, L. M., & Shea, J. A. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00018 · Cited by 17 · see citing works
Mellinkoff, S. M. (1987) · New England Journal of Medicine · doi:10.1056/nejm198710223171710 · Cited by 14 · see citing works
Effect on medical education of computerized physician order entry
Stair, T. O., & Howell, J. M. (1995) · Academic Medicine · doi:10.1097/00001888-199506000-00019 · Cited by 13 · see citing works
The future of medical student education in internal medicine
Whelan, A. J., Appel, J. L., Alper, E., Fer, T. M. D., Dickinson, T. A., Fazio, S. B., Friedman, E. S., Kuzma, M. A., & Reddy, S. T. (2004) · The American Journal of Medicine · doi:10.1016/j.amjmed.2004.02.001 · Cited by 9 · see citing works
Introducing Physician Order Entry at a Major Academic Medical Center: Impact on Medical Education
Massaro, T. A. (2006) · Springer eBooks · doi:10.1007/0-387-30329-4_12 · Cited by 1 · see citing works
Flagged first, then by citations
3 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Tierney WM, Overhage JM, McDonald CJ, Wolinsky FD. Medi- cal students' and housestaff's opinions of computerized order- writing. Acad Med. 1994;69:386-9.
Cited by
Sorted by citations
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823 · see citing works
Hammoud, M. M., Dalrymple, J. L., Christner, J. G., Stewart, R., Fisher, J., Margo, K. L., Ali, I., Briscoe, G. W., & Pangaro, L. N. (2012) · Teaching and Learning in Medicine · doi:10.1080/10401334.2012.692284 · Cited by 108 · see citing works
Medical Education in the Electronic Medical Record (EMR) Era
Tierney, M. J., Pageler, N. M., Kahana, M. D., Pantaleoni, J. L., & Longhurst, C. (2013) · Academic Medicine · doi:10.1097/acm.0b013e3182905ceb · Cited by 108 · see citing works
Hammoud, M. M., Margo, K. L., Christner, J. G., Fisher, J., Fischer, S. H., & Pangaro, L. N. (2012) · Teaching and Learning in Medicine · doi:10.1080/10401334.2012.692267 · Cited by 82 · see citing works
Simulated Electronic Health Record (Sim-EHR) Curriculum
Milano, C. E., Hardman, J. A., Plesiu, A., Rdesinski, R. E., & Biagioli, F. E. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000149 · Cited by 83 · see citing works
Use of Electronic Medical Records by Physicians and Students in Academic Internal Medicine Settings
Mintz, M. L., Narvarte, H. J., O’Brien, K. E., Papp, K. K., Thomas, M., & Durning, S. J. (2009) · Academic Medicine · doi:10.1097/acm.0b013e3181bf9d45 · Cited by 66 · see citing works
Computerized Physician Order Entry in the Critical Care Environment: A Review of Current Literature
Maslove, D. M., Rizk, N. W., & Lowe, H. (2011) · Journal of Intensive Care Medicine · doi:10.1177/0885066610387984 · Cited by 64 · see citing works
Do Electronic Health Records Help or Hinder Medical Education?
Peled, J. U., Sagher, O., Morrow, J. B., & Dobbie, A. E. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000069 · Cited by 59 · see citing works
Using electronic patient records: defining learning outcomes for undergraduate education
Pontefract, S. K., & Wilson, K. C. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1466-5 · Cited by 60 · see citing works
Alsohime, F., Temsah, M.-H. A., Al-Eyadhy, A. A., Bashiri, F. A., Househ, M. S., Jamal, A. A., Hasan, G., Alhaboob, A. A. N., Alabdulhafid, M., & Amer, Y. S. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.12.026 · Cited by 56 · see citing works
Computerized Provider Order Entry and Patient Safety
Lehmann, C. U., & Kim, G. R. (2006) · Pediatric Clinics of North America · doi:10.1016/j.pcl.2006.09.006 · Cited by 45 · see citing works
Leveraging Coordinative Conventions to Promote Collaboration Awareness
Cabitza, F., Simone, C., & Sarini, M. (2009) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-009-9093-z · Cited by 37 · see citing works
Herrmann-Werner, A., Holderried, M., Loda, T., Malek, N., Zipfel, S., & Holderried, F. (2019) · JMIR Medical Informatics · doi:10.2196/12648 · Cited by 20 · see citing works
Electronic Health Record Skills Workshop for Medical Students
Zavodnick, J. H., & Kouvatsos, T. (2019) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10849 · Cited by 19 · see citing works
A Targeted Needs Assessment for the Development of a Surgical Sub-internship Curriculum
Lamb, C. R., Shaw, R. D., Chu, B. K. H., Wong, S. L., & Rosenkranz, K. M. (2021) · Journal of surgical education · doi:10.1016/j.jsurg.2021.06.017 · Cited by 19 · see citing works
CPOE in Iran—A viable prospect?
Kazemi, A., Ellenius, J., Tofighi, S., Salehi, A., Eghbalian, F., & Fors, U. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.07.004 · Cited by 16 · see citing works
Booth, R. G., Sinclair, B., Brennan, L., & Strudwick, G. (2016) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000309 · Cited by 15 · see citing works
Active artifacts as bridges between context and community knowledge sources
Cabitza, F., & Simone, C. (2009) · International Conference on Communities and Technologies (C&T) · doi:10.1145/1556460.1556478 · Cited by 11 · see citing works
The Effect of Computerized Provider Order Entry on Medical Students’ Ability to Write Orders
Knight, A. M., Kravet, S. J., Kiyatkin, D., & Leff, B. A. (2012) · Teaching and Learning in Medicine · doi:10.1080/10401334.2012.641490 · Cited by 11 · see citing works
Self-citationClaret, P., Bobbia, X., Macrì, F., Stowell, A., Motté, A., Landais, P., Bérégi, J.-P., & Coussaye, J.-E. D. L. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.03.006 · Cited by 9 · see citing works
Attitudes and Perceptions of Pediatric Residents on Transitioning to CPOE
Webber, E. C., & Shriner, A. R. (2014) · Applied Clinical Informatics · doi:10.4338/aci-2014-04-ra-0045 · Cited by 9 · see citing works
Medical students’ experience with accessing medical records in Saudi Arabia: a descriptive study
Almulhem, J. A. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02715-7 · Cited by 8 · see citing works
Wack, M., Puymirat, É., Ranque, B., Georgin‐Lavialle, S., Pierre, I., Tanguy, A., Ackermann, F., Mallet, C., Pavie, J., Boultache, H., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138094 · Cited by 8 · see citing works
Computerised provider order entry and residency education in an academic medical centre
Wong, B. M., Kuper, A., Robinson, N., Morra, D. J., Etchells, E. E., Wu, R. C., & Shojania, K. G. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04317.x · Cited by 7 · see citing works
Enter and Discuss Orders and Prescriptions (EPA 4): A Curriculum for Fourth-Year Medical Students
Liao, N. N., Leung, C. G., Barbee, J., Gonzales, G., Schaffernocker, T., Kman, N., Curren, C., & Lewis, K. (2022) · MedEdPORTAL · doi:10.15766/mep_2374-8265.11263 · Cited by 6 · see citing works
The education and training of medical students in electronic prescribing
Burns, N., & Okorie, M. (2022) · Pharmacology Research & Perspectives · doi:10.1002/prp2.1011 · Cited by 6 · see citing works
Schor, N. F. (2016) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2016.06.001 · Cited by 3 · see citing works
Clinical Documentation in Electronic Medical Records: The Student Perspective
Stephens, M. B., Corcoran, T. S., & Motsinger, C. D. (2011) · Medical Science Educator · doi:10.1007/bf03341587 · Cited by 2 · see citing works
Volume 30, Number 6, November/December 2006
Keenan, C. R., Nguyen, H. H., & Srinivasan, M. (2007) · Academic Psychiatry · doi:10.1176/appi.ap.31.6.492 · Cited by 2 · see citing works
PED-IA, a CDSS to support decision in pediatrics telephone triage: a crossover evaluation
Manns, A., Millet, A., Fleur Mougin, A., Campeotto, F., Vivien, B., Dupic, L., Burgun, A., Jaïs, J., & Tsopra, R. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110645 · Cited by 1 · see citing works
Computerized provider order entry and patient safety : Experiences from an Iranian teaching hospital
Kazemi, A. (2009) · Figshare
Alsohime, F., Temsah, M.-H. A., Khan, S., Amer, Y. S., Al-Eyadhy, A. A., Bashiri, F. A., Jamal, A. A., Househ, M. S., & Alhaboob, A. A. N. (2017) · doi:10.2196/preprints.9191
Puranik, C. P., Slavik, A., Pickett, K. L., Dani, A., Generalovich, Z., Neveaux, L., & de Peralta, T. L. (2023) · Journal of Dental Education · doi:10.1002/jdd.13175
- Authors
- Knight, A. M.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Knight, A. M.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-05-19
- Volume
- 12
- Issue
- 5
- Pages
- 554-560
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W1492739470
- Cited by
- 34
- References
- 50
- Citations by year
- 2025: 1 · 2023: 1 · 2022: 2 · 2021: 3 · 2019: 3 · 2018: 1 · 2017: 1 · 2016: 3 · 2015: 1 · 2014: 2 · 2013: 1 · 2012: 4
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Center for Research Resources (M01RR002719, M0-1-RR-02719)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Emergency Medicine › Hospital Admissions and Outcomes
- Keywords
- computerized physician order entry, medical clerkship, clinical decision-making, order entry, medical education, barriers to student participation, resident supervision, hospital information systems
- MeSH terms
- Attitude to Computers, Clinical Clerkship, Data Collection, Hospital Information Systems, Humans, Prospective Studies, User-Computer Interface, Medical Records Systems, Computerized
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review