The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Determinants of Success of Inpatient Clinical Information Systems: A Literature Review
Open accessAbstract
We reviewed the English and Dutch literature on evaluations of patient care information systems that require data entry by health care professionals published from 1991 to 2001. Our objectives were to identify attributes that were used to assess the success of such systems and to test the ability of a framework developed by Delone and McLean for management information systems(1) to categorize these attributes correctly. The framework includes six dimensions or success factors: system quality, information quality, usage, user satisfaction, individual impact, and organizational impact. Thirty-three papers were selected for complete review. Types of study design included descriptive, correlational, comparative, and case studies. A variety of relevant attributes could be assigned to the six dimensions in the Delone and McLean framework, but some attributes, predominantly in cases of failure, did not fit any of the categories. They related to contingent factors, such as organizational culture. Our review points out the need for more thorough evaluations of patient care information systems that look at a wide range of factors that can affect the relative success or failure of these systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Two frameworks drew on DeLone and McLean’s classic theoretical model of information system success [94]. This considers system quality, information quality, usage attributes, user satisfaction, individual impact, and organizational impact [49,50].”
In the citing paper
“Some authors [30,48,60,80,84,85,94] have expressed the need for mixed methods using both quantitative and qualitative designs in order to better measure the uptake and impact of eHealth technologies.”
From A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies (2011) · cites this paper as [30]
In the citing paper
“Impact fluctuates over time and situations [30,88-90]; therefore, we need to have more advanced methods to assess the added value of eHealth technologies for health care and society.”
From A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies (2011) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
(1993) · Cited by 7,856
The Impact of Computerized Physician Order Entry on Medication Error Prevention
Bates, D. W., Teich, J. M., Lee, J., Seger, D., Kuperman, G. J., Ma'Luf, N., Boyle, D., & Leape, L. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.00660313 · Cited by 1,260
Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study1
Kaplan, B., & Duchon, D. (1988) · MIS Quarterly · doi:10.2307/249133 · Cited by 1,114
Implementing information systems in health care organizations: myths and challenges
Berg, M. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00200-3 · Cited by 715
Evaluation Methods in Medical Informatics
Friedman, C. P., & Wyatt, J. C. (1997) · Computers and medicine · doi:10.1007/978-1-4757-2685-5 · Cited by 450
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00184-8 · Cited by 380
Yearbook of Medical Informatics
International Medical Informatics Association (2017) · Yearbook of Medical Informatics · doi:10.1055/s-00034612 · Cited by 296
Massaro, T. A. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00003 · Cited by 287
Computer-based Physician Order Entry: The State of the Art
Sittig, D. F., & Stead, W. W. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236142 · Cited by 273
Implementation of Physician Order Entry: User Satisfaction and Self-Reported usage Patterns
Lee, F., Teich, J. M., Spurr, C. D., & Bates, D. W. (1996) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1996.96342648 · Cited by 261
Evaluating information technology in health care: barriers and challenges
Heathfield, H., Pitty, D., & Hanka, R. (1998) · BMJ · doi:10.1136/bmj.316.7149.1959 · Cited by 226
Addressing organizational issues into the evaluation of medical systems
Kaplan, B. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040094 · Cited by 175
Ash, J. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040102 · Cited by 174
Lessons from a failed information systems initiative: issues for complex organisations☆
Southon, G., SAUER, C., & Dampney, K. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00018-0 · Cited by 157
Southon, F. C. G., Sauer, C., & Dampney, C. N. G. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040112 · Cited by 150
A Randomized Evaluation of a Computer-Based Nursing Documentation System
Ronald Eichstädter, D., Haux, R., Pohl, U., Rebel, S., Ziegler, S., & Ammenwerth, E. (2001) · Methods of Information in Medicine · doi:10.1055/s-0038-1634465 · Cited by 128
Evaluation of Medical Practices
Fineberg, H. V., & Hiatt, H. H. (1979) · New England Journal of Medicine · doi:10.1056/nejm197911153012004 · Cited by 123
Weiner, M., Gress, T., Thiemann, D. R., Jenckes, M. W., Reel, S., Mandell, S. F., & Bass, E. B. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.0060234 · Cited by 112
Evaluating the Impact of Health Care Information Systems
Anderson, J. G., & Aydin, C. E. (1997) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300010436 · Cited by 95
LARRABEE, J. H., Boldreghini, S., Elder-Sorrells, K., Turner, Z., Wender, R. G., Hart, J. M., & Lenzi, P. S. (2001) · PubMed · Cited by 87
The impact of computerized documentation on nurses' use of time.
Pabst, M., Scherubel, J. C., & Minnick, A. F. (1996) · PubMed · Cited by 86
Use and Impact of Computers in Clinical Medicine
Anderson, J. G., & Jay, S. J. (1987) · Computers and medicine · doi:10.1007/978-1-4613-8674-2 · Cited by 80
Patient-Centered Documentation
Allan, J., & Englebright, J. D. (2000) · JONA The Journal of Nursing Administration · doi:10.1097/00005110-200002000-00006 · Cited by 73
‘CHEATS’: a generic information communication technology (ICT) evaluation framework
Shaw, N. T. (2002) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(02)00016-1 · Cited by 69
A Qualitative Comparison of Paper Flowsheets vs A Computer-Based Clinical Information System
Hammond, J., Johnson, H. M., Varas, R. P., & Ward, C. G. (1991) · CHEST Journal · doi:10.1378/chest.99.1.155 · Cited by 62
Clinical data systems, part 3: development and evaluation
Wyatt, J. C. (1994) · The Lancet · doi:10.1016/s0140-6736(94)90463-4 · Cited by 62
Broadening our approach to evaluating medical information systems.
Forsythe, D. E., & Buchanan, B. G. (1991) · PubMed · Cited by 60
The Computer-Based Patient Record Challenges Towards Timeless and Spaceless Medical Practice
Sicotte, C., Denis, J., Lehoux, P., & Champagne, F. (1998) · Journal of Medical Systems · doi:10.1023/a:1022661701101 · Cited by 55
Culture counts: how institutional values affect computer use.
Kaplan, B. (2000) · PubMed · Cited by 52
Point of care technology: impact on people and paperwork.
Dennis, K. E., Sweeney, P., MacDonald, L., & Morse, N. (1993) · PubMed · Cited by 51
Marasovic, C., Kenney, C., Elliott, D., & Sindhusake, D. P. (1997) · PubMed · Cited by 48
People, Organizational, and Social Issues: Evaluation as an exemplar
Kaplan, B., & Shaw, N. T. (2002) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638129 · Cited by 46
Effect of automatic record keeping on vigilance and record keeping time
ALLARD, J., Dzwonczyk, R. R., Yablok, D. O., Block, F. E., & McDonald, J. S. (1995) · British Journal of Anaesthesia · doi:10.1093/bja/74.5.619 · Cited by 44
Assessment of a computerized medical record system: disclosing scripts of use
Lehoux, P., Sicotte, C., & Denis, J.-L. (1999) · Evaluation and Program Planning · doi:10.1016/s0149-7189(99)00034-8 · Cited by 43
Time differences in handwritten and computer documentation of nursing assessment.
Minda, S. A., & Brundage, D. (1995) · PubMed · Cited by 42
Pretest and post-test attitudes of nursing personnel toward a patient care information system.
Murphy, C., Maynard, M., & Morgan, G. (1994) · PubMed · Cited by 39
Automated Ambulatory Medical Records Systems: An Orphan Technology
Schoenbaum, S. C., & Barnett, G. O. (1992) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300002300 · Cited by 37
Bedside terminals and quality of nursing documentation.
Marr, P. B., Duthie, E. A., Glassman, K. S., Janovas, D. M., Kelly, J. B., Graham, E., Kovner, C. T., Rienzi, A., Roberts, N. K., & Schick, D. (1993) · PubMed · Cited by 35
Evaluating large scale health information systems: from practice towards theory.
Heathfield, H., Peel, V., Hudson, P., Kay, S., Mackay, L., Marley, T., Nicholson, L., Roberts, R., & Williams, J. G. (1997) · Europe PMC (PubMed Central) · Cited by 34
Toward an Evaluation of an Integrated Clinical Imaging System: Identifying Clinical Benefits
Lundsgaarde, H. P., & Kaplan, B. (1996) · Methods of Information in Medicine · doi:10.1055/s-0038-1634674 · Cited by 34
Stepwise Evaluation of Information Systems in an University Hospital
Kuch, R., Prokosch, H.-U., Dudeck, J., & Bürkle, T. (1999) · Methods of Information in Medicine · doi:10.1055/s-0038-1634150 · Cited by 33
Increasing the acceptance of clinical information systems.
Anderson, J. D. (1999) · PubMed · Cited by 32
Grémy, F., & Patrice Degoulet, A. (1993) · Medical Informatics · doi:10.3109/14639239309025309 · Cited by 31
Standard obstetric record charting system: evaluation of a new electronic medical record
Nielsen, P. E. (2000) · Obstetrics and Gynecology · doi:10.1016/s0029-7844(00)01073-5 · Cited by 30
Abenstein, J. P., Devos, C., Abel, A., & Tarhan, S. (1992) · International journal of clinical monitoring and computing · doi:10.1007/bf01142189 · Cited by 29
van der Loo, R. P., van Gennip, E. M. S. J., Bakker, A. R., Hasman, A., & Rutten, F. (1995) · Computer Methods and Programs in Biomedicine · doi:10.1016/0169-2607(95)01659-h · Cited by 29
Three Years' Experience with a Patient Data Management System at a Neonatal Intensive Care Unit
Urschitz, M. S., Lorenz, S., Unterasinger, L., Metnitz, P. G. H., Preyer, K., & Popow, C. (1998) · Journal of Clinical Monitoring and Computing · doi:10.1023/a:1007467831587 · Cited by 25
Integrating computerized anesthesia charting into a hospital information system
Wang, X., Gardner, R. M., & Seager, P. R. (1995) · International journal of clinical monitoring and computing · doi:10.1007/bf01142485 · Cited by 24
Evaluation of Medical Practices
Frazier, H. S., & Hiatt, H. H. (1978) · Science · doi:10.1126/science.417402 · Cited by 23
Embracing or Rejecting Innovations: Clinical Diffusion of Health Care Technology
Banta, H. D. (1984) · Computers and medicine · doi:10.1007/978-1-4613-8674-2_10 · Cited by 22
The Winchester Experience with the TDS Hospital Information System
HARRISON, G. S. M. (1991) · British Journal of Urology · doi:10.1111/j.1464-410x.1991.tb15201.x · Cited by 22
Clinical evaluation of a computer-based patient monitoring and data management system.
Hammond, J., Johnson, H. M., Ward, C. G., Varas, R. P., Dembicki, R., & Marcial, E. H. (1991) · PubMed · Cited by 22
Østbye, T., Moen, A., Erikssen, G., & Hurlen, P. (1997) · Journal of Medical Systems · doi:10.1023/a:1022894324357 · Cited by 19
Markert, D. J., Haney, P. J., & Allman, R. M. (1997) · Academic Radiology · doi:10.1016/s1076-6332(97)80015-3 · Cited by 17
Automated Nursing Documentation System Provides a Favorable Return on Investment
Kabl, K., Ivancin, L., & Fubrmann, M. (1991) · JONA The Journal of Nursing Administration · doi:10.1097/00005110-199111000-00011 · Cited by 17
A Computerized System for Entering Orders to Limit Treatment: Implementation and Evaluation
Sulmasy, D. P., & Marx, E. S. (1997) · The Journal of Clinical Ethics · doi:10.1086/jce199708306 · Cited by 12
GOODMAN, E. (1998) · International Journal of Information Management · doi:10.1016/s0268-4012(97)00054-6 · Cited by 5
Meyer, K. E., Altamore, R., Chapko, M. K., Miner, M. N., McGann, M. E., Hill, E., Duesen-Lucas, C. V., Bates, M. J., Weir, C. R., & Lincoln, T. (1998) · PubMed · Cited by 3
A Computer-based Clinical Information System
El-Gamal, S. S. (1987) · Methods of Information in Medicine · doi:10.1055/s-0038-1635501 · Cited by 3
Flagged first, then by citations
Cited by
Sorted by citations
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Häyrinen, K., Saranto, K., & Nykänen, P. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.09.001 · Cited by 1,374
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126
Yusof, M. M., Kuljis, J., Papazafeiropoulou, A., & Stergioulas, L. K. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.08.011 · Cited by 740
Metadata
- Authors
- van der Meijden, M. J.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2003-01-28
- Volume
- 10
- Issue
- 3
- Pages
- 235-243
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC342046
- OpenAlex
- W2108856141
- Cited by
- 363
- References
- 61
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 9 · 2023: 7 · 2022: 5 · 2021: 11 · 2020: 9 · 2019: 13 · 2018: 11 · 2017: 13 · 2016: 16 · 2015: 31 · 2014: 25 · 2013: 21 · 2012: 31
- FWCI
- 2.38
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- clinical information systems, system success factors, system quality, information quality, user satisfaction, organizational impact, organizational culture, system evaluation
- MeSH terms
- Computer Systems, Consumer Behavior, Evaluation Studies as Topic, Hospital Information Systems, Humans, Nursing Records, Organizational Innovation, Organizational Culture, Medical Records Systems, Computerized, Computer Security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
