Experience with a structure, process and outcome framework for evaluating an information system

Systems Thinking, Systems Practice

Checkland, P. B. (1981) · Cumulative Index of Computer Aided Architectural Design · Cited by 6,256 · see citing works

Building expert systems

Hayes-Roth, F. A., WATERMAN, D. A., & Lenat, D. B. (1983) · Andalas University Repository (Andalas University) · Cited by 1,699 · see citing works

Systems thinking, systems practice

Huggett, R. J. (1982) · Applied Geography · doi:10.1016/0143-6228(82)90039-x · Cited by 995 · see citing works

The Quality of Medical Care

Donabedian, A. (1978) · Science · doi:10.1126/science.417400 · Cited by 571 · see citing works

Validating Expert System Performance

O’Keefe, R. M., Balcı, O., & Smith, E. P. (1987) · IEEE Expert · doi:10.1109/mex.1987.5006538 · Cited by 359 · see citing works

Evaluating medical expert systems: what to test and how?

Wyatt, J. C., & Spiegelhalter, D. J. (1990) · Medical Informatics · doi:10.3109/14639239009025268 · Cited by 196 · see citing works

How to Assess Your It Investment: A Study of Methods and Practice

Farbey, B., Land, F. F., & Targett, D. (1993) · Medical Entomology and Zoology · Cited by 183 · see citing works

Information Technology Evaluation: Is It Different?

Powell, P. L. (1992) · Journal of the Operational Research Society · doi:10.1057/jors.1992.4 · Cited by 172 · see citing works

Diagnosis of an information system failure

Davis, G. B., Lee, A. S., Nickles, K. R., Chatterjee, S., Hartung, R., & Wu, Y. (1992) · Information & Management · doi:10.1016/0378-7206(92)90059-o · Cited by 118 · see citing works

Useful approach for evaluating expert systems

Liebowitz, J. (1986) · Expert Systems · doi:10.1111/j.1468-0394.1986.tb00198.x · Cited by 98 · see citing works

Social implications of computers in developing countries

Bhatnagar, S. C., & Odedra, M. (1992) · Tata McGraw-Hill eBooks · Cited by 93 · see citing works

Expert Systems and Decision Support in Medicine

Rienhoff, O., Piccolo, U., & Schneider, B. (1988) · Lecture notes in medical informatics · doi:10.1007/978-3-642-48706-4 · Cited by 63 · see citing works

The evaluation of decision-aiding systems: Guidelines and methods

O’Keefe, R. M. (1989) · Information & Management · doi:10.1016/0378-7206(89)90045-1 · Cited by 60 · see citing works

On evaluating AI systems for medical diagnosis

Chandrasekaran, B. (1989) · American Association for Artificial Intelligence eBooks · Cited by 55 · see citing works

Developing Information Systems: Concepts, Issues and Practice

Avgerou, C., & Cornford, T. (1998) · doi:10.1007/978-1-349-14813-4 · Cited by 48 · see citing works

Evaluation of Expert Systems

Hollnagel, E. (1989) · Studies in computer science and artificial intelligence · doi:10.1016/b978-0-444-87321-7.50019-3 · Cited by 36 · see citing works

Meeting the Challenge: Informatics and Medical Education

Pagès, J.-C., Levy, A. H., Anderson, J., & Grémy, F. (1983) · Elsevier eBooks · Cited by 35 · see citing works

Expert system evaluation techniques: a selected bibliography

Grogono, P. D., Batarekh, A., Preece, A. D., Shinghal, R., & Suen, C. Y. (1991) · Expert Systems · doi:10.1111/j.1468-0394.1991.tb00371.x · Cited by 34 · see citing works

The potential for computer-aided diagnosis of tropical diseases in developing countries: An expert system case study

Doukidis, G. I., & Forster, D. (1990) · European Journal of Operational Research · doi:10.1016/0377-2217(90)90345-c · Cited by 12 · see citing works

Computerization in Developing Countries

Lind, P. (2018) · Routledge eBooks · doi:10.4324/9781351142281 · Cited by 12 · see citing works

On the Assessment of Medical Expert Systems

Rossi-Mori, A., & Ricci, F. L. (1988) · Lecture notes in medical informatics · doi:10.1007/978-3-642-48706-4_46 · Cited by 11 · see citing works

A hand-held decision-aid system designed for rural health workers

Auvert, B., Aegerter, P., Look, F. V., Du-Boutin, L. T. H., Boutin, P., Monier, J. L., Emmanuelli, X., Gilbos, V., & Benillouche, E. (1986) · Computers and Biomedical Research · doi:10.1016/0010-4809(86)90008-x · Cited by 10 · see citing works

Medical expert systems for developing countries: Evaluation in practice

Doukidis, G., Cornford, T., & Forster, D. (1994) · Expert Systems with Applications · doi:10.1016/0957-4174(94)90039-6 · Cited by 9 · see citing works

Sympmed I: computer program for primary health care.

Uplekar, M., Antia, N. H., & Dhumale, P. S. (1988) · BMJ · doi:10.1136/bmj.297.6652.841 · Cited by 9 · see citing works

Information systems assessment

(1986) · Information & Management · doi:10.1016/0378-7206(86)90012-1 · Cited by 9 · see citing works

Computerization in Developing Countries

Lind, P. (2006) · Routledge eBooks · doi:10.4324/9780203012819 · Cited by 7 · see citing works

Developing information systems. Concepts, issues and practice

Bawden, D. (1993) · International Journal of Information Management · doi:10.1016/0268-4012(93)90009-s · Cited by 7 · see citing works

Health informatics in developing countries: Experiences and viewpoints

Davies, I. J. T. (1984) · International Journal of Bio-Medical Computing · doi:10.1016/0020-7101(84)90049-7 · Cited by 6 · see citing works

Should we be surprised at expert system success ?

Powell, P. L. (1992) · Information Systems Journal · doi:10.1111/j.1365-2575.1992.tb00082.x · Cited by 4 · see citing works

Implementing ESTROPID — An Expert System for Tropical Diseases

Forster, D., & Doukidis, G. I. (1989) · Lecture notes in medical informatics · doi:10.1007/978-3-642-93437-7_11 · Cited by 2 · see citing works

Healthcare professionals’ organisational barriers to health information technologies—A literature review

Lluch, M. (2011) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.09.005 · Cited by 358 · see citing works

Implementation and adoption of nationwide electronic health records in secondary care in England: final qualitative results from prospective national evaluation in early adopter hospitals

Sheikh, A., Cornford, T., Barber, N., Avery, A., Takian, A., Lichtner, V., Petrakaki, D., Crowe, S., Marsden, K., Robertson, A., et al. (2011) · BMJ · doi:10.1136/bmj.d6054 · Cited by 314 · see citing works

The impact of a closed-loop electronic prescribing and administration system on prescribing errors, administration errors and staff time: a before-and-after study

Franklin, B. D., O'Grady, K., Donyai, P., Jacklin, A., & Barber, N. (2007) · BMJ Quality & Safety · doi:10.1136/qshc.2006.019497 · Cited by 315 · see citing works

Implementation and adoption of nationwide electronic health records in secondary care in England: qualitative analysis of interim results from a prospective national evaluation

Robertson, A., Cresswell, K., Takian, A., Petrakaki, D., Crowe, S., Cornford, T., Barber, N., Avery, A., Fernando, B., Jacklin, A., et al. (2010) · BMJ · doi:10.1136/bmj.c4564 · Cited by 230 · see citing works

Persuasiveness of expert systems

Dijkstra, J. J., Liebrand, W. B. G., & Timminga, E. (1998) · Behaviour & Information Technology · doi:10.1080/014492998119526 · Cited by 161 · see citing works

Evidence-Based Evaluation of eHealth Interventions: Systematic Literature Review

Enam, A., Torres-Bonilla, J., & Eriksson, H. (2018) · Journal of Medical Internet Research · doi:10.2196/10971 · Cited by 147 · see citing works

Evaluating policy and service interventions: framework to guide selection and interpretation of study end points

Lilford, R. J., Chilton, P. J., Hemming, K., Girling, A. J., Taylor, C. A., & Barach, P. (2010) · BMJ · doi:10.1136/bmj.c4413 · Cited by 146 · see citing works

Future Directions in Evaluation Research: People, Organizational, and Social Issues

Shaw, N. T., & Kaplan, B. (2004) · Methods of Information in Medicine · doi:10.1055/s-0038-1633862 · Cited by 141 · see citing works

A critical approach to evaluation

Klecuń, E., & Cornford, T. (2005) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000540 · Cited by 115 · see citing works

Developing and Applying a Formative Evaluation Framework for Health Information Technology Implementations: Qualitative Investigation

Cresswell, K. M., Williams, R., & Sheikh, A. (2020) · Journal of Medical Internet Research · doi:10.2196/15068 · Cited by 111 · see citing works

We are bitter, but we are better off: case study of the implementation of an electronic health record system into a mental health hospital in England

Takian, A., Sheikh, A., & Barber, N. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-484 · Cited by 94 · see citing works

Evaluating eHealth: How to Make Evaluation More Methodologically Robust

Lilford, R. J., Foster, J., & Pringle, M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000186 · Cited by 79 · see citing works

Evaluation of medium-term consequences of implementing commercial computerized physician order entry and clinical decision support prescribing systems in two 'early adopter' hospitals

Cresswell, K. M., Bates, D. W., Williams, R., Morrison, Z., Slee, A., Coleman, J. J., Robertson, A. R. R., Sheikh, A., Avery, A. J., Blake, L., et al. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002252 · Cited by 76 · see citing works

Framework for Selecting Best Practices in Public Health: A Systematic Literature Review

Ng, E., & de Colombani, P. (2015) · Journal of Public Health Research · doi:10.4081/jphr.2015.577 · Cited by 76 · see citing works

Qualitative evaluation of an electronic prescribing and administration system

Barber, N., Cornford, T., & Klecuń, E. (2007) · BMJ Quality & Safety · doi:10.1136/qshc.2006.019505 · Cited by 69 · see citing works

Information Infrastructures within European Health Care

Mozaffar, H., Williams, R., Cresswell, K. M., Pollock, N., Morison, Z., & Sheikh, A. (2017) · Health informatics · doi:10.1007/978-3-319-51020-0 · Cited by 65 · see citing works

Implementing and adopting electronic health record systems

Cresswell, K. M., Worth, A., & Sheikh, A. (2011) · Clinical Governance An International Journal · doi:10.1108/14777271111175369 · Cited by 59 · see citing works

That’s nice, but what does IT do? Evaluating the impact of bar coded medication administration by measuring changes in the process of care

Holden, R. J., Brown, R., Alper, S. J., Scanlon, M. C., Patel, N., & Karsh, B. (2011) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2011.02.007 · Cited by 53 · see citing works

Undertaking sociotechnical evaluations of health information technologies

Cresswell, K. M., & Sheikh, A. (2014) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v21i2.54 · Cited by 53 · see citing works

Building a house on shifting sand: methodological considerations when evaluating the implementation and adoption of national electronic health record systems

Takian, A., Petrakaki, D., Cornford, T., Sheikh, A., & Barber, N. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-105 · Cited by 51 · see citing works

The ISSUE methodology for quantifying benefits from information systems

Giaglis, G. M., Mylonopoulos, N. A., & Doukidis, G. I. (1999) · Logistics Information Management · doi:10.1108/09576059910256259 · Cited by 49 · see citing works

People, Organizational, and Social Issues: Evaluation as an exemplar

Kaplan, B., & Shaw, N. T. (2002) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638129 · Cited by 46 · see citing works

Soft Systems Methodology: A Context Within a 50-Year Retrospective of OR/MS

Reisman, A., & Oral, M. (2005) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.1050.0129 · Cited by 34 · see citing works

The gradient in health inequalities among families and children: A review of evaluation frameworks

Davies, J. K., & Sherriff, N. (2010) · Health Policy · doi:10.1016/j.healthpol.2010.09.015 · Cited by 31 · see citing works

Unravelling causal and temporal influences underpinning monitoring systems success: A typological approach

Iannacci, F., & Cornford, T. (2017) · Information Systems Journal · doi:10.1111/isj.12145 · Cited by 31 · see citing works

Evaluation and telehealth - an interpretative study

Klecuń, E., & Cornford, T. (2005) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2001.926564 · Cited by 30 · see citing works

Organizational learning in the implementation and adoption of national electronic health records: Case studies of two hospitals participating in the National Programme for Information Technology in England

Takian, A., Sheikh, A., & Barber, N. (2014) · Health Informatics Journal · doi:10.1177/1460458213493196 · Cited by 28 · see citing works

Unpacking ostensive and performative aspects of organisational routines in the context of monitoring systems: A critical realist approach

Iannacci, F., & Hatzaras, K. (2011) · Information and Organization · doi:10.1016/j.infoandorg.2011.10.002 · Cited by 23 · see citing works

Health information communication technology evaluation frameworks for pharmacist prescribing: A systematic scoping review

Ogundipe, A., Sim, T. F., & Emmerton, L. (2022) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2022.09.010 · Cited by 22 · see citing works

Approaches to Recording Drug Allergies in Electronic Health Records: Qualitative Study

Fernando, B., Morrison, Z., Kalra, D., Cresswell, K. M., & Sheikh, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0093047 · Cited by 21 · see citing works

English community pharmacists’ experiences of using electronic transmission of prescriptions: a qualitative study

Garfield, S., Hibberd, R. E., & Barber, N. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-435 · Cited by 20 · see citing works

Safer, faster, better? Evaluating electronic prescribing

Barber, N., Franklin, B. D., Cornford, T., Klecuń, E., & Savage, I. (2006) · UCL Discovery (University College London) · Cited by 18 · see citing works

The Long and Winding Road: An Independent Evaluation of the Implementation and Adoption of the National Health Service Care Records Service (NHS CRS) in Secondary Care in England

Cresswell, K. M., Ali, M., Avery, A. J., Barber, N., Cornford, T., Crowe, S., Fernando, B., Jacklin, A., Jani, Y. H., Klecuń, E., et al. (2011) · Figshare · Cited by 18 · see citing works

Evaluation as a Multi-Ontological Endeavour: A Case from the English National Program for IT in Healthcare

Klecuń, E., Lichtner, V., Cornford, T., & Petrakaki, D. (2014) · Journal of the Association for Information Systems · doi:10.17705/1jais.00354 · Cited by 17 · see citing works

Envisioning Electronic Health Record Systems as Change Management: The Experience of an English Hospital Joining the National Programme for Information Technology

Takian, A. (2012) · Studies in health technology and informatics · doi:10.3233/978-1-61499-101-4-901 · Cited by 18 · see citing works

Qualitative Evaluation of a Text Messaging Intervention to Support Patients With Active Tuberculosis: Implementation Considerations

Iribarren, S., Sward, K. A., Beck, S. L., Pearce, P. F. F., Thurston, D., & Chirico, C. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.3971 · Cited by 18 · see citing works

Digital Twins for Engineering Asset Management: Synthesis, Analytical Framework, and Future Directions

Li, Y., Wang, Q., Pan, X., Zuo, J., Xu, J., & Han, Y. (2024) · Engineering · doi:10.1016/j.eng.2023.12.006 · Cited by 15 · see citing works

Inpatient Clinical Information Systems

Cresswell, K. M., & Sheikh, A. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809523-2.00002-9 · Cited by 14 · see citing works

Lessons learned from England's national electronic health record implementation

Cresswell, K. M., Robertson, A. R. R., & Sheikh, A. (2012) · International Health Informatics Symposium · doi:10.1145/2110363.2110441 · Cited by 14 · see citing works

Combining business and network simulation models for IT investment evaluation

Giaglis, G. M., Paul, R. J., & O’Keefe, R. M. (2003) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1999.772717 · Cited by 8 · see citing works

Incorporating an Intelligent Tutoring System Into a Game-Based Auditory Rehabilitation Training for Adult Cochlear Implant Recipients: Algorithm Development and Validation

Gnadlinger, F., Werminghaus, M., Selmanagić, A., Filla, T., Richter, J., Kriglstein, S., & Klenzner, T. (2024) · JMIR Serious Games · doi:10.2196/55231 · Cited by 7 · see citing works

Handwritten to Electronic Prescriptions: Emerging Views and Practices, Saudi Arabia

Qureshi, N. A. (2014) · Journal of Advances in Medicine and Medical Research · doi:10.9734/bjmmr/2014/10962 · Cited by 7 · see citing works

Evaluating Monitoring Systems in the European Social Fund Context

Iannacci, F., Cornford, T., Cordella, A., & Grillo, F. (2009) · Evaluation Review · doi:10.1177/0193841x09336262 · Cited by 7 · see citing works

The Secondary Use of Data to Support Medication Safety in the Hospital Setting: A Systematic Review and Narrative Synthesis

Chaudhry, N. T., Franklin, B. D., Mohammed, S., & Benn, J. J. (2021) · Pharmacy · doi:10.3390/pharmacy9040198 · Cited by 6 · see citing works

A media analysis approach to evaluating national health information infrastructure development

Cockcroft, S. (2009) · Journal of Systems and Information Technology · doi:10.1108/13287260910983605 · Cited by 5 · see citing works

Understanding Innovation Deployment and Evaluation in Healthcare: The Triality Framework

Sharma, U., Barnett, J. C., & Clarke, M. (2012) · InTech eBooks · doi:10.5772/35671 · Cited by 4 · see citing works

An interpetive approach in the evaluation of homecare telematics interventions

Kaldoudi, E., Chatzopoulou, A., & Vargemezis, V. A. (2009) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/1579114.1579171 · Cited by 4 · see citing works

An interpretative evaluation of a healthcare intranet

Klecuń, E., & Cornford, T. (2003) · International Journal of Healthcare Technology and Management · doi:10.1504/ijhtm.2003.004163 · Cited by 4 · see citing works

England’s Electronic Prescription Service

Hibberd, R. E., Cornford, T., Lichtner, V., Venters, W., & Barber, N. (2017) · Health informatics · doi:10.1007/978-3-319-51020-0_8 · Cited by 3 · see citing works

Adapting the STARE-HI Guidelines for the Evaluation of Home Care Telehealth Applications: An Interpretive Approach

Kaldoudi, E., Chatzopoulou, A., & Vargemezis, V. A. (2009) · Cited by 3 · see citing works

Healthcare at the Crossroads: Impacts of Online Health Community on Off-line Healthcare Quality and Equity

Wu, J., Fang, Y., Zhao, J. L., & Zhu, X. (2025) · Information Systems Research · doi:10.1287/isre.2022.0250 · Cited by 3 · see citing works

A cost-benefit evaluation method for web-based information systems

Paris, C. L., Colineau, N., & Wilkinson, R. G. (2009) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/1557914.1557985 · Cited by 1 · see citing works

Implementation of a Hospital Library Automation Project in Mexico: Learning from Experience

Macías-Chapula, C. A. (2001) · The Electronic Journal of Information Systems in Developing Countries · doi:10.1002/j.1681-4835.2001.tb00035.x · Cited by 1 · see citing works

Social construction of IS evaluation: a case study of IT investment appraisal

Baygeldi, M. (2011) · London School of Economics and Political Science Theses Online (London School of Economics and Political Science)

Understanding the processes of Information Systems deployment and evaluation: the challenges facing e-health

Sharma, U. (2011) · Brunel University Research Archive (BURA) (Brunel University London)

Evaluation of Telecare Services

Chatzopoulou, A., & Kaldoudi, E. (2008)

On the use of computerised decision aids

Dijkstra, J. J. (2006)

Special Section: Cyberethics: The Internet and Allied Technologies Ethical Perspectives in Evaluation of Telehealth

Cornford, T., & Klecuń, E. (2001)

The evolving landscape of electronic prescribing in UK secondary care: exploration of uptake, benefits, and challenges

Ahmed, Z. (2016) · UCL Discovery (University College London)

Towards Eco-Sustainability and Green Analytics Model to Measure the Performance of Big Data Systems

Jusoh, Y. Y., Abdullah, R., Nor, R. N. H., Yahaya, J. H., Muhammad, S., & Arunachalam, A. R. D. O. (2023) · International Conference on Information Management · doi:10.1109/icim58774.2023.00007

UML-based evaluation framework system for National Health Information System

Wen-xu, J. (2015) · Zhonghua yixue tushu qingbao zazhi

A Framework for Evaluation of Medical Information Systems

Turunen, P. (2003) · Studies in health technology and informatics · doi:10.3233/978-1-60750-939-4-611 · Cited by 3 · see citing works

The evaluation of expert diagnostic systems — How to assess outcomes and quality parameters?

Nøhr, C. (1994) · Artificial Intelligence in Medicine · doi:10.1016/0933-3657(94)90041-8 · Cited by 17 · see citing works

Outcomes Assessment, Quality Assurance and Evaluation of Expert Diagnostic Systems

Nøhr, C. G. (1991) · Lecture notes in medical informatics · doi:10.1007/978-3-642-93503-9_65 · Cited by 1 · see citing works

A framework for information systems evaluation: the case of an integrated community‐based health services delivery system

Leonard, K. J., & Mercer, K. (2000) · Leadership in health services · doi:10.1108/13660750010326884 · Cited by 8 · see citing works