Health information systems: Failure, success and improvisation
Open accessAbstract
Background and purpose The generalised assumption of health information systems (HIS) success is questioned by a few commentators in the medical informatics field. They point to widespread HIS failure. The purpose of this paper was therefore to develop a better conceptual foundation for, and practical guidance on, health information systems failure (and success).Methods Literature and case analysis plus pilot testing of developed model.Results Defining HIS failure and success is complex, and the current evidence base on HIS success and failure rates was found to be weak. Nonetheless, the best current estimate is that HIS failure is an important problem. The paper therefore derives and explains the "design-reality gap" conceptual model. This is shown to be robust in explaining multiple cases of HIS success and failure, yet provides a contingency that encompasses the differences which exist in different HIS contexts. The design-reality gap model is piloted to demonstrate its value as a tool for risk assessment and mitigation on HIS projects. It also throws into question traditional, structured development methodologies, highlighting the importance of emergent change and improvisation in HIS.Conclusions The design-reality gap model can be used to address the problem of HIS failure, both as a post hoc evaluative tool and as a pre hoc risk assessment and mitigation tool. It also validates a set of methods, techniques, roles and competencies needed to support the dynamic improvisations that are found to underpin cases of HIS success.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previous studies show telecare does not always fulfill its potential because developed products and services do not fit end-users' needs and preferences or the context in which they should be implemented.
“Unfortunately, previous studies show that telecare does not always fulfill its potential because the telecare products and services that are developed do not fit the needs and preferences of end-users or because they do not fit the context in which they should be implemented [9-12].”
From Experiences of Multidisciplinary Development Team Members During User-Centered Design of Telecare Products and Services: A Qualitative Study (2014) · cites this paper as [12]
Neglecting the situatedness of expected challenges may lead to misinterpretation of challenges and ultimately to poor project design and disappointing results.
“Neglecting this may lead to a misinterpretation of the challenges at hand, and ultimately to poor project design and disappointing results [34, 40, 71].”
From Situating mobile health: a qualitative study of mHealth expectations in the rural health district of Nouna, Burkina Faso (2017) · cites this paper as [71]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Task-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006 · see citing works
Software Engineering Economics
BOEHM, B. W. (1984) · Springer eBooks · doi:10.1007/978-3-642-48354-7_5 · Cited by 5,938 · see citing works
Field Theory in Social Science
French, R. L., Lewin, K., & Cartwright, D. (1953) · The American Journal of Psychology · doi:10.2307/1418749 · Cited by 5,192 · see citing works
Soft Systems Methodology in Action
Gough, T., Checkland, P. B., & Scholes, J. (1991) · Journal of the Operational Research Society · doi:10.2307/2583669 · Cited by 3,414 · see citing works
The rise and fall of strategic planning
(1995) · Long Range Planning · doi:10.1016/0024-6301(95)92105-2 · Cited by 3,307 · see citing works
Suchman, L. A. (1987) · Cited by 2,279 · see citing works
Field Theory in Social Science
Reed, R., & Lewin, K. (1951) · The American Catholic Sociological Review · doi:10.2307/3707800 · Cited by 2,144 · see citing works
Improvising Organizational Transformation Over Time: A Situated Change Perspective
Orlikowski, W. J. (1996) · Information Systems Research · doi:10.1287/isre.7.1.63 · Cited by 1,957 · see citing works
The rise and fall of strategic planning
Lawrence, M. F. (1994) · International Journal of Forecasting · doi:10.1016/0169-2070(94)90036-1 · Cited by 1,377 · see citing works
Business Strategic Orientation, Information Systems Strategic Orientation, and Strategic Alignment
Chan, Y. E., Huff, S. L., Barclay, D. W., & Copeland, D. G. (1997) · Information Systems Research · doi:10.1287/isre.8.2.125 · Cited by 1,157 · see citing works
Management strategies for information technology
(1990) · Long Range Planning · doi:10.1016/0024-6301(90)90040-b · Cited by 1,045 · see citing works
A Theory of Task/Technology Fit and Group Support Systems Effectiveness1
Zigurs, I., & Buckland, B. K. (1998) · MIS Quarterly · doi:10.2307/249668 · Cited by 1,027 · see citing works
Shaping technology/Building society
Bullard, C. W. (1994) · The Journal of Technology Transfer · doi:10.1007/bf02373670 · Cited by 873 · see citing works
Information systems failures—a survey and classification of the empirical literature
Lyytinen, K., & Hirschheim, R. (1988) · Oxford University Press eBooks · Cited by 729 · see citing works
Implementing information systems in health care organizations: myths and challenges
Berg, M. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00200-3 · Cited by 715 · see citing works
Wootton, R. (2001) · BMJ · doi:10.1136/bmj.323.7312.557 · Cited by 705 · see citing works
Soft systems methodology in action
Creemers, M. (1991) · European Journal of Operational Research · doi:10.1016/0377-2217(91)90052-w · Cited by 556 · see citing works
Evaluation Methods in Medical Informatics
Friedman, C. P., & Wyatt, J. C. (1997) · Computers and medicine · doi:10.1007/978-1-4757-2685-5 · Cited by 450 · see citing works
Why information systems fail: a case study approach
Sauer, C. (1993) · Cited by 409 · see citing works
Reinventing government in the information age
Heeks, R. (2002) · Routledge eBooks · doi:10.4324/9780203204962-7 · Cited by 401 · see citing works
Self-citationYearbook of Medical Informatics
International Medical Informatics Association (2017) · Yearbook of Medical Informatics · doi:10.1055/s-00034612 · Cited by 295 · see citing works
Snow, C. C., Knudsen, T., Håkonsson, D. D., Eriksen, B. H., & Burton, R. M. (2008) · Information and organisation design series · doi:10.1007/978-0-387-77776-4 · Cited by 277 · see citing works
The Struggle for District-Based Health Information Systems in South Africa
Braa, J., & Hedberg, C. (2002) · The Information Society · doi:10.1080/01972240290075048 · Cited by 257 · see citing works
E-Government as a Carrier of Context
HEEKS, R. (2005) · Journal of Public Policy · doi:10.1017/s0143814x05000206 · Cited by 233 · see citing works
Self-citationDoctors' use of electronic medical records systems in hospitals: cross sectional survey
Lærum, H., Ellingsen, G., & Faxvaag, A. (2001) · BMJ · doi:10.1136/bmj.323.7325.1344 · Cited by 226 · see citing works
Management information systems
Goel, A. (2007) · Springer eBooks · doi:10.1007/978-0-387-75105-4_4 · Cited by 223 · see citing works
Handbook of Medical Informatics
van Bemmel, J. H., & Musen, M. A. (1997) · Springer eBooks · Cited by 216 · see citing works
Implementing computerized physician order entry: the importance of special people
Ash, J. S. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00107-7 · Cited by 183 · see citing works
Ciborra, C. (2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199275267.001.0001 · Cited by 180 · see citing works
Beynon‐Davies, P. (1995) · European Journal of Information Systems · doi:10.1057/ejis.1995.20 · Cited by 159 · see citing works
Lessons from a failed information systems initiative: issues for complex organisations☆
Southon, G., SAUER, C., & Dampney, K. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00018-0 · Cited by 157 · see citing works
Lorenzi, N. M. (2002) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00105-3 · Cited by 150 · see citing works
Kovner, A. R. (1975) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271627542100157 · Cited by 149 · see citing works
Berg, M. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00178-8 · Cited by 140 · see citing works
Why Health Care Information Systems Succeed or FailPreprint
Heeks, R., Mundy, D., & Salazar, A. J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3540062 · Cited by 135 · see citing works
Self-citationBloomfield, B. P. (1991) · Social Studies of Science · doi:10.1177/030631291021004004 · Cited by 114 · see citing works
Towards a continuous evolution and adaptation of information systems in healthcare
Lenz, R., & Kuhn, K. A. (2003) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2003.09.003 · Cited by 111 · see citing works
Riet, A. V., Berg, M., Hiddema, F., & Sol, K. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00185-x · Cited by 100 · see citing works
Health information systems challenges: the Heidelberg conference and the future
Giuse, D. A. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00182-x · Cited by 89 · see citing works
The Internationalization of Public Management
McCourt, W., & Minogue, M. (2001) · Edward Elgar Publishing eBooks · doi:10.4337/9781781952757 · Cited by 89 · see citing works
Forsythe, D. E. (1996) · Medical Anthropology Quarterly · doi:10.1525/maq.1996.10.4.02a00100 · Cited by 87 · see citing works
Organizational issues in health informatics: a model approach
Aarts, J., Peel, V., & Wright, G. (1998) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(98)00142-7 · Cited by 68 · see citing works
Elson, R. B., Faughnan, J. G., & Connelly, D. P. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040266 · Cited by 67 · see citing works
Medical Informatics: Searching for Underlying Components
Musen, M. A. (2002) · Methods of Information in Medicine · doi:10.1055/s-0038-1634307 · Cited by 65 · see citing works
Information access at the point of care: what can we learn for designing a mobile CPR system?
Reuss, E. I., Menozzi, M., Büchi, M., Koller, J., & Krueger, H. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.02.003 · Cited by 57 · see citing works
Deciding the Future for IS Failures Not the Choice You Might Think
Sauer, C. (1999) · doi:10.1093/oso/9780198775331.003.0015 · Cited by 56 · see citing works
Jayasuriya, R. (1999) · International Journal of Information Management · doi:10.1016/s0268-4012(99)00031-6 · Cited by 44 · see citing works
Working IT Out in Medical Practice: IT Systems Design and Development as Co-Realisation
Hartswood, M. J., Rouchy, P., Rouncefield, M., Slack, R., Voss, A., & Procter, R. N. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634235 · Cited by 39 · see citing works
Is there life after evidence‐based medicine?
Porta, M. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2003.00473.x · Cited by 38 · see citing works
The impact of the transfer of information technology on development
Shields, P. G., & Servaes, J. (1989) · The Information Society · doi:10.1080/01972243.1989.9960068 · Cited by 35 · see citing works
The Success Factor Profile for clinical computer innovation.
Lorenzi, N. M., Smith, J. B., Conner, S. R., et al. (2004) · PubMed · Cited by 29 · see citing works
Bowns, I., Rotherham, G., & Paisley, S. (1999) · Health Informatics Journal · doi:10.1177/146045829900500305 · Cited by 29 · see citing works
Roesch, A., Gruber, H. G., Hawelka, B., et al. (2003) · Medical Informatics and the Internet in Medicine · doi:10.1080/14639230310001613430 · Cited by 27 · see citing works
Transforming the business : the IT contribution
Moreton, R., & Chester, M. F. (1997) · Cited by 25 · see citing works
Efficiency and safety of chemotherapy plans for children: CATIPO—a nationwide approach
Knaup, P., Timm, W., Bachert, A., Creutzig, U., Haux, R., & Schilling, F. H. (2002) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(01)00106-3 · Cited by 23 · see citing works
Testing Informatics Innovations: The Value of Negative Trials
Tierney, W. M., & McDonald, C. J. (1996) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1996.97035027 · Cited by 19 · see citing works
Ruland, C. M. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.08.004 · Cited by 15 · see citing works
Using information and communication technology in healthcare
Tyrrell, S. (2002) · Cited by 13 · see citing works
Information systems and public sector reform in the Third World
Heeks, R., & Mundy, D. (2001) · Edward Elgar Publishing eBooks · doi:10.4337/9781781952757.00017 · Cited by 13 · see citing works
Self-citationTaking Health Telematics into the 21st Century
Roberts, R. (2000) · Cited by 10 · see citing works
Chandani, Y., & Breton, G. (2001) · The Electronic Journal of Information Systems in Developing Countries · doi:10.1002/j.1681-4835.2001.tb00032.x · Cited by 8 · see citing works
Using Information and Communication Technology in Healthcare
Lorenzi, N. M., & Miller, L. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-137-10-200211190-00024 · Cited by 8 · see citing works
Healthcare Information Systems
Harsanyi, B. E., Wilson, D. H., Daniels, M. A., et al. (1995) · Computers in health care · doi:10.1007/978-1-4757-2428-8_19 · Cited by 6 · see citing works
Schramm, I., & Weber, V. (2001) · International Congress Series · doi:10.1016/s0531-5131(01)00151-0 · Cited by 6 · see citing works
The Clinical Information System
Dhillon, G. S. (2006) · Cases on information technology series · doi:10.4018/978-1-59904-396-0.ch021 · Cited by 5 · see citing works
Health information systems, ‘safety’ and organizational learning
Beynon‐Davies, P., & Lloyd-Williams, M. (1998) · Health Informatics Journal · doi:10.1177/146045829800400303 · Cited by 5 · see citing works
Risk Management in Information Technology Projects
Collins, P. S. (2002) · Auerbach Publications eBooks · doi:10.1201/9781420031409-26 · Cited by 5 · see citing works
Rapid Prototyping Strategy for a Surgical Data Warehouse
Tang, S., Huang, Y.-F., Hsiao, M.-L., et al. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634364 · Cited by 4 · see citing works
Eh, V. A., & Springer, H. C. (1995) · PubMed · Cited by 4 · see citing works
Gillis, P. A., Booth, H., Graves, J. R., et al. (1994) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230000619x · Cited by 3 · see citing works
Business modeling tools for managing decision support systems.
Edwards, G. A., & Bushko, R. G. (1995) · PubMed · Cited by 2 · see citing works
Lettiere, M. (2002) · Best practices · doi:10.1201/9781420031409.ch22 · Cited by 1 · see citing works
Risk Management in Information Technology Projects
Collins, P. (2002) · Best practices · doi:10.1201/9781420031409.ch18 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 8
- Galliers, W.L. Currie (Eds.) Rethinking Management Information Systems, Oxford University Press, Oxford, pp. 279309.
- A. Salazar, Evaluating information systems for decentralisation: health management reform in Ecuador, in: R.B. Heeks (Ed.) Reinventing Government in the Information Age, Routledge, London, 2001, pp. 156176.
- M.W. Guah, Evaluation and Analysis of Multimedia Information System Design and Implementation at the Coloscopy Unit of St. James University Hospital, Leeds, UK, MSc dissertation, Manchester: School of Management, UMIST, Manchester, 1998.
- M.F. Arnold, Tools for planning, in: M.F. Arnold, L.V. Blankenship, J.M. Hess (Eds.) Administering Health Systems, AldineAtherton, Chicago, 1971, pp. 250 262.
- M. Ashmore, M. Mulkay, T. Pinch, Health & Efficiency, Open University Press, Buckingham, 1990.
- C. Davies, Professionalism and the conundrum of care, in: B. Davey, A. Gray, C. Seale (Eds.) Health and Disease, Open University Press, Buckingham, 1995, pp. 346351.
- C. Scott, Public and Private Roles in Health Care Systems, Open University Press, Buckingham, 2001.
- L.O. Silva, J.C. Castro, E.O. Rodriguez, Outsourcing as an improvisation, IFIP WG9.4 Conference on Information Flows, Local Improvisations and Work Practices, Cape Town, 2000.
Cited by
Sorted by citations
Research on information systems failures and successes: Status update and future directions
Dwivedi, Y. K., Wastell, D., Laumer, S., Henriksen, H. Z., Myers, M. D., Bunker, D., Elbanna, A., Ravishankar, M. N., & Srivastava, S. C. (2015) · Information Systems Frontiers · doi:10.1007/s10796-014-9500-y · Cited by 448 · see citing works
Designing eHealth that Matters via a Multidisciplinary Requirements Development Approach
Van Velsen, L., Wentzel, J., & Van Gemert-Pijnen, J. E. (2013) · JMIR Research Protocols · doi:10.2196/resprot.2547 · Cited by 262 · see citing works
Fritz, F., Tilahun, B., & Dugas, M. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocu038 · Cited by 131 · see citing works
Emerging ICT implementation issues in aged care.
Kapadia, V., Ariani, A., Li, J., & Ray, P. K. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.07.002 · Cited by 83 · see citing works
Teixeira, L., Ferreira, C., & Santos, B. S. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2010.10.007 · Cited by 76 · see citing works
Organizational strategies for promoting patient and provider uptake of personal health records
Wells, S., Rozenblum, R., Park, A., Dunn, M., & Bates, D. W. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-003055 · Cited by 67 · see citing works
Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., & McCauley, E. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0637-x · Cited by 63 · see citing works
Duclos, V., Yé, M., Moubassira, K., Sanou, H., Sawadogo, N. H., Bibeau, G., & Sié, A. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0211-y · Cited by 59 · see citing works
Nucita, A., Bernava, G. M., Bartolo, M., Masi, F. D. P., Giglio, P., Peroni, M., Pizzimenti, G., & Palombi, L. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-42 · Cited by 40 · see citing works
Vermeulen, J., Verwey, R., Hochstenbach, L. M., van der Weegen, S., Man, Y. P., & de Witte, L. P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3195 · Cited by 35 · see citing works
Nyame-Asiamah, F. (2020) · Information Technology for Development · doi:10.1080/02681102.2019.1650326 · Cited by 28 · see citing works
- Authors
- HEEKS, R.
- Affiliations
- University of Manchester (GB)
- Corresponding author
- HEEKS, R
- ORCID
- HEEKS, R
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2006-02
- Volume
- 75
- Issue
- 2
- Pages
- 125-137
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W2144548612
- Cited by
- 654
- References
- 73
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 15 · 2023: 23 · 2022: 28 · 2021: 36 · 2020: 37 · 2019: 33 · 2018: 33 · 2017: 53 · 2016: 38 · 2015: 57 · 2014: 41 · 2013: 24 · 2012: 52
- FWCI
- 26.76
- Type
- journal article
- Language
- en
- Open access
- Licence
- Locations
- International Journal of Medical Informatics (publishedVersion)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- health information systems, contingency theory, risk assessment, risk mitigation, improvisation, emergent change, health information system development, project evaluation
- MeSH terms
- United Kingdom, Information Systems, Medical Informatics, Models, Theoretical, Organizational Innovation, Risk Management, State Medicine, Systems Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
