The DOI matches its Crossref record; 59 of the 60 references it cites were found in a registry or an index.
Why National eHealth Programs Need Dead Philosophers: Wittgensteinian Reflections on Policymakers’ Reluctance to Learn from History
Open accessAbstract
CONTEXT: Policymakers seeking to introduce expensive national eHealth programs would be advised to study lessons from elsewhere. But these lessons are unclear, partly because a paradigm war (controlled experiment versus interpretive case study) is raging. England's $20.6 billion National Programme for Information Technology (NPfIT) ran from 2003 to 2010, but its overall success was limited. Although case study evaluations were published, policymakers appeared to overlook many of their recommendations and persisted with some of the NPfIT's most criticized components and implementation methods. METHODS: In this reflective analysis, illustrated by a case fragment from the NPfIT, we apply ideas from Ludwig Wittgenstein's postanalytic philosophy to justify the place of the "n of 1" case study and consider why those in charge of national eHealth programs appear reluctant to learn from such studies. FINDINGS: National eHealth programs unfold as they do partly because no one fully understands what is going on. They fail when this lack of understanding becomes critical to the programs' mission. Detailed analyses of the fortunes of individual programs, articulated in such a way as to illuminate the contextualized talk and action ("language games") of multiple stakeholders, offer unique and important insights. Such accounts, portrayals rather than models, deliver neither statistical generalization (as with experiments) nor theoretical generalization (as with multisite case comparisons or realist evaluations). But they do provide the facility for heuristic generalization (i.e., to achieve a clearer understanding of what is going on), thereby enabling more productive debate about eHealth programs' complex, interdependent social practices. A national eHealth program is best conceptualized not as a blueprint and implementation plan for a state-of-the-art technical system but as a series of overlapping, conflicting, and mutually misunderstood language games that combine to produce a situation of ambiguity, paradox, incompleteness, and confusion. But going beyond technical "solutions" and engaging with these language games would clash with the bounded rationality that policymakers typically employ to make their eHealth programs manageable. This may explain their limited and contained response to the nuanced messages of in-depth case study reports. CONCLUSION: The complexity of contemporary health care, combined with the multiple stakeholders in large technology initiatives, means that national eHealth programs require considerably more thinking through than has sometimes occurred. We need fewer grand plans and more learning communities. The onus, therefore, is on academics to develop ways of drawing judiciously on the richness of case studies to inform and influence eHealth policy, which necessarily occurs in a simplified decision environment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This type of evaluation will inevitably be contingent and hence we emphasize the need for reflexivity among researchers and adaptation of perspectives as have other authors writing on similar studies [66].”
In the citing paper
“and conflicting interpretations of the programme by clinicians, service users, policy-makers, industry and technical designers.8,11”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,639
The Art of Case Study Research
Johnson, K. E., & Stake, R. E. (1996) · Modern Language Journal · doi:10.2307/329758 · Cited by 15,860
Administrative Behavior: A Study of Decision-Making Processes in Administrative Organization.
Brown, M., & Simon, H. A. (1978) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2065048 · Cited by 4,807
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Self-citation(2009) · Philosophical Investigations · doi:10.1111/(issn)1467-9205 · Cited by 2,366
The SAGE handbook of organizational research methods
Buchanan, D., & Bryman, A. E. (2009) · Cited by 2,123
The “Meaningful Use” Regulation for Electronic Health Records
Blumenthal, D., & Tavenner, M. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006114 · Cited by 2,059
The Idea of a Social Science and Its Relation to Philosophy.
Catton, W. R., & Winch, P. (1960) · American Sociological Review · doi:10.2307/2092093 · Cited by 1,546
Information, Systems and Information Systems-Making Sense of the Field.
Taket, A. R., Checkland, P. B., & Holwell, S. (1999) · Journal of the Operational Research Society · doi:10.2307/3010006 · Cited by 1,074
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1654.001.0001 · Cited by 1,071
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850
Available Light: Anthropological Reflections on Philosophical Topics
Strong, P. T. (2001) · American Anthropologist · doi:10.1525/aa.2001.103.3.864 · Cited by 740
Frame-critical policy analysis and frame-reflective policy practice
Rein, M., & Schön, D. A. (1996) · Knowledge, technology & policy/Knowledge in society/Knowledge, technology, & policy · doi:10.1007/bf02832235 · Cited by 687
Aramis or the love for technology
Czarniawska-Joerges, B. (1997) · Scandinavian Journal of Management · doi:10.1016/s0956-5221(97)88283-8 · Cited by 671
The Generative Properties Of Richness
Weick, K. E. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.24160637 · Cited by 554
Achieving a Nationwide Learning Health System
Friedman, C. P., Wong, A. K., & Blumenthal, D. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3001456 · Cited by 539
Technology as equivoque: Sensemaking in new technologies.
Weick, K. E. (1990) · Cited by 532
Wittgenstein: A Social Theory of Knowledge
Hekman, S. J., & Bloor, D. (1984) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2070834 · Cited by 473
Wilsford, D. (1994) · Journal of Public Policy · doi:10.1017/s0143814x00007285 · Cited by 414
Bloor, D. (1983) · doi:10.1007/978-1-349-17273-3 · Cited by 396
Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory
Greenhalgh, T., & Stones, R. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.12.034 · Cited by 371
Self-citationThe Idea of a Social Science and its Relation to Philosophy.
Goldstein, L. J., & Winch, P. (1960) · The Philosophical Review · doi:10.2307/2183560 · Cited by 348
Greenhalgh, T., Hinder, S., Stramer, K., Bratan, T., & Russell, J. (2010) · BMJ · doi:10.1136/bmj.c5814 · Cited by 343 · cited 15×
“Those aspects of the Summary Care Record and HealthSpace programs that failed could sometimes be traced back to a missioncritical loss of overview (or, sometimes, a change of job) by one of these pivotal individuals.”
BackgroundInfluentialSelf-citationEvaluating eHealth Interventions: The Need for Continuous Systemic Evaluation
Catwell, L., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000126 · Cited by 307
Evidence-Based Policymaking: A Critique
Greenhalgh, T., & Russell, J. (2009) · Perspectives in biology and medicine · doi:10.1353/pbm.0.0085 · Cited by 275
Self-citationGreenhalgh, T., Stramer, K., Bratan, T., Byrne, E., Russell, J., & Potts, H. W. W. (2010) · BMJ · doi:10.1136/bmj.c3111 · Cited by 275
Self-citationWhy Do Evaluations of eHealth Programs Fail? An Alternative Set of Guiding Principles
Greenhalgh, T., & Russell, J. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000360 · Cited by 273
Self-citation(2000) · Choice Reviews Online · doi:10.5860/choice.37-3384 · Cited by 262
Tuohy, C. H. (1999) · doi:10.1093/oso/9780195128215.001.0001 · Cited by 262
Simons, H. (1996) · Cambridge Journal of Education · doi:10.1080/0305764960260206 · Cited by 251
Robertson, A., Cresswell, K., Takian, A., Petrakaki, D., Crowe, S., Cornford, T., Barber, N., Avery, A., Fernando, B., Jacklin, A., et al. (2010) · BMJ · doi:10.1136/bmj.c4564 · Cited by 230
New Labour, modernisation and the medical labour process
HARRISON, S. (2002) · Journal of Social Policy · doi:10.1017/s0047279402006694 · Cited by 214 · cited 2×
“generally, however, while the experimental trial has a special place in the hearts of many doctors and while its epistemological foundations resonate strongly with the rationalist, “evidence-based” ideology that pervades contemporary policymaking (Greenhalgh and Russell 2009; Harrison 2002), few researchers with a bac…”
BackgroundHam, C., Hunter, D. J., & Robinson, R. (1995) · BMJ · doi:10.1136/bmj.310.6972.71 · Cited by 179
Tsoukas, H. (2009) · University of Warwick · doi:10.82444/warw.33668011 · Cited by 120
Shifting Tenses: Reconnecting Regimes of Truth and Hope
Brown, N. (2005) · Configurations · doi:10.1353/con.2007.0019 · Cited by 119
Jelinek, M., Goodman, P. S., Sproull, L. S., Fulk, J. L., & Steinfield, C. W. (1991) · Academy of Management Review · doi:10.2307/258926 · Cited by 115
Contemporary Technology Discourse and the Legitimation of Capitalism
Fisher, E. (2010) · European Journal of Social Theory · doi:10.1177/1368431010362289 · Cited by 102
Greenhalgh, T., Stramer, K., Bratan, T., Byrne, E., Russell, J., Hinder, S., & POTTS, H. W. W. (2010) · Cited by 83
Self-citationEvaluating eHealth: How to Make Evaluation More Methodologically Robust
Lilford, R. J., Foster, J., & Pringle, M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000186 · Cited by 79
Management Implications in Information Systems Research: The Untold Story
Ramiller, N. C., & Pentland, B. T. (2009) · Journal of the Association for Information Systems · doi:10.17705/1jais.00202 · Cited by 79
Wittgenstein and psychology: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3702 · Cited by 74
Games Real Actors Could Play: The Challenge of Complexity
Scharpf, F. W. (1991) · Journal of Theoretical Politics · doi:10.1177/0951692891003003003 · Cited by 67
Κlein, R. (2000) · Journal of Public Policy · doi:10.1017/s0143814x00380771 · Cited by 66
The case for randomized controlled trials to assess the impact of clinical information systems
Liu, J. L. Y., & Wyatt, J. C. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.010306 · Cited by 66
Wittgenstein and Psychology: A Practical Guide
Harré, R., & Tissaw, M. A. (2005) · Cited by 62
Will information and communication technology disrupt the health system and deliver on its promise?
Westbrook, J. I., & Braithwaite, J. (2010) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03968.x · Cited by 61
The Biggest Computer Programme in the World Ever! How's it Going?
Brennan, S. (2007) · Journal of Information Technology · doi:10.1057/palgrave.jit.2000104 · Cited by 60
Disciplining Information Systems: Truth and its Regimes
Introna, L. D. (2003) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000465 · Cited by 50
The patchwork: Health reform, American style
Marmor, T. R., & Oberlander, J. B. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.10.016 · Cited by 45
(2000) · doi:10.1515/9781400823406 · Cited by 44
The danger of words and writings on Wittgenstein
Drury, M. O., Berman, D. S., Fitzgerald, M., & Hayes, J. L. (1996) · Thoemmes eBooks · Cited by 39
IS Success and Failure—The Problem of Scale
Kreps, D., & Richardson, H. (2007) · The Political Quarterly · doi:10.1111/j.1467-923x.2007.00871.x · Cited by 39
Shotter, J., & Tsoukas, H. (2011) · Research in the sociology of organizations · doi:10.1108/s0733-558x(2011)0000032013 · Cited by 36
Meaningful Use of Information Technology: A Local Perspective
Hussain, A. A. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-10-201105170-00010 · Cited by 30
"To Be, or Not To Be" The Question of Runaway Projects
Sarup, D. (2003) · Cited by 5
EHR strategy: top down, bottom up or middle out?
Bowden, T. (2011) · PubMed · Cited by 3
Federal Auditor General's Report on Canada Health Infoway.
Whitt, M. R. (2010) · PubMed · Cited by 2
Greenhalgh, T., & Bowden, T. (2010) · PubMed · Cited by 1
Self-citation
Research works printed but not linked: 11
- Collins, 2007, Computer Weekly
- Collins, 2010, Computer World UK
- Department of Health, 2005, Connecting for Health: A Guide to the National Programme for Information Technology
- Department of Health, 2010, Liberating the NHS: An Information Revolution
- Latour, 1996, Aramis, or Love of Technology
- Markus, 1994, If We Build It, They Will Come: Designing Information Systems That People Want to Use, Sloan Management Review, 35, 11
- Monk, 1991, Wittgenstein: The Duty of Genius
- National Audit Office, 2011, The National Programme for IT in the NHS: An Update on the Delivery of Detailed Record Systems
- Pawson, 1997, Realistic Evaluation
- Sarup, 2003, Information Systems Control Journal 5
- Shekelle, 2009, Costs and Benefits of Health Information Technology: An Updated Systematic Review
Cited by
Sorted by citations
Lessons from Complex Interventions to Improve Health
Hawe, P. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031912-114421 · Cited by 607
A critical second look at integrated knowledge translation
Kothari, A. R., & Wathen, C. N. (2012) · Health Policy · doi:10.1016/j.healthpol.2012.11.004 · Cited by 301
Electronic health record acceptance by physicians: Testing an integrated theoretical model
Gagnon, M., Ghandour, E. K., Talla, P. K., Simonyan, D., Godin, G., Labrecque, M., Ouimet, M., & Rousseau, M. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.10.010 · Cited by 250
Leon, N., Schneider, H., & Daviaud, E. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-123 · Cited by 200
Using technology to deliver mental health services to children and youth: a scoping review.
Boydell, K., Hodgins, M., Pignatiello, A., Teshima, J., Edwards, H. E., & Willis, D. (2014) · Europe PMC (PubMed Central) · Cited by 197
Metadata
- Authors
- GREENHALGH, T., RUSSELL, J., ASHCROFT, R. E., & PARSONS, W.
- Affiliations
- Queen Mary University of London (GB)
- Corresponding author
- GREENHALGH, TRISHA
- Venue
- Milbank Quarterly
- Publisher
- Wiley
- Published
- 2011-12
- Volume
- 89
- Issue
- 4
- Pages
- 533-563
- ISSN
- 0887-378X (ISSN-L)
- PMC
- PMC3250633
- OpenAlex
- W2121034333
- Cited by
- 119
- References
- 60
- Citations by year
- 2024: 4 · 2022: 2 · 2021: 4 · 2020: 6 · 2019: 34 · 2018: 4 · 2017: 8 · 2016: 4 · 2015: 10 · 2014: 15 · 2013: 12 · 2012: 14
- FWCI
- 18.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- public-domain
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 1370 d)
- Locations
- Milbank Quarterly (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- eHealth policy, Wittgenstein, language games, bounded rationality, policy making, learning from history, health information technology, stakeholder complexity, learning communities, health care complexity, realist evaluation
- MeSH terms
- Famous Persons, United Kingdom, Health Plan Implementation, Health Planning, Health Promotion, Humans, Philosophy, Medical, Policy Making, State Medicine, Total Quality Management, Health Care Reform, Internet, Social Marketing, History, 20th Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review