Why National eHealth Programs Need Dead Philosophers: Wittgensteinian Reflections on Policymakers’ Reluctance to Learn from History
Open accessAbstract
CONTEXT: Policymakers seeking to introduce expensive national eHealth programs would be advised to study lessons from elsewhere. But these lessons are unclear, partly because a paradigm war (controlled experiment versus interpretive case study) is raging. England's $20.6 billion National Programme for Information Technology (NPfIT) ran from 2003 to 2010, but its overall success was limited. Although case study evaluations were published, policymakers appeared to overlook many of their recommendations and persisted with some of the NPfIT's most criticized components and implementation methods. METHODS: In this reflective analysis, illustrated by a case fragment from the NPfIT, we apply ideas from Ludwig Wittgenstein's postanalytic philosophy to justify the place of the "n of 1" case study and consider why those in charge of national eHealth programs appear reluctant to learn from such studies. FINDINGS: National eHealth programs unfold as they do partly because no one fully understands what is going on. They fail when this lack of understanding becomes critical to the programs' mission. Detailed analyses of the fortunes of individual programs, articulated in such a way as to illuminate the contextualized talk and action ("language games") of multiple stakeholders, offer unique and important insights. Such accounts, portrayals rather than models, deliver neither statistical generalization (as with experiments) nor theoretical generalization (as with multisite case comparisons or realist evaluations). But they do provide the facility for heuristic generalization (i.e., to achieve a clearer understanding of what is going on), thereby enabling more productive debate about eHealth programs' complex, interdependent social practices. A national eHealth program is best conceptualized not as a blueprint and implementation plan for a state-of-the-art technical system but as a series of overlapping, conflicting, and mutually misunderstood language games that combine to produce a situation of ambiguity, paradox, incompleteness, and confusion. But going beyond technical "solutions" and engaging with these language games would clash with the bounded rationality that policymakers typically employ to make their eHealth programs manageable. This may explain their limited and contained response to the nuanced messages of in-depth case study reports. CONCLUSION: The complexity of contemporary health care, combined with the multiple stakeholders in large technology initiatives, means that national eHealth programs require considerably more thinking through than has sometimes occurred. We need fewer grand plans and more learning communities. The onus, therefore, is on academics to develop ways of drawing judiciously on the richness of case studies to inform and influence eHealth policy, which necessarily occurs in a simplified decision environment.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This type of evaluation will inevitably be contingent.
“This type of evaluation will inevitably be contingent and hence we emphasize the need for reflexivity among researchers and adaptation of perspectives as have other authors writing on similar studies [66].”
There were conflicting interpretations of the Summary Care Record programme by clinicians, service users, policy-makers, industry and technical designers.
“and conflicting interpretations of the programme by clinicians, service users, policy-makers, industry and technical designers.8,11”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(1984) · Cited by 81,983 · see citing works
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,631 · see citing works
The Art of Case Study Research
Johnson, K. E., & Stake, R. E. (1996) · Modern Language Journal · doi:10.2307/329758 · Cited by 15,830 · see citing works
Administrative Behavior: A Study of Decision-Making Processes in Administrative Organization.
Brown, M., & Simon, H. A. (1978) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2065048 · Cited by 4,807 · see citing works
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · see citing works
Self-citation(2009) · Philosophical Investigations · doi:10.1111/(issn)1467-9205 · Cited by 2,366 · see citing works
The SAGE handbook of organizational research methods
Buchanan, D., & Bryman, A. E. (2009) · Cited by 2,123 · see citing works
The “Meaningful Use” Regulation for Electronic Health Records
Blumenthal, D., & Tavenner, M. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006114 · Cited by 2,059 · see citing works
The Idea of a Social Science and Its Relation to Philosophy.
Catton, W. R., & Winch, P. (1960) · American Sociological Review · doi:10.2307/2092093 · Cited by 1,546 · see citing works
Information, Systems and Information Systems-Making Sense of the Field.
Taket, A. R., Checkland, P. B., & Holwell, S. (1999) · Journal of the Operational Research Society · doi:10.2307/3010006 · Cited by 1,074 · see citing works
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1654.001.0001 · Cited by 1,033 · see citing works
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850 · see citing works
Available Light: Anthropological Reflections on Philosophical Topics
Strong, P. T. (2001) · American Anthropologist · doi:10.1525/aa.2001.103.3.864 · Cited by 740 · see citing works
Aramis or the love for technology
Czarniawska-Joerges, B. (1997) · Scandinavian Journal of Management · doi:10.1016/s0956-5221(97)88283-8 · Cited by 671 · see citing works
Frame-critical policy analysis and frame-reflective policy practice
Rein, M. L., & Schön, D. A. (1996) · Knowledge, technology & policy/Knowledge in society/Knowledge, technology, & policy · doi:10.1007/bf02832235 · Cited by 630 · see citing works
The Generative Properties Of Richness
Weick, K. E. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.24160637 · Cited by 554 · see citing works
Achieving a Nationwide Learning Health System
Friedman, C. P., Wong, A. K., & Blumenthal, D. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3001456 · Cited by 539 · see citing works
Technology as equivoque: Sensemaking in new technologies.
Weick, K. E. (1990) · Cited by 528 · see citing works
Wittgenstein: A Social Theory of Knowledge
Hekman, S. J., & Bloor, D. (1984) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2070834 · Cited by 473 · see citing works
Wilsford, D. (1994) · Journal of Public Policy · doi:10.1017/s0143814x00007285 · Cited by 414 · see citing works
Bloor, D. (1983) · doi:10.1007/978-1-349-17273-3 · Cited by 396 · see citing works
Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory
Greenhalgh, T., & Stones, R. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.12.034 · Cited by 371 · see citing works
Self-citationThe Idea of a Social Science and its Relation to Philosophy.
Goldstein, L. J., & Winch, P. (1960) · The Philosophical Review · doi:10.2307/2183560 · Cited by 348 · see citing works
Greenhalgh, T., Hinder, S., Stramer, K., Bratan, T., & Russell, J. (2010) · BMJ · doi:10.1136/bmj.c5814 · Cited by 343 · see citing works
Self-citationEvaluating eHealth Interventions: The Need for Continuous Systemic Evaluation
Catwell, L., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000126 · Cited by 307 · see citing works
Evidence-Based Policymaking: A Critique
Greenhalgh, T., & Russell, J. (2009) · Perspectives in biology and medicine · doi:10.1353/pbm.0.0085 · Cited by 275 · see citing works
Self-citationGreenhalgh, T., Stramer, K., Bratan, T., Byrne, E., Russell, J., & Potts, H. W. W. (2010) · BMJ · doi:10.1136/bmj.c3111 · Cited by 275 · see citing works
Self-citationWhy Do Evaluations of eHealth Programs Fail? An Alternative Set of Guiding Principles
Greenhalgh, T., & Russell, J. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000360 · Cited by 273 · see citing works
Self-citation(2000) · Choice Reviews Online · doi:10.5860/choice.37-3384 · Cited by 262 · see citing works
Tuohy, C. H. (1999) · doi:10.1093/oso/9780195128215.001.0001 · Cited by 262 · see citing works
Simons, H. (1996) · Cambridge Journal of Education · doi:10.1080/0305764960260206 · Cited by 251 · see citing works
Robertson, A., Cresswell, K., Takian, A., Petrakaki, D., Crowe, S., Cornford, T., Barber, N., Avery, A., Fernando, B., Jacklin, A., et al. (2010) · BMJ · doi:10.1136/bmj.c4564 · Cited by 230 · see citing works
New Labour, modernisation and the medical labour process
HARRISON, S. (2002) · Journal of Social Policy · doi:10.1017/s0047279402006694 · Cited by 214 · cited 2× · see citing works
“generally, however, while the experimental trial has a special place in the hearts of many doctors and while its epistemological foundations resonate strongly with the rationalist, “evidence-based” ideology that pervades contemporary policymaking (Greenhalgh and Russell 2009; Harrison 2002), few researchers with a bac…”
BackgroundHam, C., Hunter, D. J., & Robinson, R. (1995) · BMJ · doi:10.1136/bmj.310.6972.71 · Cited by 179 · see citing works
Tsoukas, H. (2009) · Sage eBooks · Cited by 117 · see citing works
Shifting Tenses: Reconnecting Regimes of Truth and Hope
Brown, N. (2005) · Configurations · doi:10.1353/con.2007.0019 · Cited by 115 · see citing works
Jelinek, M., Goodman, P. S., Sproull, L. S., Fulk, J. L., & Steinfield, C. W. (1991) · Academy of Management Review · doi:10.2307/258926 · Cited by 115 · see citing works
Contemporary Technology Discourse and the Legitimation of Capitalism
Fisher, E. (2010) · European Journal of Social Theory · doi:10.1177/1368431010362289 · Cited by 102 · see citing works
Greenhalgh, T., Stramer, K., Bratan, T., Byrne, E., Russell, J., Hinder, S., & POTTS, H. W. W. (2010) · Cited by 84 · see citing works
Self-citationEvaluating eHealth: How to Make Evaluation More Methodologically Robust
Lilford, R. J., Foster, J., & Pringle, M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000186 · Cited by 79 · see citing works
Management Implications in Information Systems Research: The Untold Story
Ramiller, N. C., & Pentland, B. T. (2009) · Journal of the Association for Information Systems · doi:10.17705/1jais.00202 · Cited by 77 · see citing works
Wittgenstein and psychology: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3702 · Cited by 74 · see citing works
Games Real Actors Could Play: The Challenge of Complexity
Scharpf, F. W. (1991) · Journal of Theoretical Politics · doi:10.1177/0951692891003003003 · Cited by 67 · see citing works
Κlein, R. (2000) · Journal of Public Policy · doi:10.1017/s0143814x00380771 · Cited by 66 · see citing works
The case for randomized controlled trials to assess the impact of clinical information systems
Liu, J. L. Y., & Wyatt, J. C. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.010306 · Cited by 66 · see citing works
Wittgenstein and Psychology: A Practical Guide
Harré, R., & Tissaw, M. A. (2005) · Cited by 62 · see citing works
Will information and communication technology disrupt the health system and deliver on its promise?
Westbrook, J. I., & Braithwaite, J. (2010) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03968.x · Cited by 61 · see citing works
The Biggest Computer Programme in the World Ever! How's it Going?
Brennan, S. (2007) · Journal of Information Technology · doi:10.1057/palgrave.jit.2000104 · Cited by 60 · see citing works
Disciplining Information Systems: Truth and its Regimes
Introna, L. D. (2003) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000465 · Cited by 50 · see citing works
The patchwork: Health reform, American style
Marmor, T. R., & Oberlander, J. B. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.10.016 · Cited by 45 · see citing works
(2000) · doi:10.1515/9781400823406 · Cited by 44 · see citing works
The danger of words and writings on Wittgenstein
Drury, M. O., Berman, D. S., Fitzgerald, M., & Hayes, J. L. (1996) · Thoemmes eBooks · Cited by 39 · see citing works
IS Success and Failure—The Problem of Scale
Kreps, D., & Richardson, H. (2007) · The Political Quarterly · doi:10.1111/j.1467-923x.2007.00871.x · Cited by 39 · see citing works
Shotter, J., & Tsoukas, H. (2011) · Research in the sociology of organizations · doi:10.1108/s0733-558x(2011)0000032013 · Cited by 36 · see citing works
Meaningful Use of Information Technology: A Local Perspective
Hussain, A. A. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-10-201105170-00010 · Cited by 30 · see citing works
"To Be, or Not To Be" The Question of Runaway Projects
Sarup, D. (2003) · Cited by 5 · see citing works
EHR strategy: top down, bottom up or middle out?
Bowden, T. (2011) · PubMed · Cited by 3 · see citing works
Federal Auditor General's Report on Canada Health Infoway.
Whitt, M. R. (2010) · PubMed · Cited by 2 · see citing works
Greenhalgh, T., & Bowden, T. (2010) · PubMed · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
1 of the 60 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Brown, N. 2007. Shifting Tenses-From Regimes of Truth to Regimes of Hope? Configurations 13(3):331-55.
- Latour, B. 1996. Aramis, or Love of Technology. Trans. Catherine Porter. Cambridge, MA: Harvard University Press.
- Markus, L.M., and M. Keil. 1994. If We Build It, They Will Come: Designing Information Systems That People Want to Use. Sloan Management Review 35(4):11-25.
- Shekelle, P.G., and C.L. Goldzweig. 2009. Costs and Benefits of Health Information Technology: An Updated Systematic Review. London: Health Foundation on behalf of the Southern California Evidence-Based Practice Center, RAND Corporation.
Cited by
Sorted by citations
Lessons from Complex Interventions to Improve Health
Hawe, P. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031912-114421 · Cited by 607 · see citing works
A critical second look at integrated knowledge translation
Kothari, A. R., & Wathen, C. N. (2012) · Health Policy · doi:10.1016/j.healthpol.2012.11.004 · Cited by 301 · see citing works
Electronic health record acceptance by physicians: Testing an integrated theoretical model
Gagnon, M., Ghandour, E. K., Talla, P. K., Simonyan, D., Godin, G., Labrecque, M., Ouimet, M., & Rousseau, M. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.10.010 · Cited by 250 · see citing works
Leon, N., Schneider, H., & Daviaud, E. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-123 · Cited by 200 · see citing works
Using technology to deliver mental health services to children and youth: a scoping review.
Boydell, K., Hodgins, M., Pignatiello, A., Teshima, J., Edwards, H. E., & Willis, D. (2014) · Europe PMC (PubMed Central) · Cited by 197 · see citing works
The Art and Craft of Comparison
Boswell, J., Corbett, J., & Rhodes, R. A. W. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108561563 · Cited by 158 · see citing works
Greenhalgh, T., Maylor, H., Shaw, S., Wherton, J., Papoutsi, C., Betton, V., Nelissen, N., Gremyr, A., Rushforth, A., Koshkouei, M., et al. (2020) · JMIR Research Protocols · doi:10.2196/16861 · Cited by 152 · see citing works
Self-citationBurton‐Jones, A., Akhlaghpour, S., Ayre, S. J., Barde, P., Staib, A. N., & Sullivan, C. M. (2019) · Information and Organization · doi:10.1016/j.infoandorg.2019.100255 · Cited by 154 · see citing works
Schneckenberg, D., Truong, Y., & Khamseh, H. M. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.08.008 · Cited by 114 · see citing works
Shankardass, K., Renahy, É., Muntaner, C., & O'Campo, P. J. (2014) · Health Policy and Planning · doi:10.1093/heapol/czu021 · Cited by 110 · see citing works
Kenealy, T. W., Parsons, M. J. G., Rouse, A. P. B., Doughty, R. N., Sheridan, N., Hindmarsh, J. K. H., Masson, S. C., & Rea, H. H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0116188 · Cited by 102 · see citing works
Complex, but not quite complex enough: The turn to the complexity sciences in evaluation scholarship
Mowles, C. (2014) · Evaluation · doi:10.1177/1356389014527885 · Cited by 100 · see citing works
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.001.0001 · Cited by 83 · see citing works
Greenhalgh, T., Morris, L., Wyatt, J. C., Thomas, G., & Gunning, K. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2013.01.002 · Cited by 79 · see citing works
Self-citationSalisbury, C., Thomas, C., O’Cathain, A., Rogers, A. E., Pope, C. J., Yardley, L., Hollinghurst, S. P., Fahey, T. P., Lewis, G., Large, S., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006448 · Cited by 78 · see citing works
Greenhalgh, T., Swinglehurst, D., & Stones, R. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02390 · Cited by 71 · see citing works
Self-citationAlami, H., Gagnon, M., & Fortin, J. (2019) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2019.12 · Cited by 58 · see citing works
National electronic health records and the digital disruption of moral orders
Garrety, K., McLoughlin, I. P., Wilson, R., Zelle, G., & Martin, M. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.11.029 · Cited by 56 · see citing works
Maximising value from a United Kingdom Biomedical Research Centre: study protocol
Greenhalgh, T., Ovseiko, P. V., Fahy, N., Shaw, S. E., Kerr, P., Rushforth, A., Channon, K. M., & Kiparoglou, V. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0237-1 · Cited by 52 · see citing works
Self-citationFunction allocation in complex systems: reframing an old problem
Challenger, R., Clegg, C., & Shepherd, C. (2013) · Ergonomics · doi:10.1080/00140139.2013.790482 · Cited by 53 · see citing works
Takian, A., Petrakaki, D., Cornford, T., Sheikh, A., & Barber, N. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-105 · Cited by 51 · see citing works
“This type of evaluation will inevitably be contingent and hence we emphasize the need for reflexivity among researchers and adaptation of perspectives as have other authors writing on similar studies [66].”
ResultEthnographic process evaluation in primary care: explaining the complexity of implementation
Bunce, A., Gold, R. B., Davis, J. V., McMullen, C. K., Jaworski, V., Mercer, M., & Nelson, C. A. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0607-0 · Cited by 49 · see citing works
Kiddey, R. (2018) · Journal of Refugee Studies · doi:10.1093/jrs/fey061 · Cited by 39 · see citing works
Cresswell, K. M., Sheikh, A., Franklin, B. D., Krasuska, M., Nguyen, H. T., Hinder, S., Lane, W., Mozaffar, H., Mason, K., Eason, S., et al. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05355-7 · Cited by 39 · see citing works
Shotter, J., & Tsoukas, H. (2011) · Research in the sociology of organizations · doi:10.1108/s0733-558x(2011)0000032013 · Cited by 36 · see citing works
Niklas Luhmann: Social Systems Theory and the Translation of Public Health Research
Meyer, S. B., Gibson, B., & Ward, P. (2015) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137355621_22 · Cited by 35 · see citing works
Collaborative learning framework for online stakeholder engagement
Khodyakov, D., Savitsky, T. D., & Dalal, S. R. (2015) · Health Expectations · doi:10.1111/hex.12383 · Cited by 34 · see citing works
Stoopendaal, A., & Bal, R. A. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.11.037 · Cited by 33 · see citing works
Liaw, S., Pearce, C. M., Liyanage, H., Liaw, G. S. S., & de Lusignan, S. (2014) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v21i4.87 · Cited by 33 · see citing works
England's national programme for IT
Greenhalgh, T., & Keen, J. (2013) · BMJ · doi:10.1136/bmj.f4130 · Cited by 30 · see citing works
Self-citationConte, K. P., Grøn, S., Loblay, V., Green, A. S., Milat, A., Persson, L., Innes‐Hughes, C., Mitchell, J., Thackway, S. V., Williams, M., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0686-5 · Cited by 27 · see citing works
Anatomy of an Incident Disclosure: The Importance of Dialogue
Iedema, R. A. M., & Allen, S. (2012) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(12)38057-4 · Cited by 27 · see citing works
Wells, S., Rafter, N., Kenealy, T. W., Herd, G., Eggleton, K. S., Lightfoot, R., Arcus, K., Wadham, A. K., Jiang, Y., & Bullen, C. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174504 · Cited by 26 · see citing works
Craig, P., Gibson, M., Campbell, M., Popham, F., & Katikireddi, S. V. (2017) · Preventive Medicine · doi:10.1016/j.ypmed.2017.12.025 · Cited by 23 · see citing works
Coiera, E. W. (2013) · The Medical Journal of Australia · doi:10.5694/mja13.10101 · Cited by 24 · see citing works
Krasuska, M., Williams, R., Sheikh, A., Franklin, B. D., Hinder, S., TheNguyen, H., Lane, W., Mozaffar, H., Mason, K., Eason, S., et al. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100429 · Cited by 23 · see citing works
Chambers, N., Sheaff, R., Mahon, A., Byng, R., Mannion, R., Charles, N., Exworthy, M., & Llewellyn, S. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-s1-s4 · Cited by 23 · see citing works
Patient safety in nursing homes in Sweden: nurses’ views on safety and their role
Andersson, F., & Hjelm, K. (2017) · Journal of Health Services Research & Policy · doi:10.1177/1355819617691070 · Cited by 20 · see citing works
Scantlebury, A., Watt, I. S., Sheard, L., Wright, J., & Adamson, J. (2016) · British Medical Bulletin · doi:10.1093/bmb/ldw055 · Cited by 18 · see citing works
Iedema, R. A. M., Verma, R., Wutzke, S. E., Lyons, N. J., & McCaughan, B. C. (2017) · Journal of Health Organization and Management · doi:10.1108/jhom-07-2016-0146 · Cited by 17 · see citing works
Henderson, J. L., Sword, W. A., Niccols, A., & Dobbins, M. (2014) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/1747-597x-9-21 · Cited by 16 · see citing works
Hwang, H., Dutta, B., & Chang, H.-C. (2019) · Methods of Information in Medicine · doi:10.1055/s-0039-1695718 · Cited by 16 · see citing works
Singleton, G. F., Dowrick, A., Manby, L., Fillmore, H., Syverson, A., Lewis‐Jackson, S., Uddin, I., Sumray, K., Bautista-González, E., Johnson, G. A., et al. (2021) · International Journal of Health Policy and Management · doi:10.34172/ijhpm.2021.101 · Cited by 16 · see citing works
Evaluation, complexity, uncertainty – theories of change and some alternatives
Mowles, C. (2013) · Practical Action Publishing eBooks · doi:10.3362/9781780447780.003 · Cited by 16 · see citing works
Untangling complexity as a health determinant
Petrie, S., & Peters, P. (2020) · Health Science Inquiry · doi:10.29173/hsi299 · Cited by 15 · see citing works
Aziz, F., Jorgenson, M. R., Garg, N., Mohamed, M., Djamali, A., Mandelbrot, D. A., & Parajuli, S. (2020) · Transplantation Reviews · doi:10.1016/j.trre.2020.100567 · Cited by 15 · see citing works
de Vries, J. R., van Bommel, S., & Peters, K. (2018) · Sustainability · doi:10.3390/su10114005 · Cited by 15 · see citing works
Lindberg, J., Kvist, E., & Lindgren, S. (2022) · Journal of Technology in Human Services · doi:10.1080/15228835.2022.2144588 · Cited by 14 · see citing works
Common good in the era of data-intensive healthcare
Grön, K. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00911-w · Cited by 14 · see citing works
Larson, A. (2018) · Evaluation · doi:10.1177/1356389018781357 · Cited by 14 · see citing works
Definition, Scope, and Challenges
Greenes, R. A. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-398476-0.00001-4 · Cited by 13 · see citing works
National electronic health record systems as `wicked projects': The Australian experience
Garrety, K., McLoughlin, I. P., Dalley, A., Wilson, R., & Yu, P. (2016) · Information Polity · doi:10.3233/ip-160389 · Cited by 12 · see citing works
Health care policies: European debate and national reforms
Baeten, R., & Thomson, S. (2012) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 11 · see citing works
Loblay, V., Conte, K. P., Grøn, S., Green, A. S., Innes‐Hughes, C., Milat, A., Persson, L., Williams, M., Mitchell, J., & Hawe, P. (2020) · Qualitative Health Research · doi:10.1177/1049732320962438 · Cited by 11 · see citing works
Noyes, J., Lewis, M., Bennett, V. C., Widdas, D., & Brombley, K. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12169 · Cited by 11 · see citing works
A Clinician’s View of Next-Generation Remote Healthcare System
Puddu, P. E., D’Ambrosi, A., Scarparo, P., Centaro, E., Torromeo, C., Schiariti, M. S., Fedele, F., & Gensini, G. F. (2013) · Springer eBooks · doi:10.1007/978-1-4614-8842-2_1 · Cited by 10 · see citing works
Salisbury, C., O’Cathain, A., Thomas, C., Edwards, L., Montgomery, A. A., Hollinghurst, S. P., Large, S., Nicholl, J. P., Pope, C. J., Rogers, A. E., et al. (2017) · Programme Grants for Applied Research · doi:10.3310/pgfar05010 · Cited by 9 · see citing works
From benefits idealisation to value optimisation: application in the digital health context
Smith, N., Burton‐Jones, A., & Sullivan, C. M. (2020) · Australian Health Review · doi:10.1071/ah19255 · Cited by 8 · see citing works
Wears, R. L. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-000916 · Cited by 7 · see citing works
Technology for Transparency: The Case of the Web‐Based Dutch National Health Portal
Ossebaard, H. C., van Gemert‐Pijnen, L., & Seydel, E. R. (2012) · Policy & Internet · doi:10.1515/1944-2866.1160 · Cited by 7 · see citing works
Understanding Stakeholder Interests and Perspectives in Evaluations of Health IT
Lee, L., & Sheikh, A. (2016) · Studies in health technology and informatics · doi:10.3233/978-1-61499-635-4-53 · Cited by 7 · see citing works
Day, K., Kenealy, T. W., & Sheridan, N. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0175-6 · Cited by 7 · see citing works
Ribesse, N., Bossyns, P., Marchal, B., Karemere, H. B., Burman, C. J., & Macq, J. (2015) · Global Health Promotion · doi:10.1177/1757975915591684 · Cited by 6 · see citing works
Flitcroft, K. L., Gillespie, J., Carter, S. M., Salkeld, G. P., & Trevena, L. J. (2014) · Evidence & Policy · doi:10.1332/174426514x672399 · Cited by 6 · see citing works
Technostress in Nuclear Medicine: A Qualitative Study of Causes, Mitigators, and Resolution Levels
Stana, R. A., & Hertzum, M. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105547 · Cited by 5 · see citing works
Gaddi, A. V., & Capello, F. (2013) · Springer eBooks · doi:10.1007/978-88-470-5253-6_1 · Cited by 5 · see citing works
Nursing Informatics: A Core Competency for the Profession
Hussey, P., & Hannah, K. J. (2021) · Health informatics · doi:10.1007/978-3-030-58740-6_3 · Cited by 4 · see citing works
Jones, E. B., Swain, M. J., Patel, V., & Furukawa, M. F. (2014) · Healthcare · doi:10.1016/j.hjdsi.2013.12.015 · Cited by 4 · see citing works
Au-delà de l’évaluation des bénéfices : réflexion sur les conséquences inattendues de la télésanté
Alami, H., Gagnon, M. ‐., Côté, A., Kostović, C. N., Ahmed, M. A. A., Samri, M. A., & Fortin, J. (2020) · Ethics Medicine and Public Health · doi:10.1016/j.jemep.2020.100596 · Cited by 4 · see citing works
The 11th hour-time forEBMto return to first principles?
Campbell-Scherer, D. L. (2012) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2012-100578 · Cited by 4 · see citing works
Boswell, J., Corbett, J., & Rhodes, R. A. W. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108561563.005 · Cited by 3 · see citing works
Researching big IT in the UK National Health Service: A systematic review of theory-based studies
Price, C., Suhomlinova, O. O., & Green, W. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105395 · Cited by 5 · see citing works
Howard, J., Flores, A., & Hambleton, R. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1474-786320140000015008 · Cited by 3 · see citing works
Ameli, V., Wong, G., Barlow, J., Mohraz, M., Meinck, F., Taj, L., Amiri, T., Boosiraz, A., Sabin, L., & Haberer, J. E. (2024) · Qualitative Health Research · doi:10.1177/10497323241256865 · Cited by 2 · see citing works
Petrie, S., McLeod, S. L., & Ho, K. (2024) · Healthcare Management Forum · doi:10.1177/08404704241294255 · Cited by 3 · see citing works
The role of electronic records in disability support
Kraal, B., van Dooren, K., Popović, V., Lennox, N., & Livingstone, A. (2017) · Research and Practice in Intellectual and Developmental Disabilities · doi:10.1080/23297018.2017.1360789 · Cited by 2 · see citing works
Gray, B. H. (2010) · Milbank Quarterly · doi:10.1111/j.1468-0009.2010.00607.x · Cited by 1 · see citing works
Clarke, A. (2015) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 1 · see citing works
Sohal, R. (2018) · TSpace (University of Toronto) · Cited by 1 · see citing works
Nursing roles and interagency communication demonstrating requirements for future models of care
Hussey, P., & Rodger, D. (2014) · Arrow@dit (Dublin Institute of Technology) · Cited by 1 · see citing works
Sanderson, D., Gagnon, M., & Duplantie, J. (2012) · InTech eBooks · doi:10.5772/50322
Briggs, M. (2012) · University of Hertfordshire Research Archive (University of Hertfordshire)
iHealth: supporting health by technology
Ossebaard, H. C. (2012) · doi:10.3990/1.9789036533751 · Cited by 1 · see citing works
National e-health innovation : conduct of international e-health technology transfers in Africa
Iluyemi, A. (2012) · UPT. Syiah Kuala University Library (Syiah Kuala University)
The press, the terminal care pathway, the politician, and the hubris
Greenhalgh, T. (2012) · British Journal of General Practice · doi:10.3399/bjgp12x659385
Self-citationSalisbury, C., Rogers, A. E., Yardley, L., Fahey, T. P., Lewis, G., Edwards, L., Brownsell, S., & Montgomery, A. A. (2014)
Diment, K. (2015) · Research Online (University of Wollongong)
Case Studies Introduction: Transformational Research
Hussey, P., & Sheerin, F. K. (2014) · Health informatics · doi:10.1007/978-1-4471-2999-8_14
Islam, N., Munro, S. B., Rivers, R., Vishniakov, D., Wilcox, E., & Sheps, S. B. (2014)
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0006
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0012
The Special Case of Anesthesia
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0004
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0003
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0010
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0005
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0007
Irruption onto the World Stage
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.003.0008
Boswell, J., Corbett, J., & Rhodes, R. A. W. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108561563.007
Boswell, J., Corbett, J., & Rhodes, R. A. W. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108561563.004
- Authors
- GREENHALGH, T., RUSSELL, J., ASHCROFT, R. E., & PARSONS, W.
- Affiliations
- Queen Mary University of London (GB)
- Corresponding author
- GREENHALGH, TRISHA
- Venue
- Milbank Quarterly
- Publisher
- Wiley
- Published
- 2011-12
- Volume
- 89
- Issue
- 4
- Pages
- 533-563
- ISSN
- 0887-378X (ISSN-L)
- PMC
- PMC3250633
- OpenAlex
- W2121034333
- Cited by
- 119
- References
- 60
- Citations by year
- 2024: 4 · 2022: 2 · 2021: 4 · 2020: 6 · 2019: 34 · 2018: 4 · 2017: 8 · 2016: 4 · 2015: 10 · 2014: 15 · 2013: 12 · 2012: 14
- FWCI
- 18.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- public-domain
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 1370 d)
- Locations
- Milbank Quarterly (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- eHealth policy, Wittgenstein, language games, bounded rationality, policy making, learning from history, health information technology, stakeholder complexity, learning communities, health care complexity, realist evaluation
- MeSH terms
- Famous Persons, United Kingdom, Health Plan Implementation, Health Planning, Health Promotion, Humans, Philosophy, Medical, Policy Making, State Medicine, Total Quality Management, Health Care Reform, Internet, Social Marketing, History, 20th Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review