The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Never the twain shall meet? - a comparison of implementation science and policy implementation research
Open accessAbstract
BACKGROUND: Many of society's health problems require research-based knowledge acted on by healthcare practitioners together with implementation of political measures from governmental agencies. However, there has been limited knowledge exchange between implementation science and policy implementation research, which has been conducted since the early 1970s. Based on a narrative review of selective literature on implementation science and policy implementation research, the aim of this paper is to describe the characteristics of policy implementation research, analyze key similarities and differences between this field and implementation science, and discuss how knowledge assembled in policy implementation research could inform implementation science. DISCUSSION: Following a brief overview of policy implementation research, several aspects of the two fields were described and compared: the purpose and origins of the research; the characteristics of the research; the development and use of theory; determinants of change (independent variables); and the impact of implementation (dependent variables). The comparative analysis showed that there are many similarities between the two fields, yet there are also profound differences. Still, important learning may be derived from several aspects of policy implementation research, including issues related to the influence of the context of implementation and the values and norms of the implementers (the healthcare practitioners) on implementation processes. Relevant research on various associated policy topics, including The Advocacy Coalition Framework, Governance Theory, and Institutional Theory, may also contribute to improved understanding of the difficulties of implementing evidence in healthcare. Implementation science is at a relatively early stage of development, and advancement of the field would benefit from accounting for knowledge beyond the parameters of the immediate implementation science literature. SUMMARY: There are many common issues in policy implementation research and implementation science. Research in both fields deals with the challenges of translating intentions into desired changes. Important learning may be derived from several aspects of policy implementation research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DiMaggio, P. J., & Powell, W. W. (1983) · American Sociological Review · doi:10.2307/2095101 · Cited by 38,435
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Institutionalized Organizations: Formal Structure as Myth and Ceremony
Meyer, J. W., & Rowan, B. (1977) · American Journal of Sociology · doi:10.1086/226550 · Cited by 28,308
DiMaggio, P. J., & Powell, W. W. (2004) · Advances in Strategic Management · doi:10.1016/s0742-3322(00)17011-1 · Cited by 25,802
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
DiMaggio, P. (1983) · American Sociological Review · Cited by 9,078
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Lipsky, M. (1981) · Michigan Law Review · doi:10.2307/1288305 · Cited by 8,981
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
Policy Change and Learning: An Advocacy Coalition Approach
Roberts, A., Sabatier, P. A., & Jenkins-Smith, H. C. (1994) · Canadian Public Policy / Analyse de Politiques · doi:10.2307/3551961 · Cited by 3,628
Theories of the Policy Process
Sabatier, P. (2019) · Routledge eBooks · doi:10.4324/9780367274689 · Cited by 3,490
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044 · cited 1×
“provement among the patients has thus far received relatively limited research attention [75,76].”
BackgroundStudying public policy: policy cycles and policy subsystems
(1996) · Choice Reviews Online · doi:10.5860/choice.33-5970 · Cited by 2,483
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Cairney, P. (2012) · doi:10.1007/978-0-230-35699-3 · Cited by 2,378
Self-citationThe New Public Management in Action
Ferlie, E., Ashburner, L., Fitzgerald, L., & Pettigrew, A. (1996) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198289029.001.0001 · Cited by 2,173
Diffusion of Innovations, 5th Edition
Rogers, E. M., Simon, 。., & Schuster (2003) · Cited by 2,049
Four Systems of Policy, Politics, and Choice
Lowi, T. J. (1972) · Public Administration Review · doi:10.2307/974990 · Cited by 1,985
Sabatier, P. A. (1986) · Journal of Public Policy · doi:10.1017/s0143814x00003846 · Cited by 1,863
The Oxford Handbook of Public Policy
(2008) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199548453.001.0001 · Cited by 1,661
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Wise, A. E., & Lipsky, M. (1981) · Educational Evaluation and Policy Analysis · doi:10.2307/1164030 · Cited by 1,576
Synthesizing the Implementation Literature: The Ambiguity-Conflict Model of Policy Implementation
(1995) · Journal of Public Administration Research and Theory · doi:10.1093/oxfordjournals.jpart.a037242 · Cited by 1,512
Just Institutions Matter: The Moral and Political Logic of the Universal Welfare State
Rothstein, B. (1998) · doi:10.1017/cbo9780511598449 · Cited by 1,403
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Using evidenceHow research can inform public services
Nutley, S. M., Walter, I., & Davies, H. T. O. (2007) · Policy Press eBooks · doi:10.1332/policypress/9781861346650.001.0001 · Cited by 1,335
Kitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314
The Policy Implementation Process: A Conceptual Framework
Van Meter, D. S., & Van Horn, C. E. (1975) · Administration & Society · doi:10.1177/009539977500600404 · Cited by 1,308
Implementation and Public Policy
Goggin, M. L., Mazmanian, D. A., & Sabatier, P. A. (1984) · CrossRef Listing of Deleted DOIs · doi:10.2307/3330197 · Cited by 1,269
Successes and Failures in the Implementation of Evidence-Based Guidelines for Clinical Practice
Grol, R. (2001) · Medical Care · doi:10.1097/00005650-200108002-00003 · Cited by 1,233
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864
Themes and Variations: Taking Stock of the Advocacy Coalition Framework
Weible, C. M., Sabatier, P. A., & McQueen, K. (2009) · Policy Studies Journal · doi:10.1111/j.1541-0072.2008.00299.x · Cited by 837
Using evidence: How research can inform public services
Nutley, S. M., Walter, I., & Davies, H. T. O. (2007) · doi:10.2307/j.ctt9qgwt1 · Cited by 808
Research on Policy Implementation: Assessment and Prospects
O'Toole, L. J. (2000) · Journal of Public Administration Research and Theory · doi:10.1093/oxfordjournals.jpart.a024270 · Cited by 773
Interpreting British Governance
Bevir, M., & Rhodes, R. A. W. (2003) · Taylor & Francis eBooks · doi:10.4324/9780203352311 · Cited by 756
Handbook of public administration
(2004) · Choice Reviews Online · doi:10.5860/choice.41-4264 · Cited by 728
Knowledge Translation in Health Care: Moving from Evidence to Practice
(2009) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa.2009.06222fae.002 · Cited by 694
Peterson, E. D., Roe, M. T., Mulgund, J., DeLong, E. R., Lytle, B. L., Brindis, R. G., Smith, S. C., Pollack, C. V., Newby, L. K., Harrington, R. A., et al. (2006) · JAMA · doi:10.1001/jama.295.16.1912 · Cited by 672
Hill, M. R. H., & Hupe, P. L. (2002) · Andalas University Repository (Andalas University) · Cited by 646
Ten great public health achievements--United States, 1900-1999.
(1999) · PubMed · Cited by 635
Implementation Theory and Practice: Toward a Third Generation
Goggin, M. L. (1990) · Cited by 630
The Iowa Model of Evidence-Based Practice to Promote Quality Care
Titler, M. G., Kleiber, C., Steelman, V. J., Rakel, B. A., Budreau, G., Everett, L. Q., Buckwalter, K. C., Tripp-Reimer, T., & Goode, C. J. (2001) · Critical Care Nursing Clinics of North America · doi:10.1016/s0899-5885(18)30017-0 · Cited by 586
Understanding Public Policy: Theories and Issues
Cairney, P. (2011) · Cited by 567
Self-citationImproving Patient Care: The Implementation of Change in Clinical Practice
Cosby, J. L. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2005.016824 · Cited by 557
Improving Patient Care: The Implementation of Change in Clinical Practice
Grol, R. P. T. M., Wensing, M., Eccles, M., Davis, D., & Wensign, M. (2005) · Cited by 553
Barrett, S. M. (2004) · Public Administration · doi:10.1111/j.0033-3298.2004.00393.x · Cited by 517
Hill, M., & Varone, F. (2021) · Routledge eBooks · doi:10.4324/9781003010203 · Cited by 454
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
Greenhalgh, T., Robert, G., Bate, P., Macfarlane, F., & Kyriakidou, O. (2007) · Cited by 453
A guide to knowledge translation theory
Estabrooks, C. A., Thompson, D. S., Lovely, J. J. E., & Hofmeyer, A. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.48 · Cited by 435
John, P. C. (2013) · Routledge eBooks · doi:10.4324/9780203136218 · Cited by 433
Dissemination and Implementation Research in Health
(2017) · Oxford Scholarship Online · doi:10.1093/oso/9780190683214.001.0001 · Cited by 396
Interorganizational policy making : limits to coordination and central control
Hanf, K. I., & Scharpf, F. W. (1978) · Cited by 384
Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action
Rycroft‐Malone, J., & Bucknall, T. K. (2010) · Cited by 358
Saetren, H. (2005) · Policy Studies Journal · doi:10.1111/j.1541-0072.2005.00133.x · Cited by 321
Use of research to inform public policymaking
Lavis, J. N., Posada, F. B., Haines, A., & Osei, E. (2004) · The Lancet · doi:10.1016/s0140-6736(04)17317-0 · Cited by 307
Cunningham, F. C., Ranmuthugala, G., Plumb, J., Georgiou, A., Westbrook, J. I., & Braithwaite, J. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000187 · Cited by 297
Knowledge Translation in Health Care: Moving from Evidence to Practice
(2009) · doi:10.1002/9781444311747 · Cited by 285
Hood, C. (2007) · Public Money and Management · doi:10.1111/j.1467-9302.2007.00564.x · Cited by 260
Just institutions matter: the moral and political logic of the universal welfare state
(1998) · Choice Reviews Online · doi:10.5860/choice.36-1245 · Cited by 250
Dissemination and Implementation Research in Health: Translating Science to Practice
Chambers, D. (2023) · doi:10.1093/oso/9780197660690.001.0001 · Cited by 243
Evidence for the Effectiveness of Techniques To Change Physician Behavior
Smith, W. R. (2000) · Chest · doi:10.1378/chest.118.2_suppl.8s · Cited by 239
The Theory–Practice Issue in Policy Implementation Research
O'toole, L. J. (2004) · Public Administration · doi:10.1111/j.0033-3298.2004.00396.x · Cited by 235
Peters, B., & Pierre, J. (2006) · SAGE Publications Ltd eBooks · doi:10.4135/9781848608054 · Cited by 223
Implementation Research — The Link Gone Missing
Hjern, B. (1982) · Journal of Public Policy · doi:10.1017/s0143814x00001975 · Cited by 223
Evidence-Based Practice: A Critical Appraisal
Trinder, E., & Reynolds, S. A. (2015) · UEA Digital Repository (University of East Anglia) · Cited by 222
Schofield, J. (2001) · International Journal of Management Reviews · doi:10.1111/1468-2370.00066 · Cited by 220
Seddon, M. E. (2001) · Quality in Health Care · doi:10.1136/qhc.0100152 · Cited by 215
Developing and selecting interventions for translating knowledge to action
Wensing, M., Bosch, M., & Grol, R. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.081233 · Cited by 207
Complexity, Institutions and Public Policy: Agile Decision-Making in a Turbulent World
Room, G. (2011) · Edward Elgar Publishing eBooks · doi:10.4337/9780857932648 · Cited by 197
CIHR Research: How to Translate Health Research Knowledge into Effective Healthcare Action
Graham, I., & Tetroe, J. (2007) · Healthcare Quarterly · doi:10.12927/hcq..18919 · Cited by 182
P√ºlzl, H., & Treib, O. (2006) · Public Administration and Public Policy · doi:10.1201/9781420017007.ch7 · Cited by 170
A Critical Appraisal of Evidence‐based Practice
Trinder, L. (2000) · Evidence-Based Practice · doi:10.1002/9780470699003.ch10 · Cited by 165
Estabrooks, C. A., Derksen, L., Winther, C., Lavis, J. N., Scott, S. D., Wallin, L., & Profetto-McGrath, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-49 · Cited by 165
Implementation and the Policy Process: Opening Up the Black Box
Palumbo, D., & Calista, D. J. (1990) · Praeger eBooks · doi:10.5040/9798400668951 · Cited by 165
(1998) · Just Institutions Matter · doi:10.1017/cbo9780511598449.006 · Cited by 160
(2000) · Wiley eBooks · doi:10.1002/9780470699003 · Cited by 156
Twenty years of implementation research
Grol, R. P. T. M., & Jones, R. (2000) · Family Practice · doi:10.1093/fampra/17.suppl_1.s32 · Cited by 145
Policy Design and Implementation
May, P. J. (2012) · SAGE Publications Ltd eBooks · doi:10.4135/9781446200506.n18 · Cited by 141
Hubbard, I. J., Harris, D., Kilkenny, M. F., Faux, S. G., Pollack, M. R. P., & Cadilhac, D. A.-M. (2012) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2012.01.011 · Cited by 139
Integrating Implementation Research
Winter, S. (1990) · Cited by 139
Organizational factors that support the implementation of a nursing Best Practice Guideline
Marchionni, C., & Ritchie, J. A. (2007) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2007.00775.x · Cited by 132
Developing the Terminology for Dissemination and Implementation Research
Rabin, B. A., & Brownson, R. C. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0002 · Cited by 128
Cairney, P., Studlar, D. T., & Mamudu, H. M. (2011) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230361249 · Cited by 112
Self-citationComplexity, Institutions and Public Policy: Agile Decision-Making in a Turbulent World
Room, G. (2011) · Cited by 95
Symposium on Implementing Public Policy: Learning from Theory and Practice
Schofield, J., & Sausman, C. (2004) · Public Administration · doi:10.1111/j.0033-3298.2004.00392.x · Cited by 88
Constructing Accountability: Network Governance and Managerial Agency
Newman, J. (2004) · Public Policy and Administration · doi:10.1177/095207670401900402 · Cited by 88
Global tobacco control: power, policy, governance, and transfer
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0512 · Cited by 86
The Role of Organizational Processes in Dissemination and Implementation Research
Aarons, G. A., Moullin, J. C., & Ehrhart, M. G. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780190683214.003.0008 · Cited by 82
Estabrooks, C. A., Squires, J. E., Hutchinson, A. M., Scott, S. D., Cummings, G. G., Kang, S. H., Midodzi, W. K., & Stevens, B. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-251 · Cited by 78
Johansson, S. (2009) · European Journal of Social Work · doi:10.1080/13691450903135691 · Cited by 70
John, P. C. (2011) · Routledge eBooks · doi:10.4324/9780203830789 · Cited by 66
Winter, S. C. (2006) · SAGE Publications Ltd eBooks · doi:10.4135/9781848608054.n9 · Cited by 61
Implementation and the Governance Problem
Cairney, P. (2009) · Public Policy and Administration · doi:10.1177/0952076709340508 · Cited by 58
Self-citationDopson, S., & Fitzgerald, L. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199259014.003.0005 · Cited by 55
Scott, N. A., Moga, C., Barton, P. M., Rashiq, S., Schopflocher, D., Taenzer, P. A., Harstall, C., & the Alberta Ambassador Program Team (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00830.x · Cited by 40
Theories on implementation of change in healthcare
Grol, R. P. T. M., Wensing, M., Hulscher, M., & Eccles, M. (2004) · Cited by 37
Understanding the implementation of evidence-based care: A structural network approach
Parchman, M. L., Scoglio, C., & Schumm, P. (2011) · Implementation Science · doi:10.1186/1748-5908-6-14 · Cited by 36
Moore, B. M., Laguna, T. A., Liu, M., & McNamara, J. (2012) · Pediatric Pulmonology · doi:10.1002/ppul.22665 · Cited by 29
Graham, I. D., Tetroe, J., & the KT Theories Group (2013) · doi:10.1002/9781118413555.ch26 · Cited by 23
The Path Forward in Dissemination and Implementation Research
Brownson, R. C., Dreisinger, M., Colditz, G. A., & Proctor, E. K. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0024 · Cited by 18
Evidence-based practice : doing the right thing for patients
Bucknall, T. K., & Rycroft‐Malone, J. (2010) · Cited by 16
Cited by
How to use and assess qualitative research methods
Busetto, L., Wick, W., & Gumbinger, C. (2020) · Neurological Research and Practice · doi:10.1186/s42466-020-00059-z · Cited by 1,429
Cairney, P., & Oliver, K. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0192-x · Cited by 526
Self-citationThe Handbook of Behavior Change
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318 · Cited by 407
Artificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389
“We have described use cases (and attendant value propositions) of ML in health care as more likely relating to decision support and less likely to automation, which begins to illustrate the implementation object of focus in ML initiatives [6,7].”
BackgroundMethodHarnessing the power of theorising in implementation science
Kislov, R., Pope, C., Martin, G. P., & Wilson, P. M. (2019) · Implementation Science · doi:10.1186/s13012-019-0957-4 · Cited by 289
“…is thus clearly interdisciplinary, but this interdisciplinarity does not necessarily channel down to the level of empirical exploration, where cross-fertilisation with other social science disciplines and their theoretical orientations remains relatively low and somewhat unequal [31, 49, 50].”
Metadata
- Authors
- Nilsen, P., Ståhl, C., Roback, K., & Cairney, P.
- Venue
- Implementation Science
- Published
- 2013-06-10
- Volume
- 8
- Issue
- 1
- Pages
- 63-63
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2130717231
- Cited by
- 346
- References
- 101
- FWCI
- 27.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.