Implementation Research: Finding Common Ground on What, How, Why, Where, and Who
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Over many decades, educators have developed countless interventions and theories about how to create lasting change. Implementation research is the study of these efforts with a set of basic questions: What are we doing? Is it working? For whom? Where? When? How? And, Why? In other words, implementation research is an endeavor to understand if and how educational efforts are accomplishing their goals. This chapter describes the landscape of implementation research, tracing it back to its historical roots and connecting it to other fields with the aim of identifying common threads across diverse efforts. The authors survey where the field is today and highlight different perspectives on complex questions that have long troubled researchers. They outline some of the sticky issues ahead and make a case for shared conceptual clarity and clearly communicated and understood language that will help researchers understand how various bodies of implementation research work are related. The authors conclude by describing the opportunity presented to the education research community in this moment: to capitalize on and learn from historical and contemporary work in education and other fields, and to identify connections across theories and approaches and find ways to collectively move forward toward the shared goal of making education better.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 7×
“Depending on the innovation, the boundary of “inside the organization” and “outside the organization” may vary (Damschroder et al., 2009).”
BackgroundInfluentialExploring internal stickiness: Impediments to the transfer of best practice within the firm
Szulanski, G. (1996) · Strategic Management Journal · doi:10.1002/smj.4250171105 · Cited by 7,839
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 4×
“The need for our field to establish clearly understood language regarding fidelity of implementation has been discussed by many researchers over the past decade (e.g., Century & Cassata, 2014; Greenhalgh et al., 2004; Irwin & Supplee, 2012; O’Donnell, 2008; Sanetti & Kratochwill, 2009).”
BackgroundInfluentialDurlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
The New Meaning of Educational Change
Fullan, M. (2001) · doi:10.4324/9780203986561 · Cited by 4,373
Brown, A. L. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0202_2 · Cited by 4,000
A conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · cited 2×
“The reasoning in favor of enacting innovations with fidelity is that once there is evidence that an innovation works, we must try to replicate the effects (Chambers et al., 2013).”
BackgroundDane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 5×
“…chapter), we identified highly cited articles that included practice recommendations and preliminary guidelines for implementation research (e.g., Dane & Schneider, 1998; Durlak & DuPre, 2008; Dusenbury, Brannigan, Falco, & Hansen, 2003; Mowbray, Holter, Teague, & Bybee, 2003; O’Donnell, 2008),…”
BackgroundInfluentialThe Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9522-x · Cited by 1,102
Rethinking Scale: Moving Beyond Numbers to Deep and Lasting Change
Coburn, C. E. (2003) · Educational Researcher · doi:10.3102/0013189x032006003 · Cited by 1,030 · cited 4×
“This view considers adaptations acceptable to a certain point (sometimes called the “point” or “zone” of “drastic mutation”), as long as they are congruent with the goals and principles of the designers (Coburn, 2003; Hall & Loucks, 1978a; Kelly et al., 2000; Penuel & Fishman, 2012).”
BackgroundInfluentialDiffusion Theory and Knowledge Dissemination, Utilization, and Integration in Public Health
Green, L. W., Ottoson, J. M., García, C., & Hiatt, R. A. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100049 · Cited by 953
A General Model for Testing Mediation and Moderation Effects
Fairchild, A. J., & MacKinnon, D. P. (2009) · Prevention Science · doi:10.1007/s11121-008-0109-6 · Cited by 918
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Treatment fidelity in outcome studies
Moncher, F. J., & Prinz, R. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90103-2 · Cited by 797 · cited 1×
“…was actually enacted in the treatment and comparison conditions (Basch, 1984; Cohen, 1975; Dhillon, Darrow, & Meyers, 2015; Domitrovich & Greenberg, 2000; Moncher & Prinz, 1991; L. Peterson, Homer, & Wonderlich, 1982; Rohrbach et al., 2006; Solomon et al., 1973; Song & Herman, 2010; Wolery, 2011).”
Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., Romanelli, L. H., Leaf, P. J., Greenberg, M. T., & Ialongo, N. S. (2008) · Advances in School Mental Health Promotion · doi:10.1080/1754730x.2008.9715730 · Cited by 749 · cited 7×
“…basic elements of varied theories of change and a key part of most recent research syntheses or metaframeworks depicting innovations in context (e.g., Domitrovich et al., 2008; Donaldson, 2001; Hulleman, Rimm-Kaufman, & Abry, 2013; Moulin, Sabater-Hernandez, Fernandez-Llimos, & Benrimaj, 2015).”
BackgroundInfluentialProblems in the “Evidence” of “Evidence-Based Medicine”
Feinstein, A. R., & Horwitz, R. I. (1997) · The American Journal of Medicine · doi:10.1016/s0002-9343(97)00244-1 · Cited by 653 · cited 2×
“Good clinicians use what Feinstein and Horwitz (1997) call “soft” information (e.g., severity and nature of the symptoms, associated diseases, rate of symptom growth) to make decisions; the authors assert that “a good clinician constantly uses this ‘soft’ information for diverse clinical decisions”…”
BackgroundThe integrity of independent variables in behavior analysis
Peterson, L., Homer, A. L., & Wonderlich, S. A. (1982) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1982.15-477 · Cited by 461 · cited 1×
“L. Peterson et al. (1982) succinctly refer to this as “assessment of the independent variable” (p. 479).”
BackgroundMoullin, J. C., Sabater-Hernández, D., Fernandez-Llimos, F., & Benrimoj, S. I. (2015) · Health Research Policy and Systems · doi:10.1186/s12961-015-0005-z · Cited by 392 · cited 3×
“Moulin et al. (2015) recently located, reviewed, and compared 49 such frameworks across disciplines.”
BackgroundA Proposal to Speed Translation of Healthcare Research Into Practice
Kessler, R., & Glasgow, R. E. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.023 · Cited by 376
Rohrbach (2006) · doi:10.1177/0163278706290408 · Cited by 300
The fidelity‐adaptation debate: Implications for the implementation of public sector social programs
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987) · American Journal of Community Psychology · doi:10.1007/bf00922697 · Cited by 297 · cited 3×
“This profidelity stance has been extensively documented and referenced for decades as the dominant perspective on how end users should approach the use of novel practices and strategies that are identified as evidencebased (Blakely et al., 1987; Penuel et al., 2014; Snyder et al., 1992).”
BackgroundMoving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength
Hulleman, C. S., & Cordray, D. S. (2009) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802539325 · Cited by 291 · cited 3×
“Some studies have maintained a focus on questions of fidelity, replication, and outcomes (e.g., Hulleman & Cordray, 2009; T. Smith, Cobb, Farran, Cordray, & Munter, 2013; Strain & Bovey, 2011), while others have turned away from fidelity, to examine innovation adaptation, the reasons for…”
BackgroundInfluentialExamining Adaptations of Evidence-Based Programs in Natural Contexts
Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013) · The Journal of Primary Prevention · doi:10.1007/s10935-013-0303-6 · Cited by 250
Evolution of Diffusion and Dissemination Theory
Dearing, J. W. (2008) · Journal of Public Health Management and Practice · doi:10.1097/01.phh.0000311886.98627.b7 · Cited by 218 · cited 1×
“Like Tarde, Simmel focused on individual actions but, in particular, theorized that they are affected by external conditions (Dearing, 2008).”
BackgroundOn Sustainability of Project Innovations as Systemic Change
Adelman, H. S., & Taylor, L. (2003) · Journal of Educational and Psychological Consultation · doi:10.1207/s1532768xjepc1401_01 · Cited by 198 · cited 1×
“Adelman and Taylor (2003) speak about the presence of the “valued functions” that reside within the innovation structures and giving attention to ways those functions can endure even as the innovation structures come and go.”
BackgroundStudying program implementation is not easy but it is essential
Durlak, J. A. (2015) · Prevention Science · doi:10.1007/s11121-015-0606-3 · Cited by 191 · cited 3×
“And perhaps most important, others highlight the need to understand the relative contributions of different innovation components and how different levels of component enactment are related to outcomes (Abry et al., 2015; Damschroder et al., 2009; Durlak, 2015; Odom, 2009).”
BackgroundRandomised Controlled Trials for Evidence-based Education: Some Problems in Judging 'What Works'
Morrison, K. (2001) · Evaluation & Research in Education · doi:10.1080/09500790108666984 · Cited by 90 · cited 1×
“In medical clinical settings, “what works” is a matter of judgment that weighs, judges, and considers RCT findings in context (Morrison, 2001).”
BackgroundHistorical Roots of Dissemination and Implementation Science
Dearing, J. W., & Kee, K. F. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0003 · Cited by 67 · cited 7×
“As Dearing and Kee (2012) explained, anthropologists’ work “focused not only on spread of innovations, but also on how cultures in turn shaped those innovations by giving them new purposes and by adapting them to suit local needs—the beginnings of what we now call implementation science” (p. 61).”
BackgroundInfluentialCentury, J., Cassata, A., Rudnick, M., & Freeman, C. (2012) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-012-9287-x · Cited by 51
Self-citation
Cited by
Mapping roles in research-practice partnerships – a systematic literature review
Sjölund, S., Lindvall, J., Larsson, M., & Ryve, A. (2023) · Educational Review · doi:10.1080/00131911.2021.2023103 · Cited by 86
Krainer, K. (2021) · ZDM – Mathematics Education · doi:10.1007/s11858-021-01300-y · Cited by 21
Metadata
- Authors
- Century, J., & Cassata, A.
- Venue
- Review of Research in Education
- Published
- 2016-03
- Volume
- 40
- Issue
- 1
- Pages
- 169-215
- ISSN
- 0091-732X (ISSN-L)
- 1935-1038
- OpenAlex
- W2773649080
- Cited by
- 220
- References
- 31
- FWCI
- 11.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.