Design and Analysis in Dissemination and Implementation Research
Abstract
There remains a lack of consensus on methodological approaches to the study of dissemination and implementation (D&I) processes, and especially tests of implementation strategies. To begin to address these deficiencies, this chapter reviews design issues for dissemination and implementation research. It presents an overview of some of the analytic approaches to D&I research, recognizing that this analytic work is still at an early stage of development. Finally, the chapter presents a case study of research that crosses three of four recognized D&I phases and illustrates a number of design and analysis issues.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Crafting the study approach section is complicated by the current lack of consensus on methodological approaches to the study of implementation processes, measuring implementation context and outcomes, and testing implementation strategies.
“Yet, crafting the study approach section is complicated by the current lack of consensus on methodological approaches to the study of implementation processes, measuring implementation context and outcomes, and testing implementation strategies [112,113].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [113]
The traditional translational pipeline is commonly used by NIH and other research-focused organizations to move knowledge from basic and pre-intervention research through efficacy and effectiveness trials to a stage reaching the public.
“This traditional translational pipeline is commonly used by the National Institutes of Health (NIH) and other research-focused organizations to move scientific knowledge from basic and other pre-intervention research, to efficacy and effectiveness trials, to a stage that reaches the public (66, 79).”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [66]
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Indexing by latent semantic analysis
Deerwester, S. C., Dumais, S., Furnas, G. W., Landauer, T. K., & Harshman, R. A. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6 · Cited by 12,758 · see citing works
The Statistical Analysis of Failure Time Data.
Aitkin, M. A., Kalbfleisch, J. D., & Prentice, R. L. (1981) · Biometrics · doi:10.2307/2530581 · Cited by 9,875 · see citing works
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230 · see citing works
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058 · see citing works
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563 · see citing works
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793 · see citing works
Principal Stratification in Causal Inference
Frangakis, C., & Rubin, D. B. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00021.x · Cited by 1,496 · see citing works
The web of human sexual contacts
Liljeros, F., Edling, C., Amaral, L. A. N., Stanley, E., & Åberg, Y. (2001) · RePEc: Research Papers in Economics · Cited by 1,389 · see citing works
Practice-based research--“Blue Highways” on the NIH roadmap
Westfall, J. M., Mold, J., & Fagnan, L. (2007) · JAMA · doi:10.1001/jama.297.4.403 · Cited by 1,209 · see citing works
Handbook of Practical Program Evaluation
Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2010) · Cited by 960 · see citing works
Zerhouni, E. (2003) · Science · doi:10.1126/science.1091867 · Cited by 918 · see citing works
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907 · see citing works
Self-citationTranslational and Clinical Science — Time for a New Vision
Zerhouni, E. A. (2005) · New England Journal of Medicine · doi:10.1056/nejmsb053723 · Cited by 729 · see citing works
Flay, B. R. (1986) · Preventive Medicine · doi:10.1016/0091-7435(86)90024-1 · Cited by 723 · see citing works
Cook, T. D., Shadish, W. R., & Wong, V. C. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20375 · Cited by 604 · see citing works
Cost-Effectiveness of Screening for HIV in the Era of Highly Active Antiretroviral Therapy
Sanders, G. D., Bayoumi, A. M., H, V. S. M. P., Bilir, S. P., Neukermans, C. P., Rydzak, C. E., Douglass, L. R., Lazzeroni, L. C., Holodniy, M., & Owens, D. K. (2005) · New England Journal of Medicine · doi:10.1056/nejmsa042657 · Cited by 603 · see citing works
Statistical power and optimal design for multisite randomized trials.
Raudenbush, S. W., & Liu, X. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.199 · Cited by 593 · see citing works
Prevention effectiveness : a guide to decision analysis and economic evaluation
Haddix, A. C. (1996) · Cited by 574 · see citing works
Systems Engineering Principles and Practice
Kossiakoff, A., Seymour, S. J., Flanigan, D. A., et al. (2020) · Wiley eBooks · doi:10.1002/9781119516699 · Cited by 510 · see citing works
The CDC Diabetes Cost-effectiveness Group (2002) · JAMA · doi:10.1001/jama.287.19.2542 · Cited by 507 · see citing works
Muthén, B. (2001) · American Psychological Association eBooks · doi:10.1037/10409-010 · Cited by 442 · see citing works
Alternatives to the Randomized Controlled Trial
West, S. G., Duan, N., Pequegnat, W., Gaist, P., Jarlais, D. C. D., Holtgräve, D. R., Szapocznik, J., Fishbein, M., Rapkin, B. D., Clatts, M. C., et al. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.124446 · Cited by 405 · see citing works
Direct and Indirect Causal Effects via Potential Outcomes*
Rubin, D. B. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.02-123.x · Cited by 324 · see citing works
Stuart, E. A., & Green, K. M. (2008) · Developmental Psychology · doi:10.1037/0012-1649.44.2.395 · Cited by 315 · see citing works
Gaspoz, J., Coxson, P. G., Goldman, P. A., Williams, L. W., Kuntz, K. M., Hunink, M. G. M., & Goldman, L. (2002) · New England Journal of Medicine · doi:10.1056/nejm200206063462309 · Cited by 288 · see citing works
Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283 · see citing works
Self-citationEffects of a Foster Parent Training Intervention on Placement Changes of Children in Foster Care
Price, J. M., Chamberlain, P., Landsverk, J. A., Reid, J. B., Leve, L. D., & Laurent, H. K. (2008) · Child Maltreatment · doi:10.1177/1077559507310612 · Cited by 277 · see citing works
Self-citationPrincipal Stratification Approach to Broken Randomized Experiments
Barnard, J., Frangakis, C., Hill, J., & Rubin, D. B. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000071 · Cited by 268 · see citing works
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262 · see citing works
Self-citationNo Time to Lose: Getting More From HIV Prevention
(2001) · PsycEXTRA Dataset · doi:10.1037/e720002007-001 · Cited by 261 · see citing works
Juvenile delinquency in child welfare: Investigating group home effects
Ryan, J. P., Marshall, J. M., Herz, D. C., & Hernandez, P. M. (2008) · Children and Youth Services Review · doi:10.1016/j.childyouth.2008.02.004 · Cited by 251 · see citing works
Chamberlain, P., Leve, L. D., & DeGarmo, D. S. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.1.187 · Cited by 238 · see citing works
Self-citationTHE ANALYTIC HIERARCHY PROCESS IN CONFLICT MANAGEMENT
Saaty, T. L. (1990) · International Journal of Conflict Management · doi:10.1108/eb022672 · Cited by 161 · see citing works
Principal Stratification for Causal Inference With Extended Partial Compliance
Jin, H., & Rubin, D. B. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000000347 · Cited by 149 · see citing works
A Call to Address Complexity in Prevention Science Research
Lich, K. H., Ginexi, E. M., Osgood, N. D., & Mabry, P. L. (2012) · Prevention Science · doi:10.1007/s11121-012-0285-2 · Cited by 137 · see citing works
Observational Methods in Comparative Effectiveness Research
Concato, J., Lawler, E. V., Lew, R., Gaziano, J. M., Aslan, M., & Huang, G. D. (2010) · The American Journal of Medicine · doi:10.1016/j.amjmed.2010.10.004 · Cited by 124 · see citing works
Brown, C. H., & Liao, J. (1999) · American Journal of Community Psychology · doi:10.1023/a:1022142021441 · Cited by 116 · see citing works
Self-citationOutcome evaluation of Girls and Boys Town's family home program
Larzelere, R. E., Daly, D. L., Davis, J. L., Chmelka, M. B., & Handwerk, M. L. (2004) · Education and Treatment of Children · Cited by 105 · see citing works
Chamberlain, P., Brown, C. H., Saldana, L., Reid, J., Wang, W., Marsenich, L., Sosna, T., Padgett, C., & Bouwman, G. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0167-x · Cited by 100 · see citing works
Self-citationDynamic wait-listed designs for randomized trials: new designs for prevention of youth suicide
Brown, C. H., Wyman, P. A., Guo, J., & Peña, J. (2006) · Clinical Trials · doi:10.1191/1740774506cn152oa · Cited by 99 · see citing works
Self-citationIntroduction to the special section on Resources for Enhancing Alzheimer's Caregiver Health (REACH).
Schulz, R., Belle, S. H., Czaja, S. J., Gitlin, L. N., Wisniewski, S. R., & Ory, M. G. (2003) · Psychology and Aging · doi:10.1037/0882-7974.18.3.357 · Cited by 85 · see citing works
Self-citationPulver, A. E., Liang, K., Brown, C. H., et al. (1992) · The British Journal of Psychiatry · doi:10.1192/bjp.160.1.65 · Cited by 76 · see citing works
Self-citationA methodology for describing and decomposing complex psychosocial and behavioral interventions.
Czaja, S. J., Schulz, R., Lee, C. C., & Belle, S. H. (2003) · Psychology and Aging · doi:10.1037/0882-7974.18.3.385 · Cited by 75 · see citing works
Self-citationCascading implementation of a foster and kinship parent intervention.
Chamberlain, P., Price, J. M., Reid, J. B., & Landsverk, J. A. (2008) · PubMed · Cited by 74 · see citing works
Self-citationHierarchical document classification using automatically generated hierarchy
Li, T., Shenghuo Zhu, B., & Ogihara, M. (2007) · Journal of Intelligent Information Systems · doi:10.1007/s10844-006-0019-7 · Cited by 56 · see citing works
Self-citationFrangakis, C., Brookmeyer, R., Varadhan, R., Safaeian, M., Vlahov, D., & Strathdee, S. A. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000232 · Cited by 55 · see citing works
Wang, W., Saldana, L., Brown, C. H., & Chamberlain, P. (2010) · Implementation Science · doi:10.1186/1748-5908-5-72 · Cited by 43 · see citing works
Self-citationGoldhaber‐Fiebert, J. D., Snowden, L. R., Wulczyn, F., Landsverk, J. A., & Horwitz, S. M. (2011) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2011.05.012 · Cited by 37 · see citing works
Self-citationSample Size Determination for Studies with Repeated Continuous Outcomes
Bhaumik, D. K., Roy, A., Aryal, S., Hur, K., Duan, N., Normand, S. T., Brown, C. H., & Gibbons, R. D. (2008) · Psychiatric Annals · doi:10.3928/00485713-20081201-01 · Cited by 33 · see citing works
Self-citationText categorization via generalized discriminant analysis
Li, T., Zhu, S., & Ogihara, M. (2008) · Information Processing & Management · doi:10.1016/j.ipm.2008.03.005 · Cited by 28 · see citing works
Self-citationSchool Choice in NY City: A Bayesian Analysis of an Imperfect Randomized Experiment
Barnard, J., Frangakis, C., Hill, J. L., & Rubin, D. (2001) · Lecture notes in statistics · doi:10.1007/978-1-4613-0035-9_1 · Cited by 27 · see citing works
PODUSKA, J. M., Kellam, S. G., Brown, C. H., Ford, C., Windham, A. M., Keegan, N., & Wang, W. (2009) · Implementation Science · doi:10.1186/1748-5908-4-56 · Cited by 20 · see citing works
Self-citationMeasuring contract agency performance with administrative data.
Wulczyn, F., Orlebeke, B., & Melamid, E. (2001) · PubMed · Cited by 16 · see citing works
(2009)
Flagged first, then by citations
Cited by
Sorted by citations
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0528-y · Cited by 12,038 · see citing works
“method designs in implementation research (Proctor et al. 2009; Landsverk et al. 2012; Palinkas et al. 2011a; Aarons et al. 2011).”
Self-citationImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488 · see citing works
An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509 · see citing works
Self-citationReflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299 · see citing works
Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283 · see citing works
Self-citationWriting implementation research grant proposals: ten key ingredients
Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-96 · Cited by 169 · see citing works
Brown, C. H., Chamberlain, P., Saldana, L., Padgett, C., Wang, W., & Cruden, G. (2014) · Implementation Science · doi:10.1186/s13012-014-0134-8 · Cited by 89 · see citing works
Self-citationBrown, C. H., Kellam, S. G., Kaupert, S., Muthén, B. O., Wang, W., Muthén, L. K., Chamberlain, P., PoVey, C. L., Cady, R., Valente, T. W., et al. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0387-3 · Cited by 68 · see citing works
Self-citationKomro, K. A., Flay, B. R., Biglan, A., & Wagenaar, A. C. (2016) · Translational Behavioral Medicine · doi:10.1007/s13142-015-0358-4 · Cited by 62 · see citing works
Brown, C. H., Mohr, D. C., Gallo, C. G., Mader, C., Palinkas, L., Wingood, G., Prado, G., Kellam, S. G., Pantin, H., Poduska, J., et al. (2013) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0b013e31829372bd · Cited by 55 · see citing works
Self-citationPalinkas, L. A., Holloway, I. W., Rice, E., Brown, C. H., Valente, T. W., & Chamberlain, P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-133 · Cited by 20 · see citing works
Self-citationRusson, J., Morrissey, J., Dellinger, J., Jin, B., & Diamond, G. (2022) · Crisis · doi:10.1027/0227-5910/a000821 · Cited by 18 · see citing works
- Authors
- Landsverk, J., Brown, C. H., Chamberlain, P., Palinkas, L., Ogihara, M., Czaja, S., Goldhaber-Fiebert, J. D., Rolls Reutz, J. A., & Horwitz, S. M.
- ORCID
- Venue
- Dissemination and Implementation Research in HealthTranslating Science to Practice
- Publisher
- Oxford University Press
- Published
- 2012-03-29
- Pages
- 225-260
- OpenAlex
- W2483397181
- Cited by
- 114
- References
- 57
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 6 · 2023: 4 · 2022: 6 · 2021: 9 · 2020: 14 · 2019: 10 · 2018: 6 · 2017: 6 · 2016: 8 · 2015: 10 · 2014: 12 · 2013: 14 · 2012: 2
- FWCI
- 61.76
- Type
- book chapter
- Language
- en
- Open access
- closed
- Locations
- Oxford University Press eBooks (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- dissemination and implementation research, implementation strategies, research design, analytical approach, implementation process, implementation evaluation, methodological consensus
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
