Research design issues for evaluating complex multicomponent interventions in neighborhoods and communities

Komro, Kelli A.; Flay, Brian R.; Biglan, Anthony; Wagenaar, Alexander C.

doi:10.1007/s13142-015-0358-4

Cited by 66Health Policy Implementation ScienceEvaluation and Performance AssessmentCommunity Health and Development

Research design issues for evaluating complex multicomponent interventions in neighborhoods and communities

Open access

Komro, Kelli A., Flay, Brian R., Biglan, Anthony, Wagenaar, Alexander C.·2016·Translational Behavioral Medicine

DOI 10.1007/s13142-015-0358-4PMC PMC4807196

Open this paper in CoChat — free account Open PDF

Abstract

Major advances in population health will not occur unless we translate existing knowledge into effective multicomponent interventions, implement and maintain these in communities, and develop rigorous translational research and evaluation methods to ensure continual improvement and sustainability. We discuss challenges and offer approaches to evaluation that are key for translational research stages 3 to 5 to advance optimized adoption, implementation, and maintenance of effective and replicable multicomponent strategies. The major challenges we discuss concern (a) multiple contexts of evaluation/research, (b) complexity of packages of interventions, and (c) phases of evaluation/research questions. We suggest multiple alternative research designs that maintain rigor but accommodate these challenges and highlight the need for measurement systems. Longitudinal data collection and a standardized continuous measurement system are fundamental to the evaluation and refinement of complex multicomponent interventions. To be useful to T3-T5 translational research efforts in neighborhoods and communities, such a system would include assessments of the reach, implementation, effects on immediate outcomes, and effects of the comprehensive intervention package on more distal health outcomes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1007/s13142-015-0358-4

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

This tension between controlled experiments and more complex, community interventions is highlighted elsewhere in the literature, with no single methodology being advocated.
“This tension between controlled experiments and more complex, community interventions is highlighted elsewhere in the literature, with no single methodology being advocated (Nutbeam, 1998; Domegan et al., 2016; Komro et al., 2016; Wong et al., 2017).”
From Blue care: a systematic review of blue space interventions for health and wellbeing (2020) · cites this paper as Komro et al., 2016

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Untitled work
(2002) · Cited by 13,211 · see citing works
Utilization-Focused Evaluation
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n729 · Cited by 2,315 · see citing works
Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228 · see citing works
A pragmatic–explanatory continuum indicator summary (PRECIS): a tool to help trial designers
Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G., Tunis, S., Bergel, E., Harvey, I., Magid, D. J., et al. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.12.011 · Cited by 1,389 · see citing works
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · see citing works
Self-citation
The effects of poverty on the mental, emotional, and behavioral health of children and youth: implications for prevention.
Yoshikawa, H., Aber, J. L., & Beardslee, W. R. (2012) · American Psychologist · doi:10.1037/a0028015 · Cited by 1,090 · see citing works
How Can We Increase Translation of Research into Practice? Types of Evidence Needed
Glasgow, R. E., & Emmons, K. M. (2007) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.28.021406.144145 · Cited by 1,050 · see citing works
Current Directions in Mediation Analysis
MacKinnon, D. P., & Fairchild, A. J. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01598.x · Cited by 940 · see citing works
Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within‐study comparisons
Cook, T. D., Shadish, W. R., & Wong, V. C. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20375 · Cited by 604 · see citing works
Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments
Shadish, W. R., Clark, M. H., & Steiner, P. M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000733 · Cited by 479 · see citing works
A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers
Thorpe, K. E., Zwarenstein, M., Oxman, A., Treweek, S. P., Furberg, C. D., Altman, D. G., Tunis, S., Bergel, E. F., Harvey, I. M., Magid, D. J., et al. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.090523 · Cited by 422 · see citing works
Are High Quality Schools Enough to Close the Achievement Gap? Evidence from a Social Experiment in Harlem
Dobbie, W., & Fryer, R. (2009) · doi:10.3386/w15473 · Cited by 299 · see citing works
Dissemination and Implementation Research in Health
Chambers, D. (2023) · doi:10.1093/oso/9780197660690.001.0001 · Cited by 246 · see citing works
Public Health Law Research: Theory and Methods
Wagenaar, A. C., & Burris, S. C. (2014) · Journal of Nursing Regulation · doi:10.1016/s2155-8256(15)30116-2 · Cited by 151 · see citing works
Self-citation
The bottom-up approach to integrative validity: A new perspective for program evaluation
Chen, H. T. (2009) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2009.10.002 · Cited by 141 · see citing works
Translational Behavioral Medicine
Spring, B. J., Pfammatter, A. F., Hoffman, S. A., & Warnick, J. L. (2017) · Springer eBooks · doi:10.1007/978-1-4614-6439-6_221-2 · Cited by 134 · see citing works
Creating Nurturing Environments: A Science-Based Framework for Promoting Child Health and Development Within High-Poverty Neighborhoods
Komro, K. A., Flay, B. R., & Biglan, A. (2011) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-011-0095-2 · Cited by 119 · see citing works
Self-citation
Case matching and the reduction of selection bias in quasi-experiments: The relative importance of pretest measures of outcome, of unreliable measurement, and of mode of data analysis.
Cook, T. D., & Steiner, P. M. (2010) · Psychological Methods · doi:10.1037/a0018536 · Cited by 115 · see citing works
Design and Analysis in Dissemination and Implementation Research
Landsverk, J., Brown, C. H., Chamberlain, P., Palinkas, L., Ogihara, M., Czaja, S., Goldhaber-Fiebert, J. D., Rolls Reutz, J. A., & Horwitz, S. M. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0012 · Cited by 114 · see citing works
Estimating Causal Effects in Mediation Analysis Using Propensity Scores
Coffman, D. L. (2011) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2011.582001 · Cited by 71 · see citing works
Systems Thinking in Dissemination and Implementation Research
Holmes, B. J., Finegood, D. T., Riley, B., & Best, A. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0009 · Cited by 63 · see citing works
Beyond the clinic: improving child health through evidence-based community development
Komro, K. A., Tobler, A. L., Delisle, A. L., O'Mara, R. J., & Wagenaar, A. C. (2013) · BMC Pediatrics · doi:10.1186/1471-2431-13-172 · Cited by 52 · see citing works
Self-citation
The Path Forward in Dissemination and Implementation Research
Brownson, R. C., Dreisinger, M., Colditz, G. A., & Proctor, E. K. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0024 · Cited by 18 · see citing works
Untitled work
(2009)

Flagged first, then by citations

Research works printed but not linked: 1

Brownson RC, Colditz GA, Proctor EK. Design and analysis in dis- semination and implementation research: Oxford University Press, 2012

Sorted by citations

Blue care: a systematic review of blue space interventions for health and wellbeing
Britton, E., Kindermann, G., Domegan, C., & Carlin, C. (2020) · Health Promotion International · doi:10.1093/heapro/day103 · Cited by 483 · see citing works
Structural interventions to reduce and eliminate health disparities
Brown, A. F., Ma, G. X., Miranda, J., Eng, E., Castille, D., Brockie, T., Jones, P., Airhihenbuwa, C. O., Farhat, T., Zhu, L., et al. (2019) · American Journal of Public Health · doi:10.2105/ajph.2018.304844 · Cited by 465 · see citing works
The full translational spectrum of prevention science: facilitating the transfer of knowledge to practices and policies that prevent behavioral health problems
Fishbein, D. H., Ridenour, T. A., Herman-Stahl, M. A., & Sussman, S. Y. (2016) · Translational Behavioral Medicine · doi:10.1007/s13142-015-0376-2 · Cited by 106 · see citing works
How can experiments play a greater role in public policy? Twelve proposals from an economic model of scaling
Al‐Ubaydli, O., Lee, M. S., List, J. A., Mackevicius, C. L., & Suskind, D. L. (2020) · Behavioural Public Policy · doi:10.1017/bpp.2020.17 · Cited by 75 · see citing works
Inspiration, inoculation, and introductions are all critical to successful mentorship for undergraduate women pursuing geoscience careers
Hernandez, P. R., Adams, A. S., Barnes, R. T., Bloodhart, B., Burt, M., Clinton, S. M., Du, W., Henderson, H. L., Pollack, I. B., & Fischer, E. V. (2020) · Communications Earth & Environment · doi:10.1038/s43247-020-0005-y · Cited by 46 · see citing works
The Science of Using Science: Towards an Understanding of the Threats to Scaling Experiments
Al‐Ubaydli, O., List, J. A., & Suskind, D. L. (2019) · National Bureau of Economic Research · doi:10.3386/w25848 · Cited by 46 · see citing works
Human-Centered Design for Public Health Innovation: Codesigning a Multicomponent Intervention to Support Youth Across the HIV Care Continuum in Mozambique
Mukherjee, T. I., Zerbe, A., Falcão, J., Carey, S., Iaccarino, A., Kolada, B., Olmedo, B., Shadwick, C., Singhal, H., Weinstein, L., et al. (2022) · Global Health Science and Practice · doi:10.9745/ghsp-d-21-00664 · Cited by 39 · see citing works
Augmentations to the asset-based community development model to target power systems
Maclure, L. (2022) · Community Development · doi:10.1080/15575330.2021.2021964 · Cited by 55 · see citing works
Place-based approaches to improve health and development outcomes in young children: A scoping review
Giles, F. C., Crawford, S. B., Hackworth, N. J., Hokke, S., & Nicholson, J. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0261643 · Cited by 30 · see citing works
Role of Universal Parenting Programs in Prevention
Salari, R., & Enebrink, P. (2018) · Springer eBooks · doi:10.1007/978-3-319-94598-9_32 · Cited by 27 · see citing works
Novel public–private partnerships to address the double burden of malnutrition
Drewnowski, A., Caballero, B. H., Das, J. K., French, J., Prentice, A. M., Fries, L. R., van Koperen, T. M., Klassen-Wigger, P., & Rolls, B. J. (2018) · Nutrition Reviews · doi:10.1093/nutrit/nuy035 · Cited by 22 · see citing works
Social Intervention Research
Sundell, K., & Olsson, T. (2017) · Oxford Bibliographies in Social Work · doi:10.1093/obo/9780195389678-0254 · Cited by 21 · see citing works
Barriers to the evaluation of evidence-based public health policy
Freund, M., Zucca, A. C., Sanson‐Fisher, R., Milat, A., Mackenzie, L., & Turon, H. (2018) · Journal of Public Health Policy · doi:10.1057/s41271-018-0145-9 · Cited by 15 · see citing works
Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J., Akter, S., Rahman, T., Hall, A. E., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2020) · Implementation Science · doi:10.1186/s13012-020-01054-3 · Cited by 14 · see citing works
Responding to neurodiversity in the courtroom: A brief evaluation of environmental accommodations to increase procedural fairness
Clasby, B., Mirfin‐Veitch, B. F., Blackett, R., Kedge, S., & Whitehead, E. (2022) · Criminal Behaviour and Mental Health · doi:10.1002/cbm.2239 · Cited by 13 · see citing works
Comprehensive approaches to addressing mental health needs and enhancing school security: a hybrid type II cluster randomized trial
Eisman, A. B., Heinze, J. E., Kilbourne, A. M., Franzen, S. P., Melde, C., & McGarrell, E. F. (2020) · Health & Justice · doi:10.1186/s40352-020-0104-y · Cited by 13 · see citing works
The SUMMIT ambulatory-ICU primary care model for medically and socially complex patients in an urban federally qualified health center: study design and rationale
Chan, B. L., Edwards, S. T., Devoe, M., Gil, R., Mitchell, M., Englander, H. L., Nicolaidis, C., Kansagara, D. L., Saha, S., & Korthuis, P. T. (2018) · Addiction Science & Clinical Practice · doi:10.1186/s13722-018-0128-y · Cited by 12 · see citing works
Development of a salutogenic intervention for healthy eating among Dutch type 2 diabetes mellitus patients
Polhuis, K. C. M. M., Vaandrager, L., Soedamah-Muthu, S. S., & Koelen, M. A. (2021) · Health Promotion International · doi:10.1093/heapro/daab020 · Cited by 10 · see citing works
Assessing Implementation and Effects Associated with a Comprehensive Framework Designed to Reduce School Violence: A Randomized Controlled Trial
Dymnicki, A. B., Mattson, S. A., Spier, E., Argamaso, S., & Kingston, B. E. (2021) · Journal of School Violence · doi:10.1080/15388220.2021.1952078 · Cited by 8 · see citing works
Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2023) · BMC Public Health · doi:10.1186/s12889-023-16395-z · Cited by 6 · see citing works
System dynamics simulation models on overweight and obesity in children and adolescents: A systematic review
Aguiar, A., Gebremariam, M. K., Romanenko, E., Önal, F., Kopainsky, B., Savona, N., Brown, A. D., Allender, S. E., & Lien, N. (2023) · Obesity Reviews · doi:10.1111/obr.13632 · Cited by 6 · see citing works
Racial disparities in stroke incidence in the Women's Health Initiative: Exploring biological, behavioral, psychosocial, and social risk factors
Calancie, L., Leng, X., Whitsel, E. A., Cené, C. W., Lich, K. H., Dave, G., & Corbie-Smith, G. M. (2023) · SSM - Population Health · doi:10.1016/j.ssmph.2023.101570 · Cited by 4 · see citing works
Advancing Methodological Rigor for Psychosocial Aspects of Neuropalliative Care Interventions
Plys, E., Grunberg, V. A., & Vranceanu, A. (2024) · Journal of Palliative Care · doi:10.1177/08258597241232490 · Cited by 4 · see citing works
Community Mental Health Promotion Principles and Strategies
Barry, M. M. (2019) · Springer eBooks · doi:10.1007/978-3-030-23455-3_6 · Cited by 5 · see citing works
Association between multi-component initiatives and physical activity-related behaviors: interim findings from the Healthy Schools Healthy Communities initiative
Calise, T. V., Spitzer, N., Ruggiero, L., Ryder, A., Wingerter, C., & Hatcher, A. (2021) · BMC Public Health · doi:10.1186/s12889-021-10312-y · Cited by 3 · see citing works
A Hybrid Pragmatic and Factorial Cluster Randomized Controlled Trial for an Anti-racist, Multilevel Intervention to Improve Mental Health Equity in High Schools
Mulawa, M. I., Docherty, S. L., Bailey, D. E., Gonzalez-Guarda, R. M., Lipkus, I. M., Randolph, S. D., Yang, Q., & Pan, W. (2024) · Prevention Science · doi:10.1007/s11121-023-01626-x · Cited by 3 · see citing works
The Application of the Theory Coding Scheme to Interventions in Occupational Health Psychology
Horan, K. A., Streit, J. M. K., Beltramo, J. M. D., & Post, M. L. (2020) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000002112 · Cited by 3 · see citing works
Flourish and nourish : Development and evaluation of a salutogenic healthy eating programme for people with type 2 diabetes mellitus
Polhuis, K. C. M. M. (2023) · doi:10.18174/631882 · Cited by 2 · see citing works
Aligning clinical research ethics with community-engaged and participatory research in the United States
Eder, M. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1122479 · Cited by 2 · see citing works
Healthy Aging Outcomes Research With Villages as Grassroots Community-Based Organizations: A Framework for Capacity Development
Greenfield, E. A., & Pope, N. E. (2025) · The Gerontologist · doi:10.1093/geront/gnaf145 · Cited by 2 · see citing works
25 Years of Complex Intervention Trials
Komro, K. A. (2017) · Research on Social Work Practice · doi:10.1177/1049731517718939 · Cited by 2 · see citing works
Self-citation
The impact of Indigenous‐led programs on alcohol‐related criminal incidents: a multiple baseline design evaluation
Munro, A., Shakeshaft, A. P., Breen, C. L., Jones, M. A., Oldmeadow, C. J., Allan, J., & Snijder, M. (2022) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.13211 · Cited by 2 · see citing works
Promoting Personal and Public Health
Stokols, D. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-803113-1.00005-3 · Cited by 1 · see citing works
Community Collaboration on Education Reform Say Yes Syracuse
Herman, R., Burnett, A., Cash, M., & Coleman, V. (2014)
Prevention and Treatment
Salas‐Wright, C. P., Vaughn, M. G., & González, J. M. R. (2016) · Palgrave Macmillan US eBooks · doi:10.1057/978-1-137-55817-6_8
Waterloo Better Beginnings as a Transformative Prevention Project: Impacts on Children, Parents, and the Community
Nelson, G. B., Hasford, J., Zatarain, C. L., Gilmer, A., Worton, S. K., Eid, M., Bangash, S., & Horne, J. D. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17103442
References
Gilchrist, A. (2019) · Policy Press eBooks · doi:10.51952/9781447347880.bm002
Research on the innovation of ideological and political education theory and practice in colleges and universities under the background of big data
Zhang, Y. (2023) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns.2023.2.00117
Additional file 4 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433374
Additional file 9 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433389
Additional file 3 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611310
Additional file 12 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611337
Additional file 10 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433359
Additional file 14 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611343
Additional file 6 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433380
Additional file 13 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611340
Additional file 5 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433377
Additional file 3 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433371
Additional file 6 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611319
Additional file 1 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611304
Additional file 5 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611316
Additional file 7 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611322
Additional file 7 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433383
Additional file 4 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611313
Additional file of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433362
Additional file 2 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433368
Additional file 11 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611334
Additional file 8 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611325
Additional file 2 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611307
Additional file 1 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433365
Additional file 9 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611328
Additional file 10 of Evaluating the impact of marketing interventions on sugar-free and sugar-sweetened soft drink sales and sugar purchases in a fast-food restaurant setting
Khan, A., Evangelista, A. U., & Varua, M. E. (2024) · Figshare · doi:10.6084/m9.figshare.26611331
Additional file 8 of Effectiveness of interventions to improve rates of intravenous thrombolysis using behaviour change wheel functions: a systematic review and meta-analysis
Hasnain, M. G., Attia, J. R., Akter, S., Rahman, T., Hall, A., Hubbard, I. J., Levi, C. R., & Paul, C. L. (2021) · Figshare · doi:10.6084/m9.figshare.14433386
Additional file 1 of Association between multi-component initiatives and physical activity-related behaviors: interim findings from the Healthy Schools Healthy Communities initiative
Calise, T. V., Spitzer, N., Ruggiero, L., Ryder, A., Wingerter, C., & Hatcher, A. (2021) · Figshare · doi:10.6084/m9.figshare.13978523
Un dispositif de formalisation de processus assistée par ordinateur pour l’évaluation de programme de promotion de la santé : application à PRALIMAP et PRALIMAP-INÉS, essais de prévention du surpoids
Legrand, K. (2017) · theses.fr (ABES) · doi:10.70675/30a6ea3cz5b1bz48e4zbff4zb2c7dbf591b4
Perceived School Climate and Adolescents' Subjective Well-Being: Discrimination Experiences as a Mediator and Psychological Capital as a ModeratorPreprint
Liu, J., Dongping, L. I., Peng, W., Jia, J., & Deng, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7231698

An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509 · see citing works
Critical Measurement Issues in Translational Research
Glasgow, R. E. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335497 · Cited by 42 · see citing works
Agency for Healthcare Research and Quality Evidence-based Practice Center methods for systematically reviewing complex multicomponent health care interventions
Guise, J., Chang, C., Viswanathan, M., Glick, S., Treadwell, J. R., Umscheid, C. A., Whitlock, E. P., Fu, R. F., Berliner, E., Paynter, R. A., et al. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.06.010 · Cited by 56 · see citing works
Using mixed methods to evaluate a complex public health family intervention in a community based setting: study design
Thomas, M., Stewart-Brown, S. L., Snooks, H. A., & Simkiss, D. E. (2008) · Research Space
Development and evaluation of complex multicomponent interventions in public health
Campbell, R. M., & Bonell, C. P. (2015) · doi:10.1093/med/9780199661756.003.0128 · Cited by 4 · see citing works

Authors: Komro, K. A., Flay, B. R., Biglan, A., & Wagenaar, A. C.
Affiliations: Emory University (US)
Oregon State University (US)
Oregon Research Institute (US)
University of Florida (US)
Corresponding author: Komro, Kelli A.
ORCID: Komro, Kelli A.
Flay, Brian R.
Biglan, Anthony
Wagenaar, Alexander C.
Venue: Translational Behavioral Medicine
Publisher: Oxford University Press (OUP)
Published: 2015-11-06
Volume: 6
Issue: 1
Pages: 153-159
ISSN: 1613-9860 (ISSN-L)
1869-6716
DOI: 10.1007/s13142-015-0358-4
PMC: PMC4807196
OpenAlex: W2137834590
Cited by: 62
References: 24
Citations by year: 2026: 1 · 2025: 1 · 2024: 12 · 2023: 6 · 2022: 4 · 2021: 16 · 2020: 6 · 2019: 4 · 2018: 6 · 2017: 3 · 2016: 2 · 2014: 1
FWCI: 6.69
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.springer.com/tdm (unspecified)
Locations: Translational Behavioral Medicine (publishedVersion)
Europe PMC (PubMed Central) (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
Funders: National Institute on Drug Abuse (DA028946)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
Health Sciences › Health Professions › General Health Professions › Community Health and Development
Keywords: multicomponent intervention, complex interventions, community-based intervention, neighborhood health, intervention evaluation, research design, translational research, longitudinal data collection, intervention reach, population health
MeSH terms: Environment, Evaluation Studies as Topic, Health Policy, Humans, Research Design, Randomized Controlled Trials as Topic, Translational Research, Biomedical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Research design issues for evaluating complex multicomponent interventions in neighborhoods and communities

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks