Moving from efficacy to effectiveness trials in prevention research
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Efficacy trials test whether interventions work under optimal, highly controlled conditions whereas effectiveness trials test whether interventions work with typical clients and providers in real-world settings. Researchers, providers, and funding bodies have called for more effectiveness trials to understand whether interventions produce effects under ecologically valid conditions, which factors predict program effectiveness, and what strategies are needed to successfully implement programs in practice settings. The transition from efficacy to effectiveness with preventive interventions involves unique considerations, some of which are not shared by treatment research. The purpose of this article is to discuss conceptual and methodological issues that arise when making the transition from efficacy to effectiveness research in primary, secondary, and tertiary prevention, drawing on the experiences of two complimentary research groups as well as the existing literature. We address (a) program of research, (b) intervention design and conceptualization, (c) participant selection and characteristics, (d) providers, (e) context, (f) measurement and methodology, (g) outcomes, (h) cost, and (i) sustainability. We present examples of research in eating disorder prevention that demonstrate the progression from efficacy to effectiveness trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
In search of how people change: Applications to addictive behaviors.
Prochaska, J. O., DiClemente, C. C., & Norcross, J. C. (1992) · American Psychologist · doi:10.1037/0003-066x.47.9.1102 · Cited by 8,596
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 4×
“Part of effectiveness trials might involve finding the optimal dosage of an intervention that produces the desired outcomes, so that a program is an optimal length but not more complicated than necessary (Chambless & Hollon, 1998).”
InfluentialReducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · cited 5×
“However, matching can also provide inaccurate estimates of intervention effects and should be used with caution (Flay et al., 2005).”
InfluentialExplanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185 · cited 3×
“In reality much research lies on a continuum between the two; “pragmatic” randomized controlled trials are a hybrid of these, blending aspects of experimental control and external validity (Schwartz & Lellouch, 1967; Zwarenstein & Treweek, 2009).”
Core Implementation Components
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335549 · Cited by 1,103
Green, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922 · cited 1×
“…center on the low external validity and generalizability of results from “pure” efficacy studies, and the difficulty and time required in moving from this type of research to effectiveness trials (Glasgow et al., 2003; Green & Glasgow, 2006; Tunis et al., 2003; Zwarenstein & Treweek, 2009).”
Flay, B. R. (1986) · Preventive Medicine · doi:10.1016/0091-7435(86)90024-1 · Cited by 723
Eating disorder prevention programs: A meta-analytic review.
Stice, E., & Shaw, H. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.2.206 · Cited by 510 · cited 1×
“Based on the effects observed in three preliminary trials (reviewed in Stice & Shaw, 2004), a large efficacy trial was conducted (Stice, Marti et al., 2008).”
Self-citationPitfalls of and controversies in cluster randomization trials
Donner, A., & Klar, N. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.416 · Cited by 442 · cited 1×
“…randomized designs can be used to assign intact groups to intervention conditions; researchers must, however, choose appropriate statistical methods to deal with these group-level data (i.e., a statistic that takes into account both group-level and individual-level variance; Donner & Klar, 2004).”
Wells, K. B. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.1.5 · Cited by 390 · cited 6×
“Effectiveness trials often require larger samples than efficacy trials because greater variability of participants, providers, and settings results in decreased statistical power and potentially smaller effects (Wells, 1999).”
InfluentialHoagwood, K., Hibbs, E., Brent, D., & Jensen, P. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.5.683 · Cited by 266
Clarke, G. N. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.5.718 · Cited by 193
Stice, E., Rohde, P., Seeley, J. R., & Gau, J. M. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0012645 · Cited by 182
Self-citationCost-effectiveness of guided self-help treatment for recurrent binge eating
Lynch, F. L., Striegel-Moore, R. H., Dickerson, J. F., Perrin, N., DeBar, L., Wilson, G. T., & Kraemer, H. C. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018982 · Cited by 100
Phases of alcohol problem prevention research
Holder, H., Flay, B., Howard, J., Boyd, G., Voas, R., & Grossman, M. (1999) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.1999.tb04043.x · Cited by 57 · cited 1×
“…Rohrbach, Skara, & Pentz, 2006) and a few reports have described programs of efficacy to effectiveness research in various fields of prevention, including substance abuse, childhood obesity, and HIV infection (Holder et al., 1999; Reynolds & Spruijt-Metz, 2006; Solomon, Card, & Malow, 2006).”
Cited by
Fleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670
“Interventions may have poorer outcomes when implemented in community or clinical settings than they do in research trials [10-12].”
BackgroundKoorts, H., Eakin, E., Estabrooks, P., Timperio, A., Salmon, J., & Bauman, A. (2018) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-018-0678-0 · Cited by 335
Shonkoff, J. P., & Fisher, P. A. (2013) · Development and Psychopathology · doi:10.1017/s0954579413000813 · Cited by 326
Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283
“However, as noted in the introduction, there are discontinuities on the continuum between epidemiology and intervention dissemination, and not all research proceeds temporally from efficacy to effectiveness to dissemination (Marchand et al. 2011).”
BackgroundWhat works in secondary schools? A systematic review of classroom-based body image programs
Yager, Z., Diedrichs, P. C., Ricciardelli, L. A., & Halliwell, E. (2013) · Body Image · doi:10.1016/j.bodyim.2013.04.001 · Cited by 250
Metadata
- Authors
- Marchand, E., Stice, E., Rohde, P., & Becker, C. B.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2011-01
- Volume
- 49
- Issue
- 1
- Pages
- 32-41
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W1967583216
- Cited by
- 136
- References
- 19
- FWCI
- 12.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.