Moving from efficacy to effectiveness trials in prevention research
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Efficacy trials test whether interventions work under optimal, highly controlled conditions whereas effectiveness trials test whether interventions work with typical clients and providers in real-world settings. Researchers, providers, and funding bodies have called for more effectiveness trials to understand whether interventions produce effects under ecologically valid conditions, which factors predict program effectiveness, and what strategies are needed to successfully implement programs in practice settings. The transition from efficacy to effectiveness with preventive interventions involves unique considerations, some of which are not shared by treatment research. The purpose of this article is to discuss conceptual and methodological issues that arise when making the transition from efficacy to effectiveness research in primary, secondary, and tertiary prevention, drawing on the experiences of two complimentary research groups as well as the existing literature. We address (a) program of research, (b) intervention design and conceptualization, (c) participant selection and characteristics, (d) providers, (e) context, (f) measurement and methodology, (g) outcomes, (h) cost, and (i) sustainability. We present examples of research in eating disorder prevention that demonstrate the progression from efficacy to effectiveness trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
In search of how people change: Applications to addictive behaviors.
Prochaska, J. O., DiClemente, C. C., & Norcross, J. C. (1992) · American Psychologist · doi:10.1037/0003-066x.47.9.1102 · Cited by 8,596
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 4×
“Part of effectiveness trials might involve finding the optimal dosage of an intervention that produces the desired outcomes, so that a program is an optimal length but not more complicated than necessary (Chambless & Hollon, 1998).”
InfluentialReducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836 · cited 9×
“In contrast, effectiveness trials are designed to evaluate whether interventions produce effects when delivered by endogenous providers (e.g., school counselors, hospital staff), under real-world conditions in natural settings with heterogeneous samples (Flay, 1986; Glasgow et al., 2003).”
InfluentialImproving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Tunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · cited 5×
“However, matching can also provide inaccurate estimates of intervention effects and should be used with caution (Flay et al., 2005).”
InfluentialExplanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185 · cited 3×
“In reality much research lies on a continuum between the two; “pragmatic” randomized controlled trials are a hybrid of these, blending aspects of experimental control and external validity (Schwartz & Lellouch, 1967; Zwarenstein & Treweek, 2009).”
Core Implementation Components
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335549 · Cited by 1,103
Cited by
Fleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670
“Interventions may have poorer outcomes when implemented in community or clinical settings than they do in research trials [10-12].”
BackgroundKoorts, H., Eakin, E., Estabrooks, P., Timperio, A., Salmon, J., & Bauman, A. (2018) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-018-0678-0 · Cited by 335
Shonkoff, J. P., & Fisher, P. A. (2013) · Development and Psychopathology · doi:10.1017/s0954579413000813 · Cited by 326
Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283
“However, as noted in the introduction, there are discontinuities on the continuum between epidemiology and intervention dissemination, and not all research proceeds temporally from efficacy to effectiveness to dissemination (Marchand et al. 2011).”
BackgroundWhat works in secondary schools? A systematic review of classroom-based body image programs
Yager, Z., Diedrichs, P. C., Ricciardelli, L. A., & Halliwell, E. (2013) · Body Image · doi:10.1016/j.bodyim.2013.04.001 · Cited by 250
Improving Methodological Standards in Behavioral Interventions for Cognitive Enhancement
Shawn Green, C., Bavelier, D., Kramer, A. F., Vinogradov, S., Ansorge, U., Ball, K. K., Bingel, U., Chein, J. M., Colzato, L. S., Edwards, J. D., et al. (2019) · Journal of Cognitive Enhancement · doi:10.1007/s41465-018-0115-y · Cited by 235
“However, unlike efficacy studies—which focus on results obtained under a set of carefully controlled circumstances—effectiveness studies examine whether significant real-world impact is observed when the intervention is used in less than ideally controlled settings (e.g., in the “real-world”; Fritz and Cleland 2003; M…”
BackgroundBecker, K. D., Boustani, M., Gellatly, R., & Chorpita, B. F. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2017.1326121 · Cited by 234
“[American Psychiatric Association, 1994] Axis IV stressor, low socioeconomic status, caregiver symptomatology; Marchand et al., 2011; Southam-Gerow, Chorpita, Miller, & Gleacher, 2008) that make it more difficult for these clients to participate in treatment (Gopalan et al., 2010).”
BackgroundBody image as a global mental health concern
Rodgers, R. F., Laveway, K., Campos, P., & de Carvalho, P. H. B. (2023) · Cambridge Prisms: Global Mental Health · doi:10.1017/gmh.2023.2 · Cited by 194
“Effective interventions to decrease body image concerns have been developed, in particular those that increase understandings of the socially constructed nature of appearance ideals and decrease adherence to them (Marchand et al., 2011; Lewis-Smith et al., 2019).”
BackgroundReducing eating disorder symptoms and risk factors using the internet: A meta‐analytic review
Melioli, T., Bauer, S., Franko, D. L., Moessner, M., Ozer, F., Chabrol, H., & Rodgers, R. F. (2016) · International Journal of Eating Disorders · doi:10.1002/eat.22477 · Cited by 147
“Because of the potential advantages of Internet-delivered programs, establishing their efficacy is an important step toward greater dissemination.(12,14,15)”
Atkinson, M. J., & Wade, T. D. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.09.012 · Cited by 36
Bauer, S., Papezova, H., Chereches, R., Caselli, G., McLoughlin, O., Szumska, I., van Furth, E., Ozer, F., & Moessner, M. (2013) · Mental Health & Prevention · doi:10.1016/j.mhp.2013.10.003 · Cited by 36
Lee, G. Y., Park, E. J., Kim, Y.-R., Kwag, K. H., Park, J. H., An, S. H., Lee, J. H., Sim, J. H., & Treasure, J. (2018) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-017-0436-3 · Cited by 10
Eating disorder prevention on college campuses: Recruitment challenges
Rodgers, R. F., & Franko, D. L. (2015) · European Review of Applied Psychology · doi:10.1016/j.erap.2015.03.003 · Cited by 8
Metadata
- Authors
- Marchand, E., Stice, E., Rohde, P., & Becker, C. B.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2011-01
- Volume
- 49
- Issue
- 1
- Pages
- 32-41
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W1967583216
- Cited by
- 136
- References
- 20
- FWCI
- 12.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.