Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs
The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.
Abstract
The concepts of efficacy and effectiveness are examined from the viewpoints of the traditions and philosophies of health-care research and social program evaluation. Consideration of the status of the program being assessed, its availability to, and its acceptance by the target audience leads to the derivation of four levels of health promotion program testing: efficacy trials, under optimum conditions of program implementation and recipient participation; treatment effectiveness trials, with expected variation in target audience acceptance; implementation effectiveness trials, under varying conditions of implementation; and program evaluation of previously untested programs. These four levels of testing, together with experience in one area of health promotion research (smoking prevention), suggest eight phases of research for the development of health promotion programs: basic research, hypothesis development, pilot applied research, prototype evaluation studies, efficacy trials, treatment effectiveness trials, implementation effectiveness trials, and demonstration evaluations. Issues of design, the use of random assignment, the use of blinding procedures, and of the role of process evaluation in these different research levels, particularly efficacy and effectiveness trials, are considered in light of the terminologies and methods of health-care and social program evaluation research. Suggestions are made for improved health promotion research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“can work successfully in research settings where intervention delivery and follow-up is carefully managed (Flay 1986)”
From Effectiveness of brief alcohol interventions in primary care populations (2018) · cites this paper as Flay 1986
In the citing paper
“As such, efficacy trials tell us little about the effect of the intervention under “real-world” conditions or in “natural” settings (Flay 1986).”
From Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation (2015) · cites this paper as Flay 1986
In the citing paper
“The current trial was a true effectiveness trial employing a volunteer workforce for recruitment and tracking, and hence would be expected to be associated with recruitment and adherence issues relative to the more controlled environment of an efficacy study [49].”
From Internet-Based CBT for Depression with and without Telephone Tracking in a National Helpline: Randomised Controlled Trial (2011) · cites this paper as [49]
Citations
Cites
Kytle, J., & Bandura, A. (1978) · Contemporary Sociology · doi:10.2307/2065952 · Cited by 25,422
(1963) · Medical Entomology and Zoology · Cited by 15,085
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,517
(1979) · Medical Entomology and Zoology · Cited by 11,252
Peto, R., Pike, M. C., Armitage, P., Breslow, N. E., Cox, D. R., Howard, S. V., Mantel, N., McPherson, K., Peto, J., & Smith, P. G. (1977) · British Journal of Cancer · doi:10.1038/bjc.1977.1 · Cited by 8,285
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
SOCIAL SCIENCE EDUCATION CONSORTIUM. PUBLICATION 110, THE METHODOLOGY OF EVALUATION.
Scriven, M. S. (1966) · Social Science Education Consortium eBooks · Cited by 2,504
(1966) · Social Science Education Consortium eBooks · Cited by 2,483
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Utilization-Focused Evaluation
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n729 · Cited by 2,308
Research works printed but not linked: 9
- Boruch, 1975, On common contentions about randomized field experiments, Vol. 1, 158
- Carter, 1978, 28, 6
- Flay, B. R. Social psychological approaches to smoking prevention: Review and recommendations, in “Advances in Health Promotion and Education” (W. Ward, S. Simonds, P. Mullen, and M. Becker, Eds.), Vol. 2. JAI Press, Greenwich, Conn. In press.
- Flay, 1977, Artifact in social psychological research: The subject's view, N. Z. Psychol., 6, 84
- Flay, 1982, Evaluation of a mass media enhanced smoking prevention and cessation program, Vol. 5
- Hops, 1986, A taped situation test of cigarette refusal skill among adolescents, Behav. Assess., 8, 145
- McGuire, 1964, Inducing resistance to persuasion, Vol. 1, 191
- Sechrest, 1979, Some neglected problems in evaluation research: Strength and integrity of treatments, Vol. 4, 15
- Starfield, 1977, Efficacy and effectiveness of primary medical care for children, Vol. 2
Cited by
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Allergic Rhinitis and its Impact on Asthma (ARIA) 2008*
Bousquet, J., Khaltaev, N., Cruz, A. A., Denburg, J., Fokkens, W. J., Togias, A., Zuberbier, T., Baena‐Cagnani, C. E., Canonica, G. W., Van Weel, C., et al. (2008) · Allergy · doi:10.1111/j.1398-9995.2007.01620.x · Cited by 4,729
“Effectiveness refers to the impact of the intervention or technology under routine operating conditions, administered to a more generalized patient population (1136, 1137).”
BackgroundAllergic Rhinitis and Its Impact on Asthma
Bousquet, J., van Cauwenberge, P., & Khaltaev, N. (2001) · Journal of Allergy and Clinical Immunology · doi:10.1067/mai.2001.118891 · Cited by 3,588
The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368
“…efficacy research (documentation that an experimental effect can be obtained under carefully controlled conditions) and effectiveness research (documentation that an experimental effect can be obtained under typical conditions) that may affect large-scale implementation of a procedure (Flay, 1986).”
BackgroundInternational guidelines for groin hernia management
The HerniaSurge Group (2018) · Hernia · doi:10.1007/s10029-017-1668-x · Cited by 2,296
Metadata
- Authors
- Flay, B. R.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Flay, Brian R.
- ORCID
- Flay, Brian R.
- Venue
- Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 1986-09
- Volume
- 15
- Issue
- 5
- Pages
- 451-474
- ISSN
- 0091-7435 (ISSN-L)
- OpenAlex
- W2060222617
- Semantic Scholar
- ef59c29198efb1eb8704073049005538c8592aa9
- Cited by
- 723
- References
- 104
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 5 · 2023: 12 · 2022: 11 · 2021: 18 · 2020: 61 · 2019: 36 · 2018: 20 · 2017: 27 · 2016: 22 · 2015: 23 · 2014: 27 · 2013: 30 · 2012: 38
- FWCI
- 10.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Drug Abuse (DA-03468)
- National Cancer Institute (CA 38268, CA 34622)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Keywords
- health promotion programs, effectiveness trials, program evaluation, smoking prevention, program implementation, random assignment, blinding, process evaluation, health care research, social program evaluation, research design
- MeSH terms
- Smoking Prevention, Clinical Trials as Topic, Double-Blind Method, Health Promotion, Health Services Research, Humans, Psychology, Social, Random Allocation, Research Design, Social Sciences, United States
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. https://app.cochat.ai/papers/10.1016/0091-7435(86)90024-1
- The paper
- Flay, B. R. (1986). Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Preventive Medicine. https://doi.org/10.1016/0091-7435(86)90024-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.