The 2 “Es” of Research: Efficacy and Effectiveness Trials
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Studies that investigate the usefulness of various therapies fall along a continuum that ranges from those looking at whether an intervention can work under ideal circumstances (efficacy trials) to those that focus on whether a treatment works when applied in the real world (effectiveness trials). Whether a study is closer to one end of the spectrum or the other affects almost every aspect of the trial. These aspects include which patients are eligible for enrolment, the degree of control over the way the intervention is delivered, which patients are or are not included in the analyses, how missing data are handled, and even which statistical tests may be used. The 2 types of trials may yield different results, but both provide useful information. This paper explores these issues, shows the decisions researchers must take at each phase of a trial, and discusses how clinicians should interpret the results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Trials with an OR method provide evidence more related to efficacy (investigating whether a treatment works under ideal circumstances, with high internal validity), as opposed to CSR trials that are more related to effectiveness and provide information on whether a treatment works in clinically representative conditions [10].”
From Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis (2019) · cites this paper as [10]
Citations
Cites
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Biostatistics : The Bare Essentials
Norman, G. R., & Streiner, D. L. (1993) · Cited by 1,482
Self-citationExplanatory and Pragmatic Attitudes in Therapeutical Trials
Schwartz, D., & Lellouch, J. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.012 · Cited by 1,252
Explanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185
Sensky, T., Turkington, D., Kingdon, D., Scott, J. L., Scott, J., Siddle, R., O'Carroll, M., & Barnes, T. R. E. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.2.165 · Cited by 693
Biostatistics: The Bare Essentials
Vaisrub, N. (2009) · JAMA · doi:10.1001/jama.2009.1734 · Cited by 666
Bridging the gap between laboratory and clinic in child and adolescent psychotherapy.
Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.5.688 · Cited by 607
(1970) · JAMA · doi:10.1001/jama.213.7.1143 · Cited by 554
NIMH Treatment of Depression Collaborative Research Program: Background and Research Plan
Elkin, I. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790260103013 · Cited by 520
Research works printed but not linked: 2
- 10.1001/jama.1970.03170330025003 · DOI · Paper page
- 10.1037/0022-006x.63.5.688 · DOI · Paper page
Cited by
Effects of testosterone on sexual function in men: results of a meta‐analysis
Isidori, A. M., Giannetta, E., Gianfrilli, D., Greco, E. A., Bonifacio, V., Aversa, A., Isidori, A., Fabbri, A., & Lenzi, A. (2005) · Clinical Endocrinology · doi:10.1111/j.1365-2265.2005.02350.x · Cited by 492
Rehm, J., Shield, K. D., Gmel, G., Rehm, M. X., & Frick, U. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2012.08.001 · Cited by 257
More treatment but no less depression: The treatment-prevalence paradox
Ormel, J., Hollon, S. D., Kessler, R. C., Cuijpers, P., & Monroe, S. M. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102111 · Cited by 213
Sontrop, J., & Campbell, M. K. (2006) · Preventive Medicine · doi:10.1016/j.ypmed.2005.11.005 · Cited by 176
Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165
Metadata
- Authors
- Streiner, D. L.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Streiner, David L
- ORCID
- Streiner, David L
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2002-08
- Volume
- 47
- Issue
- 6
- Pages
- 552-556
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- OpenAlex
- W2162627860
- Cited by
- 79
- References
- 23
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 3 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 1 · 2019: 1 · 2018: 4 · 2017: 1 · 2016: 1 · 2014: 2 · 2013: 4 · 2012: 3
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The Canadian Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- effectiveness trials, clinical trial design, inclusion and exclusion criteria, missing data handling, statistical tests, trial interpretation, psychotherapy research
- MeSH terms
- Mental Disorders, Clinical Trials as Topic, Humans, Psychotherapy, Psychotropic Drugs, Randomized Controlled Trials as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The 2 “Es” of Research: Efficacy and Effectiveness Trials. https://app.cochat.ai/papers/10.1177/070674370204700607
- The paper
- Streiner, D. L. (2002). The 2 “Es” of Research: Efficacy and Effectiveness Trials. The Canadian Journal of Psychiatry. https://doi.org/10.1177/070674370204700607
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.