The 2 “Es” of Research: Efficacy and Effectiveness Trials
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Studies that investigate the usefulness of various therapies fall along a continuum that ranges from those looking at whether an intervention can work under ideal circumstances (efficacy trials) to those that focus on whether a treatment works when applied in the real world (effectiveness trials). Whether a study is closer to one end of the spectrum or the other affects almost every aspect of the trial. These aspects include which patients are eligible for enrolment, the degree of control over the way the intervention is delivered, which patients are or are not included in the analyses, how missing data are handled, and even which statistical tests may be used. The 2 types of trials may yield different results, but both provide useful information. This paper explores these issues, shows the decisions researchers must take at each phase of a trial, and discusses how clinicians should interpret the results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Trials with an OR method provide evidence more related to efficacy (investigating whether a treatment works under ideal circumstances, with high internal validity), as opposed to CSR trials that are more related to effectiveness and provide information on whether a treatment works in clinically representative conditions [10].”
From Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis (2019) · cites this paper as [10]
Citations
Cites
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Biostatistics : The Bare Essentials
Norman, G. R., & Streiner, D. L. (1993) · Cited by 1,482
Self-citationExplanatory and Pragmatic Attitudes in Therapeutical Trials
Schwartz, D., & Lellouch, J. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.012 · Cited by 1,252
Explanatory and pragmatic attitudes in therapeutical trials
Schwartz, D., & Lellouch, J. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90041-0 · Cited by 1,185
Sensky, T., Turkington, D., Kingdon, D., Scott, J. L., Scott, J., Siddle, R., O'Carroll, M., & Barnes, T. R. E. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.2.165 · Cited by 693
Biostatistics: The Bare Essentials
Vaisrub, N. (2009) · JAMA · doi:10.1001/jama.2009.1734 · Cited by 666
Bridging the gap between laboratory and clinic in child and adolescent psychotherapy.
Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.5.688 · Cited by 607
(1970) · JAMA · doi:10.1001/jama.213.7.1143 · Cited by 554
NIMH Treatment of Depression Collaborative Research Program: Background and Research Plan
Elkin, I. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790260103013 · Cited by 520
Controversy in Counting and Attributing Events in Clinical Trials
Sackett, D. L., & Gent, M. (1979) · New England Journal of Medicine · doi:10.1056/nejm197912273012602 · Cited by 413 · cited 1×
“They are sometimes distinguished as explanatory and pragmatic trials (1,2); at other times they are called explanatory and management trials (3).”
BackgroundGasecki, A. P., Eliasziw, M., Ferguson, G. G., Hachinski, V., Barnett, H. J. M., & _, _. (1995) · Journal of Neurosurgery · doi:10.3171/jns.1995.83.5.0778 · Cited by 342
The use of psychotherapy treatment manuals: A small revolution in psychotherapy research style
Luborsky, L. (1984) · Clinical Psychology Review · doi:10.1016/0272-7358(84)90034-5 · Cited by 227
The Case of the Missing Data: Methods of Dealing with Dropouts and other Research Vagaries
Streiner, D. V. L. (2002) · The Canadian Journal of Psychiatry · doi:10.1177/070674370204700111 · Cited by 215
Self-citationPhilipp, M., Kohnen, R., Hiller, K.-O., Linde, K., & Berner, M. (1999) · BMJ · doi:10.1136/bmj.319.7224.1534 · Cited by 209
Pragmatic randomised controlled trials in psychiatry
Hotopf, M., Churchill, R., & Lewis, G. (1999) · British Journal of Psychiatry · doi:10.1192/bjp.175.3.217 · Cited by 165
Effects of cognitive therapy on psychological symptoms and social functioning in residual depression
Scott, J., Teasdale, J. D., Paykel, E. S., Johnson, A. L., Abbott, R., Hayhurst, H., Moore, R., & Garland, A. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.5.440 · Cited by 139
Antidepressant use in clinical practice: efficacy v. effectiveness
Donoghue, J., & Hylan, T. R. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.179.42.s9 · Cited by 71
Quitkin, F. M., McGrath, P. J., Stewart, J. W., Ocepek-Welikson, K., Taylor, B. P., Nunes, E., Delivannides, D., Agosti, V., Donovan, S. J., Ross, D., et al. (1998) · British Journal of Psychiatry · doi:10.1192/bjp.173.3.242 · Cited by 37
Evolving methodologies in bipolar disorder maintenance research
Calabrese, J. R., RAPPORT, D. J., Shelton, M. D., & Kimmel, S. E. (2001) · The British Journal of Psychiatry · doi:10.1192/bjp.178.41.s157 · Cited by 20
Do You See What I Mean? Indices of Central Tendency
Streiner, D. L. (2000) · The Canadian Journal of Psychiatry · doi:10.1177/070674370004500908 · Cited by 18
Self-citationRisky Business: Making Sense of Estimates of Risk
Streiner, D. L. (1998) · The Canadian Journal of Psychiatry · doi:10.1177/070674379804300411 · Cited by 18
Self-citationFoundations of Clinical Psychology
Cullari, S. (1998) · Medical Entomology and Zoology · Cited by 9
Research works printed but not linked: 1
- 10.1037/0022-006x.63.5.688 · DOI · Paper page
Cited by
Effects of testosterone on sexual function in men: results of a meta‐analysis
Isidori, A. M., Giannetta, E., Gianfrilli, D., Greco, E. A., Bonifacio, V., Aversa, A., Isidori, A., Fabbri, A., & Lenzi, A. (2005) · Clinical Endocrinology · doi:10.1111/j.1365-2265.2005.02350.x · Cited by 492
Rehm, J., Shield, K. D., Gmel, G., Rehm, M. X., & Frick, U. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2012.08.001 · Cited by 257
More treatment but no less depression: The treatment-prevalence paradox
Ormel, J., Hollon, S. D., Kessler, R. C., Cuijpers, P., & Monroe, S. M. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102111 · Cited by 213
Sontrop, J., & Campbell, M. K. (2006) · Preventive Medicine · doi:10.1016/j.ypmed.2005.11.005 · Cited by 176
Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165
Metadata
- Authors
- Streiner, D. L.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Streiner, David L
- ORCID
- Streiner, David L
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2002-08
- Volume
- 47
- Issue
- 6
- Pages
- 552-556
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- OpenAlex
- W2162627860
- Cited by
- 79
- References
- 23
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 3 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 1 · 2019: 1 · 2018: 4 · 2017: 1 · 2016: 1 · 2014: 2 · 2013: 4 · 2012: 3
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The Canadian Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- effectiveness trials, clinical trial design, inclusion and exclusion criteria, missing data handling, statistical tests, trial interpretation, psychotherapy research
- MeSH terms
- Mental Disorders, Clinical Trials as Topic, Humans, Psychotherapy, Psychotropic Drugs, Randomized Controlled Trials as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.