Does Study Design Influence Outcome?
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Background: Clinicians and researchers synthesize data from randomized controlled trials (RCTs) of antidepressants to make conclusions about the efficacy of medications for depression. All treatments include nonspecific factors in addition to the specific effects of drugs, and study design may influence patient outcomes via nonspecific factors. This study investigated whether placebo control and treatment duration affect the outcome in antidepressant RCTs. Methods: Medline and the Cochrane Database were searched to identify RCTs of antidepressants for major depression approved by the Food and Drug Administration. Included studies enrolled outpatient participants aged 18–65, lasted 6–12 weeks, compared an antidepressant to placebo or another antidepressant and were published in English after 1985. Excluded trials enrolled inpatients, pregnant women and subjects with psychosis or mania. Mixed-effects logistic regression models including study type (placebo-controlled or comparator) and study duration (6, 8 or 12 weeks) as fixed effects determined whether these factors affected response and remission rates. Results: In the 90 trials analyzed, the odds of depression response (OR = 1.79, 95% CI = 1.45–2.17, p < 0.001) and remission (OR 1.53, 95% CI = 1.11–2.11, p < 0.001) were significantly higher in comparator relative to placebo-controlled trials. Trials lasting 8 (OR = 1.37, CI = 1.14–1.64, p = 0.001) and 12 (OR = 1.52, CI = 1.12–2.07, p = 0.008) weeks had significantly greater response rates than 6-week trials without differing themselves. Conclusions: Response and remission rates to antidepressants are significantly affected by study type and duration. Clinicians and researchers must consider the study design when interpreting and designing RCTs of antidepressant medications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442
Keller, M. B., McCullough, J. P., Klein, D. N., Arnow, B., Dunner, D. L., Gelenberg, A. J., Markowitz, J. C., Nemeroff, C. B., Russell, J. M., Thase, M. E., et al. (2000) · New England Journal of Medicine · doi:10.1056/nejm200005183422001 · Cited by 1,331
Placebo Response in Studies of Major Depression: Variable, Substantial, and Growing
Walsh, B. T., Seidman, S. N., Sysko, R., & Gould, M. (2002) · JAMA · doi:10.1001/jama.287.14.1840 · Cited by 1,109
Residual symptoms after partial remission: an important outcome in depression
Paykel, E. S., Ramana, R., Cooper, Z., Hayhurst, H., Kerr, J., & Barocka, A. (1995) · Psychological Medicine · doi:10.1017/s0033291700033146 · Cited by 791 · cited 1×
“recently examined antidepressant response rates in 9 placebo-controlled and 7 comparator trials for late-life depression. A 46p response rate to medication was found in placebo-controlled trials compared to 63p in comparator trials. The odds of medication response in comparator trials were nearly 2 times the odds in p…”
BackgroundInfluentialReport by the ACNP Task Force on Response and Remission in Major Depressive Disorder
Rush, A. J., Kraemer, H. C., Sackeim, H. A., Fava, M., Trivedi, M. H., Frank, E., Ninan, P. T., Thase, M. E., Gelenberg, A. J., Kupfer, D. J., et al. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301131 · Cited by 707
(1991) · American Journal of Psychiatry · doi:10.1176/ajp.148.8.997 · Cited by 580
Khan, A., Leventhal, R. M., Khan, S. R., & Brown, W. A. (2002) · Journal of Clinical Psychopharmacology · doi:10.1097/00004714-200202000-00007 · Cited by 456
Cited by
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
The placebo response in medicine: minimize, maximize or personalize?
Enck, P., Bingel, U., Schedlowski, M., & Rief, W. (2013) · Nature Reviews Drug Discovery · doi:10.1038/nrd3923 · Cited by 671
Segal, Z. V., Bieling, P., Young, T., MacQueen, G., Cooke, R., Martin, L., Bloch, R., & Levitan, R. D. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.168 · Cited by 429
Locher, C., Koechlin, H., Zion, S. R., Werner, C., Pine, D. S., Kirsch, I., Kessler, R. C., & Kossowsky, J. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2432 · Cited by 360
Schedlowski, M., Enck, P., Rief, W., & Bingel, U. (2015) · Pharmacological Reviews · doi:10.1124/pr.114.009423 · Cited by 323
“However, despite the unequivocal effect of expectancy and learning on pharmacological treatments, research into its underlying mechanisms remains at a very early stage, leaving many unanswered questions.”
Blinding and expectancy confounds in psychedelic randomized controlled trials
Muthukumaraswamy, S. D., Forsyth, A., & Lumley, T. (2021) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2021.1933434 · Cited by 324
A systematic review of comparative efficacy of treatments and controls for depression
Khan, A., Faucett, J., Lichtenberg, P., Kirsch, I., & Brown, W. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041778 · Cited by 288
A Model of Placebo Response in Antidepressant Clinical Trials
Rutherford, B. R., & Roose, S. P. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12040474 · Cited by 268
Self-citationFurukawa, T. A., Salanti, G., Atkinson, L. Z., Leucht, S., Ruhe, H. G., Turner, E. H., Chaimani, A., Ogawa, Y., Takeshima, N., Hayasaka, Y., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010919 · Cited by 214
Placebo effect in the treatment of depression and anxiety
Kirsch, I. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00407 · Cited by 205
Patient Expectancy as a Mediator of Placebo Effects in Antidepressant Clinical Trials
Rutherford, B. R., Wall, M. M., Brown, P. J., Choo, T.-H., Wager, T. D., Peterson, B. S., Chung, S., Kirsch, I., & Roose, S. P. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16020225 · Cited by 183
“In adults and older adults with major depressive disorder, mean medication response rates in comparator trials are significantly greater than the mean medication response rates in placebo-controlled trials (12, 13).”
Self-citationAntidepressants and the placebo effect
Kirsch, I. (2014) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000176 · Cited by 164
Role of expectations in health
Colloca, L., & Miller, F. G. (2011) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e328343803b · Cited by 161
Placebo effects in psychotherapy: a framework
Enck, P., & Zipfel, S. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00456 · Cited by 115
Pigott, H. E., Kim, T., Xu, C., Kirsch, I., & Amsterdam, J. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-063095 · Cited by 93
Dorrepaal, E., Thomaes, K., Smit, J. H., van Balkom, A. J. L. M., Veltman, D. J., Hoogendoorn, A. W., & Draijer, N. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000335044 · Cited by 82
Dauphinais, D. R., Rosenthal, J. Z., Terman, M., DiFebo, H. M., Tuggle, C., & Rosenthal, N. E. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2012.01.015 · Cited by 63
Zilcha-Mano, S., Roose, S. P., Brown, P. J., & Rutherford, B. R. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00293 · Cited by 53
Self-citationA Randomized Controlled Trial of Cognitive Behavioral Group Therapy for Bipolar Disorder
Gomes, B. C., Abreu, L. N., Brietzke, E., Caetano, S. C., Kleinman, A., Nery, F. G., & Lafer, B. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000320738 · Cited by 52
“Recent studies have demonstrated that the remission rates in randomized controlled trials can be affected by study type and its duration, with longer randomized controlled trials showing greater response rates [”
Cheng, Q., Huang, J., Xu, L., Li, Y., Li, H., Shen, Y., Zheng, Q., & Li, L. (2020) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyz062 · Cited by 38
Maina, G., Rosso, G., Rigardetto, S., Chiadò Piat, S., & Bogetto, F. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000318296 · Cited by 34
A sham-controlled randomized trial of adjunctive light therapy for non-seasonal depression
Chojnacka, M., Antosik-Wójcińska, A. Z., Dominiak, M., Bzinkowska, D., Borzym, A., Sokół-Szawłowska, M., Bodzak-Opolska, G., Antoniak, D., & Święcicki, Ł. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.05.062 · Cited by 32
Optimizing patient expectancy in the pharmacologic treatment of major depressive disorder
Zilcha-Mano, S., Brown, P. J., Roose, S. P., Cappetta, K., & Rutherford, B. R. (2019) · Psychological Medicine · doi:10.1017/s0033291718003343 · Cited by 29
Self-citationUebelacker, L. A., Weinstock, L. M., Battle, C. L., Abrantes, A. M., & Miller, I. W. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.05.009 · Cited by 25
“Consistent with this, the odds of being considered a treatment responder are higher in trials that compare two active antidepressant medications than they are in the medication arms of randomized, doubleblind, placebo-controlled trials (Rutherford et al., 2009).”
BackgroundKirsch, I., Huedo-Medina, T. B., Pigott, H. E., & Johnson, B. T. (2018) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000164 · Cited by 24
Neural mechanisms of expectancy-based placebo effects in antidepressant clinical trials
Zilcha-Mano, S., Wang, Z., Peterson, B. S., Wall, M. M., Chen, Y., Wager, T. D., Brown, P. J., Roose, S. P., & Rutherford, B. R. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.05.023 · Cited by 21
Self-citationUnderstanding the non‐pharmacological correlates of self‐reported efficacy of antidepressants
Read, J., Gibson, K., Cartwright, C., Shiels, C., Dowrick, C., & Gabbay, M. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12390 · Cited by 20
“gest that clinicians can influence treatment outcomes via the nature of their interactions with patients (26, 27).”
Weisler, R. H., Khan, A., Trivedi, M. H., Yang, H., Eudicone, J. M., Pikalov, A., Tran, Q. V., Berman, R. M., & Carlson, B. X. (2011) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.09m05495gre · Cited by 19
Chehadi, A. C., Pereira de Lima, E., Detregiachi, C. R. P., Santos de Argollo Haber, R., Catharin, V. M. C. S., Fornari Laurindo, L., Engracia Valenti, V., Machado Galhardi, C., Tanaka, M., & Maria Barbalho, S. (2026) · International Journal of Molecular Sciences · doi:10.3390/ijms27010465 · Cited by 8
“A duration of at least 8–12 weeks is needed to capture the short-term efficacy, but follow-up at 6 to 12 months will be critical to assess durability, safety, and adherence in real-world contexts [415,416].”
Metadata
- Authors
- Rutherford, B. R., Sneed, J. R., & Roose, S. P.
- Venue
- Psychotherapy and Psychosomatics
- Publisher
- S. Karger AG
- Published
- 2009
- Volume
- 78
- Issue
- 3
- Pages
- 172-181
- ISSN
- 0033-3190 (ISSN-L)
- 1423-0348
- OpenAlex
- W1989468762
- Cited by
- 158
- References
- 28
- FWCI
- 8.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.