The generalizability of antidepressant efficacy trials to routine psychiatric out-patient practice
Abstract
Background: Generalizability of antidepressant efficacy trials (AETs) to daily practice is questioned because of their very stringent patient selection. This study aims to determine eligibility for AETs of out-patients suffering from major depression in a routine out-patient setting and investigates influence of eligibility on treatment outcome. Method: Data collection ( n =1653) was performed through routine outcome monitoring by independent trained research nurses. The Mini-International Neuropsychiatric Interview Plus and the Dimensional Assessment of Personality Pathology, short Dutch version were used for diagnostic assessment and personality pathology screening. The Montgomery–Asberg Depression Rating Scale (MADRS) was used for assessment of baseline severity and treatment outcome. Eligibility was assessed by stepwise application of commonly used exclusion criteria. Influence of eligibility on treatment outcome was investigated in a subsample of the 1653 patients who had at least one follow-up assessment ( n =626). Eligible and non-eligible patients were compared on proportion of response (50% reduction) and remission on MADRS (MADRS⩽10). Results: Altogether, 17–25% of the patients were eligible for AETs. The most common reasons for exclusion would be ‘not meeting minimum baseline severity’ and ‘presence of co-morbid Axis I disorder’. Eligible and non-eligible patients did not differ in treatment outcome. Only ‘meeting the minimum baseline severity’ is associated with remission. Conclusions: The majority of ‘real life’ out-patients are not eligible for AETs. However, the influence of eligibility on treatment outcome seems to be small. This suggests that stringent patient selection by eligibility criteria is not the major reason for lack of generalizability of AETs. Exclusion of less severely depressed patients from the analyses resulted in better treatment outcome. Milder depression is highly prevalent in daily practice and more research into treatment effectiveness in milder depression is warranted.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The question of whether the treatment of depression per se has a significant effect on suicidality does not have a definitive answer, largely due to low power of trials to detect rare outcomes, though there are real-world studies which suggest an association.
“The question of whether the treatment of depression per se has a significant effect on suicidality does not have a definitive answer, largely due to low power of trials to detect rare outcomes, though there are real-world studies which suggest an association (discussed later). 558”
From Time for united action on depression: a Lancet–World Psychiatric Association Commission (2022) · cites this paper as [558]
Cites
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
Development of a Rating Scale for Primary Depressive Illness
Hamilton, M. (1967) · British Journal of Social and Clinical Psychology · doi:10.1111/j.2044-8260.1967.tb00530.x · Cited by 8,410 · see citing works
Review: a gentle introduction to imputation of missing values.
Donders, A. R. T., van der Heijden, G. J. M. G., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.014 · Cited by 2,582 · see citing works
Tunis (2003) · doi:10.1001/jama.290.12.1624 · Cited by 1,724 · see citing works
Multiple Imputation of Missing Values: Update
Royston, P. (2005) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x0500500204 · Cited by 1,683 · see citing works
PRACTICE GUIDELINE FOR THE Treatment of Patients With Major Depressive Disorder
Gelenberg, A. J., Freeman, P. B., Markowitz, J. C., Rosenbaum, J. F., Thase, M. E., Trivedi, M. H., & Rhoads, R. S. (2010) · Cited by 1,372 · see citing works
A COMPREHENSIVE PSYCHOPATHOLOGICAL RATING SCALE
Åsberg, M., Montgomery, S., Perris, C., Schalling, D., & Sedvall, G. (1978) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1978.tb02357.x · Cited by 1,327 · see citing works
Sequenced treatment alternatives to relieve depression (STAR*D): Rationale and design
Rush, A. J., Fava, M., Wisniewski, S. R., Lavori, P. W., Trivedi, M. H., Sackeim, H. A., Thase, M. E., Nierenberg, A. A., Quitkin, F. M., Kashner, T. M., et al. (2004) · Controlled Clinical Trials · doi:10.1016/s0197-2456(03)00112-0 · Cited by 1,076 · see citing works
Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., O’Reardon, J. P., Lovett, M. L., Gladis, M. M., Brown, L. L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.409 · Cited by 989 · see citing works
Wells, K. B. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.1.5 · Cited by 390 · see citing works
Detke, M. J., Lu, Y., Goldstein, D. J., Hayes, J. R., & Demitrack, M. A. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0407 · Cited by 384 · see citing works
Zimmerman, M., Mattia, J. I., & Posternak, M. A. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.3.469 · Cited by 382 · see citing works
Duloxetine in the Treatment of Major Depressive Disorder: A Double-Blind Clinical Trial
Goldstein, D. J., Mallinckrodt, C., Lu, Y., & Demitrack, M. A. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0309 · Cited by 334 · see citing works
Goldstein, D. J., Lu, Y., Detke, M. J., Wiltse, C., Mallinckrodt, C., & Demitrack, M. A. (2004) · Journal of Clinical Psychopharmacology · doi:10.1097/01.jcp.0000132448.65972.d9 · Cited by 314 · see citing works
Measuring depression: comparison and integration of three scales in the GENDEP study
Uher, R., FARMER, A. E., Maier, W., Rietschel, M., Hauser, J., Marušić, A., Mors, O. N., Elkin, A., Williamson, R. J., Schmael, C., et al. (2007) · Psychological Medicine · doi:10.1017/s0033291707001730 · Cited by 290 · see citing works
The Montgomery Äsberg and the Hamilton ratings of depression: A comparison of measures
Carmody, T. J., Rush, A. J., Bernstein, I. H., Warden, D., Brannan, S. K., Burnham, D. B., Woo, A., & Trivedi, M. H. (2006) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2006.04.008 · Cited by 243 · see citing works
Zimmerman, M., Posternak, M. A., & Chelminski, I. (2004) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2004.03.007 · Cited by 229 · see citing works
Wisniewski, S. R., Rush, A. J., Nierenberg, A. A., Gaynes, B. N., Warden, D., Luther, J. F., McGrath, P. J., Lavori, P. W., Thase, M. E., Fava, M., et al. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08071027 · Cited by 223 · cited 5× · see citing works
“included patients would have been eligible for AETs and had a better treatment outcome than non-eligible patients (Wisniewski et al. 2009).”
BackgroundResultInfluentialde Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E. M., & Zitman, F. G. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.696 · Cited by 195 · see citing works
Self-citationFabre, L. F., Abuzzahab, F. S., Amin, M., Claghorn, J. L., MENDELS, J., Petrie, W. M., Dubé, S., & Small, J. G. (1995) · Biological Psychiatry · doi:10.1016/0006-3223(95)00178-8 · Cited by 184 · see citing works
Differential efficacy of escitalopram and nortriptyline on dimensional measures of depression
Uher, R., Maier, W., Hauser, J., Marušič†, A., Schmael, C., Mors, O. N., Henigsberg, N., Souery, D., Placentino, A., Rietschel, M., et al. (2009) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.108.057554 · Cited by 183 · see citing works
Bielski, R. J., Ventura, D., & Chang, C.-C. (2004) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v65n0906 · Cited by 178 · see citing works
Stahl, S. M. (2000) · Biological Psychiatry · doi:10.1016/s0006-3223(00)00957-4 · Cited by 134 · see citing works
Sir, A., D'Souza, R. F., Uguz, S., George, T., Vahip, S., Hopwood, M., Martin, A. J., Lam, W., & Burt, T. (2005) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v66n1015 · Cited by 129 · see citing works
Six Months of Treatment for Depression: Outcome and Predictors of the Course of Illness
Mulder, R. T., Joyce, P. R., Frampton, C. M. A., Luty, S. E., & Sullivan, P. F. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.95 · Cited by 127 · see citing works
Sequential Treatment of Mood and Anxiety Disorders
Fava, G. A., Ruini, C., & Rafanelli, C. (2005) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v66n1108 · Cited by 103 · see citing works
Golden, R. N., Nemeroff, C. B., McSorley, P., Pitts, C. D., & Dube, E. M. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0707 · Cited by 101 · see citing works
A Reevaluation of the Exclusion Criteria Used in Antidepressant Efficacy Trials
Posternak, M. A., Zimmerman, M. A., Keitner, G. I., & Miller, I. W. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.2.191 · Cited by 97 · see citing works
Generalisability of results from randomised drug trials
Licht, R. W., Gouliaev, G., Vestergaard, P., & Frydenberg, M. (1997) · The British Journal of Psychiatry · doi:10.1192/bjp.170.3.264 · Cited by 78 · see citing works
Relevance of Exclusion Criteria in Antidepressant Clinical Trials
Zetin, M., & Hoepner, C. T. (2007) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e318058263f · Cited by 61 · see citing works
Trivedi, M. H., Pigott, T. A., Perera, P., Dillingham, K., Carfagno, M. L., & Pitts, C. D. (2004) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v65n1010 · Cited by 58 · see citing works
Zimmerman, M., Chelminski, I., & Posternak, M. A. (2004) · Journal of Nervous & Mental Disease · doi:10.1097/01.nmd.0000110279.23893.82 · Cited by 58 · see citing works
van Kampen, D., de Beurs, E., & Andrea, H. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.05.002 · Cited by 57 · see citing works
Shelton, R. C., Haman, K., Rapaport, M. H., Kiev, A., Smith, W. T., Hirschfeld, R. M. A., Lydiard, R. B., Zajecka, J., & Dünner, D. L. (2006) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v67n1102 · Cited by 51 · see citing works
Can mildly depressed outpatients with atypical depression benefit from antidepressants?
Stewart, J. W., McGrath, P. J., & Quitkin, F. M. (1992) · American Journal of Psychiatry · doi:10.1176/ajp.149.5.615 · Cited by 50 · see citing works
Symptom Severity and Exclusion From Antidepressant Efficacy Trials
Zimmerman, M., Posternak, M. A., & Chelminski, I. (2002) · Journal of Clinical Psychopharmacology · doi:10.1097/00004714-200212000-00011 · Cited by 49 · see citing works
Benkert, O., Szegedi, A., Philipp, M., Kohnen, R., Heinrich, C., Heukels, A., van der Vegte-Senden, M., Baker, R., Simmons, J. H., & Schutte, A. (2006) · Journal of Clinical Psychopharmacology · doi:10.1097/01.jcp.0000194622.99986.d6 · Cited by 47 · see citing works
IJff, M. A., Huijbregts, K. M. L., van Marwijk, H., Beekman, A. T. F., Roijen, L. H., Rutten, F., Unützer, J., & Feltz-Cornelis, C. M. V. D. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-34 · Cited by 46 · see citing works
Efficacy and Tolerability of Reboxetine Compared with Citalopram
Langworth, S., Bodlund, O., & Ågren, H. (2006) · Journal of Clinical Psychopharmacology · doi:10.1097/01.jcp.0000204138.20417.c3 · Cited by 45 · see citing works
An open-label trial of nefazodone in high comorbidity panic disorder.
DeMartinis, N. A., Schweizer, E. E., & Rickels, K. (1996) · PubMed · Cited by 43 · see citing works
Patients Excluded From an Antidepressant Efficacy Trial
Partonen, T., Sihvo, S., & Lönnqvist, J. K. (1996) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v57n1203 · Cited by 41 · see citing works
Dimensions of Personality Pathology
Livesley, W. J., Jackson, D. N., & Schroeder, M. L. (1991) · The Canadian Journal of Psychiatry · doi:10.1177/070674379103600802 · Cited by 40 · see citing works
Montgomery-Åsberg severity gradations
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.9.1320b · Cited by 39 · see citing works
de Beurs, E., Rinne, T., van Kampen, D., Verheul, R., & Andrea, H. (2009) · Journal of Personality Disorders · doi:10.1521/pedi.2009.23.3.308 · Cited by 38 · see citing works
Randomized Controlled Trials in Psychiatry. Part II: Their Relationship to Clinical Practice
Mulder, R., Frampton, C. M., Joyce, P. R., & Porter, R. (2003) · Australian & New Zealand Journal of Psychiatry · doi:10.1046/j.1440-1614.2003.01176.x · Cited by 36 · see citing works
Characteristics of Insured and Noninsured Outpatients With Depression in STAR*D
Lesser, I. M., Leuchter, A. F., Trivedi, M. H., Davis, L. L., Wisniewski, S. R., Balasubramani, G. K., Petersen, T., Stegman, D., & Rush, A. J. (2005) · Psychiatric Services · doi:10.1176/appi.ps.56.8.995 · Cited by 29 · see citing works
Depression rating scales can be related to each other by simple equations
Hawley, C. J., Gale, T. M., Smith, V. R. H., & Sen, P. (1998) · International Journal of Psychiatry in Clinical Practice · doi:10.3109/13651509809115359 · Cited by 21 · see citing works
[Randomized controlled trials in psychiatry].
Jaeschke, R. R., Siwek, M., Brożek, J., & Brudkiewicz, P. (2012) · PubMed · Cited by 11 · see citing works
Dinan, T. G. (2001) · PubMed · Cited by 11 · see citing works
The STAR*D trial: the 300 lb gorilla is in the room, but does it block all the light?
Hatcher, S. (2008) · Evidence-Based Mental Health · doi:10.1136/ebmh.11.4.97 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Severity classification on the Hamilton depression rating scale
Zimmerman, M., Martinez, J. H., Young, D., Chelminski, I., & Dalrymple, K. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.04.028 · Cited by 1,199 · see citing works
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104 · see citing works
Kennedy-Martin, T., Curtis, S., Faries, D., Robinson, S., & Johnston, J. (2015) · Trials · doi:10.1186/s13063-015-1023-4 · Cited by 878 · see citing works
Side effects of antidepressants during long-term use in a naturalistic setting
Bet, P. M., Hugtenburg, J. G., Penninx, B. W. J. H., & Hoogendijk, W. J. G. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2013.05.001 · Cited by 239 · see citing works
The severity of psychiatric disorders
Zimmerman, M., Morgan, T. A., & Stanton, K. (2018) · World Psychiatry · doi:10.1002/wps.20569 · Cited by 227 · see citing works
Cognitive behavioral therapy for suicidal behaviors: improving patient outcomes
Mewton, L., & Andrews, G. (2016) · Psychology Research and Behavior Management · doi:10.2147/prbm.s84589 · Cited by 69 · see citing works
van der Lem, R., van der Wee, N. J. A., van Veen, T., & Zitman, F. G. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000330890 · Cited by 63 · see citing works
Self-citationvan der Lem, R., de Wever, W. W., van der Wee, N. J., van Veen, T., Cuijpers, P., & Zitman, F. G. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-192 · Cited by 37 · see citing works
Self-citationSampling bias in an internet treatment trial for depression
Donkin, L., Hickie, I. B., Christensen, H., Naismith, S. L., Neal, B., Cockayne, N. L., & Glozier, N. (2012) · Translational Psychiatry · doi:10.1038/tp.2012.100 · Cited by 38 · see citing works
Zimmerman, M., Balling, C., Chelminski, I., & Dalrymple, K. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.012 · Cited by 10 · see citing works
Agger, J. L., Schröder, A., Ørnbøl, E., Jensen, J. S., Pedersen, H. F., Fink, P., & Gormsen, L. K. (2022) · Psychiatry Research · doi:10.1016/j.psychres.2022.114474 · Cited by 1 · see citing works
- Authors
- van der Lem, R., van der Wee, N. J. A., van Veen, T., & Zitman, F. G.
- Affiliations
- Leiden University Medical Center (NL)
- ORCID
- Zitman, F. G.
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2010-11-16
- Volume
- 41
- Issue
- 7
- Pages
- 1353-1363
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- OpenAlex
- W2143892561
- Cited by
- 63
- References
- 50
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 2 · 2023: 3 · 2022: 3 · 2020: 1 · 2019: 4 · 2018: 4 · 2017: 2 · 2016: 7 · 2015: 7 · 2014: 7 · 2013: 6 · 2012: 10
- FWCI
- 4.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Medicine (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- Funders
- Rivierduinen
- Topics
- Health Sciences › Medicine › Pharmacology › Treatment of Major Depression
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- generalizability, major depressive disorder, inclusion and exclusion criteria, exclusion criteria, baseline depression severity, remission, treatment response, personality pathology, comorbidities, routine outcome monitoring
- MeSH terms
- Adult, Ambulatory Care, Antidepressive Agents, Clinical Trials as Topic, Major Depressive Disorder, Female, Humans, Male, Netherlands, Outpatients, Practice Patterns, Physicians', Psychiatric Status Rating Scales, Research Design, Treatment Outcome, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review