The effectiveness of long-term psychotherapy: Methodological research issues
Open accessThe DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
In evidence-based medicine (EBM) hierarchy, randomized controlled trials (RCTs) are ranked higher than cohort studies. However, cohort intervention studies are frequently, and RCTs rarely, used to investigate long-term psychotherapy (LTP). The authors compare the two methods and provide critical discussion of their acceptability, feasibility, and decisive power in LTP. The only essential and unchangeable difference between RCTs and cohort studies is that the former always include randomized control groups and the latter never do, giving RCTs a head start on internal validity that cohort studies cannot match. However, randomization nearly always has dramatic consequences for LTP research: The control conditions that are most informative (no treatment, wait list, placebo) are so unacceptable for the patients that decisive RCTs are, in most cases, unfeasible, but more feasible RCTs are less decisive. In contrast, the decisive power of cohort studies is determined by their methodological quality and knowledge of the natural course of the investigated disorders. Cohort studies are as capable as RCTs of meeting all quality criteria for intervention research, except for randomization. The knowledge of the natural course of the disorders suitable for LTP treatment is limited but not nonexistent. In most cases of LTP research, decisive RCTs present insurmountable, method-inherent feasibility problems and represent not the highest but rather an irrelevant level of evidence. The authors conclude that cohort studies provide the best available evidence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
(2002) · Cited by 13,211
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 3×
“The American Psychological Association (Chambless & Hollon, 1998; Task Force on Promotion and Dis- semination of Psychological Procedures, 1995) has defined quality criteria to assess whether or not the effectiveness of a psychotherapeutic method has been sufficiently substantiated empirically to…”
BackgroundInfluentialCognitive-behavioral treatment of chronically parasuicidal borderline patients
Linehan, M. M. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810360024003 · Cited by 2,203 · cited 1×
“Dialectic behavior therapy (Linehan et al., 1991, 1999, 2002; Verheul et al., 2003) and mentalization-based therapy (Bateman & Fonagy, 1999) in the treatment of BPD patients qualify as such control conditions.”
MethodResearch design in clinical psychology
(1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1<3::aid-jclp2270080102>3.0.co;2-0 · Cited by 2,147
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608 · cited 1×
“…past decade, RCTs have been severely criticized as well, not only in the field of psychotherapy and regardless of treatment length (Crits-Christoph, 1997; Healy, 2001; Hollon, 1996; Howard, Moras, Brill, Martinovich, & Lutz, 1996; Kaptchuck, 2001; Leichsenring, 2004; Marks, 1997; Seligman, 1995).”
BackgroundBateman, A., & Fonagy, P. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.10.1563 · Cited by 1,416 · cited 3×
“Dialectic behavior therapy (Linehan et al., 1991, 1999, 2002; Verheul et al., 2003) and mentalization-based therapy (Bateman & Fonagy, 1999) in the treatment of BPD patients qualify as such control conditions.”
MethodSchema Therapy: a Practitioner's Guide
Simeon, D. (2004) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(03)00529-4 · Cited by 1,274
Effectiveness of psychotherapy
(2011) · Revision MCQs and EMIs for the MRCPsych · doi:10.1201/b13482-76 · Cited by 1,058
Dialectical behavior therapy for patients with borderline personality disorder and drug dependence
Linehan, M. M., Schmidt, H., Dimeff, L. A., Craft, J. C., Kanter, J., & Comtois, K. A. (1999) · The American Journal on Addictions · doi:10.1080/105504999305686 · Cited by 1,043
Research works printed but not linked: 4
- Centre for Evidence-Based Medicine Toronto . ( n.d .) . Glossary of EBM terms . Retrieved March 15, 2005, from http://www.cebm.utoronto.ca/glossary/
- 10.1037/0003-066X.51.10.1025 · doi:10.1037/0003-066x.51.10.1025 · Paper page
- 10.1037/0022-006X.66.1.3 · DOI · Paper page
- Task Force on Promotion and Dissemination of Psychological Procedures . ( 1995 ). Training and dissemination of empirically-validated psychological treatments . Behavioral Research & Therapy , 39 , 299 – 308 .
Cited by
Spreeuwenberg, M. D., Bartak, A., Croon, M. A., Hagenaars, J. A., Busschbach, J. J. V., Andrea, H., Twisk, J., & Stijnen, T. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181c1328f · Cited by 227
The Effectiveness of Long-Term Psychoanalytic Therapy: A Systematic Review of Empirical Studies
de Maat, S., de Jonghe, F., Schoevers, R., & Dekker, J. (2009) · Harvard Review of Psychiatry · doi:10.1080/10673220902742476 · Cited by 200
Self-citationFlückiger, C., & Grosse Holtforth, M. (2008) · Journal of Clinical Psychology · doi:10.1002/jclp.20493 · Cited by 144
de Maat, S., Philipszoon, F., Schoevers, R., Dekker, J., & De Jonghe, F. (2007) · Harvard Review of Psychiatry · doi:10.1080/10673220701811654 · Cited by 48
Self-citationThe Use of Propensity Score Methods in Psychotherapy Research
Bartak, A., Spreeuwenberg, M. D., Andrea, H., Busschbach, J. J. V., Croon, M. A., Verheul, R., Emmelkamp, P. M. G., & Stijnen, T. (2009) · Psychotherapy and Psychosomatics · doi:10.1159/000162298 · Cited by 38
Metadata
- Authors
- Maat, S. D., Dekker, J., Schoevers, R., & Jonghe, F. D.
- Affiliations
- Mentrum Institute for Mental Health Amsterdam
- Vrije Universiteit Amsterdam (NL)
- Mentrum (NL)
- Corresponding author
- Dekker, Jack
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2007-01
- Volume
- 17
- Issue
- 1
- Pages
- 59-65
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W2028966252
- Semantic Scholar
- 3bb4198148b0adc0c3855614bc5716e21f19a163
- Cited by
- 21
- References
- 39
- Citations by year
- 2026: 1 · 2022: 1 · 2021: 1 · 2020: 1 · 2019: 1 · 2016: 1 · 2015: 1 · 2013: 1 · 2012: 1
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- green
- research.vu.nl
- Licence
- other-oa
- Locations
- Psychotherapy Research (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- long-term psychotherapy, randomized controlled trials, cohort studies, evidence hierarchy, evidence-based medicine, internal validity, randomization, waitlist control, placebo comparison, methodological quality, feasibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effectiveness of long-term psychotherapy: Methodological research issues. https://app.cochat.ai/papers/10.1080/10503300600607605
- The paper
- Maat, S. D., Dekker, J., Schoevers, R., & Jonghe, F. D. (2007). The effectiveness of long-term psychotherapy: Methodological research issues. Psychotherapy Research. https://doi.org/10.1080/10503300600607605
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.