Cited by 18Psychotherapy Techniques and ApplicationsPsychoanalysis and Psychopathology ResearchMental Health Treatment and Access

No pain, no gain revisited: the impact of positive and negative psychotherapy experiences on treatment outcome

Open access
Verkooyen, Roos, Broers, Nick J., Dandachi-FitzGerald, Brechje·2024·Frontiers in Psychology

Abstract

Objective: Psychotherapy may have many benefits for patients with mental health problems, but patients may also have negative experiences related to the therapy. Not much is known about these negative psychotherapy experiences and their impact on treatment outcome. The aim of this study was to examine the association between positive and negative psychotherapy experiences and treatment outcome. Methods: A total of 130 patients participated in the study. They received treatment as usual and were assessed for positive and negative psychotherapy experiences at mid-treatment and post-treatment using the Positive and Negative Experiences of Psychotherapy Questionnaire (PNEP). Treatment outcome was measured by the Outcome Questionnaire - 45 (OQ-45). Multiple linear regression was used to analyze the data. Results: All patients reported positive psychotherapy experiences at mid-treatment. At least one negative experience was reported by 69% of participants. After correction for baseline severity (i.e., OQ-45 at baseline) and relevant demographic variables, positive psychotherapy experiences at mid-treatment emerged as a predictor for treatment outcome. In contrast, negative psychotherapy experiences did not predict treatment outcome. However, reporting more negative experiences was associated with reporting fewer positive experiences at mid- and end of treatment. Conclusion: Both positive and negative psychotherapy experiences commonly occur. Although in this study negative psychotherapy experiences did not predict treatment outcome in terms of symptom reduction, the findings do suggest that negative experiences may influence the way in which patients evaluate their treatment. Although positive experiences outweigh negative experiences, patients should be informed that negative experiences may also occur.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2024.1378456

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Evidence suggests that adverse events can trigger dropouts [66].

    “evidence suggests that the former can trigger the latter [66].”

    From Habit as a therapeutic component in psychological treatment for obsessive-compulsive disorder: A randomised controlled feasibility study. (2026) · cites this paper as [66]

    The Introduction discusses adverse events and treatment outcomes, but does not link adverse events to dropout. The Methods (Participants; page unavailable) reports study dropout after questionnaire non-response, without attributing it to adverse events. Searches for dropout, premature termination, and negative experiences found no passage making the claimed connection. (LLM, conf=0.74)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 60 · Cited by 18

Research works printed but not linked: 42

  1. Antichi L. Giannini M. (2023). An introduction to change in psychotherapy: moderators, course of change, and change mechanisms. J. Contemp. Psychother. 53, 315– 323. doi: 10.1007/s10879-023-09590-x, PMID: 34763203 · DOI
  2. Berghs M.H.G.A. (2020). Evaluation of two questionnaires to measure negative effects of psychotherapy. Master’s thesis. Maastricht, the Netherlands: Maastricht University.
  3. Bergin A. E. (1966). Some implications of psychotherapy research for therapeutic practice. J. Abnorm. Psychol. 71, 235– 246. doi: 10.1037/h0023577, PMID: 5941041 · DOI
  4. Berk M. Parker G. (2009). The elephant on the couch: side-effects of psychotherapy. Aust. N. Z. J. Psychiatry 43, 787– 794. doi: 10.1080/00048670903107559, PMID: 19670051 · DOI · Paper page
  5. Binder P. E. Holgersen H. Nielsen G. H. (2010). What is a “good outcome” in psychotherapy? A qualitative exploration of former patients' point of view. Psychother. Res. 20, 285– 294. doi: 10.1080/10503300903376338, PMID: 19941195 · DOI
  6. Blease C. R. Lilienfeld S. O. Kelley J. M. (2016). Evidence-based practice and psychological treatments: the imperatives of informed consent. Front. Psychol. 7: 1770. doi: 10.3389/fpsyg.2016.01170 27559322 PMC4979245 · DOI
  7. Bordin E. S. (1994). “ Theory and research on the therapeutic working alliance: new directions” in The working alliance: Theory, research, and practice. eds. Horvath A. O. Greenberg L. S. (Hoboken, NJ: John Wiley & Sons), 13– 37.
  8. Brakemeier E.-L. Herzog P. Radtke M. Schneibel R. Breger V. Becker M.. (2018). CBASP als stationäres Behandlungskonzept der therapieresistenten chronischen Depression: Eine Pilotstudie zum Zusammenhang von Nebenwirkungen und Therapieerfolg. Psychother. Psychosom. Med. Psychol. 68, 399– 407. doi: 10.1055/a-0629-7802, PMID: 30286506 · DOI
  9. Burton L. Thériault A. (2020). Hindering events in psychotherapy: a retrospective account from the client's perspective. Couns. Psychother. Res. 20, 116– 127. doi: 10.1002/capr.12268 · DOI
  10. Cuijpers P. Miguel C. Ciharova M. Harrer M. Moir F. Roskvist R.. (2023). Psychological treatment of adult depression in primary care compared with outpatient mental health care: a meta-analysis. J. Affect. Disord. 339, 660– 675. doi: 10.1016/j.jad.2023.07.011, PMID: 37467801 · DOI
  11. Curran J. Parry G. D. Darling J. Mason A. M. Chambers E. (2019). How does therapy harm? A model of adverse process using task analysis in the meta-synthesis of service users’ experience. Front. Psychol. 10: 347. doi: 10.3389/fpsyg.2019.00347 30930805 PMC6425860 · DOI
  12. Dandachi-Fitz Gerald B. Houben S. Broers N. J. Merckelbach H. (2024). The positive and negative experiences of psychotherapy questionnaire (PNEP): First psychometric findings of a new instrument for monitoring clients’ experiences. J. Clin. Psychol. Psychoth. doi: 10.1002/cpp.3014 38837842 · DOI
  13. Dandachi-Fitz Gerald B. Meijs L. Moonen I. M. Merckelbach H. (2022). No self-serving bias in therapists' evaluations of clients' premature treatment termination: an approximate replication of Murdock et al. (2010). Clin. Psychol. Psychother. 29, 972– 981. doi: 10.1002/cpp.2677, PMID: 34694674 PMC9298110 · DOI
  14. Dandachi-Fitz Gerald B. Otgaar H. Merckelbach H. (2023). “ When psychotherapy fails” in Toward a science of clinical psychology: A tribute to the life and works of Scott O Lilienfeld. eds. Cobb C. L. Lynn S. J. O’Donohue W. (Cham, Switzerland: Springer International Publishing), 301– 319.
  15. De Jong K. Nugter A. Polak M. Wagenborg H. Spinhoven P. Heiser W. (2008). De Nederlandse versie van de Outcome Questionnaire (OQ-45): Een crossculturele validatie. Psychol. Gezondh. 36, 35– 45. doi: 10.1007/BF03077465 · DOI
  16. Dobler C. C. Harb N. Maguire C. A. Armour C. L. Coleman C. Murad M. H. (2018). Treatment burden should be included in clinical practice guidelines. Br. M. J. 363: k4065. doi: 10.1136/bmj.k4065 30314981 · DOI
  17. Fleming L. Agnew S. Peddie N. Crawford M. Dixon D. Mac Pherson I. (2022). The impact of medication side effects on adherence and persistence to hormone therapy in breast cancer survivors: a quantitative systematic review. Breast J. 64, 63– 84. doi: 10.1016/j.breast.2022.04.010 PMC9130570 35609380 · DOI
  18. Franzoi M. A. Agostinetto E. Perachine M. Del Mastro L. de Azambuja A. Vaz-Luis I. (2021). Evidence-based approaches for the management of side-effects of adjuvant endocrine therapy in patients with breast cancer. Lancet Oncol. 22, e303– e313. doi: 10.1016/S1470-2045(20)30666-5 33891888 · DOI
  19. Hannan C. Lambert M. J. Harmon C. Nielsen S. L. Smart D. W. Shimokawa K.. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. J. Clin. Psychol. 61, 155– 163. doi: 10.1002/jclp.20108, PMID: 15609357 · DOI
  20. Hatfield D. McCullough L. Frantz S. H. Krieger K. (2010). Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clin. Psychol. Psychother. 17, 25– 32. doi: 10.1002/cpp.656, PMID: 19916162 · DOI · Paper page
  21. Herzog P. Lauff S. Rief W. Brakemeier E.-L. (2019). Assessing the unwanted: a systematic review of instruments used to assess negative effects of psychotherapy. Brain Behav. 9: e01447. doi: 10.1002/brb3.1447, PMID: 31647202 PMC6908878 · DOI · Paper page
  22. Hill C. E. Chui H. Baumann E. (2013). Revisiting and reenvisioning the outcome problem in psychotherapy: an argument to include individualized and qualitative measurement. Psychotherapy 50, 68– 76. doi: 10.1037/a0030571, PMID: 23505982 · DOI
  23. Hughes S. Lacasse J. Rogers Fuller R. Spaulding-Givens J. (2017). Adverse effects and treatment satisfaction among online users of four antidepressants. Psychiatry Res. 255, 78– 86. doi: 10.1016/j.psychres.2017.05.021, PMID: 28531820 · DOI
  24. Klatte R. Strauss B. Flückiger C. Rosendahl J. (2023). Adverse events in psychotherapy randomized controlled trials: a systematic review. Psychother. Res. 13, 1– 16. doi: 10.1080/10503307.2023.2286992, PMID: 38090772 · DOI
  25. Ladmanová M. Rihacek T. Timulak L. (2022). Client-identified impacts of helpful and hindering events in psychotherapy: a qualitative meta-analysis. Psychother. Res. 32, 723– 735. doi: 10.1080/10503307.2021.2003885, PMID: 34806550 · DOI
  26. Lambert M. J. Burlingame G. M. Umphress V. Hansen N. B. Vermeersch D. A. Clouse G. C.. (1996). The reliability and validity of the outcome questionnaire. Clin. Psychol. Psychother. 3, 249– 258. doi: 10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S, PMID: 38797014 · DOI
  27. Lilienfeld S. O. (2007). Psychological treatments that cause harm. Perspect. Psychol. Sci. 2, 53– 70. doi: 10.1111/j.1745-6916.2007.00029.x, PMID: 26151919 · DOI · Paper page
  28. McCord J. (2003). Cures that harm: unanticipated outcomes of crime prevention programs. Ann. Am. Ac. Pol. Soc. Sci. 587, 16– 30. doi: 10.1177/0002716202250781 · DOI · Paper page
  29. Moos R. H. (2005). Iatrogenic effects of psychosocial interventions for substance use disorders: prevalence, predictors, prevention. Addiction 100, 595– 604. doi: 10.1111/j.1360-0443.2005.01073.x, PMID: 15847616 · DOI
  30. Moritz S. Fieker M. Hottenrott B. Seeralan T. Cludius B. Kolbeck K.. (2015). No pain, no gain? Adverse effects of psychotherapy in obsessive-compulsive disorder and its relationship to treatment gains. J. Obsessive Compuls. Relat. Disord. 5, 61– 66. doi: 10.1016/j.jocrd.2015.02.002 · DOI
  31. Moritz S. Nestoriuc Y. Rief W. Klein J. P. Jelinek L. Peth J. (2019). It can’t hurt, right? Adverse effects of psychotherapy in patients with depression. Eur. Arch. Psychiatry Clin. Neurosci. 269, 577– 586. doi: 10.1007/s00406-018-0931-1 30088072 · DOI
  32. Muschalla B. Müller J. Grocholewski A. Linden A. (2023). Effects of talking about side effects versus not talking about side effects on the therapeutic alliance: a controlled clinical trial. Acta Psychiatr. Scand. 148, 208– 216. doi: 10.1111/acps.13543, PMID: 36905373 · DOI
  33. Parry G. D. Crawford M. J. Duggan C. (2016). Iatrogenic harm from psychological therapies - time to move on. Br. J. Psychiatry 208, 210– 212. doi: 10.1192/bjp.bp.115.163618, PMID: 26932481 · DOI · Paper page
  34. Peth J. Jelinek L. Nestoriuc Y. Moritz S. (2018). Unerwünschte Effekte von Psychotherapie bei depressiven Patienten-Erste Anwendung der Positive and Negative Effects of Psychotherapy Scale (PANEPS). Psychother. Psychosom. Med. Psychol. 68, 391– 398. doi: 10.1055/s-0044-101952, PMID: 29631298 · DOI
  35. Powers E. Witmer H. (1951). An experiment in the prevention of delinquency: The Cambridge–Somerville youth study. New York, NY: Columbia University Press.
  36. Schneibel R. Wilbertz G. Scholz C. Becker M. Brakemeier E.-L. Bschor T.. (2017). Adverse events of group psychotherapy in the in-patient setting - results of a naturalistic trial. Acta Psychiatr. Scand. 163, 247– 258. doi: 10.1111/acps.12747 28561929 · DOI
  37. Timulak L. Keogh D. (2017). The client’s perspective on (experiences of) psychotherapy: a practice friendly review. J. Clin. Psychol. 73, 1556– 1567. doi: 10.1002/jclp.22532, PMID: 28898410 · DOI
  38. Vybíral Z. Ogles B. M. Rihacek T. Urbancová B. Gocieková V. (2024). Negative experiences in psychotherapy from clients’ perspective: a qualitative meta-analysis. Psychother. Res. 34, 279– 292. doi: 10.1080/10503307.2023.2226813, PMID: 37410872 · DOI
  39. Wakefield S. Kellett S. Simmonds-Buckley M. Stockton D. Bradbury A. Delgadillo J. (2020). Improving access to psychological therapies (IAPT) in the United Kingdom: a systematic review and meta-analysis of 10-years of practice-based evidence. Br. J. Clin. Psychol. 60, 1– 37. doi: 10.1111/bjc.12259 32578231 · DOI · Paper page
  40. Werbart A. Annevall A. Hillblom J. (2019). Successful and less successful psychotherapies compared: three therapists and their six contrasting cases. Front. Psychol. 10: 816. doi: 10.3389/fpsyg.2019.00816 31057456 PMC6478662 · DOI
  41. Whipple J. L. Lambert M. J. (2011). Outcome measures for practice. Ann. Rev. Clin. Psychol. 7, 87– 111. doi: 10.1146/annurev-clinpsy-040510-143938, PMID: 21166536 · DOI
  42. Williams A. J. Botanov Y. Kilshaw R. E. Wong R. E. Sakulak J. K. (2021). Potentially harmful therapies: a meta-scientific review of evidential value. Clin. Psychol. 28, 5– 18. doi: 10.1111/cpsp.12331 · DOI

Authors
Verkooyen, R., Broers, N. J., & Dandachi-FitzGerald, B.
Affiliations
  • Zuyderland Medisch Centrum (NL)
  • Maastricht University (NL)
Venue
Frontiers in Psychology
Published
2024-06-18
Volume
15
Pages
1378456-1378456
ISSN
1664-1078 (ISSN-L)
OpenAlex
W4399811936
Cited by
18
References
60
Citations by year
2026: 9 · 2025: 8 · 2024: 1
FWCI
9.02
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Psychology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Research Publications (Maastricht University) (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • DSpace (Open University in the Netherlands) (submittedVersion, cc-by)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
  • Social Sciences › Psychology › Clinical Psychology › Psychoanalysis and Psychopathology Research
  • Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
Keywords
psychotherapy experience, treatment outcomes, mental illness, symptom relief, OQ-45, baseline symptom severity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review