Negative Effects of Psychological Treatments: An Exploratory Factor Analysis of the Negative Effects Questionnaire for Monitoring and Reporting Adverse and Unwanted Events
Open accessAbstract
Research conducted during the last decades has provided increasing evidence for the use of psychological treatments for a number of psychiatric disorders and somatic complaints. However, by focusing only on the positive outcomes, less attention has been given to the potential of negative effects. Despite indications of deterioration and other adverse and unwanted events during treatment, little is known about their occurrence and characteristics. Hence, in order to facilitate research of negative effects, a new instrument for monitoring and reporting their incidence and impact was developed using a consensus among researchers, self-reports by patients, and a literature review: the Negative Effects Questionnaire. Participants were recruited via a smartphone-delivered self-help treatment for social anxiety disorder and through the media (N = 653). An exploratory factor analysis was performed, resulting in a six-factor solution with 32 items, accounting for 57.64% of the variance. The derived factors were: symptoms, quality, dependency, stigma, hopelessness, and failure. Items related to unpleasant memories, stress, and anxiety were experienced by more than one-third of the participants. Further, increased or novel symptoms, as well as lack of quality in the treatment and therapeutic relationship rendered the highest self-reported negative impact. In addition, the findings were discussed in relation to prior research and other similar instruments of adverse and unwanted events, giving credence to the items that are included. The instrument is presently available in eleven different languages and can be freely downloaded and used from www.neqscale.com.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This result fits literature that shows that psychological interventions, online and offline, can initially evoke negative effects and symptom deteriorations.
“On the one hand, this result fits literature that shows, that psychological interventions, online and offline, can initially evoke negative effects and symptom deteriorations (Ladwig et al., 2014; Rozental et al., 2016).”
From Feasibility of a Software agent providing a brief Intervention for Self-help to Uplift psychological wellbeing (“SISU”). A single-group pretest-posttest trial investigating the potential of SISU to act as therapeutic agent (2021) · cites this paper as Rozental et al., 2016
The Introduction reports symptom deterioration during psychological treatment, and the Discussion reports unpleasant memories, stress, anxiety, and increased symptoms among participants, including those receiving a smartphone-delivered intervention. The paper also says some effects may not endure, but it does not establish that they occur specifically at the start of treatment or demonstrate the same pattern separately for online and offline interventions. (LLM, conf=0.83)
Experimental — accuracy not yet measuredAdverse events and harms during the RCT are measured with the Negative Experiences Questionnaire (NEQ).
“Adverse events and harms during the RCT are measured with the Negative Experiences Questionnaire (NEQ), [61]”
From Transdiagnostic and tailored internet intervention to improve mental health among university students: Research protocol for a randomized controlled trial (2024) · cites this paper as [61]
The NEQ has excellent internal consistency (Cronbach's α = 0.95).
“The internal consistency for the full instrument is excellent (Cronbach's α = 0.95), and is scored on several dimensions; 1) “Did you experience this?” (yes/no), 2) “If yes – here is how negatively it affected me”, from 0 (“Not at all”) to 4 (“Extremely”), and 3) “Probably caused by” (“The treatment I received” or “Other circumstances”).”
From A study protocol of a randomized controlled study of internet-based cognitive behavioral therapy for adult attention deficit hyperactivity disorder (2023) · cites this paper as Rozental et al., 2016
The Negative Effects Questionnaire (NEQ) has an internal consistency of α = 0.95.
“Internal Consistency of the NEQ is reported to be α = 0.95 (90).”
Non-response, dropout, and interpersonal difficulties may be perceived as negative effects of psychotherapeutic treatments.
“Others have also implied that non-response, dropout, and interpersonal difficulties may be perceived as negative effects (Dimidjian 2010; Rozental 2016).”
From Psychotherapeutic treatments for depression in older adults (2024) · cites this paper as Rozental 2016
Trials have begun to include and report results from broader measures of negative effects used elsewhere in psychotherapy research.
“and trials have already begun (Miloff et al. 2019) to include and report results from broader measures of negative effects used elsewhere in psychotherapy research (Rozental et al. 2016).”
From Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy (2021) · cites this paper as Rozental et al. 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · see citing works
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 27,815 · see citing works
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
The Scree Test For The Number Of Factors
Cattell, R. B. (1966) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0102_10 · Cited by 13,554 · see citing works
The application of electronic computers to factor analysis
Kaiser, H. F. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000116 · Cited by 12,459 · see citing works
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
(1998) · PubMed · Cited by 10,216 · see citing works
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587 · see citing works
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 8,965 · see citing works
Selective Cortical Undercutting As a Means of Modifying and Studying Frontal Lobe Function in Man
Scoville, W. B. (1949) · Journal of neurosurgery · doi:10.3171/jns.1949.6.1.0065 · Cited by 7,373 · see citing works
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567 · see citing works
Lippa, N. C., & Sanderson, S. C. (2013) · Human Heredity · doi:10.1159/000353712 · Cited by 6,093 · see citing works
O’connor, B. P. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200807 · Cited by 4,116 · see citing works
Factor analysis in the development and refinement of clinical assessment instruments.
Floyd, F. J., & Widaman, K. F. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.286 · Cited by 3,970 · see citing works
Moral Identity and Developmental Theory
Lapsley, D. K. (2015) · Human Development · doi:10.1159/000435926 · Cited by 3,836 · see citing works
How stigma interferes with mental health care.
Corrigan, P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.7.614 · Cited by 3,648 · see citing works
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445 · see citing works
A Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193 · see citing works
Comparison of five rules for determining the number of components to retain.
Zwick, W. R., & Velicer, W. F. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.3.432 · Cited by 3,139 · see citing works
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846 · see citing works
Liebowitz, M. R. (2015) · Modern Trends in Pharmacopsychiatry · doi:10.1159/000414022 · Cited by 2,266 · see citing works
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852 · see citing works
Research summary on the therapeutic relationship and psychotherapy outcome.
Lambert, M. J., & Barley, D. E. (2001) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.38.4.357 · Cited by 1,621 · see citing works
The psychotherapeutic process: A research handbook.
Greenberg, L. S., & Pinsof, W. M. (1986) · Cited by 1,386 · see citing works
Link, B. G., Struening, E. L., Neese-Todd, S., Asmussen, S., & Phelan, J. C. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.12.1621 · Cited by 1,254 · see citing works
An Overview of Analytic Rotation in Exploratory Factor Analysis
Browne, M. W. (2001) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3601_05 · Cited by 1,145 · see citing works
Relationship between hopelessness and ultimate suicide: a replication with psychiatric outpatients
(1990) · American Journal of Psychiatry · doi:10.1176/ajp.147.2.190 · Cited by 1,120 · see citing works
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · see citing works
Self-citationCuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066 · see citing works
Self-citationMental health consumers' experience of stigma.
Wahl, O. F. (1999) · Schizophrenia bulletin · doi:10.1093/oxfordjournals.schbul.a033394 · Cited by 1,009 · see citing works
Psychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959 · see citing works
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · see citing works
Cuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832 · see citing works
Self-citationCognitive interviewing: verbal data in the design and pretesting of questionnaires
Drennan, J. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02579.x · Cited by 769 · see citing works
Clark, D. M. (2011) · International Review of Psychiatry · doi:10.3109/09540261.2011.606803 · Cited by 699 · see citing works
Mohr, D. C., Burns, M. N., Schueller, S. M., Clarke, G., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.008 · Cited by 693 · cited 1× · see citing works
“In addition, several studies on therapist effects have revealed that some could potentially be harmful for the patient, inducing more deterioration in comparison to their colleagues [66], and interpersonal issues in treatment have been found to be detrimental for some patients [67].”
BackgroundIs cognitive–behavioral therapy more effective than other therapies?
Tolin, D. F. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.05.003 · Cited by 645 · see citing works
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608 · see citing works
SOLVING MEASUREMENT PROBLEMS WITH THE RASCH MODEL
Wright, B. D. (1977) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1977.tb00031.x · Cited by 600 · see citing works
Mind the gap: improving the dissemination of CBT
Shafran, R., Clark, D. M., Fairburn, C. G., Arntz, A., Barlow, D. H., Ehlers, A., Freeston, M., Garety, P. A., Hollon, S. D., Ost, L. G., et al. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.003 · Cited by 569 · see citing works
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494 · see citing works
Common methodological problems in factor analytic studies.
Comrey, A. L. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.648 · Cited by 489 · see citing works
Negative effects from psychological treatments: a perspective
Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0015643 · Cited by 426 · see citing works
Linden, M. (2013) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1765 · Cited by 397 · cited 2× · see citing works
“Patients becoming overly reliant on their treatment or therapist have frequently been mentioned as a possible adverse and unwanted event [13, 24, 41], but the evidence has been missing.”
BackgroundLearned helplessness, depression, and the attribution of failure.
Klein, D. C., Fencil-Morse, E., & Seligman, M. (1976) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.33.5.508 · Cited by 384 · see citing works
Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037/0022-0167.50.1.59 · Cited by 374 · see citing works
Consensus statement on defining and measuring negative effects of internet interventions
Rozental, A., Andersson, G., Boettcher, J., Ebert, D. D., Cuijpers, P., Knaevelsrud, C., Ljótsson, B., Kaldo, V., Titov, N., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.001 · Cited by 371 · see citing works
Self-citationLearned helplessness, depression, and the attribution of failure.
Klein, D. C., Fencil-Morse, E., & Seligman, M. E. P. (1976) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.33.5.508 · Cited by 337 · see citing works
Strupp, H. H., & Hadley, S. W. (1977) · American Psychologist · doi:10.1037//0003-066x.32.3.187 · Cited by 336 · see citing works
How would we know if psychotherapy were harmful?
Dimidjian, S., & Hollon, S. D. (2010) · American Psychologist · doi:10.1037/a0017299 · Cited by 314 · see citing works
Outcome in psychotherapy: The past and important advances.
Lambert, M. J. (2013) · Psychotherapy · doi:10.1037/a0030682 · Cited by 286 · see citing works
Strupp, H. H., & Hadley, S. W. (1977) · American Psychologist · doi:10.1037/0003-066x.32.3.187 · Cited by 286 · see citing works
Ly, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269 · see citing works
Self-citationTraining implications of harmful effects of psychological treatments.
Castonguay, L. G., Boswell, J. F., Constantino, M. J., Goldfried, M. R., & Hill, C. E. (2010) · American Psychologist · doi:10.1037/a0017330 · Cited by 240 · see citing works
Ladwig, I., Rief, W., & Nestoriuc, Y. (2014) · Verhaltenstherapie · doi:10.1159/000367928 · Cited by 227 · see citing works
The accuracy of therapists' interpretations and the outcome of dynamic psychotherapy.
Crits-Christoph, P. F., Cooper, A. A., & Luborsky, L. B. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.56.4.490 · Cited by 221 · see citing works
Definition, assessment and rate of psychotherapy side effects
Linden, M., & Schermuly-Haupt, M.-L. (2014) · World Psychiatry · doi:10.1002/wps.20153 · Cited by 220 · see citing works
An Experiment in the Prevention of Delinquency: The Cambridge-Somerville Youth Study
Shalloo, J. P., Powers, E., & Witmer, H. L. (1952) · The Journal of Criminal Law Criminology and Police Science · doi:10.2307/1139954 · Cited by 217 · see citing works
The Elephant on the Couch: Side-Effects of Psychotherapy
Berk, M., & Parker, G. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670903107559 · Cited by 216 · see citing works
Rozental, A., Boettcher, J., Andersson, G., Schmidt, B., & Carlbring, P. (2015) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2015.1008033 · Cited by 189 · cited 2× · see citing works
“Items were generated by consulting a number or researchers [32], distributing open-ended questions [42], analyzing patient responses using qualitative method [44], and a comprehensive literature review.”
MethodSelf-citationJonsson, U., Alaie, I., Parling, T., & Arnberg, F. K. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.02.005 · Cited by 175 · see citing works
The accuracy of therapists' interpretations and the outcome of dynamic psychotherapy.
Crits-Christoph, P. F., Cooper, A., & Luborsky, L. B. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.4.490 · Cited by 174 · see citing works
Bergin, A. E. (1963) · Journal of Counseling Psychology · doi:10.1037/h0043353 · Cited by 169 · see citing works
Saxon, D. H., & Barkham, M. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028898 · Cited by 163 · see citing works
Binder, J. L., & Strupp, H. H. (1997) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.1997.tb00105.x · Cited by 156 · see citing works
Is It Time for Clinicians to Routinely Track Patient Outcome? A Meta-Analysis
Lambert, M. J. (2003) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/bpg025 · Cited by 150 · see citing works
Iatrogenic harm from psychological therapies—time to move on
Parry, G. D., Crawford, M. J., & Duggan, C. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.163618 · Cited by 146 · see citing works
Contemporary Views of Negative Effects in Psychotherapy: An Integrated Account
Hadley, S. W. (1976) · Archives of General Psychiatry · doi:10.1001/archpsyc.1976.01770110019001 · Cited by 126 · see citing works
Uncritical positive regard? Issues in the efficacy and safety of psychotherapy
Nutt, D. J., & Sharpe, M. (2008) · Journal of Psychopharmacology · doi:10.1177/0269881107086283 · Cited by 123 · see citing works
Abela, J. R. Z., & Seligman, M. E. P. (2000) · Cognitive Therapy and Research · doi:10.1023/a:1005571518032 · Cited by 102 · see citing works
Suh, C. S., Strupp, H. H., & O’Malley, S. S. (1986) · Cited by 100 · see citing works
Side effects in internet-based interventions for social anxiety disorder
Boettcher, J., Rozental, A., Andersson, G., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.002 · Cited by 88 · see citing works
Self-citationThe challenger app for social anxiety disorder: New advances in mobile psychological treatment
Miloff, A., Marklund, A., & Carlbring, P. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.08.001 · Cited by 87 · see citing works
Self-citationNegative factors in brief psychotherapy: An empirical assessment.
Sachs, J. S. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.4.557 · Cited by 81 · see citing works
Clinicians' Perspectives on Negative Effects of Psychological Treatments
Bystedt, S., Rozental, A., Andersson, G., Boettcher, J., & Carlbring, P. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2014.939593 · Cited by 78 · see citing works
Self-citationNegative outcome in psychotherapy and what to do about it
Mays, D. T., & Franks, C. M. (1985) · Springer eBooks · Cited by 75 · see citing works
Abramovitch (2015) · doi:10.1016/j.jocrd.2015.02.002 · Cited by 72 · see citing works
The need for expanded monitoring of adverse events in behavioral health clinical trials
Peterson, A. L., Roache, J. D., Raj, J., & Young-McCaughan, S. (2013) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.10.009 · Cited by 70 · see citing works
Identification of patients at risk for nonresponse and negative outcome in psychotherapy.
Mohr, D. C., Beutler, L. E., Engle, D. E., Shoham-Salomon, V., & al, E. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.5.622 · Cited by 68 · see citing works
Vaughan, B., Goldstein, M. H., Alikakos, M., Cohen, L. J., & Serby, M. J. (2014) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2014.01.001 · Cited by 63 · see citing works
Contraindications and Dangers of Psychotherapy
Crown, S. (1983) · The British Journal of Psychiatry · doi:10.1192/bjp.143.5.436 · Cited by 48 · see citing works
Component Analysis versus Common Factor Analysis: A Case of Disputed Authorship
Loehlin, J. C. (1990) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2501_2 · Cited by 46 · see citing works
Parker, G. B., Fletcher, K., Berk, M., & Paterson, A. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2012.11.026 · Cited by 45 · see citing works
Negative factors in brief psychotherapy: An empirical assessment.
Sachs, J. S. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.4.557 · Cited by 45 · see citing works
Identification of patients at risk for nonresponse and negative outcome in psychotherapy.
Mohr, D. C., Beutler, L. E., Engle, D., Shoham-Salomon, V., Bergan, J. J., Kaszniak, A. W., & Yost, E. B. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.58.5.622 · Cited by 45 · see citing works
Patients’ Perceptions of Risky Developments During Psychotherapy
Leitner, A., Märtens, M., Koschier, A., Gerlich, K., Liegl, G., Hinterwallner, H., & Schnyder, U. (2012) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-012-9215-7 · Cited by 42 · see citing works
Negative Indicators, Therapeutic Alliance, and Therapy Outcome
Eaton, T., Abeles, N., & Gutfreund, M. J. (1993) · Psychotherapy Research · doi:10.1080/10503309312331333719 · Cited by 36 · see citing works
The deterioration effect: A reply to Braucht.
Bergin, A. E. (1970) · Journal of Abnormal Psychology · doi:10.1037/h0029341 · Cited by 31 · see citing works
Getting worse: Psychotherapy or no treatment—the jury should still be out.
Mays, D. T., & Franks, C. M. (1980) · Professional Psychology · doi:10.1037/0735-7028.11.1.78 · Cited by 26 · see citing works
FOR BETTER OR FOR WORSE? PSYCHOTHERAPY AND VARIANCE CHANGE: A CRITICAL REVIEW OF THE LITERATURE
May, P. R. A. (1971) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-197103000-00004 · Cited by 19 · see citing works
Construct validity of the Experiences of Therapy Questionnaire (ETQ)
Parker, G. B., Paterson, A., Fletcher, K., McClure, G., & Berk, M. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0369-6 · Cited by 13 · see citing works
Demoralization Predicts Nonresponse to Cognitive Therapy in Depressed Outpatients
Stewart, J. W., Mercier, M. A., Quitkin, F. M., McGrath, P. J., Nunes, E. V., Young, J. E., Ocepek‐Welikson, K., & TRICAMO, E. (1993) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.7.2.105 · Cited by 11 · see citing works
Getting worse: Psychotherapy or no treatment--the jury should still be out.
Mays, D. T., & Franks, C. M. (1980) · Professional Psychology · doi:10.1037//0735-7028.11.1.78 · Cited by 4 · see citing works
(2014) · Psychotherapy Research · doi:10.1080/10503307.2014.942531 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Lancet Psychiatry Commission on psychological treatments research in tomorrow's science
Holmes, E. A., Ghaderi, A., Harmer, C. J., Ramchandani, P. G., Cuijpers, P., Morrison, A. P., Roiser, J. P., Bockting, C. L. H., O'Connor, R. C., Shafran, R., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30513-8 · Cited by 624 · see citing works
Rozental, A., Kottorp, A., Forsström, D., Månsson, K., Boettcher, J., Andersson, G., Furmark, T., & Carlbring, P. (2019) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465819000018 · Cited by 230 · see citing works
Self-citationThe Return of the Repressed: The Persistent and Problematic Claims of Long-Forgotten Trauma
Otgaar, H., Howe, M. L., Patihis, L., Merckelbach, H. L. G. J., Lynn, S. J., Lilienfeld, S. O., & Loftus, E. F. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619862306 · Cited by 211 · see citing works
Lindner, P., Miloff, A., Hamilton, W., Reuterskiöld, L., Andersson, G., Powers, M. B., & Carlbring, P. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1280843 · Cited by 187 · see citing works
Self-citationLindner, P., Miloff, A., Fagernäs, S., Andersen, J., Sigeman, M., Andersson, G., Furmark, T., & Carlbring, P. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.07.003 · Cited by 175 · see citing works
Self-citationMiloff, A., Lindner, P., Dafgård, P., Deak, S., Garke, M., Hamilton, W., Heinsoo, J., Kristoffersson, G., Rafi, J., Sindemark, K., et al. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.04.004 · Cited by 155 · see citing works
Self-citationRozental, A., Magnusson, K., Boettcher, J., Andersson, G., & Carlbring, P. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000158 · Cited by 137 · see citing works
Self-citationRozental, A., Castonguay, L., Dimidjian, S., Lambert, M., Shafran, R., Andersson, G., & Carlbring, P. (2018) · BJPsych Open · doi:10.1192/bjo.2018.42 · Cited by 124 · see citing works
Self-citationBetter, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy
Lindner, P. (2021) · International Journal of Cognitive Therapy · doi:10.1007/s41811-020-00090-7 · Cited by 120 · see citing works
Negative experiences in psychotherapy from clients’ perspective: A qualitative meta-analysis
Vybíral, Z., Ogles, B. M., Řiháček, T., Urbancová, B., & Gocieková, V. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2226813 · Cited by 107 · see citing works
Herzog, P., Lauff, S., Rief, W., & Brakemeier, E. (2019) · Brain and Behavior · doi:10.1002/brb3.1447 · Cited by 95 · see citing works
Strategies for de-implementation of low-value care—a scoping review
Ingvarsson, S., Hasson, H., Schwarz, U. V. T., Nilsén, P., Powell, B. J., Lindberg, C., & Augustsson, H. (2022) · Implementation Science · doi:10.1186/s13012-022-01247-y · Cited by 96 · see citing works
Deterioration rates in Virtual Reality Therapy: An individual patient data level meta-analysis
Fernández-Álvarez, J., Rozental, A., Carlbring, P., Colombo, D., Riva, G., Anderson, P. L., Baños, R. M., Benbow, A. A., Bouchard, S., Bretón-López, J. M., et al. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.06.005 · Cited by 79 · see citing works
Self-citationLindner, P., Dagöö, J., Hamilton, W., Miloff, A., Andersson, G., Schill, A., & Carlbring, P. (2020) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2020.1795240 · Cited by 84 · see citing works
Self-citationRozental, A., Andersson, G., & Carlbring, P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00589 · Cited by 74 · see citing works
Depression in primary care: part 2—management
Ramanuj, P., Ferenchick, E. K., & Pincus, H. A. (2019) · BMJ · doi:10.1136/bmj.l835 · Cited by 62 · see citing works
Hoffmann, D., Rask, C. U., Hedman-Lagerlöf, E., Jensen, J. S., & Frostholm, L. (2021) · Psychological Medicine · doi:10.1017/s0033291720001312 · Cited by 63 · see citing works
Papaioannou, D. E., Cooper, C. L., Mooney, C., Glover, R., & Coates, E. J. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.002 · Cited by 60 · see citing works
Scheenen, M. E., Visser-Keizer, A. C., de Koning, M. E., van der Horn, H. J., van de Sande, P., van Kessel, M. E., van der Naalt, J., & Spikman, J. M. (2017) · Journal of Neurotrauma · doi:10.1089/neu.2016.4885 · Cited by 51 · see citing works
The evidence base of Acceptance and Commitment Therapy (ACT) in psychosis: A systematic review
Wakefield, S., Roebuck, S., & Boyden, P. (2018) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2018.07.001 · Cited by 49 · see citing works
Maroti, D., Lumley, M. A., Schubiner, H., Lilliengren, P., Bileviciute-Ljungar, I., Ljótsson, B., & Johansson, R. (2022) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2022.111068 · Cited by 40 · see citing works
Palermo, T. M., Slack, K., Loren, D., Eccleston, C., & Jamison, R. N. (2020) · Pain · doi:10.1097/j.pain.0000000000001772 · Cited by 42 · see citing works
Spanhel, K., Hovestadt, E., Lehr, D., Spiegelhalder, K., Baumeister, H., Bengel, J., & Sander, L. B. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.832196 · Cited by 37 · see citing works
Honkalampi, K. M., Urhonen, H.-R., & Virtanen, M. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2301972 · Cited by 36 · see citing works
Afsharnejad, B., Falkmer, M., Black, M. H., Alach, T., Lenhard, F., Fridell, A., Coco, C., Milne, K., Bölte, S., & Girdler, S. J. (2021) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-021-01814-6 · Cited by 35 · see citing works
Eye movement desensitization and reprocessing (EMDR) practitioners’ beliefs about memory.
Houben, S. T. L., Otgaar, H., Roelofs, J., Wessel, I., Patihis, L., & Merckelbach, H. L. G. J. (2019) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000211 · Cited by 33 · see citing works
Bergin, A. D. G., Valentine, A., Rennick-Egglestone, S., Slade, M., Hollis, C., & Hall, C. (2022) · JMIR Mental Health · doi:10.2196/42501 · Cited by 32 · see citing works
Baumeister, H., Bauereiss, N., Zarski, A.-C., Braun, L., Buntrock, C., Hoherz, C., Idrees, A. R., Kraft, R., Meyer, P., Nguyen, T. B. D., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.660534 · Cited by 30 · see citing works
“Additionally, possible negative effects of the psychotherapies are assessed by means of the 20-item version of the Negative Effects Questionnaire [NEQ; 20 items; (90, 91)] which measures the frequency (score range: 0–20) and impact (score range: 0–80) of several different negative effects during the treatment period.”
MethodGerke, L., Meyrose, A.-K., Ladwig, I., Rief, W., & Nestoriuc, Y. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02144 · Cited by 33 · see citing works
Maroti, D., Ek, J., Widlund, R.-M., Schubiner, H. H., Lumley, M. A., Lilliengren, P., Bilevičiūtė-Ljungar, I., Ljótsson, B., & Johansson, R. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.620359 · Cited by 32 · see citing works
Adverse effects of meditation: A review of observational, experimental and case studies
Lambert, D., van den Berg, N. H., & Mendrek, A. (2023) · Current Psychology · doi:10.1007/s12144-021-01503-2 · Cited by 31 · see citing works
Fritz, J. M., Rhon, D. I., Teyhen, D. S., Kean, J. T., Vanneman, M. E., Garland, E. L., Lee, I. E., Thorp, R. E., & Greene, T. (2020) · Pain Medicine · doi:10.1093/pm/pnaa338 · Cited by 31 · see citing works
Bendig, E., Erb, B., Meißner, E., Bauereiß, N., & Baumeister, H. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100377 · Cited by 24 · see citing works
“On the one hand, this result fits literature that shows, that psychological interventions, online and offline, can initially evoke negative effects and symptom deteriorations (Ladwig et al., 2014; Rozental et al., 2016).”
Resultvan de Leur, J. C., Buhrman, M., Åhs, F., Rozental, A., & Jansen, G. B. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02907-3 · Cited by 30 · see citing works
Self-citationContextualizing the negative effects of psychotherapy
Rosendahl, J., Klatte, R., Frenzl, D., Castonguay, L., Vybíral, Z., & Strauss, B. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00472-8 · Cited by 9 · see citing works
Negative Effekte von Psychotherapie: Häufigkeit und Korrelate in einer klinischen Stichprobe
Abeling, B., Müller, A., Stephan, M., Pollmann, I., & de Zwaan, M. (2017) · PPmP - Psychotherapie · Psychosomatik · Medizinische Psychologie · doi:10.1055/s-0043-117604 · Cited by 27 · see citing works
Tauber, N. M., O’Toole, M. S., Jensen, A. B., Butow, P. N., Thewes, B., Elkjær, E., Knutzen, S., von Heymann, A., Johansen, C., & Zachariae, R. (2023) · Psycho-Oncology · doi:10.1002/pon.6193 · Cited by 26 · see citing works
“Possible adverse effects of the intervention were assessed with the Hopelessness and Failure Subscale of the Negative Effects Questionnaire (NEQ).(33) Working alliance and group cohesion were assessed after each session with the Working Alliance Inventory Revised Short Form(34) and the Therapeutic Factors Inventory Co…”
MethodKallestad, H., Vedaa, Ø., Scott, J. L., Morken, G., Pallesen, S., Harvey, A. G., Gehrman, P., Thorndike, F. P., Ritterband, L. M., Stiles, T. C., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-025152 · Cited by 25 · see citing works
Houben, S. T. L., Otgaar, H., Roelofs, J., Smeets, T., & Merckelbach, H. L. G. J. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103546 · Cited by 27 · see citing works
Gullickson, K. M., Hadjistavropoulos, H. D., Dear, B. F., & Titov, N. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100278 · Cited by 26 · see citing works
Wiklund, T., Molander, P., Lindner, P., Andersson, G., Gerdle, B. U. C., & Dragioti, E. (2022) · Journal of Medical Internet Research · doi:10.2196/29258 · Cited by 25 · see citing works
Self-citationAsplund, M., Lenhard, F., Andersson, E., & Ivanov, V. Z. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100573 · Cited by 25 · see citing works
Klein, J. P., Hauer, A., Berger, T., Faßbinder, E., Mayer, J., Borgwardt, S., Wellhöfer, B., Schweiger, U., & Jacob, G. A. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047771 · Cited by 23 · see citing works
Otgaar, H., Houben, S. T. L., Rassin, E., & Merckelbach, H. L. G. J. (2021) · Memory · doi:10.1080/09658211.2021.1966043 · Cited by 22 · see citing works
Munsch, S., Wyssen, A., Vanhulst, P., Lalanne, D., Steinemann, S. T., & Tuch, A. N. (2019) · Trials · doi:10.1186/s13063-019-3192-z · Cited by 21 · see citing works
Mechler, J., Lindqvist, K., Magnusson, K., Ringström, A., Krafman, J. D., Alvinzi, P., Kassius, L., Sowa, J., Andersson, G., & Carlbring, P. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00063-0 · Cited by 20 · see citing works
Self-citationEvaluating the Unified Protocol in the Treatment of Dissociative Identify Disorder
Mohajerin, B., Lynn, S. J., Bakhtiyari, M., & Dolatshah, B. (2019) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2019.07.012 · Cited by 20 · see citing works
Blampied, M., Bell, C., Gilbert, C., & Rucklidge, J. J. (2020) · Expert Review of Neurotherapeutics · doi:10.1080/14737175.2020.1740595 · Cited by 23 · see citing works
Skolasky, R. L., Wegener, S. T., Aaron, R. V., Ephraim, P. L., Brennan, G. P., Greene, T., Lane, E., Minick, K. I., Hanley, A. W., Garland, E. L., et al. (2020) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-020-03324-z · Cited by 19 · see citing works
Predictors and impact of psychotherapy side effects in young adults
Lorenz, T. K. (2020) · Counselling and Psychotherapy Research · doi:10.1002/capr.12356 · Cited by 19 · see citing works
Niemeyer, H., Knaevelsrud, C., Schumacher, S., Engel, S., Kuester, A., Burchert, S., Muschalla, B., Weiss, D., Spies, J., Rau, H., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02595-z · Cited by 20 · see citing works
Lodewyk, K., Bagnell, A. L., Courtney, D., & Newton, A. S. (2023) · Child and Adolescent Mental Health · doi:10.1111/camh.12661 · Cited by 18 · see citing works
Moyes, E., Nutman, G., & Mirman, J. H. (2022) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-022-00454-5 · Cited by 19 · see citing works
Schubert, K., Lohse, J., Kalder, M., Ziller, V., & Weise, C. (2022) · Trials · doi:10.1186/s13063-022-06204-0 · Cited by 17 · see citing works
Verkooyen, R., Broers, N. J., & Dandachi-FitzGerald, B. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1378456 · Cited by 18 · see citing works
Vernmark, K., Buhrman, M., Carlbring, P., Hedman‐Lagerlöf, E., Kaldo, V., & Andersson, G. (2024) · Digital Health · doi:10.1177/20552076241287059 · Cited by 19 · see citing works
Self-citationDietrichkeit, M., Hagemann-Goebel, M., Nestoriuc, Y., Moritz, S., & Jelinek, L. (2021) · Scientific Reports · doi:10.1038/s41598-021-87198-8 · Cited by 16 · see citing works
Dissociative identity disorder: validity and use in the criminal justice system
Paris, J. (2019) · BJPsych Advances · doi:10.1192/bja.2019.12 · Cited by 15 · see citing works
Kocur, M., Dechant, M., Wolff, C., Nothdurfter, C., Wetter, T. C., Rupprecht, R., & Shiban, Y. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.608997 · Cited by 15 · see citing works
Dahlin, M., Johansson, A., Romare, H., Carlbring, P., & Andersson, G. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100531 · Cited by 15 · see citing works
Self-citationSundell, K., & Olsson, T. (2017) · Oxford Bibliographies in Social Work · doi:10.1093/obo/9780195389678-0254 · Cited by 21 · see citing works
Dandachi‐FitzGerald, B., Houben, S. T. L., Broers, N. J., & Merckelbach, H. L. G. J. (2024) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.3014 · Cited by 15 · see citing works
Jensen, K. H. R., Dam, V. H., Ganz, M., Fisher, P. M., Ip, C.-T., Sankar, A., Marstrand-Joergensen, M. R., Ozenne, B., Osler, M., Penninx, B. W. J. H., et al. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-04618-x · Cited by 16 · see citing works
Rubel, J. A., Väth, T., Hanraths, S., Pruessner, L., Timm, C., Hartmann, S. F., Barnow, S., & Lalk, C. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100716 · Cited by 15 · see citing works
Bech, P., Lindberg, L., & Møeller, S. B. (2018) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2018.1463393 · Cited by 15 · see citing works
Afsharnejad, B., Falkmer, M., Black, M. H., Alach, T., Lenhard, F., Fridell, A., Coco, C., Milne, K., Chen, N. T. M., Bölte, S., et al. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04477-5 · Cited by 14 · see citing works
Mathiesen, A. S., Zoffmann, V., Skytte, T. B., Jakobsen, J. C., Gluud, C. N., Lindschou, J., Rasmussen, B., Marqvorsen, E. H. S., Thomsen, T., & Rothmann, M. J. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047037 · Cited by 13 · see citing works
Negative effects during multicomponent group-based treatment: A multisite study
Pourová, M., Řiháček, T., Chvála, Ľ., Vybíral, Z., & Boehnke, J. R. (2022) · Psychotherapy Research · doi:10.1080/10503307.2022.2095237 · Cited by 14 · see citing works
Spada, F., Caruso, R., Maria, M. D., Karma, E., Oseku, A., Pata, X., Prendi, E., Rocco, G., Notarnicola, I., & Stievano, A. (2022) · Healthcare · doi:10.3390/healthcare10091698 · Cited by 14 · see citing works
Patient experience of supported computerized CBT in an inner-city IAPT service: a qualitative study
Perera-Delcourt, R. P., & Sharkey, G. (2019) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x18000284 · Cited by 14 · see citing works
Olsen, M. H., Morthorst, B., Pagsberg, A., Heinrichsen, M., Møhl, B., Rubæk, L., Bjureberg, J., Simonsson, O., Lindschou, J., Gluud, C., et al. (2021) · Trials · doi:10.1186/s13063-021-05406-2 · Cited by 9 · see citing works
Watson, P., Leroux, E. J., Chowdhury, M., Mehra, K., Henderson, J. L., Szatmári, P., & Hawke, L. D. (2022) · Journal of Child and Family Studies · doi:10.1007/s10826-022-02431-w · Cited by 12 · see citing works
Is psychotherapy for functional somatic syndromes harmful? A mixed methods study on negative effects
Holsting, A. F., Pedersen, H. F., Rask, M. T., Frostholm, L., & Schröder, A. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.05.010 · Cited by 13 · see citing works
Gaps in measures of adverse outcomes relating to psychological interventions
McIntosh, L. G., McMurran, M., Taylor, P. J., & Thomson, L. D. G. (2019) · Criminal Behaviour and Mental Health · doi:10.1002/cbm.2100 · Cited by 12 · see citing works
Morthorst, B., Olsen, M. H., Jakobsen, J., Lindschou, J., Gluud, C., Heinrichsen, M., Møhl, B., Rubæk, L., Ojala, O., Hellner, C., et al. (2022) · JCPP Advances · doi:10.1002/jcv2.12115 · Cited by 13 · see citing works
Kalde, J., Atik, E., Stricker, J. H., Schückes, M., Neudeck, P., Pittig, A., & Pietrowsky, R. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2277866 · Cited by 12 · see citing works
Lindgren, A., & Rozental, A. (2021) · Ethics & Behavior · doi:10.1080/10508422.2021.1948855 · Cited by 12 · see citing works
Self-citationBerman, A. H., Topooco, N., Lindfors, P., Bendtsen, M., Lindner, P., Molander, O., Kraepelien, M., Sundström, C., Talebizadeh, N., Engström, K., et al. (2024) · Trials · doi:10.1186/s13063-024-07986-1 · Cited by 9 · see citing works
“Adverse events and harms during the RCT are measured with the Negative Experiences Questionnaire (NEQ), [61], and trial safety procedures include monitoring of symptom levels.”
MethodSelf-citationHooi, L. Y., Chen, P. L., Tan, K. W., de Vries, M., & Wong, H. K. (2025) · Scientific Reports · doi:10.1038/s41598-025-23727-z · Cited by 17 · see citing works
Harrison, G. J., & Pooe, D. R. I. (2022) · Acta Commercii · doi:10.4102/ac.v22i1.989 · Cited by 11 · see citing works
Wallsten, D., Norell‐Clarke, A., Anniko, M. K., Eriksson, O., Lamourín, V., Halldin, I., Kindbom, T., Hesser, H., Watkins, E. R., & Tillfors, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1196945 · Cited by 11 · see citing works
Side Effects in Psychodynamic and Cognitive Behavior Therapy
Balder, T., Linden, M., & Rose, M. (2024) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-023-09615-5 · Cited by 12 · see citing works
Shared reading as an intervention to improve health and well-being in adults: a scoping review
Järvholm, K., Ohlsson, A., Bernhardsson, K., Gustafsson, A. W., Johnsson, P., Malmström, M., Wistrand, J., & Forslid, T. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1484839 · Cited by 11 · see citing works
Klein, J. P., Hauer, A., Berger, T., Faßbinder, E., Schweiger, U., & Jacob, G. A. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00439 · Cited by 11 · see citing works
Wahlund, T., Jolstedt, M., Andersson, E., Vigerland, S., Perrin, S. G., Öst, L., Högström, J., & Serlachius, E. (2020) · mHealth · doi:10.21037/mhealth.2019.09.10 · Cited by 12 · see citing works
Zeevenhooven, J., Timp, M. L., Singendonk, M. M. J., Benninga, M. A., & Tabbers, M. M. (2019) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2019.04.048 · Cited by 11 · see citing works
KONTAKT© for Australian adolescents on the autism spectrum: protocol of a randomized control trial
Afsharnejad, B., Falkmer, M., Black, M. H., Alach, T., Lenhard, F., Fridell, A., Coco, C., Milne, K., Chen, N. T. M., Bölte, S., et al. (2019) · Trials · doi:10.1186/s13063-019-3721-9 · Cited by 11 · see citing works
School-based social skills group training (SKOLKONTAKT™): a pilot randomized controlled trial
Fridell, A., Coco, C., Borg, A., & Bölte, S. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1128288 · Cited by 10 · see citing works
Taher, R., Bhanushali, P., Allan, S., Álvarez‐Jiménez, M., Bolton, H., Dennison, L., Wallace, B. E., Hadjistavropoulos, H. D., Hall, C. L., Hardy, A., et al. (2024) · BJPsych Open · doi:10.1192/bjo.2024.713 · Cited by 10 · see citing works
Schulte, C. E., Sachser, C., Rosner, R., Ebert, D. D., & Zarski, A. (2024) · European Journal of Psychotraumatology · doi:10.1080/20008066.2024.2364469 · Cited by 9 · see citing works
Saur, S., Weisel, K. K., Lang, C., Fuhrmann, L. M., Steins‐Loeber, S., Enewoldsen, N., Reichl, D., Zink, M., Jakobi, F., Rudolph, M., et al. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100517 · Cited by 11 · see citing works
Distance supervision in the Aiglé Foundation's Latin American Psychotherapy Training Program
Fernández‐Álvarez, H., Grazioso, M. D. P., & Kirszman, D. (2018) · Journal of Clinical Psychology · doi:10.1002/jclp.22721 · Cited by 9 · see citing works
Rautio, D., Andrén, P., Gumpert, M., Jolstedt, M., Jassi, A. D., Krebs, G., Jansson‐Fröjmark, M., Lundgren, T., Serlachius, E., Mataix‐Cols, D., et al. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100688 · Cited by 9 · see citing works
Morthorst, B., Rubæk, L., Lindschou, J., Jakobsen, J., Gluud, C., Bjureberg, J., Hellner, C., Møhl, B., & Pagsberg, A. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00785-4 · Cited by 8 · see citing works
Beiner, E., Baumeister, D., Buhai, D.-V., Löffler, M., Löffler, A., Schick, A., Ader, L., Eich, W., Sirazitdinov, A., Malone, C., et al. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01199-6 · Cited by 9 · see citing works
Axelsson, E., & Hedman-Lagerlöf, E. (2023) · Expert review of pharmacoeconomics & outcomes research · doi:10.1080/14737167.2023.2250915 · Cited by 7 · see citing works
Shahidi, S., Zargar, F., Khajelangi, H. A., & Tarrahi, M. J. (2023) · PubMed Central · doi:10.30476/ijcbnm.2023.97271.2172 · Cited by 8 · see citing works
Geurtzen, N., Keijsers, G. P. J., Karremans, J. C., & Hutschemaekers, G. J. M. (2018) · Journal of Psychotherapy Integration · doi:10.1037/int0000150 · Cited by 8 · see citing works
Melvin, G. A., Finnin, L., Taffe, J. R., Dudley, A. L., Klimkeit, E., Gordon, M. S., & Tonge, B. J. (2019) · Clinical Child Psychology and Psychiatry · doi:10.1177/1359104518822681 · Cited by 9 · see citing works
Strålin, E. E., Thorell, L. B., Szybek, K., Lundgren, T., Bölte, S., & Bohman, B. (2022) · Nordic Psychology · doi:10.1080/19012276.2021.2020683 · Cited by 8 · see citing works
- Authors
- Rozental, A., Kottorp, A., Boettcher, J., Andersson, G., & Carlbring, P.
- Affiliations
- Stockholm University (SE)
- Karolinska Institutet (SE)
- Freie Universität Berlin (DE)
- Linköping University (SE)
- Corresponding author
- Rozental, Alexander
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-22
- Volume
- 11
- Issue
- 6
- Pages
- e0157503
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4917117
- OpenAlex
- W2472395746
- Cited by
- 223
- References
- 94
- Citations by year
- 2026: 23 · 2025: 39 · 2024: 23 · 2023: 27 · 2022: 31 · 2021: 20 · 2020: 16 · 2019: 25 · 2018: 12 · 2017: 6 · 2016: 1
- FWCI
- 19.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DiVA (Linkoping University) (submittedVersion, other-oa)
- Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Refubium (Universitätsbibliothek der Freien Universität Berlin) (submittedVersion, cc-by)
- ZHAW Digital Collection (cc-by)
- Funders
- FORTE (FORTE 2013-1107)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- adverse events, unwanted events, self-report instrument development, social anxiety disorder, symptom deterioration, treatment quality, therapeutic relationship, stigma, hopelessness, factor structure
- MeSH terms
- Adult, Mental Disorders, Demography, Factor Analysis, Statistical, Female, Humans, Male, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review