The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
The Negative Effects Questionnaire: psychometric properties of an instrument for assessing negative effects in psychological treatments
Open accessAbstract
Background: Psychological treatments provide many benefits for patients with psychiatric disorders, but research also suggests that negative effects might occur from the interventions involved. The Negative Effects Questionnaire (NEQ) has previously been developed as a way of determining the occurrence and characteristics of such incidents, consisting of 32 items and six factors. However, the NEQ has yet to be examined using modern test theory, which could help to improve the understanding of how well the instrument works psychometrically. Aims: The current study investigated the reliability and validity of the NEQ from both a person and item perspective, establishing goodness-of-fit, item bias, and scale precision. Method: The NEQ was distributed to 564 patients in five clinical trials at post-treatment. Data were analysed using Rasch analysis, i.e. a modern test theory application. Results: (1) the NEQ exhibits fairness in testing across sociodemographics, (2) shows comparable validity for a final and condensed scale of 20 instead of 32 items, (3) uses a rating scale that advances monotonically in steps of 0 to 4, and (4) is suitable for monitoring negative effects on an item-level. Conclusions: The NEQ is proposed as a useful instrument for investigating negative effects in psychological treatments, and its newer shorter format could facilitate its use in clinical and research settings. However, further research is needed to explore the relationship between negative effects and treatment outcome, as well as to test it in more diverse patient populations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The 20-item version has demonstrated satisfactory psychometric properties [52].”
From Internet-Delivered Therapy for Parents With Health Anxiety by Proxy: Protocol for a Single-Case Experimental Design Study (2023) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“The internal consistency for the full instrument is excellent (Cronbach's α = 0.95), and is scored on several dimensions; 1) “Did you experience this?” (yes/no), 2) “If yes – here is how negatively it affected me”, from 0 (“Not at all”) to 4 (“Extremely”), and 3) “Probably caused by” (“The treatment I received” or “Other circumstances”).”
From A study protocol of a randomized controlled study of internet-based cognitive behavioral therapy for adult attention deficit hyperactivity disorder (2023) · cites this paper as Rozental et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“The 20-item NEQ shows comparable validity to the original 32-item version.”
From Efficacy of an internet-based psychological intervention for problem gambling and gambling disorder: Study protocol for a randomized controlled trial (2021) · cites this paper as Rozental et al., 2019
In the citing paper
“Negative treatment effects are here assessed post-treatment using the negative effects questionnaire (NEQ), a tool with reliable and valid psychometrics.74”
From Development, evaluation and implementation of a digital behavioural health treatment for chronic pain: study protocol of the multiphase DAHLIA project (2022) · cites this paper as [74]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“Several secondary outcome measures were also administered; the Patient Health Questionnaire – 9 items (PHQ-9; Löwe et al., 2004), the Generalized Anxiety Disorder – 7 items (GAD-7; Spitzer et al., 2006), and the Brunnsviken Brief Quality of Life Scale (BBQ; Lindner et al., 2016).”
MethodLovibond, P. F., & Lovibond, S. H. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)00075-u · Cited by 14,523 · cited 2×
“A similar study was conducted using Rasch analysis for the Depression, Anxiety and Stress Scales (Lovibond and Lovibond, 1995), suggesting that a number of items could be removed and that it was not supported as a general instrument for mental distress (Shea et al.”
MethodApplying the Rasch Model: Fundamental Measurement in the Human Sciences
Bond, T. G., & Fox, C. M. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01103.x · Cited by 4,490
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445 · cited 1×
“Research on the efficacy of evidencebased approaches, such as cognitive behaviour therapy (CBT), suggest that a large number of patients improve thanks to the interventions they receive (Hofmann et al., 2012).”
BackgroundA Rating Formulation for Ordered Response Categories
Andrich, D. (1978) · Psychometrika · doi:10.1007/bf02293814 · Cited by 2,984 · cited 1×
“This can be helpful for identifying abnormal responses that might warrant further development of the instrument (Andrich, 1978).”
BackgroundChi-Square Tests with One Degree of Freedom; Extensions of the Mantel- Haenszel Procedure
Mantel, N. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10500879 · Cited by 2,899 · cited 1×
“The magnitude of DIF was evaluated using the Mantel-Haenszel statistic for polytomous scales using log-odds estimators (Mantel, 1963).”
MethodSummated Rating Scale Construction
Spector, P. E. (1992) · Sage eBooks · doi:10.4135/9781412986038 · Cited by 2,173 · cited 1×
“This converted item measure is then applied to determine whether they are scored on a similar unidimensional construct, which is often viewed as crucial in terms of validity in both classical and modern test theory (Spector, 1992).”
MethodKrosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852 · cited 1×
“It is possible that the negative effects that were reported were affected by recall bias, primacy-recency effects, and social desirability (Krosnick, 1999), resulting in less valid responses.”
BackgroundLöwe, B., Kroenke, K., Herzog, W., & Gräfe, K. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(03)00198-8 · Cited by 1,558 · cited 2×
“Several secondary outcome measures were also administered; the Patient Health Questionnaire – 9 items (PHQ-9; Löwe et al., 2004), the Generalized Anxiety Disorder – 7 items (GAD-7; Spitzer et al., 2006), and the Brunnsviken Brief Quality of Life Scale (BBQ; Lindner et al., 2016).”
MethodThe psychotherapeutic process: A research handbook.
Greenberg, L. S., & Pinsof, W. M. (1986) · Cited by 1,386
Research works printed but not linked: 4
- 10.1037/0003-066X.32.3.187 · DOI
- Fisher, 1992, Reliability, separation, strata statistics, Rasch Measurement Transactions, 6, 238
- Linacre, 2005, Rasch dichotomous model vs. one-parameter logistic model, Rasch Measurement Transactions, 19, 1032
- Raîche, 2005, Critical eigenvalue sizes in standardized residual principal components analysis, Rasch Measurement Transactions, 19, 1012
Cited by
Sorted by citations
Items 101–200 of 230
Pagsberg, A. K., Lønfeldt, N. N., Thoustrup, C. L., Korsbjerg, N. L. J., Uhre, C. F., Christensen, S. H., Uhre, V., Mora‐Jensen, A. C., Ritter, M., Pretzmann, L., et al. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-025-02797-4 · Cited by 4
“Moreover, although the NEQ is validated for assessing adverse events in psychotherapy trials [43], it has not yet been validated in youth.”
Kooij, L. H., Hein, I. M., Bouwmeester, S., & Lindauer, R. (2025) · European Journal of Psychotraumatology · doi:10.1080/20008066.2025.2538355 · Cited by 4
“However, psychometric validation in a Dutch, and in a youth sample is still lacking, and results should be interpreted with caution (Rozental et al., 2019).”
Rozental, A., Shafran, R., Johansson, F., Forsström, D., Jovicic, F., Gelberg, O., Molin, K., Carlbring, P., Andersson, G., & Buhrman, M. (2024) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2024.2327339 · Cited by 7
“Meanwhile, the NEQ has been used to assess the incidence and impact of negative effects during treatment, but has mainly been reported descriptively, while the association with other outcome measures is unclear (Rozental et al., 2019).”
MethodSelf-citationHauschild, S., Taubner, S., Blachowiak, T. V., Dinger, U., Gündel, H., Herpertz, S. C., Rademacher, J., Strauss, B. M., Storck, T., Vassileva, R., et al. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06809-0 · Cited by 5
“The internal consistency of the original instrument is excellent ( α = 0.95) with reliabilities of the specific factors ranging from α = 0.72 to α = 0.93 [110].”
InfluentialFeasibility trial of a self-help digital intervention for functional cognitive disorder
Cabreira, V., Frostholm, L., Stone, J., & Carson, A. J. (2025) · Brain Communications · doi:10.1093/braincomms/fcaf248 · Cited by 4
“Unwanted effects of the intervention were evaluated using the 20-item Negative Effects Questionnaire, 35 aiming for total number of negative effects reported by all the participants/total number of negative effects possible ≤ 10%.”
Sauer, K. S., Bailer, J., Jungmann, S. M., & Witthöft, M. (2023) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2022.08.001 · Cited by 3
Ingeman, K., Frostholm, L., Wellnitz, K. B., Wright, K., Frydendal, D. H., Onghena, P., & Rask, C. U. (2023) · JMIR Research Protocols · doi:10.2196/46927 · Cited by 3
“The 20-item version has demonstrated satisfactory psychometric properties [52].”
Lao, U., Zhu, H., Liang, F., Bai, E. W., Yin, P., Huang, X., Girdler, S. J., Bölte, S., & Zou, X. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-081827 · Cited by 3
“…homework completion rates, Group Session Rating Scale, 59 Theoretical Framework of Acceptability Questionnaire 60 and Negative Effects Questionnaire 61 ) and qualitative data from focus groups with both participants and providers conducted after intervention (ITG: post-training (T3) and follow-up…”
Ejdemyr, I., Sundqvist, R., Bjureberg, J., Birgegård, A., Jokinen, J., Levallius, J., Gilbert, K., & Sjögren, M. (2025) · Eating Disorders · doi:10.1080/10640266.2025.2524215 · Cited by 4
Andresen, J., Jeppesen, A. C. E., Due, A. S., Mariegaard, L. S., Parvaiz, R., Hjorthøj, C. R., Pinkham, A. E., Nordentoft, M., Letnar, G., Jepsen, J. R. M., et al. (2025) · JMIR Research Protocols · doi:10.2196/72854 · Cited by 3
“…the Client Satisfaction Questionnaire (CSQ) [79] to assess satisfaction with the assigned intervention; the Negative Effects Questionnaire (NEQ) [80] to assess negative events and outcomes; (2) the Multimodal Presence Scale, Modified Shortened Danish Version (MPS-MSDV) [81] to assess…”
Ten Concerns About Volitional Personality-Change Interventions—and How to Address Them
Haehner, P., Asselmann, E., Baumgardt, S., Brüggmann, L., Denissen, J. J. A., Harzer, C., Juchem, C. M., Krämer, M. D., Kuper, N., Puhlmann, L. M. C., et al. (2026) · Perspectives on Psychological Science · doi:10.1177/17456916261466950 · Cited by 3
Giguère, S., Potvin, S., Fortier, A., Phraxayavong, K., Lespérance, F., Do, A., Bahremand, A., & Dumais, A. (2026) · Psychiatry Research · doi:10.1016/j.psychres.2026.117080 · Cited by 4
Andersson, R., Vigerland, S., Lenhard, F., Åhlén, J., Bottai, M., Mataix‐Cols, D., & Serlachius, E. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-083507 · Cited by 3
“The 20-item Negative Effects Questionnaire will be used to investigate participants’ negative effects of psychological treatments 56 (total range 0–80, higher values represent more negative effects).”
Löthberg, M., Meyer, J., Niman, A., Berggren, S., Hirvikoski, T., Bölte, S., & Jonsson, U. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2459889 · Cited by 4
“An internal consistency of α = 0.95 has been reported for the full instrument [55].”
InfluentialSimon, L., Terhorst, Y., Küchler, A., Riemann, D. W., Ebert, D. D., Rozental, A., Spiegelhalder, K., & Baumeister, H. (2025) · Sleep Medicine · doi:10.1016/j.sleep.2025.02.044 · Cited by 3
Self-citationOscarsson, M., Hammarbäck, S., Wiberg, K. B., Rozental, A., Ginsberg, Y., Carlbring, P., Andersson, G., & Jönsson, F. U. (2025) · JMIR Formative Research · doi:10.2196/66388 · Cited by 5
“The Negative Effects Questionnaire (NEQ-20 [46]) was used to explore negative effects and adverse events.”
Self-citationDigital Psychological Intervention for Inflammatory Rheumatic Diseases
Knitza, J., Kraus, J., Krusche, M., Haase, I., Klemm, P., Hueber, A. J., Pfeil, A., Drott, U., Kühn, S., & Klein, J. P. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.29892 · Cited by 3
Prado, A. D. S., Kohls, E., Baldofski, S., Rummel‐Kluge, C., & Freitas, J. D. L. (2023) · JMIR Formative Research · doi:10.2196/44887 · Cited by 3
“Potential negative outcomes were measured using the short version (20 items) of the NEQ [58,59], which investigates the occurrence and characteristics of negative effects of psychological treatments on 6 derived factors: symptoms, quality, dependency, stigma, hopelessness, and failure.”
BackgroundMethodResultInfluentialWahab, A. A., Hasibuan, A., Siregar, R., Risnawaty, & Ningsih, T. Z. (2023) · Journal of Education Research and Evaluation · doi:10.23887/jere.v7i3.59239 · Cited by 3
“Test results between participants cannot be reliably compared if the ratio of item difficulty levels does not match (Din, 2020; Rozental et al., 2019).”
BackgroundArvidson, E., Hofstedt, A., & Gordh, A. S. (2025) · Trials · doi:10.1186/s13063-025-09147-4 · Cited by 3
“The reliability has been shown to be good, with a Cronbach´s alpha of 0.95 [57].”
InfluentialBragesjö, M., Fina, B. A., Ivanova, E. N., Ivanov, V. Z., & Rück, C. (2024) · Trials · doi:10.1186/s13063-024-08218-2 · Cited by 2
“The Negative Effects Questionnaire (NEQ; [21]) will be used to capture potential adverse events immediately after treatment completion and the upcoming assessment points.”
MethodMolander, O., Kolaas, K., Jayaram‐Lindström, N., Pontén, M., Särnholm, J., & Bragesjö, M. (2025) · European Journal of Psychotraumatology · doi:10.1080/20008066.2025.2520637 · Cited by 2
“Adverse events were systematically monitored using the Negative Effects Questionnaire (NEQ; Rozental et al., 2019), which defines adverse events as self-perceived unwanted or negative experiences during treatment, independent of clinical expectations.”
Astenvald, R., Isaksson, M., Meyer, J., Lööf, M., Frick, M. A., & Isaksson, J. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2537812 · Cited by 3
“The original versions of the NEQ have demonstrated a solid factor structure (Rozental et al., 2016, 2019).”
Ingeman, K., Frydendal, D. H., Frostholm, L., Bjerre-Nielsen, E., Wellnitz, K. B., Onghena, P., Wright, K. D., & Rask, C. U. (2025) · JMIR Formative Research · doi:10.2196/65396 · Cited by 1
“…at the end of treatment: (1) The Negative Effects Questionnaire-20 (NEQ), which measured factors related to negative effects of the treatment [49]; (2) the Internet Evaluation and Utility Questionnaire (IEUQ), which was used to evaluate experience of receiving internet-delivered treatment…”
Aminoff, V., Bielinski, L. L., Berg, M., Berger, T., & Andersson, G. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100875 · Cited by 1
Self-citationNegative events in psychotherapy: A narrative review
Ram, D., Manjunatha, N., & Math, S. B. (2026) · Industrial Psychiatry Journal · doi:10.4103/ipj.ipj_114_25 · Cited by 3
Digital acceptance and commitment therapy for the treatment of chronic pain
Etzelmueller, A., Barke, A., Feiler, M., Guth, M., Heber, E., Baumeister, H., & Ebert, D. D. (2026) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.m2025.0239 · Cited by 3
Mindful Self-Compassion for Infertility-Related Distress: A Single-Group Intervention Study
Halleran, M., Balsom, A. A., & Gordon, J. L. (2026) · Journal of Integrative and Complementary Medicine · doi:10.1177/27683605261427699 · Cited by 3
“35 The measure uses a yes/no scale and contains four items.”
Tiba, A., Drugas, M. I., Sîrbu, I., Trip, S., Bora, C. H., & Voss, L. (2026) · Behaviour Research and Therapy · doi:10.1016/j.brat.2026.105025 · Cited by 2
Pretzmann, L., Christensen, S. H., Christensen, A. B., Uhre, C. F., Uhre, V., Thoustrup, C. L., Clemmesen, I. T., Gudmandsen, T. A., Korsbjerg, N. L. J., Mora‐Jensen, A. C., et al. (2023) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2023.101173 · Cited by 2
“The NEQ is the only instrument in Danish with published psychometric properties to monitor adverse events in psychotherapy [9,38].”
BackgroundSelf-citationHuang, X., Chen, Y., Luo, J., Wang, D., Yang, C., Luo, W., & Zhou, Y. (2024) · PLoS ONE · doi:10.1371/journal.pone.0304084 · Cited by 3
Skaarnes, H., Sørensen, N. M., Wisnewski, A. H., Lomholt, J. J., Thastum, M., McLellan, L. F., & Mathiasen, K. (2024) · Trials · doi:10.1186/s13063-024-08511-0 · Cited by 3
“Negative Effect Questionnaire (NEQ) [60] is a 20-item questionnaire used to monitor the occurrence of negative effects in psychological treatments.”
BackgroundFeasibility of trauma-focused cognitive behavioural therapy for patients with PTSD and psychosis
Buhmann, C., Mortensen, E. L., Græbe, F. L., Larsen, S. K., Harder, S. K., Arnfred, S., & Austin, S. F. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1375972 · Cited by 3
Ottergård, M.-L. H., Pretzmann, L., Lundgren, T., McCracken, L. M., Buhrman, M., Molander, P., & Rozental, A. (2025) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2025.100914 · Cited by 2
“The NEQ has been tested using both classical and modern test theory approaches on data from clinical trials and surveys (Rozental et al., 2019), and is one of the most widely used measures on UE (Jeckel et al., 2024).”
Self-citationFenski, F., Heinrich, M., Schaeuffele, C., Zagorscak, P., Knaevelsrud, C., & Boettcher, J. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2565674 · Cited by 2
Self-citationBoettcher, J., Heinrich, M., Boettche, M., Burchert, S., Glaesmer, H., Gouzoulis‐Mayfrank, E., Heeke, C., Hernek, M., Knaevelsrud, C., Konnopka, A., et al. (2024) · Trials · doi:10.1186/s13063-023-07845-5 · Cited by 1
Self-citationMathiesen, A. S., Zoffmann, V., Lindschou, J., Jakobsen, J. C., Gluud, C. N., Olsen, M. H., Rasmussen, B., Marqvorsen, E. H. S., & Rothmann, M. J. (2024) · Trials · doi:10.1186/s13063-024-08589-6 · Cited by 1
Persson, A., Finn, D. W., Broberg, A., Westerberg, A., Magnusson, Å., & Molander, O. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1473988 · Cited by 1
Irniger, C., Vetter, J., Mürner, F., Weidt, S., Seifritz, E., Holtforth, M. G., & Krähenmann, R. (2025) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2025.100909 · Cited by 1
Charalampopoulou, Μ., Ibrahim, A. T., Prime, H., Eddy, N., Panetta, L., Brown, H. M., Desai, S., Gray, K. M., Lai, M., Langdon, P. E., et al. (2025) · Autism · doi:10.1177/13623613251359196 · Cited by 2
“Negative Effects Questionnaire (NEQ; Rozental et al., 2019): The 20-item NEQ was used to assess participants’ experiences of 20 adverse outcomes during their participation in TP. Negative effects were categorized into one of five factors: symptoms, quality, stigma, hopelessness, and dependency.”
Cognitive analytic therapy‐guided self‐help for depression: A mixed methods evaluation
Kelly, R. E., Kellett, S., Simmonds‐Buckley, M., & Power, N. (2025) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.70008 · Cited by 1
“Furthermore, the burden of CAT-GSH needs to be better considered, and future evaluations should also include measures of possible negative intervention effects (e.g., the Negative Effects Questionnaire; Rozental et al., 2019).”
Streit, H., Merkt, L., Reindl, M., Zeder, J., & Berking, M. (2026) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2607746 · Cited by 1
“Adverse events were assessed at T2 and T3 with an adapted version of the Negative Effects Questionnaire (NEQ (Rozental et al., 2019)).”
Do Cyberbullies Develop Depressive Symptoms? A Longitudinal Multi-Study
Bansal, S., Garg, N., & Singh, J. (2026) · Basic and Applied Social Psychology · doi:10.1080/01973533.2026.2625487 · Cited by 2
“In both studies, the CA and CR values for HCA, GCC, overall CBAS, PHQ-9, NEQ, and TRGI exceeded the required threshold limit of 0.70, establishing their reliability (please refer to Table 2).”
InfluentialMolander, O., Johnsson, A., Bjureberg, J., Jayaram‐Lindström, N., Dowling, N. A., & Ljótsson, B. (2026) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2026.2639523 · Cited by 2
Wardęszkiewicz, J., Holas, P., & Andersson, G. (2026) · Mindfulness · doi:10.1007/s12671-026-02778-x · Cited by 4
Self-citationMaroti, D., Ljungdahl, M., Petersen, H., Rööst, M., Lumley, M. A., Falkenström, F., & Lilliengren, P. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100942 · Cited by 2
Pain reprocessing therapy in adults with chronic widespread pain: A pilot randomized clinical trial
Sit, R. W. S., Chan, C. Y.-K., Fong, H. P.-Y., Fung, C. L.-C., & Wong, S. Y. S. (2026) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2026.112688 · Cited by 1
Quality Assurance in Outpatient Psychotherapy
Volz, M., Benecke, C., & Cropp, C. (2026) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000874 · Cited by 1
Pantić, M., Rančić, N., Djoković, D., & Mihajlović, G. (2022) · Vojnosanitetski pregled · doi:10.2298/vsp211220037p · Cited by 1
Nielsen, S. S., Mikkelsen, L. J., Quaade, N., Gladstone, T. R. G., Beardslee, W. R., Bonnemose, K., Rosenberg, N., Hjorthøj, C. R., Thorup, A. A. E., Nordentoft, M., et al. (2023) · Trials · doi:10.1186/s13063-023-07256-6 · Cited by 1
“…the Working Alliance Inventory (WAI-SR) [37], the Client Satisfaction Questionnaire (CSQ-8) [38] and the Negative Effects Questionnaire (NeQ) [39], number of days the child was absent from school (information will be obtained from registry and parents’ report), the Family Assessment Device…”
BackgroundTiba, A., Drugas, M. I., Sârbu, I., Trip, S., Bora, C. H., Miclăuș, D., Manea, L., Sanislav, I., & Ciurescu, D. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288910 · Cited by 3
Psychological Treatment in the Family Format
Carr, A. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00198-9 · Cited by 1
Schaeuffele, C., Heinrich, M., Behr, S., Fenski, F., Hammelrath, L., Zagorscak, P., Jansen, A., Pohl, S., Boettcher, J., & Knaevelsrud, C. (2022) · doi:10.31234/osf.io/ugwsx · Cited by 1
Self-citationWardęszkiewicz, J., Holas, P., & Andersson, G. (2025) · Research Square · doi:10.21203/rs.3.rs-7166236/v1 · Cited by 1
Self-citationBehandlungsschwierigkeiten bei geleiteter Online-Therapie
Bär, J., Ziehn, P., Ewert-Altenhain, D., Seidl, L., Schaeuffele, C., & Boettcher, J. (2021) · Psychotherapeut · doi:10.1007/s00278-021-00522-5
Self-citation“First do no harm” the side effect profile of psychotherapeutic treatments
Redyk, R. (2020) · eSource (Dublin Business School)
Леонидовна, К. М. (2013) · Вестник Санкт-Петербургского государственного университета культуры и искусств
Risiken und Nebenwirkungen psychotherapeutischer Behandlungen
Strauss, B. M. (2022) · NeuroTransmitter · doi:10.1007/s15016-021-9345-9
Negative effects of low intensity interventions in children and young people
Rozental, A. (2022) · doi:10.1093/med-psych/9780198867791.003.0006
Self-citationPersson, A., Finn, D. W., Broberg, A., Westerberg, A., Magnusson, Å., & Molander, O. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4192944
Tiba, A., Sîrbu, I., Drugas, M. I., Bora, C. H., Miclăuș, D., & Voss, L. (2022) · doi:10.31234/osf.io/w4z9e
Lao, U., Zhu, H., Liang, F., Bai, E. W., Yin, P., Huang, X., Girdler, S. J., Bölte, S., & Zou, X. (2023) · medRxiv · doi:10.1101/2023.10.30.23296686
Mathiesen, A. S., Zoffmann, V., Lindschou, J., Jakobsen, J. C., Gluud, C. N., Olsen, M. H., Rasmussen, B., Marqvorsen, E. H. S., & Rothmann, M. J. (2024) · Research Square · doi:10.21203/rs.3.rs-3669654/v1
Böge, K., Bergmann, N., Hahne, I., Emde, L., Cartner, S., Bell, I. H., Pillny, M., & Thomas, N. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5013762
Andresen, J., Jeppesen, A. C. E., Due, A. S., Mariegaard, L. S., Parvaiz, R., Hjorthøj, C. R., Pinkham, A. E., Nordentoft, M., Jepsen, J. R. M., & Glenthøj, L. B. (2025) · doi:10.2196/preprints.72854
Ardianti, R., Razak, A., Alberida, H., Fadilah, M., & Sari, M. (2024) · Journal of Education Research and Evaluation · doi:10.23887/jere.v8i4.84026
“Such items can negatively impact the overall quality of the instrument (Azzarkasyi et al., 2019; Rozental et al., 2019).”
Platt, B., Löchner, J., Danzer, V., Geissler, S. S., Frey, M., Compas, B. E., Schuler, C., Graf, P., Wiegand‐Grefe, S., & Schulte-Körne, A. G. (2025) · Kindheit und Entwicklung · doi:10.1026/0942-5403/a000470
Sørensen, N. M., Skaarnes, H., Mathiasen, K., McLellan, L. F., Thastum, M., & Lomholt, J. J. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2522995 · Cited by 2
“The NEQ shows acceptable psychometric properties (Rozental et al., 2019).”
Chalker, S. A., Carter, J., Imai, Y., Depp, C. A., & Chinman, M. (2025) · JMIR Research Protocols · doi:10.2196/66182
“To assess potential iatrogenic effects of delivering the intervention, peer specialist participants will complete the Negative Effects Questionnaire [26,27] (See peer specialist participant measure section below) as part of their posttreatment assessment.”
Feasibility, utility, and acceptability of an online ACT-based rehabilitation for clinical burnout
van de Leur, J. C., Lundbäck, K., Forslund, S., Virtanen, N., & Buhrman, M. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2530420
“The scale has been shown to have good reliability and to effectively measure the adverse effects of psychological interventions (Rozental et al., 2019).”
McCollum, J. K., Xu, L., Silberschatz, G., Kealy, D., & Penedo, J. M. G. (2025) · Psychotherapy Research · doi:10.1080/10503307.2025.2528031
“This is intended to fill a gap in the existing measures, which are cumbersome to administer (HAT; Llewelyn, 1988), narrowly focused (TDS; Mallinckrodt et al., 2014), or focused on the effects of therapy overall (ETQ and NEQ; Parker et al., 2013; Rozental et al., 2019).”
InfluentialArendt, I. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C. R., & Møeller, S. B. (2025) · Trials · doi:10.1186/s13063-025-09012-4
Survivor’s Bias in Psychotherapy
Math, S. B. (2025) · Journal of Psychiatry Spectrum · doi:10.4103/jopsys.jopsys_123_25
Compère, V. N., Balci, S., Heinz, C., Schade‐Brittinger, C., Rastan, A. J., Salzmann-Djufri, M., Niemann, B., Boening, A., Choi, Y., Zarski, A., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-092482
“To explore potential adverse effects and unmet needs, we assess negative side effects (NEQ, negative effects questionnaire) 43 and prior pretreatment experiences.”
Winter, J., Gasslander, N., Rane, G., Sundström, F., Björkhem‐Bergman, L., Hedman, C., & Axelsson, E. (2025) · Journal of Cancer Survivorship · doi:10.1007/s11764-025-01905-2
“Negative effects and adverse events were assessed post-treatment using the 20-Item Negative Effects Questionnaire (NEQ-20) [58], as well as a questionnaire regarding adverse events, previously used in other clinical trials [45, 59, 60].”
Kern, D., Ljótsson, B., Catrina, S., Lindefors, N., & Kraepelien, M. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2595107
Tandon, T., Berger, T., Meyer, B., Khaled, O. A., Gupta, R., & Martin-Söelch, C. (2025) · Trials · doi:10.1186/s13063-025-09377-6
“Negative Effects of Psychotherapy (NEP; [95]).”
Bragesjö, M., Ivanov, V. Z., Andersson, E., & Rück, C. (2025) · Trials · doi:10.1186/s13063-025-09361-0
“Moreover, information on adverse events will be gathered using the Negative Effects Questionnaire (NEQ) immediately after treatment completion and the upcoming assessment points [21].”
Arendt, I.-M. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C. R., Bach, B., Videbech, P., Jørgensen, M. B., & Møeller, S. B. (2024) · Figshare · doi:10.6084/m9.figshare.26707769
Arendt, I.-M. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C., Bach, B., Videbech, P., Jørgensen, M. B., & Møeller, S. B. (2024) · Figshare · doi:10.6084/m9.figshare.25621913
Boettcher, J., Heinrich, M., Boettche, M., Burchert, S., Glaesmer, H., Gouzoulis‐Mayfrank, E., Heeke, C., Hernek, M., Knaevelsrud, C., Konnopka, A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26658565
Self-citationJensen, K. H. R., Dam, V. H., Ganz, M., Fisher, P. M., Ip, C.-T., Sankar, A., Marstrand-Joergensen, M. R., Ozenne, B., Osler, M., Penninx, B. W. J. H., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22623808
Taher, R., Hall, C. L., Bergin, A. D. G., Gupta, N., Heaysman, C. L., Jacobsen, P., Kabir, T., Kalnad, N., Keppens, J., Hsu, C.-W., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26974360
Arendt, I.-M. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C. R., Bach, B., Videbech, P., Jørgensen, M. B., & Møeller, S. B. (2024) · Figshare · doi:10.6084/m9.figshare.26707763
Arendt, I.-M. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C. R., Bach, B., Videbech, P., Jørgensen, M. B., & Møeller, S. B. (2024) · Figshare · doi:10.6084/m9.figshare.26707766
Arendt, I.-M. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C. R., Bach, B., Videbech, P., Jørgensen, M. B., & Møeller, S. B. (2024) · Figshare · doi:10.6084/m9.figshare.25622121
Jensen, K. H. R., Dam, V. H., Ganz, M., Fisher, P. M., Ip, C.-T., Sankar, A., Marstrand-Joergensen, M. R., Ozenne, B., Osler, M., Penninx, B. W. J. H., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22623805
Mutter, A., Küchler, A., Idrees, A. R., Kählke, F., Terhorst, Y., & Baumeister, H. (2024) · Figshare · doi:10.6084/m9.figshare.26616967
Jensen, K. H. R., Dam, V. H., Ganz, M., Fisher, P. M., Ip, C.-T., Sankar, A., Marstrand-Joergensen, M. R., Ozenne, B., Osler, M., Penninx, B. W. J. H., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22623802
Balsom, A. A., Klest, B., Sander, B. J., & Gordon, J. L. (2024) · Figshare · doi:10.6084/m9.figshare.26702290
Taher, R., Hall, C. L., Bergin, A. D. G., Gupta, N., Heaysman, C. L., Jacobsen, P., Kabir, T., Kalnad, N., Keppens, J., Hsu, C.-W., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26974363
Benz, F., Grolig, L., Hannibal, S., Buntrock, C., Cuijpers, P., Domschke, K., Ebert, D. D., Ell, J., Janneck, M., Jenkner, C., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26731849
Hybelius, J., Gustavsson, A., af Winklerfelt Hammarberg, S., Toth-Pal, E., Johansson, R., Ljótsson, B., & Axelsson, E. (2022) · Figshare · doi:10.6084/m9.figshare.20342406
Arendt, I.-M. T. P., Gondan, M., Juul, S., Hastrup, L. H., Hjorthøj, C. R., Bach, B., Videbech, P., Jørgensen, M. B., & Møeller, S. B. (2024) · Figshare · doi:10.6084/m9.figshare.26707760
Clinician and Client Reports of the Negative Effects of Neuropsychological Assessment for Dementia
Miller, N., Grinter, D. J., McGraw, D., Pritchett, R., & McLeod, H. J. (2025) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/08919887251407122
“Firstly, an existing validated measure of negative effects in psychological therapy 25 was reviewed to explore an acceptable format to seek these views and obtain examples of question content, which were then considered alongside expressed negative effects of NPA from the literature described in…”
InfluentialBuskbjerg, C. R., Johannsen, M., Nørskov, C. S., Jensen, A. B., Frederiksen, Y., Egerod, I., Guastaferro, K., Johansen, C., von Heymann, A., Speckens, A. E. M., et al. (2025) · Scandinavian Journal of Psychology · doi:10.1111/sjop.70063
Houben, S. T. L., Backus, A. C. P., Merckelbach, H. L. G. J., & Dandachi‐FitzGerald, B. (2026) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70209
Fässler, L., Ersöz, B., Hahne, I. M., Koop, S., & Böge, K. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1727156
Topooco, N., Lindner, P., Andersson, C. R., Lindfors, P., Molander, O., Kraepelien, M., Sundström, C., Vlaescu, G., Andersson, G., Bendtsen, M., et al. (2026) · JMIR Formative Research · doi:10.2196/68698
“…Revised (range 12-84; higher scores denote stronger alliance [51]), (3) treatment satisfaction with the Client Satisfaction Questionnaire (range 0-32; higher scores reflect greater satisfaction [52]), and (4) negative effects with the Negative Effects Questionnaire-20 (NEQ-20; [53]).”
Self-citation
Metadata
- Authors
- Rozental, A., Kottorp, A., Forsström, D., Månsson, K., Boettcher, J., Andersson, G., Furmark, T., & Carlbring, P.
- Affiliations
- Karolinska Institutet (SE)
- Malmö University (SE)
- Stockholm University (SE)
- Uppsala University (SE)
- Freie Universität Berlin (DE)
- Linköping University (SE)
- Corresponding author
- Rozental, Alexander
- ORCID
- Venue
- Behavioural and Cognitive Psychotherapy
- Publisher
- Cambridge University Press (CUP)
- Published
- 2019-03-15
- Volume
- 47
- Issue
- 5
- Pages
- 559-572
- ISSN
- 1352-4658 (ISSN-L)
- 1469-1833
- OpenAlex
- W2922529521
- Cited by
- 230
- References
- 46
- Citations by year
- 2026: 47 · 2025: 47 · 2024: 47 · 2023: 32 · 2022: 30 · 2021: 15 · 2020: 7 · 2019: 4
- FWCI
- 10.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Behavioural and Cognitive Psychotherapy (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Uppsala University Publications (Uppsala University) (submittedVersion, other-oa)
- Malmö University Publications (Malmö University) (submittedVersion)
- University of Southern Denmark Research Portal (University of Southern Denmark) (submittedVersion, cc-by)
- Funders
- University of Illinois at Urbana-Champaign
- University of Illinois at Chicago
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- adverse effects, psychometric properties, Rasch analysis, differential item functioning, item response theory, short-form scale, treatment outcome monitoring, mental illness
- MeSH terms
- Negative Results, Adult, Mental Disorders, Female, Humans, Male, Psychology, Psychometrics, Surveys and Questionnaires, Reproducibility of Results, Treatment Failure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review