Chatbot-Delivered Cognitive Defusion versus Cognitive Restructuring for Negative Self-Referential Thoughts: A Pilot Study
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Conversational agents or chatbots are a novel, highly accessible, and low-resource method of psychological intervention delivery. The present research aims to compare two brief chatbot interventions that delivered cognitive restructuring and defusion interventions, respectively. It was hypothesized that a defusion chatbot would lead to reduced cognitive fusion and decreased thought believability relative to cognitive restructuring and a nonactive control. Participants (N = 223; M age of 28.01 [SD = 10.29]; 47 identified as male, 174 as female, and 2 as nonbinary) were randomized into one of three conditions (defusion, restructuring, control), engaged for 5 days completing thought and mood measures pre- and postintervention. Sixty-two participants (M age of 25.98; SD = 8.647 years) completed measures again at time 2 (49 identified as female, 12 as male, and 1 as nonbinary). No statistically significant differences were observed among groups on believability of thoughts (F[2, 25] = .79, p = .47, ηp 2 = .06), negativity of thoughts (F[2,25] = 1.49, p = .25, η 2 = .11), discomfort associated with thoughts (F[2, 25] = .48, p = .62, ηp 2 = .04), and willingness (F[2, 25] = 3.00, p = .07, ηp 2 = .19) to have negative self-referential thoughts. Moreover, substantial attrition of 72% was observed. Acceptability and usability of the chatbots employed are discussed as contributing toward the limited effectiveness of interventions and elevated attrition. Various recommendations are presented to support researchers and clinicians in developing engaging and effective chatbots.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950 · cited 6×
“This procedure was enacted for the AAQ-II, CFQ-7, and PANAS providing 70% of items had been completed by the participant (Sterne et al., 2009; Jakobsen et al., 2017).”
BackgroundResultInfluentialJakobsen, J. C., Gluud, C., Wetterslev, J., & Winkel, P. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0442-1 · Cited by 2,747 · cited 2×
“This procedure was enacted for the AAQ-II, CFQ-7, and PANAS providing 70% of items had been completed by the participant (Sterne et al., 2009; Jakobsen et al., 2017).”
MethodFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 6×
“Early evidence suggests that chatbots delivering CBT are effective interventions for depression, anxiety, and stress with attrition observed to be lower than traditional online self-help (Fitzpatrick et al., 2017; Fulmer et al., 2018; Inkster et al., 2018; Ly et al., 2017).”
BackgroundMethodResultInfluentialHayes, S. C. (2004) · Behavior Therapy · doi:10.1016/s0005-7894(04)80013-3 · Cited by 2,493 · cited 1×
“ACT draws on cognitive defusion (hereafter defusion) to separate thoughts from their literal and undesirable functions and develop awareness of cognition as an active, ongoing, process (Cullen, 2008; Hayes et al., 1999; Hayes, 2004; Luoma & Hayes, 2008; Hayes et al., 2012).”
BackgroundRelational Frame Theory: A Post-Skinnerian Account of Human Language and Cognition
(2001) · doi:10.1007/b108413 · Cited by 1,296
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
The development and initial validation of the cognitive fusion questionnaire
Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., et al. (2014) · Behavior Therapy · doi:10.1016/j.beth.2013.09.001 · Cited by 837
Acceptance and Commitment Therapy as a Unified Model of Behavior Change
Hayes, S. C., Pistorello, J., & Levin, M. E. (2012) · The Counseling Psychologist · doi:10.1177/0011000012460836 · Cited by 718
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
An overview of the features of chatbots in mental health: A scoping review
Abd-alrazaq, A. A., Alajlani, M., Alalwan, A. A., Bewick, B. M., Gardner, P., & Househ, M. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103978 · Cited by 605 · cited 2×
“is likely to have inhibited participant rapport and working alliance with chatbots (Bendig et al., 2019; Morris et al., 2018; Abd-alrazaq et al., 2019).”
BackgroundHopelessness, depression, suicidal ideation, and clinical diagnosis of depression
Beck, A. T., Steer, R. A., Beck, J. S., & Newman, C. F. (1993) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.1993.tb00378.x · Cited by 584 · cited 1×
“Cognitive models of psychopathology have long asserted the involvement of negative selfrelevant cognitions, negative cognitions pertaining to the future, and negative appraisals of past events (Beck et al., 1976; Clark & Rhyno, 2005).”
BackgroundRathbone, A. L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7740 · Cited by 497 · cited 2×
“However, growing evidence suggests that both CBT and ACT-informed interventions are effective as online self-help orientated interventions for difficulties including depression, anxiety, and stress (Brown et al., 2016; Grist & Cavanagh, 2013; O’Connor et al., 2018; Rathbone, 2017).”
BackgroundMentalism, Behavior-Behavior Relations, and a Behavior-Analytic View of the Purposes of Science
Hayes, S. C., & Brownstein, A. J. (1986) · The Behavior Analyst · doi:10.1007/bf03391944 · Cited by 371 · cited 1×
“Although behavior cannot be said to cause other behavior, it may have a controlling effect on behavior in certain contexts (Hayes & Brownstein, 1986).”
BackgroundLy, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Tyndall, I., Waldeck, D., Pancani, L., Whelan, R., Roche, B., & Dawson, D. L. (2019) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2018.09.005 · Cited by 303 · cited 2×
“…of the measure suggested it to be psychometrically sound with high validity and reliability (Bond et al., 2011), more recent findings have called into question the discriminant validity of the AAQ-II and its appropriateness as a measure of psychological inflexibility (Tyndall et al., 2019).”
BackgroundResultConversational agents in the treatment of mental health problems: mixed-method systematic review
Gaffney, H., Mansell, W., & Tai, S. (2019) · JMIR Mental Health · doi:10.2196/14166 · Cited by 275
Morris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10148 · Cited by 273
Prochaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257 · cited 3×
“Indeed, a recent study by Prochaska et al. (2021) observed that a stronger working alliance with the chatbot employed was associated with key therapeutic outcomes and greater engagement with the intervention.”
BackgroundInfluentialBendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H. (2022) · Verhaltenstherapie · doi:10.1159/000501812 · Cited by 214 · cited 2×
“is likely to have inhibited participant rapport and working alliance with chatbots (Bendig et al., 2019; Morris et al., 2018; Abd-alrazaq et al., 2019).”
BackgroundBrown, M., Glendenning, A., Hoon, A. E., & John, A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6200 · Cited by 198 · cited 3×
“However, growing evidence suggests that both CBT and ACT-informed interventions are effective as online self-help orientated interventions for difficulties including depression, anxiety, and stress (Brown et al., 2016; Grist & Cavanagh, 2013; O’Connor et al., 2018; Rathbone, 2017).”
BackgroundMethodClark, D. A. (2013) · The Wiley Handbook of Cognitive Behavioral Therapy · doi:10.1002/9781118528563.wbcbt02 · Cited by 192
Using Brief Cognitive Restructuring and Cognitive Defusion Techniques to Cope With Negative Thoughts
Larsson, A., Hooper, N., Osborne, L. A., Bennett, P., & McHugh, L. (2016) · Behavior Modification · doi:10.1177/0145445515621488 · Cited by 120
Self-citationGrist, R., & Cavanagh, K. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9243-y · Cited by 100 · cited 1×
“However, growing evidence suggests that both CBT and ACT-informed interventions are effective as online self-help orientated interventions for difficulties including depression, anxiety, and stress (Brown et al., 2016; Grist & Cavanagh, 2013; O’Connor et al., 2018; Rathbone, 2017).”
BackgroundHealy, H.-A., Barnes-Holmes, Y., Barnes-Holmes, D., Keogh, C., Luciano, C., & Wilson, K. (2008) · The Psychological Record · doi:10.1007/bf03395641 · Cited by 87 · cited 3×
“Healy et al. (2008) observed that said defusion exercise resulted in reduced discomfort with negative self-statements and undermined the believability of same while increasing willingness to experience such psychological content in future.”
BackgroundMethodCognitive defusion in acceptance and commitment therapy: What are the basic processes of change?
Assaz, D. A., Roche, B., Kanter, J. W., & Oshiro, C. K. B. (2018) · The Psychological Record · doi:10.1007/s40732-017-0254-z · Cited by 85
A meta-analysis of dropout rates in acceptance and commitment therapy
Ong, C. W., Lee, E. B., & Twohig, M. P. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.02.004 · Cited by 69
O’Connor, M., Munnelly, A., Whelan, R., & McHugh, L. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.07.007 · Cited by 62 · cited 2×
“, 2017) and meta-analyses of online and face-to-face ACT (O’Connor et al., 2018; Ong et al., 2018).”
BackgroundSelf-citationMasuda, A., Feinstein, A. B., Wendell, J. W., & Sheehan, S. T. (2010) · Behavior Modification · doi:10.1177/0145445510379632 · Cited by 53 · cited 5×
“Unlike previous studies examining brief restructuring and defusion interventions (e.g., Larsson et al., 2016; Masuda et al., 2004; Masuda et al., 2010) the present study did not present a rationale for the defusion and restructuring interventions that were presented.”
BackgroundMethodResultInfluentialBarrera, T. L., Szafranski, D. D., Ratcliff, C. G., Garnaat, S. L., & Norton, P. J. (2016) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465814000630 · Cited by 42 · cited 1×
“One such study by Barrera et al. (2015) infused defusion and restructuring respectively into in-vivo exposure for social anxiety (resulting in three intervention groups: defusion plus invivo exposure, restructuring plus in-vivo exposure, and standalone in- vivo exposure).”
BackgroundAn empirical investigation of the role of self, hierarchy, and distinction in a common act exercise
Foody, M., Barnes-Holmes, Y., Barnes-Holmes, D., Rai, L., & Luciano, C. (2015) · The Psychological Record · doi:10.1007/s40732-014-0103-2 · Cited by 42
Acceptance and commitment therapy (ACT): A third wave behaviour therapy
Cullen, C. (2008) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465808004797 · Cited by 32 · cited 1×
“ACT draws on cognitive defusion (hereafter defusion) to separate thoughts from their literal and undesirable functions and develop awareness of cognition as an active, ongoing, process (Cullen, 2008; Hayes et al., 1999; Hayes, 2004; Luoma & Hayes, 2008; Hayes et al., 2012).”
BackgroundAn Experimental Investigation of Cognitive Defusion
Pilecki, B. C., & McKay, D. (2012) · The Psychological Record · doi:10.1007/bf03395784 · Cited by 28
Cited by
He, Y., Yang, L., Qian, C., Li, T., Su, Z., Zhang, Q., & Hou, X. (2023) · Journal of Medical Internet Research · doi:10.2196/43862 · Cited by 213
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Feng, X., Tian, L., Ho, G. W. K., Yorke, J., & Hui, V. (2025) · Journal of Medical Internet Research · doi:10.2196/79850 · Cited by 51
Kuhail, M. A., Al-Shamaileh, O., Farooq, S., Shahin, H., Abdelzaher, F., & Thomas, J. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/9942295 · Cited by 11
Metadata
- Authors
- Lavelle, J., Dunne, N., Mulcahy, H. E., & McHugh, L.
- Venue
- The Psychological Record
- Published
- 2021-08-24
- Volume
- 72
- Issue
- 2
- Pages
- 247-261
- ISSN
- 0033-2933 (ISSN-L)
- 2163-3452
- OpenAlex
- W3195958027
- Cited by
- 12
- References
- 32
- FWCI
- 1.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.