A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index; 22 of the 46 sources its claims cite were checked for support.
Abstract
Background: An increase in health anxiety was observed during the COVID-19 pandemic. However, due to physical distancing restrictions and a strained mental health system, people were unable to access support to manage health anxiety. Chatbots are emerging as an interactive means to deliver psychological interventions in a scalable manner and provide an opportunity for novel therapy delivery to large groups of people including those who might struggle to access traditional therapies. Objective: The aim of this mixed methods pilot study was to investigate the feasibility, acceptability, engagement, and effectiveness of a cognitive behavioral therapy (CBT)–based chatbot (Otis) as an early health anxiety management intervention for adults in New Zealand during the COVID-19 pandemic. Methods: Users were asked to complete a 14-day program run by Otis, a primarily decision tree–based chatbot on Facebook Messenger. Health anxiety, general anxiety, intolerance of uncertainty, personal well-being, and quality of life were measured pre-intervention, postintervention, and at a 12-week follow-up. Paired samples t tests and 1-way ANOVAs were conducted to investigate the associated changes in the outcomes over time. Semistructured interviews and written responses in the self-report questionnaires and Facebook Messenger were thematically analyzed. Results: The trial was completed by 29 participants who provided outcome measures at both postintervention and follow-up. Although an average decrease in health anxiety did not reach significance at postintervention (P=.55) or follow-up (P=.08), qualitative analysis demonstrated that participants perceived benefiting from the intervention. Significant improvement in general anxiety, personal well-being, and quality of life was associated with the use of Otis at postintervention and follow-up. Anthropomorphism, Otis’ appearance, and delivery of content facilitated the use of Otis. Technical difficulties and high performance and effort expectancy were, in contrast, barriers to acceptance and engagement of Otis. Conclusions: Otis may be a feasible, acceptable, and engaging means of delivering CBT to improve anxiety management, quality of life, and personal well-being but might not significantly reduce health anxiety. © Yenushka Goonesekera, Liesje Donkin.
Overview
CoChat Summary
## TL;DR
This mixed methods pilot study tested Otis, a Facebook Messenger CBT chatbot, for health anxiety management in 69 adults in New Zealand during COVID-19. Otis was feasible and acceptable and improved general anxiety, well-being, and quality of life, but it did not significantly reduce health anxiety.
## Key findings
- Of the 69 participants who completed baseline measures, 35 (51%) completed the postintervention questionnaire and 29 (42%) completed the 12-week follow-up; 12 of 29 (41%) completed all 14 days.
- Health anxiety decreased from baseline to postintervention and follow-up, but not significantly: SHAI-18 mean 19.93 to 19.31 at postintervention (P=.55) and 17.38 at follow-up (P=.08).
- General anxiety improved significantly: GAD-7 mean 9.69 to 7.58 at postintervention (t28=3.30, P=.003) and 7.00 at follow-up (t28=3.26, P=.003).
- Personal well-being and quality of life also improved significantly: ONS4 mean 5.70 to 6.31 at postintervention and 6.50 at follow-up (both P=.03), and quality of life improved at postintervention (P=.02) and follow-up (P<.001).
- Mean overall user experience was 18.24/30 and overall acceptability was rated 8.24/10; the most common reason for abandonment was lack of time (14/29, 35%).
## Methods
- Single-group, pretest-posttest mixed methods pilot study with semistructured interviews; participants were recruited via social media and email between May and July 2020.
- Sample: adults aged 18+ in New Zealand with Facebook Messenger and internet access; final follow-up sample was 29 participants, predominantly female (25/29, 86%), mean age 37.4 years.
- Intervention and analysis: a 14-day, primarily decision tree–based CBT chatbot (Otis) on Facebook Messenger; outcomes were measured at baseline, postintervention, and 12-week follow-up, analyzed with paired-samples t tests and 1-way ANOVAs, and qualitative data were thematically analyzed.
## Limitations
- The paper states that the observational design limited causal inference, and results may have been confounded by unidentifiable variables such as psychological input outside the intervention and changes in COVID-19 restrictions.
- The sample was mostly New Zealand European and highly educated, limiting generalizability.
- The authors note low statistical power from the small sample size, and the text also suggests a possible floor effect because only 5 participants met the health-anxiety cut-off; these are evident in the paper’s discussion.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
13 Valid · 6 Not valid · 15 Not checked · 89 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“During the initial development phase of a chatbot, it can produce crude responses that users may perceive as invalidating, robotic, or disconnected from their response [26].”
§ A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study > Methods > Intervention
What the sources say
- Partly supportedcites [26] sourceExperimental — accuracy not yet measured
The Discussion (Principal Findings; page unavailable) says chatbots’ limited responses might reflect their early development stage. The Results (Study Findings; page unavailable) report confusing responses, a robotic voice, and failures to understand users’ responses. They do not report that users perceived the responses as invalidating, so that part of the claim is unsupported. (LLM, conf=0.84)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“a previous study concluded that a score of 27 and greater differentiated health anxiety from other anxiety disorders [2].”
§ A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study > Methods > Measures
What the sources say
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
The Discussion reports that the SHAI differentiated people with health anxiety from people with other anxiety problems, citing Salkovskis et al. (2002). It does not give a score of 27 or conclude that this threshold makes the distinction; a search for that score found no supporting passage. Page numbers are not available in our copy. (LLM, conf=0.86)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Previous effective CBT interventions for health anxiety have been approximately 12 modules [24,25].”
§ A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study > Methods > Intervention
What the sources say
- Could not verifycites [24] sourceExperimental — accuracy not yet measured
The CBT component of CALM section describes treatment for panic disorder, generalized anxiety disorder, social anxiety disorder, and posttraumatic stress disorder—not health anxiety. The Results from CALM Tools for Living section reports an average of 7.63 attended CBT sessions, but does not establish that effective health-anxiety interventions comprised approximately 12 modules. Searches for health anxiety and 12 modules found no supporting passage in our copy. (LLM, conf=0.76)
- Not checked — no full text of the sourcecites [25] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Previous studies have demonstrated that chatbot interventions improve psychological difficulties including major depressive disorder [15], panic disorder [16], posttraumatic stress disorder [17], antipsychotic medication adherence [18], and perceived stress [19].”
§ A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study > Introduction
What the sources say
- Partly supportedcites [15] sourceExperimental — accuracy not yet measured
Citation [15] is attached to major depressive disorder, not the other conditions in the sentence. The Related Work section says internet-based cognitive behavioral therapy can relieve depressive symptoms, but does not identify those interventions as chatbots. This paper’s Discussion reports that patients with major depressive symptoms accepted and formed a stronger alliance with the relational agent; it does not report that the agent improved their depression. (LLM, conf=0.82)
- Not checked — no full text of the sourcecites [16] source
- Partly supportedcites [17] sourceExperimental — accuracy not yet measured
Citation [17] is attached to posttraumatic stress disorder, not the other conditions in the sentence. The Evaluation’s second usability test reports that four former PTSD patients found the virtual-agent system’s questions useful for recalling traumatic memories. It does not demonstrate that the intervention improved PTSD symptoms; the reported outcomes concern recollection and usability. (LLM, conf=0.86)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The themes of technical difficulties and content delivery affecting engagement with Otis reflected the results in the systematic review by Borghouts and colleagues [53].”
§ A Cognitive Behavioral Therapy Chatbot (Otis) for Health Anxiety Management: Mixed Methods Pilot Study > Discussion > Comparison With Prior Work
What the sources say
- Supportedcites [53] source
The Results sections on technology-related and program-related constructs report that technical issues were a common barrier to engagement and that content type and delivery affected engagement. The Discussion’s Principal Findings summarize both as factors influencing engagement with digital mental health interventions; the claim does not attribute findings about Otis itself to the review. (LLM, conf=0.94)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
58 more claims · 3 with their cited sources checked
Create a free account to see all 123 claims and to verify the 3 references still open.
- Probably not a substantial claim. 28
- It may state two separate claims as one. 44
Citations
Cites
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“92 and high convergent and discriminant validity [32].”
BackgroundThe WHO-5 well-being index: A systematic review of the literature
Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000376585 · Cited by 4,708 · cited 1×
“A vast set of literature supports the validity and reliability of the measure in several populations [42-45].”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Qualitative Research: Rigour and qualitative research
Mays, N., & Pope, C. (1995) · BMJ · doi:10.1136/bmj.311.6997.109 · Cited by 2,715 · cited 1×
“Additionally, bias within the interpretation of the qualitative results, a common critique of qualitative research [62], is another limitation of the study.”
BackgroundGarnefski, N., Kraaij, V., Schroevers, M. J., & Somsen, G. A. (2008) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-008-9136-5 · Cited by 2,479
Fearing the unknown: A short version of the Intolerance of Uncertainty Scale
Carleton, R. N., Norton, M. A. P. J., & Asmundson, G. J. G. (2007) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2006.03.014 · Cited by 2,288 · cited 4×
“AI: artificial intelligence ANOVA: analysis of variance CBT: cognitive behavioral therapy DHI: digital health intervention DSM: Diagnostic Manual of Mental Disorders GAD-7: Generalized Anxiety Disorder 7-item Scale iCBT: internet-based cognitive behavioral therapy IUS-12: Intolerance of Uncertainty Scale mHealth: mobi…”
BackgroundInfluentialThe intolerance of uncertainty scale: psychometric properties of the English version
Buhr, K., & Dugas, M. J. (2002) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(01)00092-4 · Cited by 1,391 · cited 2×
“The ONS4 is widely used among various patient populations [36-40] and has demonstrated good internal reliability (Cronbach α=.”
BackgroundSALKOVSKIS, P. M., RIMES, K. A., WARWICK, H. M. C., & CLARK, D. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702005822 · Cited by 1,351 · cited 5×
“AI: artificial intelligence ANOVA: analysis of variance CBT: cognitive behavioral therapy DHI: digital health intervention DSM: Diagnostic Manual of Mental Disorders GAD-7: Generalized Anxiety Disorder 7-item Scale iCBT: internet-based cognitive behavioral therapy IUS-12: Intolerance of Uncertainty Scale mHealth: mobi…”
InfluentialFear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020
Mertens, G., Gerritsen, L., Duijndam, S., Salemink, E., & Engelhard, I. M. (2020) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2020.102258 · Cited by 1,264 · cited 1×
“However, when this fear is associated with functional impairment and distress, it is termed health anxiety [3].”
BackgroundAdherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 1×
“This study found that approximately 41% of participants completed the study and that, on average, the final sample completed 70% of the intervention, which is higher than seen in most of the literature [48-50].”
ResultBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 2×
“The themes of technical difficulties and content delivery affecting engagement with Otis reflected the results in the systematic review by Borghouts and colleagues [53].”
BackgroundResultBech, P., Olsen, L. R., Kjoller, M., & Rasmussen, N. K. (2003) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.145 · Cited by 1,015 · cited 1×
“A vast set of literature supports the validity and reliability of the measure in several populations [42-45].”
BackgroundThe importance of behaviour in the maintenance of anxiety and panic: A cognitive account
Salkovskis, P. M. (1991) · Behavioural Psychotherapy · doi:10.1017/s0141347300011472 · Cited by 780 · cited 1×
“Both avoidance and reassurance-seeking maintain the anxiety as the individual foregoes their opportunity to become aware of their ability to cope with their perceived fear [8,9], thus preventing long-term cognitive change [10].”
BackgroundQiu, L., & Benbasat, I. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222250405 · Cited by 737 · cited 1×
“These findings are in direct conflict with previous research suggesting that, if users were to apply the same social rules to their interactions with a chatbot, it may improve a user’s perception of social presence [60].”
ResultAn overview of the features of chatbots in mental health: A scoping review
Abd-alrazaq, A. A., Alajlani, M., Alalwan, A. A., Bewick, B. M., Gardner, P., & Househ, M. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103978 · Cited by 605 · cited 1×
“Chatbots are conversational agents that hold text, speech, or visual-based conversations with users [14].”
BackgroundDropout from Internet‐based treatment for psychological disorders
Melville, K. M., Casey, L. M., & Kavanagh, D. J. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x472138 · Cited by 597 · cited 1×
“This study found that approximately 41% of participants completed the study and that, on average, the final sample completed 70% of the intervention, which is higher than seen in most of the literature [48-50].”
ResultPsychological Predictors of Anxiety in Response to the H1N1 (Swine Flu) Pandemic
Wheaton, M. G., Abramowitz, J. S., Berman, N. C., Fabricant, L. E., & Olatunji, B. O. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-011-9353-3 · Cited by 509
Bults, M., Beaujean, D. J., de Zwart, O., Kok, G., van Empelen, P., van Steenbergen, J. E., Richardus, J. H., & Voeten, H. A. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-2 · Cited by 508
Impact of Ebola experiences and risk perceptions on mental health in Sierra Leone, July 2015
Jalloh, M. F., Li, W., Bunnell, R. E., Ethier, K. A., O’Leary, A., Hageman, K. M., Sengeh, P., Jalloh, M. B., Morgan, O., Hersey, S., et al. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000471 · Cited by 433
van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409
Measures of self-perceived well-being
McDowell, I. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2009.07.002 · Cited by 388 · cited 1×
“A vast set of literature supports the validity and reliability of the measure in several populations [42-45].”
BackgroundPrevalence and correlates of clinical insomnia co‐occurring with chronic back pain
TANG, N. K. Y., WRIGHT, K. J., & SALKOVSKIS, P. M. (2007) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2007.00571.x · Cited by 383 · cited 1×
“The cut-off scores of the SHAI-18 vary across studies [29-31]; however, a previous study concluded that a score of 27 and greater differentiated health anxiety from other anxiety disorders [2].”
MethodLy, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Main, A., Zhou, Q., Ma, Y., Luecken, L. J., & Liu, X. (2011) · Journal of Counseling Psychology · doi:10.1037/a0023632 · Cited by 361
Abramowitz, J. S., Deacon, B. J., & Valentiner, D. P. (2007) · Cognitive Therapy and Research · doi:10.1007/s10608-006-9058-1 · Cited by 308 · cited 7×
“As health anxiety is correlated with intolerance of uncertainty [2,33,34], the Short Intolerance of Uncertainty Scale (IUS-12) [35], a 12-item self-report measure that assesses an individual’s response to ambiguous situations, uncertainty, and future events, was administered.”
BackgroundMethodResultInfluentialLau, J. T., Griffiths, S., Choi, K. C., & Tsui, H. Y. (2010) · BMC Infectious Diseases · doi:10.1186/1471-2334-10-139 · Cited by 305
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301 · cited 2×
“Instead, the results were consistent with a systematic review and meta-analysis of mental health chatbots demonstrating weak evidence for chatbots producing clinically significant psychological outcomes [26].”
BackgroundResultHealth anxiety in Australia: prevalence, comorbidity, disability and service use
Sunderland, M., Newby, J. M., & Andrews, G. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.111.103960 · Cited by 280 · cited 1×
“Health anxiety in particular is associated with greater levels of distress, thus warranting a greater need for psychological support [11-13].”
The Short Health Anxiety Inventory: A systematic review and meta-analysis
Alberts, N. M., Hadjistavropoulos, H. D., Jones, S. L., & Sharpe, D. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2012.10.009 · Cited by 267 · cited 1×
“Each statement is scored between 0 and 3 and summed, with higher scores indicating more severe health anxiety in clinical, nonclinical, and medical samples [28].”
Background(2004) · Cited by 261
Sischka, P. E., Costa, A. P., Steffgen, G., & Schmidt, A. F. (2020) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2020.100020 · Cited by 245 · cited 1×
“A vast set of literature supports the validity and reliability of the measure in several populations [42-45].”
BackgroundHelbig-Lang, S., & Petermann, F. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2010.01213.x · Cited by 218 · cited 1×
“Both avoidance and reassurance-seeking maintain the anxiety as the individual foregoes their opportunity to become aware of their ability to cope with their perceived fear [8,9], thus preventing long-term cognitive change [10].”
BackgroundResponse to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218 · cited 1×
“Previous studies have demonstrated that chatbot interventions improve psychological difficulties including major depressive disorder [15], panic disorder [16], posttraumatic stress disorder [17], antipsychotic medication adherence [18], and perceived stress [19].”
BackgroundMaintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213 · cited 1×
“Previous studies have demonstrated that chatbot interventions improve psychological difficulties including major depressive disorder [15], panic disorder [16], posttraumatic stress disorder [17], antipsychotic medication adherence [18], and perceived stress [19].”
BackgroundDonkin, L., & Glozier, N. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2100 · Cited by 212 · cited 1×
“The importance of integration is reflected in this study in which the perceived high effort expectancy of using Otis competed with other activities leading to forgetfulness or deprioritizing of use, as seen in other studies [54,55].”
ResultSelf-citationThe effects of safety behaviors on health anxiety: An experimental investigation
Olatunji, B. O., Etzel, E. N., Tomarken, A. J., Ciesielski, B. G., & Deacon, B. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.07.008 · Cited by 192 · cited 1×
“Both avoidance and reassurance-seeking maintain the anxiety as the individual foregoes their opportunity to become aware of their ability to cope with their perceived fear [8,9], thus preventing long-term cognitive change [10].”
BackgroundHedman, E., Andersson, E., Ljótsson, B., Andersson, G., Rück, C., & Lindefors, N. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.07.009 · Cited by 183 · cited 1×
“Previous effective CBT interventions for health anxiety have been approximately 12 modules [24,25].”
BackgroundOlatunji, B. O., Kauffman, B. Y., Meltzer, S., Davis, M. L., Smits, J. A. J., & Powers, M. B. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.002 · Cited by 167 · cited 1×
“Cognitive behavioral therapy (CBT) has the greatest evidence base for health anxiety management compared with several control conditions, including treatment as usual, medication, placebo, waitlist, support groups, non-CBT–based psychoeducation, and other psychological interventions [20,21].”
BackgroundAnxiety sensitivity and intolerance of uncertainty as potential risk factors for cyberchondria
Norr, A. M., Albanese, B. J., Oglesby, M. E., Allan, N. P., & Schmidt, N. B. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.11.023 · Cited by 138 · cited 1×
“As health anxiety is correlated with intolerance of uncertainty [2,33,34], the Short Intolerance of Uncertainty Scale (IUS-12) [35], a 12-item self-report measure that assesses an individual’s response to ambiguous situations, uncertainty, and future events, was administered.”
BackgroundCase study—Embodied virtual agents: An analysis on reasons for failure
Ben Mimoun, M. S., Poncin, I., & Garnier, M. (2012) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2012.07.006 · Cited by 136 · cited 1×
“characteristics in a chatbot avatar set up high expectations, leading to user disappointment [61], thus supporting the idea that high expectations of functionality can lead to feelings of disappointment and frustration for participants.”
BackgroundHypochondriacal concerns in a community population
LOOPER, K. J., & KIRMAYER, L. J. (2001) · Psychological Medicine · doi:10.1017/s0033291701003737 · Cited by 135 · cited 1×
“Given the importance of physical health to survival, it is natural and adaptive for people to be vigilant and fearful about their health, engage in health-promoting behaviors, and scan for health threats [1,2].”
BackgroundOh, J., Jang, S., Kim, H., & Kim, J.-J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104171 · Cited by 124 · cited 1×
“Previous studies have demonstrated that chatbot interventions improve psychological difficulties including major depressive disorder [15], panic disorder [16], posttraumatic stress disorder [17], antipsychotic medication adherence [18], and perceived stress [19].”
BackgroundCognitive Behaviour Therapy for Health Anxiety: A Systematic Review and Meta-Analysis
Cooper, K., Gregory, J. D., Walker, I., Lambe, S., & Salkovskis, P. M. (2017) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465816000527 · Cited by 118 · cited 1×
“Cognitive behavioral therapy (CBT) has the greatest evidence base for health anxiety management compared with several control conditions, including treatment as usual, medication, placebo, waitlist, support groups, non-CBT–based psychoeducation, and other psychological interventions [20,21].”
BackgroundHealth anxiety levels in chronic pain clinic attenders
Rode, S., Salkovskis, P., Dowd, H., & Hanna, M. (2006) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2005.07.005 · Cited by 103 · cited 1×
“The cut-off scores of the SHAI-18 vary across studies [29-31]; however, a previous study concluded that a score of 27 and greater differentiated health anxiety from other anxiety disorders [2].”
MethodTreatment for anxiety disorders: Efficacy to effectiveness to implementation
Craske, M. G., Roy-Byrne, P. P., Stein, M. B., Sullivan, G., Sherbourne, C., & Bystritsky, A. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.012 · Cited by 98 · cited 1×
“Previous effective CBT interventions for health anxiety have been approximately 12 modules [24,25].”
BackgroundAxelsson, E., & Hedman-Lagerlöf, E. (2019) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2019.1703182 · Cited by 96 · cited 2×
“CBT has been adapted for internet-based use (iCBT) in treating health anxiety and has shown similar effects to face-to-face CBT [22].”
MethodResultTielman, M. L., Neerincx, M. A., Bidarra, R., Kybartas, B., & Brinkman, W.-P. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0771-y · Cited by 94 · cited 1×
“Previous studies have demonstrated that chatbot interventions improve psychological difficulties including major depressive disorder [15], panic disorder [16], posttraumatic stress disorder [17], antipsychotic medication adherence [18], and perceived stress [19].”
BackgroundSomatic symptom burden and health anxiety in the population and their correlates
Lee, S., Creed, F. H., Ma, Y.-L., & Leung, C. M. (2015) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2014.11.012 · Cited by 89 · cited 1×
“Health anxiety in particular is associated with greater levels of distress, thus warranting a greater need for psychological support [11-13].”
BackgroundUnderstanding and treating health anxiety: A cognitive-behavioral approach
Taylor, S. (2004) · Cognitive and Behavioral Practice · doi:10.1016/s1077-7229(04)80015-4 · Cited by 82
Sinha Deb, K., Tuli, A., Sood, M., Chadda, R., Verma, R., Kumar, S., Ganesh, R., & Singh, P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203353 · Cited by 79 · cited 1×
“Finally, participants found that Otis’ short and varied content delivery (text, videos, audio, and GIFs) was engaging, which is congruent with other studies assessing the effects of content delivery on overall user experience [56].”
ResultBenson, T., Sladen, J., Liles, A., & Potts, H. W. W. (2019) · BMJ Open Quality · doi:10.1136/bmjoq-2018-000394 · Cited by 77
Fergus, T. A., & Valentiner, D. P. (2011) · Cognitive Therapy and Research · doi:10.1007/s10608-011-9392-9 · Cited by 59 · cited 1×
“As health anxiety is correlated with intolerance of uncertainty [2,33,34], the Short Intolerance of Uncertainty Scale (IUS-12) [35], a 12-item self-report measure that assesses an individual’s response to ambiguous situations, uncertainty, and future events, was administered.”
BackgroundPrevalence and service implications of health anxiety in genitourinary medicine clinics
Seivewright, H., Salkovskis, P., Green, J., Mullan, N., Behr, G., Carlin, E., Young, S., Goldmeier, D., & Tyrer, P. (2004) · International Journal of STD & AIDS · doi:10.1258/0956462041558122 · Cited by 57 · cited 1×
“The cut-off scores of the SHAI-18 vary across studies [29-31]; however, a previous study concluded that a score of 27 and greater differentiated health anxiety from other anxiety disorders [2].”
MethodSimblett, S. K., Bruno, E., Siddi, S., Matcham, F., Giuliano, L., López, J. H., Biondi, A., Curtis, H., Ferrão, J., Polhemus, A., et al. (2019) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2019.05.035 · Cited by 54 · cited 1×
“The importance of integration is reflected in this study in which the perceived high effort expectancy of using Otis competed with other activities leading to forgetfulness or deprioritizing of use, as seen in other studies [54,55].”
ResultSoucy, J. N., & Hadjistavropoulos, H. D. (2017) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2017.02.002 · Cited by 38 · cited 1×
“Despite relatively high engagement and reported acceptability, participants did not consider Otis a substitute for a health professional, in line with previous research that showed a preference for CBT and medication in the treatment of health anxiety over iCBT [57].”
ResultSeymour, M., Yuan, L., Dennis, A., & Riemer, K. (2020) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2020.574 · Cited by 38 · cited 1×
“A recent study reported that users’ perceived trustworthiness and affinity were lower when a realistic digital avatar was used as compared with a human being but remained unaffected by the knowledge of whether a chatbot was controlled by a person or AI [59].”
BackgroundWinter is coming: age and early psychological concomitants of the Covid-19 pandemic in England
Carson, J. F., Prescott, J., Allen, R. E., & McHugh, S. (2020) · Journal of Public Mental Health · doi:10.1108/jpmh-06-2020-0062 · Cited by 37 · cited 1×
“The ONS4 is widely used among various patient populations [36-40] and has demonstrated good internal reliability (Cronbach α=.”
BackgroundNass, C., Kim, E.-Y., & Lee, E.-J. (1998) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '98 · doi:10.1145/274644.274667 · Cited by 34 · cited 1×
“Though previous work suggests that anthropomorphism is amplified by human-looking avatars [58], even in the absence of a human avatar, users responded socially to Otis.”
BackgroundHedman, E., Lekander, M., Karshikoff, B., Ljótsson, B., Axelsson, E., & Axelsson, J. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000195 · Cited by 30 · cited 1×
“For example, a previous study reported that, compared with controls, individuals with severe health anxiety were more likely to rate photos of healthy people as being less healthy, demonstrating a bias toward evaluating others as a health threat [7].”
ResultGao, L., Moodie, M., & Chen, G. (2019) · Quality of Life Research · doi:10.1007/s11136-018-2094-y · Cited by 24 · cited 1×
“The ONS4 is widely used among various patient populations [36-40] and has demonstrated good internal reliability (Cronbach α=.”
BackgroundRelationship between health-related quality of life and subjective wellbeing in asthma
de Albornoz, S. C., & Chen, G. (2021) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2021.110356 · Cited by 24 · cited 1×
“The ONS4 is widely used among various patient populations [36-40] and has demonstrated good internal reliability (Cronbach α=.”
BackgroundLifestyle and wellbeing: Exploring behavioral and demographic covariates in a large US sample
Eichstaedt, J. C., Yaden, D. B., Ribeiro, F., Adler, A., & Kern, M. L. (2020) · International Journal of Wellbeing · doi:10.5502/ijw.v10i4.831 · Cited by 18 · cited 1×
“The ONS4 is widely used among various patient populations [36-40] and has demonstrated good internal reliability (Cronbach α=.”
Background
Research works printed but not linked: 3
- 2000, Diagnostic and Statistical Manual of Mental Disorders, 4th edition
- Ersoy, K, 2020, Social Sciences Research Journal, 9, 117
- RietzTBenkeIMaedcheAThe impact of anthropomorphic and functional chatbot design features in enterprise collaboration systems on user acceptance201914th International Conference on WirtschaftsinformatikFebruary 24-27, 2019Siegen, Germany
Cited by
Chakraborty, C., Bhattacharya, M., Pal, S., & Lee, S.-S. (2024) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2023.100164 · Cited by 274
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Does the Digital Therapeutic Alliance Exist? Integrative Review
Malouin-Lachance, A., Capolupo, J., Laplante, C., & Hudon, A. (2025) · JMIR Mental Health · doi:10.2196/69294 · Cited by 103
“Goonesekera and Donkin [57] identified anthropomorphic features and engaging content as key facilitators but pointed to technical difficulties and limited interactivity in decision-tree-based chatbots as barriers.”
InfluentialYuan, A., Colato, E. G., Pescosolido, B. A., Song, H., & Samtani, S. (2025) · ACM Transactions on Management Information Systems · doi:10.1145/3701041 · Cited by 109
Sarbay, İ., Berikol, G. B., & Özturan, İ. U. (2023) · Turkish Journal of Emergency Medicine · doi:10.4103/tjem.tjem_79_23 · Cited by 68
Metadata
- Authors
- Goonesekera, Y., & Donkin, L.
- Affiliations
- University of Auckland (NZ)
- Corresponding author
- Donkin, Liesje
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-10-20
- Volume
- 6
- Issue
- 10
- Pages
- e37877
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC9586257
- OpenAlex
- W4296509688
- Cited by
- 43
- References
- 58
- Citations by year
- 2026: 11 · 2025: 12 · 2024: 12 · 2023: 8
- FWCI
- 7.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- health anxiety, cognitive behavioral therapy, chatbots, Otis, COVID-19 pandemic, digital mental health interventions, Facebook Messenger, decision tree, anthropomorphism, feasibility and acceptability, general anxiety, quality of life, well-being, intolerance of uncertainty, barriers to engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


