CoChat
Sign Up
Cited by 65

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

Vickybot, a Chatbot for Anxiety-Depressive Symptoms and Work-Related Burnout in Primary Care and Health Care Professionals: Development, Feasibility, and Potential Effectiveness Studies

Anmella, Gerard, Sanabra, Miriam, Primé-Tous, Mireia, Segú, Xavier, Cavero, Myriam, Morilla, Ivette, Grande, Iria, Ruiz, Victoria, Mas, Ariadna, Martín-Villalba, Inés, Caballo, Alejandro, Esteva, Julia-Parisad, Rodríguez-Rey, Arturo, Piazza, Flavia, Valdesoiro, Francisco José, Rodriguez-Torrella, Claudia, Espinosa, Marta, Virgili, Giulia, Sorroche, Carlota, Ruiz, Alicia, Solanes, Aleix, Radua, Joaquim, Also, María Antonieta, Sant, Elisenda, Murgui, Sandra, Sans-Corrales, Mireia, H Young, Allan, Vicens, Victor, Blanch, Jordi, Caballeria, Elsa, López-Pelayo, Hugo, López, Clara, Olivé, Victoria, Pujol, Laura, Quesada, Sebastiana, Solé, Brisa, Torrent, Carla, Martínez-Aran, Anabel, Guarch, Joana, Navinés, Ricard, Murru, Andrea, Fico, Giovanna, de Prisco, Michele, Oliva, Vicenzo, Amoretti, Silvia, Pio-Carrino, Casimiro, Fernández-Canseco, María, Villegas, Marta, Vieta, Eduard, Hidalgo-Mazzei, Diego·2023·Journal of Medical Internet Research
DOI 10.2196/43293PMC PMC10131622

Published version of a preprint

Open this paper in CoChat — free account

Abstract

Background: Many people attending primary care (PC) have anxiety-depressive symptoms and work-related burnout compounded by a lack of resources to meet their needs. The COVID-19 pandemic has exacerbated this problem, and digital tools have been proposed as a solution. Objective: We aimed to present the development, feasibility, and potential effectiveness of Vickybot, a chatbot aimed at screening, monitoring, and reducing anxiety-depressive symptoms and work-related burnout, and detecting suicide risk in patients from PC and health care workers. Methods: Healthy controls (HCs) tested Vickybot for reliability. For the simulation study, HCs used Vickybot for 2 weeks to simulate different clinical situations. For feasibility and effectiveness study, people consulting PC or health care workers with mental health problems used Vickybot for 1 month. Self-assessments for anxiety (Generalized Anxiety Disorder 7-item) and depression (Patient Health Questionnaire-9) symptoms and work-related burnout (based on the Maslach Burnout Inventory) were administered at baseline and every 2 weeks. Feasibility was determined from both subjective and objective user-engagement indicators (UEIs). Potential effectiveness was measured using paired 2-tailed t tests or Wilcoxon signed-rank test for changes in self-assessment scores. Results: Overall, 40 HCs tested Vickybot simultaneously, and the data were reliably transmitted and registered. For simulation, 17 HCs (n=13, 76% female; mean age 36.5, SD 9.7 years) received 98.8% of the expected modules. Suicidal alerts were received correctly. For the feasibility and potential effectiveness study, 34 patients (15 from PC and 19 health care workers; 76% [26/34] female; mean age 35.3, SD 10.1 years) completed the first self-assessments, with 100% (34/34) presenting anxiety symptoms, 94% (32/34) depressive symptoms, and 65% (22/34) work-related burnout. In addition, 27% (9/34) of patients completed the second self-assessment after 2 weeks of use. No significant differences were found between the first and second self-assessments for anxiety (t8=1.000; P=.34) or depressive (t8=0.40; P=.70) symptoms. However, work-related burnout scores were moderately reduced (z=−2.07, P=.04, r=0.32). There was a nonsignificant trend toward a greater reduction in anxiety-depressive symptoms and work-related burnout with greater use of the chatbot. Furthermore, 9% (3/34) of patients activated the suicide alert, and the research team promptly intervened with successful outcomes. Vickybot showed high subjective UEI (acceptability, usability, and satisfaction), but low objective UEI (completion, adherence, compliance, and engagement). Vickybot was moderately feasible. Conclusions: The chatbot was useful in screening for the presence and severity of anxiety and depressive symptoms, and for detecting suicidal risk. Potential effectiveness was shown to reduce work-related burnout but not anxiety or depressive symptoms. Subjective perceptions of use contrasted with low objective-use metrics. Our results are promising but suggest the need to adapt and enhance the smartphone-based solution to improve engagement. A consensus on how to report UEIs and validate digital solutions, particularly for chatbots, is required.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/43293

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 75

  1. 10.1016/j.anyes.2017.10.005 · DOI
  2. 10.1007/s00127-009-0056-y · DOI
  3. 10.1192/bjp.bp.106.023507 · DOI
  4. 10.1016/j.anyes.2017.10.002 · DOI
  5. 10.4321/s1699-695x2012000100007 · DOI
  6. 10.4321/s0211-57352015000200002 · DOI
  7. 10.1177/0706743716640288 · DOI
  8. 10.1186/s12875-015-0252-7 · DOI
  9. 10.1192/j.eurpsy.2022.28 · DOI
  10. 10.1016/j.rpsm.2020.05.010 · DOI
  11. 10.1176/ps.62.2.pss6202_0152 · DOI
  12. 10.1157/13079144 · DOI
  13. 10.1157/13079145 · DOI
  14. 10.3390/ijerph13121177 · DOI
  15. 10.1016/j.rpsm.2022.12.001 · DOI
  16. 10.1016/j.rpsm.2020.07.003 · DOI
  17. 10.1016/j.rpsm.2020.04.004 · DOI
  18. 10.1016/j.jad.2020.06.027 · DOI
  19. 10.1016/j.rpsm.2020.05.004 · DOI
  20. 10.1016/j.rpsm.2020.12.001 · DOI
  21. 10.1016/j.jpsychires.2022.02.009 · DOI
  22. 10.1002/da.23129 · DOI
  23. 10.1037/tra0000914 · DOI
  24. 10.1016/S2215-0366(20)30047-X · DOI · Paper page
  25. 10.1016/j.rpsm.2020.04.009 · DOI
  26. 10.1016/j.jad.2020.05.061 · DOI
  27. 10.1146/annurev.psych.52.1.397 · DOI · Paper page
  28. 10.1186/1471-244X-12-18 · DOI
  29. 10.1136/bmjopen-2016-012816 · DOI
  30. 10.1016/S0140-6736(19)31573-9 · DOI
  31. 10.1056/NEJMp2003539 · DOI · Paper page
  32. 10.1016/j.rpsm.2020.06.001 · DOI
  33. 10.1080/08854726.2019.1670539 · DOI
  34. 10.2196/34951 · DOI
  35. 10.1007/s40501-018-0154-0 · DOI · Paper page
  36. 10.3389/fpsyt.2019.00094 · DOI
  37. 10.1016/j.jad.2016.04.042 · DOI · Paper page
  38. 10.1016/j.jad.2018.08.048 · DOI
  39. 10.2196/16862 · DOI
  40. 10.2196/10042 · DOI · Paper page
  41. 10.1111/acps.13093 · DOI
  42. 10.1111/acps.13149 · DOI
  43. 10.1016/j.rpsm.2021.04.003 · DOI
  44. 10.1001/archinte.166.10.1092 · DOI · Paper page
  45. 10.1097/00006842-200107000-00021 · DOI · Paper page
  46. Maslach, C, 1986, Evaluating Stress: A Book of Resources
  47. Aguayo, R, 2011, Int J Clin Heal Psychol, 11, 343
  48. Luis Martorell, J, 2014, Psicoterapiascuelas y Conceptos Básicos. 2da edición
  49. Barlow, DH, 2021, Clinical Handbook of Psychological Disorders: A Step-by-Step Treatment Manual. 6th edition
  50. Díaz, MI, 2017, Manual de Técnicas y Terapias Cognitivo Conductuales
  51. Linehan, MM, 2015, Skills Training Manual for Treating Borderline Personality Disorder. DBT Skills Training Manual. 2nd edition
  52. Wilson, KG, 2007, Terapia de aceptacion y compromiso (ACT) (Psicologia / Psychology). Spanish edition
  53. Lehrhaupt, L, 2017, Mindfulness-Based Stress Reduction: The MBSR Program for Enhancing Health and Vitality
  54. 10.2196/15433 · DOI
  55. 10.1111/bdi.13243 · DOI
  56. 10.1016/j.euroneuro.2022.08.001 · DOI
  57. 10.2196/39129 · DOI
  58. 10.1093/jamia/ocaa301 · DOI · Paper page
  59. 10.2196/21678 · DOI · Paper page
  60. 10.3233/SHTI210719 · DOI
  61. 10.1016/S0140-6736(22)00173-8 · DOI
  62. 10.4088/JCP.20l13702 · DOI
  63. 10.1016/j.euroneuro.2021.06.005 · DOI
  64. 10.1016/j.euroneuro.2021.05.011 · DOI
  65. 10.1016/j.euroneuro.2021.11.006 · DOI
  66. 10.1007/s11920-019-1119-8 · DOI · Paper page
  67. 10.1176/appi.prcp.20200029 · DOI
  68. 10.1017/S0033291719000710 · DOI
  69. 10.1016/j.ijmedinf.2021.104440 · DOI
  70. 10.1016/j.jad.2020.12.168 · DOI
  71. 10.2196/31565 · DOI
  72. 10.3389/fpubh.2022.865712 · DOI
  73. 10.2196/28577 · DOI · Paper page
  74. 10.1038/s41746-022-00604-x · DOI
  75. 10.1002/wps.20592 · DOI · Paper page

Cited by

Sorted by citations

Metadata

Authors
Anmella, G., Sanabra, M., Primé-Tous, M., Segú, X., Cavero, M., Morilla, I., Grande, I., Ruiz, V., Mas, A., Martín-Villalba, I., Caballo, A., Esteva, J.-P., Rodríguez-Rey, A., Piazza, F., Valdesoiro, F. J., Rodriguez-Torrella, C., Espinosa, M., Virgili, G., Sorroche, C., Ruiz, A., Solanes, A., Radua, J., Also, M. A., Sant, E., Murgui, S., Sans-Corrales, M., H Young, A., Vicens, V., Blanch, J., Caballeria, E., López-Pelayo, H., López, C., Olivé, V., Pujol, L., Quesada, S., Solé, B., Torrent, C., Martínez-Aran, A., Guarch, J., Navinés, R., Murru, A., Fico, G., de Prisco, M., Oliva, V., Amoretti, S., Pio-Carrino, C., Fernández-Canseco, M., Villegas, M., Vieta, E., & Hidalgo-Mazzei, D.
ORCID
Venue
Journal of Medical Internet Research
Publisher
JMIR Publications Inc.
Published
2023-04-03
Volume
25
Pages
e43293
ISSN
1438-8871
DOI
10.2196/43293
PMC
PMC10131622
Cited by
65
References
23
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review