Digital Health Interventions in Prevention, Relapse, and Therapy of Mild and Moderate Depression: Scoping Review
Open accessPublished version of a preprint
Abstract
Background: Depression is a major cause for disability worldwide, and digital health interventions are expected to be an augmentative and effective treatment. According to the fast-growing field of information and communication technologies and its dissemination, there is a need for mapping the technological landscape and its benefits for users. Objective: The purpose of this scoping review was to give an overview of the digital health interventions used for depression. The main goal of this review was to provide a comprehensive review of the system landscape and its technological state and functions, as well as its evidence and benefits for users. Methods: A scoping review was conducted to provide a comprehensive overview of the field of digital health interventions for the treatment of depression. PubMed, PSYNDEX, and the Cochrane Library were searched by two independent researchers in October 2020 to identify relevant publications of the last 10 years, which were examined using the inclusion and exclusion criteria. To conduct the review, we used Rayyan, a freely available web tool. Results: In total, 65 studies were included in the qualitative synthesis. After categorizing the studies into the areas of prevention, early detection, therapy, and relapse prevention, we found dominant numbers of studies in the area of therapy (n=52). There was only one study for prevention, 5 studies for early detection, and 7 studies for relapse prevention. The most dominant therapy approaches were cognitive behavioral therapy, acceptance and commitment therapy, and problem-solving therapy. Most of the studies revealed significant effects of digital health interventions when cognitive behavioral therapy was applied. Cognitive behavioral therapy as the most dominant form was often provided through web-based systems. Combined interventions consisting of web-based and smartphone-based approaches are increasingly found. Conclusions: Digital health interventions for treating depression are quite comprehensive. There are different interventions focusing on different fields of care. While most interventions can be beneficial to achieve a better depression treatment, it can be difficult to determine which approaches are suitable. Cognitive behavioral therapy through digital health interventions has shown good effects in the treatment of depression, but treatment for depression still stays very individualistic.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many reviews of the evidence for web-based interventions for specific disorders and for specific populations have been undertaken in recent years.
“many reviews of the evidence for web-based interventions for specific disorders (eg, depression [29-31]) and for specific populations (eg, adolescents and young adults [32,33]) have been undertaken in recent years.”
From Web-Based Interventions to Help Australian Adults Address Depression, Anxiety, Suicidal Ideation, and General Mental Well-being: Scoping Review (2022) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1× · see citing works
“PRISMA flow diagram of literature search and selection process [7].”
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 2× · see citing works
“Research questions and inclusion criteria were adapted from Arksey and O’Malley [5].”
A scoping review on the conduct and reporting of scoping reviews
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K., Colquhoun, H., Kastner, M., Levac, D., Ng, C., Sharpe, J. P., Wilson, K., et al. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0116-4 · Cited by 2,250 · cited 1× · see citing works
“Therefore, scoping reviews generate hypotheses, while systematic reviews focus more on testing hypotheses [6].”
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442 · cited 2× · see citing works
“Studies have consistently demonstrated that effects appear to increase with higher levels of human guidance (eg, no guidance vs administrative guidance vs therapist guidance) [4,76].”
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · see citing works
Advantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160 · cited 3× · see citing works
“A steadily increasing amount of empirical data show first indications of patient-related benefits of DHIs, especially the reduction of depressive symptoms; improvement in quality of life; and reduction of direct, indirect, and intangible costs [3].”
InfluentialAndersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 1× · see citing works
“Studies have consistently demonstrated that effects appear to increase with higher levels of human guidance (eg, no guidance vs administrative guidance vs therapist guidance) [4,76].”
Barth, J., Munder, T., Gerger, H., Nüesch, E., Trelle, S., Znoj, H., Jüni, P., & Cuijpers, P. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001454 · Cited by 569 · cited 1× · see citing works
“Especially for mild and moderate depression, there is good evidence for symptom reduction [73].”
Internet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509 · cited 1× · see citing works
“Johansson et al [77] showed in a systematic review of 25 controlled trials that guided internet-based CBT is more effective than unguided internet-based CBT.”
Reducing the global burden of depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Kieling, C., McGorry, P. D., Horton, R., Sargent, J., & Patel, V. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32408-5 · Cited by 422 · cited 2× · see citing works
“Nearly 300 million people are affected worldwide [1].”
BackgroundMobile Sensing and Support for People With Depression: A Pilot Trial in the Wild
Wahle, F., Kowatsch, T., Fleisch, E., Rufer, M., & Weidt, S. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5960 · Cited by 333 · cited 8× · see citing works
“A total of 71% (37/52) of studies reported improvements in d e p r e s s i v e s y m p t o m s [22,30,32,37,40,42,44,46,49-51,53-57,59-64,67,68,70-72], 27% (14/52) reported no (significant) effects [21,31,33-36,41,45,47,48,58,65,66,69], and 2% (1/52) did not consider depressive symptoms as an outcome [52].”
InfluentialWagner, B., Horn, A. B., & Maercker, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.032 · Cited by 311 · cited 4× · see citing works
“Of the studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app…”
InfluentialIntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301 · cited 3× · see citing works
“%) were offered as guided interventions in which a therapist supported t h e p a r t i c i p a n t s [21,25,26,28,29,31-39, 42-44 42-44,”
InfluentialFinding a Depression App: A Review and Content Analysis of the Depression App Marketplace
Shen, N., Levitan, M.-J., Johnson, A., Bender, J. L., Hamilton-Page, M., Jadad, A. (. R., & Wiljer, D. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3713 · Cited by 282 · cited 1× · see citing works
“A review from 2015 identified 82 mobile apps for depression treatment [79].”
Ebert, D. D., Berking, M., Cuijpers, P., Lehr, D., Pörtner, M., & Baumeister, H. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.01.056 · Cited by 268 · cited 2× · see citing works
“Reasons for this are low expectations of their effectiveness, concerns about data security, poor user-friendliness, general skepticism about psychotherapy, and little experience with the internet in general [74].”
Roepke, A. M., Jaffee, S. R., Riffle, O. M., McGonigal, J., Broome, R., & Maxwell, B. (2015) · Games for Health Journal · doi:10.1089/g4h.2014.0046 · Cited by 265 · cited 2× · see citing works
“The majority of studies (41/52) differentiated between an IG and CG and were conducted as randomized controlled trials (RCTs) [22,24,27-29, 33-52 33-52”
Van Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234 · see citing works
Buntrock, C., Ebert, D. D., Lehr, D., Smit, F., Riper, H., Berking, M., & Cuijpers, P. (2016) · JAMA · doi:10.1001/jama.2016.4326 · Cited by 232 · see citing works
Blackwell, S. E., Browning, M. D., Mathews, A., Pictet, A., Welch, J., Davies, J., Watson, P., Geddes, J. R., & Holmes, E. A. (2015) · Clinical Psychological Science · doi:10.1177/2167702614560746 · Cited by 225 · cited 9× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialA randomized controlled trial of three smartphone apps for enhancing public mental health
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.08.003 · Cited by 176 · cited 3× · see citing works
“…studies that chose a CBT approach reported a positive effect on the reduction of d e p r e s s i v e s y m p t o m s [23,24,28,30,32,39,40,44,46,49,50,55,57,60,62,67,70-72], 21% (6/28) could not find any effect in terms of reduction [21,41,43,47,65,66], and 4% (1/28) did not report any…”
Segal, Z. V., Dimidjian, S., Beck, A., Boggs, J. M., Vanderkruik, R., Metcalf, C. A., Gallop, R., Felder, J. N., & Levy, J. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4693 · Cited by 159 · cited 8× · see citing works
“Four studies were financed by countries [14,17,18,20], and 2 studies were privately financed [16,19].”
InfluentialBerger, T., Krieger, T., Sude, K., Meyer, B., & Maercker, A. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.021 · Cited by 153 · cited 5× · see citing works
“…(21/28) of studies that chose a CBT approach reported a positive effect on the reduction of d e p r e s s i v e s y m p t o m s [23,24,28,30,32,39,40,44,46,49,50,55,57,60,62,67,70-72], 21% (6/28) could not find any effect in terms of reduction [21,41,43,47,65,66], and 4% (1/28) did not report…”
InfluentialLappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappalainen, R. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.006 · Cited by 138 · cited 4× · see citing works
“[26,35,38,63,64] and problem-solving therapy (4/52, 8”
InfluentialClarke, J., Proudfoot, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0272-1 · Cited by 138 · cited 2× · see citing works
“In 19% (9/52), mixed forms were used, consisting of 2 or more forms of therapy [27,31,33,34,42,47,51,58,59].”
Pots, W. T. M., Fledderus, M., Meulenbeek, P. A. M., ten Klooster, P. M., Schreurs, K. M. G., & Bohlmeijer, E. T. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.146068 · Cited by 133 · cited 9× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialAguilera, A., Bruehlman-Senecal, E., Demasi, O., & Avila, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6914 · Cited by 122 · cited 6× · see citing works
“%) were offered as guided interventions in which a therapist supported t h e p a r t i c i p a n t s [21,25,26,28,29,31-39, 42-44 42-44,”
InfluentialLüdtke, T., Pult, L. K., Schröder, J., Moritz, S., & Bücker, L. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.08.113 · Cited by 122 · cited 3× · see citing works
“…studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app [47].”
Pratap, A., Renn, B. N., Volponi, J. J., Mooney, S. D., Gazzaley, A. H., Areán, P. A., & Anguera, J. A. (2018) · Journal of Medical Internet Research · doi:10.2196/10130 · Cited by 116 · cited 3× · see citing works
“One study was a comparison of different interventions and did not have a CG [12].”
Lappalainen, P., Langrial, S., Oinas-Kukkonen, H., Tolvanen, A., & Lappalainen, R. (2015) · Behavior Modification · doi:10.1177/0145445515598142 · Cited by 115 · cited 9× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialKleiboer, A. M., Donker, T., Seekles, W., van Straten, A., Riper, H. M., & Cuijpers, P. J. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.013 · Cited by 109 · cited 5× · see citing works
“One of the studies with a reported benefit was a web-based application [37] and the second was a virtual reality intervention [29].”
InfluentialRichards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109 · see citing works
Harnessing Peer Support in an Online Intervention for Older Adults with Depression
Tomasino, K. N., Lattie, E. G., Ho, J., Palac, H. L., Kaiser, S. M., & Mohr, D. C. (2017) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2017.04.015 · Cited by 107 · cited 5× · see citing works
“A total of 71% (37/52) of studies reported improvements in d e p r e s s i v e s y m p t o m s [22,30,32,37,40,42,44,46,49-51, In Figure 3, the type of technology used with reported benefits of the studies is shown.”
InfluentialKelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.014 · Cited by 105 · cited 3× · see citing works
“[26,35,38,63,64] and problem-solving therapy (4/52, 8”
InfluentialThe Effects of Computerized Cognitive Control Training on Community Adults with Depressed Mood
Calkins, A. W., McMorran, K. E., Siegle, G., & Otto, M. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465814000046 · Cited by 105 · cited 10× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
BackgroundMethodInfluentialBuntrock, C., Ebert, D. D., Lehr, D., Riper, H. M., Smit, F., Cuijpers, P. J., & Berking, M. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000438673 · Cited by 102 · cited 6× · see citing works
“In 2 studies, the intervention consisted of web-based cognitive behavioral therapy (CBT) and problem-solving therapy [9,10].”
InfluentialRandomized controlled pilot trial of supportive text messages for patients with depression
Agyapong, V. I. O., Juhás, M., Ohinmaa, A. E., Omeje, J., Mrklas, K., Suen, V. Y. M., Dursun, S. M., & Greenshaw, A. J. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1448-2 · Cited by 102 · cited 9× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialComputer-Assisted Cognitive-Behavior Therapy and Mobile Apps for Depression and Anxiety
Wright, J. H., Mishkind, M., Eells, T. D., & Chan, S. R. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1031-2 · Cited by 93 · cited 1× · see citing works
“Wright et al [78] showed similar results in a recent study from 2019.”
Kivi, M., Eriksson, M. C. M., Hange, D., Petersson, E.-L., Vernmark, K., Johansson, B., & Björkelund, C. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2014.921834 · Cited by 92 · cited 3× · see citing works
“…studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app [47].”
Geraedts, A. S., Kleiboer, A. M., Twisk, J., Wiezer, N. M., van Mechelen, W., & Cuijpers, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3539 · Cited by 89 · see citing works
Dimidjian, S., Beck, A., Felder, J. N., Boggs, J. M., Gallop, R., & Segal, Z. V. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.09.004 · Cited by 87 · cited 6× · see citing works
“Of those, 27 were sponsored by countries [23,25,26,28-32, 35, 40 , In the studies differentiating between an IG and CG, the number of participants ranged from 10 to 1904 participants in the IG (mean 191.0; mode 88) and from 8 to 1901 participants in the CG (mean 179.1; mode 67.5).”
InfluentialKhatri, N., Marziali, E., Tchernikov, I., & Sheppard, N. (2014) · Clinical Interventions in Aging · doi:10.2147/cia.s57832 · Cited by 87 · see citing works
Ebert, D. D., Buntrock, C., Lehr, D., Smit, F., Riper, H., Baumeister, H., Cuijpers, P., & Berking, M. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.05.004 · Cited by 75 · cited 4× · see citing works
“A total of 67% (26/39) of studies identified a benefit [22,23,28,37,40,42,44,46,49,52,55,57,59-64, 67 ,”
InfluentialPictet, A., Jermann, F., & Ceschi, G. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.07.008 · Cited by 73 · cited 2× · see citing works
“Three studies were conducted in Switzerland [54-56] and 4 in Spain [57-60].”
Lambert, J., Greaves, C., Farrand, P., Price, L., Haase, A., & Taylor, A. H. (2018) · Journal of Medical Internet Research · doi:10.2196/10112 · Cited by 73 · cited 2× · see citing works
“In Canada [61,62], Finland [63,64], Sweden [65,66], and Great Britain [67,68] 2 studies each were identified.”
Mira, A., Bretón-López, J., García-Palacios, A., Quero, S., Baños, R. M., & Botella, C. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s130994 · Cited by 71 · cited 9× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
BackgroundMethodInfluentialKenter, R., Cuijpers, P., Beekman, A., & van Straten, A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4861 · Cited by 66 · cited 10× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialRosso, I. M., Killgore, W. D. S., Olson, E. A., Webb, C. A., Fukunaga, R., Auerbach, R. P., Gogel, H., Buchholz, J. L., & Rauch, S. L. (2016) · Depression and Anxiety · doi:10.1002/da.22590 · Cited by 65 · cited 7× · see citing works
“%) were offered as guided interventions in which a therapist supported t h e p a r t i c i p a n t s [21,25,26,28,29,31-39, 42-44 42-44,”
InfluentialBeiwinkel, T., Eißing, T., Telle, N.-T., Siegmund-Schultze, E., & Rössler, W. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6546 · Cited by 62 · cited 5× · see citing works
“%) were offered as guided interventions in which a therapist supported t h e p a r t i c i p a n t s [21,25,26,28,29,31-39, 42-44 42-44,”
InfluentialCrisp, D. A., Griffiths, K. M., Mackinnon, A. J., Bennett, K., & Christensen, H. M. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.01.041 · Cited by 60 · cited 4× · see citing works
“The majority of studies (41/52) differentiated between an IG and CG and were conducted as randomized controlled trials (RCTs) [22,24,27-29, 33-52 33-52”
InfluentialStiles-Shields, C., Montague, E., Kwasny, M. J., & Mohr, D. C. (2019) · Psychological Services · doi:10.1037/ser0000261 · Cited by 59 · cited 2× · see citing works
“%) were offered as guided interventions in which a therapist supported t h e p a r t i c i p a n t s [21,25,26,28,29,31-39, 42-44 42-44,”
Schure, M. B., Lindow, J. C., Greist, J. H., Nakonezny, P. A., Bailey, S. J., Bryan, W. L., & Byerly, M. (2019) · Journal of Medical Internet Research · doi:10.2196/14754 · Cited by 50 · cited 3× · see citing works
“CBT was the dominant form of therapy in 54% (28/52) of the studies [21,23,24,28,30,32,39-41,43-46,48-50,52,55-57,60-62, 65-67,70-72].”
Zwerenz, R., Becker, J., Johansson, R., Frederick, R. J., Andersson, G., & Beutel, M. E. (2017) · JMIR Mental Health · doi:10.2196/mental.7889 · Cited by 46 · see citing works
Tulbure, B. T., Rusu, A., Sava, F. A., Sălăgean, N., & Farchione, T. J. (2018) · JMIR Mental Health · doi:10.2196/mental.8901 · Cited by 43 · see citing works
Rycroft‐Malone, J., Gradinger, F., Griffiths, H. O., Anderson, R., Crane, R. S., Gibson, A., Mercer, S. W., & Kuyken, W. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026244 · Cited by 42 · cited 1× · see citing works
“Although there is an increasing awareness of mental health issues, accessibility to health care has been a key problem [2].”
Zwerenz, R., Baumgarten, C., Becker, J., Tibubos, A. N., Siepmann, M., Knickenberg, R. J., & Beutel, M. E. (2019) · Journal of Medical Internet Research · doi:10.2196/13655 · Cited by 42 · cited 3× · see citing works
“Some studies used CBT , either Five studies described depression-specific symptoms as primary outcome [15-17, 19,”
Gili, M., Castro, A., García‐Palacios, A., García‐Campayo, J., Mayoral, F., Botella, C., Roca, M., Barceló‐Soler, A., Hurtado, M. M., Navarro, M., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/15845 · Cited by 36 · cited 1× · see citing works
“In 19% (9/52), mixed forms were used, consisting of 2 or more forms of therapy [27,31,33,34,42,47,51,58,59].”
Lauritsen, L., Andersen, L., Olsson, E. C., Søndergaard, S. R., Nørregaard, L. B., Løventoft, P. K., Svendsen, S. D., Frøkjær, E., Jensen, H. M., Hageman, I., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6673 · Cited by 33 · cited 3× · see citing works
“Some studies used CBT , either Five studies described depression-specific symptoms as primary outcome [15-17, 19,”
Geraedts, A. S., van Dongen, J. M., Kleiboer, A. M., Wiezer, N. M., van Mechelen, W., Cuijpers, P. J., & Bosmans, J. E. (2015) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000000423 · Cited by 32 · cited 9× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
BackgroundMethodInfluentialImamura, K., Kawakami, N., Tsuno, K., Tsuchiya, M., Shimada, K., & Namba, K. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.05.045 · Cited by 31 · cited 3× · see citing works
“Of the studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app…”
Fogarty, A. S., Proudfoot, J. G., Whittle, E. L., Clarke, J., Player, M. J., Christensen, H. M., & Wilhelm, K. A. (2017) · JMIR Mental Health · doi:10.2196/mental.7769 · Cited by 31 · cited 1× · see citing works
“Four studies were conducted in Australia [50-53].”
Sandoval, L., Buckey, J., Ainslie, R., Tombari, M., Stone, W., & Hegel, M. T. (2016) · The Behavior Therapist · doi:10.1016/j.beth.2016.04.001 · Cited by 29 · cited 5× · see citing works
“One of the studies with a reported benefit was a web-based application [37] and the second was a virtual reality intervention [29].”
InfluentialKlein, N. S., Bockting, C., Wijnen, B. F. M., Kok, G. D., van Valen, E., Riper, H. M., Cuijpers, P. J., Dekker, J., van der Heiden, C., Burger, H., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/10437 · Cited by 29 · cited 4× · see citing works
“Four out of the 7 studies chose CBT as a therapeutic approach [16-18 ,20].”
InfluentialAdherence predictors in an Internet-based Intervention program for depression
Castro, A., del Hoyo, Y. L., Peake, C., Mayoral, F., Botella, C., García‐Campayo, J., Baños, R., Nogueira‐Arjona, R., Roca, M., & Gili, M. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1366546 · Cited by 27 · see citing works
Bücker, L., Schnakenberg, P., Karyotaki, E., Moritz, S., & Westermann, S. (2019) · Journal of Medical Internet Research · doi:10.2196/14240 · Cited by 27 · cited 3× · see citing works
“…studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app [47].”
Flygare, A.-L., Engström, I., Hasselgren, M., Jansson-Fröjmark, M., Frejgrim, R., Andersson, G., & Holländare, F. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100303 · Cited by 26 · cited 10× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialSchlicker, S., Ebert, D., Middendorf, T., Titzler, I., & Berking, M. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.10.047 · Cited by 25 · cited 2× · see citing works
“One study did not provide information on financing [15].”
Brief Web-Based Intervention for Depression: Randomized Controlled Trial on Behavioral Activation
Jelinek, L., Arlt, S., Moritz, S., Schröder, J., Westermann, S., & Cludius, B. (2019) · Journal of Medical Internet Research · doi:10.2196/15312 · Cited by 25 · cited 1× · see citing works
“The remaining studies either focused on cognitive restructuring [54], cognitive control therapy [22], behavioral activation [45,68], or supplied no information about the therapeutic approach that was used [25].”
Schuster, R., Fichtenbauer, I., Sparr, V. M., Berger, T., & Laireiter, A.-R. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018412 · Cited by 23 · cited 10× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialGräfe, V., Moritz, S., & Greiner, W. (2020) · Health Economics Review · doi:10.1186/s13561-020-00273-0 · Cited by 22 · cited 5× · see citing works
“%) were offered as guided interventions in which a therapist supported t h e p a r t i c i p a n t s [21,25,26,28,29,31-39, 42-44 42-44,”
InfluentialMira, A., Bretón-López, J., Enrique, Á., Castilla, D., García-Palacios, A., Baños, R., & Botella, C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02360 · Cited by 21 · cited 4× · see citing works
“Three studies were conducted in Switzerland [54-56] and 4 in Spain [57-60].”
InfluentialHirsch, A., Luellen, J. K., Holder, J., Steinberg, G., Dubiel, T., Blazejowskyj, A., & Schladweiler, K. M. (2017) · JMIR Research Protocols · doi:10.2196/resprot.7203 · Cited by 20 · cited 3× · see citing works
“A total of 75% (21/28) of studies that chose a CBT approach reported a positive effect on the reduction of d e p r e s s i v e s y m p t o m s [23,24,28,30,32,39,40,44,46,49,50,55,57,60,62,67,70-72], 21% (6/28) could not find any effect in terms of reduction [21,41,43,47,65,66], and 4% (1/28) did…”
Schmädeke, S., & Bischoff, C. (2015) · Verhaltenstherapie · doi:10.1159/000441856 · Cited by 15 · see citing works
Hatcher, S., Whittaker, R., Patton, M., Miles, W., Ralph, N., Kercher, K., & Sharon, C. (2018) · JMIR Mental Health · doi:10.2196/mental.8510 · Cited by 15 · cited 3× · see citing works
“New Zealand [69], Austria [70], Ireland [71], and Japan [72] were each represented with 1 study (Multimedia Appendix 1).”
Effect of a Mobile Monitoring System vs Usual Care on Depression Symptoms and Psychological Health
Place, S. S., Blanch‐Hartigan, D., Smith, V., Erb, J. L., Marci, C. D., & Ahern, D. K. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.19403 · Cited by 15 · cited 7× · see citing works
“In Place et al [11], the intervention consisted of a monitoring system that collected different types of metadata and clinicians providing feedback.”
InfluentialKraft, S., Wolf, M., Klein, T., Becker, T. M., Bauer, S., & Puschner, B. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7095 · Cited by 14 · cited 3× · see citing works
“In the area of relapse prevention, 4 studies from Germany [14-17], 1 study from the Netherlands [18], 1 study from Denmark [19], and 1 from the United States [20] were identified (Multimedia Appendix 1).”
Gräfe, V., Berger, T., Hautzinger, M., Hohagen, F., Lutz, W., Meyer, B., Moritz, S., Rose, M., Schröder, J., Späth, C., et al. (2019) · Health Economics Review · doi:10.1186/s13561-019-0233-y · Cited by 14 · cited 3× · see citing works
“…studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app [47].”
Pilot study of psychotherapeutic text messaging for depression
Pfeiffer, P. N., Henry, J., Ganoczy, D. A., & Piette, J. D. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16659955 · Cited by 11 · cited 10× · see citing works
“Other therapy approaches such as ACT (5/52, 9%) [26,35,38,63,64] and problem-solving therapy (4/52, 8%) [29,36,37,69] were significantly less common in interventions.”
BackgroundMethodInfluentialCastro, A., García‐Palacios, A., del Hoyo, Y. L., Mayoral, F., Pérez-Ara, M. Á., Baños, R. M., García‐Campayo, J., Hurtado, M. M., Botella, C., Barceló‐Soler, A., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041774 · Cited by 9 · cited 5× · see citing works
“CBT was the dominant form of therapy in 54% (28/52) of the studies [21,23,24,28,30,32,39-41,43-46,48-50,52,55-57,60-62, 65-67,70-72].”
InfluentialZagorscak, P., Heinrich, M., Bohn, J., Stein, J., & Knaevelsrud, C. (2019) · Brain and Behavior · doi:10.1002/brb3.1484 · Cited by 7 · cited 10× · see citing works
“Most of the studies (39/52, 75%) used a web-based system in which an application was used online [21-23,28,33-46,48,49,52-55,57-67,69-72].”
InfluentialGräfe, V., Moritz, S., & Greiner, W. (2020) · Health Economics Review · doi:10.1186/s13561-020-00280-1 · Cited by 5 · see citing works
Löbner, M., Dorow, M., Pabst, A., Stein, J., Kersting, A., Luppa, M., König, H., & Riedel-Heller, S. G. (2019) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/a-0849-9802 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [42]Ebert DD Buntrock C Lehr D Smit F Riper H Baumeister H Cuijpers P Berking M Effectiveness of web- and mobile-based treatment of subthreshold depression with adherence-focused guidance: a single-blind randomized controlled trial Behav Ther 2018 12 49 1 71 83 10.1016/j.beth.2017.05.004 29405923 29405923 · DOI · Paper page
Cited by
Sorted by citations
Problems and Barriers Related to the Use of Digital Health Applications: Scoping Review
Giebel, G. D., Speckemeier, C., Abels, C., Plescher, F., Börchers, K., Wasem, J., Blase, N., & Neusser, S. (2023) · Journal of Medical Internet Research · doi:10.2196/43808 · Cited by 238 · see citing works
Coaching to Support Mental Health Apps: Exploratory Narrative Review
Meyer, A., Wisniewski, H., & Torous, J. (2022) · JMIR Human Factors · doi:10.2196/28301 · Cited by 34 · see citing works
The Economics of Treatment for Depression
Stecher, C. D., Cloonan, S., & Domino, M. E. (2023) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-061022-040533 · Cited by 42 · see citing works
Ariöz, U., Smrke, U., Plohl, N., & Mlakar, I. (2022) · Diagnostics · doi:10.3390/diagnostics12112683 · Cited by 34 · see citing works
“Even in our scoping review, the sizes of the datasets were not sufficient (DAIC-WOZ, 189 subjects; BDC WB, 51 subjects; AViD-C, 84 subjects).”
Cederberg, M., Alsén, S., Ali, L., Ekman, I., Glise, K., Jónsdóttir, I. H., Gyllensten, H., Swedberg, K. B., & Fors, A. (2022) · JMIR Mental Health · doi:10.2196/30966 · Cited by 24 · see citing works
“Internet interventions have proven to be a viable alternative to face-to-face treatments in patients with CMDs [13-16].”
Catella, S., Gendreau, R. M., Kraus, A. C., Vega, N., Rosenbluth, M. J., Soefje, S., Malhotra, S., Luciano, J. V., McCracken, L. M., Williams, D. A., et al. (2024) · Journal of Behavioral Medicine · doi:10.1007/s10865-023-00429-3 · Cited by 23 · see citing works
“…to effectively decrease anxiety and depression, conditions commonly comorbid with FM (Dahlin et al., 2016 ; Han & Kim, 2022 ; Kelson et al., 2019 ; Lappalainen et al., 2014 ; Lappalainen et al., 2015 ; Pots et al., 2016 ; Rickardsson et al., 2021 ; Thompson et al., 2021 ; Tokgoz et al., 2021 ).”
BackgroundFatouros, P., Tsirmpas, C., Andrikopoulos, D., Kaplow, S., Kontoangelos, K. A., & Papageorgiou, C. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01511-7 · Cited by 27 · see citing works
“These results indicate robustreductionsinsymptomsacrossbothdepressionandanxiety,aligning with fi ndingsfrompreviousstudiesofdigitalhealthinterventionsformental health 26,52 – 54 .”
Amin, R., Schreynemackers, S., Oppenheimer, H., Petrovic, M., Hegerl, U., & Reich, H. (2025) · Journal of Medical Internet Research · doi:10.2196/57418 · Cited by 24 · see citing works
“In between the episodes, there are symptom-free intervals, during which well-managed strategies might prevent the risk of a worsening status [8,9].”
Posselt, J., Baumann, E., & Dierks, M. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1275569 · Cited by 17 · see citing works
“Further, many research results generally do not suf fi ciently distinguish between different digital approaches in mental health or DTx and non-medical applications (42, 43).”
BackgroundYosep, I., Suryani, S., Mediani, . S., Mardhiyah, A., & Maulana, I. (2023) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s416424 · Cited by 19 · see citing works
“Previous scoping review also found that digital-based nursing interventions were given to students to reduce student anxiety.(29,32) While students have other problems such as stress, depression, and anxiety.”
BackgroundKernebeck, S., Scheibe, M., Sinha, M., Fischer, F., Knapp, A., Timpel, P., Harst, L., Reininghaus, U., & Vollmar, H. C. (2022) · Das Gesundheitswesen · doi:10.1055/a-1933-2779 · Cited by 16 · see citing works
“Diese und weitere Herausforderungen bei der Evaluation [6] und Evidenzgenerierung [7] spiegeln sich in den Ergebnissen verschie-dener Übersichtsarbeiten wider, die auf eine eingeschränkte bis moderate Evidenz hinweisen [8, 9].”
BackgroundHäfner, J., Schönfeld, S., Tokgöz, P., Choroschun, K., Schlubach, A., & Dockweiler, C. (2022) · Healthcare · doi:10.3390/healthcare10102019 · Cited by 13 · see citing works
“Digital health interventions (DHIs) could be a solution to overcome existing or potential problems [4,5].”
BackgroundSelf-citationThe potential of psilocybin use to enhance well-being in healthy individuals – A scoping review
Wiepking, L., de Bruin, E. J., & Ghiţă, A. (2023) · Journal of Psychedelic Studies · doi:10.1556/2054.2023.00244 · Cited by 11 · see citing works
“This is useful if the evidence on a topic is scarce (Tokgöz, Hrynyschyn, Hafner, Schönfeld, & Dockweiler, 2021) as is the case for research on psilocybin and the effect on well-being in healthy individuals.”
BackgroundThe VESPA Project: Virtual Reality Interventions for Neurocognitive and Developmental Disorders
Merlo, E. M., Myles, L. A. M., & Pappalardo, S. (2022) · Journal of Mind and Medical Sciences · doi:10.22543/7674.91.p1627 · Cited by 11 · see citing works
“Evidence adheres to several domains, such as in the case of cognitive deficits linked to developmental disorders and diseases [7,8], psychiatric conditions [9-16] and neurocognitive disorders [17-23].”
BackgroundGuided Internet-Delivered Treatment for Depression: Scoping Review
Børtveit, L., Dechsling, A., Sütterlin, S., Nordgreen, T., & Nordahl‐Hansen, A. (2022) · JMIR Mental Health · doi:10.2196/37342 · Cited by 11 · see citing works
Skaczkowski, G., van der Kruk, S., Loxton, S., Hughes-Barton, D., Howell, C., Turnbull, D., Jensen, N., Smout, M., & Gunn, K. (2022) · JMIR Mental Health · doi:10.2196/31018 · Cited by 9 · see citing works
“We note that many reviews of the evidence for web-based interventions for specific disorders (eg, depression [29-31]) and for specific populations (eg, adolescents and young adults [32,33]) have been undertaken in recent years.”
BackgroundPosselt, J., Klawunn, R., & Dierks, M. (2023) · Zeitschrift für Allgemeinmedizin · doi:10.1007/s44266-023-00034-2 · Cited by 9 · see citing works
Peiper, N. C., Pettitt, A., Shah, B., Atwood, O., Sivonen, E., & Pfeffer, J. (2025) · JMIR Formative Research · doi:10.2196/71828 · Cited by 3 · see citing works
“Recently, digital coaching programs (DCP) have emerged as viable interventions grounded in behavioral science principles to help people with subclinical mental health problems improve their mental well-being, reduce stress, and prevent the onset of mental disorders [19].”
Digital Technologies and Artificial Intelligence in Cardiac Rehabilitation
Hamilton, D. E., Xie, J. X., Chang, A. L., Beatty, A. L., & Golbus, J. R. (2025) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000935 · Cited by 3 · see citing works
Web-Based Psychotherapy and Exercise Interventions for Depressive and Anxiety Disorders
Carneiro, L. S. R. D. S. F., Afonso, J. R., Clemente, F. M., & Frontini, R. (2021) · Advances in psychology, mental health, and behavioral studies (APMHBS) book series · doi:10.4018/978-1-7998-8634-1.ch005 · Cited by 3 · see citing works
Relapse prevention following guided self-help for common health problems: A Scoping Review
Nawaz, S., Bee, P., Devaney, H., & Faija, C. (2024) · Cognitive Therapy and Research · doi:10.1007/s10608-024-10520-x · Cited by 2 · see citing works
“A standard systematic review, differ - ently to a scoping review, aims to answer a specific research question (Tokgöz et al., 2021) and can be undertaken to confirm or refute hypotheses, report on the quality of the evi - dence base or address any variations or uncertainty (Munn et al., 2018).”
Denecke, K., Rivera-Romero, O., Wynn, R., & Gabarrón, E. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1429304 · Cited by 2 · see citing works
Smith, A. C., Ahuvia, I. L., Zapata, J. P., Cohen, K. A., Graham, A. K., & Schleider, J. L. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104809 · Cited by 2 · see citing works
Zimmermann, M., & Papa, A. (2023) · Mental Health & Prevention · doi:10.1016/j.mhp.2023.200298 · Cited by 2 · see citing works
Pettitt, A., Nelson, B. W., Forman‐Hoffman, V. L., Goldin, P. R., & Peiper, N. C. (2024) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12517 · Cited by 3 · see citing works
Pettitt, A., Nelson, B. W., Forman‐Hoffman, V. L., Goldin, P. R., & Peiper, N. C. (2022) · doi:10.31219/osf.io/8jvtd · Cited by 2 · see citing works
Promotion and Prevention of Oral Cancer in the Digital Era
Jaber, M. A., & Elameen, E. M. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-3872-8.ch011 · Cited by 1 · see citing works
Børtveit, L., Nordgreen, T., & Nordahl‐Hansen, A. (2024) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104510 · Cited by 1 · see citing works
Peiper, N. C., Pettitt, A., Shah, B., Atwood, O., & Pfeffer, J. (2023) · doi:10.31234/osf.io/8adpu · Cited by 1 · see citing works
Gleicher Maßstab bei App und Medikament
Abholz, H. (2023) · Zeitschrift für Allgemeinmedizin · doi:10.1007/s44266-023-00110-7
Jusoh, M. Y. F., & Ishak, N. A. (2024) · International Journal of Education Psychology and Counseling · doi:10.35631/ijepc.953036
“Penyelidikan telah menunjukkan bahawa intervensi CBT berasaskan web berkesan untuk mengurangkan gejala kemurungan (Tokgöz, Hrynyschyn, Hafner, Schönfeld, & Dockweiler, 2021).”
Attridge, M. D. (2024) · Qeios · doi:10.32388/4ys33s.3
“While most of these technological programs focus on specific disorders for education or self-treatment goals - such as depression [54] - the comorbidity of multiple behavioral health risk factors often is not assessed.”
de Lange, I. G. S., Albers, M. R. C., Scheepstra, K. W. F., Bockting, C., & Aben, L. (2026) · doi:10.2196/preprints.101839
de Lange, I. G. S., Albers, M. R. C., Scheepstra, K. W. F., Bockting, C., & Aben, L. (2026) · JMIR Research Protocols · doi:10.2196/101839
“Previous research has shown that online CBT is as effective as face-to-face treatment [47-49].”
- Authors
- Tokgöz, P., Hrynyschyn, R., Hafner, J., Schönfeld, S., & Dockweiler, C.
- Affiliations
- Bielefeld University (DE)
- Humboldt-Universität zu Berlin (DE)
- Witten/Herdecke University (DE)
- Corresponding author
- Tokgöz, Pinar
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2021-04-16
- Volume
- 8
- Issue
- 4
- Pages
- e26268
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC8087966
- OpenAlex
- W3133325027
- Cited by
- 36
- References
- 82
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 9 · 2023: 9 · 2022: 9 · 2021: 1
- FWCI
- 1.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion, cc-by)
- Funders
- Landeszentrum Gesundheit Nordrhein-Westfalen
- Deutsche Forschungsgemeinschaft
- Universität Bielefeld
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- digital health interventions, depression, depression prevention, relapse prevention, early detection of depression, cognitive behavioral therapy, acceptance and commitment therapy, problem-solving therapy, online intervention, smartphone-based intervention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review