Cognitive-Behavioral Therapy in the Digital Age: Presidential Address
Open accessThe DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
Our field has come a long way in establishing cognitive-behavioral therapy as the empirically supported treatment of choice for a wide range of mental and behavioral health problems. Nevertheless, most individuals with mental disorders do not receive any care at all, and those who do often have difficulty accessing care that is consistently high in quality. Addressing these issues is complex and costly and thus progress has been slow. We are entering an exciting stage in which emerging technologies might offer novel solutions to the treatment gap. This paper discusses a number of technology-enabled solutions to our field's challenges, including Internet-based and smartphone-based cognitive-behavioral therapy. Nevertheless, we must remain attentive to potential pitfalls of these emerging technologies. The paper incorporates suggestions for how the field may approach these potential pitfalls and provides a vision for how we might develop powerful, scalable, precisely timed, personalized interventions to enhance global mental health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12381 · Cited by 3,990
(2004) · JAMA · doi:10.1001/jama.291.21.2581 · Cited by 3,448 · cited 1×
“Thus, even if all psychologists provided psychotherapy to 50 clients per week, only 3,185 patients would receive care in a given year, whereas the prevalence estimates would suggest that 26,400 meet criteria for a psychological disorder yearly (Demyttenaere et al., 2004).”
BackgroundThe global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846 · cited 1×
“Similarly, across the globe, one in five persons suffers from a mood, anxiety, and/or substance use disorder in any given year (Steel et al., 2014).”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 2×
“A randomized controlled trial of Woebot (N = 70) showed that depression symptoms reduced more in nonclinical college students who interacted with Woebot compared to students in an information-only control condition, with a medium effect (Fitzpatrick et al., 2017).”
BackgroundInfluentialWang, P. S., Lane, M., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.629 · Cited by 2,695
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
The World’s Technological Capacity to Store, Communicate, and Compute Information
Hilbert, M., & López, P. (2011) · Science · doi:10.1126/science.1200970 · Cited by 1,643
Stigma and its public health implications
Link, B. G., & Phelan, J. C. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68184-1 · Cited by 1,498
Depression Is the Leading Cause of Disability Around the World
Friedrich, M. J. (2017) · JAMA · doi:10.1001/jama.2017.3826 · Cited by 1,459
Wang, P. S., Berglund, P., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.603 · Cited by 1,325
Twenge, J. M., & Campbell, W. K. (2018) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2018.10.003 · Cited by 1,304
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 2×
“In addition to the potential for I-CBT to be more accessible to patients, metaanalyses have shown superiority of I-CBT to waitlist control groups, and randomized controlled trials have shown I-CBT to have approximately equivalent efficacy compared to face-to-face CBT (Andrews et al., 2018; Carlbring, Andersson, Cuijpe…”
MethodHollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846 · cited 1×
“Ultimately, however, most published studies of technology-based treatments to date do not include details on the level of human support provided (Hollis et al., 2017), underscoring the importance of further research that specifically seeks to elucidate how much and what kind of human support is necessary to efficientl…”
BackgroundPersonal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802
Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675
Using the Internet to provide cognitive behaviour therapy
Andersson, G. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.01.010 · Cited by 560 · cited 1×
“Many pioneers have made great strides in developing these treatments and evaluating the efficacy of I-CBT (e.g., Andersson, 2009; Andersson, Carlbring, Berger, Almlöv, & Cuijpers, 2009; Andersson et al., 2016; Batterham et al., 2015; Bergström et al., 2010; Carlbring, Ekselius, & Andersson, 2003;…”
BackgroundNewman, M. G., Szkodny, L. E., Llera, S. J., & Przeworski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.008 · Cited by 480 · cited 1×
“Although the amount of support required for engagement may vary depending on the type of clinical issues being addressed (Newman et al., 2011), it appears that only a small amount of therapist time may be necessary to meaningfully bolster engagement.”
BackgroundMoskowitz, D. S., & Young, S. N. (2006) · Journal of Psychiatry and Neuroscience · doi:10.1139/jpn.0602 · Cited by 457
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438
Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432
Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1176 · Cited by 412 · cited 1×
“Last, although the fidelity of in-person therapy to validated techniques can vary dramatically in outpatient settings (Weisz et al., 2013; Zima et al., 2005), app-based treatments have the potential to deliver standardized care across persons.”
BackgroundPinto, A., Mancebo, M. C., Eisen, J. L., Pagano, M. E., & Rasmussen, S. A. (2006) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v67n0503 · Cited by 386
The need to approximate the use-case in clinical machine learning
Saeb, S., Lonini, L., Jayaraman, A., Mohr, D. C., & Kording, K. P. (2017) · GigaScience · doi:10.1093/gigascience/gix019 · Cited by 367
Torous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · cited 3×
“It is important to note that reliance on app store “star ratings” is not sufficient, as star ratings do not correlate strongly with an app’s clinical utility (Singh et al., 2016; Torous & Roberts, 2017).”
BackgroundUsing science to sell apps: Evaluation of mental health app store quality claims
Larsen, M. E., Huckvale, K., Nicholas, J., Torous, J., Birrell, L., Li, E., & Reda, B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0093-1 · Cited by 334 · cited 5×
“However, when these descriptions referenced specific treatment approaches, only about half described methods supported in the literature—furthermore, only two descriptions cited research about the app itself to back up effectiveness claims (Larsen et al., 2019).”
BackgroundInfluentialIntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301
Marques, L., LeBlanc, N. J., Weingarden, H. M., Timpano, K. R., Jenike, M., & Wilhelm, S. (2010) · Depression and Anxiety · doi:10.1002/da.20694 · Cited by 283 · cited 1×
“…gap between illness onset and the receipt of care, with a median delay ranging from 6 to 23 years depending on the disorder (Cullen et al., 2008; Marques et al., 2010; Pinto, Mancebo, Eisen, Pagano, & Rasmussen, 2006; Stengler et al., 2013; Thompson, Issakidis, & CBT IN THE DIGITAL AGE 4 Hunt,…”
BackgroundSelf-citationInternet-based mental health programs: A powerful tool in the rural medical kit
Griffiths, K. M., & Christensen, H. (2007) · Australian Journal of Rural Health · doi:10.1111/j.1440-1584.2007.00859.x · Cited by 270
Smartphone Apps for Schizophrenia: A Systematic Review
Firth, J., & Torous, J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4930 · Cited by 268 · cited 1×
“Although meta-analyses have yet to be conducted in other domains, systematic reviews suggest that apps show promising uptake and potential efficacy in treating those with serious mental illnesses (Batra et al., 2017; Berry, Lobban, Emsley, & Bucci, 2016; Firth & Torous, 2015).”
BackgroundState of the Field of Mental Health Apps
Neary, M., & Schueller, S. M. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2018.01.002 · Cited by 247 · cited 5×
“Some apps in PsyberGuide also have expert reviews (Neary & Schueller, 2018).”
BackgroundInfluentialTreatment of panic disorder via the Internet: a randomized trial of CBT vs. applied relaxation
Carlbring, P., Ekselius, L., & Andersson, G. (2003) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(03)00026-0 · Cited by 240
Anxiety: There is an app for that. A systematic review of anxiety apps: SUCALA et al.
Sucala, M., Cuijpers, P., Muench, F., Cardoș, R., Soflau, R., Dobrean, A., Achimas-Cadariu, P., & David, D. (2017) · Depression and Anxiety · doi:10.1002/da.22654 · Cited by 232 · cited 4×
“%) lacked information about their theoretical or treatment approach (Sucala et al., 2017).”
BackgroundInfluentialBerry, N., Lobban, F., Emsley, R., & Bucci, S. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5250 · Cited by 230
Harvey, A. G., & Gumport, N. B. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.02.004 · Cited by 221 · cited 1×
“For instance, individuals often report logistical barriers, including a lack of transportation to attend appointments, an inability to take time off from work to attend appointments, and/or a lack of child care (Harvey & Gumport, 2015).”
BackgroundmHealth in the Wild: Using Novel Data to Examine the Reach, Use, and Impact of PTSD Coach
Owen, J. E., Jaworski, B. K., Kuhn, E., Makin-Byrd, K. N., Ramsey, K. M., & Hoffman, J. E. (2015) · JMIR Mental Health · doi:10.2196/mental.3935 · Cited by 216 · cited 1×
“6% of its users had opened the app the week after download, and only 37% ever accessed its primary content (Owen et al., 2015).”
BackgroundMorris, R. R., Schueller, S. M., & Picard, R. W. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4167 · Cited by 206
Bergström, J., Andersson, G., Ljótsson, B., Rück, C., Andréewitch, S., Karlsson, A., Carlbring, P., Andersson, E., & Lindefors, N. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-54 · Cited by 202 · cited 7×
“Although I-CBT is effective and addresses key access barriers, most of its practice occurs within one setting (i.e., at home, in front of one’s computer).”
BackgroundInfluentialMany Mobile Health Apps Target High-Need, High-Cost Populations, But Gaps Remain
Singh, K., Drouin, K., Newmark, L. P., Lee, J., Faxvaag, A., Rozenblum, R., Pabo, E. A., Landman, A., Klinger, E., & Bates, D. W. (2016) · Health Affairs · doi:10.1377/hlthaff.2016.0578 · Cited by 201 · cited 2×
“It is important to note that reliance on app store “star ratings” is not sufficient, as star ratings do not correlate strongly with an app’s clinical utility (Singh et al., 2016; Torous & Roberts, 2017).”
BackgroundRohani, D. A., Faurholt-Jepsen, M., Kessing, L. V., & Bardram, J. E. (2017) · doi:10.2196/preprints.9691 · Cited by 195 · cited 2×
“For example, across 46 depression studies using passive sensor data, mood was assessed using 19 different methods (Rohani et al., 2018).”
BackgroundMethodReviewing the data security and privacy policies of mobile apps for depression
O'Loughlin, K., Neary, M., Adkins, E. C., & Schueller, S. M. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.12.001 · Cited by 179
Batra, S., Baker, R., Wang, T., Forma, F., DiBiasi, F., & Peters-Strickland, T. (2017) · Medical Devices: Evidence and Research · doi:10.2147/mder.s144158 · Cited by 169 · cited 1×
“Although meta-analyses have yet to be conducted in other domains, systematic reviews suggest that apps show promising uptake and potential efficacy in treating those with serious mental illnesses (Batra et al., 2017; Berry, Lobban, Emsley, & Bucci, 2016; Firth & Torous, 2015).”
BackgroundNicholas, J., Fogarty, A. S., Boydell, K., & Christensen, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7273 · Cited by 158
Realizing the Potential of Behavioral Intervention Technologies
Schueller, S. M., Muñoz, R. F., & Mohr, D. C. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721413495872 · Cited by 152 · cited 1×
“Altogether, we are likely to build the most usable and engaging tools if clinical experts and industry developers adopt a true, multidisciplinary partnership approach (Schueller et al., 2013).”
BackgroundApp-based psychological interventions: friend or foe?
Leigh, S., & Flatt, S. (2015) · Evidence Based Mental Health · doi:10.1136/eb-2015-102203 · Cited by 140 · cited 1×
“Leigh and Flatt (2015) note that 1,536 depression apps were available for download in 2013, whereas only 32 papers about depression apps had been published at that time.”
BackgroundKaldo, V., Jernelöv, S., Blom, K., Ljótsson, B., Brodin, M., Jörgensen, M., Kraepelien, M., Rück, C., & Lindefors, N. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.001 · Cited by 132 · cited 7×
“Although I-CBT is effective and addresses key access barriers, most of its practice occurs within one setting (i.e., at home, in front of one’s computer).”
BackgroundInfluentialDelay to Seek Treatment for Anxiety and Mood Disorders in an Australian Clinical Sample
Thompson, A., Issakidis, C., & Hunt, C. (2008) · Behaviour Change · doi:10.1375/bech.25.2.71 · Cited by 130
Glozier, N., Christensen, H., Naismith, S., Cockayne, N., Donkin, L., Neal, B., Mackinnon, A., & Hickie, I. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059139 · Cited by 129 · cited 7×
“Although I-CBT is effective and addresses key access barriers, most of its practice occurs within one setting (i.e., at home, in front of one’s computer).”
BackgroundInfluentialEnander, J., Andersson, E., Mataix-Cols, D., Lichtenstein, L., Alström, K., Andersson, G., Ljótsson, B., & Rück, C. (2016) · BMJ · doi:10.1136/bmj.i241 · Cited by 129
Zima, B. T., Hurlburt, M. S., Knapp, P., Ladd, H., Tang, L., Duan, N., Wallace, P., Rosenblatt, A., Landsverk, J., & Wells, K. B. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00005 · Cited by 117 · cited 1×
“Last, although the fidelity of in-person therapy to validated techniques can vary dramatically in outpatient settings (Weisz et al., 2013; Zima et al., 2005), app-based treatments have the potential to deliver standardized care across persons.”
BackgroundUptake and usage of IntelliCare: A publicly available suite of mental health and well-being apps
Lattie, E. G., Schueller, S. M., Sargent, E., Stiles-Shields, C., Tomasino, K. N., Corden, M. E., Begale, M., Karr, C. J., & Mohr, D. C. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.06.003 · Cited by 113
Eliminating The Wait For Mental Health Services
Williams, M. E., Latta, J., & Conversano, P. (2008) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-007-9091-1 · Cited by 107
Data Security and Privacy in Apps for Dementia: An Analysis of Existing Privacy Policies
Rosenfeld, L., Torous, J., & Vahia, I. V. (2017) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2017.04.009 · Cited by 100 · cited 1×
“Apps that do provide privacy policies frequently fail to include relevant information (O’Loughlin et al., 2019; Rosenfeld et al., 2017), present privacy policies at too high a reading level (O’Loughlin et al.”
BackgroundNewman, M. G., Jacobson, N. C., Zainal, N. H., Shin, K. E., Szkodny, L. E., & Sliwinski, M. J. (2019) · Clinical Psychological Science · doi:10.1177/2167702619827019 · Cited by 96 · cited 1×
“However, symptoms can occur anywhere, at any time (e.g., Moskowitz & Young, 2006; Newman et al., 2019).”
BackgroundSelf-citationDeveloping a roadmap for the translation of e-mental health services for depression
Batterham, P. J., Sunderland, M., Calear, A. L., Davey, C. G., Christensen, H., Teesson, M., Kay-Lambkin, F., Andrews, G., Mitchell, P. B., Herrman, H., et al. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867415582054 · Cited by 77 · cited 7×
“Although I-CBT is effective and addresses key access barriers, most of its practice occurs within one setting (i.e., at home, in front of one’s computer).”
BackgroundInfluentialFord II, J. H., Alagoz, E., Dinauer, S., Johnson, K. A., Pe-Romashko, K., & Gustafson, D. H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3965 · Cited by 73
The Opportunity and Obstacles for Smartwatches and Wearable Sensors
Foster, K. R., & Torous, J. (2019) · IEEE Pulse · doi:10.1109/mpuls.2018.2885832 · Cited by 62
Green, A. C., Hunt, C., & Stain, H. J. (2012) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-011-0453-x · Cited by 53
History and current status of ICBT
Andersson, G., Carlbring, P., & Lindefors, N. (2016) · Guided Internet-Based Treatments in Psychiatry · doi:10.1007/978-3-319-06083-5_1 · Cited by 36 · cited 7×
“Although I-CBT is effective and addresses key access barriers, most of its practice occurs within one setting (i.e., at home, in front of one’s computer).”
BackgroundInfluentialReimbursement of Apps for Mental Health: Findings From Interviews
Powell, A. C., Bowman, M. B., & Harbin, H. T. (2019) · JMIR Mental Health · doi:10.2196/14724 · Cited by 35
The impact of waiting-list times on client attendance for relationship counselling
Hicks, C., & Hickman, G. (1994) · British Journal of Guidance & Counselling · doi:10.1080/03069889408260312 · Cited by 22
Ventura, J., & Chung, J. (2019) · Journal of Psychosocial Nursing and Mental Health Services · doi:10.3928/02793695-20190221-01 · Cited by 11
Cited by
Reviewing the data security and privacy policies of mobile apps for depression
O'Loughlin, K., Neary, M., Adkins, E. C., & Schueller, S. M. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.12.001 · Cited by 179
Digital Biomarkers of Social Anxiety Severity: Digital Phenotyping Using Passive Smartphone Sensors
Jacobson, N. C., Summers, B., & Wilhelm, S. (2020) · Journal of Medical Internet Research · doi:10.2196/16875 · Cited by 162
“Taken together, our study extends recent efforts to utilize passive smartphone sensor data to improve the field’s ability to detect nuanced behavioral indicators of problematic pathology [44,45].”
BackgroundSelf-citationJacobson, N. C., & Chung, Y. J. (2020) · Sensors · doi:10.3390/s20123572 · Cited by 139
“Consequently, most prior research is unable to adequately translate to inform just-in-time adaptive interventions (JITAI) [38,39], as this research might miss important times in which persons might be experiencing depressed mood fluctuations.”
BackgroundSelf-citationJacobson, N. C., & Bhattacharya, S. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.104013 · Cited by 92
Self-citationThe future of psychological treatments: The Marburg Declaration
Rief, W., Asmundson, G. J. G., Bryant, R. A., Clark, D. M., Ehlers, A., Holmes, E. A., McNally, R. J., Neufeld, C. B., Wilhelm, S., Jaroszewski, A. C., et al. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102417 · Cited by 54
Self-citation
Metadata
- Authors
- Wilhelm, S., Weingarden, H., Ladis, I., Braddick, V., Shin, J., & Jacobson, N. C.
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 51
- Issue
- 1
- Pages
- 1-14
- ISSN
- 0005-7894 (ISSN-L)
- OpenAlex
- W2969000953
- Cited by
- 120
- References
- 67
- FWCI
- 11.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.