Toward a paradigm shift in treatment and research of mental disorders
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Mental disorders are common and represent a significant and worldwide public health concern (Smith, 2011;Vigo et al., 2016;Patel et al., 2018).The global burden of disease due to mental illness accounts for 21-32% of years lived with disability and 7-13% of disability-adjusted life-years (Vigo et al., 2016).The Lancet commission on global mental health and sustainable development just recently estimated a loss of US$16 trillion to the global economy due to mental disorders in the period 2010 -2030(Patel et al., 2018)).Psychotherapy and pharmacotherapy are the two key available treatments presently offered to millions of subjects with mental disorders around the world.However, recent evidence suggests that their effects are overestimated due to several factors, such as publication bias, researcher allegiance, and other shortcomings in study design (Ioannidis, 2005(Ioannidis, , 2008;;Driessen et al., 2015;Tajika et al., 2015;Cuijpers et al., 2016; Leichsenring et al., 2017;Leucht et al., 2017;Cuijpers et al., 2019;van Os et al., 2019).Thus, the true efficacy of psychotherapy and pharmacotherapy remains contested.Meta-analyses or systematic reviews of randomized controlled trials (RCTs) are considered to provide the highest level of evidence (1a) (Oxford Centre, 2009).Both meta-analyses and RCTs, however, may differ with regard to the strictness of testing treatment efficacy, depending, for example, on the comparator against which the treatment is tested.Whereas comparisons to waiting list or no-treatment can at best show that a treatment is better than doing nothing, comparisons with treatment as usual (TAU) or placebo show whether treatments have an additional gain compared to TAU or placebo.They also provide information on whether the efforts, costs, and possible side effects of specialized treatments pay off from a health-economic perspective.Thus, these comparisons provide better estimates of the true efficacy of a treatment (Cuijpers et al., 2016).Recent high-ranking meta-analyses suggest that the efficacy of psychotherapy and pharmacotherapy in comparison to placebo or TAU is limited.For key mental disorders such as depressive disorders (Driessen et al., 2015;Cipriani et al., 2018;Cuijpers et al., 2019), anxiety disorders (Heeren et al., 2015;Curtiss et al.,
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643 · cited 1×
“Switching or augmenting is common in pharmacotherapy research (Rush et al., 2006) but such strategies are practically non-existing in psychotherapy research (Markowitz and Milrod, 2015).”
BackgroundThe Lancet Commission on global mental health and sustainable development
Patel, V., Saxena, S., Lund, C., Thornicroft, G., Baingana, F., Bolton, P., Chisholm, D., Collins, P. Y., Cooper, J. L., Eaton, J., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31612-x · Cited by 3,692
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541
Self-citationA manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationEstimating the true global burden of mental illness
Vigo, D., Thornicroft, G., & Atun, R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00505-2 · Cited by 2,494
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
The Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773
Cost of disorders of the brain in Europe 2010
Gustavsson, A., Svensson, M., Jacobi, F., Allgulander, C., Alonso, J., Beghi, E., Dodel, R., Ekman, M., Faravelli, C., Fratiglioni, L., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.08.008 · Cited by 1,723
How to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
Self-citationAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 10×
“Furthermore, success rates of treatments need to be compared to those of placebo or TAU.”
BackgroundResultInfluentialWeisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., Jensen-Doss, A., Hawley, K. M., Krumholz Marchette, L. S., Chu, B. C., et al. (2017) · American Psychologist · doi:10.1037/a0040360 · Cited by 862 · cited 1×
“…(Cipriani et al., 2013), schizophrenia spectrum disorders (Jauhar et al., 2014; Leucht et al., 2017), and psychotherapy of children and adolescents (Weisz et al., 2006, 2013, 2017, 2019; Eckshtain et al., 2019), psychotherapy and pharmacotherapy yielded effect sizes in terms of standardized mean…”
BackgroundCarpenter, J. K., Andrews, L. A., Witcraft, S. M., Powers, M. B., Smits, J. A. J., & Hofmann, S. G. (2018) · Depression and Anxiety · doi:10.1002/da.22728 · Cited by 846 · cited 2×
“, 2019), anxiety disorders (Heeren et al., 2015; Curtiss et al., 2017; Li et al., 2017; Liu et al., 2017; Carpenter et al., 2018; Gomez et al., 2018), somatoform disorders (van Dessel et al.”
BackgroundShimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657 · cited 1×
“As a somehow puzzling result, some preliminary data suggest that neither measures of adherence to treatment manuals nor of competence in delivering interventions were associated with outcome (Webb et al., 2010).”
ResultCristea, I. A., Gentili, C., Cotet, C. D., Palomba, D., Barbui, C., & Cuijpers, P. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.4287 · Cited by 655
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614 · cited 1×
“Poor reporting of interventions was found for pharmacological interventions and even more so for non-pharmacological interventions (Glasziou et al., 2008; Schroter et al., 2012; Hoffmann et al., 2013, 2014, 2015).”
BackgroundResponse rates for CBT for anxiety disorders: need for standardized criteria
Loerinc, A. G., Meuret, A. E., Twohig, M. P., Rosenfield, D., Bluett, E. J., & Craske, M. G. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.08.004 · Cited by 592 · cited 4×
“included in the meta-analyses mentioned above were short-term, encompassing, for example, 1–28 treatment sessions (Loerinc et al., 2015; Cuijpers et al., 2016).”
BackgroundInfluentialCuijpers, P., Karyotaki, E., Weitz, E., Andersson, G., Hollon, S. D., & van Straten, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.02.026 · Cited by 586
Cuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Huibers, M. J. H. (2016) · World Psychiatry · doi:10.1002/wps.20346 · Cited by 572 · cited 6×
“…be fully double-blind), other shortcomings in study design, financial conflicts (e.g. industry funding) and spontaneous remission due to the natural course of mental disorders (Ioannidis, 2005, 2008; Cuijpers et al., 2014, 2016; Huhn et al., 2014; Leichsenring et al., 2017; Cipriani et al., 2018).”
BackgroundInfluentialWeisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.671 · Cited by 560 · cited 1×
“…(Cipriani et al., 2013), schizophrenia spectrum disorders (Jauhar et al., 2014; Leucht et al., 2017), and psychotherapy of children and adolescents (Weisz et al., 2006, 2013, 2017, 2019; Eckshtain et al., 2019), psychotherapy and pharmacotherapy yielded effect sizes in terms of standardized mean…”
BackgroundLeucht, S., Leucht, C., Huhn, M., Chaimani, A., Mavridis, D., Helfer, B., Samara, M., Rabaioli, M., Bächer, S., Cipriani, A., et al. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16121358 · Cited by 542
Jauhar, S., McKenna, P. J., Radua, J., Fung, E., Salvador, R., & Laws, K. R. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.116285 · Cited by 517 · cited 2×
“…et al., 2014), borderline personality disorder (Cristea et al., 2017a), bipolar disorder (Cipriani et al., 2013), schizophrenia spectrum disorders (Jauhar et al., 2014; Leucht et al., 2017), and psychotherapy of children and adolescents (Weisz et al., 2006, 2013, 2017, 2019; Eckshtain et al.,…”
BackgroundRealizing the Mass Public Benefit of Evidence-Based Psychological Therapies: The IAPT Program
Clark, D. M. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084833 · Cited by 492 · cited 2×
“These rates are based on self-report measures (Clark, 2018), whereas in the meta-analyses cited above, remission rates were based on observer-rated measures.”
BackgroundPatterns of symptomatic recovery in psychotherapy.
Kopta, S. M., Howard, K. I., Lowry, J. L., & Beutler, L. E. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.5.1009 · Cited by 442 · cited 2×
“For patients with chronic disorders or personality problems, short-term treatment fails most patients (Kopta et al., 1994; Lambert, 2013).”
BackgroundWeisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1176 · Cited by 412 · cited 1×
“…(Cipriani et al., 2013), schizophrenia spectrum disorders (Jauhar et al., 2014; Leucht et al., 2017), and psychotherapy of children and adolescents (Weisz et al., 2006, 2013, 2017, 2019; Eckshtain et al., 2019), psychotherapy and pharmacotherapy yielded effect sizes in terms of standardized mean…”
BackgroundHoffmann, T. C., Erueti, C., & Glasziou, P. P. (2013) · BMJ · doi:10.1136/bmj.f3755 · Cited by 375
Huhn, M., Tardy, M., Spineli, L. M., Kissling, W., Förstl, H., Pitschel-Walz, G., Leucht, C., Samara, M., Dold, M., Davis, J. M., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.112 · Cited by 333 · cited 6×
“…be fully double-blind), other shortcomings in study design, financial conflicts (e.g. industry funding) and spontaneous remission due to the natural course of mental disorders (Ioannidis, 2005, 2008; Cuijpers et al., 2014, 2016; Huhn et al., 2014; Leichsenring et al., 2017; Cipriani et al., 2018).”
BackgroundInfluentialJohnsen, T. J., & Friborg, O. (2015) · Psychological Bulletin · doi:10.1037/bul0000015 · Cited by 331 · cited 1×
“(4) Reported effect sizes of psychotherapy for anxiety and depressive disorders seem to have stagnated or even decreased during recent decades (Öst, 2008; Johnsen and Friborg, 2015; Friborg and Johnsen, 2017; Cristea et al., 2017b; Weisz et al., 2019).”
BackgroundAttention bias modification for social anxiety: A systematic review and meta-analysis
Heeren, A., Mogoașe, C., Philippot, P., & McNally, R. J. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.06.001 · Cited by 312
van Dessel, N., den Boeft, M., van der Wouden, J. C., Kleinstäuber, M., Leone, S. S., Terluin, B., Numans, M. E., van der Horst, H. E., & van Marwijk, H. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011142.pub2 · Cited by 302
Experimental design and primary data analysis methods for comparing adaptive interventions.
Nahum-Shani, I., Qian, M., Almirall, D., Pelham, W. E., Gnagy, B., Fabiano, G. A., Waxmonsky, J. G., Yu, J., & Murphy, S. A. (2012) · Psychological Methods · doi:10.1037/a0029372 · Cited by 298 · cited 1×
“For psychotherapy, no evidence-based treatment sequence algorithms exist how to proceed if a treatment fails (Markowitz and Milrod, 2015), while designs for such trials are available (Nahum-Shani et al., 2012; Steinert et al., 2016).”
BackgroundLeichsenring, F., & Leweke, F. (2017) · New England Journal of Medicine · doi:10.1056/nejmcp1614701 · Cited by 256 · cited 1×
“(5) Long-term treatment effects (which may be even smaller than short-term effects) are under-studied (Ioannidis, 2008; Huhn et al., 2014; Steinert et al., 2016; Leichsenring and Leweke, 2017).”
BackgroundSelf-citationEffectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials?
Ioannidis, J. P. (2008) · Philosophy, Ethics, and Humanities in Medicine · doi:10.1186/1747-5341-3-14 · Cited by 253
Self-citationClinimetrics: the science of clinical measurements
Fava, G. A., Tomba, E., & Sonino, N. (2012) · International Journal of Clinical Practice · doi:10.1111/j.1742-1241.2011.02825.x · Cited by 233 · cited 1×
“Taking into account relevant factors besides a patient’s present state such as response to previous treatments (staging) may be helpful (Fava et al., 2012; Steinert et al., 2016).”
BackgroundMeta-analysis: 13-year follow-up of psychotherapy effects on youth depression
Eckshtain, D., Kuppens, S., Ugueto, A., Ng, M. Y., Vaughn-Coaxum, R., Corteselli, K., & Weisz, J. R. (2020) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.04.002 · Cited by 224 · cited 1×
“, 2017), and psychotherapy of children and adolescents (Weisz et al., 2006, 2013, 2017, 2019; Eckshtain et al., 2019), psychotherapy and pharmacotherapy yielded effect sizes in terms of standardized mean differences (SMDs) of about 0.”
BackgroundDefinition, assessment and rate of psychotherapy side effects
Linden, M., & Schermuly-Haupt, M.-L. (2014) · World Psychiatry · doi:10.1002/wps.20153 · Cited by 220 · cited 1×
“(7) Data on side effects of psychotherapy are scarce (Linden and Schermuly-Haupt, 2014).”
BackgroundFurukawa, T. A., Cipriani, A., Atkinson, L. Z., Leucht, S., Ogawa, Y., Takeshima, N., Hayasaka, Y., Chaimani, A., & Salanti, G. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30307-8 · Cited by 219 · cited 1×
“For depressive and anxiety disorders, placebo response rates range between 35% and 40% (Furukawa et al., 2016; Li et al., 2017; Williams et al., 2017).”
BackgroundEmpirically Supported Treatment: Recommendations for a New Model
Tolin, D. F., McKay, D., Forman, E. M., Klonsky, E. D., & Thombs, B. D. (2015) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12122 · Cited by 219
Driessen, E., Hollon, S. D., Bockting, C. L. H., Cuijpers, P., & Turner, E. H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0137864 · Cited by 208 · cited 4×
“For key mental disorders such as depressive disorders (Driessen et al., 2015; Cipriani et al., 2018; Cuijpers et al., 2019), anxiety disorders (Heeren et al.”
BackgroundInfluentialMethodological Recommendations for Trials of Psychological Interventions
Guidi, J., Brakemeier, E.-L., Bockting, C. L. H., Cosci, F., Cuijpers, P., Jarrett, R. B., Linden, M., Marks, I., Peretti, C. S., Rafanelli, C., et al. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000490574 · Cited by 205 · cited 2×
“Furthermore, active comparators need to be included since waiting list or no-treatment conditions are likely to overestimate effect sizes (Cuijpers et al., 2016; Guidi et al., 2017).”
BackgroundHoffmann, T. C., Oxman, A. D., Ioannidis, J. P., Moher, D., Lasserson, T. J., Tovey, D. I., Stein, K., Sutcliffe, K., Ravaud, P., Altman, D. G., et al. (2017) · BMJ · doi:10.1136/bmj.j2998 · Cited by 194
Self-citationWatts, S. E., Turnell, A., Kladnitski, N., Newby, J. M., & Andrews, G. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.025 · Cited by 188 · cited 4×
“In a meta-analysis testing different forms of TAU psychotherapy (cognitive–behavior therapy) achieved small effect sizes when compared with general practitioner management (0.20) and larger effect sizes (0.71) when compared with minimal contact (Watts et al., 2015).”
BackgroundResultInfluentialSwift, J. K., Greenberg, R. P., Tompkins, K. A., & Parkin, S. R. (2017) · Psychotherapy · doi:10.1037/pst0000104 · Cited by 167 · cited 1×
“(6) About 20% of patients drop out of psychotherapy, even more of pharmacotherapy (Swift et al., 2017), with patients apparently experiencing the treatments as not acceptable.”
BackgroundGomez, A. F., Barthel, A. L., & Hofmann, S. G. (2018) · Expert Opinion on Pharmacotherapy · doi:10.1080/14656566.2018.1472767 · Cited by 125 · cited 6×
“…Cuijpers et al., 2019), anxiety disorders (Heeren et al., 2015; Curtiss et al., 2017; Li et al., 2017; Liu et al., 2017; Carpenter et al., 2018; Gomez et al., 2018), somatoform disorders (van Dessel et al., 2014), borderline personality disorder (Cristea et al., 2017a), bipolar disorder…”
BackgroundResultInfluentialPharmacotherapy for social anxiety disorder (SAnD)
Williams, T., Hattingh, C. J., Kariuki, C. M., Tromp, S. A., van Balkom, A. J., Ipser, J. C., & Stein, D. J. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001206.pub3 · Cited by 84 · cited 2×
“For depressive and anxiety disorders, placebo response rates range between 35% and 40% (Furukawa et al., 2016; Li et al., 2017; Williams et al., 2017).”
BackgroundQuality of descriptions of treatments: a review of published randomised controlled trials
Schroter, S., Glasziou, P., & Heneghan, C. (2012) · BMJ Open · doi:10.1136/bmjopen-2012-001978 · Cited by 64
Curtiss, J., Andrews, L., Davis, M., Smits, J., & Hofmann, S. G. (2017) · Expert Opinion on Pharmacotherapy · doi:10.1080/14656566.2017.1285907 · Cited by 46 · cited 2×
“…such as depressive disorders (Driessen et al., 2015; Cipriani et al., 2018; Cuijpers et al., 2019), anxiety disorders (Heeren et al., 2015; Curtiss et al., 2017; Li et al., 2017; Liu et al., 2017; Carpenter et al., 2018; Gomez et al., 2018), somatoform disorders (van Dessel et al., 2014),…”
BackgroundDeclining efficacy in controlled trials of antidepressants: effects of placebo dropout
Schalkwijk, S., Undurraga, J., Tondo, L., & Baldessarini, R. J. (2014) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145714000224 · Cited by 34
Patient perspectives on the benefits of psychotherapy for late-life depression
Dakin, E. K., & Areán, P. (2013) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2012.10.016 · Cited by 25
Cited by
Leichsenring, F., Steinert, C., Rabung, S., & Ioannidis, J. P. A. (2022) · World Psychiatry · doi:10.1002/wps.20941 · Cited by 485
Self-citationStein, D. J., Shoptaw, S. J., Vigo, D. V., Lund, C., Cuijpers, P., Bantjes, J., Sartorius, N., & Maj, M. (2022) · World Psychiatry · doi:10.1002/wps.20998 · Cited by 331
von Thiele Schwarz, U., Aarons, G. A., & Hasson, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4668-y · Cited by 134
Control interventions in randomised trials among people with mental health disorders
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050.pub2 · Cited by 40
Cayoun, B. A., & Shires, A. G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.545945 · Cited by 36
Metadata
- Authors
- Leichsenring, F., Steinert, C., & Ioannidis, J. P. A.
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2019-09-02
- Volume
- 49
- Issue
- 13
- Pages
- 2111-2117
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- OpenAlex
- W2972040771
- Cited by
- 53
- References
- 52
- FWCI
- 7.64
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.