Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults: A protocol for systematic review and meta-analysis
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; 8 of the 19 sources its claims cite were checked for support.
Abstract
Background Major Depressive Disorder is a long-term, recurring, and very common illness that is associated with a significant decline in functional ability. The gold-standard method of treating depression is pharmacotherapy, which involves the use of antidepressant medications either alone or in various combinations. However, approximately 30% of Major Depressive Disorder patients suffer from Treatment Resistant Depression, a more severe condition that has a profound impact on patients' lives. Our study aims to conduct the first comprehensive review and meta-analysis to assess the effectiveness and safety of adding Dialectical Behavior Therapy to antidepressant medications compared to groups using pharmacotherapy alone as an intervention for adults with Treatment Resistant Depression. Materials and methods We will search for publications in the following databases: Cochrane Central Register of Controlled Trials, MEDLINE, Embase, Lilacs, Web of Science, and PsycINFO. We will manually review the reference lists of the included studies to identify potentially relevant studies. There will be no restrictions on the language or publication date. Quality assessment of the included studies will be performed independently according to the Cochrane Risk of Bias instrument. To assess the certainty of the findings' body of evidence, we will use the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology. This study aims to determine the effectiveness and safety of Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults. Ethics and dissemination Ethical approval was not required as individual patient data was not obtained. Our intention is to publish the systematic review in a medical journal that offers open access upon completion of the process. © 2024 Junkes et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Overview
CoChat Summary
TL;DR
This is a 2024 systematic review and meta-analysis protocol, not a completed review, so it reports no results. The planned review will examine whether adding Dialectical Behavior Therapy (DBT) to antidepressant medication improves outcomes for adults with treatment-resistant depression (TRD) compared with pharmacotherapy alone.
Key findings
- The paper states that about 30% of Major Depressive Disorder patients suffer from TRD, and that TRD has an estimated prevalence of 1% in the population.
- The review question is whether DBT plus standard drug treatment is more effective and safe than drug treatment alone for adults with TRD.
- The planned outcomes are depressive symptoms measured by HAM-D and BDI, quality of life by SF-12, and clinical global impression by CGI.
- The protocol cites prior studies suggesting benefit, including a DBT skills-training adaptation with 16 sessions that showed greater improvement on HAM-D and BDI, and an RODBT trial with 250 patients where the 7-month difference favored RODBT by 5.40 HDRS points, though the 12- and 18-month differences were not significant.
Methods
- Systematic review and meta-analysis protocol, registered in PROSPERO (CRD42023406301) on March 24, 2023, following PRISMA.
- Planned searches in CENTRAL, MEDLINE, Embase, Lilacs, Web of Science, and PsycINFO, plus manual reference-list screening, with no language or publication-date restrictions.
- Eligible studies: adults 18+ with TRD; DBT compared with active or inactive controls; randomized or open clinical trials, observational studies, and case series; case reports and incomplete protocols excluded.
- Planned analysis includes risk ratio (RR) for dichotomous outcomes, mean difference/standardized mean difference for continuous outcomes, heterogeneity via I², fixed- or random-effects models as appropriate, subgroup/sensitivity analyses, publication-bias assessment with funnel plot and Egger’s test, and certainty grading with GRADE.
Limitations
- Stated in the paper: this is only a protocol, so the paper itself contains no pooled results, effect estimates, or conclusions from the planned review.
- Stated in the paper: the evidence base motivating the review is limited; the authors say there is “limited evidence” on which psychotherapeutic techniques are more effective for TRD.
- Evident from the text: the review’s inclusion of randomized or open clinical trials, observational studies, and case series may create heterogeneity in design and risk of bias; the paper plans to address this with bias assessment and subgroup/sensitivity analyses.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 3 Not valid · 7 Not checked · 6 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Adults with resistant depressive disorders may display traits of overcontrol, such as heightened self-criticism, diminished autonomy, rigid internalized expectations, heightened control over spontaneous emotions, and a fear of making mistakes [28–30].”
§ Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults: A protocol for systematic review and meta-analysis > Introduction
What the sources say
- Not checked — no full text of the sourcecites [28] TR Lynch, 2015, Radically Open-Dialectical Behavior Therapy for Disorders of Over-Control: Signaling Matters. source
- Partly supportedcites [29] JC Fournier, 2009, Prediction of Response to Medication and Cognitive Therapy in the Treatment of Moderate to Severe Depression., J Consult Clin Psychol. sourceExperimental — accuracy not yet measured
The Methods > Potential Predictors section (page unavailable) includes perfectionism, need for approval, and self-esteem among variables assessed in depressed outpatients, which overlaps with the claimed traits. It does not establish that adults with treatment-resistant depression display the listed pattern of overcontrol, including reduced autonomy, emotional restraint, or fear of mistakes. The Methods > Participants section (page unavailable) describes a moderate-to-severe depression sample, not a treatment-resistant sample. (LLM, conf=0.78)
- Not checked — no full text of the sourcecites [30] M Candrian, 2008, Personality disorders and perceived stress in major depressive disorder., Psychiatry Res source
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“DBT-A demonstrated small to moderate effects in reducing self-harm (g = -0.44; 95% CI -0.81 to -0.07) and suicidal ideation (g = -0.31, 95% CI -0.52 to -0.09) compared to the control group.”
§ Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults: A protocol for systematic review and meta-analysis > Introduction
What the sources say
- Supportedcites [25] OD Kothgassner, 2021, Efficacy of dialectical behavior therapy for adolescent self-harm and suicidal ideation: A systematic review and meta-analysis. source
The Abstract’s Results report small-to-moderate reductions in adolescent self-harm and suicidal ideation with DBT-A compared with control groups. Both effect sizes and confidence intervals match the citing sentence exactly. (LLM, conf=0.95)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“These maladaptive responses can prolong depressive symptoms [29,30].”
§ Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults: A protocol for systematic review and meta-analysis > Introduction
What the sources say
- Could not verifycites [29] JC Fournier, 2009, Prediction of Response to Medication and Cognitive Therapy in the Treatment of Moderate to Severe Depression., J Consult Clin Psychol. sourceExperimental — accuracy not yet measured
The Methods section lists cognitive variables such as attributional style and perfectionism, but does not say that maladaptive responses prolong depression. The Discussion reports that patients with chronic depression had less symptom relief during treatment, without attributing that persistence to maladaptive responses. Searches for maladaptive coping, rumination, and symptom persistence found no passage making the claimed link. (LLM, conf=0.74)
- Not checked — no full text of the sourcecites [30] M Candrian, 2008, Personality disorders and perceived stress in major depressive disorder., Psychiatry Res source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The treatments did not show a statistically significant difference in the primary endpoint after 12 months.”
§ Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults: A protocol for systematic review and meta-analysis > Introduction
What the sources say
- Partly supportedcites [33] TR Lynch, 2020, Refractory depression—Mechanisms and efficacy of radically open dialectical behaviour therapy (RefraMED): Findings of a randomised trial on benefits and harms., British Journal of Psychiatry sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainn = 250- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Therefore, RODBT has some evidence for use in Treatment Resistant Depression [28,32].”
§ Dialectical Behavior Therapy as an intervention for Treatment Resistant Depression in adults: A protocol for systematic review and meta-analysis > Introduction
What the sources say
- Not checked — no full text of the sourcecites [28] TR Lynch, 2015, Radically Open-Dialectical Behavior Therapy for Disorders of Over-Control: Signaling Matters. source
- Supportedcites [32] TR Lynch, 2018, Radically open dialectical behaviour therapy for refractory depression: the RefraMED RCT, Efficacy and Mechanism Evaluation source
The Conclusions report significantly fewer depressive symptoms with RO DBT than treatment as usual after seven months, supporting the cautious claim that it has some evidence for use in treatment-resistant depression. Differences were not statistically significant at 12 or 18 months. No page number is provided for the passage. (LLM, conf=0.93)
hedgedstates a possible causen = 250- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
4 more claims · 2 with their cited sources checked
Create a free account to see all 22 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 6
- Probably not a substantial claim. 11
Citations
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 1×
“This systematic review will adhere to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA guidelines) [34].”
MethodRush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643
Cochrane Database of Systematic Reviews
(2008) · Encyclopedia of Public Health · doi:10.1007/978-1-4020-5614-7_436 · Cited by 4,527
Linehan, M. M., Comtois, K. A., Murray, A. M., Brown, M. Z., Gallop, R. J., Heard, H. L., Korslund, K. E., Tutek, D. A., Reynolds, S. K., & Lindenboim, N. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.7.757 · Cited by 2,025 · cited 1×
“Dialectical Behavior Therapy, which was developed by American psychologist Marsha Linehan, was originally designed to help women who exhibit suicidal and self-harming behaviors [18–22].”
BackgroundGRADE guidelines: 5. Rating the quality of evidence—publication bias
Guyatt, G. H., Oxman, A. D., Montori, V., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Djulbegovic, B., Atkins, D., Falck-Ytter, Y., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.011 · Cited by 1,819 · cited 1×
“To assess the certainty of the findings’ body of evidence, we will use the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology, which evaluates five pillars: risk of bias, imprecision, inconsistency, indirect assessment of outcomes, and publication bias [35].”
MethodDepression Is the Leading Cause of Disability Around the World
Friedrich, M. J. (2017) · JAMA · doi:10.1001/jama.2017.3826 · Cited by 1,459
Linehan, M. M., Korslund, K. E., Harned, M. S., Gallop, R. J., Lungu, A., Neacsiu, A. D., McDavid, J., Comtois, K. A., & Murray-Gregory, A. M. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.3039 · Cited by 714
Mechanisms of change in dialectical behavior therapy: theoretical and empirical observations
Lynch, T. R., Chapman, A. L., Rosenthal, M. Z., Kuo, J. R., & Linehan, M. M. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20243 · Cited by 628
A Review of the Clinical, Economic, and Societal Burden of Treatment-Resistant Depression: 1996–2013
Mrazek, D. A., Hornberger, J. C., Altar, C. A., & Degtiar, I. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300059 · Cited by 580 · cited 1×
“Patients with this condition, particularly the subgroup with Treatment Resistant Depression (TRD), present a greater challenge due to the severity of their symptoms, longer duration of illness, high rates of recurrence and comorbidities, and increased mortality [3,4].”
BackgroundDefining treatment‐resistant depression
Gaynes, B. N., Lux, L., Gartlehner, G., Asher, G., Forman‐Hoffman, V., Green, J., Boland, E., Weber, R. P., Randolph, C., Bann, C., et al. (2020) · Depression and Anxiety · doi:10.1002/da.22968 · Cited by 447
Treatment resistant depression: methodological overview and operational criteria
Souery, D., Amsterdam, J., de Montigny, C., Lecrubier, Y., Montgomery, S., Lipp, O., Racagni, G., Zohar, J., & Mendlewicz, J. (1999) · European Neuropsychopharmacology · doi:10.1016/s0924-977x(98)00004-2 · Cited by 444
Treatment-resistant depression: Definitions, review of the evidence, and algorithmic approach
McIntyre, R. S., Filteau, M.-J., Martin, L., Patry, S., Carvalho, A., Cha, D. S., Barakat, M., & Miguelez, M. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.043 · Cited by 421
Economics and mental health: the current scenario
Knapp, M., & Wong, G. (2020) · World Psychiatry · doi:10.1002/wps.20692 · Cited by 409 · cited 1×
“Due to limited resources, it is necessary to prioritize cost-effectiveness and make strategic, clinical, preventive and person-centered decisions [15].”
BackgroundFournier, J. C., DeRubeis, R. J., Shelton, R. C., Hollon, S. D., Amsterdam, J. D., & Gallop, R. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0015401 · Cited by 340 · cited 1×
“These maladaptive responses can prolong depressive symptoms [29,30].”
BackgroundThe burden of severe depression: A review of diagnostic challenges and treatment alternatives
Nemeroff, C. B. (2007) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2006.05.008 · Cited by 295
Kothgassner, O. D., Goreis, A., Robinson, K., Huscsava, M. M., Schmahl, C., & Plener, P. L. (2021) · Psychological Medicine · doi:10.1017/s0033291721001355 · Cited by 288 · cited 1×
“These results suggest that DBT-A shows promise as a treatment for reducing both self-harm and suicidal ideation in adolescents [25].”
Findings, issues, and new directions for research on emotion socialization.
Eisenberg, N. (2020) · Developmental Psychology · doi:10.1037/dev0000906 · Cited by 265 · cited 1×
“Having too much self-control has been linked to being socially isolated, having difficulty relating to others, and showing emotions that are not genuine [31].”
BackgroundConway, C. R., George, M. S., & Sackeim, H. A. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.2586 · Cited by 244
Valentine, S. E., Bankoff, S. M., Poulin, R. M., Reidler, E. B., & Pantalone, D. W. (2015) · Journal of Clinical Psychology · doi:10.1002/jclp.22114 · Cited by 219 · cited 1×
“Since its development, Dialectical Behavior Therapy has been tested and implemented as a treatment in various clinical settings, from a transdiagnostic viewpoint, with initial evidence supporting its effectiveness [23].”
BackgroundAdaptation of dialectical behavior therapy skills training group for treatment-resistant depression
Harley, R., Sprich, S., Safren, S., Jacobo, M., & Fava, M. (2008) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e318162aa3f · Cited by 184
Psychological therapies for treatment-resistant depression in adults
Ijaz, S., Davies, P., Williams, C. J., Kessler, D., Lewis, G., & Wiles, N. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010558.pub2 · Cited by 155 · cited 1×
“A Cochrane Systematic Review [17] assessed the effectiveness of psychotherapy in adults with TRD, including studies evaluating Cognitive Behavioral Therapy (CBT), Interpersonal Therapy (IT), Brief Psychodynamic Therapy (BPT), and Dialectical Behavior Therapy (DBT).”
Radically Open-Dialectical Behavior Therapy for Disorders of Over-Control: Signaling Matters.
Lynch, T. R., Hempel, R. J., & Dunkley, C. (2015) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.2015.69.2.141 · Cited by 103
Treatment‐resistant depression: resistant to definition?
Malhi, G. S., Parker, G. B., Crawford, J., Wilhelm, K., & Mitchell, P. B. (2005) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2005.00602.x · Cited by 100
Wu, Y., Mo, J., Sui, L., Zhang, J., Hu, W., Zhang, C., Wang, Y., Liu, C., Zhao, B., Xiu, W., et al. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.655412 · Cited by 97
Feldman, G., Harley, R., Kerrigan, M., Jacobo, M., & Fava, M. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.01.005 · Cited by 79
Malaspina, D. (2023) · Psychological Medicine · doi:10.1017/s0033291720003517 · Cited by 74
Cost-Utility Analyses of Cognitive-Behavioural Therapy of Depression: A Systematic Review
Brettschneider, C., Djadran, H., Härter, M., Löwe, B., Riedel-Heller, S., & König, H.-H. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000365150 · Cited by 40
Lynch, T. R., Hempel, R. J., Whalley, B., Byford, S., Chamba, R., Clarke, P., Clarke, S., Kingdon, D. G., O'Mahen, H., Remington, B., et al. (2020) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.53 · Cited by 38
Personality disorders and perceived stress in major depressive disorder.
Candrian, M., Schwartz, F., Farabaugh, A., Perlis, R. H., Ehlert, U., & Fava, M. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.06.014 · Cited by 37
The dialectics of effective treatment of borderline personality disorder.
Linehan, M. M., & Schmidt, H. (1995) · American Psychological Association eBooks · doi:10.1037/10169-020 · Cited by 29
Radically open dialectical behaviour therapy for refractory depression: the RefraMED RCT
Lynch, T. R., Hempel, R. J., Whalley, B., Byford, S., Chamba, R., Clarke, P., Clarke, S., Kingdon, D., O’Mahen, H., Remington, B., et al. (2018) · Efficacy and Mechanism Evaluation · doi:10.3310/eme05070 · Cited by 22 · cited 1×
“Therefore, RODBT has some evidence for use in Treatment Resistant Depression [28,32].”
Method(2010) · Europe PMC (PubMed Central) · Cited by 6
Combined Pharmacotherapy and Psychological Treatment for Depression: A Systematic Review
Pampallona, S., Bollini, P., Tibaldi, G., Kupelnick, B., & Munizza, C. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.7.714 · Cited by 5
Research works printed but not linked: 1
- 2017, WHO. Depression and Other Common Mental Disorders Global Health Estimates
Cited by
Atta, M. H. R., El-Gueneidy, M., & Lachine, O. A. R. (2024) · BMC Psychology · doi:10.1186/s40359-024-01949-6 · Cited by 36
“One such intervention is dialectical behavior therapy (DBT), including the emotion regulation module, which is effective in treating depression [37].”
BackgroundLee, M.-W., Jang, S., Shin, H. K., Choi, S., Kim, H. T., Oh, J., Kwon, J. H., Choi, Y., Kang, S., Back, I.-S., et al. (2024) · Yonsei Medical Journal · doi:10.3349/ymj.2024.0002 · Cited by 22
“6 However, even though those treatments have proved to be useful psychosocial interventions for depression, the provision of CBT by mental health professionals has been limited, 7 primarily by the time and money required to receive CBT face-to-face from a therapist.”
Ruffini, G., Castaldo, F., Lopez-Sola, E., Sanchez-Todo, R., & Vohryzek, J. (2024) · Entropy · doi:10.3390/e26110953 · Cited by 25
Rodrigues, M. F., Junkes, L., Appolinário, J. C., & Nardi, A. E. (2024) · PLoS ONE · doi:10.1371/journal.pone.0306227 · Cited by 7
Self-citation
Metadata
- Authors
- Junkes, L., Gherman, B. R., Appolinario, J. C., & Nardi, A. E.
- Affiliations
- Universidade Federal do Rio de Janeiro (BR)
- Corresponding author
- Junkes, Larissa
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2024-05-22
- Volume
- 19
- Issue
- 5
- Pages
- e0303967
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC11111054
- OpenAlex
- W4398199996
- Cited by
- 4
- References
- 33
- Citations by year
- 2024: 4
- FWCI
- 0.25
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Social Sciences › Psychology › Clinical Psychology › Personality Disorders and Psychopathology
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- dialectical behavior therapy, treatment-resistant depression, major depressive disorder, antidepressant augmentation, pharmacotherapy, psychotherapy
- MeSH terms
- Dialectical Behavior Therapy, Systematic Reviews as Topic, Adult, Antidepressive Agents, Major Depressive Disorder, Humans, Meta-Analysis as Topic, Treatment Outcome, Depressive Disorder, Treatment-Resistant
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.