Identification of a Claims Data "Signature" and Economic Consequences for Treatment-Resistant Depression
The DOI matches its Crossref record.
Abstract
BACKGROUND: Major depressive disorder (MDD) is a debilitating condition with significant economic consequences. Conservative estimates indicate that between 10% and 20% of all individuals with MDD are treatment resistant. The objectives for this study were (1) to use current treatment strategies identified in the literature to evaluate the validity of studying treatment-resistant depression (TRD) using claims data and (2) to estimate cost differences between TRD-likely and TRD-unlikely patients identified by use of treatment patterns. METHOD: The data source consisted of medical, pharmaceutical, and disability claims from a Fortune 100 manufacturer for 1996 through 1998 (N = 125,242 continuously enrolled beneficiaries between the ages of 18 and 64 years). The sample included individuals with medical or disability claims for MDD (NMDD = 4186). A treatment pattern algorithm was applied to classify adult MDD patients into TRD-likely (NTRD = 487) and TRD-unlikely groups. Resource utilization and costs were compared among TRD-likely and TRD-unlikely patients and a random sample of average beneficiaries (i.e., 10% of all beneficiaries) for 1998. RESULTS: Consistent with the epidemiologic literature, the algorithm classified 12% of the MDD sample as TRD-likely. Mean annual costs were $10,954 for TRD-likely patients, $5025 for TRD-unlikely patients, and $3006 for average beneficiaries. TRD-likely patients used almost twice as many medical services as did TRD-unlikely patients and incurred significantly greater indirect costs (p < .0001). CONCLUSION: It is feasible to use an administrative dataset to develop a claim-based treatment algorithm to identify TRD-likely patients. Resource utilization by TRD-likely patients was substantial, not only for direct treatment of depression but also for treatment of comorbid medical conditions. Additionally, TRD imposed on employers substantial indirect costs resulting from high rates of depression-associated disability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Direct medical costs associated with TRD are estimated to be 2-6 times higher compared with other patients with MDD, 42, 43 with costs increasing with chronicity and severity of TRD. 44”
From Treatment resistance in psychiatry: state of the art and new directions (2022) · cites this paper as [42]
Citations
Cites
Still being checked.
Cited by
A Review of the Clinical, Economic, and Societal Burden of Treatment-Resistant Depression: 1996–2013
Mrazek, D. A., Hornberger, J. C., Altar, C. A., & Degtiar, I. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300059 · Cited by 580
Zhdanava, M., Pilon, D., Ghelerter, I., Chow, W., Joshi, K., Lefebvre, P., & Sheehan, J. J. (2021) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.20m13699 · Cited by 523
Treatment resistance in psychiatry: state of the art and new directions
Howes, O. D., Thase, M. E., & Pillinger, T. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01200-3 · Cited by 413
Birnbaum, H. G., Kessler, R. C., Kelley, D., Ben-Hamadi, R., Joish, V. N., & Greenberg, P. E. (2010) · Depression and Anxiety · doi:10.1002/da.20580 · Cited by 380
Self-citationTherapeutic Options for Treatment-Resistant Depression
Shelton, R. C., Osuntokun, O., Heinloth, A. N., & Corya, S. A. (2010) · CNS Drugs · doi:10.2165/11530280-000000000-00000 · Cited by 205
Corya, S. A., Williamson, D., Sanger, T. M., Briggs, S. D., Case, M., & Tollefson, G. (2006) · Depression and Anxiety · doi:10.1002/da.20130 · Cited by 170
The economic burden of depression in the US: societal and patient perspectives
Greenberg, P. E., & Birnbaum, H. G. (2005) · Expert Opinion on Pharmacotherapy · doi:10.1517/14656566.6.3.369 · Cited by 166
Self-citation(2010) · PubMed · Cited by 157
The Economic Burden of Treatment-Resistant Depression
Olchanski, N., McInnis Myers, M., Halseth, M., Cyr, P. L., Bockstedt, L., Goss, T. F., & Howland, R. H. (2013) · Clinical Therapeutics · doi:10.1016/j.clinthera.2012.09.001 · Cited by 146
Kubitz, N., Mehra, M., Potluri, R. C., Garg, N., & Cossrow, N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076882 · Cited by 143
Ivanova, J. I., Birnbaum, H. G., Kidolezi, Y., Subramanian, G., Khan, S. A., & Stensland, M. D. (2010) · Current Medical Research and Opinion · doi:10.1185/03007995.2010.517716 · Cited by 131
Self-citationEconomic implications of treatment-resistant depression among employees
Greenberg, P., Corey-Lisle, P. K., Birnbaum, H., Marynchenko, M., & Claxton, A. (2004) · PharmacoEconomics · doi:10.2165/00019053-200422060-00003 · Cited by 113
Self-citationMauskopf, J. A., Simon, G. E., Kalsekar, A., Nimsch, C., Dunayevich, E., & Cameron, A. (2009) · Depression and Anxiety · doi:10.1002/da.20505 · Cited by 94
Mortality in treatment-resistant unipolar depression: A register-based cohort study in Sweden
Reutfors, J., Andersson, T. M.-L., Brenner, P., Brandt, L., DiBernardo, A., Li, G., Hägg, D., Wingård, L., & Bodén, R. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.06.030 · Cited by 94
Scherrer, J. F., Chrusciel, T., Garfield, L. D., Freedland, K. E., Carney, R. M., Hauptman, P. J., Bucholz, K. K., Owen, R., & Lustman, P. J. (2012) · British Journal of Psychiatry · doi:10.1192/bjp.bp.111.096479 · Cited by 68
Reutfors, J., Andersson, T., Tanskanen, A. J., DiBernardo, A., Li, G., Brandt, L., & Brenner, P. (2019) · Archives of Suicide Research · doi:10.1080/13811118.2019.1691692 · Cited by 77
Scherrer, J. F., Salas, J., Sullivan, M. D., Schneider, F. D., Bucholz, K. K., Burroughs, T., Copeland, L., Ahmedani, B., & Lustman, P. J. (2016) · Preventive Medicine · doi:10.1016/j.ypmed.2016.08.003 · Cited by 64
Humanistic outcomes in treatment resistant depression: a secondary analysis of the STAR*D study
DiBernardo, A., Lin, X., Zhang, Q., Xiang, J., Lu, L., Jamieson, C., Benson, C., Lee, K., Bodén, R., Brandt, L., et al. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1920-7 · Cited by 66
Thase, M. E. (2004) · CNS Spectrums · doi:10.1017/s1092852900002236 · Cited by 67
Economic Burden of Treatment-Resistant Depression on the U.S. Health Care System
Sussman, M., O’sullivan, A. K., Shah, A., Olfson, M., & Menzin, J. (2019) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2019.25.7.823 · Cited by 65
Health care costs of depression in patients diagnosed with cancer
Mausbach, B. T., Yeung, P., Bos, T., & Irwin, S. A. (2018) · Psycho-Oncology · doi:10.1002/pon.4716 · Cited by 56
McIntyre, R. S., Millson, B., & Power, G. S. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.07.045 · Cited by 60
The economic impact of depression: Resistance or severity?
Fostick, L., Silberman, A., Beckman, M., Спивак, Б., & Amital, D. (2010) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2010.06.001 · Cited by 68
Epidemiology of pharmaceutically treated depression and treatment resistant depression in Taiwan
Fife, D., Feng, Y., Wang, M. Y.-H., Chang, C.-J., Liu, C.-Y., Juang, H.-T., Furnback, W., Singh, J., & Wang, B. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.03.006 · Cited by 55
Treatment-Resistant Depression Increases Health Costs and Resource Utilization
Lepine, B. A., Moreno, R. A., Campos, R. N., & Couttolenc, B. F. (2012) · Revista Brasileira de Psiquiatria · doi:10.1016/j.rbp.2012.05.009 · Cited by 54
Burden of treatment-resistant depression in Medicare: A retrospective claims database analysis
Pilon, D., Joshi, K., Sheehan, J. J., Zichlin, M. L., Zuckerman, P. R., Lefèbvre, P., & Greenberg, P. E. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223255 · Cited by 60
Self-citationMahlich, J., Tsukazawa, S., & Wiegand, F. (2018) · Drugs - Real World Outcomes · doi:10.1007/s40801-017-0126-5 · Cited by 49
Olfson, M., Amos, T. B., Benson, C., McRae, J., & Marcus, S. C. (2018) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2018.24.3.226 · Cited by 48
Gronemann, F. H., Jørgensen, M. B., Nordentoft, M., Andersen, P. K., & Osler, M. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.01.014 · Cited by 50
Kim, N., Cho, S., Kim, H.-Y., Kim, S. H., Lee, H. J., Park, C. H. K., Rhee, S. J., Kim, D.-W., Yang, B. R., Choi, S., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0221552 · Cited by 48
Brenner, P., Brandt, L., Li, G., DiBernardo, A., Bodén, R., & Reutfors, J. (2019) · Addiction · doi:10.1111/add.14866 · Cited by 49
Gronemann, F. H., Petersen, J., Alulis, S., Jensen, K. J., Riise, J., Ankarfeldt, M. Z., Solem, E. J., Bødker, N., & Osler, M. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.03.029 · Cited by 36
Herbild, L., Bech, M., & Gyrd‐Hansen, D. (2008) · Value in Health · doi:10.1111/j.1524-4733.2008.00465.x · Cited by 35
Dougherty, R. F., Clarke, P., Atli, M., Kuc, J., Schlosser, D. A., Dunlop, B. W., Hellerstein, D. J., Aaronson, S. T., Zisook, S., Young, A. H., et al. (2023) · Psychopharmacology · doi:10.1007/s00213-023-06432-5 · Cited by 35
Shin, D., Kim, N. W., Kim, M. J., Rhee, S. J., Park, C. H. K., Kim, H.-Y., Yang, B. R., Kim, M.-S., Choi, G., Koh, M., et al. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05153-1 · Cited by 34
Medicaid spending burden among beneficiaries with treatment-resistant depression
Pilon, D., Sheehan, J. J., Szukis, H., Singer, D., Jacques, P., Lejeune, D., Lefèbvre, P., & Greenberg, P. E. (2019) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2018-0140 · Cited by 35
Self-citationBirnbaum, H. G., Ben-Hamadi, R., Greenberg, P. E., Hsieh, M., Tang, J., & Reygrobellet, C. (2009) · PharmacoEconomics · doi:10.2165/00019053-200927060-00006 · Cited by 31
Self-citationHägg, D., Brenner, P., Reutfors, J., Li, G., DiBernardo, A., Bodén, R., & Brandt, L. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236434 · Cited by 33
Madsen, K. B., Plana‐Ripoll, O., Musliner, K. L., Debost, J.-C., Petersen, L. V., & Munk‐Olsen, T. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.11.042 · Cited by 33
Staging of unipolar depression: systematic review and discussion of clinical implications
Cosci, F., & Fava, G. A. (2022) · Psychological Medicine · doi:10.1017/s0033291722001507 · Cited by 28
Shah, D., Allen, L., Zheng, W., Madhavan, S., Wei, W., LeMasters, T. J., & Sambamoorthi, U. (2021) · PharmacoEconomics · doi:10.1007/s40273-021-01029-2 · Cited by 27
Jamieson, C., Popova, V., Daly, E., Cooper, K., Drevets, W. C., Rozjabek, H., & Singh, J. B. (2023) · Health and Quality of Life Outcomes · doi:10.1186/s12955-023-02113-1 · Cited by 30
Taipale, H. T., Reutfors, J., Tanskanen, A. J., Brandt, L., Tiihonen, J., DiBernardo, A., Mittendorfer‐Rutz, E., & Brenner, P. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02642-9 · Cited by 28
Psychedelic renaissance: Revitalized potential therapies for psychiatric disorders
Rhee, T. G., Davoudian, P. A., Sanacora, G., & Wilkinson, S. T. (2023) · Drug Discovery Today · doi:10.1016/j.drudis.2023.103818 · Cited by 24
Pilon, D., Sheehan, J. J., Szukis, H., Morrison, L., Zhdanava, M., Lefèbvre, P., & Joshi, K. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.04.100 · Cited by 24
Madsen, K. B., Petersen, L. V., Plana‐Ripoll, O., Musliner, K. L., Debost, J.-C., Gronemann, F. H., Mortensen, P. B., & Munk‐Olsen, T. (2020) · Therapeutic Advances in Psychopharmacology · doi:10.1177/2045125320973791 · Cited by 29
Birnbaum, H. G., Ben-Hamadi, R., Kelley, D., Hsieh, M., Seal, B. S., Kantor, E., Crémieux, P., & Greenberg, P. E. (2010) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0b013e3181cb5b10 · Cited by 22
Self-citationMcDonald, W. M. (2006) · Journal of Ect · doi:10.1097/00124509-200603000-00005 · Cited by 19
Economic burden of treatment-resistant depression among veterans in the United States
Szukis, H., Joshi, K., Huang, A., Amos, T. B., Wang, L., & Benson, C. J. (2021) · Current Medical Research and Opinion · doi:10.1080/03007995.2021.1918073 · Cited by 18
Tian, H., Abouzaid, S., Gabriel, S., Kahler, K. H., & Kim, E. (2012) · The Primary Care Companion For CNS Disorders · doi:10.4088/pcc.12m01374 · Cited by 15
The Role of Psychotherapy in the Management of Treatment-Resistant Depression
Rogan, T., & Wilkinson, S. T. (2023) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2023.02.006 · Cited by 15
Cohen, L. J., & Allen, J. C. (2008) · Current Medical Research and Opinion · doi:10.1185/03007990802229050 · Cited by 13
Kabotyanski, K. E., Najera, R. A., Banks, G. P., Sharma, H., Provenza, N. R., Hayden, B. Y., Mathew, S. J., & Sheth, S. A. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-02951-7 · Cited by 13
The economic burden associated with SSRI treatment failure in a managed care population
Balkrishnan, R., Joish, V. N., Yang, T. T., Jayawant, S. S., & Mullins, C. D. (2008) · Journal of Medical Economics · doi:10.3111/13696990802522339 · Cited by 13
Jing, Y., Kalsekar, I. D., Curkendall, S. M., Carls, G. S., Bagalman, E., Forbes, R. A., Hebden, T., & Thase, M. E. (2011) · Clinical Therapeutics · doi:10.1016/j.clinthera.2011.07.015 · Cited by 11
Clinical Utility and Economic Impact of CYP2D6 Genotyping
Reynolds, K. K., McNally, B. A., & Linder, M. W. (2016) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2016.05.008 · Cited by 12
Arnaud, A. M., Benner, J., Suthoff, E. D., WERNEBURG, B. G., Reinhart, M. L., Sussman, M., & Kessler, R. C. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.12.147 · Cited by 11
Nadkarni, A., Kalsekar, You, Hebden, & Forbes (2013) · ClinicoEconomics and Outcomes Research · doi:10.2147/ceor.s36526 · Cited by 11
Salloum, N. C., Gott, B. M., & Conway, C. R. (2017) · Brain stimulation · doi:10.1016/j.brs.2017.06.001 · Cited by 11
Descriptive analysis of the economic burden of treatment resistance in a major depressive episode
Cai, Q., Sheehan, J. J., Wu, B., Alphs, L. D., Connolly, N., & Benson, C. J. (2019) · Current Medical Research and Opinion · doi:10.1080/03007995.2019.1671087 · Cited by 10
Wang, H., Wu, T., Dong, S., Guan, M., Liu, A., Jiang, K., Chi, R., Qiu, H. X., Dong, W., & Si, T. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.02.054 · Cited by 9
Shah, D., Zheng, W., Allen, L., Wei, W., LeMasters, T., Madhavan, S., & Sambamoorthi, U. (2021) · Current Medical Research and Opinion · doi:10.1080/03007995.2021.1900088 · Cited by 9
Health care utilisation in treatment-resistant depression: a Swedish population-based cohort study
Brenner, P., Nygren, A., Hägg, D., Tiger, M., O’Hara, M., Brandt, L., & Reutfors, J. (2021) · International Journal of Psychiatry in Clinical Practice · doi:10.1080/13651501.2021.2003405 · Cited by 9
Park, H., Park, C. M., Woo, J., Shin, J., Lee, E., & Kwon, S. (2021) · Journal of Medical Economics · doi:10.1080/13696998.2021.1918922 · Cited by 8
Trajectories of pharmacological therapies for treatment-resistant depression: a longitudinal study
DiBello, J. R., Xiong, X., Liu, X., Zhong, W., Merola, A., Li, M., & Lu, K. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06518-8 · Cited by 7
Pharmacologic Strategies for Treatment-resistant Depression: An Update on the State of the Evidence
Thase, M. E. (2005) · Psychiatric Annals · doi:10.3928/00485713-20051201-04 · Cited by 7
Demitrack, M. A. (2010) · Psychopharm Review · doi:10.1097/01.idt.0000369508.83887.db · Cited by 4
Lee, K. K. C., Mohamed, N. N. E., Aziz, S. A., Nazri, D. M., Malek, A. Z. A., Lim, J.-S., Wu, D. B.-C., Aftab, R. A., Thanimalai, S., Swaminathan, M., et al. (2025) · Expert Opinion on Pharmacotherapy · doi:10.1080/14656566.2025.2472976 · Cited by 3
Health Economics: The Hidden Costs of Mental Illness
Martini, D. R., & Attallah, T. (2019) · Springer eBooks · doi:10.1007/978-3-030-12665-0_1 · Cited by 3
Effect of Reliable Recovery on Health Care Costs and Productivity Losses in Emotional Disorders
Barrio‐Martínez, S., Ruiz‐Rodríguez, P., Medrano, L. A., Priede, A., Muñoz‐Navarro, R., Moriana, J. A., Carpallo-González, M., Prieto-Vila, M., Vindel, A. C., & González‐Blanch, C. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.08.012 · Cited by 3
Antidepressant treatment patterns and costs among US employees
Birnbaum, H. G., Greenberg, P. E., Tang, J., Hsieh, M., Wu, E. Q., Amand, C., & Ben-Hamadi, R. (2009) · Journal of Medical Economics · doi:10.3111/13696990902757389 · Cited by 3
Self-citationThe Economic Burden of Depression: Societal and Patient Perspectives
Greenberg, P. E., & Birnbaum, H. G. (2005) · Wiley eBooks · doi:10.1002/9783527619672.ch3 · Cited by 2
Self-citationTherapeutic Alternatives for Difficult-to-treat Depression: What is the State of the Evidence?
Thase, M. E. (2003) · Psychiatric Annals · doi:10.3928/0048-5713-20031201-08 · Cited by 3
Inhaled gases for treatment-resistant major depression
Conway, C. R., Mickey, B. J., Palanca, B. J. A., Tadler, S. C., & Nägele, P. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-824067-0.00033-5 · Cited by 2
Depression: Current Conceptual Trends
Nahas, Z. H. (2016) · Springer eBooks · doi:10.1007/978-1-59745-495-7_1 · Cited by 1
Adu, M. K., Dias, R. D. L., Agyapong, B., Eboreime, E., Sapara, A. O., Lawal, M. A., Chew, C., Frost, K. D., Li, D., Flynn, M., et al. (2023) · JMIR Research Protocols · doi:10.2196/46830 · Cited by 1
Revista Brasileira de Psiquiatria
Lepine, B. A., Moreno, R. A., Campos, R. N., & Couttolenc, B. F. (2012)
Shah, D. (2019) · The Research Repository @ WVU (West Virginia University) · doi:10.33915/etd.3855
Boin, A. C. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.17.2021.tde-04102021-164001 · Cited by 1
Cipriani, A., Barbui, C., Baethge, C., Wilder, H., & Geddes, J. R. (2005) · Springer eBooks · doi:10.1007/3-540-28049-9_14
The use of inhaled gases in psychiatry
Hristidis, V. C., Nägele, P., Palanca, B. J. A., Tadler, S. C., Mickey, B. J., Gott, B. M., & Conway, C. R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-18496-3.00016-1
Taipale, H. T., Reutfors, J., Tanskanen, A., Brandt, L., Tiihonen, J., DiBernardo, A., Mittendorfer-Rutz, E., & Brenner, P. (2020) · Figshare · doi:10.6084/m9.figshare.12299210
Shin, D., Kim, N. W., Kim, M. J., Rhee, S. J., Park, C. H. K., Kim, H., Yang, B. R., Kim, M.-S., Choi, G. J., Koh, M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12096774
Paillé, M. T. (2019) · Mspace (University of Manitoba) · Cited by 1
Metadata
- Authors
- Corey-Lisle, P. K., Birnbaum, H. G., Greenberg, P. E., Marynchenko, M. B., & Claxton, A. J.
- Venue
- The Journal of Clinical Psychiatry
- Publisher
- Physicians Postgraduate Press, Inc
- Published
- 2002-08-15
- Volume
- 63
- Issue
- 8
- Pages
- 717-726
- ISSN
- 0160-6689 (ISSN-L)
- OpenAlex
- W2005410879
- Cited by
- 84
- References
- 0
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 7 · 2022: 3 · 2021: 10 · 2020: 8 · 2019: 10 · 2018: 4 · 2017: 3 · 2016: 3 · 2014: 1 · 2013: 3 · 2012: 3
- FWCI
- 1.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Clinical Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- treatment-resistant depression, major depressive disorder, claims data, treatment patterns, economic burden, resource utilization (health care), indirect costs, disability claims, comorbidities, employer costs, administrative claims data
- MeSH terms
- Adolescent, Adult, Aged, Algorithms, Clinical Protocols, Costs and Cost Analysis, Depressive Disorder, Electroconvulsive Therapy, Female, Health Benefit Plans, Employee, Health Services, Humans, Insurance Claim Review, Male, Middle Aged, Monoamine Oxidase Inhibitors, Sampling Studies, Treatment Outcome, Health Care Costs, Practice Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.