Cited by 22Healthcare Policy and ManagementSubstance Abuse Treatment and OutcomesOpioid Use Disorder Treatment

Healthcare utilization of individuals with substance use disorders following Affordable Care Act implementation in a California healthcare system

Open access
Satre, Derek D., Palzes, Vanessa A., Young-Wolff, Kelly C., Parthasarathy, Sujaya, Weisner, Constance, Guydish, Joseph, Campbell, Cynthia I.·2020·Journal of Substance Abuse Treatment

Abstract

Background: Practitioners expected the Affordable Care Act (ACA) to increase availability of health services and access to treatment for Americans with substance use disorders (SUDs). Yet research has not examined the associations among ACA enrollment mechanisms, deductibles, and the use of SUD treatment and other healthcare services. Understanding these relationships can inform future healthcare policy. Methods: We conducted a longitudinal analysis of patients with SUDs newly enrolled in the Kaiser Permanente Northern California health system in 2014 (N = 6957). Analyses examined the likelihood of service utilization (primary care, specialty SUD treatment, psychiatry, inpatient, and emergency department [ED]) over three years after SUD diagnosis, and associations with enrollment mechanisms (ACA Exchange vs. other), deductibles (none, $1–$999 [low] and ≥$1000 [high]), membership duration, psychiatric comorbidity, and demographic characteristics. We also evaluated whether the enrollment mechanism moderated the associations between deductible limits and utilization likelihood. Results: Service utilization was highest in the 6 months after SUD diagnosis, decreased in the following 6 months, and remained stable in years 2–3. Relative to patients with no deductible, those with a high deductible had lower odds of using all health services except SUD treatment; associations with primary care and psychiatry were strongly negative among Exchange enrollees. Among non-Exchange enrollees, patients with deductibles were more likely than those without deductibles to receive SUD treatment. Exchange enrollment compared to other mechanisms was associated with less ED use. Psychiatric comorbidity was associated with greater use of all services. Nonwhite patients were less likely to initiate SUD and psychiatry treatment. Conclusions: Higher deductibles generally were associated with use of fewer health services, especially in combination with enrollment through the Exchange. The role of insurance factors, psychiatric comorbidity and race/ethnicity in health services for people with SUDs are important to consider as health policy evolves. © 2020 Elsevier Inc.

Integrity signals

Registry

Crossref · 10.1016/j.jsat.2020.108097

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

9 of 27 cited sources checked · 4 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    The ACA appears to have improved coverage for SUD and psychiatry care.

    “Evidence suggests a positive impact of the ACA on both SUD and psychiatry coverage (Cowell, Prakash, Jones, Barnosky, & Wedehase, 2018; Novak, Anderson, & Chen, 2018; Shover, Abraham, D’Aunno, Friedmann, & Humphreys, 2019), including an increase in insurance choices (Abraham et al., 2017; Andrews et al., 2018; Feder et al., 2017).”
    Quote in the paperNot a substantial claim2 of 3 sources checked
    • cites Cowell, Prakash, Jones, Barnosky, & Wedehase, 2018 source
    • cites Novak, Anderson, & Chen, 2018 source

      The Discussion reports that adults with serious psychological distress were more likely to have health insurance after 2014 and faced fewer barriers to mental health care. It does not establish improved coverage specifically for substance use disorder treatment or psychiatry services; its finding concerns overall insurance coverage in a mental-health population. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites Shover, Abraham, D’Aunno, Friedmann, & Humphreys, 2019 source
  • Premisecitation

    Access to services is still a major problem.

    “But access to services remains a major concern (Feder et al., 2017; Saloner et al., 2017), and much is still unknown regarding how ACA-associated enrollment through insurance exchanges and cost-sharing structures (especially deductibles) are associated with access to and use of SUD treatment and other health services in this complex patient population.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Feder et al., 2017 source
    • cites Saloner et al., 2017 source
  • Study design and conductown data

    The study could not examine Medicaid expansion's relationship to services due to collinearity with deductible limits.

    “Medicaid expansion has the potential to improve access to SUD treatment (Andrews et al., 2019), but we were also not able to examine its relationship to services in the current analysis due to collinearity with deductible limits (Medicaid patients in our cohort did not have a deductible).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Andrews et al., 2019 source

      The citation is attached to the claim that Medicaid expansion could improve access to SUD treatment, not to the citing authors’ explanation of collinearity in their own analysis. Table 1 (METHODS; page unavailable) includes Medicaid expansion status and shows higher unadjusted buprenorphine availability in expansion states, but its adjusted estimate is not statistically significant; it does not establish improved access to SUD treatment generally. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Findingown data

    Nonwhite patients had lower odds of initiating psychiatry treatment.

    “Controlling for all other characteristics, nonwhite patients had lower odds of initiating specialty SUD and psychiatry treatment (Table 2).”
    Quote in the paperSubstantial claim
  • Findingown data

    The difference between ACA Exchange and non-ACA enrollees in the association between high deductibles and psychiatry use was significant (ORR=0.68, 95% CI 0.51-0.91; 32% lower).

    “The corresponding ORs among patients who enrolled via other non-ACA mechanisms were 0.83 (95% CI=0.74–0.92) for primary care and 0.85 (95% CI=0.73–0.98) for psychiatry; these represent a significantly lower difference of 22% (ratio of odds ratios [ORR]=0.78, 95% CI=0.63–0.96) and 32% (ORR=0.68, 95% CI=0.51–0.91), respectively.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 14
  • May combine two claims. 16
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The ACA increased the number of insurance choices available.

    “including an increase in insurance choices (Abraham et al., 2017; Andrews et al., 2018; Feder et al., 2017).”
    Quote in the paperNot a substantial claim2 of 3 sources checked
    • cites Abraham et al., 2017 source
    • cites Andrews et al., 2018 source

      The Study Results (Alternative Benefit Coverage; page unavailable) report an increase in the number of states offering an alternative Medicaid benefit plan. The paper does not establish that individuals had more insurance plans to choose from; its finding concerns plan availability across states and addiction-treatment benefits. (LLM, conf=0.73)

      Experimental — accuracy not yet measured
    • cites Feder et al., 2017 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Chronic medical conditions may affect whether patients choose a plan with a lower or no deductible when such a choice is available.

    “Patients with chronic medical conditions utilize more health services than patients without such conditions (Gulley, Rasch, & Chan, 2011), which may influence their decision to choose a plan with a lower (or no) deductible if given an option (Gulley et al., 2011), so we included this covariate to control for confounding.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Gulley et al., 2011 source

      The Results report greater health-service use among people with chronic conditions, but the cited claim concerns whether that affects their choice of deductible. The Methods discuss insurance coverage as a control variable, not plan selection; searches for deductible and plan choice found no passage addressing that decision. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim.

    Premisecitation

    Patients with chronic medical conditions use more health services than patients without them.

    “Patients with chronic medical conditions utilize more health services than patients without such conditions (Gulley, Rasch, & Chan, 2011), which may influence their decision to choose a plan with a lower (or no) deductible if given an option (Gulley et al., 2011), so we included this covariate to control for confounding.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Gulley, Rasch, & Chan, 2011 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    After the ACA was implemented in 2014, the number of people without insurance in the United States fell.

    “Following ACA implementation in 2014, the overall number of individuals living without insurance dropped (Maclean & Saloner, 2019; Thomas, Shartzer, Kurth, & Hall, 2018).”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Maclean & Saloner, 2019 source

      The Discussion (p. 29) reports a reduction in the uninsured among people receiving substance use disorder treatment after ACA-related Medicaid expansions. Section 2.3 also reports a post-expansion decline in uninsurance among low-income U.S. adults. Neither passage establishes that the overall number of uninsured people in the United States fell. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites Thomas, Shartzer, Kurth, & Hall, 2018 source
  • May combine two claims.

    Findingown data

    In sensitivity analysis, the censored group had a larger proportion of patients with high deductibles (28% vs 19%, p<.001) and a smaller proportion who enrolled via the ACA exchange (13% vs 18%, p<.001) compared to the noncensored group.

    “The censored group had a larger proportion of patients with high deductibles (28% vs. 19%, p<.001) and a smaller proportion of patients who enrolled via the ACA exchange (13% vs 18%, p<.001) compared to the noncensored group (Table S6).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    There were no differences in psychiatry treatment, inpatient hospitalization, or ED visits between patients with membership duration ≥6 months and those with <6 months.

    “Patients with a longer membership duration before receiving an SUD diagnosis (≥6 months) were less likely to utilize primary care (OR=0.89, 95% CI=0.83–0.96) and specialty SUD treatment (OR=0.78, 95% CI=0.69–0.87) than those with a shorter duration (<6 months); there were no differences for psychiatry treatment, inpatient hospitalizations, or ED visits (Tables 2–3).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Utilization of primary care, specialty SUD treatment, psychiatry, inpatient hospitalization, and ED was highest in the first 6 months after index and declined in the next 6 months, then remained stable.

    “Utilization of any primary care, specialty SUD treatment, psychiatry, inpatient hospitalizations, and ED was highest in the 0–6 months after index and decreased in the subsequent (6–12 months) time window; utilization remained stable thereafter (Figure 1, Table S3).”
    • Also stated in: § Conclusion · plain
      “This study found that in newly enrolled patients with SUDs, health service utilization peaked in the 6 months following an SUD diagnosis and then decreased to a stable level in years 2–3.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Compared to patients aged 18-34, patients aged 50-64 had higher odds of utilizing primary care and inpatient services, but lower odds of utilizing psychiatry and ED services.

    “Compared to younger patients (18–34 years), older patients (50–64 years) had higher odds of utilizing primary care and inpatient services, but lower odds of utilizing psychiatry and ED services (Tables 2–3).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The trends in utilization did not differ by deductible limit or SUD diagnosis type.

    “These trends did not vary by deductible limit (Figure S1) or type of SUD diagnosis (Figure S2).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Compared to patients aged 18-34, patients aged 35-49 had higher odds of utilizing primary care and specialty SUD services, but lower odds of utilizing inpatient and ED services.

    “Patients aged 35–49 years had higher odds of utilizing primary care and specialty SUD services, but lower odds of utilizing inpatient and ED services, compared to patients aged 18–34 years (Tables 2–3).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In sensitivity analysis, patients censored due to disenrollment at 6-12 months used less primary care (59% vs 77%, p<.001) and psychiatry services (20% vs 29%, p<.001) in the first 6 months than noncensored patients.

    “The censored group used less primary care (59% vs. 77%, p<.001) and psychiatry services (20% vs. 29%, p<.001) in the first 6 months but were slightly more likely to visit the ED (64% vs. 60%, p=0.009; Table S6).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Patients with a chronic medical comorbidity had significantly higher odds of utilizing all health services except specialty SUD treatment, which they were less likely to utilize.

    “Patients with a chronic medical comorbidity had significantly higher odds of utilizing all health services, except for specialty SUD treatment, which they were less likely to utilize (Tables 2–3).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    KPNC's membership is racially and socioeconomically diverse and matches the surrounding geographic area's demographics.

    “The membership is racially and socioeconomically diverse and representative of the demographic of the geographic area (Gordon, 2015; Selby et al., 2005).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Gordon, 2015

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Selby et al., 2005

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The study received approval from the UCSF and KPNC institutional review boards, which also granted a waiver of informed consent.

    “The University of California, San Francisco and Kaiser Permanente Northern California Institutional Review Boards approved the study and approved a waiver of informed consent.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    This study used a large SUD patient cohort enrolled in health coverage post-ACA and included comprehensive data on diagnoses, insurance coverage, and use of care over three years.

    “This study used a large SUD patient cohort enrolled in health coverage post-ACA and included comprehensive data on diagnoses, insurance coverage, and use of care over three years.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The study did not include insurance type as a covariate because it was collinear with deductible limits and Exchange enrollment.

    “We did not include type of insurance (beyond deductible limits) as a covariate due to its collinearity with deductible limits and enrollment via the ACA exchange (Medicaid patients did not have a deductible and enrolled through another mechanism).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Study design and conductreasoning

    KPNC data are well-suited to examine ACA-related changes in health service utilization given the size and diversity of its membership.

    “KPNC data are well-suited to examine ACA-related changes in health service utilization given the size and diversity of its membership.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    High deductibles have the potential to dissuade SUD patients from accessing needed health services, and ACA Exchange enrollees may be more sensitive to them.

    “Consistent with prior findings (Agarwal, Mazurenko, & Menachemi, 2017), our results suggest that high deductibles have the potential to dissuade SUD patients from accessing needed health services, and that those who enroll via the ACA exchange may be more sensitive to them.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Agarwal, Mazurenko, & Menachemi, 2017 source
  • May combine two claims.

    Interpretationown data

    Race/ethnic disparities in SUD and psychiatry treatment initiation exist in this cohort, where overall insurance coverage was not a barrier but specific mechanisms could be.

    “The race/ethnic disparities in SUD and psychiatry treatment initiation in this cohort, in which overall insurance coverage was not a barrier but specific mechanisms could be, highlight the importance of addressing this complicated challenge to health equity.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Earlier research indicates that an SUD diagnosis frequently follows a critical event, such as an ED visit.

    “As with earlier studies (Holder, 1998; Parthasarathy, Weisner, Hu, & Moore, 2001), which indicate that SUD diagnosis is often precipitated by a critical event such as an ED visit, we expected that postdiagnosis utilization would be highest in the period immediately following diagnosis but would likely decrease over time, although trajectories would vary by type of utilization.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Holder, 1998 source
    • cites Parthasarathy, Weisner, Hu, & Moore, 2001 source
  • May combine two claims.

    Premisecitation

    The ACA created state insurance exchanges and required SUD and psychiatric disorder treatment to be covered as essential benefits.

    “The Affordable Care Act (ACA) (U.S. Congress, 2010) established state insurance exchanges to promote and offer health coverage, and mandated SUD and psychiatric disorder treatment as essential benefits.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites U.S. Congress, 2010

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The study is observational and based on EHR data, so causal relationships cannot be attributed to the findings.

    “However, we should note that is an observational study based on EHR data. As such, we cannot attribute causal relationships to our findings.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The Andersen model holds that healthcare utilization is shaped by predisposing factors, need, and enabling factors.

    “We examined factors associated with utilization as conceptualized by the Andersen model of healthcare utilization (Andersen, 1995; Weisner, Matzger, Tam, & Schmidt, 2002), which proposes that utilization is determined by predisposing (e.g., race/ethnicity and other demographic factors) need (e.g., diagnoses) (Andersen, 1995) and enabling factors (e.g., benefit plan, Exchange enrollment) (Dhingra,”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Andersen, 1995 source
    • cites Weisner, Matzger, Tam, & Schmidt, 2002 source
    • cites Dhingra, Zack, Strine, Pearson, & Balluz, 2010 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Many chronic medical conditions are known to be associated with SUDs.

    “We identified common chronic medical conditions (Ornstein, Nietert, Jenkins, & Litvin, 2013), many of which are known to be associated with SUDs (Mertens, Lu, Parthasarathy, Moore, & Weisner, 2003) using ICD-9/10 codes recorded within the first year after initial enrollment.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mertens, Lu, Parthasarathy, Moore, & Weisner, 2003 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The study ran a sensitivity analysis to test whether high utilizers leaving the health system explained the observed drop in utilization between the first and second six-month periods.

    “We conducted a sensitivity analysis to determine whether high utilizers leaving the health system influenced the observed pattern of decreased utilization from the 0–6 month to the 6–12 month follow-up periods.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductcitation

    The analysis applied generalized estimating equations to handle correlation across repeated measures.

    “To account for correlation between repeated measures, we used the generalized estimating equations methodology (Liang & Zeger, 1986).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Liang & Zeger, 1986 source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationown data

    The findings can inform future work on health reform and policy efforts to improve access to healthcare for similar clinically complex patients in other health systems.

    “Nevertheless, our findings can inform future work on health reform and policy efforts to improve access to healthcare for similar clinically complex patients in other health systems.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    Sensitivity analyses were conducted to examine the robustness of the findings in the absence of a randomized clinical trial, and these analyses supported the initial findings.

    “However, we have conducted sensitivity analyses to examine the robustness of our findings in the absence of a randomized clinical trial. These analyses supported our initial findings; e.g., indicating that service use decrease over time was not due to high utilizers leaving KPNC.”
    Quote in the paperSubstantial claim
28 of 28
  • The paper relies on this without support.

    How ACA enrollment mechanisms and cost-sharing structures relate to SUD treatment and other health service use in this population is not yet known.

    “Yet research has not examined the associations among ACA enrollment mechanisms, deductibles, and the use of SUD treatment and other healthcare services.”
    “But access to services remains a major concern (Feder et al., 2017; Saloner et al., 2017), and much is still unknown regarding how ACA-associated enrollment through insurance exchanges and cost-sharing structures (especially deductibles) are associated with access to and use of SUD treatment and other health services in this complex patient population.”
  • The authors state this as an assumption.

    ACA-related effects would be more visible among first-time enrollees than among the broader SUD-diagnosed membership.

    “We focused on new enrollees based on the premise that ACA-related influence would be more apparent among first-time enrollees than in the overall SUD-diagnosed membership.”
  • The paper relies on this without support.

    Deductibles are more common in ACA benefit plans than in other plans.

    “Deductibles are features across different benefit plans, including commercial plans, but are more common in ACA benefit plans.”
  • The paper relies on this without support.

    The index date (first SUD diagnosis) is a valid starting point for measuring post-diagnosis utilization.

    “Utilization of any primary care, specialty SUD treatment, psychiatry, inpatient hospitalizations, and ED was highest in the 0–6 months after index and decreased in the subsequent (6–12 months) time window; utilization remained stable thereafter (Figure 1, Table S3).”
  • The paper relies on this without support.

    Deductible limits are a valid measure of patient cost-sharing that can affect healthcare utilization.

    “As anticipated, higher deductibles had a generally negative association with utilizing healthcare in this population.”
  • The paper relies on this without support.

    Enrollment mechanism (ACA Exchange vs other) is a valid proxy for coverage type and information environment.

    “Controlling for demographic characteristics, chronic medical conditions, and psychiatric comorbidities, there was evidence that the enrollment mechanism moderated the associations between deductible limits and the likelihood of utilizing primary care and psychiatry treatment from the multivariable models (Table 2; Figure 2).”
  • The paper relies on this without support.

    The multivariable models adequately control for confounding.

    “Controlling for demographic characteristics, chronic medical conditions, and psychiatric comorbidities, there was evidence that the enrollment mechanism moderated the associations between deductible limits and the likelihood of utilizing primary care and psychiatry treatment from the multivariable models (Table 2; Figure 2).”
  • The paper relies on this without support.

    The sensitivity analysis comparing censored and noncensored patients addresses the potential bias from disenrollment.

    “Our sensitivity analysis suggested that this result was not due to high utilizers leaving the KPNC healthcare system.”
8 of 8

Cites

Flagged first, then by citations

3 of the 59 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Satre, D. D., Palzes, V. A., Young-Wolff, K. C., Parthasarathy, S., Weisner, C., Guydish, J., & Campbell, C. I.
Affiliations
  • Kaiser Permanente (US)
  • University of California, San Francisco (US)
Corresponding author
Satre, Derek D.
Venue
Journal of Substance Abuse Treatment
Publisher
Elsevier BV
Published
2020-11
Volume
118
Pages
108097
ISSN
0740-5472 (ISSN-L)
OpenAlex
W3047345873
Cited by
22
References
59
Citations by year
2026: 1 · 2025: 3 · 2024: 7 · 2023: 4 · 2022: 3 · 2021: 2 · 2020: 2
FWCI
2.34
Type
journal article
Language
en
Open access
Locations
  • Journal of Substance Abuse Treatment (acceptedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
Funders
  • National Institute on Alcohol Abuse and Alcoholism
  • Tobacco-Related Disease Research Program
  • National Institute on Drug Abuse
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Healthcare Policy and Management
  • Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Opioid Use Disorder Treatment
Keywords
substance use disorders, Affordable Care Act, health care utilization, health insurance deductibles, psychiatric comorbidity, emergency department utilization, racial and ethnic disparities, Kaiser Permanente, health policy
MeSH terms
California, Delivery of Health Care, Humans, Patient Acceptance of Health Care, United States, Substance-Related Disorders, Patient Protection and Affordable Care Act

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review