Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Open accessThe DOI matches its Crossref record; 53 of the 55 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: A randomized trial assessed the effectiveness of a 2-level strategy for implementing evidence-based mental health treatments for delinquent youth. METHOD: A 2 x 2 design encompassing 14 rural Appalachian counties included 2 factors: (a) the random assignment of delinquent youth within each county to a multisystemic therapy (MST) program or usual services and (b) the random assignment of counties to the ARC (for availability, responsiveness, and continuity) organizational intervention for implementing effective community-based mental health services. The design created 4 treatment conditions (MST plus ARC, MST only, ARC only, control). Outcome measures for 615 youth who were 69% male, 91% Caucasian, and aged 9-17 years included the Child Behavior Checklist and out-of-home placements. RESULTS: A multilevel, mixed-effects, regression analysis of 6-month treatment outcomes found that youth total problem behavior in the MST plus ARC condition was at a nonclinical level and significantly lower than in other conditions. Total problem behavior was equivalent and at nonclinical levels in all conditions by the 18-month follow-up, but youth in the MST plus ARC condition entered out-of-home placements at a significantly lower rate (16%) than youth in the control condition (34%). CONCLUSIONS: Two-level strategies that combine an organizational intervention such as ARC and an evidence-based treatment such as MST are promising approaches to implementing effective community-based mental health services. More research is needed to understand how such strategies can be used effectively in a variety of organizational contexts and with other types of evidence-based treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Considerable information is available on the organizational characteristics that promote the exploration and eventual adoption of innovation (Greenhalgh et al. 2004; Rogers 2003) and EBPs in mental health and social service organizations”
From Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors (2011) · cites this paper as Glisson et al. 2010
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, Glisson et al. (2010) demonstrated in a randomized trial that multisystemic therapy (MST) is more effective when implemented in the context of an organization development intervention that focuses on improving leadership and community agency culture and climate than when MST is implemented alone.”
From Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation (2015) · cites this paper as Glisson et al. 2010
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 4×
“The analysis used a binomial sampling model based on the Bernoulli distribution and a logit link function with the log of the odds of custody as the outcome variable (Raudenbush & Bryk, 2002, pp. 294–309).”
MethodInfluentialBowman, P. W. (1963) · AIBS Bulletin · doi:10.2307/1292957 · Cited by 3,638
Child abuse and neglect: The myth of classlessness.
Pelton, L. H. (1978) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1978.tb02565.x · Cited by 1,949
Lenggenhager, J. (1947) · PubMed · Cited by 1,772
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n404 · Cited by 1,528
Evidence-Based Psychosocial Treatments for Children and Adolescents With Disruptive Behavior
Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410701820117 · Cited by 1,335
(2003) · Guilford Press eBooks · Cited by 1,037
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Identifying and developing empirically supported child and adolescent treatments.
Kazdin, A. E., & Weisz, J. R. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.19 · Cited by 758 · cited 1×
“…of the implementation and outcomes of MST in community settings have been summarized in peerreviewed journals (e.g., Eyberg, Nelson & Boggs, 2008; Kazdin & Weisz, 1998; Schoenwald, 2008), government reports (e.g., National Institute on Drug Abuse, 1999; National Institutes of Health, 2006; U.S.…”
BackgroundSholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628 · cited 1×
“They suggest that, first, implementation strategies that simply train clinicians in a new clinical treatment model (evidence-based or not) are insufficient to implement effective services (e.g., Sholomskas et al., 2005).”
BackgroundMental Health, United States, 2000: (360402004-001)
Manderscheid, R. W., & Henderson, M. J. (2001) · PsycEXTRA Dataset · doi:10.1037/e360402004-001 · Cited by 593
Detecting and measuring rater effects using many-facet Rasch measurement: Part II.
Myford, C. M., & Wolfe, E. W. (2003) · PubMed · Cited by 587
Improving the Quality of Health Care for Mental and Substance-Use Conditions: Quality Chasm Series
(2006) · National Academies Press eBooks · doi:10.17226/11470 · Cited by 553
Multisystemic therapy for antisocial behavior in children and adolescents
Henggeler, S. W. (2009) · Cited by 533
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533
Linacre, J. M. (1994) · Medical Entomology and Zoology · Cited by 528
Reliability and Validity of DSM-IV Axis V
Hilsenroth, M. J., Ackerman, S. J., Blagys, M. D., Baumann, B. D., Baity, M. R., Smith, S. R., Price, J. L., Smith, C. L., Heindselman, T. L., Mount, M. K., et al. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.11.1858 · Cited by 438 · cited 1×
“…2000), (h) be TennCare (Tennessee’s Medicaid waiver program) eligible, (i) have a Global Assessment of Functioning score of less than 51 (Greenberg & Rosenheck, 2005; Hilsenroth et al., 2000), (j) have behavioral or psychiatric symptoms that require intervention, and (k) have an IQ greater than 54.”
BackgroundAllegra, C. J., Aberle, D. R., Ganschow, P., Hahn, S. M., Lee, C. N., Millon-Underwood, S., Pike, M. C., Reed, S. D., Saftlas, A. F., Scarvalone, S. A., et al. (2010) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djp485 · Cited by 373
The Organizational Context of Children's Mental Health Services
Glisson, C. (2002) · Clinical Child and Family Psychology Review · doi:10.1023/a:1020972906177 · Cited by 367 · cited 1×
“This study provides support for the use of contextual interventions that address organizational and community barriers to the implementation of mental health services and evidence-based treatment programs (Glisson, 2002; Glisson et al., 2008).”
Self-citation2001: Youth Violence—A Report of the Surgeon General
(2014) · The Social History of the American Family: An Encyclopedia · doi:10.4135/9781452286143.n705 · Cited by 350
Glisson, C., Dukes, D., & Green, P. (2006) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2005.12.010 · Cited by 298 · cited 2×
“The ARC intervention was guided by a trained ARC specialist (a PhD industrial organizational psychologist) who directed the manual guided activities for each of 12 components sequenced in three stages (Glisson, 2009; Glisson et al., 2006).”
BackgroundMethodSelf-citationAssessing and Changing Organizational Culture and Climate for Effective Services
Glisson, C. (2007) · Research on Social Work Practice · doi:10.1177/1049731507301659 · Cited by 294 · cited 2×
“…Schoenwald, Borduin, Rowland, & Cunningham, 2009), and (b) an organizational intervention labeled ARC (for availability, responsiveness, and continuity) that addresses service barriers in the organizational and community social contexts (Glisson, 2007, 2008; Glisson, Dukes, & Green, 2006).”
BackgroundSelf-citationCostello, E. J., Farmer, E. M., Angold, A., Burns, B. J., & Erkanli, A. (1997) · American Journal of Public Health · doi:10.2105/ajph.87.5.827 · Cited by 270
Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0152-9 · Cited by 232 · cited 1×
“This study provides support for the use of contextual interventions that address organizational and community barriers to the implementation of mental health services and evidence-based treatment programs (Glisson, 2002; Glisson et al., 2008).”
Self-citationPsychotherapy for children and adolescents evidence-based treatments and case examples
Weisz, J. R. (2004) · Cited by 212
Placement into foster care and the interplay of urbanicity, child behavior problems, and poverty.
Barth, R. P., Wildfire, J., & Green, R. L. (2006) · American Journal of Orthopsychiatry · doi:10.1037/0002-9432.76.3.358 · Cited by 204
Moving innovations into treatment: A stage-based approach to program change
Simpson, D. D., & Flynn, P. M. (2007) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.12.023 · Cited by 195 · cited 1×
“…strategy described here underscores the need for additional research on implementation strategies that support mental health treatment programs within the organizational and community contexts in which they are introduced (National Institute of Mental Health, 2006, 2008; Simpson & Flynn, 2007).”
BackgroundBarriers to Help Seeking for Mental Disorders in a Rural Impoverished Population
Fox, J. C., Blank, M. B., Rovnyak, V. G., & Barnett, R. Y. (2001) · Community Mental Health Journal · doi:10.1023/a:1017580013197 · Cited by 179 · cited 1×
“The strength-focused nature of MST and its emphasis on indigenous support systems may also be well suited to rural families (Fox et al., 2001).”
BackgroundClinical supervision in treatment transport: Effects on adherence and outcomes.
Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013788 · Cited by 179
Self-citationThe Impact of Inappropriate Modeling of Cross-Classified Data Structures
Meyers, J. L., & Beretvas, S. N. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4104_3 · Cited by 173 · cited 1×
“This approach is not without consequences, as described by Meyers and Beretvas (2006).”
Use, Quality, and Outcomes of Care for Mental Health: The Rural Perspective
Rost, K., Fortney, J., Fischer, E., & Smith, J. (2002) · Medical Care Research and Review · doi:10.1177/1077558702059003001 · Cited by 167
Transportability of Multisystemic Therapy: Evidence for Multilevel Influences
Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003) · Mental Health Services Research · doi:10.1023/a:1026229102151 · Cited by 165
Self-citationSpoth, R., Trudeau, L., Guyll, M., Shin, C., & Redmond, C. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016029 · Cited by 139
Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0181-z · Cited by 123 · cited 2×
“Two indicators of therapist fidelity to MST were used, one molar and one molecular (Perpletchikova, Treat, & Kazdin, 2007; Waltz, Addis, Koerner, & Jackson, 1993) The 28-item MST Therapist Adherence Measure—Revised (TAM-R; Henggeler, Borduin, Schoenwald, Huey, & Chapman, 2006) is a valid, reliable measure of therapist…”
MethodSelf-citationCorrecting a Significance Test for Clustering
Hedges, L. V. (2007) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998606298040 · Cited by 115 · cited 1×
“Thus, following procedures specified by Hedges (2007) to correct significance tests for unmodeled clustering, we calculated adjusted outcome p values for an ICC level of .10.”
MethodChamberlain, P., Brown, C. H., Saldana, L., Reid, J., Wang, W., Marsenich, L., Sosna, T., Padgett, C., & Bouwman, G. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0167-x · Cited by 100 · cited 2×
“…evidence-based treatments, including but not limited to MST, have designed strategies to accomplish similar aims, although few are as comprehensive as the model used here and few are being tested experimentally (e.g., Chamberlain et al., 2008; Henggeler, Sheidow, Cunningham, Donohue, & Ford, 2008).”
BackgroundMethodFACTORS AFFECTING USE OF THE MENTAL HEALTH SYSTEM BY RURAL CHILDREN
Starr, S., Campbell, L. R., & Herrick, C. A. (2002) · Issues in Mental Health Nursing · doi:10.1080/016128402753543027 · Cited by 89
Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410802575388 · Cited by 88
Self-citationSample Size Determination for Hierarchical Longitudinal Designs with Differential Attrition Rates
Roy, A., Bhaumik, D. K., Aryal, S., & Gibbons, R. D. (2007) · Biometrics · doi:10.1111/j.1541-0420.2007.00769.x · Cited by 87
Treating the juvenile offender
(2008) · Choice Reviews Online · doi:10.5860/choice.46-1189 · Cited by 84
Toward Evidence-Based Transport of Evidence-Based Treatments: MST as an Example
Schoenwald, S. K. (2008) · Journal of Child & Adolescent Substance Abuse · doi:10.1080/15470650802071671 · Cited by 70 · cited 7×
“In addition to the manuals for therapists, the MST quality assurance system consists of several elements (Henggeler et al., 2009; Schoenwald, 2008): (a) site assessment, (b) 5-day orientation for therapists and clinical supervisors, (c) on-site clinical supervision guided by a manual-based supervision protocol (Hengge…”
BackgroundMethodInfluentialSelf-citationNational Institutes of Health State-of-the-Science Conference Statement
Lochman, J. E. (2006) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-006-9043-x · Cited by 61
Henggeler, S. W., Sheidow, A. J., Cunningham, P. B., Donohue, B. C., & Ford, J. D. (2008) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410802148087 · Cited by 56
Greenberg, G. A., & Rosenheck, R. A. (2005) · Psychiatric Services · doi:10.1176/appi.ps.56.4.420 · Cited by 56 · cited 1×
“…Association, 2000), (h) be TennCare (Tennessee’s Medicaid waiver program) eligible, (i) have a Global Assessment of Functioning score of less than 51 (Greenberg & Rosenheck, 2005; Hilsenroth et al., 2000), (j) have behavioral or psychiatric symptoms that require intervention, and (k) have an IQ…”
BackgroundMental Disorders and Help Seeking in a Rural Impoverished Population
Fox, J. C., Blank, M., Berman, J., & Rovnyak, V. G. (1999) · The International Journal of Psychiatry in Medicine · doi:10.2190/y4ka-8xyc-kqwh-duxn · Cited by 53
Predictors of Workforce Turnover in a Transported Treatment Program
Sheidow, A. J., Schoenwald, S. K., Wagner, H. R., Allred, C. A., & Burns, B. J. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0061-3 · Cited by 46
Self-citationMolgaard, V. K. (1997) · American Journal of Community Psychology · doi:10.1023/a:1024611706598 · Cited by 44 · cited 2×
“…community; and (d) provide organizational structures and processes for identifying and addressing service barriers (Beeson, Britain, Howell, Kirwan, & Sawyer, 1998; Bjorklund & Pipard, 1999; Boydell et al., 2008; Fox, Blank, Rovnyak, & Barnett, 2001; Molgaard, 1997; St. Lawrence & Ndiaye, 1997).”
BackgroundThe Mental Health Consumer Movement: Implications for Rural Practice
Bjorklund, R. W., & Pippard, J. L. (1999) · Community Mental Health Journal · doi:10.1023/a:1018714024063 · Cited by 40
Prevention Research in Rural Communities: Overview and Concluding Comments
Lawrence, J. S. S., & Ndiaye, S. M. (1997) · American Journal of Community Psychology · doi:10.1023/a:1024663723437 · Cited by 29 · cited 2×
“…community; and (d) provide organizational structures and processes for identifying and addressing service barriers (Beeson, Britain, Howell, Kirwan, & Sawyer, 1998; Bjorklund & Pipard, 1999; Boydell et al., 2008; Fox, Blank, Rovnyak, & Barnett, 2001; Molgaard, 1997; St. Lawrence & Ndiaye, 1997).”
Schoenwald, S. K., & Henggeler, S. W. (2003) · Cognitive and Behavioral Practice · doi:10.1016/s1077-7229(03)80045-7 · Cited by 24 · cited 1×
“Second, implementing effective mental health services requires strategies that remove service barriers in the organizational and community contexts in which the services are provided (e.g., Chamberlain et al., 2008; Schoenwald & Henggeler, 2003).”
BackgroundSelf-citationChallenges of Knowledge Translation in Rural Communities: The Case of Rural Children'S Mental Health
Boydell, K., Stasiulis, E., Barwick, M. A., Greenberg, N., & Pong, R. (2008) · Canadian Journal of Community Mental Health · doi:10.7870/cjcmh-2008-0004 · Cited by 22 · cited 2×
“…community; and (d) provide organizational structures and processes for identifying and addressing service barriers (Beeson, Britain, Howell, Kirwan, & Sawyer, 1998; Bjorklund & Pipard, 1999; Boydell et al., 2008; Fox, Blank, Rovnyak, & Barnett, 2001; Molgaard, 1997; St. Lawrence & Ndiaye, 1997).”
BackgroundMental Health Needs of Poor Suburban and Rural Children and Their Families
Robbins, V., Dollard, N., Armstrong, B. J., Kutash, K., & Vergon, K. S. (2008) · Journal of Loss and Trauma · doi:10.1080/15325020701769170 · Cited by 20
Research works printed but not linked: 3
- Glisson C Sowers K Dulmus C 2008 Interventions with organizations: The ARC model The Comprehensive Handbook of Social Work and Social Welfare 3 556 581 Hoboken, NJ John Wiley & Sons
- Glisson C Webb MB Dowd K Harden BJ Landsverk J Testa MF 2009 Organizational climate and service outcomes in child welfare agencies Child welfare and child protection: New perspectives from the National Survey of Child and Adolescent Well-being New York Oxford University Press
- Myford CM Wolfe EW 2003 Detecting and measuring rater effects using many-facet Rasch measurement: Part I Journal of Applied Measurement 4 386 422 14523257
Cited by
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
“Considerable information is available on the organizational characteristics that promote the exploration and eventual adoption of innovation (Greenhalgh et al. 2004; Rogers 2003) and EBPs in mental health and social service organizations (Glisson et al. 2010).”
BackgroundImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
“, culture, climate, structure) to enable improved fit between the intervention and the setting [19]; harnessing the understanding of context can enable beneficial adaptation of the intervention and improve sustainability.”
BackgroundBridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
“There are several examples of such models, including the Translating Research Into Practice intervention, the Availability, Responsibility and Continuity model, and the Institute for Healthcare Improvement’s Framework for Spread (Brooks, Titler, Ardery, & Herr, 2009; Glisson & Schoenwald, 2005; Glisson, Schoenwald, He…”
Method
Metadata
- Authors
- Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E.
- Affiliations
- University of Tennessee at Knoxville (US)
- Medical University of South Carolina (US)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2010
- Volume
- 78
- Issue
- 4
- Pages
- 537-550
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- PMC
- PMC3951378
- OpenAlex
- W2070012218
- Cited by
- 243
- References
- 55
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 9 · 2023: 8 · 2022: 4 · 2021: 6 · 2020: 16 · 2019: 13 · 2018: 21 · 2017: 16 · 2016: 19 · 2015: 30 · 2014: 29 · 2013: 28 · 2012: 25
- FWCI
- 36.35
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01-MH066905, R01-MH084855, MH59138)
- National Institute on Drug Abuse (DA018107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Child Welfare and Adoption
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- multisystemic therapy, organizational interventions, treatment implementation, delinquent youth, juvenile delinquency, community mental health services, out-of-home placement, behavioral problems, rural Appalachia, evidence-based treatment
- MeSH terms
- Adolescent, Appalachian Region, Mental Disorders, Child, Community Mental Health Services, Family Therapy, Humans, Juvenile Delinquency, Male, Rural Population, Systems Theory, Tennessee, Comorbidity, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.