Adaptations in a Community-Based Family Intervention: Replication of Two Coding Schemes
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Although program adaptation is a reality in community-based implementations of evidence-based programs, much of the discussion about adaptation remains theoretical. The primary aim of this study was to replicate two coding systems to examine adaptations in large-scale, community-based disseminations of the Strengthening Families Program for Parents and Youth 10-14, a family-based substance use prevention program. Our second aim was to explore intersections between various dimensions of facilitator-reported adaptations from these two coding systems. Our results indicate that only a few types of adaptations and a few reasons accounted for a majority (over 70 %) of all reported adaptations. We also found that most adaptations were logistical, reactive, and not aligned with program's goals. In many ways, our findings replicate those of the original studies, suggesting the two coding systems are robust even when applied to self-reported data collected from community-based implementations. Our findings on the associations between adaptation dimensions can inform future studies assessing the relationship between adaptations and program outcomes. Studies of local adaptations, like the present one, should help researchers, program developers, and policymakers better understand the issues faced by implementers and guide efforts related to program development, transferability, and sustainability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The frameworks also did not specify whether modifications were planned (i.e., adaptations) or unplanned (e.g., [2, 4, 27]), or allow investigators to consider modifications in conjunction with fidelity, a related but distinct implementation outcome [1].”
From The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions (2019) · cites this paper as [4]
Citations
Cites
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01564.x · Cited by 10,854
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304 · cited 1×
“…(i.e., program delivery as designed) and participant outcomes (Breitenstein, Gross, Garvey, Hill, Fogg, & Resnick, 2010b; Byrnes, Miller, Aalborg, Plasencia, & Keagy, 2010; Durlak & DuPre, 2008; Hamre et al., 2010; Hill & Owens, 2013; Pettigrew, Graham, Miller-Day, Hecht, Krieger, & Shin, 2015).”
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339 · cited 2×
“…Taylor, & Schellinger, 2011; Spoth, Randall, Trudeau, Shin, & Redmond, 2008), the gap between research, practice, and meaningful public health impact remains substantial (Glasgow, Lichtenstein, & Marcus, 2003; Rohrbach, Grana, Sussman, & Valente, 2006; Spoth et al., 2013; Wandersman et al., 2008).”
The Cultural Adaptation of Prevention Interventions: Resolving Tensions Between Fidelity and Fit
Castro, F. G., Barrera, M., & Martinez, C. R. (2004) · Prevention Science · doi:10.1023/b:prev.0000013980.12412.cd · Cited by 1,228
Implementation fidelity in community‐based interventions
Breitenstein, S. M., Gross, D., Garvey, C. A., Hill, C., Fogg, L., & Resnick, B. (2010) · Research in Nursing & Health · doi:10.1002/nur.20373 · Cited by 709 · cited 1×
“In order to advance the study of adaptation in real-world implementations of EBPs, we must develop valid, reliable, classification systems that can be effectively and efficiently used across a variety of settings (Breitenstein et al., 2010a, 2010b; Hansen, 2013; Hill & Owens, 2013).”
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-65 · Cited by 691 · cited 5×
“This system highlights the importance of considering multiple dimensions of adapations within and across different studies, and intervention types and settings (Stirman et al., 2013).”
InfluentialWorldwide application of prevention science in adolescent health
Catalano, R. F., Fagan, A. A., Gavin, L. E., Greenberg, M. T., Irwin, C. E., Ross, D. A., & Shek, D. T. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60238-4 · Cited by 674 · cited 2×
“Despite significant progress in demonstrating the efficacy of health behavior education programs (Botvin & Griffin, 2004; Catalano et al., 2012; Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 2011; Spoth, Randall, Trudeau, Shin, & Redmond, 2008), the gap between research, practice, and…”
Putting the Pieces Together: An Integrated Model of Program Implementation
Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011) · Prevention Science · doi:10.1007/s11121-010-0186-1 · Cited by 531 · cited 1×
“Theoretical and empirical evidence suggests that adaptations that increase participant engagement and improve program delivery are likely to improve participant outcomes (Berkel, Mauricio, Schoenfelder, & Sandler, 2011; Berkel et al., 2013; Hamre et al., 2010; Pettigrew et al. 2015). Again, future research is needed t…”
Longer‐term primary prevention for alcohol misuse in young people: a systematic review
Foxcroft, D. R., Ireland, D., Lister‐Sharp, D. J., Lowe, G., & Breen, R. (2003) · Addiction · doi:10.1046/j.1360-0443.2003.00355.x · Cited by 433
Life Skills Training: Empirical Findings and Future Directions
Botvin, G. J., & Griffin, K. W. (2004) · Journal of Primary Prevention · doi:10.1023/b:jopp.0000042391.58573.5b · Cited by 432 · cited 1×
“Despite significant progress in demonstrating the efficacy of health behavior education programs (Botvin & Griffin, 2004; Catalano et al., 2012; Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 2011; Spoth, Randall, Trudeau, Shin, & Redmond, 2008), the gap between research, practice, and…”
Rohrbach (2006) · doi:10.1177/0163278706290408 · Cited by 300
The fidelity‐adaptation debate: Implications for the implementation of public sector social programs
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987) · American Journal of Community Psychology · doi:10.1007/bf00922697 · Cited by 297 · cited 1×
“Our findings do suggest that some adaptations may enhance program delivery in community-based settings, although additional studies linking adaptations to program outcomes are necessary to determine this empirically (Blakely et al., 1987; Hansen, 2013; Hill & Owens, 2013).”
Harn, B., Parisi, D., & Stoolmiller, M. (2013) · Exceptional Children · doi:10.1177/001440291307900204 · Cited by 290 · cited 3×
“If program developers provide the option of several possible modifications, all of which align with the program model, facilitators can cover the core program components while flexibly addressing local needs (Card et al., 2011; Daele et al. 2014; Harn et al., 2013; Pettigrew et al., 2013).”
Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283 · cited 2×
“…Taylor, & Schellinger, 2011; Spoth, Randall, Trudeau, Shin, & Redmond, 2008), the gap between research, practice, and meaningful public health impact remains substantial (Glasgow, Lichtenstein, & Marcus, 2003; Rohrbach, Grana, Sussman, & Valente, 2006; Spoth et al., 2013; Wandersman et al., 2008).”
Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005) · Health Education Research · doi:10.1093/her/cyg134 · Cited by 278
Examining Adaptations of Evidence-Based Programs in Natural Contexts
Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013) · The Journal of Primary Prevention · doi:10.1007/s10935-013-0303-6 · Cited by 250 · cited 32×
“Assuming the former, 58 % is slightly higher than in the Moore et al. (2013) study where only 43 % reported making adaptations. However, it is important to note that the Moore et al. (2013) study included SFP 10–14 programs among a variety of other EBPs as well.”
InfluentialSelf-citationCohen, D. J., Crabtree, B. F., Etz, R. S., Balasubramanian, B. A., Donahue, K. E., Leviton, L. C., Clark, E. C., Isaacson, N. F., Stange, K. C., & Green, L. W. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.08.005 · Cited by 248 · cited 14×
“…information or resources; change the program’s target population; add rewards, prizes, or celebrations; and modify training or evaluation processes (Cohen et al., 2008; Lara et al., 2011; Miller-Day et al., 2013; Moore, Bumbarger, & Cooper, 2013; Stirman, Miller, Toder, & Calloway, 2013;…”
InfluentialFidelity of delivery of a physical activity intervention: Predictors and consequences
Hardeman, W., Michie, S., Fanshawe, T., Prevost, A. T., Mcloughlin, K., & Kinmonth, A. L. (2008) · Psychology & Health · doi:10.1080/08870440701615948 · Cited by 195 · cited 2×
“Although we believe that facilitator self-reports are the most efficient strategy for collecting adaptation data in the real world, and we are confident these data can be reliably coded, some research suggests self-reported implementation data is biased (Hansen & McNeal, 1999; Hardeman et al., 2008).”
Hamre, B. K., Justice, L. M., Pianta, R. C., Kilday, C., Sweeney, B., Downer, J. T., & Leach, A. (2010) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2009.07.002 · Cited by 170 · cited 3×
“…(i.e., program delivery as designed) and participant outcomes (Breitenstein, Gross, Garvey, Hill, Fogg, & Resnick, 2010b; Byrnes, Miller, Aalborg, Plasencia, & Keagy, 2010; Durlak & DuPre, 2008; Hamre et al., 2010; Hill & Owens, 2013; Pettigrew, Graham, Miller-Day, Hecht, Krieger, & Shin, 2015).”
Spoth, R., Reyes, M. L., Redmond, C., & Shin, C. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.5.619 · Cited by 161
The Tug-of-War: Fidelity Versus Adaptation Throughout the Health Promotion Program Life Cycle
Bopp, M., Saunders, R. P., & Lattimore, D. (2013) · The Journal of Primary Prevention · doi:10.1007/s10935-013-0299-y · Cited by 150 · cited 2×
“guidance on how to implement programs in accordance with program models but still be flexible enough to meet the needs of diverse populations and settings (Bopp et al., 2013; Card, Solomon, & Cunningham, 2011; Harn, Parisi, & Stoolmiller, 2013).”
Measuring Implementation Fidelity in a Community-Based Parenting Intervention
Breitenstein, S. M., Fogg, L., Garvey, C., Hill, C., Resnick, B., & Gross, D. (2010) · Nursing Research · doi:10.1097/nnr.0b013e3181dbb2e2 · Cited by 146 · cited 7×
“In order to advance the study of adaptation in real-world implementations of EBPs, we must develop valid, reliable, classification systems that can be effectively and efficiently used across a variety of settings (Breitenstein et al., 2010a, 2010b; Hansen, 2013; Hill & Owens, 2013). By replicating coding systems and d…”
InfluentialSpoth, R., Redmond, C., & Lepper, H. (1999) · Journal of Studies on Alcohol, Supplement · doi:10.15288/jsas.1999.s13.103 · Cited by 144
A Focused Approach to Assessing Program Fidelity
Hill, L. G., Maucione, K., & Hood, B. (2006) · Prevention Science · doi:10.1007/s11121-006-0051-4 · Cited by 134 · cited 45×
“Table 1 Comparison of Current Study to Original Hill et al. (2007) and Moore et al. (2013) Results Code Percentage of adaptations Chi square df Hill et al. (2007) Current study Add/change/delete Addition 32 % 9 % 20.33* 1 Change 28 % 45 % 8.22* 1 Deletion 40 % 43 % .02 1 Typea Games 25 % 28 % .25 1 Activities 12 % 25…”
MethodInfluentialSelf-citationLillehoj, C. J. (., Griffin, K. W., & Spoth, R. (2004) · Health Education & Behavior · doi:10.1177/1090198103260514 · Cited by 128
How to Adapt Effective Programs for Use in New Contexts
Card, J. J., Solomon, J., & Cunningham, S. D. (2011) · Health Promotion Practice · doi:10.1177/1524839909348592 · Cited by 124 · cited 1×
“If program developers provide the option of several possible modifications, all of which align with the program model, facilitators can cover the core program components while flexibly addressing local needs (Card et al., 2011; Daele et al. 2014; Harn et al., 2013; Pettigrew et al., 2013).”
Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative
Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2015) · Prevention Science · doi:10.1007/s11121-013-0427-1 · Cited by 117
Self-citationSpoth, R. L., Randall, G. K., Trudeau, L., Shin, C., & Redmond, C. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.01.023 · Cited by 117 · cited 2×
“…with state and community partners) have promoted the statewide dissemination of SFP 10–14, an internationally recognized evidence-based family skills training program for youth ages 10–14 and their parents (Spoth et al., 2008; Spoth, Redmond, & Lepper, 1999; Spoth, Reyes, Redmond, & Shin, 1999).”
Informetric distributions, part I: Unified overview
Bookstein, A. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199007)41:5<368::aid-asi8>3.0.co;2-c · Cited by 91
Pettigrew, J., Graham, J. A., Miller-Day, M. A., Hecht, M. L., Krieger, J. L. R., & Shin, Y. (2014) · Prevention Science · doi:10.1007/s11121-014-0459-1 · Cited by 81 · cited 1×
“Theoretical and empirical evidence suggests that adaptations that increase participant engagement and improve program delivery are likely to improve participant outcomes (Berkel, Mauricio, Schoenfelder, & Sandler, 2011; Berkel et al., 2013; Hamre et al., 2010; Pettigrew et al. 2015).”
Empowerment implementation: enhancing fidelity and adaptation in a psycho-educational intervention
van Daele, T., van Audenhove, C., Hermans, D., van den Bergh, O., & van den Broucke, S. (2014) · Health Promotion International · doi:10.1093/heapro/das070 · Cited by 70 · cited 1×
“If program developers provide the option of several possible modifications, all of which align with the program model, facilitators can cover the core program components while flexibly addressing local needs (Card et al., 2011; Daele et al. 2014; Harn et al., 2013; Pettigrew et al., 2013).”
Drug education practice: results of an observational study
Hansen, W. B. (1999) · Health Education Research · doi:10.1093/her/14.1.85 · Cited by 65 · cited 1×
“…we believe that facilitator self-reports are the most efficient strategy for collecting adaptation data in the real world, and we are confident these data can be reliably coded, some research suggests self-reported implementation data is biased (Hansen & McNeal, 1999; Hardeman et al., 2008).”
Miller‐Day, M., Pettigrew, J., Hecht, M. L., Shin, Y., Graham, J., & Krieger, J. (2013) · Health Education · doi:10.1108/09654281311329259 · Cited by 64 · cited 8×
“Hansen et al. (2013) included valence, which is similar to our conceptualization of alignment, and Miller-Day et al. (2013) included timing.”
InfluentialPettigrew, J., Miller-Day, M. A., Shin, Y., Hecht, M. L., Krieger, J. L. R., & Graham, J. A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9539-1 · Cited by 51 · cited 1×
“If program developers provide the option of several possible modifications, all of which align with the program model, facilitators can cover the core program components while flexibly addressing local needs (Card et al., 2011; Daele et al. 2014; Harn et al., 2013; Pettigrew et al., 2013).”
Byrnes, H. F., Miller, B. A., Aalborg, A. E., Plasencia, A. V., & Keagy, C. D. (2010) · Health Education Research · doi:10.1093/her/cyq006 · Cited by 49
Styles of adaptation: The impact of frequency and valence of adaptation on preventing substance use
Hansen, W. B., Pankratz, M. M., Dusenbury, L., Giles, S. M., Bishop, D. C., Albritton, J., Albritton, L. P., & Strack, J. (2013) · Health Education · doi:10.1108/09654281311329268 · Cited by 44 · cited 3×
“Hansen et al. (2013) included valence, which is similar to our conceptualization of alignment, and Miller-Day et al. (2013) included timing.”
August, G. J., Gewirtz, A. H., & Realmuto, G. M. (2008) · Applied and Preventive Psychology · doi:10.1016/j.appsy.2008.11.001 · Cited by 44 · cited 1×
“Program adaptation is a reality in community-based implementations of EBPs, and it may also be essential to program success (August et al., 2010; Breitenstein, Fogg, Garvey, Hill, Resnick, & Gross, 2010a; Daele, Audenhove, Hermans, Bergh, & Broucke, 2014; Lara et al., 2011).”
Lara, M., Bryant-Stephens, T. C., Damitz, M., Findley, S. E., Gavillán, J. A. G., Mitchell, H., Ohadike, Y. U., Persky, V., Valencia, G. R., Smith, L. R., et al. (2011) · Health Promotion Practice · doi:10.1177/1524839911414888 · Cited by 43 · cited 6×
“Also, most adaptation studies have not taken into account alignment with program theory and timing of the adaptation but focus on categorizing types of adaptations (Cohen et al., 2008; Lara et al., 2011; Miller-Day et al., 2013; Ozer et al., 2010).”
InfluentialOzer, E. J., Wanis, M. G., & Bazell, N. (2010) · Prevention Science · doi:10.1007/s11121-009-0148-7 · Cited by 41 · cited 4×
“Also, most adaptation studies have not taken into account alignment with program theory and timing of the adaptation but focus on categorizing types of adaptations (Cohen et al., 2008; Lara et al., 2011; Miller-Day et al., 2013; Ozer et al., 2010).”
InfluentialAdapting HIV prevention evidence-based interventions in practice settings: an interview study
Veniegas, R. C., Kao, U. H., & Rosales, R. (2009) · Implementation Science · doi:10.1186/1748-5908-4-76 · Cited by 35
Implementation Fidelity in a Teacher-Led Alcohol use Prevention Curriculum
Pankratz, M. M., Jackson-Newsom, J., Giles, S. M., Ringwalt, C. L., Bliss, K., & Bell, M. L. (2006) · Journal of Drug Education · doi:10.2190/h210-2n47-5x5t-21u4 · Cited by 34
Understanding the art and science of implementation in the SAAF efficacy trial
Berkel, C., Murry, V. M., Roulston, K., & Brody, G. H. (2013) · Health Education · doi:10.1108/09654281311329240 · Cited by 23 · cited 1×
“Theoretical and empirical evidence suggests that adaptations that increase participant engagement and improve program delivery are likely to improve participant outcomes (Berkel, Mauricio, Schoenfelder, & Sandler, 2011; Berkel et al., 2013; Hamre et al., 2010; Pettigrew et al. 2015).”
Component analysis of adherence in a family intervention
Hill, L. G., & Owens, R. W. (2013) · Health Education · doi:10.1108/09654281311329222 · Cited by 22 · cited 5×
“…(i.e., program delivery as designed) and participant outcomes (Breitenstein, Gross, Garvey, Hill, Fogg, & Resnick, 2010b; Byrnes, Miller, Aalborg, Plasencia, & Keagy, 2010; Durlak & DuPre, 2008; Hamre et al., 2010; Hill & Owens, 2013; Pettigrew, Graham, Miller-Day, Hecht, Krieger, & Shin, 2015).”
InfluentialSelf-citationIntroduction to the special issue on adaptation and fidelity
Hansen, W. B. (2013) · Health Education · doi:10.1108/09654281311329213 · Cited by 10 · cited 5×
“Evidence suggests that programs can have high levels of adaptation while maintaining high levels of fidelity (Hansen, 2013), and therefore another strategy would be for developers to use the results of our study to provide a menu of ‘‘builtin’’ adaptations to the program model, which address the…”
InfluentialSegrott, J., Rothwell, H., Murphy, S., Morgan‐Trimmer, S., Scourfield, J., Holliday, J., Thomas, C., Gillespie, D., Roberts, Z., FOXCROFT, D. R., et al. (2014) · European Journal of Public Health · doi:10.1093/eurpub/cku163.072 · Cited by 2 · cited 2×
“Facilitators who know they are being monitored may not fully and accurately report modifications to the program— although some studies have shown that facilitators report similar patterns of fidelity but at systematically higher levels than that observed by a third party (Segrott et al., 2014).”
Cited by
Wiltsey Stirman, S., Baumann, A. A., & Miller, C. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0898-y · Cited by 1,329
The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare
Miller, C. J., Barnett, M. L., Baumann, A. A., Gutner, C. A., & Wiltsey-Stirman, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01105-3 · Cited by 490
“Modifications to EBPs may be made in either an ad hoc or planful manner; the latter category of planned modifications may be labeled as adaptations [3, 4].”
BackgroundA systematic review of adaptations of evidence-based public health interventions globally
Escoffery, C., Lebow-Skelley, E., Haardoerfer, R., Boing, E., Udelson, H., Wood, R., Hartman, M., Fernandez, M. E., & Mullen, P. D. (2018) · Implementation Science · doi:10.1186/s13012-018-0815-9 · Cited by 386
A scoping study of frameworks for adapting public health evidence-based interventions
Escoffery, C., Lebow-Skelley, E., Udelson, H., Böing, E. A., Wood, R., Fernandez, M. E., & Mullen, P. D. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibx067 · Cited by 307
Fagan, A. A., Bumbarger, B. K., Barth, R. P., Bradshaw, C. P., Cooper, B. R., Supplee, L. H., & Walker, D. K. (2019) · Prevention Science · doi:10.1007/s11121-019-01048-8 · Cited by 207
Self-citation
Metadata
- Authors
- Cooper, B. R., Shrestha, G., Hyman, L., & Hill, L.
- Affiliations
- Washington State University (US)
- Corresponding author
- Cooper, Brittany Rhoades
- Venue
- The Journal of Primary Prevention
- Published
- 2015-12-12
- Volume
- 37
- Issue
- 1
- Pages
- 33-52
- ISSN
- 0278-095X (ISSN-L)
- 1573-6547
- OpenAlex
- W2224982335
- Cited by
- 62
- References
- 46
- Citations by year
- 2026: 2 · 2025: 11 · 2024: 9 · 2023: 6 · 2022: 5 · 2021: 7 · 2020: 5 · 2019: 7 · 2018: 4 · 2017: 2 · 2016: 3
- FWCI
- 5.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- The Journal of Primary Prevention (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Drug Abuse (R21 DA025139-01Al, R21 DA19758-01)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- program adaptation, Strengthening Families Program, coding scheme, community-based implementation, evidence-based programs, replication, adolescent substance use prevention, program dissemination
- MeSH terms
- Adolescent, Child, Community Health Services, Family Therapy, Humans, Primary Prevention, Reproducibility of Results, Program Evaluation, Program Development, Clinical Coding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.