Reflections on 10 years of effectiveness-implementation hybrid studies
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
This article provides new reflections and recommendations from authors of the initial effectiveness-implementation hybrid study manuscript and additional experts in their conceptualization and application. Given the widespread and continued use of hybrid studies, critical appraisals are necessary. The article offers reflections across five conceptual and methodological areas. It begins with the recommendation to replace the term “design” in favor of “study.” The use of the term “design” and the explicit focus on trial methodology in the original paper created confusion. The essence of hybrid studies is combining research questions concerning intervention effectiveness and implementation within the same study, and this can and should be achieved by applying a full range of research designs. Supporting this recommendation, the article then offers guidance on selecting a hybrid study type based on evidentiary and contextual information and stakeholder concerns/preferences. A series of questions are presented that have been designed to help investigators select the most appropriate hybrid type for their study situation. The article also provides a critique on the hybrid 1-2-3 typology and offers reflections on when and how to use the typology moving forward. Further, the article offers recommendations on research designs that align with each hybrid study type. Lastly, the article offers thoughts on how to integrate costs analyses into hybrid studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Third, the taxonomy raised widespread awareness around the lack of tools, instruments, and designs (e.g., hybrids II and III [5, 6]) that support the measurement of implementation outcomes either as standalone research aims or in conjunction with other outcomes and/or variables capturing contextual determinants.”
From Ten years of implementation outcomes research: a scoping review (2023) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Self-citationVandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Updating cost-effectiveness—the curious resilience of the $50,000-per-QALY threshold
Neumann, P. J., Cohen, J. T., & Weinstein, M. C. (2014) · New England Journal of Medicine · doi:10.1056/nejmp1405158 · Cited by 2,249 · cited 2×
“A commonly accepted threshold for considering an intervention cost-effective is $100,000 to $15,000 per QALY (46).”
BackgroundCONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836 · cited 1×
“Indeed, because tightly controlled efficacy studies often sacrifice the external validity needed to rapidly scale up implementation efforts, some authors (33) suggest questioning the assumption that effectiveness research logically follows from successful efficacy research.”
BackgroundCost-Effectiveness in Health and Medicine
(2016) · doi:10.1093/acprof:oso/9780190492939.001.0001 · Cited by 1,552
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446 · cited 1×
“org/), the format of the Standards for Reporting Implementation Studies (StaRI) statement (42) is well-aligned with all three hybrid study types.”
MethodDissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Methods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967 · cited 1×
“If enough is known about implementation determinants to be able to select and tailor (17) implementation strategies (see Question 4), a hybrid type 2 or 3 approach is indicated, depending on the existing level of the effectiveness evidence for the intervention (Question 1).”
BackgroundEnhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711
An introduction to effectiveness-implementation hybrid designs
Landes, S. J., McBain, S. A., & Curran, G. M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112513 · Cited by 516 · cited 1×
“(5) published reflections and novel recommendations for applying hybrid designs.”
BackgroundSelf-citationAn Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509 · cited 2×
“’s (14) typology of “within,” “between,” and “within and between” site designs.”
BackgroundSelf-citationGuidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475 · cited 2×
“At the same time, many in the field currently recommend exploring “implementability” of interventions very early in their development (24, 25) (or adaptation), and there are numerous published hybrid type 1 “pilot” studies (8, 26, 27) indicating a recognition of the value of considering implementation factors very ear…”
BackgroundHemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
“Scaling-out” evidence-based interventions to new populations or new health care delivery systems
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017) · Implementation Science · doi:10.1186/s13012-017-0640-6 · Cited by 399 · cited 1×
“Question 2 focuses on the expected degree of adaptation required to permit use of the intervention for use with a new population, context, or behavioral target (15, 16).”
BackgroundKlaic, M., Kapp, S., Hudson, P., Chapman, W., Denehy, L., Story, D., & Francis, J. J. (2022) · Implementation Science · doi:10.1186/s13012-021-01171-7 · Cited by 394
Designing and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J. M., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 270
Designing for Dissemination and Sustainability to Promote Equitable Impacts on Health
Kwan, B. M., Brownson, R. C., Glasgow, R. E., Morrato, E. H., & Luke, D. A. (2022) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-052220-112457 · Cited by 234 · cited 1×
“At the same time, many in the field currently recommend exploring “implementability” of interventions very early in their development (24, 25) (or adaptation), and there are numerous published hybrid type 1 “pilot” studies (8, 26, 27) indicating a recognition of the value of considering implementation factors very ear…”
BackgroundSample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230
Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S. W., & Lane-Fall, M. B. (2022) · Implementation Science · doi:10.1186/s13012-022-01226-3 · Cited by 230
Eisman, A. B., Kilbourne, A. M., Dopp, A. R., Saldana, L., & Eisenberg, D. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.008 · Cited by 210 · cited 1×
“With increased attention on how best to accelerate and sustain uptake of evidence-based practices in healthcare, there is now increasing attention being paid to the cost of implementation strategies (47).”
BackgroundA pragmatic method for costing implementation strategies using time-driven activity-based costing
Cidav, Z., Mandell, D., Pyne, J., Beidas, R., Curran, G., & Marcus, S. (2020) · Implementation Science · doi:10.1186/s13012-020-00993-1 · Cited by 174 · cited 1×
“Procedures for costing implementation strategies can be time intensive and need to balance the precision and accuracy of implementation cost data against respondent burden for collecting these data (48, 49).”
MethodSelf-citationDopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00020-w · Cited by 169
Harnessing Implementation Science to Increase the Impact of Health Equity Research
Chinman, M., Woodward, E. N., Curran, G. M., & Hausmann, L. R. M. (2017) · Medical Care · doi:10.1097/mlr.0000000000000769 · Cited by 163 · cited 1×
“(7) provided ways in which hybrid designs could be used in service of research focusing on reducing disparities.”
BackgroundSelf-citationLane-Fall, M. B., Curran, G. M., & Beidas, R. S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0783-z · Cited by 143 · cited 1×
“(23) also note the resource intensity of hybrid studies and recommend they should only be undertaken by experienced research teams.”
BackgroundSelf-citationProctor, E. K., Landsverk, J., Baumann, A. A., Mittman, B. S., Aarons, G. A., Brownson, R. C., Glisson, C., & Chambers, D. (2013) · Implementation Science · doi:10.1186/1748-5908-8-105 · Cited by 126 · cited 2×
“Further, the designs are included in many/most national and international training programs (3, 4) in implementation science and interventions research, and Curran and colleagues have provided well over 50 invited presentations/workshops and hundreds of project consultations on hybrids.”
Self-citationEisman, A. B., Quanbeck, A., Bounthavong, M., Panattoni, L., & Glasgow, R. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01143-x · Cited by 126
Mixed-method approaches to strengthen economic evaluations in implementation research
Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D. (2019) · Implementation Science · doi:10.1186/s13012-018-0850-6 · Cited by 118 · cited 1×
“, context for understanding site-level variation in implementation activity and stakeholder interpretation of results) (52).”
BackgroundDesign and Analysis in Dissemination and Implementation Research
Landsverk, J., Brown, C. H., Chamberlain, P., Palinkas, L., Ogihara, M., Czaja, S., Goldhaber-Fiebert, J. D., Rolls Reutz, J. A., & Horwitz, S. M. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0012 · Cited by 114 · cited 5×
“It is our observation that most hybrid type 2 studies are either—(1) a person-level randomized study where the implementation strategies are used universally (essentially a pilot study of the strategies supporting the intervention effectiveness trial), or (2) a “single arm” study of both an intervention and implementa…”
BackgroundInfluentialDesigns and methods for implementation research: Advancing the mission of the CTSA program
Hwang, S., Birken, S. A., Melvin, C. L., Rohweder, C. L., & Smith, J. D. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.16 · Cited by 107 · cited 2×
“(12), with type 3 designs being most commonly cluster randomized trials, this can result in”
BackgroundSelf-citationExpanding the CONSORT Figure: Increasing Transparency in Reporting on External Validity
Glasgow, R. E., Huebschmann, A. G., & Brownson, R. C. (2018) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.04.044 · Cited by 76 · cited 1×
“These include the expanded CONSORT figure (34) that helps researchers summarize program participation and representativeness across different settings, staffing structures, and patients/community members.”
BackgroundMaking Health Research Matter: A Call to Increase Attention to External Validity
Huebschmann, A. G., Leavitt, I. M., & Glasgow, R. E. (2019) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040218-043945 · Cited by 76 · cited 1×
“Such approaches improve generalizability and potential for scale up (37).”
BackgroundSelecting and tailoring implementation interventions: a concept mapping approach
Kwok, E. Y. L., Moodie, S., Cunningham, B. J., & Cardy, J. O. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05270-x · Cited by 66
Kemp, C. G., Wagenaar, B. H., & Haroz, E. E. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00325 · Cited by 63
Estimating Costs of an Implementation Intervention
Wagner, T. H., Yoon, J., Jacobs, J. C., So, A., Kilbourne, A. M., Yu, W., & Goodrich, D. E. (2020) · Medical Decision Making · doi:10.1177/0272989x20960455 · Cited by 59 · cited 1×
“Procedures for costing implementation strategies can be time intensive and need to balance the precision and accuracy of implementation cost data against respondent burden for collecting these data (48, 49).”
MethodNorton, W. E., Loudon, K., Chambers, D. A., & Zwarenstein, M. (2021) · Implementation Science · doi:10.1186/s13012-020-01075-y · Cited by 58
Self-citationKnapp, A. A., Carroll, A. J., Mohanty, N., Fu, E. S., Powell, B. J., Hamilton, A., Burton, N. D., Coldren, E., Hossain, T., Limaye, D., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00276-4 · Cited by 57
Self-citationSmith, J. D., Berkel, C., Rudo‐Stern, J., Montaño, Z., George, S. M. S., Prado, G. J., Mauricio, A. M., Chiapa, A., Bruening, M. M., & Dishion, T. J. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00293 · Cited by 56
Self-citationBeidas, R. S., Ahmedani, B. K., Linn, K. A., Marcus, S. C., Johnson, C., Maye, M. P., Westphal, J. A., Wright, L., Beck, A. L., Buttenheim, A. M., et al. (2021) · Implementation Science · doi:10.1186/s13012-021-01154-8 · Cited by 41 · cited 1×
“At the same time, many in the field currently recommend exploring “implementability” of interventions very early in their development (24, 25) (or adaptation), and there are numerous published hybrid type 1 “pilot” studies (8, 26, 27) indicating a recognition of the value of considering implementation factors very ear…”
BackgroundGarner, B. R., Gotham, H. J., Chaple, M., Martino, S., Ford, J. H., Roosa, M. R., Speck, K. J., Vandersloot, D., Bradshaw, M., Ball, E. L., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520948073 · Cited by 40 · cited 1×
“Type 2 hybrids beg for dual randomized research designs in which units are assigned to both an intervention and an implementation strategy (28), but for various reasons (e.”
BackgroundSmith, M. J., Smith, J. D., Jordan, N., Sherwood, K. L., McRobert, E., Ross, B., Oulvey, E. A., & Atkins, M. S. (2020) · Journal of Special Education Technology · doi:10.1177/0162643420960093 · Cited by 37
Self-citationJohnson, A. L., Ecker, A. H., Fletcher, T. L., Hundt, N., Kauth, M. R., Martin, L. A., Curran, G. M., & Cully, J. A. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/iby116 · Cited by 27 · cited 1×
“(10) discussed applications of hybrid studies in psychotherapy research.”
BackgroundSelf-citationAron, D. C., Lowery, J. C., Tseng, C., Conlin, P. R., & Kahwati, L. C. (2014) · Implementation Science · doi:10.1186/1748-5908-9-58 · Cited by 14 · cited 1×
“However, the hybrid typology can and has been applied to observational designs (30), nonrandomized trials (31), and designs more commonly used in formative and pilot work (pre-post/repeated measures withingroup, interrupted time-series, etc.”
BackgroundImplementing Implementation Research: Teaching Implementation Research to HIV Researchers
Schwartz, S., Smith, J. D., Hoffmann, C. J., Hansoti, B., Mishra, S., Means, A. R., Go, V. F.-L., Sherr, K., Nash, D., Sullivan, P. S., et al. (2021) · Current HIV/AIDS Reports · doi:10.1007/s11904-021-00551-4 · Cited by 11 · cited 2×
“, barriers/facilitators to implementation), and (4) the extent to which implementation strategies are “ready” to be evaluated.”
BackgroundSelf-citationWong, E. S., Rajan, S., Liu, C., Morland, L. A., Pyne, J. M., Simsek‐Duran, F., Reisinger, H. S., Moeckli, J. K., & Fortney, J. C. (2022) · Implementation Research and Practice · doi:10.1177/26334895221116771 · Cited by 6 · cited 1×
“Third, time spent on implementation activities will vary by site (51).”
BackgroundSelf-citationAnton, M. T., Ridings, L. E., Hanson, R. F., Davidson, T. M., Saunders, B. E., Price, M., Danielson, C. K., Chu, B. C., Dismuke, C. E., Adams, Z. W., et al. (2020) · Contemporary Clinical Trials · doi:10.1016/j.cct.2020.106010 · Cited by 4 · cited 1×
“At the same time, many in the field currently recommend exploring “implementability” of interventions very early in their development (24, 25) (or adaptation), and there are numerous published hybrid type 1 “pilot” studies (8, 26, 27) indicating a recognition of the value of considering implementation factors very ear…”
Background
Research works printed but not linked: 1
- 11. Weber M, Shils E, Finch HA. Max Weber on the Methodology of the Social Sciences Vol 1. Glencoe, IL: Free Press (1949).
Cited by
Kim, D. H., & Rockwood, K. (2024) · New England Journal of Medicine · doi:10.1056/nejmra2301292 · Cited by 824
Ten years of implementation outcomes research: a scoping review
Proctor, E. K., Bunger, A. C., Lengnick-Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023) · Implementation Science · doi:10.1186/s13012-023-01286-z · Cited by 424
The Lancet Commission on rethinking coronary artery disease: moving from ischaemia to atheroma
Zaman, S., Wasfy, J. H., Kapil, V., Ziaeian, B., Parsonage, W. A., Sriswasdi, S., Chico, T. J. A., Capodanno, D., Colleran, R., Sutton, N. R., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00055-8 · Cited by 203
AI, Health, and Health Care Today and Tomorrow: The JAMA Summit Report on Artificial Intelligence
Angus, D. C., Khera, R., Lieu, T., Liu, V., Ahmad, F. S., Anderson, B., Bhavani, S. V., Bindman, A., Brennan, T., Celi, L. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.18490 · Cited by 195
Midwife continuity of care models versus other models of care for childbearing women
Sandall, J., Fernandez Turienzo, C., Devane, D., Soltani, H., Gillespie, P., Gates, S., Jones, L. V., Shennan, A. H., & Rayment-Jones, H. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004667.pub6 · Cited by 192
Metadata
- Authors
- Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S.
- Affiliations
- Central Arkansas Veterans Healthcare System (US)
- University of Arkansas for Medical Sciences (US)
- University of Utah (US)
- National Institutes of Health (US)
- Kaiser Permanente (US)
- Corresponding author
- Landes, Sara J.
- ORCID
- Venue
- Frontiers in Health Services
- Publisher
- Frontiers Media SA
- Published
- 2022-12-08
- Volume
- 2
- Pages
- 1053496-1053496
- ISSN
- 2813-0146 (ISSN-L)
- PMC
- PMC10012680
- OpenAlex
- W4310841035
- Cited by
- 299
- References
- 52
- Citations by year
- 2026: 80 · 2025: 98 · 2024: 78 · 2023: 42
- FWCI
- 62.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Health Services (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Veterans Affairs (20-026, QUE 20‐026, EBP 22-104)
- National Institutes of Health (UL1TR003107, UL1TR002538)
- Quality Enhancement Research Initiative (QUE 20-026, PII 19-462, EBP 22-104)
- National Heart, Lung, and Blood Institute (UG3HL154297, HL154297, UH3HL154297)
- National Center for Advancing Translational Sciences (TR003107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- implementation research, intervention effectiveness, research design selection, stakeholder preferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
