Reflections on 10 years of effectiveness-implementation hybrid studies
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
This article provides new reflections and recommendations from authors of the initial effectiveness-implementation hybrid study manuscript and additional experts in their conceptualization and application. Given the widespread and continued use of hybrid studies, critical appraisals are necessary. The article offers reflections across five conceptual and methodological areas. It begins with the recommendation to replace the term “design” in favor of “study.” The use of the term “design” and the explicit focus on trial methodology in the original paper created confusion. The essence of hybrid studies is combining research questions concerning intervention effectiveness and implementation within the same study, and this can and should be achieved by applying a full range of research designs. Supporting this recommendation, the article then offers guidance on selecting a hybrid study type based on evidentiary and contextual information and stakeholder concerns/preferences. A series of questions are presented that have been designed to help investigators select the most appropriate hybrid type for their study situation. The article also provides a critique on the hybrid 1-2-3 typology and offers reflections on when and how to use the typology moving forward. Further, the article offers recommendations on research designs that align with each hybrid study type. Lastly, the article offers thoughts on how to integrate costs analyses into hybrid studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Third, the taxonomy raised widespread awareness around the lack of tools, instruments, and designs (e.g., hybrids II and III [5, 6]) that support the measurement of implementation outcomes either as standalone research aims or in conjunction with other outcomes and/or variables capturing contextual determinants.”
From Ten years of implementation outcomes research: a scoping review (2023) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Self-citationVandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Updating cost-effectiveness—the curious resilience of the $50,000-per-QALY threshold
Neumann, P. J., Cohen, J. T., & Weinstein, M. C. (2014) · New England Journal of Medicine · doi:10.1056/nejmp1405158 · Cited by 2,249 · cited 2×
“A commonly accepted threshold for considering an intervention cost-effective is $100,000 to $15,000 per QALY (46).”
BackgroundCONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836 · cited 1×
“Indeed, because tightly controlled efficacy studies often sacrifice the external validity needed to rapidly scale up implementation efforts, some authors (33) suggest questioning the assumption that effectiveness research logically follows from successful efficacy research.”
Background
Research works printed but not linked: 1
- Weber, 1949, Max Weber on the Methodology of the Social Sciences Vol 1
Cited by
Kim, D. H., & Rockwood, K. (2024) · New England Journal of Medicine · doi:10.1056/nejmra2301292 · Cited by 824
Ten years of implementation outcomes research: a scoping review
Proctor, E. K., Bunger, A. C., Lengnick-Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023) · Implementation Science · doi:10.1186/s13012-023-01286-z · Cited by 424
The Lancet Commission on rethinking coronary artery disease: moving from ischaemia to atheroma
Zaman, S., Wasfy, J. H., Kapil, V., Ziaeian, B., Parsonage, W. A., Sriswasdi, S., Chico, T. J. A., Capodanno, D., Colleran, R., Sutton, N. R., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00055-8 · Cited by 203
AI, Health, and Health Care Today and Tomorrow: The JAMA Summit Report on Artificial Intelligence
Angus, D. C., Khera, R., Lieu, T., Liu, V., Ahmad, F. S., Anderson, B., Bhavani, S. V., Bindman, A., Brennan, T., Celi, L. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.18490 · Cited by 195
Midwife continuity of care models versus other models of care for childbearing women
Sandall, J., Fernandez Turienzo, C., Devane, D., Soltani, H., Gillespie, P., Gates, S., Jones, L. V., Shennan, A. H., & Rayment-Jones, H. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004667.pub6 · Cited by 192
Metadata
- Authors
- Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S.
- Affiliations
- Central Arkansas Veterans Healthcare System (US)
- University of Arkansas for Medical Sciences (US)
- University of Utah (US)
- National Institutes of Health (US)
- Kaiser Permanente (US)
- Corresponding author
- Landes, Sara J.
- ORCID
- Venue
- Frontiers in Health Services
- Publisher
- Frontiers Media SA
- Published
- 2022-12-08
- Volume
- 2
- Pages
- 1053496-1053496
- ISSN
- 2813-0146 (ISSN-L)
- PMC
- PMC10012680
- OpenAlex
- W4310841035
- Cited by
- 299
- References
- 52
- Citations by year
- 2026: 80 · 2025: 98 · 2024: 78 · 2023: 42
- FWCI
- 62.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Health Services (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Veterans Affairs (20-026, QUE 20‐026, EBP 22-104)
- National Institutes of Health (UL1TR003107, UL1TR002538)
- Quality Enhancement Research Initiative (QUE 20-026, PII 19-462, EBP 22-104)
- National Heart, Lung, and Blood Institute (UG3HL154297, HL154297, UH3HL154297)
- National Center for Advancing Translational Sciences (TR003107)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- implementation research, intervention effectiveness, research design selection, stakeholder preferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reflections on 10 years of effectiveness-implementation hybrid studies. https://app.cochat.ai/papers/10.3389/frhs.2022.1053496
- The paper
- Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022). Reflections on 10 years of effectiveness-implementation hybrid studies. Frontiers in Health Services. https://doi.org/10.3389/frhs.2022.1053496
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
