Mixed-method approaches to strengthen economic evaluations in implementation research
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Guidance from economic evaluations on which implementation strategies represent the best return on investment will be critical to advancing the Triple Aim of health care: improving patient care and population health while minimizing per-capita cost. The results of traditional (quantitative) economic evaluations are limited by a remaining "qualitative residual" of contextual information and stakeholders perspectives, which cannot be captured by monetary values alone and is particularly prevalent in implementation science research. The emergence of qualitative methods for economic evaluation offers a promising solution. MAIN BODY: To maximize the contributions of economic evaluations to implementation science, we recommend that researchers embrace a mixed-methods research agenda that merges traditional quantitative approaches with innovative, contextually grounded qualitative methods. Such studies are exceedingly rare at present. To assist implementation scientists in making use of mixed methods in this research context, we present an adapted taxonomy of mixed-method studies relevant to economic evaluation. We then illustrate the application of mixed methods in a recently completed cost-effectiveness evaluation, making use of an adapted version of reporting standards for economic evaluations. CONCLUSIONS: By incorporating qualitative methods, implementation researchers can enrich their economic evaluations with detailed, context-specific information that tells the full story of the costs and impacts of implementation. We end by providing suggestions for building a research agenda in mixed-method economic evaluation, along with more resources and training to support investigators who wish to answer our call to action.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There has been a recent surge of publications related to the collection of costs in implementation science [9, 14, 31, 36], and emerging consensus regarding the importance of economic influences on implementation outcomes (see other articles in this collection).”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Designing and Conducting Mixed Methods Research
Robinson, P. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,258
The Interpretation of Cultures
Fenn, R., & Geertz, C. (1974) · Journal for the Scientific Study of Religion · doi:10.2307/1384392 · Cited by 19,154
The Interpretation of Cultures
(2017) · Macat Library eBooks · doi:10.4324/9781912128310 · Cited by 16,449
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
Designing and Conducting Mixed Methods Research
นิลพันธุ์, ม. (2010) · Silpakorn Educational Research Journal · Cited by 9,351
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 1×
“This limitation is especially salient in implementation research because the outcomes [10] and costs [11, 12] are dependent on the context in which implementation takes place.”
BackgroundCost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193
(2006) · Cited by 7,081
Toward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
The Triple Aim: Care, Health, And Cost
Berwick, D. M., Nolan, T. W., & Whittington, J. (2008) · Health Affairs · doi:10.1377/hlthaff.27.3.759 · Cited by 5,136
Research works printed but not linked: 1
- Onwuegbuzie AJ Teddlie C Tashakkori AJ Teddlie C A framework for analyzing data in mixed methods research Handbook of mixed methods in social and behavioral research 2003 London Sage Publications 351 383
Cited by
Shelton, R. C., Chambers, D. A., & Glasgow, R. E. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00134 · Cited by 448
Reflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299
“, context for understanding site-level variation in implementation activity and stakeholder interpretation of results) (52).”
BackgroundEisman, A. B., Kilbourne, A. M., Dopp, A. R., Saldana, L., & Eisenberg, D. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.008 · Cited by 210
Self-citationA pragmatic method for costing implementation strategies using time-driven activity-based costing
Cidav, Z., Mandell, D., Pyne, J., Beidas, R., Curran, G., & Marcus, S. (2020) · Implementation Science · doi:10.1186/s13012-020-00993-1 · Cited by 174
“However, there is little guidance with regard to how to pragmatically estimate these costs [ 5 – 7].”
BackgroundShelton, R. C., Lee, M., Brotzman, L., Wolfenden, L., Nathan, N., & Wainberg, M. L. (2020) · International Journal of Behavioral Medicine · doi:10.1007/s12529-020-09848-x · Cited by 161
Metadata
- Authors
- Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D.
- Affiliations
- University of Arkansas at Fayetteville (US)
- University of Oklahoma Health Sciences Center (US)
- Oklahoma State University (US)
- University of Michigan (US)
- Corresponding author
- Dopp, Alex R.
- Venue
- Implementation Science
- Published
- 2019-01-11
- Volume
- 14
- Issue
- 1
- Pages
- 2-2
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC6329154
- OpenAlex
- W2909883179
- Cited by
- 118
- References
- 47
- Citations by year
- 2026: 4 · 2025: 16 · 2024: 30 · 2023: 11 · 2022: 19 · 2021: 11 · 2020: 24 · 2019: 3
- FWCI
- 19.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- U.S. Department of Justice
- Office of Justice Programs
- Office of Juvenile Justice and Delinquency Prevention (2013-MU-MU-K102, 2010-WP-BX-K062, 2016-MU-MU-K053)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- implementation research, cost-effectiveness analysis, Triple Aim, stakeholder perspectives
- MeSH terms
- Implementation Science, Cost-Benefit Analysis, Delivery of Health Care, Humans, Quality of Health Care, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mixed-method approaches to strengthen economic evaluations in implementation research. https://app.cochat.ai/papers/10.1186/s13012-018-0850-6
- The paper
- Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D. (2019). Mixed-method approaches to strengthen economic evaluations in implementation research. Implementation Science. https://doi.org/10.1186/s13012-018-0850-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.