The DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index.
Economic evaluation in implementation science: Making the business case for implementation strategies
Open accessAbstract
Implementation researchers have made notable progress in developing and testing implementation strategies (i.e., highly-specified methods used to help providers improve uptake of mental health evidence-based practices: EBPs). Yet, implementation strategies are not widely applied in healthcare organizations to improve delivery of EBPs. Economic considerations are a key factor influencing the use of implementation strategies to deliver and sustain mental health evidence-based practices, in part because many health care leaders are reluctant to invest in ongoing implementation strategy support without knowing the return-on-investment. Comparative economic evaluation of implementation strategies provides critical information for payers, policymakers, and providers to make informed decisions if specific strategies are an efficient use of scarce organizational resources. Currently, few implementation studies include implementation cost data and even fewer conduct comparative economic analyses of implementation strategies. This summary will introduce clinicians, researchers and other health professionals to the economic evaluation in implementation science. We provide an overview of different economic evaluation methods, discuss differences between economic evaluation in health services and implementation science. We also highlight approaches and frameworks to guide economic evaluation of implementation, provide an example for a cognitive-behavioral therapy program and discuss recommendations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Ongoing work is making economic evaluations more relevant to implementation (see [9])—e.g., through increased use of budget impact analyses to characterize budget gaps—but additional information is needed by key healthcare delivery and financing decision-makers.”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193
Methods for the economic evaluation of health care programmes
Wilson, S. (1987) · Journal of Epidemiology & Community Health · doi:10.1136/jech.41.4.355-a · Cited by 4,312
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
Sanders, G. D., Neumann, P. J., Basu, A., Brock, D. W., Feeny, D., Krahn, M., Kuntz, K. M., Meltzer, D. O., Owens, D. K., Prosser, L. A., et al. (2016) · JAMA · doi:10.1001/jama.2016.12195 · Cited by 3,069
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
An introduction to implementation science for the non-specialist
Bauer, M. S., Damschroder, L. J., Hagedorn, H., Smith, J. L., & Kilbourne, A. M. (2015) · BMC Psychology · doi:10.1186/s40359-015-0089-9 · Cited by 2,168
Self-citationCost-Effectiveness in Health and Medicine
(2016) · doi:10.1093/acprof:oso/9780190492939.001.0001 · Cited by 1,552
Handbook of Practical Program Evaluation
Newcomer, K. E., Hatry, H. P., & Wholey, J. S. (2015) · Wiley eBooks · doi:10.1002/9781119171386 · Cited by 1,471
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339
Treating Trauma and Traumatic Grief in Children and Adolescents
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006) · Cited by 1,199
The Role of Cost-effectiveness Analysis in Health and Medicine
Russell, L. B. (1996) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1996.03540140060028 · Cited by 1,167
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085
Reenvisioning Clinical Science: Unifying the Discipline to Improve the Public Health
Onken, L. S., Carroll, K. M., Shoham, V., Cuthbert, B. N., & Riddle, M. (2014) · Clinical Psychological Science · doi:10.1177/2167702613497932 · Cited by 872
Treating Trauma and Traumatic Grief in Children and Adolescents
Bubier, R. B. J. L., & Sloan, D. M. (2007) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-006-9043-8 · Cited by 784
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775
Mauskopf, J., Sullivan, S. D., Annemans, L., Jaime, J., Mullins, C. D., Nuijten, M. J. C., Orlewska, E., Watkins, J., & Trueman, P. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00187.x · Cited by 752
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-65 · Cited by 691
Cost-effectiveness of Treatments for Major Depression in Primary Care Practice
Lave, J. R., Frank, R. G., Schulberg, H. C., & Kamlet, M. S. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.7.645 · Cited by 306
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262
Self-citationQUALITATIVE AND MIXED‐METHODS RESEARCH IN ECONOMICS: SURPRISING GROWTH, PROMISING FUTURE
Starr, M. (2012) · Journal of Economic Surveys · doi:10.1111/joes.12004 · Cited by 211
Economic evaluation of implementation strategies in health care
Hoomans, T., & Severens, J. L. (2014) · Implementation Science · doi:10.1186/s13012-014-0168-y · Cited by 181
Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.006 · Cited by 175
Self-citationLong-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies
Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0461-5 · Cited by 172
Implementation science in resource-poor countries and communities
Yapa, H. M., & Bärnighausen, T. (2018) · Implementation Science · doi:10.1186/s13012-018-0847-1 · Cited by 170
Integrating microfinance and health strategies: examining the evidence to inform policy and practice
Leatherman, S., Metcalfe, M., Geissler, K., & Dunford, C. (2012) · Health Policy and Planning · doi:10.1093/heapol/czr014 · Cited by 137
Costing behavioral interventions: a practical guide to enhance translation
Ritzwoller, D. P., Sukhanova, A., Gaglio, B., & Glasgow, R. E. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9088-5 · Cited by 130
Reeves, P., Edmunds, K., Searles, A., & Wiggers, J. (2019) · Public Health · doi:10.1016/j.puhe.2019.01.012 · Cited by 120
Mixed-method approaches to strengthen economic evaluations in implementation research
Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D. (2019) · Implementation Science · doi:10.1186/s13012-018-0850-6 · Cited by 118
Self-citationCost‐Effectiveness and Cost‐Benefit Analysis
Cellini, S. R., & Kee, J. E. (2015) · doi:10.1002/9781119171386.ch24 · Cited by 116
Systematic review of economic evaluations and cost analyses of guideline implementation strategies
Vale, L., Thomas, R., MacLennan, G., & Grimshaw, J. (2007) · The European Journal of Health Economics · doi:10.1007/s10198-007-0043-8 · Cited by 107
Ebert, L., Amaya-Jackson, L. M., Markiewicz, J. M., Kisiel, C., & Fairbank, J. A. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0347-y · Cited by 89
Kilbourne, A. M., Smith, S. N., Choi, S. Y., Koschmann, E., Liebrecht, C., Rusch, A., Abelson, J. L., Eisenberg, D., Himle, J. A., Fitzgerald, K. D., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0808-8 · Cited by 88
Self-citationOrganizational Cost of Quality Improvement for Depression Care
Liu, C., Rubenstein, L. V., Kirchner, J. E., Fortney, J. C., Perkins, M. W., Ober, S. K., Pyne, J. M., & Chaney, E. F. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2008.00911.x · Cited by 64
Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice
Roundfield, K. D., & Lang, J. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600193 · Cited by 60
Cost-effectiveness and cost-benefit analysis
Rosenheck, R. A., & LESLIE, D. L. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511712265.005 · Cited by 54
Cost Effectiveness in Health and Medicine.
McGrath, M. H. (1998) · Plastic & Reconstructive Surgery · doi:10.1097/00006534-199809040-00063 · Cited by 53
Darnell, D. A., Dorsey, C. N., Melvin, A., Chi, J., Lyon, A. R., & Lewis, C. C. (2017) · Implementation Science · doi:10.1186/s13012-017-0673-x · Cited by 51
The Role of Economic Evaluation in Dissemination and Implementation Research
Raghavan, R. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0005 · Cited by 49
Dopp, A. R., Hanson, R. F., Saunders, B. E., Dismuke, C. E., & Moreland, A. D. (2017) · Psychological Services · doi:10.1037/ser0000131 · Cited by 41
Self-citationDopp, A. R., Coen, A. S., Smith, A. B., Reno, J., Bernstein, D. H., Kerns, S. E. U., & Altschul, D. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.12.003 · Cited by 33
Self-citationHumphreys, K. N., Wagner, T. H., & Gage, M. K. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.04.006 · Cited by 23
Mixed-methods research: What’s in it for economists?
Jefferson, T., Austen, S., Sharp, R., Ong, R., Lewin, G. F., & Adams, V. (2014) · The Economic and Labour Relations Review · doi:10.1177/1035304614530819 · Cited by 21
The Conceptual Basis for Dissemination and Implementation Research
Tabak, R. G., Chambers, D., Hook, M., & Brownson, R. C. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780190683214.003.0005 · Cited by 17
Cited by
Sorted by citations
Understanding and applying the RE-AIM framework: Clarifications and resources
Holtrop, J. S., Estabrooks, P. A., Gaglio, B., Harden, S. M., Kessler, R. S., King, D. K., Kwan, B. M., Ory, M. G., Rabin, B. A., Shelton, R. C., et al. (2021) · Journal of Clinical and Translational Science · doi:10.1017/cts.2021.789 · Cited by 549
Stover, A. M., Haverman, L., van Oers, H. A., Greenhalgh, J., Potter, C., Ahmed, S., Greenhalgh, J., Gibbons, E. J., Haverman, L., Manalili, K., et al. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02564-9 · Cited by 313
Reflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299
Implementation strategies for digital mental health interventions in health care settings.
Graham, A. K., Lattie, E. G., Powell, B. J., Lyon, A. R., Smith, J. D., Schueller, S. M., Stadnick, N. A., Brown, C. H., & Mohr, D. C. (2020) · American Psychologist · doi:10.1037/amp0000686 · Cited by 236
Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S. W., & Lane-Fall, M. B. (2022) · Implementation Science · doi:10.1186/s13012-022-01226-3 · Cited by 230
Self-citation
Metadata
- Authors
- Eisman, A. B., Kilbourne, A. M., Dopp, A. R., Saldana, L., & Eisenberg, D.
- Affiliations
- University of Michigan (US)
- United States Department of Veterans Affairs (US)
- University of Arkansas at Fayetteville (US)
- Oregon Social Learning Center (US)
- Corresponding author
- Eisman, Andria B.
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 283
- Pages
- 112433
- ISSN
- 0165-1781 (ISSN-L)
- PMC
- PMC6898762
- OpenAlex
- W2952330955
- Cited by
- 210
- References
- 50
- Citations by year
- 2026: 21 · 2025: 30 · 2024: 47 · 2023: 37 · 2022: 35 · 2021: 24 · 2020: 12
- FWCI
- 3.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Psychiatry Research (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health
- National Institute on Drug Abuse
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- economic evaluation, implementation science, implementation strategies, return on investment, implementation costs, comparative economic analysis, cognitive behavioral therapy
- MeSH terms
- Implementation Science, Mental Disorders, Cost-Benefit Analysis, Delivery of Health Care, Humans, Mental Health, Cognitive Behavioral Therapy, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
