Economic evaluation in implementation science: Making the business case for implementation strategies
Open accessAbstract
Implementation researchers have made notable progress in developing and testing implementation strategies (i.e., highly-specified methods used to help providers improve uptake of mental health evidence-based practices: EBPs). Yet, implementation strategies are not widely applied in healthcare organizations to improve delivery of EBPs. Economic considerations are a key factor influencing the use of implementation strategies to deliver and sustain mental health evidence-based practices, in part because many health care leaders are reluctant to invest in ongoing implementation strategy support without knowing the return-on-investment. Comparative economic evaluation of implementation strategies provides critical information for payers, policymakers, and providers to make informed decisions if specific strategies are an efficient use of scarce organizational resources. Currently, few implementation studies include implementation cost data and even fewer conduct comparative economic analyses of implementation strategies. This summary will introduce clinicians, researchers and other health professionals to the economic evaluation in implementation science. We provide an overview of different economic evaluation methods, discuss differences between economic evaluation in health services and implementation science. We also highlight approaches and frameworks to guide economic evaluation of implementation, provide an example for a cognitive-behavioral therapy program and discuss recommendations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Ongoing work is making economic evaluations more relevant to implementation, e.g., through increased use of budget impact analyses to characterize budget gaps.
“Ongoing work is making economic evaluations more relevant to implementation (see [9])—e.g., through increased use of budget impact analyses to characterize budget gaps—but additional information is needed by key healthcare delivery and financing decision-makers.”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193 · see citing works
Methods for the economic evaluation of health care programmes
Wilson, S. (1987) · Journal of Epidemiology & Community Health · doi:10.1136/jech.41.4.355-a · Cited by 4,312 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · see citing works
Sanders, G. D., Neumann, P. J., Basu, A., Brock, D. W., Feeny, D., Krahn, M., Kuntz, K. M., Meltzer, D. O., Owens, D. K., Prosser, L. A., et al. (2016) · JAMA · doi:10.1001/jama.2016.12195 · Cited by 3,069 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254 · see citing works
An introduction to implementation science for the non-specialist
Bauer, M. S., Damschroder, L. J., Hagedorn, H., Smith, J. L., & Kilbourne, A. M. (2015) · BMC Psychology · doi:10.1186/s40359-015-0089-9 · Cited by 2,023 · see citing works
Self-citationCost-Effectiveness in Health and Medicine
(2016) · doi:10.1093/acprof:oso/9780190492939.001.0001 · Cited by 1,552 · see citing works
Handbook of Practical Program Evaluation
Newcomer, K. E., Hatry, H. P., & Wholey, J. S. (2015) · Wiley eBooks · doi:10.1002/9781119171386 · Cited by 1,471 · see citing works
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355 · see citing works
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339 · see citing works
Treating Trauma and Traumatic Grief in Children and Adolescents
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006) · Cited by 1,199 · see citing works
The Role of Cost-effectiveness Analysis in Health and Medicine
Russell, L. B. (1996) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1996.03540140060028 · Cited by 1,167 · see citing works
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085 · see citing works
Reenvisioning Clinical Science: Unifying the Discipline to Improve the Public Health
Onken, L. S., Carroll, K. M., Shoham, V., Cuthbert, B. N., & Riddle, M. (2014) · Clinical Psychological Science · doi:10.1177/2167702613497932 · Cited by 872 · see citing works
Treating Trauma and Traumatic Grief in Children and Adolescents
Bubier, R. B. J. L., & Sloan, D. M. (2007) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-006-9043-8 · Cited by 784 · see citing works
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775 · see citing works
Mauskopf, J., Sullivan, S. D., Annemans, L., Jaime, J., Mullins, C. D., Nuijten, M. J. C., Orlewska, E., Watkins, J., & Trueman, P. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00187.x · Cited by 752 · see citing works
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-65 · Cited by 691 · see citing works
Cost-effectiveness of Treatments for Major Depression in Primary Care Practice
Lave, J. R., Frank, R. G., Schulberg, H. C., & Kamlet, M. S. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.7.645 · Cited by 306 · see citing works
Chamberlain, P., Brown, C. H., & Saldana, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-116 · Cited by 262 · see citing works
Self-citationQUALITATIVE AND MIXED‐METHODS RESEARCH IN ECONOMICS: SURPRISING GROWTH, PROMISING FUTURE
Starr, M. (2012) · Journal of Economic Surveys · doi:10.1111/joes.12004 · Cited by 211 · see citing works
Economic evaluation of implementation strategies in health care
Hoomans, T., & Severens, J. L. (2014) · Implementation Science · doi:10.1186/s13012-014-0168-y · Cited by 181 · see citing works
Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.006 · Cited by 175 · see citing works
Self-citationLong-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies
Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0461-5 · Cited by 172 · see citing works
Implementation science in resource-poor countries and communities
Yapa, H. M., & Bärnighausen, T. (2018) · Implementation Science · doi:10.1186/s13012-018-0847-1 · Cited by 170 · see citing works
Integrating microfinance and health strategies: examining the evidence to inform policy and practice
Leatherman, S., Metcalfe, M., Geissler, K., & Dunford, C. (2012) · Health Policy and Planning · doi:10.1093/heapol/czr014 · Cited by 137 · see citing works
Costing behavioral interventions: a practical guide to enhance translation
Ritzwoller, D. P., Sukhanova, A., Gaglio, B., & Glasgow, R. E. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9088-5 · Cited by 130 · see citing works
Reeves, P., Edmunds, K., Searles, A., & Wiggers, J. (2019) · Public Health · doi:10.1016/j.puhe.2019.01.012 · Cited by 120 · see citing works
Mixed-method approaches to strengthen economic evaluations in implementation research
Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D. (2019) · Implementation Science · doi:10.1186/s13012-018-0850-6 · Cited by 118 · see citing works
Self-citationCost‐Effectiveness and Cost‐Benefit Analysis
Cellini, S. R., & Kee, J. E. (2015) · doi:10.1002/9781119171386.ch24 · Cited by 116 · see citing works
Systematic review of economic evaluations and cost analyses of guideline implementation strategies
Vale, L., Thomas, R., MacLennan, G., & Grimshaw, J. (2007) · The European Journal of Health Economics · doi:10.1007/s10198-007-0043-8 · Cited by 107 · see citing works
Ebert, L., Amaya-Jackson, L. M., Markiewicz, J. M., Kisiel, C., & Fairbank, J. A. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0347-y · Cited by 89 · see citing works
Kilbourne, A. M., Smith, S. N., Choi, S. Y., Koschmann, E., Liebrecht, C., Rusch, A., Abelson, J. L., Eisenberg, D., Himle, J. A., Fitzgerald, K. D., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0808-8 · Cited by 85 · see citing works
Self-citationOrganizational Cost of Quality Improvement for Depression Care
Liu, C., Rubenstein, L. V., Kirchner, J. E., Fortney, J. C., Perkins, M. W., Ober, S. K., Pyne, J. M., & Chaney, E. F. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2008.00911.x · Cited by 63 · see citing works
Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice
Roundfield, K. D., & Lang, J. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600193 · Cited by 60 · see citing works
Cost-effectiveness and cost-benefit analysis
Rosenheck, R. A., & LESLIE, D. L. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511712265.005 · Cited by 54 · see citing works
Cost Effectiveness in Health and Medicine.
McGrath, M. H. (1998) · Plastic & Reconstructive Surgery · doi:10.1097/00006534-199809040-00063 · Cited by 53 · see citing works
Darnell, D. A., Dorsey, C. N., Melvin, A., Chi, J., Lyon, A. R., & Lewis, C. C. (2017) · Implementation Science · doi:10.1186/s13012-017-0673-x · Cited by 51 · see citing works
The Role of Economic Evaluation in Dissemination and Implementation Research
Raghavan, R. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0005 · Cited by 49 · see citing works
Dopp, A. R., Hanson, R. F., Saunders, B. E., Dismuke, C. E., & Moreland, A. D. (2017) · Psychological Services · doi:10.1037/ser0000131 · Cited by 41 · see citing works
Self-citationDopp, A. R., Coen, A. S., Smith, A. B., Reno, J., Bernstein, D. H., Kerns, S. E. U., & Altschul, D. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.12.003 · Cited by 33 · see citing works
Self-citationHumphreys, K. N., Wagner, T. H., & Gage, M. K. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.04.006 · Cited by 23 · see citing works
Mixed-methods research: What’s in it for economists?
Jefferson, T., Austen, S., Sharp, R., Ong, R., Lewin, G. F., & Adams, V. (2014) · The Economic and Labour Relations Review · doi:10.1177/1035304614530819 · Cited by 21 · see citing works
The Conceptual Basis for Dissemination and Implementation Research
Tabak, R. G., Chambers, D., Hook, M., & Brownson, R. C. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780190683214.003.0005 · Cited by 17 · see citing works
Flagged first, then by citations
2 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Edejer T, Baltussen R, Adam T, Hutubessy R, Acharya A, Evans D, & Murray C (Series Ed.). (2003). Making Choices in Health: WHO Guide to Cost-Effectiveness Analysis. Geneva, Switzerland: World Health Organization.
- Nathan PE, editor., & Gorman JM, editor. (2015). A guide to treatments that work / (Fourth edition., Vols. 1– 1 online resource.). Oxford: Oxford University Press, [2015]. U-M Catalog Search.
Cited by
Sorted by citations
Understanding and applying the RE-AIM framework: Clarifications and resources
Holtrop, J. S., Estabrooks, P. A., Gaglio, B., Harden, S. M., Kessler, R. S., King, D. K., Kwan, B. M., Ory, M. G., Rabin, B. A., Shelton, R. C., et al. (2021) · Journal of Clinical and Translational Science · doi:10.1017/cts.2021.789 · Cited by 549 · see citing works
Stover, A. M., Haverman, L., van Oers, H. A., Greenhalgh, J., Potter, C., Ahmed, S., Greenhalgh, J., Gibbons, E. J., Haverman, L., Manalili, K., et al. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02564-9 · Cited by 313 · see citing works
Reflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299 · see citing works
Implementation strategies for digital mental health interventions in health care settings.
Graham, A. K., Lattie, E. G., Powell, B. J., Lyon, A. R., Smith, J. D., Schueller, S. M., Stadnick, N. A., Brown, C. H., & Mohr, D. C. (2020) · American Psychologist · doi:10.1037/amp0000686 · Cited by 236 · see citing works
Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S. W., & Lane-Fall, M. B. (2022) · Implementation Science · doi:10.1186/s13012-022-01226-3 · Cited by 230 · see citing works
Self-citationA pragmatic method for costing implementation strategies using time-driven activity-based costing
Cidav, Z., Mandell, D., Pyne, J., Beidas, R., Curran, G., & Marcus, S. (2020) · Implementation Science · doi:10.1186/s13012-020-00993-1 · Cited by 174 · see citing works
Cost data in implementation science: categories and approaches to costing
Gold, H. T., McDermott, C., Hoomans, T., & Wagner, T. H. (2022) · Implementation Science · doi:10.1186/s13012-021-01172-6 · Cited by 152 · see citing works
Eisman, A. B., Quanbeck, A., Bounthavong, M., Panattoni, L., & Glasgow, R. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01143-x · Cited by 126 · see citing works
Self-citationMixed-method approaches to strengthen economic evaluations in implementation research
Dopp, A. R., Mundey, P., Beasley, L. O., Silovsky, J. F., & Eisenberg, D. (2019) · Implementation Science · doi:10.1186/s13012-018-0850-6 · Cited by 118 · see citing works
Self-citationA scoping review of de-implementation frameworks and models
Walsh‐Bailey, C., Tsai, E., Tabak, R. G., Morshed, A. B., Norton, W. E., McKay, V., Brownson, R. C., & Gifford, S. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01173-5 · Cited by 135 · see citing works
The Lancet Psychiatry Commission: transforming mental health implementation research
McGinty, E. E., Alegria, M. M., Beidas, R. S., Braithwaite, J., Kola, L., LESLIE, D. L., Moise, N., Mueller, B., Pincus, H. A., Shidhaye, R. R., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00040-3 · Cited by 127 · see citing works
Reilly, K. L., Kennedy, S., Porter, G., & Estabrooks, P. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00430 · Cited by 102 · see citing works
Miller, C. J., Adjognon, O. L., Brady, J. E., Dichter, M. E., & Iverson, K. M. (2021) · Implementation Research and Practice · doi:10.1177/26334895211039894 · Cited by 112 · see citing works
Quantitative approaches for the evaluation of implementation research studies
Smith, J. D., & Hasan, M. M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112521 · Cited by 115 · see citing works
A Review of Interventions to Enhance HIV Medication Adherence
Whiteley, L., Olsen, E. M., Haubrick, K. K., Odoom, E., Tarantino, N., & Brown, L. K. (2021) · Current HIV/AIDS Reports · doi:10.1007/s11904-021-00568-9 · Cited by 95 · see citing works
Ashcraft, L. E., Goodrich, D. E., Hero, J., Phares, A., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01369-5 · Cited by 89 · see citing works
Implementation Support Skills: Findings From a Systematic Integrative Review
Albers, B., Metz, A. J. R., Burke, K., Bührmann, L., Bartley, L., Driessen, P., & Varsi, C. (2020) · Research on Social Work Practice · doi:10.1177/1049731520967419 · Cited by 89 · see citing works
Dopp, A. R., Narcisse, M.-R., Mundey, P., Silovsky, J. F., Smith, A. B., Mandell, D., Funderburk, B. W., Powell, B. J., Schmidt, S., Edwards, D., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520939980 · Cited by 79 · see citing works
Self-citationAdvancing healthcare equity through dissemination and implementation science
Baumann, A. A., Shelton, R. C., Kumanyika, S., & Haire-Joshu, D. L. (2023) · Health Services Research · doi:10.1111/1475-6773.14175 · Cited by 87 · see citing works
Saldana, L., Ritzwoller, D. P., Campbell, M. R., & Block, E. P. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00295-1 · Cited by 79 · see citing works
Self-citationGlasgow, R. E., Trinkley, K. E., Ford, B., & Rabin, B. A. (2024) · Global Implementation Research and Applications · doi:10.1007/s43477-024-00134-6 · Cited by 70 · see citing works
Extending analytic methods for economic evaluation in implementation science
O’Leary, M. C., Lich, K. H., Frerichs, L., Leeman, J., Reuland, D. S., & Wheeler, S. B. (2022) · Implementation Science · doi:10.1186/s13012-022-01192-w · Cited by 56 · see citing works
Translating economic evaluations into financing strategies for implementing evidence-based practices
Dopp, A. R., Kerns, S. E. U., Panattoni, L., Ringel, J. S., Eisenberg, D., Powell, B. J., Low, R., & Raghavan, R. (2021) · Implementation Science · doi:10.1186/s13012-021-01137-9 · Cited by 52 · see citing works
Self-citationWolfenden, L., McCrabb, S., Barnes, C., O’Brien, K. M., Ng, K., Nathan, N., Sutherland, R., Hodder, R. K., Tzelepis, F., Nolan, E., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011677.pub3 · Cited by 49 · see citing works
Hohl, S. D., Matulewicz, R. S., Salloum, R. G., Ostroff, J. S., Baker, T. B., Schnoll, R. A., Warren, G. W., Bernstein, S. L., Minion, M. M., Lenhoff, K., et al. (2022) · Journal of Clinical Oncology · doi:10.1200/jco.22.00936 · Cited by 48 · see citing works
Lyon, A. R., Connors, E. H., Lawson, G. M., Nadeem, E., & Owens, J. S. (2024) · School Mental Health · doi:10.1007/s12310-024-09731-0 · Cited by 47 · see citing works
Implementation costs of hospital-based computerised decision support systems: a systematic review
Donovan, T., Abell, B., Fernando, M., McPhail, S., & Carter, H. E. (2023) · Implementation Science · doi:10.1186/s13012-023-01261-8 · Cited by 44 · see citing works
Collaborating with health economists to advance implementation science: a qualitative study
Barnett, M. L., Dopp, A. R., Klein, C. C., Ettner, S. L., Powell, B. J., & Saldana, L. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00074-w · Cited by 38 · see citing works
Self-citationBeidas, R. S., Ahmedani, B. K., Linn, K. A., Marcus, S. C., Johnson, C., Maye, M. P., Westphal, J. A., Wright, L., Beck, A. L., Buttenheim, A. M., et al. (2021) · Implementation Science · doi:10.1186/s13012-021-01154-8 · Cited by 38 · see citing works
Malhotra, A., Thompson, R. R., Kagoya, F., Masiye, F., Mbewe, P., Mosepele, M., Phiri, J., Sambo, J., Barker, A. R., Cameron, D., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01248-x · Cited by 33 · see citing works
Smith, S. N., Almirall, D., Choi, S. Y., Koschmann, E., Rusch, A., Bilek, E. L., Lane, A., Abelson, J. L., Eisenberg, D., Himle, J. A., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01211-w · Cited by 33 · see citing works
Self-citationBunger, A. C., & Lengnick‐Hall, R. (2019) · Human Services Organizations Management Leadership & Governance · doi:10.1080/23303131.2019.1666765 · Cited by 30 · see citing works
Miller, C. J., Griffith, K. N., Stolzmann, K. L., Kim, B., Connolly, S. L., & Bauer, M. S. (2020) · Medical Care · doi:10.1097/mlr.0000000000001372 · Cited by 27 · see citing works
Martens, N., Destoop, M., & Dom, G. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18020462 · Cited by 27 · see citing works
Bloyd, C., Murthy, S., Song, C., Franck, L. S., & Mangurian, C. (2022) · Children · doi:10.3390/children9060793 · Cited by 26 · see citing works
Michaud, T. L., Pereira, E. L., Porter, G. C., Golden, C. A., Hill, J. L., Kim, J., Wang, H., Schmidt, C., & Estabrooks, P. A. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060785 · Cited by 24 · see citing works
Kavulikirwa, O. K., & Sikakulya, F. K. (2022) · One Health · doi:10.1016/j.onehlt.2022.100379 · Cited by 22 · see citing works
Using decision analysis to support implementation planning in research and practice
Smith, N., Knocke, K., & Lich, K. H. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00330-1 · Cited by 22 · see citing works
Budget impact analysis for implementation decision making, planning, and financing
Smith, N., & Levy, D. E. (2023) · Translational Behavioral Medicine · doi:10.1093/tbm/ibad059 · Cited by 19 · see citing works
Cidav, Z., Mandell, D. S., Ingersoll, B. R., & Pellecchia, M. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01247-6 · Cited by 17 · see citing works
Huebschmann, A. G., Trinkley, K. E., Gritz, M., & Glasgow, R. E. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00292-4 · Cited by 15 · see citing works
Lane, C., Nathan, N., Reeves, P., Sutherland, R., Wolfenden, L., Shoesmith, A., & Hall, A. E. (2022) · Implementation Science · doi:10.1186/s13012-022-01215-6 · Cited by 14 · see citing works
Orth, L. E., Feudtner, C., Kempe, A., Morris, M. A., Colborn, K. L., Gritz, R. M., Linnebur, S. A., Begum, A., & Feinstein, J. A. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09439-y · Cited by 14 · see citing works
Lee, D. C. W., O’Brien, K. M., McCrabb, S., Wolfenden, L., Tzelepis, F., Barnes, C., Yoong, S., Bartlem, K. M., & Hodder, R. K. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011677.pub4 · Cited by 15 · see citing works
Nwaozuru, U., Obiezu‐Umeh, C., Obi‐Jeff, C., Shato, T., Gbaja-Biamila, T. A., Oladele, D. A., Idigbe, I. E., Tucker, J. D., Ezechi, O., & Iwelunmor, J. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00243-5 · Cited by 13 · see citing works
Donovan, T., Abell, B., McPhail, S., & Carter, H. E. (2025) · Implementation Science · doi:10.1186/s13012-025-01423-w · Cited by 14 · see citing works
Rusch, A., DeCamp, L., Liebrecht, C., Choi, S. Y., Dalack, G. W., Kilbourne, A. M., & Smith, S. N. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.655999 · Cited by 13 · see citing works
Self-citationCosts to Implement a Pediatric Weight Management Program Across 3 Distinct Contexts
Smith, N., Simione, M., Farrar-Muir, H., Granadeño, J., Moreland, J., Wallace, J., Frost, H. M., Young, J., Craddock, C., Sease, K. K., et al. (2023) · Medical Care · doi:10.1097/mlr.0000000000001891 · Cited by 12 · see citing works
Barbosa, C., Cowell, A., Dunlap, L., Wedehase, B., Dušek, K., Schwartz, R. P., Gryczynski, J., Barnosky, A., Kirk, A. S., Oros, M., et al. (2022) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2022.83.231 · Cited by 11 · see citing works
Nilsén, P., Kirk, J. W., Gunnarsson, K. U., & Thomas, K. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00781-2 · Cited by 11 · see citing works
Glasgow, R. E., Ford, B. S., & Bradley, C. J. (2023) · Translational Behavioral Medicine · doi:10.1093/tbm/ibad078 · Cited by 11 · see citing works
Wolfenden, L., Hall, A. E., Bauman, A. E., Milat, A., Hodder, R. K., Webb, E., Mooney, K., Yoong, S., Sutherland, R., & McCrabb, S. (2024) · Health Research Policy and Systems · doi:10.1186/s12961-024-01144-4 · Cited by 11 · see citing works
Ngusa, D. A. (2025) · Energy Strategy Reviews · doi:10.1016/j.esr.2025.101834 · Cited by 10 · see citing works
Owning Police Reform: The Path Forward for Practitioners and Researchers
ENGEL, R. S., Isaza, G. T., & McManus, H. D. (2022) · American Journal of Criminal Justice · doi:10.1007/s12103-022-09719-z · Cited by 10 · see citing works
Hinde, J. M., Garner, B. R., Watson, C. J., Ramanan, R., Ball, E. L., & Tueller, S. (2022) · Implementation Research and Practice · doi:10.1177/26334895221089266 · Cited by 10 · see citing works
Hamilton, A. B., Finley, E. P., Bean‐Mayberry, B., Lang, A. J., Haskell, S. G., Moin, T., Farmer, M. M., & the EMPOWER QUERI Team (2023) · Implementation Science Communications · doi:10.1186/s43058-022-00389-w · Cited by 10 · see citing works
Taking a School-Based Child Sexual Abuse Prevention Program to Scale: a Cost Analysis
Shipe, S. L., Guastaferro, K., Noll, J. G., Connell, C. M., Morgan, P. L., & Crowley, D. M. (2022) · Prevention Science · doi:10.1007/s11121-022-01401-4 · Cited by 11 · see citing works
MacKinnon, K. R., Gómez-Ramírez, O., Worthington, C., Gilbert, M., & Grace, D. (2020) · Critical Public Health · doi:10.1080/09581596.2020.1854182 · Cited by 10 · see citing works
Leveraging Artificial Intelligence for Expediting Implementation Efforts
Younas, A., & Reynolds, S. S. (2024) · Creative Nursing · doi:10.1177/10784535241239059 · Cited by 10 · see citing works
Carrandi, A., Grove, A., Skouteris, H., Melder, A., Hu, Y., Dever, M., & Higgins, A. M. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00562-3 · Cited by 10 · see citing works
Lyon, A. R., Munson, S. A., Pullmann, M. D., Mosser, B., Aung, T., Fortney, J. C., Dopp, A. R., Osterhage, K. P., Haile, H. G., Bruzios, K. E., et al. (2024) · JMIR Research Protocols · doi:10.2196/65446 · Cited by 10 · see citing works
Self-citationMcLoughlin, G. M., Kerstetter, M., Yohannes, Y., Martínez, O., Jones, R. M., Brownson, R. C., & Fisher, J. O. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00713-0 · Cited by 10 · see citing works
Heggie, R., Boyd, K., & Wu, O. (2021) · Health Research Policy and Systems · doi:10.1186/s12961-021-00766-2 · Cited by 9 · see citing works
Moving Integrative Health Research from Effectiveness to Widespread Dissemination
Taylor, S. L., Dusek, J. A., & Elwy, A. R. (2021) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2021.0080 · Cited by 10 · see citing works
Can fundamental care be advanced using the science of care framework?
Jeffs, L. P., Merkley, J., Ronald, K., Newton, G. E., Yang, L., & Gray, C. S. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15404 · Cited by 8 · see citing works
Donovan, T., Carter, H. E., McPhail, S., & Abell, B. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00648-y · Cited by 8 · see citing works
Implementation costs of sugary drink policies in the United States
Smith, N., Lich, K. H., Ng, S. W., Hall, M. G., Trogdon, J. G., & Frerichs, L. (2023) · Journal of Public Health Policy · doi:10.1057/s41271-023-00435-4 · Cited by 8 · see citing works
Kim, B., Miller, C. J., Ritchie, M. J., Smith, J. L., Kirchner, J. E., Stolzmann, K. L., Connolly, S. L., Drummond, K. L., & Bauer, M. S. (2022) · Implementation Research and Practice · doi:10.1177/26334895221086275 · Cited by 8 · see citing works
Corral‐Partearroyo, C., Sánchez‐Viñas, A., Gil‐Girbau, M., Peñarrubia‐María, M. T., Aznar‐Lou, I., Gallardo‐Gonzalez, C., Olmos-Palenzuela, M. D. C., & Rubio-Valera, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-067468 · Cited by 8 · see citing works
Shrestha, G. S., Prabhakar, H., Mahajan, C., Kapoor, I., Livesay, S. L., Rajajee, V., Zirpe, K. G., Videtta, W., Hossain, S., Silva, G. S., et al. (2025) · Journal of Critical Care · doi:10.1016/j.jcrc.2025.155296 · Cited by 7 · see citing works
Gold, H. T., Siman, N., Cuthel, A. M., Nguyen, A. M., Pham-Singer, H., Berry, C. A., & Shelley, D. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00116-x · Cited by 7 · see citing works
Falkenbach, P., Raudasoja, A., Vernooij, R. W. M., Mustonen, J. M. J., Agarwal, A., Aoki, Y., Blanker, M. H., Cartwright, R., García‐Perdomo, H. A., Kilpeläinen, T. P., et al. (2023) · Implementation Science · doi:10.1186/s13012-023-01290-3 · Cited by 9 · see citing works
Eisman, A. B., Whitman, J., Palinkas, L. A., Fridline, J., Harvey, C., Kilbourne, A. M., & Hutton, D. W. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00511-6 · Cited by 9 · see citing works
Self-citationGarner, B. R., Patel, S. V., & Kirk, M. A. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01535-y · Cited by 7 · see citing works
Economic evaluation methods used in home‐visiting interventions: A systematic search and review
Bailey, C., Skouteris, H., Morris, H., O’Donnell, R., Hill, B., & Ademi, Z. (2021) · Health & Social Care in the Community · doi:10.1111/hsc.13349 · Cited by 6 · see citing works
AI Implementation Science for Social Issues: Pitfalls and Tips
Takaoka, K. (2022) · Journal of Epidemiology · doi:10.2188/jea.je20210278 · Cited by 7 · see citing works
Michaud, T. L., Hill, J. L., Heelan, K. A., Bartee, R. T., Abbey, B. M., Malmkar, A., Masker, J., Golden, C. A., Porter, G. C., Glasgow, R. E., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00287-1 · Cited by 7 · see citing works
Delgado, R. I., la Rosa, M. D., Picado, M. A., Ayoub-Rodriguez, L., Gonzalez, C. E., & Gemoets, L. A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0278386 · Cited by 7 · see citing works
Maxwell, C. A., Ehrhart, M. G., Williams, N. J., Moore, T. M., Kendall, P. C., & Beidas, R. S. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01128-4 · Cited by 7 · see citing works
McLeman, B. M., Gauthier, P. R., Lester, L. S., Homsted, F. A. E., Gardner, V. T., Moore, S. K., Joudrey, P. J., Saldana, L., Cochran, G., Harris, J. P., et al. (2024) · Addiction Science & Clinical Practice · doi:10.1186/s13722-024-00452-y · Cited by 7 · see citing works
Self-citationBankole, A. O., Conombo, B., Légaré, F., & Laberge, M. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13024-w · Cited by 6 · see citing works
Implementation science on the margins: How do we demonstrate the value of implementation strategies?
Hinde, J. M., Bray, J. W., & Cowell, A. J. (2020) · Families Systems & Health · doi:10.1037/fsh0000535 · Cited by 6 · see citing works
Health Dissemination and Implementation Within Schools
Lee, R. M., Eisman, A. B., & Gortmaker, S. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0022 · Cited by 6 · see citing works
Self-citationThe Role of Economic Evaluation in Dissemination and Implementation Research
Dopp, A. R., Walker, S., & Raghavan, R. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0011 · Cited by 6 · see citing works
Self-citationIncluding Economic Evaluations in Implementation Science
Yoon, J. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-05649-w · Cited by 6 · see citing works
Webb, S., Drake, C., Coffman, C. J., Sullivan, C., Sperber, N. R., Tucker, M., Zullig, L. L., Hughes, J. M., Kaufman, B. G., Pura, J. A., et al. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00502-7 · Cited by 6 · see citing works
Kaburi, B. B., Harries, M., Hauri, A. M., Kenu, E., Wyss, K., Silenou, B. C., Klett-Tammen, C. J., Ressing, C., Awolin, J., Lange, B., et al. (2024) · BMC Public Health · doi:10.1186/s12889-024-19205-2 · Cited by 5 · see citing works
Luo, S., Wu, C., Luo, Q., Ran, M., Liu, Y., Lei, F., Chen, X., Yuan, Z., Liu, H., & Wan, C. (2021) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s340718 · Cited by 6 · see citing works
Brown, V., Tran, H. N. Q., Williams, J. W., Laws, R., & Moodie, M. (2022) · BMC Public Health · doi:10.1186/s12889-022-13754-0 · Cited by 5 · see citing works
Appel‐Meulenbroek, R., & Danivska, V. (2023) · Business Process Management Journal · doi:10.1108/bpmj-10-2022-0532 · Cited by 5 · see citing works
Hogue, A., MacLean, A., Bobek, M., Dunnsue, S., Porter, N., Jensen‐Doss, A., & Henderson, C. E. (2023) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2023.2222405 · Cited by 5 · see citing works
Levin, C., Tauscher, J. S., Meller, S., Brian, R., Buck, B., & Ben‐Zeev, D. (2023) · Psychiatric Services · doi:10.1176/appi.ps.20230140 · Cited by 5 · see citing works
Bumbarger, B. K., Moore, J. E., & Crane, M. E. (2024) · Evaluation & the Health Professions · doi:10.1177/01632787241293457 · Cited by 5 · see citing works
The forgotten contexts of evaluation
Harris, B., Alderman, L., & Staheli, J. (2025) · Evaluation · doi:10.1177/13563890241312910 · Cited by 5 · see citing works
Engell, T., Varsi, C., Graverholt, B., & Egeland, K. M. (2021) · Global Implementation Research and Applications · doi:10.1007/s43477-021-00027-y · Cited by 5 · see citing works
Raciborski, R. A., Woodward, E. N., & Painter, J. T. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.1031325 · Cited by 5 · see citing works
Kataria, I., Selmouni, F., Duggan, C. R., Sullivan, R. J., Purushotham, A. D., Sankaranarayanan, R., Taghavi, K., & Basu, P. S. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-108755 · Cited by 4 · see citing works
Rossiter, S., Howe, S., Szanyi, J., Trauer, J. M., Wilson, T., & Blakely, T. A. (2024) · Cost Effectiveness and Resource Allocation · doi:10.1186/s12962-024-00585-6 · Cited by 4 · see citing works
Villagracia, H. N., Alhejaili, T. N., Alshammari, B., Sallam, S. A. E. G., Alrasheeday, A., Dando, L. L., Nacubuan, O. A., Alrashedi, H., Nageeb, S. M., Cornejo, L. T. O., et al. (2025) · BMC Nursing · doi:10.1186/s12912-025-03601-z · Cited by 4 · see citing works
Namyalo, P. K., Wodnik, B. K., Michaelides, O., Kane, S. S., Essue, B. M., & Ruggiero, E. D. (2025) · BMJ Global Health · doi:10.1136/bmjgh-2024-018562 · Cited by 4 · see citing works
- Authors
- Eisman, A. B., Kilbourne, A. M., Dopp, A. R., Saldana, L., & Eisenberg, D.
- Affiliations
- University of Michigan (US)
- United States Department of Veterans Affairs (US)
- University of Arkansas at Fayetteville (US)
- Oregon Social Learning Center (US)
- Corresponding author
- Eisman, Andria B.
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 283
- Pages
- 112433
- ISSN
- 0165-1781 (ISSN-L)
- PMC
- PMC6898762
- OpenAlex
- W2952330955
- Cited by
- 210
- References
- 50
- Citations by year
- 2026: 21 · 2025: 30 · 2024: 47 · 2023: 37 · 2022: 35 · 2021: 24 · 2020: 12 · 2019: 3
- FWCI
- 3.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Psychiatry Research (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health
- National Institute on Drug Abuse
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- economic evaluation, implementation science, implementation strategies, return on investment, implementation costs, comparative economic analysis, cognitive behavioral therapy
- MeSH terms
- Implementation Science, Mental Disorders, Cost-Benefit Analysis, Delivery of Health Care, Humans, Mental Health, Cognitive Behavioral Therapy, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review