Cost analysis in implementation studies of evidence-based practices for mental health and substance use disorders: a systematic review
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Background: This study is a systematic literature review of cost analyses conducted within implementation studies on behavioral health services. Cost analysis of implementing evidence-based practices (EBP) has become important within implementation science and is critical for bridging the research to practice gap to improve access to quality healthcare services. Costing studies in this area are rare but necessary since cost can be a barrier to implementation and sustainment of EBP. Methods: We followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology and applied the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist. Key search terms included: (1) economics, (2) implementation, (3) EBP, and (4) behavioral health. Terms were searched within article title and abstracts in: EconLit, SocINDEX, Medline, and PsychINFO. A total of 464 abstracts were screened independently by two authors and reduced to 37 articles using inclusion and exclusion criteria. After a full-text review, 18 articles were included. Results: Findings were used to classify costs into direct implementation, direct services, and indirect implementation. While all studies included phases of implementation as part of their design, only five studies examined resources across multiple phases of an implementation framework. Most studies reported direct service costs associated with adopting a new practice, usually summarized as total EBP cost, cost per client, cost per clinician, and/or cost per agency. For studies with detailed analysis, there were eleven direct cost categories represented. For five studies that reported costs per child served, direct implementation costs varied from $886 to $9470 per child, while indirect implementation costs ranged from $897 to $3805 per child. Conclusions: This is the first systematic literature review to examine costs of implementing EBP in behavioral healthcare settings. Since 2000, 18 studies were identified that included a cost analysis. Given a wide variation in the study designs and economic methods, comparison across studies was challenging, which is a major limitation in the field, as it becomes difficult to replicate studies or to estimate future costs to inform policy decisions related to budgeting. We recommend future economic implementation studies to consider standard economic costing methods capturing costs across implementation framework phases to support comparisons and replicability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There has been a recent surge of publications related to the collection of costs in implementation science [9, 14, 31, 36], and emerging consensus regarding the importance of economic influences on implementation outcomes (see other articles in this collection).”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [9]
In the citing paper
“Implementation costs and effects accrue at different levels and are variable across different parties.”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [9]
In the citing paper
“Stakeholder engagement across levels is especially critical when organizations face overwhelming competing demands and scarce resources and/or stakeholders experience disproportionate costs related to implementation, such as opportunity costs for frontline staff engaging in implementation efforts in lieu of billable patient care [9].”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [9]
In the citing paper
“This is consistent with conclusions from a recent systematic review whereby researchers recommended standardized guidelines around costing perspectives, instrumentation, and reporting as critical next steps to advance the field [9].”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [9]
In the citing paper
“Tools to support standardization of multi-level costing approaches and reporting will also aid in building the business case for implementation science; this will facilitate harmonizing data across implementation studies and provide needed empirical evidence for the costs and benefits of implementation efforts for all stakeholders [9].”
From Implementation science issues in understanding, collecting, and using cost estimates: A multi-stakeholder perspective (2021) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1×
“The Consolidated Framework for Implementation Research (CFIR) provides a point of reference as it includes a comprehensive list of constructs (intervention characteristics, agency/staff characteristics, outer and inner contexts within which the agency operates, and the implementation process itself) [37].”
MethodMethods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · cited 1×
“specifically called for implementation research to include costs as an outcome [4].”
BackgroundEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550 · cited 1×
“We based our search strategy on suggestions from psychology and economics published best practices for systematic literature reviews [14, 15].”
Method
Cited by
Cost data in implementation science: categories and approaches to costing
Gold, H. T., McDermott, C., Hoomans, T., & Wagner, T. H. (2022) · Implementation Science · doi:10.1186/s13012-021-01172-6 · Cited by 152
Eisman, A. B., Quanbeck, A., Bounthavong, M., Panattoni, L., & Glasgow, R. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01143-x · Cited by 126
Saldana, L., Ritzwoller, D. P., Campbell, M. R., & Block, E. P. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00295-1 · Cited by 86
Implementation costs of hospital-based computerised decision support systems: a systematic review
Donovan, T., Abell, B., Fernando, M., McPhail, S., & Carter, H. E. (2023) · Implementation Science · doi:10.1186/s13012-023-01261-8 · Cited by 55
Tracing the Evolution of Agency Theory in Corporate Governance
Gwala, R. S., & Mashau, P. (2023) · Advances in public policy and administration (APPA) book series · doi:10.4018/978-1-6684-6966-8.ch013 · Cited by 42
Metadata
- Authors
- Bowser, D. M., Henry, B. F., & McCollister, K. E.
- Affiliations
- Brandeis University (US)
- University of Miami (US)
- Corresponding author
- Henry, Brandy F.
- Venue
- Implementation Science
- Published
- 2021-03-12
- Volume
- 16
- Issue
- 1
- Pages
- 26-26
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC7953634
- OpenAlex
- W3134013756
- Cited by
- 61
- References
- 51
- Citations by year
- 2026: 12 · 2025: 13 · 2024: 7 · 2023: 18 · 2022: 8 · 2021: 3
- FWCI
- 1.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute on Drug Abuse (T32DA37801, R21DA044378, P30 DA040500, R01DA035808)
- National Institute on Alcohol Abuse and Alcoholism (T32AA007567)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- cost analysis, evidence-based practice, implementation costs, behavioral health services, mental health services, substance use disorders, research-practice gap
- MeSH terms
- Child, Cost-Benefit Analysis, Delivery of Health Care, Humans, Mental Health, Substance-Related Disorders, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cost analysis in implementation studies of evidence-based practices for mental health and substance use disorders: a systematic review. https://app.cochat.ai/papers/10.1186/s13012-021-01094-3
- The paper
- Bowser, D. M., Henry, B. F., & McCollister, K. E. (2021). Cost analysis in implementation studies of evidence-based practices for mental health and substance use disorders: a systematic review. Implementation Science. https://doi.org/10.1186/s13012-021-01094-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
