The DOI matches its Crossref record; 82 of the 85 references it cites were found in a registry or an index.
Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges
Open accessAbstract
One of the most critical issues in mental health services research is the gap between what is known about effective treatment and what is provided to consumers in routine care. Concerted efforts are required to advance implementation science and produce skilled implementation researchers. This paper seeks to advance implementation science in mental health services by over viewing the emergence of implementation as an issue for research, by addressing key issues of language and conceptualization, by presenting a heuristic skeleton model for the study of implementation processes, and by identifying the implications for research and training in this emerging field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These are all important considerations, because if the program lacks acceptability and feasibility, its efficacy in controlled clinical trials is unlikely to translate to effectiveness in diverse real-world settings (health care, education, etc.; Proctor et al., 2009).”
From Acceptability and Feasibility of an Intervention to Enhance Social Group Belonging: Evidence From Three Trials of Groups 4 Health (2022) · cites this paper as Proctor et al., 2009
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Glasgow et al4 and others17–20 argue that the time lag between research discovery and routine uptake is also inflated by the dominant developmental approach; that is, one that encourages delimited, step-wise progressions of research through clinical efficacy research, then clinical effectiveness research, and finally implementation research.”
From Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact (2012) · cites this paper as [20]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Equity is a key service system outcome [1, 62].”
From Ten years of implementation outcomes research: a scoping review (2023) · cites this paper as [62]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“To study implementation outcomes, mixed qualitative and quantitative approaches can yield richer information than either method alone (Landsverk et al., 2012;Palinkas et al., 2011;Proctor et al., 2009).”
From Perceived acceptability and appropriateness of a web-based program targeting risk for anxiety in young children and their parents (2025) · cites this paper as Proctor et al., 2009
Experimental — accuracy not yet measuredIn the citing paper
“Similarly, Proctor et al.[46] have proposed a model that informs evaluation by differentiating implementation, service system, and clinical outcomes, and identifying a range of implementation outcomes that can be assessed [24].”
From Writing implementation research grant proposals: ten key ingredients (2012) · cites this paper as [46]
In the citing paper
“These frameworks propose that implementation outcomes are a function of multiple types of broad factors that can be hierarchically organized to represent micro-, meso-, and macro-level factors.”
In the citing paper
“In order to ensure enough statistical power to test the effect of structural-level constructs on implementation outcomes, researchers must typically utilize exceptionally large samples that are typically difficult to obtain [17].”
In the citing paper
“sustainability and penetration constructs typically require very large sample sizes that are hard to obtain [102]”
From eMental Healthcare Technologies for Anxiety and Depression in Childhood and Adolescence: Systematic Review of Studies Reporting Implementation Outcomes (2018) · cites this paper as [102]
In the citing paper
“Proctor et al. articulated a research agenda for DIS outcome evaluations that appears to have positively influenced instrument development.”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [8]
In the citing paper
“Implementation outcomes are typically measured in implementation activities, can advance understanding of the implementation processes, enhance efficiency in implementation research, and pave the way for studies of the comparative effectiveness of implementation strategies [8].”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [8]
In the citing paper
“over one third (34.90%) of instruments for implementation outcomes have been developed since the seminal paper by Proctor et al. was published [8].”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [8]
In the citing paper
“The isolation and concrete operationalization of implementation outcomes, separate from service and client outcomes, was a unique and important addition to the literature (Table 1).”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [8]
In the citing paper
“Basing our work on the CFIR [7] and Implementation Outcomes Framework [8] provides a comprehensive conceptual framework, yet it is clear that DIS investigators employ diverse frameworks delineating unique constructs not included in the SIRC IRP [2].”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
Exchange and Power in Social Life
Blau, P. M. (2017) · doi:10.4324/9780203792643 · Cited by 15,923
Exchange and Power in Social Life.
Bierstedt, R., & Blau, P. M. (1965) · American Sociological Review · doi:10.2307/2091154 · Cited by 13,625
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,779
Crossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal for Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,508
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Donabedian, A. (1988) · JAMA · doi:10.1001/jama.260.12.1743 · Cited by 5,895
REVIEW OF COMMUNITY-BASED RESEARCH: Assessing Partnership Approaches to Improve Public Health
Israel, B. A., Schulz, A. J., Parker, E. A., & Becker, A. B. (1998) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.19.1.173 · Cited by 5,893
(2005) · Cited by 3,748
Crossing the Quality Chasm: A New Health System for the 21st Century
Bloom, B. S. (2002) · JAMA · doi:10.1001/jama.287.5.646-a · Cited by 3,733
Research works printed but not linked: 5
- Backer, T. E., David, S. L., & Saucy, G. (Eds.). (1995). Synthesis of behavioral science learnings about technology transfer in reviewing the behavioral science knowledge base on technology transfer. Rockville, MD: US Department of Health and Human Services.
- Blasé, K. A., Fixsen, D. L., Naoom, S. F., & Wallace, F. (2005). Operationalizing implementation: Strategies and methods. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute.
- Grimshaw, J. (2007). Improving the scientific basis of health care research dissemination and implementation. Paper presented at NIH Conference on Building the Sciences of Dissemination and Implementation in the Service of Public Health, Washington, DC.
- President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health in America. Final report. Rockville, MD: DHHS Publication.
- Proctor, E. K., & Landsverk, J. (2005). Challenges of translating evidence-based treatments into practice contexts and service sectors. Paper presented at The Mental Health Services Research Conference, Washington, DC.
Cited by
Sorted by citations
Items 1,001–1,001 of 1,001
Contextual Influences and Strategies for Dissemination and Implementation in Mental Health
Benjamin Wolk, C., Powell, B. J., & Beidas, R. S. (2015) · Oxford Handbook Topics in Psychology · doi:10.1093/oxfordhb/9780199935291.013.12 · Cited by 6
Metadata
- Authors
- Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B.
- Affiliations
- Washington University in St. Louis (US)
- University of California System (US)
- National Institute of Mental Health (US)
- University of Tennessee at Knoxville (US)
- United States Department of Veterans Affairs (US)
- Corresponding author
- Proctor, Enola K.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2008-12-23
- Volume
- 36
- Issue
- 1
- Pages
- 24-34
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- PMC
- PMC3808121
- OpenAlex
- W2097206783
- Semantic Scholar
- 1506bf0903ba73ff708619e3fbec077844c446f5
- Cited by
- 1,894
- References
- 85
- Citations by year
- 2026: 100 · 2025: 98 · 2024: 142 · 2023: 155 · 2022: 143 · 2021: 227 · 2020: 213 · 2019: 139 · 2018: 112 · 2017: 95 · 2016: 77 · 2015: 88 · 2014: 95 · 2013: 83 · 2012: 46
- FWCI
- 50.78
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Administration and Policy in Mental Health and Mental Health Services Research (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (5p30mh068579-05)
- National Institute of Mental Health (5 P30 MH068579, P30-MH-068579, R21MH082731, R25MH080916)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Keywords
- implementation research, mental health services, implementation process, knowledge-practice gap
- MeSH terms
- Diffusion of Innovation, Health Services Research, Humans, Mental Health Services, Models, Theoretical, Information Dissemination, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review