The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Advancing the application, quality and harmonization of implementation science measures
Open accessAbstract
BACKGROUND: The field of implementation science (IS) encompasses a broad range of constructs and uses measures from a variety of disciplines. However, there has been little standardization of measures or agreement on definitions of constructs across different studies, fields, authors, or research groups. METHODS: We describe a collaborative, web-based activity using the United States National Cancer Institute's (NCI) Grid-Enabled Measures (GEM) portal that uses a wiki platform to focus discussion and engage the research community to enhance the quality and harmonization of measures for IS health-related research and practice. We present the history, process, and preliminary data from the GEM Dissemination & Implementation (D&I) Campaign on IS measurement. RESULTS: The GEM D&I Campaign has been ongoing for eight weeks as of this writing, and has used a combination of expert opinion and crowd-sourcing approaches. To date it has listed definitions for 45 constructs and summarized information on 120 measures. Usage of the website peaked at a rate of 124 views from 89 visitors on week seven. Users from seven countries have contributed measures and/or constructs, shared experience in using different measures, contributed comments, and identified research gaps and needs. CONCLUSION: Thus far, this campaign has provided information about different IS measures, their associated characteristics, and comments. The next step is to rate these measures for quality and practicality. This resource and ongoing activity have potential to advance the quality and harmonization of IS measures and constructs, and we invite readers to contribute to the process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, there is an increasing number of measures of implementation determinants [74, 75] (e.g., implementation leadership [76], implementation climate [77, 78], or implementation intentions [79]).”
From Ten recommendations for using implementation frameworks in research and practice (2020) · cites this paper as [75]
In the citing paper
“Certainly, these problems are evident within the dissemination and implementation science literature [13,62-64]”
From Implementation strategies: recommendations for specifying and reporting (2013) · cites this paper as [62]
In the citing paper
“Rather, the GEM approach encourages website users to provide their own ratings regardless of user knowledge of the extant literature.”
From The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation (2016) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,559
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 1×
“First, measurement can help refine the meaning and understanding of constructs and help enhance conceptual frameworks, models, and theories [13,14].”
BackgroundWelcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Diffusion of Innovations, 5th Edition
Rogers, E. M., Simon, 。., & Schuster (2003) · Cited by 2,049
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
Self-citationDissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Self-citationGlasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2012.300755 · Cited by 762
Self-citationThe Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation
Preece, J., & Shneiderman, B. (2009) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00005 · Cited by 677
Reinventing discovery: the new era of networked science
(2012) · Choice Reviews Online · doi:10.5860/choice.49-4420 · Cited by 644
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608
Dissemination and Implementation Research in Health
(2017) · Oxford Scholarship Online · doi:10.1093/oso/9780190683214.001.0001 · Cited by 396
The meaning and measurement of implementation climate
Weiner, B. J., Belden, C. M., Bergmire, D. M., & Johnston, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-78 · Cited by 260
Dissemination and Implementation Research in Health
Chambers, D. (2023) · doi:10.1093/oso/9780197660690.001.0001 · Cited by 246
An Evidence Integration Triangle for Aligning Science with Policy and Practice
Glasgow, R. E., Green, L. W., Taylor, M., & Stange, K. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.02.016 · Cited by 191
Self-citationEstabrooks, P. A., Boyle, M., Emmons, K. M., Glasgow, R. E., Hesse, B. W., Kaplan, R. M., Krist, A. H., Moser, R. P., & Taylor, M. V. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000576 · Cited by 146
Self-citationDeveloping the Terminology for Dissemination and Implementation Research
Rabin, B. A., & Brownson, R. C. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0002 · Cited by 128
Self-citationMoser, R. P., Hesse, B. W., Shaikh, A. R., Courtney, P., Morgan, G., Augustson, E., Kobrin, S., Levin, K. Y., Helba, C., Garner, D., et al. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.01.004 · Cited by 44
Self-citationPublic health surveillance and the prevention of injuries in sports: what gets measured gets done.
Thacker, S. B. (2007) · PubMed · Cited by 41
Research works printed but not linked: 4
- National Institutes of Health: PA-10-038: dissemination and implementation research in health (R01). 2010
- Hesse BW: Technology-mediated social participation in health and healthcare. Technology mediated social participation workshop. 2010, Arlington, VA: U.S. National Science Foundation
- Surowiecki J: The wisdom of crowds. 2005, New York: Random House
- Dissemination and implementation research in health. Edited by: Brownson RC, Colditz GC, Proctor EK. 2012, New York: Oxford University Press, First edition.
Cited by
Sorted by citations
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Self-citationThe dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
Self-citationSystematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223
Self-citationChambers, D. A., & Norton, W. E. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.05.011 · Cited by 581
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488
Metadata
- Authors
- Rabin, B. A., Purcell, P., Naveed, S., Moser, R. P., Henton, M. D., Proctor, E. K., Brownson, R. C., & Glasgow, R. E.
- Affiliations
- Kaiser Permanente (US)
- National Institutes of Health (US)
- Washington University in St. Louis (US)
- Corresponding author
- Rabin, Borsika A.
- ORCID
- Venue
- Implementation Science
- Published
- 2012-12
- Volume
- 7
- Issue
- 1
- Pages
- 119-119
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3541131
- OpenAlex
- W2136559874
- Cited by
- 106
- References
- 22
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 1 · 2023: 9 · 2022: 5 · 2021: 12 · 2020: 8 · 2019: 15 · 2018: 7 · 2017: 12 · 2016: 5 · 2015: 10 · 2014: 2 · 2013: 11
- FWCI
- 13.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Institute of Clinical and Translational Sciences
- Georgia Clinical and Translational Science Alliance
- National Institutes of Health
- Centers for Disease Control and Prevention (U48DP001903)
- National Cancer Institute (U54CA155496, U48/DP001903, P20CA137219, R01CA124404)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK092950)
- National Center for Research Resources (5UL1RR02499205, UL1RR024992)
- National Center for Chronic Disease Prevention and Health Promotion (U48-DP-001903)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- measurement harmonization, construct definition, crowdsourcing, wiki platform, dissemination and implementation research, research community engagement
- MeSH terms
- Cooperative Behavior, Humans, United States, Internet, Information Dissemination, National Cancer Institute (U.S.), Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
