Reflections on the measurement of implementation constructs
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
To advance research and practice, it is crucial to build on validated measures. A wide range of measures for implementation research were identified in seven systematic reviews conducted under the auspices of the project, “Advancing Implementation Science through Measure Development and Evaluation,” but many had unclear or limited measurement qualities. In this commentary, I suggest the psychometric paradigm of measurement validation may have to be reconsidered because many determinants and outcomes of interest are defined at higher levels of aggregation than the individual. Nonetheless, the practice of using non-validated measures should be reduced, and measurement validation research should be encouraged. Adaptation of existing measures to different domains, settings, and languages further adds to the need for validation research. Coordination of the development and validation of measures is required to avoid unneeded replication in some domains and lack of measures in others, and to take care that validation research remains instrumental to the purposes of implementation research and practice. Plain language abstract: Many measures for implementation research have limited or unknown qualities. There is thus a need for better measures and targeted research is required to provide those. New studies should use measures of high-quality whenever possible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Lewis et al.’s measurement reviews on the original CFIR constructs [10] focused specifically on assessing questionnaires administered to healthcare professionals or leaders within behavioral health settings [97] using multi-dimensional criteria for validity and pragmatism [98].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [97]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 4×
“The published reviews comprise a Special Collection of Implementation Research and Practice entitled “Systematic Reviews of Methods to Measure Implementation Constructs.””
MethodInfluentialFlottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-35 · Cited by 1,138
Self-citationKnowledge translation in health: how implementation science could contribute more
Wensing, M., & Grol, R. (2019) · BMC Medicine · doi:10.1186/s12916-019-1322-9 · Cited by 413
Self-citationStrifler, L., Cardoso, R., McGowan, J., Cogo, E., Nincic, V., Khan, P. A., Scott, A., Ghassemi, M., MacDonald, H., Lai, Y., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.04.008 · Cited by 227
An updated protocol for a systematic review of implementation-related measures
Lewis, C. C., Mettert, K. D., Dorsey, C. N., Martinez, R. G., Weiner, B. J., Nolen, E., Stanick, C., Halko, H., & Powell, B. J. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0728-3 · Cited by 118
Clinton-McHarg, T., Yoong, S. L., Tzelepis, F., Regan, T., Fielding, A., Skelton, E., Kingsland, M., Ooi, J. Y., & Wolfenden, L. (2016) · Implementation Science · doi:10.1186/s13012-016-0512-5 · Cited by 116
Implementation outcome instruments for use in physical healthcare settings: a systematic review
Khadjesari, Z., Boufkhed, S., Vitoratou, S., Schatte, L., Ziemann, A., Daskalopoulou, C., Uglik‐Marucha, N., Sevdalis, N., & Hull, L. (2020) · Implementation Science · doi:10.1186/s13012-020-01027-6 · Cited by 109
Hilbink, M., Laurant, M. G. H., Verhaak, P. F. M., Prins, M., van Marwijk, H., Penninx, B. W. J. H., Wensing, M., & Grol, R. P. T. M. (2009) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2009.05.011 · Cited by 97
Self-citationPowell, B. J., Mettert, K. D., Dorsey, C. N., Weiner, B. J., Stanick, C. F., Lengnick-Hall, R., Ehrhart, M. G., Aarons, G. A., Barwick, M. A., Damschroder, L. J., et al. (2021) · Implementation Research and Practice · doi:10.1177/26334895211018862 · Cited by 79
Weiner, B. J., Mettert, K. D., Dorsey, C. N., Nolen, E. A., Stanick, C., Powell, B. J., & Lewis, C. C. (2020) · Implementation Research and Practice · doi:10.1177/2633489520933896 · Cited by 58
Research works printed but not linked: 1
- Powell B. J., 2021, Implementation Research and Practice
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
“’s measurement reviews on the original CFIR constructs [10] focused specifically on assessing questionnaires administered to healthcare professionals or leaders within behavioral health settings [97] using multi-dimensional criteria for validity and pragmatism [98].”
BackgroundHamm, R. F., Moniz, M. H., Wahid, I., Breman, R. B., Callaghan‐Koru, J. A., Implementation Science for Maternal Health National Working Group, Allyse, M. A., Bennet, I., Bingham, D., Blackman, K. C. A., et al. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00461-z · Cited by 20
Making implementation science more efficient: capitalizing on opportunities beyond the field
Wensing, M., & Wilson, P. M. (2023) · Implementation Science · doi:10.1186/s13012-023-01298-9 · Cited by 22
Self-citationHoyer, E. H., Friedman, M. A., Lavezza, A., Flanagan, E., Kumble, S., D'Alessandro, M., Gutierrez, M., Colantuoni, E., Brotman, D. J., & Young, D. L. (2022) · Applied Nursing Research · doi:10.1016/j.apnr.2022.151655 · Cited by 15
Weight, C., Laritz, R., Collins, S. E., Mooney, M., Vinette, B., Castiglione, S. A., Straiton, N., Chicoine, G., Liang, S., Presseau, J., et al. (2025) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaf043 · Cited by 9
Metadata
- Authors
- Wensing, M.
- Affiliations
- University Hospital Heidelberg (DE)
- Corresponding author
- Wensing, Michel
- ORCID
- Wensing, Michel
- Venue
- Implementation Research and Practice
- Publisher
- SAGE Publications
- Published
- 2021-01
- Volume
- 2
- Pages
- 26334895211020125-26334895211020125
- ISSN
- 2633-4895 (ISSN-L)
- PMC
- PMC9978632
- OpenAlex
- W3168261046
- Cited by
- 14
- References
- 9
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 3 · 2022: 2
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Implementation Research and Practice (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- implementation research, measurement validation, psychometrics, measurement development, cross-cultural adaptation, measurement quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reflections on the measurement of implementation constructs. https://app.cochat.ai/papers/10.1177/26334895211020125
- The paper
- Wensing, M. (2021). Reflections on the measurement of implementation constructs. Implementation Research and Practice. https://doi.org/10.1177/26334895211020125
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.