Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Background: Identification of psychometrically strong implementation measures could (1) advance researchers’ understanding of how individual characteristics impact implementation processes and outcomes, and (2) promote the success of real-world implementation efforts. The current study advances the work that our team published in 2015 by providing an updated and enhanced systematic review that identifies and evaluates the psychometric properties of implementation measures that assess individual characteristics. Methods: A full description of our systematic review methodology, which included three phases, is described in a previously published protocol paper. Phase I focused on data collection and involved search string generation, title and abstract screening, full-text review, construct assignment, and measure forward searches. During Phase II, we completed data extraction (i.e., coding psychometric information). Phase III involved data analysis, where two trained specialists independently rated each measurement tool using our psychometric rating criteria. Results: Our team identified 124 measures of individual characteristics used in mental or behavioral health research, and 123 of those measures were deemed suitable for rating using Psychometric and Pragmatic Evidence Rating Scale. We identified measures of knowledge and beliefs about the intervention ( n = 76), self-efficacy ( n = 24), individual stage of change ( n = 2), individual identification with organization ( n = 7), and other personal attributes ( n = 15). While psychometric information was unavailable and/or unreported for many measures, information about internal consistency and norms were the most commonly identified psychometric data across all individual characteristics’ constructs. Ratings for all psychometric properties predominantly ranged from “poor” to “good.” Conclusion: The majority of research that develops, uses, or examines implementation measures that evaluate individual characteristics does not include the psychometric properties of those measures. The development and use of psychometric reporting standards could advance the use of valid and reliable tools within implementation research and practice, thereby enhancing the successful implementation and sustainment of evidence-based practice in community care. Plain Language Summary: Measurement is the foundation for advancing practice in health care and other industries. In the field of implementation science, the state of measurement is only recently being targeted as an area for improvement, given that high-quality measures need to be identified and utilized in implementation work to avoid developing another research to practice gap. For the current study, we utilized the Consolidated Framework for Implementation Research to identify measures related to individual characteristics’ constructs, such as knowledge and beliefs about the intervention, self-efficacy, individual identification with the organization, individual stage of change, and other personal attributes. Our review showed that many measures exist for certain constructs (e.g., measures related to assessing providers’ attitudes and perceptions about evidence-based practice interventions), while others have very few (e.g., an individual’s stage of change). Also, we rated measures for their psychometric strength utilizing an anchored rating system and found that most measures assessing individual characteristics are in need of more research to establish their evidence of quality. It was also clear from our results that frequency of use/citations does not equate to high quality, psychometric strength. Ultimately, the state of the literature has demonstrated that assessing individual characteristics of implementation stakeholders is an area of strong interest in implementation work. It will be important for future research to focus on clearly delineating the psychometric properties of existing measures for saturated constructs, while for the others the emphasis should be on developing new, high-quality measures and make these available to stakeholders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Systematic reviews of implementation context measures have been conducted, all of which have found significant gaps and signal the continued need for measure validation and development [89–95].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [94]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
(1991) · Cited by 15,554
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 8×
“Trained research specialists (CD, KM) then completed the fourth step in which they used a consensus coding approach to assigned included measures to one or more of the five CFIR constructs (Bradley et al., 2007; Damschroder et al., 2009).”
BackgroundMethodInfluentialMichie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
Development of the Job Diagnostic Survey.
Hackman, J. R., & Oldham, G. R. (1975) · Journal of Applied Psychology · doi:10.1037/h0076546 · Cited by 7,246
Stanton, B. F., & Rogers, E. M. (1963) · Journal of Farm Economics · doi:10.2307/1235767 · Cited by 6,675
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory
Bradley, E. H., Curry, L. A., & Devers, K. J. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00684.x · Cited by 3,437 · cited 2×
“approach to assigned included measures to one or more of the five CFIR constructs (Bradley et al., 2007; Damschroder et al., 2009).”
BackgroundMethodAdvancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 1×
“…articles contained in each measure packet; number of scales; number of items; setting in which measure had been used; level of analysis; target problem; and stage of implementation as defined by the Exploration, Adoption/ Preparation, Implementation, Sustainment (EPIS) model [Aarons et al., 2011]).”
MethodAssessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863 · cited 1×
“However, it was most notable that the measure is widely used in the implementation science literature (cited 68 + times) and yet psychometric ratings have not improved substantially with repeated use (Lehman et al., 2002).”
Background
Research works printed but not linked: 1
- Halko H. M., 2017, Stakeholder perspectives and use of implementation science measurement tools
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Pilar, M. R., Jost, E., Walsh‐Bailey, C., Powell, B. J., Mazzucca, S., Eyler, A. A., Purtle, J., Allen, P. M., & Brownson, R. C. (2022) · Implementation Research and Practice · doi:10.1177/26334895221141116 · Cited by 29
Self-citationTerminology for Dissemination and Implementation Research
Rabin, B. A., Viglione, C., & Brownson, R. C. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0002 · Cited by 16
Charting the path to excellence: A review of research competencies in university students
Tapullima-Mori, C., Tomanguillo, S. L. P., Tomanguillo, N. D. P. P., Sánchez, M. V., & Soria, J. J. (2025) · Journal of Technology and Science Education · doi:10.3926/jotse.2729 · Cited by 15
McLoughlin, G. M., Walsh‐Bailey, C., Singleton, C. R., & Turner, L. R. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.984130 · Cited by 12
Metadata
- Authors
- Stanick, C., Halko, H., Mettert, K., Dorsey, C., Moullin, J., Weiner, B., Powell, B., & Lewis, C. C.
- Affiliations
- Hathaway-Sycamores Child and Family Services, Pasadena, CA, USA
- Judge Baker Children's Center (US)
- Kaiser Permanente Washington Health Research Institute (US)
- Curtin University (AU)
- University of Washington (US)
- Washington University in St. Louis (US)
- Corresponding author
- Stanick, Cameo
- ORCID
- Venue
- Implementation Research and Practice
- Publisher
- SAGE Publications
- Published
- 2021-01
- Volume
- 2
- Pages
- 26334895211000458-26334895211000458
- ISSN
- 2633-4895 (ISSN-L)
- PMC
- PMC9978649
- OpenAlex
- W3136682254
- Cited by
- 11
- References
- 36
- Citations by year
- 2026: 2 · 2025: 4 · 2023: 2 · 2022: 3
- FWCI
- 0.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Research and Practice (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute of Mental Health
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- implementation measures, individual characteristics, psychometric properties, self-efficacy, stages of change, mental health services, behavioral health services, implementation research, Consolidated Framework for Implementation Research, provider attitudes, measurement quality, research-practice gap
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties. https://app.cochat.ai/papers/10.1177/26334895211000458
- The paper
- Stanick, C., Halko, H., Mettert, K., Dorsey, C., Moullin, J., Weiner, B., Powell, B., & Lewis, C. C. (2021). Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties. Implementation Research and Practice. https://doi.org/10.1177/26334895211000458
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.