CoChat

Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties

Open access

The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.

Abstract

Background: Identification of psychometrically strong implementation measures could (1) advance researchers’ understanding of how individual characteristics impact implementation processes and outcomes, and (2) promote the success of real-world implementation efforts. The current study advances the work that our team published in 2015 by providing an updated and enhanced systematic review that identifies and evaluates the psychometric properties of implementation measures that assess individual characteristics. Methods: A full description of our systematic review methodology, which included three phases, is described in a previously published protocol paper. Phase I focused on data collection and involved search string generation, title and abstract screening, full-text review, construct assignment, and measure forward searches. During Phase II, we completed data extraction (i.e., coding psychometric information). Phase III involved data analysis, where two trained specialists independently rated each measurement tool using our psychometric rating criteria. Results: Our team identified 124 measures of individual characteristics used in mental or behavioral health research, and 123 of those measures were deemed suitable for rating using Psychometric and Pragmatic Evidence Rating Scale. We identified measures of knowledge and beliefs about the intervention ( n = 76), self-efficacy ( n = 24), individual stage of change ( n = 2), individual identification with organization ( n = 7), and other personal attributes ( n = 15). While psychometric information was unavailable and/or unreported for many measures, information about internal consistency and norms were the most commonly identified psychometric data across all individual characteristics’ constructs. Ratings for all psychometric properties predominantly ranged from “poor” to “good.” Conclusion: The majority of research that develops, uses, or examines implementation measures that evaluate individual characteristics does not include the psychometric properties of those measures. The development and use of psychometric reporting standards could advance the use of valid and reliable tools within implementation research and practice, thereby enhancing the successful implementation and sustainment of evidence-based practice in community care. Plain Language Summary: Measurement is the foundation for advancing practice in health care and other industries. In the field of implementation science, the state of measurement is only recently being targeted as an area for improvement, given that high-quality measures need to be identified and utilized in implementation work to avoid developing another research to practice gap. For the current study, we utilized the Consolidated Framework for Implementation Research to identify measures related to individual characteristics’ constructs, such as knowledge and beliefs about the intervention, self-efficacy, individual identification with the organization, individual stage of change, and other personal attributes. Our review showed that many measures exist for certain constructs (e.g., measures related to assessing providers’ attitudes and perceptions about evidence-based practice interventions), while others have very few (e.g., an individual’s stage of change). Also, we rated measures for their psychometric strength utilizing an anchored rating system and found that most measures assessing individual characteristics are in need of more research to establish their evidence of quality. It was also clear from our results that frequency of use/citations does not equate to high quality, psychometric strength. Ultimately, the state of the literature has demonstrated that assessing individual characteristics of implementation stakeholders is an area of strong interest in implementation work. It will be important for future research to focus on clearly delineating the psychometric properties of existing measures for saturated constructs, while for the others the emphasis should be on developing new, high-quality measures and make these available to stakeholders.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/26334895211000458

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Knowledge and beliefs about the intervention.
Figure 1. Knowledge and beliefs about the intervention.CC BY-NC · PubMed Central
Figure 2. Self-efficacy.
Figure 2. Self-efficacy.CC BY-NC · PubMed Central
Figure 3. Individual stage of change.
Figure 3. Individual stage of change.CC BY-NC · PubMed Central
Figure 4. Individual identification with the organization.
Figure 4. Individual identification with the organization.CC BY-NC · PubMed Central
Figure 5. Other personal attributes.
Figure 5. Other personal attributes.CC BY-NC · PubMed Central
Figure 6. Knowledge and beliefs about the intervention.
Figure 6. Knowledge and beliefs about the intervention.CC BY-NC · PubMed Central
Figure 7. Self-efficacy.
Figure 7. Self-efficacy.CC BY-NC · PubMed Central
Figure 8. Individual stage of change.
Figure 8. Individual stage of change.CC BY-NC · PubMed Central
Figure 9. Individual identification with the organization.
Figure 9. Individual identification with the organization.CC BY-NC · PubMed Central
Figure 10. Other personal attributes.
Figure 10. Other personal attributes.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 36 references

Research works printed but not linked: 1

  1. Halko H. M., 2017, Stakeholder perspectives and use of implementation science measurement tools

Cited by

See all 18

Metadata

Authors
Stanick, C., Halko, H., Mettert, K., Dorsey, C., Moullin, J., Weiner, B., Powell, B., & Lewis, C. C.
Affiliations
  • Hathaway-Sycamores Child and Family Services, Pasadena, CA, USA
  • Judge Baker Children's Center (US)
  • Kaiser Permanente Washington Health Research Institute (US)
  • Curtin University (AU)
  • University of Washington (US)
  • Washington University in St. Louis (US)
Corresponding author
Stanick, Cameo
Venue
Implementation Research and Practice
Published
2021-01
Volume
2
Pages
26334895211000458-26334895211000458
ISSN
2633-4895 (ISSN-L)
OpenAlex
W3136682254
Cited by
11
References
36
Citations by year
2026: 2 · 2025: 4 · 2023: 2 · 2022: 3
FWCI
0.26
Type
journal article
Language
en
Open access
Locations
  • Implementation Research and Practice (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Institute of Mental Health
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Health Sciences › Nursing › Research and Theory › Health Education and Validation
Keywords
implementation measures, individual characteristics, psychometric properties, self-efficacy, stages of change, mental health services, behavioral health services, implementation research, Consolidated Framework for Implementation Research, provider attitudes, measurement quality, research-practice gap

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties. https://app.cochat.ai/papers/10.1177/26334895211000458
The paper
Stanick, C., Halko, H., Mettert, K., Dorsey, C., Moullin, J., Weiner, B., Powell, B., & Lewis, C. C. (2021). Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties. Implementation Research and Practice. https://doi.org/10.1177/26334895211000458

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.