The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures
Abstract
The purpose of this study was to apply a set of rarely reported psychometric indices that, nevertheless, are important to consider when evaluating psychological measures. All can be derived from a standardized loading matrix in a confirmatory bifactor model: omega reliability coefficients, factor determinacy, construct replicability, explained common variance, and percentage of uncontaminated correlations. We calculated these indices and extended the findings of 50 recent bifactor model estimation studies published in psychopathology, personality, and assessment journals. These bifactor derived indices (most not presented in the articles) provided a clearer and more complete picture of the psychometric properties of the assessment instruments. We reached 2 firm conclusions. First, although all measures had been tagged "multidimensional," unit-weighted total scores overwhelmingly reflected variance due to a single latent variable. Second, unit-weighted subscale scores often have ambiguous interpretations because their variance mostly reflects the general, not the specific, trait. Finally, we review the implications of our evaluations and consider the limits of inferences drawn from a bifactor modeling approach.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Omega is a reliability estimate that does not depend on the assumption of tau equivalence unlike its classic counterpart Cronbach’s alpha [39].”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [39]
In the citing paper
“When PUC is greater than .70 and ECV greater than .70 relative bias will be slight and the common variance can be regarded as essentially unidimensional [39].”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [39]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
The Scientific Use of Factor Analysis in Behavioral and Life Sciences
Cattell, R. B. (1978) · doi:10.1007/978-1-4684-2262-7 · Cited by 2,165
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 6×
“…on this equation, it is clear that, as the proportion of variance explained by the general factor increases, ECV will increase, and, as noted by Reise (2012), higher ECV values indicate a strong general factor, which could guide researchers in deciding whether to fit a unidimensional model…”
InfluentialSelf-citationBorsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,733
Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma
Revelle, W., & Zinbarg, R. E. (2008) · Psychometrika · doi:10.1007/s11336-008-9102-z · Cited by 1,652
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439 · cited 1×
“For more details, we refer readers to the original sources as well as to reviews (e.g., McDonald, 1999; Reise, Moore, & Haviland, 2013; Revelle & Zinbarg, 2009; Zinbarg et al., 2005; Zinbarg, Yovel, Revelle, & McDonald, 2006).”
MethodOsman, A., Wong, J. L., Bagge, C. L., Freedenthal, S. L., Gutierrez, P. M., & Lozano, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21908 · Cited by 1,097
Scoring and Modeling Psychological Measures in the Presence of Multidimensionality
Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2012.725437 · Cited by 1,069
Self-citation
Research works printed but not linked: 5
- Gorsuch R. L., 1983, Factor analysis
- *Jonason P. K., 2013, Individual Differences Research, 11, 81
- McDonald R. P., 1999, Test theory: A unified approach
- Reise S. P., 2013, APA Handbook of Testing and Assessment in Psychology
- Stucky B. D., 2014, Handbook of item response theory modeling: Applications to typical performance assessment, 183
Cited by
Sorted by citations
Ferrando, P. J., & Lorenzo‐Seva, U. (2017) · Educational and Psychological Measurement · doi:10.1177/0013164417719308 · Cited by 630
Neff, K. D., Tóth-Király, I., Yarnell, L. M., Arimitsu, K., Castilho, P., Ghorbani, N., Guo, H. X., Hirsch, J. K., Hupfeld, J., Hutz, C. S., et al. (2019) · Psychological Assessment · doi:10.1037/pas0000629 · Cited by 397
Three Concerns With Applying a Bifactor Model as a Structure of Psychopathology
Bonifay, W. E., Lane, S. P., & Reise, S. P. (2016) · Clinical Psychological Science · doi:10.1177/2167702616657069 · Cited by 423
Self-citationZanon, C., Brenner, R. E., Baptista, M. N., Vogel, D. L., Rubin, M., Al-Darmaki, F. R., Gonçalves, M., Heath, P. J., Liao, H.-Y., Mackenzie, C. S., et al. (2020) · Assessment · doi:10.1177/1073191119887449 · Cited by 429
Twenty-five years with the 20-item Toronto Alexithymia Scale
Bagby, R. M., Parker, J. D. A., & Taylor, G. J. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.109940 · Cited by 334
Metadata
- Authors
- Rodriguez, A., Reise, S. P., & Haviland, M. G.
- Affiliations
- University of California, Los Angeles (US)
- Loma Linda University (US)
- Corresponding author
- Reise, Steven P.
- Venue
- Journal of Personality Assessment
- Publisher
- Informa UK Limited
- Published
- 2015-10-29
- Volume
- 98
- Issue
- 3
- Pages
- 223-237
- ISSN
- 0022-3891 (ISSN-L)
- 1532-7752
- OpenAlex
- W1881923603
- Cited by
- 990
- References
- 77
- Citations by year
- 2026: 105 · 2025: 97 · 2024: 104 · 2023: 134 · 2022: 127 · 2021: 124 · 2020: 102 · 2019: 75 · 2018: 59 · 2017: 49 · 2016: 13
- FWCI
- 50.26
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-12-23)
- Open access
- closed
- Locations
- Journal of Personality Assessment (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- bifactor model, multidimensional measure, personality assessment, psychopathology assessment
- MeSH terms
- Factor Analysis, Statistical, Humans, Models, Psychological, Psychometrics, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
