The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
To Aggregate or Not to Aggregate: Steps for Developing and Validating Higher-Order Multidimensional Constructs
Open accessAbstract
The use of higher-order multidimensional constructs (i.e., latent constructs comprised of standalone variables) in the organizational psychology and behavior literatures is becoming commonplace. Despite their advantages (e.g., greater parsimony and bandwidth), the development and validation of such constructs often unfolds in an indiscriminant fashion. It is not surprising, then, that much debate has arisen regarding the viability of many higher-order constructs. In this article, we outline ten recommendations for improving the construct- and criterion-related validity of higher-order constructs. Chief among these recommendations include the need for researchers to specify precise theoretical and empirical inclusion criteria, to rule out alternative explanations for the emergence of a higher-order factor and to assess incremental and relative importance. To illustrate how these recommendations play out, we apply them to core self-evaluation as an example. We believe that higher-order constructs may offer unique insight into work-relevant phenomena, provided they are established via rigorous means.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Validation of the five-factor model of personality across instruments and observers.
McCrae, R. R., & Costa, P. T. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.52.1.81 · Cited by 6,404
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618
Diamantopoulos, A., & Siguaw, J. A. (2006) · British Journal of Management · doi:10.1111/j.1467-8551.2006.00500.x · Cited by 3,410 · cited 1×
“Thus, for aggregate constructs, researchers should identify indicators that tap into unique dimensions of the focal construct and thus are minimally redundant ( Diamantopoulos and Siguaw 2006 ).”
BackgroundHigher-order factors of the Big Five.
Digman, J. M. (1997) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.73.6.1246 · Cited by 1,839
Lack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616
Multidimensional constructs in organizational behavior research: an integrative analytical framework
Edwards, J. R. (2001) · Organizational Research Methods · doi:10.1177/109442810142004 · Cited by 1,128
Relative Importance Analysis: A Useful Supplement to Regression Analysis
Tonidandel, S., & LeBreton, J. M. (2011) · Journal of Business and Psychology · doi:10.1007/s10869-010-9204-3 · Cited by 953
The Fallacy of Formative Measurement
Edwards, J. R. (2011) · Organizational Research Methods · doi:10.1177/1094428110378369 · Cited by 495
Cited by
Servant leadership: Validation of a short form of the SL-28
Liden, R. C., Wayne, S. J., Meuser, J. D., Hu, J., Wu, J., & Liao, C. (2015) · The Leadership Quarterly · doi:10.1016/j.leaqua.2014.12.002 · Cited by 712
Core Self-Evaluations: A Review and Evaluation of the Literature
Chang, C.-H. (., Ferris, D. L., Johnson, R. E., Rosen, C. C., & Tan, J. A. (2012) · Journal of Management · doi:10.1177/0149206311419661 · Cited by 608
Self-citationTechnostress of HR professionals: the darker implication of remote work transformations
Nayak, S., Budhwar, P., & Malik, A. (2025) · The International Journal of Human Resource Management · doi:10.1080/09585192.2024.2446508 · Cited by 16
Metadata
- Authors
- Johnson, R. E., Rosen, C. C., & Chang, C.-H.
- Venue
- Journal of Business and Psychology
- Published
- 2011-07-01
- Volume
- 26
- Issue
- 3
- Pages
- 241-248
- ISSN
- 0889-3268 (ISSN-L)
- 1573-353X
- OpenAlex
- W2067558006
- Cited by
- 159
- References
- 11
- FWCI
- 9.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: To Aggregate or Not to Aggregate: Steps for Developing and Validating Higher-Order Multidimensional Constructs. https://app.cochat.ai/papers/10.1007/s10869-011-9238-1
- The paper
- Johnson, R. E., Rosen, C. C., & Chang, C.-H. (2011). To Aggregate or Not to Aggregate: Steps for Developing and Validating Higher-Order Multidimensional Constructs. Journal of Business and Psychology. https://doi.org/10.1007/s10869-011-9238-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
