The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice.
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The authors highlight the importance and discuss the criticality of distinguishing between constructs and methods when comparing predictors. They note that comparisons of constructs and methods in comparative evaluations of predictors result in outcomes that are theoretically to conceptually uninterpretable and thus potentially misleading. The theoretical and practical implications of the distinction between predictor constructs and predictor methods are discussed, with three important streams of personnel psychology research being used to frame this discussion. Researchers, editors, reviewers, educators, and consumers of research are urged to carefully consider the extent to which the construct-method distinction is made and maintained in their own research and that of others, especially when predictors are being compared. It is hoped that this discussion will reorient researchers and practitioners toward a more construct-oriented approach that is aligned with a scientific emphasis in personnel selection research and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · cited 2×
“A second, more applied critique of the construct–method distinction is that the confound (i.e., the failure to disaggregate predictor constructs and predictor methods) is not a concern, because this is the way personnel measures are conceptualized and used in the field (Schmidt & Hunter, 1998).”
Applicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.00003.x · Cited by 816
Personality measurement and employment decisions: Questions and answers.
Hogan, R., Hogan, J., & Roberts, B. W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.5.469 · Cited by 572
Subgroup Differences in Situational Judgment Test Performance: A Meta-Analysis
Whetzel, D. L., McDaniel, M. A., & Nguyen, N. T. (2008) · Human Performance · doi:10.1080/08959280802137820 · Cited by 183
Cited by
Emotional intelligence: An integrative meta-analysis and cascading model
Joseph, D. L., & Newman, D. A. (2010) · Journal of Applied Psychology · doi:10.1037/a0017286 · Cited by 1,722
A Meta-Analysis of Different Forms of Shared Leadership–Team Performance Relations
D’Innocenzo, L., Mathieu, J. E., & Kukenberger, M. R. (2016) · Journal of Management · doi:10.1177/0149206314525205 · Cited by 590
The Structured Employment Interview: Narrative and Quantitative Review of the Research Literature
Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014) · Personnel Psychology · doi:10.1111/peps.12052 · Cited by 480
Joseph, D. L., Jin, J., Newman, D. A., & O'Boyle, E. H. (2015) · Journal of Applied Psychology · doi:10.1037/a0037681 · Cited by 461
The Writing on the (Facebook) Wall: The Use of Social Networking Sites in Hiring Decisions
Brown, V. R., & Vaughn, E. D. (2011) · Journal of Business and Psychology · doi:10.1007/s10869-011-9221-x · Cited by 345
CHRISTIAN, M. S., EDWARDS, B. D., & BRADLEY, J. C. (2010) · Personnel Psychology · doi:10.1111/j.1744-6570.2009.01163.x · Cited by 336
Employee compensation: The neglected area of HRM research
Gupta, N., & Shaw, J. D. (2014) · Human Resource Management Review · doi:10.1016/j.hrmr.2013.08.007 · Cited by 303
Principles for the Validation and Use of Personnel Selection Procedures
(2018) · Industrial and Organizational Psychology · doi:10.1017/iop.2018.195 · Cited by 300
The employment interview: A review of current studies and directions for future research
Macan, T. (2009) · Human Resource Management Review · doi:10.1016/j.hrmr.2009.03.006 · Cited by 263
Social Media in Employee-Selection-Related Decisions: A Research Agenda for Uncharted Territory
Roth, P. L., Bobko, P., Van Iddekinge, C. H., & Thatcher, J. B. (2016) · Journal of Management · doi:10.1177/0149206313503018 · Cited by 254
Situational judgment tests: An overview of current research
Whetzel, D. L., & McDaniel, M. A. (2009) · Human Resource Management Review · doi:10.1016/j.hrmr.2009.03.007 · Cited by 207
VAN IDDEKINGE, C. H., & PLOYHART, R. E. (2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00133.x · Cited by 101
Do Agile Managed Information Systems Projects Fail Due to a Lack of Emotional Intelligence?
Luong, T. T., Sivarajah, U., & Weerakkody, V. (2021) · Information Systems Frontiers · doi:10.1007/s10796-019-09962-6 · Cited by 45
“However, researchers should pay attention to distinct between construct and method (Arthur and Villado 2008).”
BackgroundCorrecting Misconceptions About Gamification of Assessment: More Than SJTs and Badges
Armstrong, M. B., Ferrell, J. Z., Collmus, A. B., & Landers, R. N. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2016.69 · Cited by 38
Improving Advisor Systems: Algorithms that Explain Themselves
Neumann, M., & Kuncel, N. R. (2025) · Journal of Business and Psychology · doi:10.1007/s10869-025-10014-x · Cited by 2
Metadata
- Authors
- Arthur, W., & Villado, A. J.
- Venue
- Journal of Applied Psychology
- Published
- 2008
- Volume
- 93
- Issue
- 2
- Pages
- 435-442
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W1966030960
- Cited by
- 233
- References
- 4
- FWCI
- 27.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.