The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Mechanical versus clinical data combination in selection and admissions decisions: A meta-analysis.
Abstract
In employee selection and academic admission decisions, holistic (clinical) data combination methods continue to be relied upon and preferred by practitioners in our field. This meta-analysis examined and compared the relative predictive power of mechanical methods versus holistic methods in predicting multiple work (advancement, supervisory ratings of performance, and training performance) and academic (grade point average) criteria. There was consistent and substantial loss of validity when data were combined holistically-even by experts who are knowledgeable about the jobs and organizations in question-across multiple criteria in work and academic settings. In predicting job performance, the difference between the validity of mechanical and holistic data combination methods translated into an improvement in prediction of more than 50%. Implications for evidence-based practice are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Perception and the Representative Design of Psychological Experiments
Brunswik, E. (1956) · doi:10.1525/9780520350519 · Cited by 2,974
The robust beauty of improper linear models in decision making.
Dawes, R. M. (1979) · American Psychologist · doi:10.1037/0003-066x.34.7.571 · Cited by 1,966
Clinical versus mechanical prediction: a meta-analysis
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.19 · Cited by 1,640
Representative design and probabilistic theory in a functional psychology.
Brunswik, E. (1955) · Psychological Review · doi:10.1037/h0047470 · Cited by 1,561
Managerial Behavior, Performance, and Effectiveness.
Miljus, R. C., Campbell, J. P., Dunnette, M. D., Lawler, E. E., & Weick, K. E. (1971) · Industrial and Labor Relations Review · doi:10.2307/2521540 · Cited by 1,507
Grove, W. M., & Meehl, P. E. (1996) · Psychology, Public Policy, and Law · doi:10.1037/1076-8971.2.2.293 · Cited by 1,457
Goldberg, L. R. (1970) · Psychological Bulletin · doi:10.1037/h0029230 · Cited by 617
Measurement and prediction, clinical and statistical.
Sawyer, J. (1966) · Psychological Bulletin · doi:10.1037/h0023624 · Cited by 594
A case study of graduate admissions: Application of three principles of human decision making.
Dawes, R. M. (1971) · American Psychologist · doi:10.1037/h0030868 · Cited by 572
Stubborn Reliance on Intuition and Subjectivity in Employee Selection
Highhouse, S. (2008) · Industrial and Organizational Psychology · doi:10.1111/j.1754-9434.2008.00058.x · Cited by 498
Taylor, H. C., & Russell, J. T. (1939) · Journal of Applied Psychology · doi:10.1037/h0057079 · Cited by 491
Unbiased Estimation of Certain Correlation Coefficients
Olkin, I., & Pratt, J. W. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706717 · Cited by 480
Meta-analysis of assessment center validity.
Gaugler, B. B., Rosenthal, D. B., Thornton, G. C., & Bentson, C. (1987) · Journal of Applied Psychology · doi:10.1037//0021-9010.72.3.493 · Cited by 478
More Progress Toward a Taxonomy of Managerial Performance Requirements
Borman, W. C., & Brush, D. H. (1993) · Human Performance · doi:10.1207/s15327043hup0601_1 · Cited by 381
Determinants of linear judgment: A meta-analysis of lens model studies.
Karelaia, N., & Hogarth, R. M. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.3.404 · Cited by 352
A META‐ANALYSIS OF THE CRITERION‐RELATED VALIDITY OF ASSESSMENT CENTER DIMENSIONS
ARTHUR, W., DAY, E. A., MCNELLY, T. L., & EDENS, P. S. (2003) · Personnel Psychology · doi:10.1111/j.1744-6570.2003.tb00146.x · Cited by 347
A New Formula for Predicting the Shrinkage of the Coefficient of Multiple Correlation
Wherry, R. J. (1931) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732951 · Cited by 276
Estimating R2Shrinkage in Multiple Regression: A Comparison of Different Analytical Methods
Yin, P., & Fan, X. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109600656 · Cited by 165
A Contribution to the Study of Actuarial and Individual Methods of Prediction
Sarbin, T. R. (1943) · American Journal of Sociology · doi:10.1086/219248 · Cited by 114
PREDICTIVE VALIDITY OF A LINEAR REGRESSION EQUATION
Browne, M. W. (1975) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1975.tb00550.x · Cited by 109
Estimation of the predictive power of a regression model.
Cattin, P. C. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.4.407 · Cited by 105
A SURVEY OF INDIVIDUAL ASSESSMENT PRACTICES BY I/O PSYCHOLOGISTS
Ryan, A. M., & Sackett, P. R. (1987) · Personnel Psychology · doi:10.1111/j.1744-6570.1987.tb00610.x · Cited by 101
Validity of behavioral assessment for predicting military recruiter performance.
Borman, W. C. (1982) · Journal of Applied Psychology · doi:10.1037//0021-9010.67.1.3 · Cited by 95
Man versus model of man revisited: The forecasting of graduate school success.
Wiggins, N., & Kolen, E. S. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0031147 · Cited by 81
Shieh, G. (2007) · Organizational Research Methods · doi:10.1177/1094428106292901 · Cited by 70
Relationship of the components of an assessment center to management success.
Wollowick, H. B., & McNamara, W. J. (1969) · Journal of Applied Psychology · doi:10.1037/h0028102 · Cited by 69
Assessment center validity: A longitudinal study.
Mitchel, J. O. (1975) · Journal of Applied Psychology · doi:10.1037/0021-9010.60.5.573 · Cited by 59
Raju, N. S., Bilgiç, R., EDWARDS, J. E., & Fleer, P. F. (1999) · Applied Psychological Measurement · doi:10.1177/01466219922031220 · Cited by 51
Estimation of cross-validated multiple correlation: A clarification.
Rozeboom, W. W. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.6.1348 · Cited by 49
Validity of an assessment center for identifying future female officers in the military.
Tziner, A. E., & Dolan, S. L. (1982) · Journal of Applied Psychology · doi:10.1037//0021-9010.67.6.728 · Cited by 47
Multiple Regression and Validity Estimation in One Sample
Claudy, J. G. (1978) · Applied Psychological Measurement · doi:10.1177/014662167800200414 · Cited by 45
Mendoza, J. L., & Stafford, K. L. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971419 · Cited by 43
Some New (and Old) Suggestions for Improving Personnel Selection
Kuncel, N. R. (2008) · Industrial and Organizational Psychology · doi:10.1111/j.1754-9434.2008.00059.x · Cited by 40
Self-citationPREDICTING SUCCESS IN GRADUATE STUDY.
Robertson, M. H., & HALL, E. (1964) · PubMed · Cited by 17
Confidence intervals for the cross-validated multiple correlation in predictive regression models.
Fowler, R. L. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.2.318 · Cited by 14
Clinical and actuarial predictions of academic survival and attrition.
Truesdell, A. B., & Bath, J. A. (1957) · Journal of Counseling Psychology · doi:10.1037/h0044494 · Cited by 10
Counselor vs. statistical predictions of job satisfaction in engineering.
Lewis, E. C., & MacKinney, A. C. (1961) · Journal of Counseling Psychology · doi:10.1037/h0043207 · Cited by 10
Highhouse, S. (2008) · Industrial and Organizational Psychology · doi:10.1111/j.1754-9434.2008.00069.x · Cited by 7
Cited by
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Newman, D. T., Fast, N. J., & Harmon, D. J. (2020) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.03.008 · Cited by 550
Köchling, A., & Wehner, M. C. (2020) · Business Research · doi:10.1007/s40685-020-00134-w · Cited by 511
Kim, J., Giroux, M., & Lee, J. C. (2021) · Psychology & Marketing · doi:10.1002/mar.21498 · Cited by 353
Langer, M., & Landers, R. N. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106878 · Cited by 338
Metadata
- Authors
- Kuncel, N. R., Klieger, D. M., Connelly, B. S., & Ones, D. S.
- Venue
- Journal of Applied Psychology
- Published
- 2013
- Volume
- 98
- Issue
- 6
- Pages
- 1060-1072
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W1989277811
- Cited by
- 261
- References
- 39
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.