Criterion‐Related Validity of Dutch Police‐Selection Measures and Differences Between Ethnic Groups
Open accessAbstract
This study investigated the criterion‐related validity of cognitive ability as well as non‐cognitive ability measures and differences between ethnic majority (N=2365) and minority applicants (N=682) in Dutch police officer selection. Findings confirmed the relatively low predictive validity of cognitive ability generally found for police jobs. Previous research reported no differential prediction. The present study, however, found small but systematic evidence for differences in validity for the ethnic majority and minority group of both cognitive and non‐cognitive measures. For the minority group, training performance appeared to be mainly predicted by the cognitive ability test. For the majority group, cognitive ability showed very little predictive power. Non‐cognitive ability variables appeared to be somewhat more predictive in this group.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Other authors have found that CAT performance was less predictive of training performance for Black recruits.
“other authors have found that CAT performance was less predictive of training performance for Black recruits (Carretta & Doub, 1998;De Meijer et al., 2008)”
From Factors Related to Mean Score Group Differences on Cognitive Ability Tests: A Systematic Review (2025) · cites this paper as De Meijer et al., 2008
The Main results (§3.2; page not available) state the opposite direction: the cognitive ability test, especially its verbal subtests, was more predictive of training performance for ethnic minority trainees than for ethnic majority trainees. The Discussion (§4; page not available) reports corrected validities of .14 and .04, respectively. The paper describes Dutch ethnic groups, not a separate finding for Black recruits. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · cited 4× · see citing works
“Many of these studies focused on cognitive ability (or g), which has been found to be a consistently good predictor of job performance across a variety of occupations ( Schmidt & Hunter, 1998, 2004 ).”
BackgroundInfluentialBarrick, M. R., Mount, M. K., & Judge, T. A. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00160 · Cited by 2,356 · cited 6× · see citing works
“First, with regard to the personality questionnaire, it is expected ‐ in line with the results of a meta-analysis by Barrick et al. (2001) ‐ that only the Big Five factor Conscientiousness will have a comparable predictive power to the cognitive ability test (Hypothesis 1a).”
BackgroundMethodResultInfluentialKanfer, R., & Ackerman, P. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.4.657 · Cited by 2,177 · cited 1× · see citing works
“Both Kanfer and Ackerman (1989), and Salas and Cannon-Bowers (2001) have shown that cognitive ability also is essential in the training context with respect to workplace learning.”
BackgroundThe science of training: a decade of progress
Salas, E., & Cannon-Bowers, J. A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.471 · Cited by 1,703 · cited 2× · see citing works
“Both Kanfer and Ackerman (1989), and Salas and Cannon-Bowers (2001) have shown that cognitive ability also is essential in the training context with respect to workplace learning.”
BackgroundGeneral Mental Ability in the World of Work: Occupational Attainment and Job Performance.
Schmidt, F. L., & Hunter, J. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.86.1.162 · Cited by 1,238 · cited 4× · see citing works
“Many of these studies focused on cognitive ability (or g), which has been found to be a consistently good predictor of job performance across a variety of occupations ( Schmidt & Hunter, 1998, 2004 ).”
BackgroundInfluentialCognitive ability, cognitive aptitudes, job knowledge, and job performance
Hunter, J. E. (1986) · Journal of Vocational Behavior · doi:10.1016/0001-8791(86)90013-8 · Cited by 1,070 · cited 2× · see citing works
“Many of these studies focused on cognitive ability (or g), which has been found to be a consistently good predictor of job performance across a variety of occupations (Schmidt & Hunter, 1998, 2004). In particular for more complex job levels, the predictive validity of g is high (Hunter, 1986). Both Kanfer and Ackerman…”
BackgroundThe validity of employment interviews: A comprehensive review and meta-analysis.
McDaniel, M. A., Whetzel, D. L., Schmidt, F., & Maurer, S. D. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.4.599 · Cited by 751 · cited 1× · see citing works
“Both the AC and the employment interview have shown to have acceptable predictive validity for (police) job performance as well as (police) training success (Dayan et al., 2002; McDaniel, Whetzel, Schmidt, & Maurer, 1994; Pynes & Bernardin, 1989; Robertson & Smith, 2001).”
BackgroundSackett, P., & Lievens, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093716 · Cited by 684 · see citing works
RECONSIDERING THE USE OF PERSONALITY TESTS IN PERSONNEL SELECTION CONTEXTS
MORGESON, F. P., CAMPION, M. A., DIPBOYE, R. L., HOLLENBECK, J. R., MURPHY, K., & SCHMITT, N. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00089.x · Cited by 638 · see citing works
An alternative selection procedure: The low-fidelity simulation.
Motowidlo, S., Dunnette, M. D., & Carter, G. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.6.640 · Cited by 563 · cited 1× · see citing works
“However, this is a common phenomenon when different items of a certain measure are behaviorally based and do not measure an underlying construct (e.g., Motowidlo, Dunnette, & Carter, 1990 ).”
BackgroundMethodological Artifacts in Moderated Multiple Regression and Their Effects on Statistical Power
Aguinis, H., & Stone-Romero, E. F. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.1.192 · Cited by 388 · cited 2× · see citing works
“One important problem of taking ethnic group membership as part of an interaction term (group membership then becomes a moderator) into a regression equation, is that group sizes should be about the same in order to have adequate statistical power (Aguinis & Stone-Romero, 1997).”
BackgroundSalgado, J., Anderson, N., Moscoso, S., Bertua, C., Fruyt, F. D., & Rolland, J. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.6.1068 · Cited by 328 · cited 8× · see citing works
“However, Salgado et al. (2003) reported much lower (corrected) predictive power for cognitive ability tests in police occupations, namely .24.”
BackgroundMethodResultInfluentialPREDICTING TRAINING SUCCESS: NOT MUCH MORE THAN g
Ree, M., & Earles, J. (2006) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00961.x · Cited by 307 · cited 1× · see citing works
“Other researchers have reported a strong effect of g in several large-scale studies in military settings on training performance (Olea & Ree, 1994; Ree, Carretta, & Teachout, 1995; Ree & Earles, 1991).”
BackgroundMorgeson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J., Murphy, K. R., & Schmitt, N. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00100.x · Cited by 296 · see citing works
The Five-Factor Model of Personality
Lodhi, P. H., Deo, S., & Belhekar, V. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0763-5_11 · Cited by 261 · see citing works
Murphy, K. R. (2005) · Human Performance · doi:10.1207/s15327043hup1804_2 · Cited by 184 · cited 8× · see citing works
“Murphy and Dzieweczynski (2005) discuss three reasons why the Big Five dimensions of personality seem to have little to do with performance in most jobs.”
BackgroundInfluentialEthnic group differences in measures of job performance: a new meta-analysis.
Roth, P. L., Huffcutt, A. I., & Bobko, P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.4.694 · Cited by 171 · see citing works
Predicting pilot and navigator criteria : not much more than g
Olea, M. M., & Ree, M. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.6.845 · Cited by 168 · cited 2× · see citing works
“Other researchers have reported a strong effect of g in several large-scale studies in military settings on training performance ( Olea & Ree, 1994; Ree, Carretta, & Teachout, 1995; Ree & Earles, 1991).”
BackgroundTHE “BIG FIVE” PERSONALITY FACTORS IN THE IPI AND MMPI: PREDICTORS OF POLICE PERFORMANCE
Cortina, J. M., Doherty, M. L., Kaufman, G., & Smith, R. G. (1992) · Personnel Psychology · doi:10.1111/j.1744-6570.1992.tb00847.x · Cited by 168 · cited 7× · see citing works
“Cortina et al. (1992) found similar results.”
BackgroundResultInfluentialRole of ability and prior knowledge in complex training performance.
Ree, M., Carretta, T., & Teachout, M. S. (1995) · Journal of Applied Psychology · doi:10.1037/0021-9010.80.6.721 · Cited by 157 · cited 1× · see citing works
“Other researchers have reported a strong effect of g in several large-scale studies in military settings on training performance (Olea & Ree, 1994; Ree, Carretta, & Teachout, 1995; Ree & Earles, 1991).”
BackgroundDifferential validity of employment tests by race: A comprehensive review and analysis.
Hunter, J. E., Schmidt, F., & Hunter, R. F. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.4.721 · Cited by 150 · cited 1× · see citing works
“Most research in this area has been conduced in North America (e.g., Hunter, Schmidt, & Hunter, 1979; Rotundo & Sackett, 1999) and has used cognitive ability tests as predictors.”
MethodRace effects in performance evaluations: Controlling for ability, education, and experience.
Waldman, D., & Avolio, B. (1991) · Journal of Applied Psychology · doi:10.1037/0021-9010.76.6.897 · Cited by 106 · cited 2× · see citing works
“Yet, evidence has been found that differences between the ethnic majority and the ethnic minority group in cognitive ability test scores are considerably larger than the differences in measures of job performance (e.g., Roth, Huffcutt, & Bobko, 2003; Waldman & Avolio, 1991).”
BackgroundVALIDITY GENERALIZATION RESULTS FOR LAW ENFORCEMENT OCCUPATIONS
Hirsh, H., Northrop, L., & Schmidt, F. (1986) · Personnel Psychology · doi:10.1111/j.1744-6570.1986.tb00589.x · Cited by 88 · cited 5× · see citing works
“One possible explanation for the relatively low validities of cognitive ability tests lies in the potential role of non-cognitive factors in the determination of performance in police work as stated by, e.g., Hirsh et al. (1986).”
BackgroundInfluentialCorrecting the Effect Size of d for Range Restriction and Unreliability
Bobko, P., Roth, P. L., & Bobko, C. (2001) · Organizational Research Methods · doi:10.1177/109442810141003 · Cited by 84 · cited 1× · see citing works
“Only the correlations corrected for direct range restriction and attenuation (for the formulae see Bobko, Roth, & Bobko, 2001 ) are shown (for the uncorrected correlations, the first author may be contacted).”
MethodHattrup, K., Rock, J., & Scalia, C. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.5.656 · Cited by 80 · cited 1× · see citing works
“Although cognitive ability is likely to be correlated with performance in virtually any job or training, in part because all jobs and trainings for these jobs call for some learning, judgment, and active information processing (Murphy, 2002), Hirsh et al. (1986) argued that noncognitive, behavioral, dimensions, such a…”
BackgroundThe Role of Cognitive Ability Tests in Employment Selection
Outtz, J. L. (2002) · Human Performance · doi:10.1080/08959285.2002.9668089 · Cited by 69 · cited 1× · see citing works
“At the same time, several studies (e.g., Goldstein, Zedeck, & Goldstein, 2002; Murphy, 2002; Outtz, 2002) have shown that cognitive ability tests represent the predictor that most likely will have substantial adverse impact on employment opportunities for most ethnic minority groups.”
BackgroundENTRY‐LEVEL POLICE CANDIDATE ASSESSMENT CENTER: AN EFFICIENT TOOL OR A HAMMER TO KILL A FLY?
Dayan, K., Kasten, R., & Fox, S. (2002) · doi:10.1111/j.1744-6570.2002.tb00131.x · Cited by 63 · cited 6×
“In support of this explanation, Dayan et al. (2002) reported that over 50% of the calls to police departments are about dealing with emotional situations, dealing with threatening and violent people, and settling family disputes. In addition, they found that for police performance, cognitive and non-cognitive factors…”
BackgroundInfluentialGoldstein, H. W., Zedeck, S., & Goldstein, I. (2002) · Human Performance · doi:10.1080/08959285.2002.9668087 · Cited by 50 · see citing works
Effect of rater race on conclusions regarding differential prediction in cognitive ability tests.
Rotundo, M., & Sackett, P. R. (1999) · Journal of Applied Psychology · doi:10.1037/0021-9010.84.5.815 · Cited by 45 · cited 2× · see citing works
“Most research in this area has been conduced in North America (e.g., Hunter, Schmidt, & Hunter, 1979; Rotundo & Sackett, 1999 ) and has used cognitive ability tests as predictors.”
MethodCan Conflicting Perspectives on the Role of g in Personnel Selection Be Resolved?
Murphy, K. R. (2002) · Human Performance · doi:10.1080/08959285.2002.9668090 · Cited by 32 · cited 5× · see citing works
“…any job or training, in part because all jobs and trainings for these jobs call for some learning, judgment, and active information processing (Murphy, 2002), Hirsh et al. (1986) argued that noncognitive, behavioral, dimensions, such as interpersonal skills, play a major role in the…”
BackgroundInfluentialPredictive Validity of an Entry-Level Police Officer Assessment Center
Pynes, J. E., & Bernardin, H. J. (1989) · doi:10.1037/0021-9010.74.5.831 · Cited by 24 · cited 4×
“Both the AC and the employment interview have shown to have acceptable predictive validity for (police) job performance as well as (police) training success (Dayan et al., 2002; McDaniel, Whetzel, Schmidt, & Maurer, 1994; Pynes & Bernardin, 1989; Robertson & Smith, 2001).”
BackgroundInfluentialde Meijer, L. A. L., Born, M., Terlouw, G., & van der Molen, H. (2006) · Human Performance · doi:10.1207/s15327043hup1903_3 · Cited by 23 · cited 3× · see citing works
“In support of this explanation, Dayan et al. (2002) reported that over 50% of the calls to police departments are about dealing with emotional situations, dealing with threatening and violent people, and settling family disputes.”
BackgroundInfluentialSelf-citationTe Nijenhuis, J., & Van Der Flier, H. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00133 · Cited by 22 · see citing works
de Meijer, L. A. L., Born, M., van Zielst, J., & van der Molen, H. (2007) · doi:10.1111/j.1468-2389.2007.00376.x · Cited by 18
Self-citationReeder, F. (2001) · Human Language Technology - The Baltic Perspectiv · doi:10.3115/1072133.1072194 · Cited by 11
Babcock, K. (2000) · doi:10.4212/cjhp.v53i2.720 · Cited by 2
Flagged first, then by citations
6 of the 42 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Cascio, W.F. and Aguinis, H. (2005) Applied Psychology in Human Resource Management (6th edn). Upper Saddle River, NJ: Prentice Hall.
- Van der Maesen, P.E.A.M. (1992). Het Rendement van Perso- neelsselectie. [The Efficiency of Personnel Selection]. Unpub- lished doctoral dissertation, Rijksuniversiteit Groningen.
Cited by
Sorted by citations
de Soete, B., Lievens, F., Oostrom, J., & Westerveld, L. (2013) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12034 · Cited by 20 · see citing works
Immigrant Groups, Vocational Training, and Employment.
Kvist, A. (2012) · European journal of training and development · doi:10.1108/03090591211263530 · Cited by 14 · see citing works
“While still much work needs to be done in relation to construct validity, a widely accepted position is that predictive validity is the same, or practically the same, for different cultural groups in Europe (e.g. Nijenhuis and Flier, 1997; Salgado et al., 2003; Meijer et al., 2008).”
BackgroundMielke, I., Breil, S. M., Amelung, D., Espe, L., & Knorr, M. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03305-x · Cited by 13 · see citing works
Soete, B. D., Lievens, F., & Druart, C. (2013) · Journal of Work and Organizational Psychology · doi:10.5093/tr2013a2 · Cited by 11 · see citing works
Validación de Procedimientos de Selección de Policías Locales
Saldaña, A. (2011) · doi:10.5093/jr2011v21a8 · Cited by 8
Selection of chairs of primary care trusts: evidence of reliability and validity.
Alban‐Metcalfe, J., Alimo‐Metcalfe, B., & Hughes, M. (2010) · Journal of health organization and management · doi:10.1108/14777261011029570 · Cited by 3 · see citing works
The predictive validity of cognitive ability and personality tests toward police on-the-job training
Skoglund, T. (2024) · International Journal of Police Science & Management · doi:10.1177/14613557241228726 · Cited by 1 · see citing works
“Findings concerning Shapes were in line with the results obtained by de Meijer et al. (2008), who did not fi nd signi fi - cant personality test predictions.”
BackgroundResultSaldaña, A. (2011) · doi:10.5093/tr2011v27n3a1 · Cited by 1
“Las medidas de formación que utilizamos en este trabajo difieren considerablemente de las utilizadas por Meijer et al (2008).”
BackgroundResultInfluentialFactors Related to Mean Score Group Differences on Cognitive Ability Tests: A Systematic Review
Cuppello, S., Zibarras, L. D., & Corr, P. J. (2025) · Trends in Psychology · doi:10.1007/s43076-025-00504-5
- Authors
- De Meijer, L. A. L., Born, M. P., Terlouw, G., & Van Der Molen, H. T.
- Affiliations
- Erasmus University Rotterdam (NL)
- Politieacademie (NL)
- ORCID
- Born, Marise Ph.
- Venue
- International Journal of Selection and Assessment
- Publisher
- Wiley
- Published
- 2008-11-20
- Volume
- 16
- Issue
- 4
- Pages
- 321-332
- ISSN
- 0965-075X (ISSN-L)
- 1468-2389
- OpenAlex
- W2145697467
- Cited by
- 18
- References
- 42
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2022: 3 · 2018: 1 · 2013: 4 · 2012: 2
- FWCI
- 2.27
- Type
- journal article
- Language
- en
- Open access
- green
- pure.eur.nl
- Licence
- public-domain
- onlinelibrary.wiley.com/termsAndConditions#vor (vor)
- Locations
- International Journal of Selection and Assessment (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, public-domain)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Employer Branding and e-HRM
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Keywords
- police selection, criterion validity, predictive validity, cognitive ability tests, training performance, Dutch police
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review