Cited by 136Psychometric Methodologies and TestingPsychological Testing and AssessmentEmployer Branding and e-HRM

The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.

Increasing Validity with Forced-Choice Criterion Measurement Formats

Bartram, Dave·2007·International Journal of Selection and Assessment

DOI 10.1111/j.1468-2389.2007.00386.x

Open this paper in CoChat — free account

Abstract

The relative validities of forced‐choice (ipsative) and Likert rating‐scale item formats as criterion measures are examined. While there has been much debate about the relative technical and psychometric merits and demerits of ipsative instruments, the present research focused on the crucial question of whether the use of this format has any practical benefit – in terms of improved validity. An analysis is reported from a meta‐analysis data set. This demonstrates that higher operational validity coefficients (prediction of line‐manager ratings of competencies) are associated with the use of forced‐choice (r=.38) rather than rating scale (r=.25) item formats for the criterion measurement instrument when performance is rated by the same line managers on both formats and where the predictor is held constant. Thus the apparent criterion‐related validity of a predictor can increase by 50% simply by changing the format of the criterion measurement instrument. The implications of this for practice are discussed.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2389.2007.00386.x

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180
Methods of Meta-Analysis
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
The five factor model of personality and job performance in the European Community.
Salgado, J. F. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.1.30 · Cited by 1,582
The Great Eight Competencies: A Criterion-Centric Approach to Validation.
Bartram, D. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.6.1185 · Cited by 745
Self-citation
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567
Comparative analysis of the reliability of job performance ratings.
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.5.557 · Cited by 505
A Meta-Analytic Study of General Mental Ability Validity for Different Occupations in the European Community.
Salgado, J. F., Anderson, N. R., Moscoso, S., Bertua, C., Fruyt, F. D., & Rolland, J. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.6.1068 · Cited by 364
Strengths and limitations of ipsative measurement
Baron, H. (1996) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1996.tb00599.x · Cited by 321
On the Reliability of a Weighted Composite
Mosier, C. I. (1943) · Psychometrika · doi:10.1007/bf02288700 · Cited by 261
Reconsidering forced-choice item formats for applicant personality assessment
Christiansen, N. D., Burns, G. N., & Montgomery, G. E. (2005) · Human Performance · doi:10.1207/s15327043hup1803_4 · Cited by 250

Show all 24 references

Research works printed but not linked: 5

Baron H.(2002). Working with Ipsative Measures.Paper Presented at the 17th Annual Conference of the Society for Industrial and Organizational Psychology April 2002 Toronto Canada.
10.1037/0033-2909.124.2.262 · DOI · Paper page
SHL, 1993, OPQ Concept Model: Manual and user's guide
SHL, 1993, Inventory of Management Competencies: Manual and user's guide
SHL, 1999, OPQ32: Manual and user's guide

Sorted by citations

Translation, Cross-Cultural Adaptation, and Validation of Measurement Instruments: A Practical Guideline for Novice Researchers
Cruchinho, P., López-Franco, M. D., Capelas, M. L., Almeida, S., Bennett, P. M., Miranda da Silva, M., Teixeira, G., Nunes, E., Lucas, P., & Gaspar, F. (2024) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s419714 · Cited by 469
PISA 2012 Technical Report
OECD (2014) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/6341a959-en · Cited by 351
Item Response Modeling of Forced-Choice Questionnaires
Brown, A., & Maydeu‐Olivares, A. (2011) · Educational and Psychological Measurement · doi:10.1177/0013164410375112 · Cited by 333
How IRT can solve problems of ipsative data in forced-choice questionnaires.
Brown, A., & Maydeu‐Olivares, A. (2012) · Psychological Methods · doi:10.1037/a0030641 · Cited by 217
The Five-Factor Model, forced-choice personality inventories and performance: A comprehensive meta-analysis of academic and occupational validity studies
Salgado, J. F., & Táuriz, G. (2014) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2012.716198 · Cited by 205
The validity of ipsative and quasi-ipsative forced-choice personality inventories for different occupational groups: A comprehensive meta-analysis
Salgado, J. F., Anderson, N., & Tauriz, G. (2015) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12098 · Cited by 138
Response Biases
Wetzel, E., Boehnke, J. R., & Brown, A. (2016) · Oxford University Press eBooks · doi:10.1093/med:psych/9780199356942.003.0024 · Cited by 129
The Evolution of Performance Management: Searching for Value
Pulakos, E. D., Mueller-Hanson, R. A., & Arad, S. (2018) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-012218-015009 · Cited by 152
Item Response Models for Forced-Choice Questionnaires: A Common Framework
Brown, A. (2014) · Psychometrika · doi:10.1007/s11336-014-9434-9 · Cited by 110
Students' Perceptions of Teacher Support Across the Transition from Primary to Secondary School
Bru, E., Stornes, T., Munthe, E., & Thuen, E. (2010) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2010.522842 · Cited by 125
Fitting a Thurstonian IRT model to forced-choice data using Mplus
Brown, A., & Maydeu‐Olivares, A. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0217-x · Cited by 101
Adaptive Testing With Multidimensional Pairwise Preference Items
Stark, S. E., Chernyshenko, O. S., Drasgow, F., & White, L. A. (2012) · Organizational Research Methods · doi:10.1177/1094428112444611 · Cited by 93
Comparing Traditional and IRT Scoring of Forced-Choice Tests
Hontangas, P. M., TORRE, J. D. L., Ponsoda, V., Leenen, I., Morillo, D., & Abad, F. J. (2015) · Applied Psychological Measurement · doi:10.1177/0146621615585851 · Cited by 82
CEO Personality: A Different Perspective on the Nonfamily Versus Family CEO Debate
Kelleci, R., Lambrechts, F., Voordeckers, W., & Huybrechts, J. (2018) · Family Business Review · doi:10.1177/0894486518811222 · Cited by 81
Moderator effects of job complexity on the validity of forced-choice personality inventories for predicting job performance
Salgado, J. F. (2017) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.1016/j.rpto.2017.07.001 · Cited by 75
Does multidimensional forced-choice prevent faking? Comparing the susceptibility of the multidimensional forced-choice format and the rating scale format to faking.
Wetzel, E., Frick, S., & Brown, A. (2020) · Psychological Assessment · doi:10.1037/pas0000971 · Cited by 73
Forced-Choice Assessment of Work-Related Maladaptive Personality Traits: Preliminary Evidence From an Application of Thurstonian Item Response Modeling
Guenole, N., Brown, A., & Cooper, A. J. (2016) · Assessment · doi:10.1177/1073191116641181 · Cited by 64
The Effect of Response Format on the Psychometric Properties of the Narcissistic Personality Inventory
Ackerman, R. A., Donnellan, M. B., Roberts, B. W., & Fraley, R. C. (2015) · Assessment · doi:10.1177/1073191114568113 · Cited by 67
Comparing the validity of trait estimates from the multidimensional forced-choice format and the rating scale format.
Wetzel, E., & Frick, S. (2019) · Psychological Assessment · doi:10.1037/pas0000781 · Cited by 59
Preventing Rater Biases in 360-Degree Feedback by Forcing Choice
Brown, A., Inceoglu, I., & Lin, Y. (2016) · Organizational Research Methods · doi:10.1177/1094428116668036 · Cited by 53
Though Forced, Still Valid: Psychometric Equivalence of Forced-Choice and Single-Statement Measures
Zhang, B., Sun, T., Drasgow, F., Chernyshenko, O. S., Nye, C. D., Stark, S. E., & White, L. A. (2019) · Organizational Research Methods · doi:10.1177/1094428119836486 · Cited by 52
A Literature Review on Collaborative Problem Solving for College and Workforce Readiness
Oliveri, M. E., Lawless, R. R., & Molloy, H. R. (2017) · ETS Research Report Series · doi:10.1002/ets2.12133 · Cited by 61
The general factor of personality: Substance or artefact?
Paul Irwing, B. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.03.002 · Cited by 51
Effects of management control mechanisms: towards a more comprehensive analysis
Goebel, S., & Weißenberger, B. E. (2016) · Journal of Business Economics · doi:10.1007/s11573-016-0816-6 · Cited by 47
Ipsative measurement and the analysis of organizational values: an alternative approach for data analysis
van Eijnatten, F. M., van der Ark, L. A., & Holloway, S. S. (2014) · Quality & Quantity · doi:10.1007/s11135-014-0009-8 · Cited by 46
Ordinal Factor Analysis of Graded-Preference Questionnaire Data
Brown, A., & Maydeu‐Olivares, A. (2017) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2017.1392247 · Cited by 44
Taking the Test Taker’s Perspective: Response Process and Test Motivation in Multidimensional Forced-Choice Versus Rating Scale Instruments
Sass, R., Frick, S., Reips, U., & Wetzel, E. (2018) · Assessment · doi:10.1177/1073191118762049 · Cited by 42
Modelling Forced‐Choice Response Formats
Brown, A., & Maydeu‐Olivares, A. (2018) · Wiley eBooks · doi:10.1002/9781118489772.ch18 · Cited by 38
On the Validity of Forced Choice Scores Derived From the Thurstonian Item Response Theory Model
Walton, K. E., Cherkasova, L., & Roberts, R. D. (2019) · Assessment · doi:10.1177/1073191119843585 · Cited by 35
A Meta-Analysis of the Faking Resistance of Forced-Choice Personality Inventories
Martínez, A., & Salgado, J. F. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.732241 · Cited by 33
Comparison of Single-Response Format and Forced-Choice Format Instruments Using Thurstonian Item Response Theory
Dueber, D., Love, A. M. A., Toland, M. D., & Turner, T. A. (2018) · Educational and Psychological Measurement · doi:10.1177/0013164417752782 · Cited by 32
Evidence for the Effectiveness of an Alternative Multisource Performance Rating Methodology
Hoffman, B. J., Gorman, C. A., Blair, C. A., Meriac, J. P., Overstreet, B. L., & Atchley, E. K. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2012.01252.x · Cited by 28
Doing less but getting more: Improving forced-choice measures with IRT
Brown, A., & Bartram, D. (2009) · PsycEXTRA Dataset · doi:10.1037/e518422013-570 · Cited by 26
Self-citation
The Multidimensional Forced-Choice Format as an Alternative for Rating Scales
Wetzel, E., Frick, S., & Greiff, S. (2020) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000609 · Cited by 26
Detecting DIF in Multidimensional Forced Choice Measures Using the Thurstonian Item Response Theory Model
Lee, P., Joo, S., & Stark, S. E. (2020) · Organizational Research Methods · doi:10.1177/1094428120959822 · Cited by 25
What format of treatment do patients with emotional disorders prefer and why? Implications for public mental health settings and policies
Osma, J., Suso-Ribera, C., Peris-Baquero, Ó., Gil-Lacruz, M., Pérez-Ayerra, L., Ferreres-Galan, V., Torres-Alfosea, M. Á., López-Escriche, M., & Domínguez, O. (2019) · PLoS ONE · doi:10.1371/journal.pone.0218117 · Cited by 29
On the Information Obtainable from Comparative Judgments
Bürkner, P. (2022) · Psychometrika · doi:10.1007/s11336-022-09843-z · Cited by 23
Using Personality Questionnaires for Selection
Hughes, D. J., & Batey, M. (2017) · Wiley eBooks · doi:10.1002/9781118972472.ch8 · Cited by 27
Factors Affecting Consumption of Water from a Newly Introduced Safe Drinking Water System: The Case of Managed Aquifer Recharge (MAR) Systems in Bangladesh
Hasan, M. B., Driessen, P., Majumder, S., Zoomers, A., & van Laerhoven, F. (2019) · Water · doi:10.3390/w11122459 · Cited by 22
Integration of the Forced-Choice Questionnaire and the Likert Scale: A Simulation Study
Xiao, Y., Liu, H., & Li, H. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00806 · Cited by 22
Management accountants and ethical dilemmas: How to promote ethical intention?
Hirth-Goebel, T. F., & Weißenberger, B. E. (2019) · Journal of Management Control · doi:10.1007/s00187-019-00288-7 · Cited by 22
How does cultural capital keep you thin? Exploring unique aspects of cultural class that link social advantage to lower body mass index
Groeniger, J. O., de Koster, W., van der Waal, J., Mackenbach, J. P., Kamphuis, C. B. M., & van Lenthe, F. J. (2020) · Sociology of Health & Illness · doi:10.1111/1467-9566.13120 · Cited by 22
The Journey of Forced Choice Measurement Over 80 Years: Past, Present, and Future
Lee, P., Son, M., Zhou, S., Joo, S., Jia, Z., & Cheng, V. (2025) · Organizational Research Methods · doi:10.1177/10944281251350687 · Cited by 20
The role of memorization in students’ self-reported mathematics learning: a large-scale study of Chinese eighth-grade students
Liu, Q., Du, X., Zhao, S., Liu, J., & Cai, J. (2019) · Asia Pacific Education Review · doi:10.1007/s12564-019-09576-2 · Cited by 19
Context-aware code summary generation
Su, C., Bansal, A., Huang, Y., Li, T. J.-J., & McMillan, C. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112580 · Cited by 17
Hacking the perfect score on high-stakes personality assessments with generative AI
Phillips, J., & Robie, C. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112840 · Cited by 17
Convergent and Predictive Validity of the Big Five Factors Assessed with SingleStimulus and Quasi-Ipsative Questionnaires
Otero, I., Cuadrado, D., & Martínez, A. (2020) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.5093/jwop2020a17 · Cited by 16
Investigating the impact of negatively keyed statements on multidimensional forced-choice personality measures: A comparison of partially ipsative and IRT scoring methods
Lee, P., Joo, S., Zhou, S., & Son, M. (2022) · Personality and Individual Differences · doi:10.1016/j.paid.2022.111555 · Cited by 16
A less evaluative measure of Big Five personality: Comparison of structure and criterion validity
Wood, J. K., Anglim, J., & Horwood, S. (2021) · European Journal of Personality · doi:10.1177/08902070211012920 · Cited by 21
Forced-Choice Personality Measures and Academic Dishonesty: a Comparative Study
Hendy, N. T. (2017) · Journal of Academic Ethics · doi:10.1007/s10805-017-9280-3 · Cited by 18
A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats
Lee, H., & Smith, W. Z. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164419871659 · Cited by 17
Traditional scores versus IRT estimates on forced-choice tests based on a dominance model
Hontangas, P. M., Leenen, I., TORRE, J. D. L., Ponsoda, V., Morillo, D., & Abad, F. J. (2016) · Psicothema · doi:10.7334/psicothema2015.204 · Cited by 15
Faking Effects on the Factor Structure of a Quasi-Ipsative Forced-Choice Personality Inventory
Martínez, A., Moscoso, S., & Lado, M. A. (2021) · Journal of Work and Organizational Psychology · doi:10.5093/jwop2021a7 · Cited by 14
The Motivational Value Systems Questionnaire (MVSQ): Psychometric Analysis Using a Forced Choice Thurstonian IRT Model
Merk, J., Schlotz, W., & Falter, T. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01626 · Cited by 14
An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures
Guo, Z. Y., Wang, D., Cai, Y., & Tu, D. (2023) · Educational and Psychological Measurement · doi:10.1177/00131644231171193 · Cited by 13
Exploring self-regulated learning within online informal language learning: a case study
Wang, Y. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2497506 · Cited by 14
Introducing a supervised alternative to forced‐choice personality scoring: A test of validity and resistance to faking
Speer, A. B., & Delacruz, A. Y. (2021) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12345 · Cited by 13
Análisis factorial de ítems de respuesta forzada: una revisión y un ejemplo
Calderón, C., & Ximénez, C. (2014) · Revista Latinoamericana de Psicología · doi:10.1016/s0120-0534(14)70003-2 · Cited by 12
Faking resistance of a quasi‐ipsative RIASEC occupational interest measure
Rasheed, S., & Robie, C. (2023) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12427 · Cited by 11
Cycling Skill Inventory: Assessment of motor–tactical skills and safety motives
de Winter, J., Kovácsová, N., & Hagenzieker, M. (2019) · Traffic Injury Prevention · doi:10.1080/15389588.2019.1639158 · Cited by 11
Personality Assessment, Forced-Choice
Brown, A. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.25084-8 · Cited by 11
The More Contextualized, the More Valid: Effects of Contextualization Strategies on Forced-choice Measurement
Li, L., Zhang, B., Sun, T., & Drasgow, F. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09983-2 · Cited by 10
Understanding, detecting, and deterring faking on interest inventories
Wegmeyer, L. J., & Speer, A. B. (2022) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12398 · Cited by 10
Validation Studies on a Measure of Overall Managerial Readiness for the Chinese
Hui, C.-C. H., Pak, S. T., & Cheng, K. H. C. (2009) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2009.00457.x · Cited by 10
Detecting Careless Respondents in Multidimensional Forced Choice Data: An Application of lz Person-Fit Statistic to the TIRT Model
Lee, P., Joo, S., & Son, M. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-023-09911-w · Cited by 9
Let's Focus on Two-Stage Alignment Not Just on Overall Performance
Bartram, D., Warr, P. B., & Brown, A. (2010) · Industrial and Organizational Psychology · doi:10.1017/s1754942600002492 · Cited by 9
Self-citation
Examining the Criterion-Related Validity of the Employee Screening Questionnaire: A Three-Sample Investigation
Iliescu, D., Ilie, A., & Ispas, D. (2011) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2011.00550.x · Cited by 9
Development and Validation of the Behavioral Tendencies Questionnaire
Dam, N. T. V., Brown, A., Mole, T. B., Davis, J. H., Britton, W. B., & Brewer, J. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0140867 · Cited by 9
Ethical considerations of Bedouin Arab school leaders: Negotiating Eurocentric and indigenous decision-making values
Eyal, O., Da’as, R., & Berkovich, I. (2020) · Educational Management Administration & Leadership · doi:10.1177/1741143220913556 · Cited by 9
When Your Boss Says, “You Need to Sound More Professional”: Writing Style and Writer Attributions
Campbell, K. S., Naidoo, J. S., & Smith, J. (2021) · International Journal of Business Communication · doi:10.1177/23294884211025735 · Cited by 8
Reviewing the Structure of Kolb’s Learning Style Inventory From Factor Analysis and Thurstonian Item Response Theory (IRT) Model Approaches
Calderón, C., Ximénez, C., Lay-Lisboa, S., & Briceño, M. (2021) · Journal of Psychoeducational Assessment · doi:10.1177/07342829211003739 · Cited by 8
Validez predictiva e impacto adverso de la entrevista conductual estructurada en el sector público
López, A. R. (2016) · Journal of Work and Organizational Psychology · doi:10.1016/j.rpto.2016.04.003 · Cited by 8
A New Item Response Theory Model for Estimating Person Ability and Item Parameters for Multidimensional Rank Order Responses
Seybert, J. M. (2013) · Digital Commons - University of South Florida (University of South Florida) · Cited by 7
Employee Selection in Times of Change
Viswesvaran, C., & Öneş, D. S. (2010) · Wiley-Blackwell eBooks · doi:10.1002/9780470661628.ch5 · Cited by 6
Situational judgment test for measuring military tactical decision-making skills
Männiste, T., Pedaste, M., & Schimanski, R. (2019) · Military Psychology · doi:10.1080/08995605.2019.1664366 · Cited by 6
Enhancing Personality Assessment in the Selection Context: A Study Protocol on Alternative Measures and an Extended Bandwidth of Criteria
Schröder, V., Heimann, A., Ingold, P. V., & Kleinmann, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.643690 · Cited by 7
The incremental validity of a Situational Judgement Test (SJT) relative to personality and cognitive ability to predict managerial performance
Fertig, S. (2009) · SUNScholar (Stellenbosch University) · Cited by 6
Less Evaluative Measures of Personality in Job Applicant Contexts: The Effect on Socially Desirable Responding and Criterion Validity
Wood, J. K., Anglim, J., & Horwood, S. (2023) · Journal of Personality Assessment · doi:10.1080/00223891.2023.2251158 · Cited by 5
Contributions to Constructing Forced-Choice Questionnaires Using the Thurstonian IRT Model
Sun, L., Qin, Z., Wang, S., Tian, X., & Luo, F. (2023) · Multivariate Behavioral Research · doi:10.1080/00273171.2023.2248979 · Cited by 5
Examining gender differences in the use of multidimensional forced‐choice measures of personality in terms of test‐taker reactions and test fairness
Zhou, S., Lee, P., & Fyffe, S. (2024) · Human Resource Development Quarterly · doi:10.1002/hrdq.21521 · Cited by 5
The Motivation and Opportunity for Socially Desirable Responding Does Not Alter the General Factor of Personality
Pelt, D. H. M., van der Linden, D., Dunkel, C. S., & Born, M. P. (2019) · Assessment · doi:10.1177/1073191119880960 · Cited by 5
Personality as a predictor of performance for customer service centre agents in the banking industry
Blignaut, L. (2011) · Unisa Institutional Repository (University of South Africa) · Cited by 5
Development of a Forced-Choice Personality Inventory via Thurstonian Item Response Theory (TIRT)
Tsaousis, I., & Al-Owidha, A. (2024) · Behavioral Sciences · doi:10.3390/bs14121118 · Cited by 4
Psychological assessments of paired-comparison and Likert formats:
Nonoda, S., & Okada, K. (2022) · The Japanese journal of psychology · doi:10.4992/jjpsy.93.20231 · Cited by 4
General intelligence, personality traits, and motivation as predictors of performance, potential, and rate of advancement of Royal Navy senior officers
Young, M., & Dulewicz, V. (2023) · Military Psychology · doi:10.1080/08995605.2023.2244818 · Cited by 7
Development and validation of the general regulatory focus measure forced choice scale (GRFM-FC)
Chammas, C. B., & Hernandez, J. M. D. C. (2024) · Current Psychology · doi:10.1007/s12144-024-05970-1 · Cited by 4
Creation of Norms for the Purpose of Global Talent Management
Hedricks, C. A., Robie, C., & Harnisher, J. V. (2008) · International Journal of Testing · doi:10.1080/15305050802435086 · Cited by 4
How Item Response Theory can solve problems of ipsative data
Brown, A. (2010) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya) · Cited by 4
Impact of E-Procurement Implementation on Bahrain Road Construction Companies: Exploring the Influence of Firm Size and Readiness Factors
Al-Kaabi, H., Alhasan, Y., Abdeldayem, M. M., & Aldulaimi, S. H. (2024) · ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS) · doi:10.1109/icetsis61505.2024.10459387 · Cited by 3
A ranking forced choice diagnostic classification model for psychological assessment using forced choice questionnaires
Zhu, Y., Xu, J., Wang, D., Li, X., Cai, Y., & Tu, D. (2024) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12376 · Cited by 3
Rank-ordering anti-speeding messages
Glendon, A. I., & Prendergast, S. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.07.030 · Cited by 4
Effects of Faking on the Predictive Validity of a Quasi-Ipsative Forced-Choice Personality Inventory: Implications for Sustainable Personnel Selection
Martínez, A., Moscoso, S., & Lado, M. A. (2021) · Sustainability · doi:10.3390/su13084398 · Cited by 3
Pitfalls of Statistical Methods in Traffic Psychology
de Winter, J., & Dodou, D. (2021) · Elsevier eBooks · doi:10.1016/b978-0-08-102671-7.10665-7 · Cited by 3
A Framework for Detecting Both Main Effect and Interactive DIF in Multidimensional Forced-Choice Assessments
Liu, K., Zheng, Y., Wang, D., Cai, Y., Shi, Y., Xi, C., & Tu, D. (2024) · Organizational Research Methods · doi:10.1177/10944281241244760 · Cited by 2
Time To Change the Bathwater: Correcting Misconceptions About Performance Ratings
Gorman, C. A., Cunningham, C. J. L., Bergman, S. M., & Meriac, J. P. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2016.17 · Cited by 2
Improving Personnel Selection through Frame of Reference Effect on Personality Inventory: Predictive and Incremental Validity over Cognitive Ability and Job Knowledge
Stroescu, O. (2015) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2015.03.049 · Cited by 4
Doing less but getting more: Improving forced‐choice measures with Item Response Theory
Brown, A. (2010) · Assessment and Development Matters · doi:10.53841/bpsadm.2010.2.1.21 · Cited by 2
CurmElo: The theory and practice of a forced-choice approach to producing preference rankings
Sankaran, S., Derechin, J., & Christakis, N. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252145 · Cited by 2
Item Response Theory Models for Forced-Choice Questionnaires
Morillo, D. (2018) · Biblos-e Archivo (Universidad Autónoma de Madrid) · Cited by 2
Decision-making in contexts of risk and uncertainty: An instrument for secondary education
Gómez, A. S. V., & Henríquez-Rivas, C. (2025) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/17175 · Cited by 1

Authors: Bartram, D.
Corresponding author: Bartram, Dave
ORCID: Bartram, Dave
Venue: International Journal of Selection and Assessment
Publisher: Wiley
Published: 2007-08-14
Volume: 15
Issue: 3
Pages: 263-272
ISSN: 0965-075X (ISSN-L)
1468-2389
DOI: 10.1111/j.1468-2389.2007.00386.x
OpenAlex: W2131404783
Cited by: 132
References: 24
Citations by year: 2026: 3 · 2025: 9 · 2024: 9 · 2023: 8 · 2022: 9 · 2021: 12 · 2020: 7 · 2019: 13 · 2018: 8 · 2017: 7 · 2016: 8 · 2015: 6 · 2014: 7 · 2013: 4 · 2012: 6
FWCI: 5.26
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: International Journal of Selection and Assessment (publishedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Employer Branding and e-HRM
Keywords: forced-choice format, criterion validity, operational validity, competency assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Increasing Validity with Forced-Choice Criterion Measurement Formats

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks