Increasing Validity with Forced-Choice Criterion Measurement Formats
Abstract
The relative validities of forced‐choice (ipsative) and Likert rating‐scale item formats as criterion measures are examined. While there has been much debate about the relative technical and psychometric merits and demerits of ipsative instruments, the present research focused on the crucial question of whether the use of this format has any practical benefit – in terms of improved validity. An analysis is reported from a meta‐analysis data set. This demonstrates that higher operational validity coefficients (prediction of line‐manager ratings of competencies) are associated with the use of forced‐choice (r=.38) rather than rating scale (r=.25) item formats for the criterion measurement instrument when performance is rated by the same line managers on both formats and where the predictor is held constant. Thus the apparent criterion‐related validity of a predictor can increase by 50% simply by changing the format of the criterion measurement instrument. The implications of this for practice are discussed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The use of forced-choice, rank orders was motivated by research showing increased validity of these formats compared to rating scales.
“The use of forced-choice, rank orders was motivated by research showing increased validity of these formats compared to rating scales [32].”
From What format of treatment do patients with emotional disorders prefer and why? Implications for public mental health settings and policies (2019) · cites this paper as [32]
Cites
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · see citing works
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023 · see citing works
The five factor model of personality and job performance in the European Community.
Salgado, J. F. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.1.30 · Cited by 1,582 · see citing works
Comparative analysis of the reliability of job performance ratings.
Viswesvaran, C., Öneş, D. S., & Schmidt, F. L. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.5.557 · Cited by 774 · see citing works
The Great Eight Competencies: A Criterion-Centric Approach to Validation.
Bartram, D. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.6.1185 · Cited by 667 · see citing works
Self-citationMeasurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567 · see citing works
Salgado, J., Anderson, N., Moscoso, S., Bertua, C., Fruyt, F. D., & Rolland, J. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.6.1068 · Cited by 328 · see citing works
Strengths and limitations of ipsative measurement
Baron, H. (1996) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1996.tb00599.x · Cited by 304 · see citing works
On the Reliability of a Weighted Composite
Mosier, C. I. (1943) · Psychometrika · doi:10.1007/bf02288700 · Cited by 261 · see citing works
Reconsidering forced-choice item formats for applicant personality assessment
Christiansen, N. D., Burns, G. N., & Montgomery, G. E. (2005) · Human Performance · doi:10.1207/s15327043hup1803_4 · Cited by 250 · see citing works
The Impact of Faking on Employment Tests: Does Forced Choice Offer a Solution?
Jackson, D. N., Wroblewski, V. R., & Ashton, M. C. (2000) · Human Performance · doi:10.1207/s15327043hup1304_3 · Cited by 233 · see citing works
Psychometric problems and issues involved with creating and using ipsative measures for selection
Meade, A. W. (2004) · Journal of Occupational and Organizational Psychology · doi:10.1348/0963179042596504 · Cited by 168 · see citing works
Competency and Individual Performance: Modelling the World of Work
Kurz, R. H., & Bartram, D. (2002) · Wiley eBooks · doi:10.1002/9780470696736.ch10 · Cited by 167 · see citing works
Self-citationThe reliability and validity of normative and ipsative approaches in the measurement of personality
Saville, P., & Willson, E. (1991) · Journal of Occupational Psychology · doi:10.1111/j.2044-8325.1991.tb00556.x · Cited by 154 · see citing works
The relationship between ipsatized and normative measures of personality
Bartram, D. (1996) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1996.tb00597.x · Cited by 152 · see citing works
Self-citationHalo in a multidimensional forced-choice performance evaluation scale.
King, L. M., Hunter, J. E., & Schmidt, F. L. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.5.507 · Cited by 143 · see citing works
How effective are people at faking on personality questionnaires?
Martin, B. A., Bowen, C.-C., & Hunt, S. T. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(01)00021-6 · Cited by 117 · see citing works
Forced Choice—The New Army Rating1
Sisson, E. D. (1948) · Personnel Psychology · doi:10.1111/j.1744-6570.1948.tb01316.x · Cited by 103 · see citing works
On the factoring and interpretation of ipsative data
Closs, S. J. (1996) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1996.tb00598.x · Cited by 96 · see citing works
Introduction: A Framework for Examining Organizational Effectiveness
Bartram, D., Robertson, I. T., & Callinan, M. (2002) · doi:10.1002/9780470696736.ch · Cited by 86 · see citing works
Self-citationOrganizational effectiveness : the role of psychology
Robertson, I. T., Callinan, M., & Bartram, D. (2002) · Medical Entomology and Zoology · Cited by 72 · see citing works
Self-citationBartram, D., Brown, A., Fleck, S., Inceoglu, I., & Ward, K. (2006) · Kent Academic Repository (University of Kent) · Cited by 33 · see citing works
Self-citationA critique and standardization of meta‐analytic validity coefficients in personnel selection
Hermelin, E., & Robertson, I. T. (2001) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317901167352 · Cited by 30 · see citing works
Flagged first, then by citations
1 of the 24 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Cruchinho, P., López-Franco, M. D., Capelas, M. L., Almeida, S., Bennett, P. M., Miranda da Silva, M., Teixeira, G., Nunes, E., Lucas, P., & Gaspar, F. (2024) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s419714 · Cited by 469 · see citing works
OECD (2014) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/6341a959-en · Cited by 351 · see citing works
Item Response Modeling of Forced-Choice Questionnaires
Brown, A., & Maydeu‐Olivares, A. (2011) · Educational and Psychological Measurement · doi:10.1177/0013164410375112 · Cited by 333 · see citing works
How IRT can solve problems of ipsative data in forced-choice questionnaires.
Brown, A., & Maydeu‐Olivares, A. (2012) · Psychological Methods · doi:10.1037/a0030641 · Cited by 217 · see citing works
Salgado, J. F., & Táuriz, G. (2014) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2012.716198 · Cited by 205 · see citing works
Salgado, J. F., Anderson, N., & Tauriz, G. (2015) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12098 · Cited by 138 · see citing works
Wetzel, E., Boehnke, J. R., & Brown, A. (2016) · Oxford University Press eBooks · doi:10.1093/med:psych/9780199356942.003.0024 · Cited by 129 · see citing works
The Evolution of Performance Management: Searching for Value
Pulakos, E. D., Mueller-Hanson, R. A., & Arad, S. (2018) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-012218-015009 · Cited by 127 · see citing works
Item Response Models for Forced-Choice Questionnaires: A Common Framework
Brown, A. (2014) · Psychometrika · doi:10.1007/s11336-014-9434-9 · Cited by 110 · see citing works
Students' Perceptions of Teacher Support Across the Transition from Primary to Secondary School
Bru, E., Stornes, T., Munthe, E., & Thuen, E. (2010) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2010.522842 · Cited by 104 · see citing works
Fitting a Thurstonian IRT model to forced-choice data using Mplus
Brown, A., & Maydeu‐Olivares, A. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0217-x · Cited by 101 · see citing works
Adaptive Testing With Multidimensional Pairwise Preference Items
Stark, S. E., Chernyshenko, O. S., Drasgow, F., & White, L. A. (2012) · Organizational Research Methods · doi:10.1177/1094428112444611 · Cited by 82 · see citing works
Comparing Traditional and IRT Scoring of Forced-Choice Tests
Hontangas, P. M., TORRE, J. D. L., Ponsoda, V., Leenen, I., Morillo, D., & Abad, F. J. (2015) · Applied Psychological Measurement · doi:10.1177/0146621615585851 · Cited by 82 · see citing works
CEO Personality: A Different Perspective on the Nonfamily Versus Family CEO Debate
Kelleci, R., Lambrechts, F., Voordeckers, W., & Huybrechts, J. (2018) · Family Business Review · doi:10.1177/0894486518811222 · Cited by 81 · see citing works
Salgado, J. F. (2017) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.1016/j.rpto.2017.07.001 · Cited by 75 · see citing works
Wetzel, E., Frick, S., & Brown, A. (2020) · Psychological Assessment · doi:10.1037/pas0000971 · Cited by 70 · see citing works
Guenole, N., Brown, A., & Cooper, A. J. (2016) · Assessment · doi:10.1177/1073191116641181 · Cited by 64 · see citing works
Ackerman, R. A., Donnellan, M. B., Roberts, B. W., & Fraley, R. C. (2015) · Assessment · doi:10.1177/1073191114568113 · Cited by 60 · see citing works
Wetzel, E., & Frick, S. (2019) · Psychological Assessment · doi:10.1037/pas0000781 · Cited by 59 · see citing works
Preventing Rater Biases in 360-Degree Feedback by Forcing Choice
Brown, A., Inceoglu, I., & Lin, Y. (2016) · Organizational Research Methods · doi:10.1177/1094428116668036 · Cited by 53 · see citing works
Though Forced, Still Valid: Psychometric Equivalence of Forced-Choice and Single-Statement Measures
Zhang, B., Sun, T., Drasgow, F., Chernyshenko, O. S., Nye, C. D., Stark, S. E., & White, L. A. (2019) · Organizational Research Methods · doi:10.1177/1094428119836486 · Cited by 52 · see citing works
A Literature Review on Collaborative Problem Solving for College and Workforce Readiness
Oliveri, M. E., Lawless, R. R., & Molloy, H. R. (2017) · ETS Research Report Series · doi:10.1002/ets2.12133 · Cited by 50 · see citing works
The general factor of personality: Substance or artefact?
Paul Irwing, B. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.03.002 · Cited by 49 · see citing works
Effects of management control mechanisms: towards a more comprehensive analysis
Goebel, S., & Weißenberger, B. E. (2016) · Journal of Business Economics · doi:10.1007/s11573-016-0816-6 · Cited by 47 · see citing works
van Eijnatten, F. M., van der Ark, L. A., & Holloway, S. S. (2014) · Quality & Quantity · doi:10.1007/s11135-014-0009-8 · Cited by 46 · see citing works
Ordinal Factor Analysis of Graded-Preference Questionnaire Data
Brown, A., & Maydeu‐Olivares, A. (2017) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2017.1392247 · Cited by 44 · see citing works
Sass, R., Frick, S., Reips, U., & Wetzel, E. (2018) · Assessment · doi:10.1177/1073191118762049 · Cited by 40 · see citing works
Modelling Forced‐Choice Response Formats
Brown, A., & Maydeu‐Olivares, A. (2018) · Wiley eBooks · doi:10.1002/9781118489772.ch18 · Cited by 38 · see citing works
On the Validity of Forced Choice Scores Derived From the Thurstonian Item Response Theory Model
Walton, K. E., Cherkasova, L., & Roberts, R. D. (2019) · Assessment · doi:10.1177/1073191119843585 · Cited by 33 · see citing works
A Meta-Analysis of the Faking Resistance of Forced-Choice Personality Inventories
Martínez, A., & Salgado, J. F. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.732241 · Cited by 33 · see citing works
Dueber, D., Love, A. M. A., Toland, M. D., & Turner, T. A. (2018) · Educational and Psychological Measurement · doi:10.1177/0013164417752782 · Cited by 32 · see citing works
Evidence for the Effectiveness of an Alternative Multisource Performance Rating Methodology
Hoffman, B. J., Gorman, C. A., Blair, C. A., Meriac, J. P., Overstreet, B. L., & Atchley, E. K. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2012.01252.x · Cited by 28 · see citing works
Doing less but getting more: Improving forced-choice measures with IRT
Brown, A., & Bartram, D. (2009) · PsycEXTRA Dataset · doi:10.1037/e518422013-570 · Cited by 26 · see citing works
Self-citationThe Multidimensional Forced-Choice Format as an Alternative for Rating Scales
Wetzel, E., Frick, S., & Greiff, S. (2020) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000609 · Cited by 26 · see citing works
Lee, P., Joo, S., & Stark, S. E. (2020) · Organizational Research Methods · doi:10.1177/1094428120959822 · Cited by 25 · see citing works
Osma, J., Suso-Ribera, C., Peris-Baquero, Ó., Gil-Lacruz, M., Pérez-Ayerra, L., Ferreres-Galan, V., Torres-Alfosea, M. Á., López-Escriche, M., & Domínguez, O. (2019) · PLoS ONE · doi:10.1371/journal.pone.0218117 · Cited by 24 · see citing works
On the Information Obtainable from Comparative Judgments
Bürkner, P. (2022) · Psychometrika · doi:10.1007/s11336-022-09843-z · Cited by 23 · see citing works
Using Personality Questionnaires for Selection
Hughes, D. J., & Batey, M. (2017) · Wiley eBooks · doi:10.1002/9781118972472.ch8 · Cited by 23 · see citing works
Hasan, M. B., Driessen, P., Majumder, S., Zoomers, A., & van Laerhoven, F. (2019) · Water · doi:10.3390/w11122459 · Cited by 22 · see citing works
Integration of the Forced-Choice Questionnaire and the Likert Scale: A Simulation Study
Xiao, Y., Liu, H., & Li, H. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00806 · Cited by 22 · see citing works
Management accountants and ethical dilemmas: How to promote ethical intention?
Hirth-Goebel, T. F., & Weißenberger, B. E. (2019) · Journal of Management Control · doi:10.1007/s00187-019-00288-7 · Cited by 22 · see citing works
Groeniger, J. O., de Koster, W., van der Waal, J., Mackenbach, J. P., Kamphuis, C. B. M., & van Lenthe, F. J. (2020) · Sociology of Health & Illness · doi:10.1111/1467-9566.13120 · Cited by 21 · see citing works
The Journey of Forced Choice Measurement Over 80 Years: Past, Present, and Future
Lee, P., Son, M., Zhou, S., Joo, S., Jia, Z., & Cheng, V. (2025) · Organizational Research Methods · doi:10.1177/10944281251350687 · Cited by 20 · see citing works
Liu, Q., Du, X., Zhao, S., Liu, J., & Cai, J. (2019) · Asia Pacific Education Review · doi:10.1007/s12564-019-09576-2 · Cited by 19 · see citing works
Context-aware code summary generation
Su, C., Bansal, A., Huang, Y., Li, T. J.-J., & McMillan, C. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112580 · Cited by 17 · see citing works
Hacking the perfect score on high-stakes personality assessments with generative AI
Phillips, J., & Robie, C. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112840 · Cited by 17 · see citing works
Otero, I., Cuadrado, D., & Martínez, A. (2020) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.5093/jwop2020a17 · Cited by 16 · see citing works
Lee, P., Joo, S., Zhou, S., & Son, M. (2022) · Personality and Individual Differences · doi:10.1016/j.paid.2022.111555 · Cited by 16 · see citing works
A less evaluative measure of Big Five personality: Comparison of structure and criterion validity
Wood, J. K., Anglim, J., & Horwood, S. (2021) · European Journal of Personality · doi:10.1177/08902070211012920 · Cited by 16 · see citing works
Forced-Choice Personality Measures and Academic Dishonesty: a Comparative Study
Hendy, N. T. (2017) · Journal of Academic Ethics · doi:10.1007/s10805-017-9280-3 · Cited by 16 · see citing works
A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats
Lee, H., & Smith, W. Z. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164419871659 · Cited by 15 · see citing works
Traditional scores versus IRT estimates on forced-choice tests based on a dominance model
Hontangas, P. M., Leenen, I., TORRE, J. D. L., Ponsoda, V., Morillo, D., & Abad, F. J. (2016) · Psicothema · doi:10.7334/psicothema2015.204 · Cited by 15 · see citing works
Faking Effects on the Factor Structure of a Quasi-Ipsative Forced-Choice Personality Inventory
Martínez, A., Moscoso, S., & Lado, M. A. (2021) · Journal of Work and Organizational Psychology · doi:10.5093/jwop2021a7 · Cited by 14 · see citing works
Merk, J., Schlotz, W., & Falter, T. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01626 · Cited by 14 · see citing works
An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures
Guo, Z. Y., Wang, D., Cai, Y., & Tu, D. (2023) · Educational and Psychological Measurement · doi:10.1177/00131644231171193 · Cited by 13 · see citing works
Exploring self-regulated learning within online informal language learning: a case study
Wang, Y. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2497506 · Cited by 13 · see citing works
Speer, A. B., & Delacruz, A. Y. (2021) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12345 · Cited by 12 · see citing works
Análisis factorial de ítems de respuesta forzada: una revisión y un ejemplo
Calderón, C., & Ximénez, C. (2014) · Revista Latinoamericana de Psicología · doi:10.1016/s0120-0534(14)70003-2 · Cited by 12 · see citing works
Faking resistance of a quasi‐ipsative RIASEC occupational interest measure
Rasheed, S., & Robie, C. (2023) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12427 · Cited by 11 · see citing works
Cycling Skill Inventory: Assessment of motor–tactical skills and safety motives
de Winter, J., Kovácsová, N., & Hagenzieker, M. (2019) · Traffic Injury Prevention · doi:10.1080/15389588.2019.1639158 · Cited by 11 · see citing works
Personality Assessment, Forced-Choice
Brown, A. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.25084-8 · Cited by 11 · see citing works
Li, L., Zhang, B., Sun, T., & Drasgow, F. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09983-2 · Cited by 10 · see citing works
Understanding, detecting, and deterring faking on interest inventories
Wegmeyer, L. J., & Speer, A. B. (2022) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12398 · Cited by 10 · see citing works
Validation Studies on a Measure of Overall Managerial Readiness for the Chinese
Hui, C.-C. H., Pak, S. T., & Cheng, K. H. C. (2009) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2009.00457.x · Cited by 10 · see citing works
Lee, P., Joo, S., & Son, M. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-023-09911-w · Cited by 9 · see citing works
Let's Focus on Two-Stage Alignment Not Just on Overall Performance
Bartram, D., Warr, P. B., & Brown, A. (2010) · Industrial and Organizational Psychology · doi:10.1017/s1754942600002492 · Cited by 9 · see citing works
Self-citationIliescu, D., Ilie, A., & Ispas, D. (2011) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2011.00550.x · Cited by 9 · see citing works
Development and Validation of the Behavioral Tendencies Questionnaire
Dam, N. T. V., Brown, A., Mole, T. B., Davis, J. H., Britton, W. B., & Brewer, J. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0140867 · Cited by 9 · see citing works
Eyal, O., Da’as, R., & Berkovich, I. (2020) · Educational Management Administration & Leadership · doi:10.1177/1741143220913556 · Cited by 9 · see citing works
When Your Boss Says, “You Need to Sound More Professional”: Writing Style and Writer Attributions
Campbell, K. S., Naidoo, J. S., & Smith, J. (2021) · International Journal of Business Communication · doi:10.1177/23294884211025735 · Cited by 8 · see citing works
Calderón, C., Ximénez, C., Lay-Lisboa, S., & Briceño, M. (2021) · Journal of Psychoeducational Assessment · doi:10.1177/07342829211003739 · Cited by 8 · see citing works
Validez predictiva e impacto adverso de la entrevista conductual estructurada en el sector público
López, A. R. (2016) · Journal of Work and Organizational Psychology · doi:10.1016/j.rpto.2016.04.003 · Cited by 7 · see citing works
Seybert, J. M. (2013) · Digital Commons - University of South Florida (University of South Florida) · Cited by 7 · see citing works
Employee Selection in Times of Change
Viswesvaran, C., & Ones, D. (2010) · Wiley-Blackwell eBooks · doi:10.1002/9780470661628.ch5 · Cited by 7 · see citing works
Situational judgment test for measuring military tactical decision-making skills
Männiste, T., Pedaste, M., & Schimanski, R. (2019) · Military Psychology · doi:10.1080/08995605.2019.1664366 · Cited by 6 · see citing works
Schröder, V. S., Heimann, A. L., Ingold, P. V., & Kleinmann, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.643690 · Cited by 6 · see citing works
Fertig, S. (2009) · SUNScholar (Stellenbosch University) · Cited by 6 · see citing works
Wood, J. K., Anglim, J., & Horwood, S. (2023) · Journal of Personality Assessment · doi:10.1080/00223891.2023.2251158 · Cited by 5 · see citing works
Contributions to Constructing Forced-Choice Questionnaires Using the Thurstonian IRT Model
Sun, L., Qin, Z., Wang, S., Tian, X., & Luo, F. (2023) · Multivariate Behavioral Research · doi:10.1080/00273171.2023.2248979 · Cited by 5 · see citing works
Zhou, S., Lee, P., & Fyffe, S. (2024) · Human Resource Development Quarterly · doi:10.1002/hrdq.21521 · Cited by 5 · see citing works
Pelt, D. H. M., van der Linden, D., Dunkel, C. S., & Born, M. P. (2019) · Assessment · doi:10.1177/1073191119880960 · Cited by 5 · see citing works
Personality as a predictor of performance for customer service centre agents in the banking industry
Blignaut, L. (2011) · Unisa Institutional Repository (University of South Africa) · Cited by 5 · see citing works
Development of a Forced-Choice Personality Inventory via Thurstonian Item Response Theory (TIRT)
Tsaousis, I., & Al-Owidha, A. (2024) · Behavioral Sciences · doi:10.3390/bs14121118 · Cited by 4 · see citing works
Psychological assessments of paired-comparison and Likert formats:
Nonoda, S., & Okada, K. (2022) · The Japanese journal of psychology · doi:10.4992/jjpsy.93.20231 · Cited by 4 · see citing works
Young, M., & Dulewicz, V. (2023) · Military Psychology · doi:10.1080/08995605.2023.2244818 · Cited by 4 · see citing works
Development and validation of the general regulatory focus measure forced choice scale (GRFM-FC)
Chammas, C. B., & Hernandez, J. M. D. C. (2024) · Current Psychology · doi:10.1007/s12144-024-05970-1 · Cited by 4 · see citing works
Creation of Norms for the Purpose of Global Talent Management
Hedricks, C. A., Robie, C., & Harnisher, J. V. (2008) · International Journal of Testing · doi:10.1080/15305050802435086 · Cited by 4 · see citing works
How Item Response Theory can solve problems of ipsative data
Brown, A. (2010) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya) · Cited by 4 · see citing works
Al-Kaabi, H., Alhasan, Y., Abdeldayem, M. M., & Aldulaimi, S. H. (2024) · ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS) · doi:10.1109/icetsis61505.2024.10459387 · Cited by 3 · see citing works
Zhu, Y., Xu, J., Wang, D., Li, X., Cai, Y., & Tu, D. (2024) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12376 · Cited by 3 · see citing works
Rank-ordering anti-speeding messages
Glendon, A. I., & Prendergast, S. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.07.030 · Cited by 3 · see citing works
Martínez, A., Moscoso, S., & Lado, M. A. (2021) · Sustainability · doi:10.3390/su13084398 · Cited by 3 · see citing works
Pitfalls of Statistical Methods in Traffic Psychology
de Winter, J., & Dodou, D. (2021) · Elsevier eBooks · doi:10.1016/b978-0-08-102671-7.10665-7 · Cited by 3 · see citing works
Liu, K., Zheng, Y., Wang, D., Cai, Y., Shi, Y., Xi, C., & Tu, D. (2024) · Organizational Research Methods · doi:10.1177/10944281241244760 · Cited by 2 · see citing works
Time To Change the Bathwater: Correcting Misconceptions About Performance Ratings
Gorman, C. A., Cunningham, C. J. L., Bergman, S. M., & Meriac, J. P. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2016.17 · Cited by 2 · see citing works
Stroescu, O. (2015) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2015.03.049 · Cited by 2 · see citing works
Doing less but getting more: Improving forced‐choice measures with Item Response Theory
Brown, A. (2010) · Assessment and Development Matters · doi:10.53841/bpsadm.2010.2.1.21 · Cited by 2 · see citing works
CurmElo: The theory and practice of a forced-choice approach to producing preference rankings
Sankaran, S., Derechin, J., & Christakis, N. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252145 · Cited by 2 · see citing works
Item Response Theory Models for Forced-Choice Questionnaires
Morillo, D. (2018) · Biblos-e Archivo (Universidad Autónoma de Madrid) · Cited by 2 · see citing works
Decision-making in contexts of risk and uncertainty: An instrument for secondary education
Gómez, A. S. V., & Henríquez-Rivas, C. (2025) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/17175 · Cited by 1 · see citing works
- Authors
- Bartram, D.
- Corresponding author
- Bartram, Dave
- ORCID
- Bartram, Dave
- Venue
- International Journal of Selection and Assessment
- Publisher
- Wiley
- Published
- 2007-08-14
- Volume
- 15
- Issue
- 3
- Pages
- 263-272
- ISSN
- 0965-075X (ISSN-L)
- 1468-2389
- OpenAlex
- W2131404783
- Cited by
- 132
- References
- 24
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 9 · 2023: 8 · 2022: 9 · 2021: 12 · 2020: 7 · 2019: 13 · 2018: 8 · 2017: 7 · 2016: 8 · 2015: 6 · 2014: 7 · 2013: 4 · 2012: 6
- FWCI
- 5.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Selection and Assessment (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Employer Branding and e-HRM
- Keywords
- forced-choice format, criterion validity, operational validity, competency assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
