The Journey from Likert to Forced-Choice Questionnaires: Evidence of the Invariance of Item Parameters
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumption.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Barrick, M. R., Mount, M. K., & Judge, T. A. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00160 · Cited by 2,356
Caring about carelessness: Participant inattention and its effects on research
Maniaci, M. R., & Rogge, R. D. (2014) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.09.008 · Cited by 852
Judge, T. A., Rodell, J. B., Klinger, R. L., Simon, L. S., & Crawford, E. R. (2013) · Journal of Applied Psychology · doi:10.1037/a0033901 · Cited by 482
Reconsidering forced-choice item formats for applicant personality assessment
Christiansen, N. D., Burns, G. N., & Montgomery, G. E. (2005) · Human Performance · doi:10.1207/s15327043hup1803_4 · Cited by 250
Salgado, J. F., & Táuriz, G. (2014) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2012.716198 · Cited by 205
Salgado, J. F., Anderson, N., & Tauriz, G. (2015) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12098 · Cited by 138
Salgado, J. F. (2017) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.1016/j.rpto.2017.07.001 · Cited by 75
Cited by
Kreitchmann, R. S., Abad, F. J., Ponsoda, V., Nieto, M. D., & Morillo, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02309 · Cited by 269
Self-citationOtero, I., Cuadrado, D., & Martínez, A. (2020) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.5093/jwop2020a17 · Cited by 16
Martínez, A., Salgado, J. F., & Lado, M. (2022) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.5093/jwop2022a16 · Cited by 11
Metadata
- Authors
- Morillo, D., Abad, F. J., Kreitchmann, R. S., Leenen, I., Hontangas, P., & Ponsoda, V.
- Venue
- Revista de Psicología del Trabajo y de las Organizaciones
- Published
- 2019
- Volume
- 35
- Issue
- 2
- Pages
- 75-83
- ISSN
- 1576-5962 (ISSN-L)
- 2174-0534
- OpenAlex
- W2950936647
- Cited by
- 39
- References
- 7
- FWCI
- 3.76
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Journey from Likert to Forced-Choice Questionnaires: Evidence of the Invariance of Item Parameters. https://app.cochat.ai/papers/10.5093/jwop2019a11
- The paper
- Morillo, D., Abad, F. J., Kreitchmann, R. S., Leenen, I., Hontangas, P., & Ponsoda, V. (2019). The Journey from Likert to Forced-Choice Questionnaires: Evidence of the Invariance of Item Parameters. Revista de Psicología del Trabajo y de las Organizaciones. https://doi.org/10.5093/jwop2019a11
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.