Item Response Modeling of Paired Comparison and Ranking Data
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The comparative format used in ranking and paired comparisons tasks can significantly reduce the impact of uniform response biases typically associated with rating scales. Thurstone's (1927, 1931) model provides a powerful framework for modeling comparative data such as paired comparisons and rankings. Although Thurstonian models are generally presented as scaling models, that is, stimuli-centered models, they can also be used as person-centered models. In this article, we discuss how Thurstone's model for comparative data can be formulated as item response theory models so that respondents' scores on underlying dimensions can be estimated. Item parameters and latent trait scores can be readily estimated using a widely used statistical modeling program. Simulation studies show that item characteristic curves can be accurately estimated with as few as 200 observations and that latent trait scores can be recovered to a high precision. Empirical examples are given to illustrate how the model may be applied in practice and to recommend guidelines for designing ranking and paired comparisons tasks in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elimination by aspects: A theory of choice
Tversky, A. (1972) · Psychological Review · doi:10.1037/h0032955 · Cited by 3,365
Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM Algorithm
Bock, R. D., & Aitkin, M. (1981) · Psychometrika · doi:10.1007/bf02293801 · Cited by 2,339
Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation
Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903203573 · Cited by 685
Self-citationPrediger's dimensional representation of Holland's RIASEC circumplex.
Rounds, J., & Tracey, T. J. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.6.875 · Cited by 218
Research works printed but not linked: 32
- Bock R. D., 1997, Handbook of modern item response theory, 33, 10.1007/978-1-4757-2691-6_2 · DOI
- Bock R. D., 1968, The measurement and prediction of judgment and choice
- 10.1037/1082-989X.9.4.453 · DOI
- Brown A., 2009, Improving forced-choice tests with IRT.
- Brown A., Educational and Psychological Measurement
- 10.1207/S15328007SEM0901_4 · DOI · Paper page
- du Toit M., 2003, IRT from SSI
- 10.1016/j.jvb.2007.04.001 · doi:10.1016/j.jvb.2007.04.001
- 10.1037/a0015825 · DOI · Paper page
- Hogan R., 1983, Nebraska symposium on motivation 1982. Personality: Current theory and research, 55
- Holland J. L., 1997, Making vocational choices: A theory of vocational personalities and work environments,
- 10.1007/BF02294299 · DOI
- 10.1007/BF02294836 · DOI · Paper page
- 10.1016/S0165-4896(02)00017-3 · DOI
- 10.1037/1082-989X.10.3.285 · DOI
- 10.1037/1082-989X.11.4.344 · DOI · Paper page
- Maydeu-Olivares A., 2007, Multivariate Behavioral Research, 42, 323, 10.1080/00273170701360555 · doi:10.1080/00273170701360555
- McDonald R. P., 1999, Test theory: A unified approach
- 10.1037/0021-9010.78.2.218 · doi:10.1037/0021-9010.78.2.218 · Paper page
- Muthén B., 1993, Testing structural equations models, 205
- Muthén B., 1997, Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes
- Muthén L. K., 1998, M
- 10.1007/978-0-387-89976-3 · DOI · Paper page
- Schuerger J. M., 2001, 16PF-APQ manual.
- Takane Y., 1987, Communication and Cognition, 20, 45
- 10.1007/BF02294363 · DOI · Paper page
- Thurstone L. L., 1927, Psychological Review, 79, 281
- 10.1037/h0070025 · DOI
- 10.1006/jmps.2000.1353 · doi:10.1006/jmps.2000.1353
- 10.1177/0022022104264126 · DOI · Paper page
- Warr P., 2007, Work, happiness, and unhappiness.
- Yang M., 2010, Exploring ways of measuring person-job fit to predict engagement.
Cited by
Item Response Modeling of Forced-Choice Questionnaires
Brown, A., & Maydeu-Olivares, A. (2011) · Educational and Psychological Measurement · doi:10.1177/0013164410375112 · Cited by 323
Self-citationSalgado, J. F., & Táuriz, G. (2014) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2012.716198 · Cited by 205
Salgado, J. F. (2017) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.1016/j.rpto.2017.07.001 · Cited by 75
Detecting careless responding in multidimensional forced-choice questionnaires
Kupffer, R., Frick, S., & Wetzel, E. (2024) · Educational and Psychological Measurement · doi:10.1177/00131644231222420 · Cited by 17
“Therefore, the sample size was determined based on simulation studies regarding the recovery of the model parameters (e.g., Maydeu-Olivares & Brown, 2010).”
Martínez, A., Lado, M., Cuadrado, D., & Salgado, J. F. (2025) · Journal of Work and Organizational Psychology · doi:10.5093/jwop2025a3 · Cited by 4
Metadata
- Authors
- Maydeu-Olivares, A., & Brown, A.
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2010-11-30
- Volume
- 45
- Issue
- 6
- Pages
- 935-974
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W2067846371
- Cited by
- 80
- References
- 4
- FWCI
- 4.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Item Response Modeling of Paired Comparison and Ranking Data. https://app.cochat.ai/papers/10.1080/00273171.2010.531231
- The paper
- Maydeu-Olivares, A., & Brown, A. (2010). Item Response Modeling of Paired Comparison and Ranking Data. Multivariate Behavioral Research. https://doi.org/10.1080/00273171.2010.531231
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.