CoChat

Item Response Modeling of Paired Comparison and Ranking Data

Maydeu-Olivares, Alberto, Brown, Anna · 2010 · Multivariate Behavioral Research
Cited by 80

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

The comparative format used in ranking and paired comparisons tasks can significantly reduce the impact of uniform response biases typically associated with rating scales. Thurstone's (1927, 1931) model provides a powerful framework for modeling comparative data such as paired comparisons and rankings. Although Thurstonian models are generally presented as scaling models, that is, stimuli-centered models, they can also be used as person-centered models. In this article, we discuss how Thurstone's model for comparative data can be formulated as item response theory models so that respondents' scores on underlying dimensions can be estimated. Item parameters and latent trait scores can be readily estimated using a widely used statistical modeling program. Simulation studies show that item characteristic curves can be accurately estimated with as few as 200 observations and that latent trait scores can be recovered to a high precision. Empirical examples are given to illustrate how the model may be applied in practice and to recommend guidelines for designing ranking and paired comparisons tasks in the future.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/00273171.2010.531231

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 32

  1. Bock R. D., 1997, Handbook of modern item response theory, 33, 10.1007/978-1-4757-2691-6_2 · DOI
  2. Bock R. D., 1968, The measurement and prediction of judgment and choice
  3. 10.1037/1082-989X.9.4.453 · DOI
  4. Brown A., 2009, Improving forced-choice tests with IRT.
  5. Brown A., Educational and Psychological Measurement
  6. 10.1207/S15328007SEM0901_4 · DOI · Paper page
  7. du Toit M., 2003, IRT from SSI
  8. 10.1016/j.jvb.2007.04.001 · doi:10.1016/j.jvb.2007.04.001
  9. 10.1037/a0015825 · DOI · Paper page
  10. Hogan R., 1983, Nebraska symposium on motivation 1982. Personality: Current theory and research, 55
  11. Holland J. L., 1997, Making vocational choices: A theory of vocational personalities and work environments,
  12. 10.1007/BF02294299 · DOI
  13. 10.1007/BF02294836 · DOI · Paper page
  14. 10.1016/S0165-4896(02)00017-3 · DOI
  15. 10.1037/1082-989X.10.3.285 · DOI
  16. 10.1037/1082-989X.11.4.344 · DOI · Paper page
  17. Maydeu-Olivares A., 2007, Multivariate Behavioral Research, 42, 323, 10.1080/00273170701360555 · doi:10.1080/00273170701360555
  18. McDonald R. P., 1999, Test theory: A unified approach
  19. 10.1037/0021-9010.78.2.218 · doi:10.1037/0021-9010.78.2.218 · Paper page
  20. Muthén B., 1993, Testing structural equations models, 205
  21. Muthén B., 1997, Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes
  22. Muthén L. K., 1998, M
  23. 10.1007/978-0-387-89976-3 · DOI · Paper page
  24. Schuerger J. M., 2001, 16PF-APQ manual.
  25. Takane Y., 1987, Communication and Cognition, 20, 45
  26. 10.1007/BF02294363 · DOI · Paper page
  27. Thurstone L. L., 1927, Psychological Review, 79, 281
  28. 10.1037/h0070025 · DOI
  29. 10.1006/jmps.2000.1353 · doi:10.1006/jmps.2000.1353
  30. 10.1177/0022022104264126 · DOI · Paper page
  31. Warr P., 2007, Work, happiness, and unhappiness.
  32. Yang M., 2010, Exploring ways of measuring person-job fit to predict engagement.

Cited by

See all 80

Metadata

Authors
Maydeu-Olivares, A., & Brown, A.
Venue
Multivariate Behavioral Research
Published
2010-11-30
Volume
45
Issue
6
Pages
935-974
ISSN
  • 0027-3171 (ISSN-L)
  • 1532-7906
OpenAlex
W2067846371
Cited by
80
References
4
FWCI
4.36
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Item Response Modeling of Paired Comparison and Ranking Data. https://app.cochat.ai/papers/10.1080/00273171.2010.531231
The paper
Maydeu-Olivares, A., & Brown, A. (2010). Item Response Modeling of Paired Comparison and Ranking Data. Multivariate Behavioral Research. https://doi.org/10.1080/00273171.2010.531231

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.