Efficient Standard Error Formulas of Ability Estimators with Dichotomous Item Response Models
Abstract
This paper focuses on the computation of asymptotic standard errors (ASE) of ability estimators with dichotomous item response models. A general framework is considered, and ability estimators are defined from a very restricted set of assumptions and formulas. This approach encompasses most standard methods such as maximum likelihood, weighted likelihood, maximum a posteriori, and robust estimators. A general formula for the ASE is derived from the theory of M-estimation. Well-known results are found back as particular cases for the maximum and robust estimators, while new ASE proposals for the weighted likelihood and maximum a posteriori estimators are presented. These new formulas are compared to traditional ones by means of a simulation study under Rasch modeling.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Simulating 3600 examinees with true ability parameters drawn from a uniform distribution across 36 discrete ability levels from −3.5 to +3.5 provides a more stringent test of the CAT algorithm's robustness across the entire ability spectrum.
“We simulated 3600 examinees with true ability parameters drawn from a uniform distribution, spanning 36 discrete ability levels from −3.5 to +3.5 at intervals of 0.2. Each ability level was replicated 100 times. This uniform sampling, as opposed to a normal distribution, provides a more stringent test of the CAT algorithm’s robustness across the entire ability spectrum15,29,33.”
From Leveraging computerized adaptive testing for cost-effective evaluation of large language models in medical benchmarking (2026) · cites this paper as [33]
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Robust estimation of a location parameter
Huber, P. J. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703732 · Cited by 7,228 · see citing works
Huber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066 · see citing works
Applications of Item Response Theory To Practical Testing Problems
Lord, F. M. (2012) · Routledge eBooks · doi:10.4324/9780203056615 · Cited by 5,009 · see citing works
(1967) · Project Euclid (Cornell University) · Cited by 4,720 · see citing works
(2000) · Cited by 4,106 · see citing works
(1968) · Addison-Wesley eBooks · Cited by 2,001 · see citing works
Item Response Theory: Principles and Applications
Hambleton, R. K., & Swaminathan, H. (1984) · Medical Entomology and Zoology · Cited by 1,779 · see citing works
Hambleton, R. K., & Swaminathan, H. (1985) · doi:10.1007/978-94-017-1988-9 · Cited by 1,777 · see citing works
Weighted Likelihood Estimation of Ability in Item Response Theory
Warm, T. A. (1989) · Psychometrika · doi:10.1007/bf02294627 · Cited by 1,216 · see citing works
Computerized Adaptive Testing: A Primer
Wainer, H., Dorans, N. J., Flaugher, R. L., Green, B. F., & Mislevy, R. J. (1990) · Medical Entomology and Zoology · Cited by 1,169 · see citing works
Item Response Theory: Parameter Estimation Techniques.
Ackerman, T. A., & Baker, F. B. (1993) · Journal of the American Statistical Association · doi:10.2307/2290371 · Cited by 833 · see citing works
Introduction to Nonparametric Item Response Theory
Sijtsma, K., & Molenaar, I. W. (2002) · Sage eBooks · doi:10.4135/9781412984676 · Cited by 765 · see citing works
Baker, F. B., & Kim, S.-H. (2004) · CRC Press eBooks · doi:10.1201/9781482276725 · Cited by 746 · see citing works
Object-Oriented Computation of Sandwich Estimators
Zeileis, A. (2006) · Journal of Statistical Software · doi:10.18637/jss.v016.i09 · Cited by 699 · see citing works
Wainer, H., Dorans, N. J., Flaugher, R. L., Green, B. F., & Mislevy, R. J. (2000) · Routledge eBooks · doi:10.4324/9781410605931 · Cited by 659 · see citing works
Adaptive EAP Estimation of Ability in a Microcomputer Environment
Bock, R. D., & Mislevy, R. J. (1982) · Applied Psychological Measurement · doi:10.1177/014662168200600405 · Cited by 637 · see citing works
Embretson, S. E., & Diehl, K. A. (2000) · Encyclopedia of psychology, Vol. 4. · doi:10.1037/10519-153 · Cited by 595 · see citing works
Stefanski, L. A., & Boos, D. D. (2002) · The American Statistician · doi:10.1198/000313002753631330 · Cited by 480 · see citing works
Bayes Modal Estimation in Item Response Models
Mislevy, R. J. (1986) · Psychometrika · doi:10.1007/bf02293979 · Cited by 306 · see citing works
Theory of Probability and Random Processes
Koralov, L., & Sinai, Y. G. (2007) · Universitext · doi:10.1007/978-3-540-68829-7 · Cited by 246 · see citing works
BAYES MODAL ESTIMATION IN ITEM RESPONSE MODELS*
Mislevy, R. J. (1985) · ETS Research Report Series · doi:10.1002/j.2330-8516.1985.tb00118.x · Cited by 240 · see citing works
Computerized adaptive testing: A primer, 2nd ed.
Wainer, H. (2000) · Cited by 217 · see citing works
On Robustness in the Logistic Regression Model
Carroll, R. J., & Pederson, S. P. (1993) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1993.tb01934.x · Cited by 195 · see citing works
Lord, F. M. (1983) · Psychometrika · doi:10.1007/bf02294018 · Cited by 183 · see citing works
MAXIMUM LIKELIHOOD AND BAYESIAN PARAMETER ESTIMATION IN ITEM RESPONSE THEORY
Lord, F. M. (1986) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1986.tb00241.x · Cited by 154 · see citing works
Random Generation of Response Patterns under Computerized Adaptive Testing with theRPackagecatR
Magis, D., & Raîche, G. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i08 · Cited by 122 · see citing works
Self-citationProbability Theory With Applications.
Mittal, Y., & Rao, M. M. (1986) · Journal of the American Statistical Association · doi:10.2307/2289275 · Cited by 108 · see citing works
Asymptotics of Estimating Equations under Natural Conditions
Yuan, K., & Jennrich, R. I. (1998) · Journal of Multivariate Analysis · doi:10.1006/jmva.1997.1731 · Cited by 103 · see citing works
Probability Theory with Applications
Rao, M. M., & Swift, R. J. (2006) · Springer eBooks · doi:10.1007/0-387-27731-5 · Cited by 91 · see citing works
Statistical theory for logistic mental test models with a prior distribution of ability
Birnbaum, A. (1969) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(69)90005-4 · Cited by 77 · see citing works
Robust Estimation of Ability in the Rasch Model
Wainer, H., & Wright, B. D. (1980) · Psychometrika · doi:10.1007/bf02293910 · Cited by 63 · see citing works
Biweight Estimates of Latent Ability
Mislevy, R. J., & Bock, R. D. (1982) · Educational and Psychological Measurement · doi:10.1177/001316448204200302 · Cited by 63 · see citing works
Robust Estimation of Latent Ability in Item Response Models
Schuster, C., & Yuan, K. (2011) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610396890 · Cited by 40 · see citing works
The Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing
Patton, J. M., Cheng, Y., Yuan, K., & Diao, Q. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612461727 · Cited by 30 · see citing works
The Problem of Bias in Person Parameter Estimation in Adaptive Testing
Doebler, A. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612443304 · Cited by 15 · see citing works
Magis, D. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12027 · Cited by 10 · see citing works
Self-citationAsymptotic properties of the Bayes and pseudo Bayes estimators of ability in item response theory
Ogasawara, H. (2012) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2012.08.013 · Cited by 9 · see citing works
Magis, D. (2013) · Applied Psychological Measurement · doi:10.1177/0146621613496890 · Cited by 9 · see citing works
Self-citationAsymptotic cumulants of ability estimators using fallible item parameters
Ogasawara, H. (2013) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2013.04.008 · Cited by 6 · see citing works
catIrt: Simulate IRT-Based Computerized Adaptive Tests
Nydick, S. W. (2012) · doi:10.32614/cran.package.catirt · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A computerized adaptive testing advancing the measurement of subjective well-being
Wu, Y., Cai, Y., & Tu, D. (2019) · Journal of Pacific Rim Psychology · doi:10.1017/prp.2019.6 · Cited by 8 · see citing works
Efficient Standard Errors in Item Response Theory Models for Short Tests
Ippel, L., & Magis, D. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164419882072 · Cited by 5 · see citing works
Self-citationAdaptives Testen von Textverständnis in der Grundschule
Ludewig, U., Trendtel, M., Schlitter, T., & McElvany, N. (2021) · Diagnostica · doi:10.1026/0012-1924/a000279 · Cited by 4 · see citing works
On the Finiteness of the Weighted Likelihood Estimator of Ability
Magis, D., & Verhelst, N. D. (2016) · Psychometrika · doi:10.1007/s11336-016-9518-9 · Cited by 4 · see citing works
Self-citationAn Overview of Item Response Theory
Magis, D., Yan, D., & von Davier, A. A. (2017) · Use R! · doi:10.1007/978-3-319-69218-0_2 · Cited by 3 · see citing works
Self-citationZheng, T., Jiang, Z., Liu, J., & Feng, S. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02671-w · Cited by 1 · see citing works
Constructing a Robust Score Scale from IRT Scores with Informed Boundaries
Choe, E. M., & Han, K. T. (2022) · Journal of Educational Measurement · doi:10.1111/jedm.12307 · Cited by 1 · see citing works
Simplicity Above Elegance: Another Look at the Asymptotically Correct Standardization of Snijders
Sinharay, S. (2026) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986251415200 · Cited by 1 · see citing works
Maintaining Score Scales Over Time: A Comparison of Five Scoring Methods
Kim, S. Y., & Lee, W. (2023) · Applied Measurement in Education · doi:10.1080/08957347.2023.2172015 · Cited by 1 · see citing works
catR: Generation of IRT Response Patterns under Computerized Adaptive Testing
David Magis (U Liege, B. (2010) · doi:10.32614/cran.package.catr · Cited by 1 · see citing works
- Authors
- Magis, D.
- Affiliations
- University of Liège (BE)
- Corresponding author
- Magis, David
- Venue
- Psychometrika
- Publisher
- Cambridge University Press (CUP)
- Published
- 2016-03
- Volume
- 81
- Issue
- 1
- Pages
- 184-200
- ISSN
- 0033-3123 (ISSN-L)
- 1860-0980
- OpenAlex
- W2086007547
- Cited by
- 9
- References
- 41
- Citations by year
- 2026: 1 · 2023: 1 · 2022: 1 · 2021: 2 · 2019: 2 · 2017: 1 · 2016: 1
- FWCI
- 0.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychometrika (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Lirias (submittedVersion)
- ORBi (University of Liège) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Keywords
- ability estimation, asymptotic standard errors, M-estimation, maximum likelihood estimation, weighted likelihood estimation, maximum a posteriori estimation, robust estimators, Rasch model
- MeSH terms
- Bayes Theorem, Computer Simulation, Humans, Psychometrics, Models, Statistical, Likelihood Functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review