The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Bayesian Item Response Modeling in R with brms and Stan
Open accessAbstract
Item response theory (IRT) is widely applied in the human sciences to model persons' responses on a set of items measuring one or more latent constructs. While several R packages have been developed that implement IRT models, they tend to be restricted to respective pre-specified classes of models. Further, most implementations are frequentist while the availability of Bayesian methods remains comparably limited. I demonstrate how to use the R package brms together with the probabilistic programming language Stan to specify and fit a wide range of Bayesian IRT models using flexible and intuitive multilevel formula syntax. Further, item and person parameters can be related in both a linear or non-linear manner. Various distributions for categorical, ordinal, and continuous responses are supported. Users may even define their own custom response distribution for use in the presented framework. Common IRT model classes that can be specified natively in the presented framework include 1PL and 2PL logistic models optionally also containing guessing parameters, graded response and partial credit ordinal models, as well as drift diffusion models of response times coupled with binary decisions. Posterior distributions of item and person parameters can be conveniently extracted and postprocessed. Model fit can be evaluated and compared using Bayes factors and efficient cross-validation procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
brms : An R Package for Bayesian Multilevel Models Using Stan
Bürkner, P.-C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v080.i01 · Cited by 9,476
Self-citationStan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754 · cited 2×
“pt_delta reduces or ideally eliminates the number of \divergent transition" that indicate problems of the sampler exploring the full posterior distribution and thus bias the posterior estimates (Carpenter et al. 2017;Homan and Gelman 2014). From the standard outputs (not shown here), we can see that the model has…”
Method(2015) · doi:10.1007/s11222-016-9696-4 · Cited by 5,611
(1996) · Institutional Research Information System University of Turin (University of Turin) · doi:10.1111/j · Cited by 5,486
Applications of Item Response Theory To Practical Testing Problems
Lord, F. M. (2012) · Routledge eBooks · doi:10.4324/9780203056615 · Cited by 5,007
MCMC Methods for Multi-Response Generalized Linear Mixed Models: The MCMCglmmR Package
Hadfield, J. D. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i02 · Cited by 4,799
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513
Applying the Rasch Model: Fundamental Measurement in the Human Sciences
Bond, T. G., & Fox, C. M. (2003) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2003.tb01103.x · Cited by 4,492
Generalized additive models for location, scale and shape.
Rigby, R. A., & Stasinopoulos, D. M. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00510.x · Cited by 3,228
Advanced Bayesian Multilevel Modeling with the R Package brms
Bürkner, P.-C. (2018) · The R Journal · doi:10.32614/rj-2018-017 · Cited by 3,015
Self-citationmirt: A Multidimensional Item Response Theory Package for the R Environment
Chalmers, R. P. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i06 · Cited by 2,643
Handbook of Modern Item Response Theory
(1997) · Springer eBooks · doi:10.1007/978-1-4757-2691-6 · Cited by 2,305
Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation
Griewank, A., & Walther, A. (1987) · Cited by 2,166
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · The Statistician · doi:10.2307/2348590 · Cited by 2,091
The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
Hoffman, M. D., & Gelman, A. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.4246 · Cited by 1,713
Analysis of Ordinal Categorical Data
Agresti, A. (2010) · Wiley Series in Probability and Statistics · doi:10.1002/9780470594001 · Cited by 1,620
The horseshoe estimator for sparse signals
Carvalho, C. M., Polson, N. G., & Scott, J. G. (2010) · Biometrika · doi:10.1093/biomet/asq017 · Cited by 1,381
Visualization in Bayesian Workflow
Gabry, J., Simpson, D., Vehtari, A., Betancourt, M., & Gelman, A. (2019) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12378 · Cited by 1,122
Generating random correlation matrices based on vines and extended onion method
Lewandowski, D., Kurowicka, D., & Joe, H. (2009) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2009.04.008 · Cited by 1,051
On General Laws and the Meaning of Measurement in Psychology
Rasch, G. (1961) · Project Euclid (Cornell University) · Cited by 766
Ordinal Regression Models in Psychology: A Tutorial
Bürkner, P.-C., & Vuorre, M. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918823199 · Cited by 689
Self-citationSIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION
Meng, X., & Wong, W. H. (1996) · Cited by 625
Explanatory Item Response Models: A Generalized Linear and Nonlinear Approach
(2004) · Springer eBooks · doi:10.1007/978-1-4757-3990-9 · Cited by 598
A Useful Distribution for Fitting Discrete Data: Revival of the Conway–Maxwell–Poisson Distribution
Shmueli, G., Minka, T. P., Kadane, J. B., Borle, S., & Boatwright, P. (2005) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/j.1467-9876.2005.00474.x · Cited by 574
The Corsini Encyclopedia of Psychology
(2010) · Wiley eBooks · doi:10.1002/9780470479216 · Cited by 538
Analysis of response time distributions: An example using the Stroop task.
Heathcote, A., Popiel, S. J., & Mewhort, D. J. K. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.109.2.340 · Cited by 537
R for Data Science: Import, Tidy, Transform, Visualize, and Model Data
Wickham, H., & Grolemund, G. (2016) · Cited by 524
Extended Rasch Modeling: The eRm Package for the Application of IRT Models in R
Mair, P., & Hatzinger, R. (2007) · Journal of Statistical Software · doi:10.18637/jss.v020.i09 · Cited by 517
A Conceptual Introduction to Hamiltonian Monte Carlo
Betancourt, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.02434 · Cited by 509
Methodology Review: Statistical Approaches for Assessing Measurement Bias
Millsap, R. E., & Everson, H. T. (1993) · Applied Psychological Measurement · doi:10.1177/014662169301700401 · Cited by 491
Sparsity information and regularization in the horseshoe and other shrinkage priors
Piironen, J., & Vehtari, A. (2017) · Electronic Journal of Statistics · doi:10.1214/17-ejs1337si · Cited by 457
The geometric foundations of Hamiltonian Monte Carlo
Betancourt, M., Byrne, S., Livingstone, S., & Girolami, M. (2017) · Bernoulli · doi:10.3150/16-bej810 · Cited by 452
Bayesian Item Response Modeling: Theory and Applications
Fox, J.-P. (2010) · doi:10.1007/978-1-4419-0742-4 · Cited by 448
The Prior Can Often Only Be Understood in the Context of the Likelihood
Gelman, A., Simpson, D., & Betancourt, M. (2017) · Entropy · doi:10.7916/d8v99mjx · Cited by 430
blavaan : Bayesian Structural Equation Models via Parameter Expansion
Merkle, E. C., & Rosseel, Y. (2018) · Journal of Statistical Software · doi:10.18637/jss.v085.i04 · Cited by 360
On the linear relation between the mean and the standard deviation of a response time distribution.
Wagenmakers, E.-J., & Brown, S. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.830 · Cited by 354
The Estimation of Item Response Models with the<tt>lmer</tt>Function from the lme4 Package in R
Boeck, P. D., Bakker, M., Zwitser, R., Nivard, M., Hofman, A., Tuerlinckx, F., & Partchev, I. (2011) · Journal of Statistical Software · doi:10.18637/jss.v039.i12 · Cited by 338
Comparison of Bayesian predictive methods for model selection
Piironen, J., & Vehtari, A. (2017) · Statistics and Computing · doi:10.1007/s11222-016-9649-y · Cited by 294
bridgesampling: An R Package for Estimating Normalizing Constants
Gronau, Q. F., Singmann, H., & Wagenmakers, E.-J. (2020) · Journal of Statistical Software · doi:10.18637/jss.v092.i10 · Cited by 222
Rasch Trees: A New Method for Detecting Differential Item Functioning in the Rasch Model
Strobl, C., Kopf, J., & Zeileis, A. (2013) · Psychometrika · doi:10.1007/s11336-013-9388-3 · Cited by 212
van der Maas, H. L. J., Molenaar, D., Maris, G., Kievit, R. A., & Borsboom, D. (2011) · Psychological Review · doi:10.1037/a0022749 · Cited by 179
The Rasch Rating Model and the Disordered Threshold Controversy
Adams, R. J., Wu, M., & Wilson, M. R. (2012) · Educational and Psychological Measurement · doi:10.1177/0013164411432166 · Cited by 161
Global Monte Carlo algorithms for many-fermion systems
Creutz, M. J. (1988) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.38.1228 · Cited by 150
To Bayes or Not to Bayes, From Whether to When: Applications of Bayesian Methodology to Modeling
Rupp, A. A., Dey, D. K., & Zumbo, B. D. (2004) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_7 · Cited by 148
Meng, X., & Schilling, S. G. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002457 · Cited by 114
Two Interpretations of the Discrimination Parameter
Tuerlinckx, F., & de Boeck, P. A. L. (2005) · Psychometrika · doi:10.1007/s11336-000-0810-3 · Cited by 111
Two Rules of Identification for Structural Equation Models
Bollen, K. A., & Davis, W. R. (2009) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510903008261 · Cited by 105
Modelling Compositional Data Using Dirichlet Regression Models
Hijazi, R. H., & Jernigan, R. W. (2007) · Cited by 95
Tree-Based Global Model Tests for Polytomous Rasch Models
Komboz, B., Strobl, C., & Zeileis, A. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164416664394 · Cited by 81
Schauberger, G., & Mair, P. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01224-2 · Cited by 65
Fixing the c Parameter in the Three-Parameter Logistic Model
(2020) · doi:10.7275/f0gz-kc87 · Cited by 55
Molenaar, D., Tuerlinckx, F., & van der Maas, H. L. J. (2015) · Journal of Statistical Software · doi:10.18637/jss.v066.i04 · Cited by 46
Mental rotation is not easily cognitively penetrable
Borst, G., Kievit, R., Thompson, W. L., & Kosslyn, S. M. (2011) · Journal of Cognitive Psychology · doi:10.1080/20445911.2011.454498 · Cited by 45
Analysing Standard Progressive Matrices (SPM-LS) with Bayesian Item Response Models
Bürkner, P. (2020) · Journal of Intelligence · doi:10.3390/jintelligence8010005 · Cited by 30
Self-citationAutomatic item generation theory and practice
Gierl, M. J. (2013) · Cited by 26
Paulewicz, B., & Blaut, A. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01370-y · Cited by 15
Cited by
Rating norms should be calculated from cumulative link mixed effects models
Taylor, J. E., Rousselet, G. A., Scheepers, C., & Sereno, S. C. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01814-7 · Cited by 126
A new avenue for Bayesian inference with INLA
Van Niekerk, J., Krainski, E., Rustand, D., & Rue, H. (2023) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2023.107692 · Cited by 75
Widmer, C. L., Sarker, M. K., Nadella, S., Fiechter, J., Juvina, I., Minnery, B., Hitzler, P., Schwartz, J., & Raymer, M. (2023) · Journal of Web Semantics · doi:10.1016/j.websem.2023.100807 · Cited by 10
Metadata
- Authors
- Bürkner, P.-C.
- Venue
- Journal of Statistical Software
- Publisher
- Foundation for Open Access Statistic
- Published
- 2021
- Volume
- 100
- Issue
- 5
- ISSN
- 1548-7660 (ISSN-L)
- OpenAlex
- W3214743865
- Cited by
- 791
- References
- 66
- FWCI
- 49.82
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.