The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Applications and Extensions of MCMC in IRT: Multiple Item Types, Missing Data, and Rated Responses
Abstract
Patz and Junker (1999) describe a general Markov chain Monte Carlo (MCMC) strategy, based on Metropolis-Hastings sampling, for Bayesian inference in complex item response theory (IRT) settings. They demonstrate the basic methodology using the two-parameter logistic (2PL) model. In this paper we extend their basic MCMC methodology to address issues such as non-response, designed missingness, multiple raters, guessing behavior and partial credit (polytomous) test items. We apply the basic MCMC methodology to two examples from the National Assessment of Educational Progress 1992 Trial State Assessment in Reading: (a) a multiple item format (2PL, 3PL, and generalized partial credit) subtest with missing response data; and (b) a sequence of rated, dichotomous short-response items, using a new IRT model called the generalized linear logistic test model (GLLTM).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Probabilistic Models for Some Intelligence and Attainment Tests
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,939
Applications of Item Response Theory To Practical Testing Problems
Lord, F. M. (2012) · Routledge eBooks · doi:10.4324/9780203056615 · Cited by 5,007
Statistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576
Understanding the Metropolis-Hastings Algorithm
Chib, S., & Greenberg, E. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476177 · Cited by 4,145
The Calculation of Posterior Distributions by Data Augmentation
Tanner, M. A., & Wong, W. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478458 · Cited by 3,928
Markov Chains for Exploring Posterior Distributions
Tierney, L. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325750 · Cited by 3,452
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,321
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · The Statistician · doi:10.2307/2348590 · Cited by 2,091
Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review
Cowles, M. K., & Carlin, B. P. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476956 · Cited by 2,056
(1968) · Addison-Wesley eBooks · Cited by 2,001
Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods
Smith, A. F. M., & Roberts, G. O. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01466.x · Cited by 1,713
A Generalized Partial Credit Model: Application of an EM Algorithm
Muraki, E. (1992) · Applied Psychological Measurement · doi:10.1177/014662169201600206 · Cited by 1,535
Efficient Metropolis Jumping Rules
Gelman*, A., Roberts**, G. O., & Gilks***, W. R. (1996) · Bayesian Statistics 5 · doi:10.1093/oso/9780198523567.003.0038 · Cited by 796
Detection of differential item functioning using the parameters of item response models.
Thissen, D., Steinberg, L., & Wainer, H. (1993) · Cited by 518
A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models
Patz, R. J., & Junker, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986024002146 · Cited by 476
Self-citationKass, R. E., & Steffey, D. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478825 · Cited by 474 · cited 1×
“…most recently sampled values of 6, This is a general feature of hierarchical mixture and Bayesian models (see for example Bryk & Raudenbush, 1992; Kass & Steffey, 1989; Longford, 1987) that has previously been noted (going back at least to Mislevy, 1985, Section 3) in the development of E-M…”
BackgroundObjective measurement : theory into practice
Wilson, M. R., Engelhard, G., & Draney, K. (1992) · Ablex Pub. Corp. eBooks · Cited by 454
Bayesian Estimation of Normal Ogive Item Response Curves Using Gibbs Sampling
Albert, J. H. (1992) · Journal of Educational Statistics · doi:10.2307/1165149 · Cited by 419
(1995) · Springer eBooks · doi:10.1007/978-1-4612-4230-7 · Cited by 359
LONGFORD, N. T. (1987) · Biometrika · doi:10.1093/biomet/74.4.817 · Cited by 353
A Bayesian Random Effects Model for Testlets
Bradlow, E. T., Wainer, H., & Wang, X. (1999) · Psychometrika · doi:10.1007/bf02294533 · Cited by 342
A BAYESIAN RANDOM EFFECTS MODEL FOR TESTLETS
Bradlow, E. T., Wainer, H., & Wang, X. (1998) · ETS Research Report Series · doi:10.1002/j.2333-8504.1998.tb01752.x · Cited by 315
Bayes Modal Estimation in Item Response Models
Mislevy, R. J. (1986) · Psychometrika · doi:10.1007/bf02293979 · Cited by 305
Examining Rater Errors in the Assessment of Written Composition With a Many‐Faceted Rasch Model
Engelhard, G. (1994) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1994.tb00436.x · Cited by 288
Multilevel Item Response Models: An Approach to Errors in Variables Regression
Adams, R. J., Wilson, M., & Wu, M. (1997) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986022001047 · Cited by 253
BAYES MODAL ESTIMATION IN ITEM RESPONSE MODELS*
Mislevy, R. J. (1985) · ETS Research Report Series · doi:10.1002/j.2330-8516.1985.tb00118.x · Cited by 240
Arminger, G., & Muthén, B. O. (1998) · Psychometrika · doi:10.1007/bf02294856 · Cited by 229
The Vemont Portfolio Assessment Program: Findings and Implications
Koretz, D., Stecher, B., Klein, S., & McCaffrey, D. (1994) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.1994.tb00443.x · Cited by 205
Fitting Full-Information Item Factor Models and an Empirical Investigation of Bridge Sampling
Meng, X.-L., & Schilling, S. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476995 · Cited by 161
Estimation of Latent Group Effects
Mislevy, R. J. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10478215 · Cited by 133
MISSING RESPONSES AND IRT ABILITY ESTIMATION: OMITS, CHOICE, TIME LIMITS, AND ADAPTIVE TESTING
Mislevy, R. J., & Wu, P. (1996) · ETS Research Report Series · doi:10.1002/j.2333-8504.1996.tb01708.x · Cited by 132
Hoijtink, H., & Molenaar, I. W. (1997) · Psychometrika · doi:10.1007/bf02295273 · Cited by 112
Evaluating Rater Accuracy in Performance Assessments
Engelhard, G. (1996) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1996.tb00479.x · Cited by 91
An alternative to traditional GPA for evaluating student performance
Johnson, V. E. (1997) · Statistical Science · doi:10.1214/ss/1030037959 · Cited by 83
On Bayesian Analysis of Multirater Ordinal Data: An Application to Automated Essay Grading
Johnson, V. E. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476662 · Cited by 78
Maximum Likelihood Estimation of Item Response Parameters when Some Responses are Omitted
Lord, F. M. (1983) · Psychometrika · doi:10.1007/bf02293689 · Cited by 66
Monitoring and Improving a Portfolio Assessment System.
Myford, C. M., & Mislevy, R. J. (1995) · Cited by 60
Wainer, H. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb00419.x · Cited by 49
Complex Composites: Issues That Arise in Combining Different Modes of Assessment
Wilson, M. R., & Wang, W. (1995) · Applied Psychological Measurement · doi:10.1177/014662169501900107 · Cited by 40
Prior distribution for item response curves
Tsutakawa, R. K. (1992) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1992.tb00977.x · Cited by 27
Cited by
Focus Article: On the Structure of Educational Assessments
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0101_02 · Cited by 802
Higher-Order Latent Trait Models for Cognitive Diagnosis
de la Torre, J., & Douglas, J. A. (2004) · Psychometrika · doi:10.1007/bf02295640 · Cited by 626
A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models
Patz, R. J., & Junker, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986024002146 · Cited by 476
Self-citationBayesian Estimation of a Multilevel IRT Model Using Gibbs Sampling
Fox, J.-P., & Glas, C. A. W. (2001) · Psychometrika · doi:10.1007/bf02294839 · Cited by 398
MCMC Estimation and Some Model-Fit Analysis of Multidimensional IRT Models
Béguin, A. A., & Glas, C. A. W. (2001) · Psychometrika · doi:10.1007/bf02296195 · Cited by 349
Metadata
- Authors
- Patz, R. J., & Junker, B. W.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 1999
- Volume
- 24
- Issue
- 4
- Pages
- 342
- ISSN
- 1076-9986 (ISSN-L)
- OpenAlex
- W2158518800
- Cited by
- 345
- References
- 45
- FWCI
- 17.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.