The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations
Open accessAbstract
The assumption of local independence is central to all item response theory (IRT) models. Violations can lead to inflated estimates of reliability and problems with construct validity. For the most widely used fit statistic Q 3, there are currently no well-documented suggestions of the critical values which should be used to indicate local dependence (LD), and for this reason, a variety of arbitrary rules of thumb are used. In this study, an empirical data example and Monte Carlo simulation were used to investigate the different factors that can influence the null distribution of residual correlations, with the objective of proposing guidelines that researchers and practitioners can follow when making decisions about LD during scale development and validation. A parametric bootstrapping procedure should be implemented in each separate situation to obtain the critical value of LD applicable to the data set, and provide example critical values for a number of data structure situations. The results show that for the Q 3 fit statistic, no single critical value is appropriate for all situations, as the percentiles in the empirical null distribution are influenced by the number of items, the sample size, and the number of response categories. Furthermore, the results show that LD should be considered relative to the average observed residual correlation, rather than to a uniform value, as this results in more stable percentiles for the null distribution of an adjusted fit statistic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Probabilistic Models for Some Intelligence and Attainment Tests
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,939
A Rasch model for partial credit scoring
Masters, G. N. (1982) · Psychometrika · doi:10.1007/bf02296272 · Cited by 3,782
A Rating Formulation for Ordered Response Categories
Andrich, D. (1978) · Psychometrika · doi:10.1007/bf02293814 · Cited by 2,970
Mayer, T. F., Lazarsfeld, P. F., & Henry, N. W. (1969) · American Sociological Review · doi:10.2307/2092222 · Cited by 2,384
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 3×
“Other approaches include using testlet models (Wang & Wilson, 2005; Wilson & Adams, 1995) or a bifactor model (Reise, 2012).”
Probabilistic Models for some Intelligence and Attainment Tests.
Wolins, L., Wright, B. D., & Rasch, G. (1982) · Journal of the American Statistical Association · doi:10.2307/2287805 · Cited by 1,979
Tennant, A., & Conaghan, P. G. (2007) · Arthritis Care & Research · doi:10.1002/art.23108 · Cited by 1,638
FISHER, R. A. (1915) · Biometrika · doi:10.1093/biomet/10.4.507 · Cited by 1,574
Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., et al. (2007) · Medical Care · doi:10.1097/01.mlr.0000250483.85507.04 · Cited by 1,491
Weighted Likelihood Estimation of Ability in Item Response Theory
Warm, T. A. (1989) · Psychometrika · doi:10.1007/bf02294627 · Cited by 1,216
Local Dependence Indexes for Item Pairs Using Item Response Theory
Chen, W.-H., & Thissen, D. (1997) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165285 · Cited by 806
Yen, W. M. (1984) · Applied Psychological Measurement · doi:10.1177/014662168400800201 · Cited by 798
Scaling Performance Assessments: Strategies for Managing Local Item Dependence
Yen, W. M. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb00423.x · Cited by 744
Differential Item Performance and the Mantel–Haenszel Procedure
(2013) · Test Validity · doi:10.4324/9780203056905-19 · Cited by 721
A Goodness of Fit Test for the Rasch Model
Andersen, E. B. (1973) · Psychometrika · doi:10.1007/bf02291180 · Cited by 664
Controversy and the Rasch Model: A Characteristic of Incompatible Paradigms?
Andrich, D. (2004) · Medical Care · doi:10.1097/01.mlr.0000103528.48582.7c · Cited by 415
A BAYESIAN RANDOM EFFECTS MODEL FOR TESTLETS
Bradlow, E. T., Wainer, H., & Wang, X. (1998) · ETS Research Report Series · doi:10.1002/j.2333-8504.1998.tb01752.x · Cited by 315
Kelderman, H. (1984) · Psychometrika · doi:10.1007/bf02294174 · Cited by 228
Testing the Conditional Independence and Monotonicity Assumptions of Item Response Theory
Rosenbaum, P. R. (1984) · Psychometrika · doi:10.1007/bf02306030 · Cited by 202
Marais, I., & Andrich, D. (2008) · PubMed · Cited by 196
Wang, W.-C., & Wilson, M. (2005) · Applied Psychological Measurement · doi:10.1177/0146621604271053 · Cited by 192
Two New Test Statistics for the Rasch Model
van den Wollenberg, A. L. (1982) · Psychometrika · doi:10.1007/bf02296270 · Cited by 150
Wilson, M. R., & Adams, R. J. (1995) · Psychometrika · doi:10.1007/bf02301412 · Cited by 140
Effects of varying magnitude and patterns of response dependence in the unidimensional Rasch model.
Marais, I., & Andrich, D. (2008) · PubMed · Cited by 130
Defiant Teens : A Clinician's Manual for Assessment and Family Intervention
Barkley, R. A., Edwards, G. H., & Robin, A. L. (1999) · Medical Entomology and Zoology · Cited by 118
Rasch analysis of the Multiple Sclerosis Impact Scale (MSIS-29)
Ramp, M., Khan, F., Misajon, R., & Pallant, J. (2009) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-7-58 · Cited by 95
Marais, I. (2012) · Rasch Models in Health · doi:10.1002/9781118574454.ch7 · Cited by 95
Analysis of Local Dependence and Multidimensionality in Graphical Loglinear Rasch Models
Kreiner, S., & Christensen, K. B. (2004) · Communication in Statistics- Theory and Methods · doi:10.1081/sta-120030148 · Cited by 94
Self-citationValidity and Objectivity in Health-Related Scales: Analysis by Graphical Loglinear Rasch Models
Kreiner, S., & Christensen, K. B. (2007) · Springer eBooks · doi:10.1007/978-0-387-49839-3_21 · Cited by 91
Self-citationAndrich, D. (1985) · Elsevier eBooks · doi:10.1016/b978-0-12-238180-5.50013-6 · Cited by 85
Makransky, G., & Bilenberg, N. (2014) · Assessment · doi:10.1177/1073191114535242 · Cited by 81
Self-citationA Low Back-Specific Version of the SF-36 Physical Functioning Scale
Davidson, M., Keating, J. L., & Eyres, S. (2004) · Spine · doi:10.1097/01.brs.0000103346.38557.73 · Cited by 78
Testing for Local Dependency in Dichotomous and Polytomous Item Response Models
Ip, E. H. (2001) · Psychometrika · doi:10.1007/bf02295736 · Cited by 75
A parametric model for local dependence among test items.
Hoskens, M., & de Boeck, P. A. L. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.3.261 · Cited by 72
Investigating Local Dependence With Conditional Covariance Functions
Douglas, J., Kim, H. R., Habing, B., & Gao, F. (1998) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165318 · Cited by 68
A Note on Item–Restscore Association in Rasch Models
Kreiner, S. (2011) · Applied Psychological Measurement · doi:10.1177/0146621611410227 · Cited by 67
ten Klooster, P. M., Taal, E., & van de Laar, M. A. F. J. (2008) · Arthritis Care & Research · doi:10.1002/art.24065 · Cited by 67
Quantifying Local, Response Dependence Between Two Polytomous Items Using the Rasch Model
Andrich, D., Humphry, S. M., & Marais, I. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612441858 · Cited by 59
Quantifying Response Dependence Between Two Dichotomous Items Using the Rasch Model
Andrich, D., & Kreiner, S. (2010) · Applied Psychological Measurement · doi:10.1177/0146621609360202 · Cited by 55
Pairwise Parameter Estimation in Rasch Models
Zwinderman, A. H. (1995) · Applied Psychological Measurement · doi:10.1177/014662169501900406 · Cited by 55
Locally Dependent Latent Trait Model and the Dutch Identity Revisited
Ip, E. H. (2002) · Psychometrika · doi:10.1007/bf02294990 · Cited by 51
Hissbach, J. C., Klusmann, D., & Hampe, W. (2011) · BMC Medical Education · doi:10.1186/1472-6920-11-83 · Cited by 51
Porta, F. L., Franceschini, M., Caselli, S., Cavallini, P., Susassi, S., & Tennant, A. (2011) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-0797 · Cited by 50
Local Dependence Diagnostics in IRT Modeling of Binary Data
Liu, Y., & Maydeu‐Olivares, A. (2012) · Educational and Psychological Measurement · doi:10.1177/0013164412453841 · Cited by 49
Scott, S. L., & Ip, E. H. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502760046961 · Cited by 46
Lucke, J. F. (2005) · Applied Psychological Measurement · doi:10.1177/0146621604272739 · Cited by 44
Rasch Analysis of the Nottingham Extended Activities of Daily Living Scale
Nair, R., Moreton, B. J., & Lincoln, N. B. (2011) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-0858 · Cited by 43
Identifying Local Dependence With a Score Test Statistic Based on the Bifactor Logistic Model
Liu, Y., & Thissen, D. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612458174 · Cited by 32
Makransky, G., Rogers, M. E., & Creed, P. A. (2014) · Journal of Career Assessment · doi:10.1177/1069072714553555 · Cited by 32
Self-citationComparing score tests and other local dependence diagnostics for the graded response model
Liu, Y., & Thissen, D. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12030 · Cited by 28
Røe, C., Damsgård, E., Fors, T., & Anke, A. (2014) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-15-95 · Cited by 20
Response dependence and the measurement of change.
Marais, I. (2009) · PubMed · Cited by 17
A Q 3 -Based Permutation Test for Assessing Local Independence
Finch, W. H., & Jeffers, H. M. (2015) · Applied Psychological Measurement · doi:10.1177/0146621615622635 · Cited by 10
Cited by
Construct validity of a revised version of the Occupational Balance Questionnaire
Håkansson, C., Wagman, P., & Hagell, P. (2020) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2019.1660801 · Cited by 115
Krägeloh, C. U., Melekhov, V., Alyami, M. M., & Medvedev, O. N. (2024) · doi:10.21203/rs.3.rs-4403120/v1 · Cited by 13
Krägeloh, C. U., Melekhov, V., Alyami, M. M., & Medvedev, O. N. (2025) · Current Psychology · doi:10.1007/s12144-025-08009-1 · Cited by 13
“The residual correlation matrix must not show signs of local dependency among items; a correlation higher than 0.20 relative to the average residual correlation suggests such dependency (Christensen et al., 2016).”
InfluentialYoung, C. A., Mills, R., Langdon, D., Sharrack, B., Majeed, T., Kalra, S., Footitt, D., Rog, D., Harrower, T., Nicholas, R., et al. (2022) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2022.120188 · Cited by 10
Buz, J., Á. Gómez-Martínez, M., Crego, A., Yela, J. R., & Sánchez-Zaballos, E. (2022) · Assessment · doi:10.1177/10731911211018855 · Cited by 3
“2 above the average correlation to judge the presence of local independence (Christensen et al., 2017; Marais, 2013).”
BackgroundInfluential
Metadata
- Authors
- Christensen, K. B., Makransky, G., & Horton, M.
- Venue
- Applied Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2016-11-16
- Volume
- 41
- Issue
- 3
- Pages
- 178-194
- ISSN
- 0146-6216 (ISSN-L)
- 1552-3497
- OpenAlex
- W2532524286
- Cited by
- 691
- References
- 54
- FWCI
- 24.45
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.