Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy.
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In this article, the authors developed a common strategy for identifying differential item functioning (DIF) items that can be implemented in both the mean and covariance structures method (MACS) and item response theory (IRT). They proposed examining the loadings (discrimination) and the intercept (location) parameters simultaneously using the likelihood ratio test with a free-baseline model and Bonferroni corrected critical p values. They compared the relative efficacy of this approach with alternative implementations for various types and amounts of DIF, sample sizes, numbers of response categories, and amounts of impact (latent mean differences). Results indicated that the proposed strategy was considerably more effective than an alternative approach involving a constrained-baseline model. Both MACS and IRT performed similarly well in the majority of experimental conditions. As expected, MACS performed slightly worse in dichotomous conditions but better than IRT in polytomous cases where sample sizes were small. Also, contrary to popular belief, MACS performed well in conditions where DIF was simulated on item thresholds (item means), and its accuracy was not affected by impact.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LISREL 7 : user's reference guide
Jöreskog, K. G., & Sörbom, D. (1989) · Medical Entomology and Zoology · Cited by 9,217
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · cited 3×
“However, metric invariance is cited as a prerequisite for meaningful examination of scalar invariance in many expositions (e.g., Vandenberg & Lance, 2000 ), which is quite different from IRT analysis, where analogous tests are performed simultaneously.”
BackgroundMethodInfluentialApplications of Item Response Theory To Practical Testing Problems
Lord, F. M. (2012) · Routledge eBooks · doi:10.4324/9780203056615 · Cited by 5,007
Assessing Measurement Invariance in Cross‐National Consumer Research
Steenkamp, J. E. M., & Baumgartner, H. (1998) · Journal of Consumer Research · doi:10.1086/209528 · Cited by 4,750
Byrne, B. M. (1998) · Cited by 3,873
(1999) · Cited by 2,653
ESTIMATION OF LATENT ABILITY USING A RESPONSE PATTERN OF GRADED SCORES1
Samejima, F. (1968) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1968.tb00153.x · Cited by 2,587
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · The Statistician · doi:10.2307/2348590 · Cited by 2,091
Structural Equation Modeling with LISREL
Hayduk, L. (1988) · Johns Hopkins University Press eBooks · doi:10.56021/9780801834783 · Cited by 1,855
A practical and theoretical guide to measurement invariance in aging research
Horn, J. L., & Mcardle, J. J. (1992) · Experimental Aging Research · doi:10.1080/03610739208253916 · Cited by 1,592
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993) · Psychological Bulletin · doi:10.1037//0033-2909.114.3.552 · Cited by 1,224
Methods for Identifying Biased Test Items
Camilli, G., & Shepard, L. A. (1994) · Rutgers University Community Repository (Rutgers University) · Cited by 823
Testing factorial invariance across groups: A reconceptualization and proposed new method
Cheung, G. (1999) · Journal of Management · doi:10.1016/s0149-2063(99)80001-4 · Cited by 726
A GENERAL METHOD FOR STUDYING DIFFERENCES IN FACTOR MEANS AND FACTOR STRUCTURE BETWEEN GROUPS
Sörbom, D. (1974) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1974.tb00543.x · Cited by 666
Cheung, G. W., & Rensvold, R. B. (2000) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022100031002003 · Cited by 577
Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002) · Journal of Applied Psychology · doi:10.1037//0021-9010.87.3.517 · Cited by 428
TECHNICAL GUIDELINES FOR ASSESSING COMPUTERIZED ADAPTIVE TESTS
GREEN, B. F., BOCK, R. D., HUMPHREYS, L. G., LINN, R. L., & RECKASE, M. D. (1984) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1984.tb01039.x · Cited by 383
Use of Item Response Theory in the Study of Group Differences in Trace Lines
(2013) · Test Validity · doi:10.4324/9780203056905-20 · Cited by 349
New horizons in testing : latent trait test theory and computerized adaptive testing
Weiss, D. J., & Bock, R. D. (1983) · Cited by 332
IRT-Based Internal Measures of Differential Functioning of Items and Tests
Roju, N. S., van der Linden, W. J., & Fleer, P. F. (1995) · Applied Psychological Measurement · doi:10.1177/014662169501900405 · Cited by 325
Meade, A. W., & Lautenschlager, G. J. (2004) · Organizational Research Methods · doi:10.1177/1094428104268027 · Cited by 301
Application of Unidimensional Item Response Theory Models to Multidimensional Data
Drasgow, F., & Parsons, C. K. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700207 · Cited by 241
Self-citationDrasgow, F. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.95.1.134 · Cited by 221
Self-citationFitting Item Response Theory Models to Two Personality Inventories: Issues and Insights
Chernyshenko, O. S., Stark, S., Chan, K.-Y., Drasgow, F., & Williams, B. (2001) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3604_03 · Cited by 202
Self-citationStudy of the measurement bias of two standardized psychological tests.
Drasgow, F. (1987) · Journal of Applied Psychology · doi:10.1037//0021-9010.72.1.19 · Cited by 198
Self-citationEffects of the testing situation on item responding: Cause for concern.
Stark, S., Chernyshenko, O. S., Chan, K.-Y., Lee, W. C., & Drasgow, F. (2001) · Journal of Applied Psychology · doi:10.1037//0021-9010.86.5.943 · Cited by 164
Self-citationStark, S., Chernyshenko, O. S., & Drasgow, F. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.3.497 · Cited by 137
Self-citationDetection of Differential Item Functioning in the Graded Response Model
Cohen, A. S., Kim, S., & Baker, F. B. (1993) · Applied Psychological Measurement · doi:10.1177/014662169301700402 · Cited by 135
Chan, D. K. (2000) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3502_2 · Cited by 134
A Monte Carlo Comparison of Parametric and Nonparametric Polytomous DIF Detection Methods
Bolt, D. M. (2002) · Applied Measurement in Education · doi:10.1207/s15324818ame1502_01 · Cited by 132
Cross-Language and Cross-Cultural Comparisons in Scale Translations
Candell, G. L., & Hulin, C. L. (1986) · Journal of Cross-Cultural Psychology · doi:10.1177/0022002186017004003 · Cited by 115
LORD, F. M. (1983) · New Horizons in Testing · doi:10.1016/b978-0-12-742780-5.50011-1 · Cited by 69 · cited 1×
“When modeling cognitive ability data, it is not uncommon for IRT researchers to find that the one-parameter logistic model outperforms the three-parameter logistic model in small samples, even though the latter is more likely to be “correct” (Lord, 1983).”
MethodAn Item Response Theory Evaluation of an English Version of the Trier Personality Inventory (TPI)
Ellis, B. B., Becker, P., & Kimmel, H. D. (1993) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022193242001 · Cited by 66
A Cautionary Note on Using G2(dif) to Assess Relative Model Fit in Categorical Data Analysis
Maydeu-Olivares, A., & Cai, L. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4101_4 · Cited by 60
(2001) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-543-1 · Cited by 37
Cited by
Putnick, D. L., & Bornstein, M. H. (2016) · Developmental Review · doi:10.1016/j.dr.2016.06.004 · Cited by 4,369
“…may be tested in a single step (Muthén & Asparouhov, 2002), and models intended to compare SEM-CFA to IRT methods may also report a combined metric-and-scalar invariance step because discrimination and location parameters are conventionally tested together in IRT (e.g., Stark et al., 2006).”
MethodPower and sensitivity of alternative fit indices in tests of measurement invariance.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.568 · Cited by 1,668
Measurement invariance: Review of practice and implications
Schmitt, N., & Kuljanin, G. (2008) · Human Resource Management Review · doi:10.1016/j.hrmr.2008.03.003 · Cited by 759
Gender differences in narcissism: A meta-analytic review.
Grijalva, E., Newman, D. A., Tay, L., Donnellan, M. B., Harms, P. D., Robins, R. W., & Yan, T. (2015) · Psychological Bulletin · doi:10.1037/a0038231 · Cited by 654
“Another important reason for choosing the IRT method is because NPI items have a dichotomous (forced choice) response format, and measurement equivalence of dichotomous items is conventionally assessed using IRT (Stark et al., 2006).”
Psychometric analysis of the Ten-Item Perceived Stress Scale.
Taylor, J. M. (2015) · Psychological Assessment · doi:10.1037/a0038100 · Cited by 492
Metadata
- Authors
- Stark, S., Chernyshenko, O. S., & Drasgow, F.
- Venue
- Journal of Applied Psychology
- Published
- 2006-11
- Volume
- 91
- Issue
- 6
- Pages
- 1292-1306
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W2071813414
- Cited by
- 437
- References
- 35
- FWCI
- 14.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.