A new method for assessing the statistical significance in the differential functioning of items and tests (DFIT) framework
Abstract
A new item parameter replication method is proposed for assessing the statistical significance of the noncompensatory differential item functioning (NCDIF) index associated with the differential functioning of items and tests framework. In this new method, a cutoff score for each item is determined by obtaining a (1 −α) percentile rank score from a frequency distribution of NCDIF values under the no‐DIF condition by generating a large number of item parameters based on the item parameter estimates and their variance‐covariance structures from a computer program such as BIILOG‐MG3. This cutoff for each item can be used as the basis for determining whether a given NCDIF index is significantly different from zero. This new method has definite advantages over the current method and yields cutoff values that are tailored to a particular data set and a particular item. A Monte Carlo assessment of this new method is presented and discussed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Inferential statistics were obtained using the item parameter replication method with the correction proposed by Cervantes.
“Inferential statistics were obtained using the item parameter replication method (Oshima et al., 2006), with the correction proposed by Cervantes (2012Cervantes ( , 2017a; see also Clark & LaHuis, 2012).”
From No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge (2021) · cites this paper as Oshima et al., 2006
Cited by
Sorted by citations
Gonthier, C., Grégoire, J., & Besançon, M. (2021) · Intelligence · doi:10.1016/j.intell.2020.101512 · Cited by 20 · see citing works
- Authors
- Oshima, T. C., Raju, N. S., & Nanda, A. O.
- Affiliations
- Georgia State University (US)
- Illinois Institute of Technology (US)
- Venue
- Journal of Educational Measurement
- Publisher
- Wiley
- Published
- 2006-01-09
- Volume
- 43
- Issue
- 1
- Pages
- 1-17
- ISSN
- 0022-0655 (ISSN-L)
- 1745-3984
- OpenAlex
- W2127108000
- Cited by
- 62
- References
- 0
- Citations by year
- 2026: 3 · 2025: 1 · 2023: 1 · 2022: 6 · 2021: 3 · 2020: 1 · 2019: 2 · 2018: 2 · 2017: 3 · 2016: 1 · 2015: 4 · 2014: 6 · 2013: 2 · 2012: 4
- FWCI
- 5.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Measurement (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Educational Assessment and Pedagogy
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Keywords
- differential item functioning, statistical significance testing, cut-off values, percentile ranks, Monte Carlo simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
