Item Response Theory Models for Wording Effects in Mixed-Format Scales
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Many scales contain both positively and negatively worded items. Reverse recoding of negatively worded items might not be enough for them to function as positively worded items do. In this study, we commented on the drawbacks of existing approaches to wording effect in mixed-format scales and used bi-factor item response theory (IRT) models to test the assumption of reverse coding and evaluate the magnitude of the wording effect. The parameters of the bi-factor IRT models can be estimated with existing computer programs. Two empirical examples from the Program for International Student Assessment and the Trends in International Mathematics and Science Study were given to demonstrate the advantages of the bi-factor approach over traditional ones. It was found that the wording effect in these two data sets was substantial and that ignoring the wording effect resulted in overestimated test reliability and biased person measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Rasch model for partial credit scoring
Masters, G. N. (1982) · Psychometrika · doi:10.1007/bf02296272 · Cited by 3,782 · cited 1×
“If ai is a constant (e.g., 1) for all items, Equation 1 becomes the partial credit model (Masters, 1982).”
BackgroundResponse Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898 · cited 1×
“Item analysis shows that NW items demonstrate somewhat lower item-to-total correlations than their counterpart PW items (Barnette, 1999; Roszkowski & Soven, 2010) and that they subsequently reduce the internal consistency reliability (Barnette, 2000; Cronbach, 1946, 1950).”
BackgroundPositive and negative global self-esteem: A substantively meaningful distinction or artifactors?
Marsh, H. W. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.70.4.810 · Cited by 811
The role of the bifactor model in resolving dimensionality issues in health outcomes measures
Reise, S. P., Morizot, J., & Hays, R. D. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9183-7 · Cited by 747 · cited 1×
“…bi-factor representation has been applied to mixed-format scales: all items measure the same latent construct, with PW items measuring one additional specific factor and NW items measuring another additional specific factor (Lindwall, Barkoukis, Grano, Lucidi, & Raudsepp, 2012; Reise et al., 2007).”
MethodBarnette, J. J. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970592 · Cited by 529 · cited 1×
“Item analysis shows that NW items demonstrate somewhat lower item-to-total correlations than their counterpart PW items (Barnette, 1999; Roszkowski & Soven, 2010) and that they subsequently reduce the internal consistency reliability (Barnette, 2000; Cronbach, 1946, 1950).”
Background
Cited by
The Math and Science Engagement Scales: Scale development, validation, and psychometric properties
Wang, M.-T., Fredricks, J. A., Ye, F., Hofkens, T. L., & Linn, J. S. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.01.008 · Cited by 592
A systematic review of Bayesian articles in psychology: The last 25 years.
van de Schoot, R., Winter, S. D., Ryan, O., Zondervan-Zwijnenburg, M., & Depaoli, S. (2017) · Psychological Methods · doi:10.1037/met0000100 · Cited by 374
Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them
Arch, J. J., Fishbein, J. N., Finkelstein, L. B., & Luoma, J. B. (2023) · Behavior Therapy · doi:10.1016/j.beth.2022.07.005 · Cited by 72
Mallinckrodt, B., & Tekie, Y. T. (2016) · Psychotherapy Research · doi:10.1080/10503307.2015.1061718 · Cited by 44
Metadata
- Authors
- Wang, W.-C., Chen, H.-F., & Jin, K.-Y.
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2014-04-06
- Volume
- 75
- Issue
- 1
- Pages
- 157-178
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2117107157
- Cited by
- 65
- References
- 5
- FWCI
- 6.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.