The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Using reversed items in Likert scales: A questionable practice
Open accessAbstract
BACKGROUND: The use of positively worded items and reversed forms aims to reduce response bias and is a commonly used practice nowadays. The main goal of this research is to analyze the psychometric implications of the use of positive and reversed items in measurement instruments. METHOD: A sample of 374 participants was tested aged between 18 and 73 (M=33.98; SD=14.12), 62.60% were women. A repeated measures design was used, evaluating the participants with positive, reversed, and combined forms of a self-efficacy test. RESULTS: When combinations of positive and reversed items are used in the same test the reliability of the test is flawed and the unidimensionality of the test is jeopardized by secondary sources of variance. In addition, the variance of the scores is reduced, and the means differ significantly from those in tests in which all items are either positive or reversed, but not combined. CONCLUSIONS: The results of this study present a trade-off between a potential acquiescence bias when items are positively worded and a potential different understanding when combining regular and reversed items in the same test. The specialized literature recommends combining regular and reversed items for controlling for response style bias, but these results caution researchers in using them as well after accounting for the potential effect of linguistic skills and the findings presented in this study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc-rcessc.v1i1.25 · Cited by 38,891
(1998) · Cited by 36,049
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Measurement and Control of Response Bias
Paulhus, D. L. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50006-x · Cited by 3,598
ESTIMATION OF LATENT ABILITY USING A RESPONSE PATTERN OF GRADED SCORES1
Samejima, F. (1968) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1968.tb00153.x · Cited by 2,587
Handbook of Modern Item Response Theory
(1997) · Springer eBooks · doi:10.1007/978-1-4757-2691-6 · Cited by 2,305
Estimation of Latent Ability Using a Response Pattern of Graded Scores
Samejima, F. (1969) · Psychometrika · doi:10.1007/bf03372160 · Cited by 2,194
The theory and practice of item response theory.
Ayala, D. (2009) · Guilford Press eBooks · Cited by 1,812
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449 · cited 1×
“The standard error of the estimate was .10 (CI = ± .196), confi dence intervals of the items did not overlap in 14 out of the 20 items when comparing regular and combined forms, so statistically signifi cant differences were found in these 14 items (α = .05; Cumming & Finch, 2006).”
Cited by
Factor structure and validity of the Revised Suicide Crisis Inventory (SCI-2) among Indian adults
Menon, V., Bafna, A. R., Rogers, M. L., Richards, J., & Galynker, I. (2022) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2022.103119 · Cited by 29
Problematic Social Network Use: Structure and Assessment
González-Nuevo, C., Cuesta, M., Postigo, Á., Menéndez-Aller, Á., & Muñiz, J. (2023) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-021-00711-y · Cited by 22
Self-citationPsychometric Properties of the Stress Mindset Measure (SMM) in a Greek Sample.
Karampas, K., Pezirkianidis, C., & Stalikas, A. (2020) · Psychology · doi:10.4236/psych.2020.118079 · Cited by 19
Metadata
- Authors
- Suárez-Álvarez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J.
- Venue
- Psicothema
- Publisher
- Grupo Editorial Psicofundación
- Published
- 2018-05-01
- Volume
- 2
- Issue
- 30
- Pages
- 149-158
- ISSN
- 0214-9915 (ISSN-L)
- 1886-144X
- OpenAlex
- W2883808623
- Cited by
- 422
- References
- 59
- FWCI
- 22.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using reversed items in Likert scales: A questionable practice. https://app.cochat.ai/papers/10.7334/psicothema2018.33
- The paper
- Suárez-Álvarez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema. https://doi.org/10.7334/psicothema2018.33
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.