The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Does the number of response options matter? Psychometric perspectives using personality questionnaire data.
Open accessAbstract
Psychological tests typically include a response scale whose purpose it is to organize and constrain the options available to respondents and facilitate scoring. One such response scale is the Likert scale, which initially was introduced to have a specific 5-point form. In practice, such scales have varied considerably in the nature and number of response options. However, relatively little consensus exists regarding several questions that have emerged regarding the use of Likert-type items. First, is there a "psychometrically optimal" number of response options? Second, is it better to include an even or odd number of response options? Finally, do visual analog items offer any advantages over Likert-type items? We studied these questions in a sample of 1,358 undergraduates who were randomly assigned to groups to complete a common personality measure using response scales ranging from 2 to 11 options, and a visual analog condition. Results revealed attenuated psychometric precision for response scales with 2 to 5 response options; interestingly, however, the criterion validity results did not follow this pattern. Also, no psychometric advantages were revealed for any response scales beyond 6 options, including visual analogs. These results have important implications for psychological scale development. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1999) · Cited by 7,995
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Preston, C. C., & Colman, A. M. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(99)00050-5 · Cited by 2,106
Benet-Martínez, V., & John, O. P. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.3.729 · Cited by 1,996
Initial construction of a maladaptive personality trait model and inventory for DSM-5
Krueger, R. F., Derringer, J., Markon, K. E., Watson, D., & Skodol, A. E. (2012) · Psychological Medicine · doi:10.1017/s0033291711002674 · Cited by 1,908
Aitken, R. C. B. (1969) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576906201005 · Cited by 1,539
Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales
Lozano, L. M., García-Cueto, E., & Muñiz, J. (2008) · Methodology · doi:10.1027/1614-2241.4.2.73 · Cited by 843
The Optimal Number of Response Alternatives for a Scale: A Review
Cox, E. P. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700401 · Cited by 811
The Mid-Point on a Rating Scale: Is it Desirable?
Garland, R. (1991) · Cited by 701
Statistical Inference for Coefficient Alpha
Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987) · Applied Psychological Measurement · doi:10.1177/014662168701100107 · Cited by 517
Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator
Reips, U.-D., & Funke, F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.699 · Cited by 453
Weng, L.-J. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404268674 · Cited by 410
Stuck in the middle: The use and interpretation of mid-points in items on questionnaires
Nadler, J. T., Weston, R., & Voyles, E. C. (2015) · The Journal of General Psychology · doi:10.1080/00221309.2014.994590 · Cited by 396
Matell, M. S., & Jacoby, J. (1972) · Journal of Applied Psychology · doi:10.1037/h0033601 · Cited by 353
Wright, A. G. C., & Simms, L. J. (2014) · Personality Disorders: Theory, Research, and Treatment · doi:10.1037/per0000037 · Cited by 309
Self-citationModerated regression analysis and Likert scales: Too coarse for comfort.
Russell, C. J., & Bobko, P. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.3.336 · Cited by 258
Watson, D. (2004) · Journal of Research in Personality · doi:10.1016/j.jrp.2004.03.001 · Cited by 247
On the loss of reliability in ratings due to coarseness of the scale
Symonds, P. M. (1924) · Journal of Experimental Psychology · doi:10.1037/h0074469 · Cited by 194
Reliability and the number of rating-scale categories.
Bendig, A. W. (1954) · Journal of Applied Psychology · doi:10.1037/h0055647 · Cited by 180
In Search of the Optimal Number of Response Categories in a Rating Scale
Lee, J., & Paek, I. (2014) · Journal of Psychoeducational Assessment · doi:10.1177/0734282914522200 · Cited by 144
Flynn, D., van Schaik, P., & van Wersch, A. (2003) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.20.1.49 · Cited by 127
Bendig, A. W. (1953) · Journal of Applied Psychology · doi:10.1037/h0057911 · Cited by 91
Kulas, J., & Stachowski, A. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.01.014 · Cited by 82
Investigating the Functioning of a Middle Category by Means of a Mixed-Measurement Model.
Hernández, A., Drasgow, F., & González‐Romá, V. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.4.687 · Cited by 73
The Impact of Item Readability on the Endorsement of the Midpoint Response in Surveys
Velez, P. M., & Ashworth, S. D. (2007) · Survey research methods · doi:10.18148/srm/2007.v1i2.76 · Cited by 60
Flamer, S. (1983) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1803_3 · Cited by 53
Finn, J. A., Ben‐Porath, Y. S., & Tellegen, A. (2014) · Psychological Assessment · doi:10.1037/pas0000044 · Cited by 44
Psychometric Features of an Assessment Instrument with Likert and Dichotomous Response Formats
Çapık, C., & Gözüm, S. (2014) · Public Health Nursing · doi:10.1111/phn.12156 · Cited by 39
Hilbert, S., Küchenhoff, H., Sarubin, N., Nakagawa, T., & Bühner, M. (2016) · Cited by 20
Effects of augmenting response options of the MMPI-2-RF: An extension of previous findings
Cox, A. A., Courrégé, S. C., Feder, A., & Weed, N. C. (2017) · Cogent Psychology · doi:10.1080/23311908.2017.1323988 · Cited by 7
Cited by
Constructing validity: New developments in creating objective measuring instruments.
Clark, L. A., & Watson, D. (2019) · Psychological Assessment · doi:10.1037/pas0000626 · Cited by 1,470
A Review of Key Likert Scale Development Advances: 1995–2019
Jebb, A. T., Ng, V., & Tay, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.637547 · Cited by 770
Clarifying the structure and nature of left-wing authoritarianism.
Costello, T. H., Bowes, S. M., Stevens, S. T., Waldman, I. D., Tasimi, A., & Lilienfeld, S. O. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000341 · Cited by 316
Kusmaryono, I., Wijayanti, D., & Maharani, H. R. (2022) · International Journal of Educational Methodology · doi:10.12973/ijem.8.4.625 · Cited by 283
Krieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
Metadata
- Authors
- Simms, L. J., Zelazny, K., Williams, T. F., & Bernstein, L.
- Venue
- Psychological Assessment
- Published
- 2019-04
- Volume
- 31
- Issue
- 4
- Pages
- 557-566
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W2921851212
- Cited by
- 441
- References
- 31
- FWCI
- 27.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.