A Psychometric Evaluation of 4-Point and 6-Point Likert-Type Scales in Relation to Reliability and Validity
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Reliability and validity of 4-point and 6-point scales were assessed using a new model-based ap proach to fit empirical data. Different measurement models were fit by confirmatory factor analyses of a multitrait-multimethod covariance matrix. 165 gradu ate students responded to nine items measuring three quantitative attitudes. Separation of method from trait variance led to greater reduction of reliability and heterotrait-monomethod coefficients for the 6-point scale than for the 4-point scale. Criterion-related valid ity was not affected by the number of scale points. The issue of selecting 4- versus 6-point scales may not be generally resolvable, but may rather depend on the empirical setting. Response conditions theorized to in fluence the use of scale options are discussed to pro vide directions for further research. Index terms: Likert-type scales, multitrait-multimethod matrix, reli ability, scale options, validity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330
Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.103.3.391 · Cited by 3,824
Evaluation of goodness-of-fit indices for structural equation models.
Mulaik, S. A., James, L. R., Van Alstine, J., & Bennett, N. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.430 · Cited by 2,923
Torgerson, W. S. (1958) · Medical Entomology and Zoology · Cited by 2,920
A comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778
Cohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Kenny, D. A. (1979) · Medical Entomology and Zoology · Cited by 1,376
STATISTICAL ANALYSIS OF SETS OF CONGENERIC TESTS*
Jo̎reskog, K. G. (1969) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1969.tb00777.x · Cited by 1,203
Cohen, P. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90009-9 · Cited by 1,112
Introduction to Psychological Measurement
Nunnally, J. C. (1970) · Medical Entomology and Zoology · Cited by 1,070
Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data
Widaman, K. F. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900101 · Cited by 1,037
Theory and Methods of Scaling.
Guttman, L., & Torgerson, W. S. (1959) · American Sociological Review · doi:10.2307/2089571 · Cited by 1,006
Further Evidence on Response Sets and Test Design
Cronbach, L. J. (1950) · Educational and Psychological Measurement · doi:10.1177/001316445001000101 · Cited by 734
Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity
Matell, M. S., & Jacoby, J. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100307 · Cited by 571
Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions
Marsh, H. W. (1989) · Applied Psychological Measurement · doi:10.1177/014662168901300402 · Cited by 505
Effect of the number of scale points on reliability: A Monte Carlo approach.
Lissitz, R. W., & Green, S. B. (1975) · Journal of Applied Psychology · doi:10.1037/h0076268 · Cited by 488
Cicchetti, D. V., Shoinralter, D., & Tyrer, P. J. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900103 · Cited by 291
On the loss of reliability in ratings due to coarseness of the scale
Symonds, P. M. (1924) · Journal of Experimental Psychology · doi:10.1037/h0074469 · Cited by 194 · cited 1×
“Others have maintained that reliability is maximized using 7-point (Cicchetti, Showalter, & Tyrer, 1985; Finn, 1972; Nunnally, 1967; ~arnsay, 1973; Symonds, 1924), 5-point (Jenkins & Taber, 1977; Lissitz & Green, 1975; Remmers & Ewart, 1941), 4-point (Bendig, 1954b),”
Number of Scale Points and the Reliability of Scales
Komorita, S. S., & Graham, W. K. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500404 · Cited by 190
Graphic rating scales — How many categories?
McKelvie, S. J. (1978) · British Journal of Psychology · doi:10.1111/j.2044-8295.1978.tb01647.x · Cited by 187
Educational and psychological measurement
(1982) · Serials Review · doi:10.1016/0098-7913(82)90053-3 · Cited by 186
Reliability and the number of rating-scale categories.
Bendig, A. W. (1954) · Journal of Applied Psychology · doi:10.1037/h0055647 · Cited by 180
Two components in bipolar scales: Direction and extremeness.
Peabody, D. (1962) · Psychological Review · doi:10.1037/h0039737 · Cited by 176
A Monte Carlo study of factors affecting three indices of composite scale reliability.
Jenkins, G. D., & Taber, T. D. (1977) · Journal of Applied Psychology · doi:10.1037//0021-9010.62.4.392 · Cited by 170
Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings
Finn, R. H. (1972) · Educational and Psychological Measurement · doi:10.1177/001316447203200203 · Cited by 164
CONFIRMATORY FACTOR ANALYSIS OF MULTITRAIT‐MULTIMETHOD MATRICES
MARSH, H. W., & HOCEVAR, D. (1983) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1983.tb00202.x · Cited by 160
Attitude Content, Intensity, and the Neutral Point on a Likert Scale
Komorita, S. S. (1963) · The Journal of Social Psychology · doi:10.1080/00224545.1963.9919489 · Cited by 158
Brown, G., Widing, R. E., & Coulter, R. L. (1991) · Journal of the Academy of Marketing Science · doi:10.1007/bf02726510 · Cited by 149
MASTERS, E. R. (1974) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1974.tb00970.x · Cited by 144
Goldberg, L. R. (1981) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.41.3.517 · Cited by 136
The Effect of Number of Categories in Rating Scales on Precision of Estimation of Scale Values
Ramsay, J. O. (1973) · Psychometrika · doi:10.1007/bf02291492 · Cited by 130
Marsh, H. W. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb01072.x · Cited by 104
Remington, M., Tyrer, P. J., Newson-Smith, J., & Cicchetti, D. V. (1979) · Psychological Medicine · doi:10.1017/s0033291700034097 · Cited by 95
Bendig, A. W. (1953) · Journal of Applied Psychology · doi:10.1037/h0057911 · Cited by 91
Effects of Scaling on the Correlation Coefficient: Additional Considerations
Martin, W. S. (1978) · Journal of Marketing Research · doi:10.1177/002224377801500219 · Cited by 86
The Effects of Scaling on the Correlation Coefficient: A Test of Validity
Martin, W. S. (1973) · Journal of Marketing Research · doi:10.1177/002224377301000315 · Cited by 67
Comparison of Factor Analytic Results with Two-Choice and Seven-Choice Personality Item Formats
Comrey, A. L., & Montag, I. (1982) · Applied Psychological Measurement · doi:10.1177/014662168200600304 · Cited by 50
The Relation Between Item Format and the Structure of the Eysenck Personality Inventory
Velicer, W. F., & Stevenson, J. F. (1978) · Applied Psychological Measurement · doi:10.1177/014662167800200210 · Cited by 49
Psychological Bulletin's top 10 "hit parade."
Sternberg, R. J. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.3.387 · Cited by 44
Remmers, H. H., Karslake, R., & Gage, N. L. (1940) · Journal of Educational Psychology · doi:10.1037/h0054189 · Cited by 34
Reliability of short rating scales and the heterogeneity of the rated stimuli.
Bendig, A. W. (1954) · Journal of Applied Psychology · doi:10.1037/h0059072 · Cited by 27
Remmers, H. H., & Ewart, E. (1941) · Journal of Educational Psychology · doi:10.1037/h0061781 · Cited by 27
Item Format and the Structure of the Personal Orientation Inventory
Velicer, W. F., DiClemente, C. C., & Corriveau, D. P. (1984) · Applied Psychological Measurement · doi:10.1177/014662168400800405 · Cited by 26
Frisbie, D. A. (1974) · Educational and Psychological Measurement · doi:10.1177/001316447403400417 · Cited by 26
Item Format and the Structure of the Eysenck Personality Inventory: A Replication
Oswald, W. T., & Velicer, W. F. (1980) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4403_11 · Cited by 22
Relating the Internal Consistency of Scales to Rater Response Tendencies
Alliger, G. M., & Williams, K. J. (1992) · Educational and Psychological Measurement · doi:10.1177/0013164492052002008 · Cited by 8
Cited by
Likert Scale: Explored and Explained
Joshi, A., Kale, S., Chandel, S., & Pal, D. (2015) · British Journal of Applied Science & Technology · doi:10.9734/bjast/2015/14975 · Cited by 3,870
Preston, C. C., & Colman, A. M. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(99)00050-5 · Cited by 2,106
Evidence-Based Survey Design: The Use of a Midpoint on the Likert Scale
Chyung, S. Y. Y., Roberts, K., Swanson, I., & Hankinson, A. (2017) · Performance Improvement · doi:10.1002/pfi.21727 · Cited by 846
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 801
A Comparison of Psychometric Properties and Normality in 4-, 5-, 6-, and 11-Point Likert Scales
Leung, S.-O. (2011) · Journal of Social Service Research · doi:10.1080/01488376.2011.580697 · Cited by 706
Metadata
- Authors
- Chang, L.
- Venue
- Applied Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 1994-09
- Volume
- 18
- Issue
- 3
- Pages
- 205-215
- ISSN
- 0146-6216 (ISSN-L)
- 1552-3497
- OpenAlex
- W2023727185
- Cited by
- 500
- References
- 50
- FWCI
- 4.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.