The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Feeling Thermometers Versus 7-Point Scales: Which are Better?
Abstract
This study addresses the issue of the relation between the number of response categories used in survey questions and the quality of measurement. Several hypotheses, derived from relevant theory and research, are tested through a comparison between 7- and 11-category rating scales used in the 1978 Quality of Life Survey. One hypothesis derived from information theory, that rating scales with more response categories transmit a greater amount of information and are therefore inherently more precise in their measurement, is strongly supported. A second hypothesis, that questions with greater numbers of response categories are more vulnerable to systematic measurement errors or shared method variance, is rejected. This study supports the conclusion that questions with more categories are both more reliable and more valid.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
(1904) · The American Journal of Psychology · doi:10.2307/1412635 · Cited by 4,187
Mathematical Theory of Communication
(2009) · Encyclopedia of Communication Theory · doi:10.4135/9781412959384.n229 · Cited by 2,492
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Smith, H. W., & Triandis, H. C. (1972) · Contemporary Sociology · doi:10.2307/2063502 · Cited by 1,385
International Encyclopedia of the Social Sciences.
Seeman, M., & Sills, D. L. (1968) · American Sociological Review · doi:10.2307/2092892 · Cited by 1,101
Response Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898
General Social Surveys: 1972 - 1994; cumulative codebook
Davis, J. A., & Smith, T. (1994) · Cited by 842
The Optimal Number of Response Alternatives for a Scale: A Review
Cox, E. P. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700401 · Cited by 811
Further Evidence on Response Sets and Test Design
Cronbach, L. J. (1950) · Educational and Psychological Measurement · doi:10.1177/001316445001000101 · Cited by 734
Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines.
Schaible, W. L., Jabine, T. B., Straf, M. L., Tanur, J. M., & Tourangeau, R. (1987) · Journal of the American Statistical Association · doi:10.2307/2289187 · Cited by 618
Converse, J., & Presser, S. (1986) · Sage eBooks · doi:10.4135/9781412986045 · Cited by 586
Separating Reliability and Stability in Test-Retest Correlation
Heise, D. R. (1969) · American Sociological Review · doi:10.2307/2092790 · Cited by 580
Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity
Matell, M. S., & Jacoby, J. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100307 · Cited by 571
Questions and Answers in Attitude Surveys
Albaum, G., Schuman, H., & Presser, S. (1982) · Journal of Marketing Research · doi:10.2307/3151742 · Cited by 511
Effect of the number of scale points on reliability: A Monte Carlo approach.
Lissitz, R. W., & Green, S. B. (1975) · Journal of Applied Psychology · doi:10.1037/h0076268 · Cited by 488
Three-Point Likert Scales Are Good Enough
Jacoby, J., & Matell, M. S. (1971) · Journal of Marketing Research · doi:10.1177/002224377100800414 · Cited by 455
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Andrews, F. M. (1984) · Public Opinion Quarterly · doi:10.1086/268840 · Cited by 415
The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes
ALWIN, D. F., & KROSNICK, J. A. (1991) · Sociological Methods & Research · doi:10.1177/0049124191020001005 · Cited by 403
Self-citationMatell, M. S., & Jacoby, J. (1972) · Journal of Applied Psychology · doi:10.1037/h0033601 · Cited by 353
Research Methods in Social Relations
Boyd, H., Jahoda, M., Deutsch, M., & Cook, S. W. (1954) · Journal of Marketing · doi:10.2307/1246908 · Cited by 266
Rating Scales and Information Recovery—How Many Scales and Response Categories to Use?
Green, P. E., & Rao, V. R. (1970) · Journal of Marketing · doi:10.1177/002224297003400307 · Cited by 259
(2010) · Sociological Methodology · doi:10.1111/(issn)1467-9531 · Cited by 251
The amount of information in absolute judgments.
Garner, W. R., & Hake, H. W. (1951) · Psychological Review · doi:10.1037/h0054482 · Cited by 243
The decomposition of multitrait‐multimethod matrices
Browne, M. W. (1984) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1984.tb00785.x · Cited by 221
Theory, Deduction, and Rules of Correspondence
Costner, H. L. (1969) · American Journal of Sociology · doi:10.1086/224770 · Cited by 214
Statistical Theories of Mental Test Scores.
Tatsuoka, M. M., Lord, F. M., Novick, M. R., & Birnbaum, A. (1971) · Journal of the American Statistical Association · doi:10.2307/2283550 · Cited by 204
On the loss of reliability in ratings due to coarseness of the scale
Symonds, P. M. (1924) · Journal of Experimental Psychology · doi:10.1037/h0074469 · Cited by 194
Number of Scale Points and the Reliability of Scales
Komorita, S. S., & Graham, W. K. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500404 · Cited by 190
The Measurement of Communication Processes: Galileo Theory and Method.
Finocchiaro, M. A., Woelfel, J., & Fink, E. L. (1982) · Contemporary Sociology · doi:10.2307/2067147 · Cited by 188
Path analysis: Psychological examples.
Werts, C. E., & Linn, R. L. (1970) · Psychological Bulletin · doi:10.1037/h0029778 · Cited by 187
Two components in bipolar scales: Direction and extremeness.
Peabody, D. (1962) · Psychological Review · doi:10.1037/h0039737 · Cited by 176
A Monte Carlo study of factors affecting three indices of composite scale reliability.
Jenkins, G. D., & Taber, T. D. (1977) · Journal of Applied Psychology · doi:10.1037//0021-9010.62.4.392 · Cited by 170
Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings
Finn, R. H. (1972) · Educational and Psychological Measurement · doi:10.1177/001316447203200203 · Cited by 164
Attitude Content, Intensity, and the Neutral Point on a Likert Scale
Komorita, S. S. (1963) · The Journal of Social Psychology · doi:10.1080/00224545.1963.9919489 · Cited by 158
Methodological Issues in Aging Research
Bergeman, C. S., & Boker, S. M. (2015) · Psychology Press eBooks · doi:10.4324/9781315820989 · Cited by 147
(1984) · Electoral Studies · doi:10.1016/0261-3794(84)90068-4 · Cited by 146
The Effect of Number of Categories in Rating Scales on Precision of Estimation of Scale Values
Ramsay, J. O. (1973) · Psychometrika · doi:10.1007/bf02291492 · Cited by 130
Social indicators of well-being: Americans' perceptions of life quality
Gottlieb, A. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90013-0 · Cited by 123
Rating scales, discriminability, and information transmission.
Garner, W. R. (1960) · Psychological Review · doi:10.1037/h0043047 · Cited by 116
Surveying Subjective Phenomena
Sudman, S., Turner, C. F., & Martin, E. (1986) · Journal of Marketing Research · doi:10.2307/3151668 · Cited by 97
The Ipsative Process to Reduce Response Set Bias
Cunningham, W. H., Cunningham, I. C. M., & Green, R. T. (1977) · Public Opinion Quarterly · doi:10.1086/268394 · Cited by 85
The measurement of values: Effects of different assessment procedures
Feather, N. T. (1973) · Australian Journal of Psychology · doi:10.1080/00049537308255849 · Cited by 75
Optimal refinement of the rating scale.
Champney, H., & Marshall, H. (1939) · Journal of Applied Psychology · doi:10.1037/h0054522 · Cited by 71
Problems in the estimation and interpretation of the reliability of survey data
Alwin, D. F. (1989) · Quality & Quantity · doi:10.1007/bf00172447 · Cited by 70
Self-citationA Study of the Likert Technique of Attitude Scale Construction
Ferguson, L. W. (1941) · The Journal of Social Psychology · doi:10.1080/00224545.1941.9714060 · Cited by 62
Are Three-Point Scales Always Good Enough?
Lehmann, D. R., & Hulbert, J. M. (1972) · Journal of Marketing Research · doi:10.2307/3149313 · Cited by 55
Variation in response functions : a source of measurement error in attitude research
Saris, W. E. (1988) · Cited by 44
A Question of Quality. Evaluating survey questions by multitrait-multimethod studies
Scherpenzeel, A. C. (1995) · UvA-DARE (University of Amsterdam) · Cited by 39
Surveying attitude structures: A discussion of principles and procedures
McKennell, A. C. (1974) · Quality & Quantity · doi:10.1007/bf00153932 · Cited by 30
How Many Scales and how many Categories shall we use in Consumer Research?—A Comment
Benson, P. H. (1971) · Journal of Marketing · doi:10.1177/002224297103500412 · Cited by 30
Cited by
Comparative Evaluation and the Relationship between Quality, Satisfaction, and Repurchase Loyalty
Olsen, S. O. (2002) · Journal of the Academy of Marketing Science · doi:10.1177/0092070302303005 · Cited by 777
Capital structure decision making
Romano, C. A., Tanewski, G. A., & Smyrnios, K. X. (2001) · Journal of Business Venturing · doi:10.1016/s0883-9026(99)00053-1 · Cited by 648
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 621
Choosing the Number of Categories in Agree–Disagree Scales
Revilla, M. A., Saris, W. E., & Krosnick, J. A. (2014) · Sociological Methods & Research · doi:10.1177/0049124113509605 · Cited by 553
Can Likert Scales be Treated as Interval Scales?—A Simulation Study
Wu, H., & Leung, S.-O. (2017) · Journal of Social Service Research · doi:10.1080/01488376.2017.1329775 · Cited by 546
Metadata
- Authors
- ALWIN, D. F.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1997-02
- Volume
- 25
- Issue
- 3
- Pages
- 318-340
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2053175782
- Cited by
- 345
- References
- 55
- FWCI
- 6.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.