The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes
Open accessAbstract
Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Increased error in some population (whether systematic or random) makes measures less capable at capturing individual differences in the trait of interest in that population (see e.g., refs. 20–22; see also ref. 23).”
From Simpson’s gender-equality paradox (2025) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances In Experimental Social Psychology
(2022) · Advances in experimental social psychology · doi:10.1016/s0065-2601(22)x0002-6 · Cited by 22,559
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
Statistical Theories of Mental Test Scores.
Tatsuoka, M., Lord, F., Novick, M. R., & Birnbaum, A. (1971) · Journal of the American Statistical Association · doi:10.2307/2283550 · Cited by 7,645
Review of personality and social psychology
Davies, M. (1983) · Personality and Individual Differences · doi:10.1016/0191-8869(83)90072-7 · Cited by 3,394
Wicker, A. W. (1969) · Journal of Social Issues · doi:10.1111/j.1540-4560.1969.tb00619.x · Cited by 2,152
The American Journal of Sociology
F., C. B. (1939) · American Journal of Psychiatry · doi:10.1176/ajp.96.1.252 · Cited by 1,923
Questions and answers in attitude surveys: Experiments on question form, wording, and context
(1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90054-w · Cited by 1,718
Smith, H. W., & Triandis, H. C. (1972) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063502 · Cited by 1,393
Gusfield, J. R., & Apter, D. E. (1966) · American Sociological Review · doi:10.2307/2091287 · Cited by 1,281
The Optimal Number of Response Alternatives for a Scale: A Review
Cox, E. P. (1980) · Journal of Marketing Research · doi:10.2307/3150495 · Cited by 867
General Social Surveys: 1972 - 1994; cumulative codebook
Davis, J. A., & Smith, T. (1994) · Cited by 842
Haslegrave, C. M. (1988) · Applied Ergonomics · doi:10.1016/0003-6870(88)90184-6 · Cited by 819
Mass Political Attitudes and the Survey Response
Achen, C. H. (1975) · American Political Science Review · doi:10.2307/1955282 · Cited by 744
Aging and susceptibility to attitude change.
Krosnick, J. A., & Alwin, D. F. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.3.416 · Cited by 723
Self-citationWilcox, J. B., Rossi, P. H., Wright, J. D., & Anderson, A. B. (1985) · Journal of Marketing Research · doi:10.2307/3151558 · Cited by 708
The Quantitative Analysis of Social Problems.
Lujan, H. D., & Tufte, E. R. (1971) · Midwest Journal of Political Science · doi:10.2307/2110128 · Cited by 660
Separating Reliability and Stability in Test-Retest Correlation
Heise, D. R. (1969) · American Sociological Review · doi:10.2307/2092790 · Cited by 581
Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity
Matell, M. S., & Jacoby, J. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100307 · Cited by 574
Effect of the number of scale points on reliability: A Monte Carlo approach.
Lissitz, R. W., & Green, S. B. (1975) · Journal of Applied Psychology · doi:10.1037/h0076268 · Cited by 488
Annual Meeting of The American Sociological Association
Hashem, M. (1995) · American Journal of Islam and Society · doi:10.35632/ajis.v12i1.2400 · Cited by 425
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Andrews, F. M. (1984) · Public Opinion Quarterly · doi:10.1086/268840 · Cited by 419
Simon, H. A. (1977) · Boston studies in the philosophy of science · doi:10.1007/978-94-010-9521-1 · Cited by 418
Plus ça change…: The New CPS Election Study Panel
Converse, P. E., & Markus, G. B. (1979) · American Political Science Review · doi:10.2307/1954729 · Cited by 402
Matell, M. S., & Jacoby, J. (1972) · Journal of Applied Psychology · doi:10.1037/h0033601 · Cited by 354
Multiple Classification Analysis
Retherford, R. D., & Choe, M. K. (1993) · doi:10.1002/9781118033135.ch3 · Cited by 329
Political Attitudes during an Election Year: A Report on the 1980 NES Panel Study
Markus, G. B. (1982) · American Political Science Review · doi:10.1017/s0003055400188392 · Cited by 278
ESTIMATION AND TESTING OF SIMPLEX MODELS
Jöreskog, K. G. (1970) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1970.tb00439.x · Cited by 274
Robustness in Regression Analysis
Bohrnstedt, G. W., & Carter, T. M. (1971) · Sociological Methodology · doi:10.2307/270820 · Cited by 268
Research Methods in Social Relations
Boyd, H. W., Jahoda, M., Deutsch, M., & Cook, S. W. (1954) · Journal of Marketing · doi:10.2307/1246908 · Cited by 266
The Effect of the Question on Survey Responses: A Review
Kalton, G., & Schuman, H. (1982) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981421 · Cited by 259
Rating Scales and Information Recovery. How Many Scales and Response Categories to Use?
Green, P. E., & Rao, V. R. (1970) · Journal of Marketing · doi:10.1177/002224297003400307 · Cited by 259
The Estimation of Measurement Error in Panel Data
Wiley, D. E., & Wiley, J. A. (1970) · American Sociological Review · doi:10.2307/2093858 · Cited by 257
(2010) · Sociological Methodology · doi:10.1111/(issn)1467-9531 · Cited by 256
The Estimation of Measurement Error in Panel Data *
Wiley, D. E., Wiley, J. A., & Blalock, H. M. (2017) · Routledge eBooks · doi:10.4324/9781315081670-9 · Cited by 251
Bivariate Agreement Coefficients for Reliability of Data
Krippendorff, K. (1970) · Sociological Methodology · doi:10.2307/270787 · Cited by 251
Survey Methods in Social Investigation.
Harvey, A., Moser, C. A., & Kalton, G. (1972) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2986691 · Cited by 228
Number of Scale Points and the Reliability of Scales
Komorita, S. S., & Graham, W. K. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500404 · Cited by 196
On the loss of reliability in ratings due to coarseness of the scale
Symonds, P. M. (1924) · Journal of Experimental Psychology · doi:10.1037/h0074469 · Cited by 194
Measurement in the Social Sciences
(1974) · doi:10.1007/978-1-349-02473-5 · Cited by 190
The Structure of Attitude Systems in the General Public: Comparisons of a Structural Equation Model
Judd, C. M., & Milburn, M. A. (1980) · American Sociological Review · doi:10.2307/2095012 · Cited by 182
Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings
Finn, R. H. (1972) · Educational and Psychological Measurement · doi:10.1177/001316447203200203 · Cited by 164
A Monte Carlo study of factors affecting three indices of composite scale reliability.
Jenkins, G. D., & Taber, T. D. (1977) · Journal of Applied Psychology · doi:10.1037/0021-9010.62.4.392 · Cited by 160
Attitude Content, Intensity, and the Neutral Point on a Likert Scale
Komorita, S. S. (1963) · The Journal of Social Psychology · doi:10.1080/00224545.1963.9919489 · Cited by 158
Methodological Issues in Aging Research
Bergeman, C. S., & Boker, S. M. (2015) · Psychology Press eBooks · doi:10.4324/9781315820989 · Cited by 147
Political Involvement and Attitude Structure in the General Public
Judd, C. M., Krosnick, J. A., & Milburn, M. A. (1981) · American Sociological Review · doi:10.2307/2094947 · Cited by 141
Self-citationMeasurement Models for Response Errors in Surveys: Issues and Applications
Alwin, D. F., & Jackson, D. J. (1980) · Sociological Methodology · doi:10.2307/270860 · Cited by 125
Self-citationSocial indicators of well-being: Americans' perceptions of life quality
Gottlieb, A. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90013-0 · Cited by 123
Rating scales, discriminability, and information transmission.
Garner, W. R. (1960) · Psychological Review · doi:10.1037/h0043047 · Cited by 116
Rating Scales and Information Recovery. How Many Scales and Response Categories to Use?
Green, P. E., & Rao, V. R. (1970) · Journal of Marketing · doi:10.2307/1249817 · Cited by 112
Comment: The Status of Nonattitudes
Converse, P. E. (1974) · American Political Science Review · doi:10.1017/s0003055400117447 · Cited by 99
Surveying Subjective Phenomena
Sudman, S., Turner, C. F., & Martin, E. (1986) · Journal of Marketing Research · doi:10.2307/3151668 · Cited by 97
Bendig, A. W. (1953) · Journal of Applied Psychology · doi:10.1037/h0057911 · Cited by 91
Comment: Rejoinder To Judd And Milburn
Converse, P. E. (1980) · American Sociological Review · doi:10.2307/2095013 · Cited by 89
Attitudes toward old people in an older sample.
Kogan, N. (1961) · Journal of Abnormal & Social Psychology · doi:10.1037/h0048356 · Cited by 84
Effects of Filter Questions in Public Opinion Surveys
Bishop, G. F., Oldendick, R. W., & Tuchfarber, A. J. (1983) · Public Opinion Quarterly · doi:10.1086/268810 · Cited by 80
Interviewing Older Adults: the Accuracy of Factual Information
Rodgers, W. L., & Herzog, A. R. (1987) · Journal of Gerontology · doi:10.1093/geronj/42.4.387 · Cited by 73
Problems in the estimation and interpretation of the reliability of survey data
Alwin, D. F. (1989) · Quality & Quantity · doi:10.1007/bf00172447 · Cited by 71
Self-citationOptimal refinement of the rating scale.
Champney, H., & Marshall, H. (1939) · Journal of Applied Psychology · doi:10.1037/h0054522 · Cited by 71
The Quality of Survey Data as Related to Age of Respondent
Andrews, F. M., & Herzog, A. R. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478284 · Cited by 70
Width of the latitude of acceptance as a determinant of attitude change.
Eagly, A. H., & Telaak, K. A. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0033161 · Cited by 70
A Study of the Likert Technique of Attitude Scale Construction
Ferguson, L. W. (1941) · The Journal of Social Psychology · doi:10.1080/00224545.1941.9714060 · Cited by 62
Making Inferences from Attitude-Behavior Correlations
Alwin, D. F. (1973) · Sociometry · doi:10.2307/2786570 · Cited by 62
Self-citation"Don't Know": Item Ambiguity or Respondent Uncertainty?
Coombs, C. H., & Coombs, L. C. (1976) · Public Opinion Quarterly · doi:10.1086/268336 · Cited by 57
Are Three-Point Scales Always Good Enough?
Lehmann, D. R., & Hulbert, J. M. (1972) · Journal of Marketing Research · doi:10.2307/3149313 · Cited by 55
Attitudes, Conflict, and Social Change
(1972) · Elsevier eBooks · doi:10.1016/c2013-0-10972-5 · Cited by 51
Comparative reliability of numerically anchored versus job-task anchored rating scales.
Peters, D. L., & McCormick, E. J. (1966) · Journal of Applied Psychology · doi:10.1037/h0022935 · Cited by 50
Measurement, psychophysics, and neural information processing
Krantz, D. H. (1974) · W.H. Freeman eBooks · Cited by 45
Attitude accessibility following a self-perception process.
Fázio, R. H., Herr, P. M., & Olney, T. J. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.47.2.277 · Cited by 44
Variation in response functions : a source of measurement error in attitude research
Saris, W. E. (1988) · Cited by 44
Comment on "The Estimation of Measurement Error in Panel Data"
Werts, C. E., Jöreskog, K. G., & Linn, R. L. (1971) · American Sociological Review · doi:10.2307/2093511 · Cited by 41
Bean, L. H., & Cantril, H. (1944) · Journal of the American Statistical Association · doi:10.2307/2280646 · Cited by 38
Survey Errors and Survey Costs.
Paterson, L., & Groves, R. M. (1992) · Biometrics · doi:10.2307/2532368 · Cited by 35
Murphy, G., & Likert, R. (1938) · Harper & Bros. eBooks · Cited by 33
Effect of Reliability and Validity on Power of Statistical Tests
Cleary, T. A., Linn, R. L., & Walster, G. W. (1970) · Sociological Methodology · doi:10.2307/270786 · Cited by 31
Transmitted information and the length of rating scales.
Bendig, A. W. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055679 · Cited by 22
Effects of variations in rating scale format on judgment.
Madden, J. M., & Bourdon, R. D. (1964) · Journal of Applied Psychology · doi:10.1037/h0047779 · Cited by 17
American National Elections Studies Data Sourcebook, 1952-1978
Miller, W. E., Miller, A. H., & Schneider, E. J. (1981) · American Political Science Review · doi:10.2307/1961093 · Cited by 16
Bohrnstedt, G. W., Mohler, P. P., & Müller, W. (1987) · Sociological Methods & Research · doi:10.1177/0049124187015003001 · Cited by 6
Assessing the Reliability of Linear Composites
Greene, V. L., & Carmines, E. G. (1980) · Sociological Methodology · doi:10.2307/270862
Research works printed but not linked: 11
- Alwin, D. F., annual meetings of the American Association of Public Opinion Research
- Bohrnstedt, G. W., Attitude Measurement, 80
- Jöreskog, K. G., LISREL VI. Analysis of Linear Structural Relationships by Maximum Likelihood, Instrumental Variables, and Least Squares Methods
- Muthén, Bengt, LISCOMP: Analysis of Linear Structural Equations Using a Comprehensive Measurement Model
- Rodgers, W. L., “Quality of Survey Measures: A Structural Modeling Approach.”
- Rodgers, W. L., “Measurement Error in Interviews with Elderly Respondents.”
- Sherif, M., Social Judgement: Assimilation and Contrast Effects in Communication and Attitude Change
- Smith, T. W., annual meetings of the American Sociological Association
- Smith, T. W. and C. B. Stephenson. 1979. “An Analysis of Test/Retest Experiments on the 1972, 1973, 1974, and 1978 General Social Surveys.” GSS Technical Report, No. 14, December, Chicago: National Opinion Research Center.
- Weisberg, H. F., “Evaluation of the Feeling Thermometer: A Report to the National Election Study Board Based on Data from the 1979 Pilot Survey.”
- Zaller, J., annual meetings of the American Political Science Association
Cited by
Sorted by citations
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
“This number of response options was selected after extensive discussion based on prior work [36] and analyses of available large data sets, in which five response options produced data sets with ample responses in each option for IRT analysis; provided good discrimination in item characteristic curves without producin…”
Diani, M., & McAdam, D. (2003) · doi:10.1093/0199251789.001.0001 · Cited by 1,492
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 813
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 625
Choosing the Number of Categories in Agree–Disagree Scales
Revilla, M., Saris, W. E., & Krosnick, J. A. (2013) · Sociological Methods & Research · doi:10.1177/0049124113509605 · Cited by 560
Self-citation
Metadata
- Authors
- ALWIN, D. F., & KROSNICK, J. A.
- Affiliations
- University of Michigan (US)
- The Ohio State University (US)
- ORCID
- KROSNICK, JON A.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1991-08
- Volume
- 20
- Issue
- 1
- Pages
- 139-181
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2137597548
- Cited by
- 403
- References
- 74
- Citations by year
- 2026: 10 · 2025: 13 · 2024: 17 · 2023: 18 · 2022: 16 · 2021: 31 · 2020: 15 · 2019: 19 · 2018: 16 · 2017: 15 · 2016: 12 · 2015: 31 · 2014: 16 · 2013: 13 · 2012: 17
- FWCI
- 7.65
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Sociological Methods & Research (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- survey reliability, attitude measurement, question characteristics, response options, respondent characteristics, age effects, educational attainment, survey error, General Social Survey
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review