The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes
Open accessAbstract
Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Increased error in some population (whether systematic or random) makes measures less capable at capturing individual differences in the trait of interest in that population (see e.g., refs. 20–22; see also ref. 23).”
From Simpson’s gender-equality paradox (2025) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances In Experimental Social Psychology
(2022) · Advances in experimental social psychology · doi:10.1016/s0065-2601(22)x0002-6 · Cited by 22,559
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
Statistical Theories of Mental Test Scores.
Tatsuoka, M., Lord, F., Novick, M. R., & Birnbaum, A. (1971) · Journal of the American Statistical Association · doi:10.2307/2283550 · Cited by 7,645
Review of personality and social psychology
Davies, M. (1983) · Personality and Individual Differences · doi:10.1016/0191-8869(83)90072-7 · Cited by 3,394
Wicker, A. W. (1969) · Journal of Social Issues · doi:10.1111/j.1540-4560.1969.tb00619.x · Cited by 2,152
The American Journal of Sociology
F., C. B. (1939) · American Journal of Psychiatry · doi:10.1176/ajp.96.1.252 · Cited by 1,923
Questions and answers in attitude surveys: Experiments on question form, wording, and context
(1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90054-w · Cited by 1,718
Smith, H. W., & Triandis, H. C. (1972) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063502 · Cited by 1,393
Gusfield, J. R., & Apter, D. E. (1966) · American Sociological Review · doi:10.2307/2091287 · Cited by 1,281
Research works printed but not linked: 11
- Alwin, D. F., annual meetings of the American Association of Public Opinion Research
- Bohrnstedt, G. W., Attitude Measurement, 80
- Jöreskog, K. G., LISREL VI. Analysis of Linear Structural Relationships by Maximum Likelihood, Instrumental Variables, and Least Squares Methods
- Muthén, Bengt, LISCOMP: Analysis of Linear Structural Equations Using a Comprehensive Measurement Model
- Rodgers, W. L., “Quality of Survey Measures: A Structural Modeling Approach.”
- Rodgers, W. L., “Measurement Error in Interviews with Elderly Respondents.”
- Sherif, M., Social Judgement: Assimilation and Contrast Effects in Communication and Attitude Change
- Smith, T. W., annual meetings of the American Sociological Association
- Smith, T. W. and C. B. Stephenson. 1979. “An Analysis of Test/Retest Experiments on the 1972, 1973, 1974, and 1978 General Social Surveys.” GSS Technical Report, No. 14, December, Chicago: National Opinion Research Center.
- Weisberg, H. F., “Evaluation of the Feeling Thermometer: A Report to the National Election Study Board Based on Data from the 1979 Pilot Survey.”
- Zaller, J., annual meetings of the American Political Science Association
Cited by
Sorted by citations
Items 301–400 of 403
Testing the Effects of Paired Issue Statements on the Seven-Point Issue Scales
Jacoby, W. G. (1993) · Political Analysis · doi:10.1093/pan/5.1.61 · Cited by 2
Expanding Discrimination Research: Moving Beyond Ethnicity and to the WebPreprint
Kuran, T., & McCaffery, E. J. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.383001 · Cited by 2
Impact of the mode of data collection on the quality of survey questions in social sciences
Revilla, M. (2012) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 2
Lilleoja, L., & Saris, W. E. (2015) · Repositori digital de la UPF (Universitat Pompeu Fabra) · Cited by 2
Li, J. (2012) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 2
Le potentiel du web pour les enquêtes de mobilité urbaine
Bayart, C. (2009) · theses.fr (ABES) · doi:10.70675/f24ead35z02f4z461az92f3z530def500e38 · Cited by 2
Suss, R., Bholanath, T., Dongchung, T. Y., Seligson, A. L., Norman, C. C., & Dumas, S. E. (2023) · Survey Practice · doi:10.29115/sp-2023-0003 · Cited by 1
Trend Analysis with Pooled Data from Different Survey Series: The Latent Attitude Method
Wang, D., Xie, Y., & Huang, J. (2023) · Sociological Methodology · doi:10.1177/00811750231193641 · Cited by 3
The Effectiveness of Education and Fear Appeal to Prevent Spear Phishing Attacks
Alsulami, S., & Dupuis, M. (2024) · Cyber Awareness and Research Symposium (CARS) · doi:10.1109/cars61786.2024.10778693 · Cited by 1
Heizmann, B. (2025) · Quality & Quantity · doi:10.1007/s11135-025-02060-7 · Cited by 1
Nguyen, H. C., & Nguyen, Q. L. H. T. T. (2025) · Cogent Social Sciences · doi:10.1080/23311886.2025.2490676 · Cited by 1
Zhang, S., & Li, Z. (2025) · Geographical Analysis · doi:10.1111/gean.70021 · Cited by 1
Fully Labeled Scales Are More Cognitively Demanding: A Multimodal Cognitive Load Approach
Klimova, A., Deviatko, I. F., Лебедев, Д. В., & Semenova, T. (2025) · Field Methods · doi:10.1177/1525822x251344709 · Cited by 1
AI Where It Matters: Where, Why, and How Developers Want AI Support in Daily Work
Choudhuri, R., Badea, C., Bird, C., Butler, J. L., DeLine, R., & Houck, B. (2026) · Proceedings of the IEEE/ACM 48th International Conference on Software Engineering: Software Engineering in Practice · doi:10.1145/3786583.3786885 · Cited by 1
Hamby, T. (2015) · UTA ResearchCommons (University of Texas Arlington) · Cited by 1
Estimating Survey Questionnaire Profiles for Measurement Error Risk
Schouten, B., Bais, F., & Toepoel, V. (2017) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smx027 · Cited by 1
Liao, P., Saris, W. E., & Zavala‐Rojas, D. (2019) · Journal of Official Statistics · doi:10.2478/jos-2019-0006 · Cited by 1
Pulickal, A., & Chakravarty, S. (2023) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2023.101986 · Cited by 1
Gonçalves, C. P., & Ayrosa, E. A. T. (2022) · Revista Eletrônica de Ciência Administrativa · doi:10.21529/recadm.2022015 · Cited by 1
No One Optimal Way to Measure People’s Attitudes? Preferred Length of Scales in Advertising Research
Yoon, G. (2023) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2023.2246049 · Cited by 1
The promises and pitfalls of using panel data to understand individual belief change
Keskintürk, T., Bello, P., & Vaisey, S. (2025) · Political Psychology · doi:10.1111/pops.70056 · Cited by 2
STUDY COMPARING THE LEVEL OF COMPETENCIES ACHIEVED WITHIN ONE UNIVERSITY COURSE
Krchova, H. (2018) · SGEM International Multidisciplinary Scientific Conferences on Social Sciences and Arts · doi:10.5593/sgemsocial2018/1.5/s05.119 · Cited by 1
Understanding the justifiability scale in international surveys: an exploratory study
Remizova, A., & Rudnev, M. (2019) · International Journal of Social Research Methodology · doi:10.1080/13645579.2019.1683135 · Cited by 1
Thomas, S. M. (2020) · International Conference on Social Sciences/International Conference on Marketing · doi:10.17501/2357268x.2019.6103 · Cited by 1
Götz, M. A. (2021) · Routledge eBooks · doi:10.4324/9781003005506-6 · Cited by 1
Dagard, J., Mazille, N., Georgi, N., Dechicha, I., Carrault, G., Pladys, P., & Beuchée, A. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01628-1 · Cited by 1
Evaluating the State-of-the-Art in Business Process Management Tools and Methodologies
Konterman, R. R. (2010) · Research Repository (Delft University of Technology) · Cited by 1
Olsen, H. (1998) · Dansk Sociologi · doi:10.22439/dansoc.v9i1.753 · Cited by 1
The Public Value of eGovernment
Scott, M. (2011) · Arrow@dit (Dublin Institute of Technology) · doi:10.13025/17772 · Cited by 1
Unlocking Souvenir Shopping Tourism in Indonesia : a Cross-Cultural Study
Kusdibyo, L. (2015) · Victoria University Research Repository (Victoria University) · Cited by 1
(2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.011 · Cited by 1
Co-worker Assessment and Physician Multisource Feedback
Trueman, G. (2013) · doi:10.11575/prism/25478 · Cited by 1
Kumpirarusk, P. (2012) · NIDA Wisdom Repository · doi:10.82164/7erg-q167 · Cited by 1
Constructing Behaviour Profiles for Answer Behaviour Across Surveys.
Bais, F. (2021) · doi:10.33540/538 · Cited by 1
Reda, A. A., Aboussalah, A. M., & Sinanoğlu, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3924999 · Cited by 1
Wang, J., & Wang, X. (2012) · Wiley series in probability and statistics · doi:10.1002/9781118356258.refs · Cited by 1
Aschauer, W. (2021) · The Blackwell Encyclopedia of Sociology · doi:10.1002/9781405165518.wbeos1698 · Cited by 1
What Surveys Can Tell Us about Public Opinion
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.008 · Cited by 1
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.001
Horn, A. B., & Niemeijer, E. (2010) · Utrecht University Repository (Utrecht University)
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.002
Ranking the individual related factors that influence change adoption
Lindelauf, O. F. (2012) · DSpace (Open University in the Netherlands)
Johnston, R. J., & Pattie, C. J. (1999) · Environment and Planning A Economy and Space · doi:10.1068/a311773
Antecedents of organizational commitment in young generation with Chinese family business background
Wang, Y. (2015) · Spectrum Research Repository (Concordia University)
Methodological questions in lighting acceptance and preference studies
Hyvärinen, M. (2015)
Noack, M. (2014) · Springer eBooks · doi:10.1007/978-3-531-18994-9_10
Zaman, T., & Bayoumi, A. E. (2014) · Vertical Flight Society Forum · doi:10.4050/f-0070-2014-9616
EXPERIENCE WITH PRESCRIPTIVE AUTHORITY SERVICES AMONG COMMUNITY PHARMACISTS IN SASKATCHEWAN
Jain, R. (2015) · University Library - University of Saskatchewan (University of Saskatchewan)
The Structure and Causes of Information Effects
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.005
Mode and scale effects : measuring confidence in institutions
Blunsdon, B., & Reed, K. (2006) · Deakin Research Online (Deakin University)
Unequal equality: The impact of differing perspectives on race-based choices
Lien, A. D. (2013) · Holmes Museum Of Anthropology (Wichita State University)
Once a Satisficer, Not Always a Satisficer: Evidence from an Awareness Control ExperimentPreprint
Lundmark, S., & Martinsson, J. (2014) · SSRN Electronic Journal
Chylíková, J. (2016) · Czech Sociological Review · doi:10.13060/00380288.2016.52.1.243
The Impact of Information Effects
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.004
Althaus, S. L. (2003) · doi:10.1017/cbo9780511610042.009
The Temporal Dynamics of Information Effects
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042.006
Jacobsen, L. (2012) · IRL - University of Missouri, St. Louis (University of Missouri–St. Louis)
Are Our Values Being Measured Adequately? Creation Of A More Comprhensive Work Values Scale
Krenn, D. R. (2016) · Human Biology
Mat á lífsgæðum og samanburður á sjálfsmatskvörðum
Frímannsdóttir, A. (2014)
Davis, G. (2014) · OhioLink ETD Center (Ohio Library and Information Network)
Kutscher, T., & Eid, M. (2020) · Journal of Well-Being Assessment · doi:10.1007/s41543-021-00041-9
MÜŞTERİ MEMNUNİYETİ ÖLÇÜM KALİTESİNİ, TERCİH EDİLEN ÖLÇEK DERECESİ NASIL ETKİLER?
TAVŞAN, N., & Duran, C. (2021) · İstanbul Ticaret Üniversitesi Sosyal Bilimler Dergisi · doi:10.46928/iticusbe.873800
Recruiting Majors: Decision Factors and the Impact of an Introductory Information Systems Course
Miller, R. E., & Jensen, B. (2014) · Journal of the Association for Information Systems
Combes, H. (2011) · Karthala eBooks · doi:10.3917/kart.combe.2011.01.0425
Elkordy, E. R., Selim, E. M. N., & Sharaby, F. A. E. (2021) · Open Access Macedonian Journal of Medical Sciences · doi:10.3889/oamjms.2021.7197
Althaus, S. L. (2003) · doi:10.1017/cbo9780511610042.010
Wang, J., & Wang, X. (2019) · Wiley series in probability and statistics · doi:10.1002/9781119422730.refs
(1998) · Current Sociology · doi:10.1177/0011392198046004008
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.001.0001.002.004
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.002.0001
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.001.0001.002.005
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.001.0001.002.010
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.001.0001.002.007
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.001.0001.002.009
(2003) · Oxford University Press eBooks · doi:10.1093/0199251789.001.0001.002.008
Eru vannýtt tækifæri til að draga úr skattsvikum? Spjótum beint að siðferði og persónuleika
Steinarsdóttir, A. L., & Hermannsdóttir, A. (2023) · Icelandic Review of Politics & Administration · doi:10.13177/irpa.a.2023.19.2.4
Smáatriðin skipta sköpum: Áhrif birtustigs og litastyrks á skynjun og hegðun neytenda
Hilmarsdóttir, T. B., & Hermannsdóttir, A. (2023) · Tímarit um viðskipti og efnahagsmál · doi:10.24122/tve.a.2023.20.2.3
Mukwakungu, S. C., & Mbohwa, C. (2023) · International Conference on Industrial Engineering and Operations Management (IEOM) · doi:10.46254/au02.20230008
Effect of branching middle responses in dichotomous scales on web surveys
Suzer‐Gurtekin, Z. T. (2024) · International Journal of Market Research · doi:10.1177/14707853241268207
Enhancing quality in online surveys: uncovering foundational themes and strategies
Yoda, F. S., & Freire, O. B. D. L. (2024) · ReMark - Revista Brasileira de Marketing · doi:10.5585/remark.v23i4.25692
Storstad, O., Caspersen, J., & Wendelborg, C. (2025) · Universitetsforlaget eBooks · doi:10.18261/9788215073934-25-01
van Someren, M. D., & Booij, P. E. (2009) · Utrecht University Repository (Utrecht University)
Dagard, J., Mazille, N., Georgi, N., Dechicha, I., Carrault, G., Pladys, P., & Beuchée, A. (2021) · Figshare · doi:10.6084/m9.figshare.16655469
Dagard, J., Mazille, N., Georgi, N., Dechicha, I., Carrault, G., Pladys, P., & Beuchée, A. (2021) · Figshare · doi:10.6084/m9.figshare.16655472
HOW DOES THE PREFERRED NUMBER OF SCALE POINTS AFFECTS THE CUSTOMER SATISFACTION MEASUREMENT QUALITY?
TAVŞAN, N., & Duran, C. (2021) · DergiPark (Istanbul University)
Jabkowski, P., Cichocki, P., & Piekut, A. (2026) · International Journal of Social Research Methodology · doi:10.1080/13645579.2026.2680975
Hidden bias in categorical response scales: Evidence from the U.S
McFadden, B. R., Schlichtig, E., Brownback, A., Nalley, L. L., & Shew, A. (2026) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2026.102597
Führung, Digitalisierung und Individualisierung in der Schulentwicklung
Hormann, O., Zschiesche, B., & Gerick, J. (2026) · MedienPädagogik Zeitschrift für Theorie und Praxis der Medienbildung · doi:10.21240/mpaed/00/2026.08.01.x
Dyadic: A Scalable Platform for Research on Human–Human and Human–AI Conversation
Markowitz, D. M. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261481065
Sibé, M., Abraham, M., & Arditi, N. (2026) · Journal de gestion et d économie médicales · doi:10.54695/jdds.043.4.0010
Neville, I. A., Petrass, L. A., & Polley, S. (2026) · Journal of Adventure Education & Outdoor Learning · doi:10.1080/14729679.2026.2744371
Validating survey measures of acquaintance networks for political behavior research
Pietryka, M. T., & Sokhey, A. E. (2026) · Network Science · doi:10.1017/nws.2026.10047
Weber, W., Felderer, B., & Kreider, A. (2026) · Quality & Quantity · doi:10.1007/s11135-026-03088-z
Metadata
- Authors
- ALWIN, D. F., & KROSNICK, J. A.
- Affiliations
- University of Michigan (US)
- The Ohio State University (US)
- ORCID
- KROSNICK, JON A.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1991-08
- Volume
- 20
- Issue
- 1
- Pages
- 139-181
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2137597548
- Cited by
- 403
- References
- 74
- Citations by year
- 2026: 10 · 2025: 13 · 2024: 17 · 2023: 18 · 2022: 16 · 2021: 31 · 2020: 15 · 2019: 19 · 2018: 16 · 2017: 15 · 2016: 12 · 2015: 31 · 2014: 16 · 2013: 13 · 2012: 17
- FWCI
- 7.65
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Sociological Methods & Research (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- survey reliability, attitude measurement, question characteristics, response options, respondent characteristics, age effects, educational attainment, survey error, General Social Survey
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review