The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes
Open accessAbstract
Several theoretical hypotheses are developed concerning the relation of question and respondent characteristics to the reliability of survey attitude measurement. To test these hypotheses, reliability is estimated for 96 survey attitude measures using data from five, 3-wave national reinterview surveys-three Michigan Election Panel Surveys and two reinterview studies conducted by the General Social Survey. As hypothesized, a number of attributes of questions are linked to estimated reliability. Attitude questions with more response options tended to have higher reliabilities, although there are some important exceptions. More extensive verbal labeling of numbered response options was found to be associated with higher reliability, but questions explicitly offering a “don't know” alternative were not found to be more reliable. Question characteristics were confounded to an unknown degree with topic differences of questions, which were significantly linked to reliability, leaving the influence of question characteristics on reliability somewhat ambiguous. Characteristics of respondents were also found to be related to levels of reliability. Older respondents and those with less schooling provided the least reliable attitude reports. These results are discussed within a general framework for the consideration of survey errors and their sources.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Increased error in a population, whether systematic or random, makes measures less capable at capturing individual differences in the trait of interest in that population.
“Increased error in some population (whether systematic or random) makes measures less capable at capturing individual differences in the trait of interest in that population (see e.g., refs. 20–22; see also ref. 23).”
From Simpson’s gender-equality paradox (2025) · cites this paper as [20]
Cites
Advances In Experimental Social Psychology
(2022) · Advances in experimental social psychology · doi:10.1016/s0065-2601(22)x0002-6 · Cited by 22,559 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812 · see citing works
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669 · see citing works
Statistical Theories of Mental Test Scores.
Tatsuoka, M., Lord, F., Novick, M. R., & Birnbaum, A. (1971) · Journal of the American Statistical Association · doi:10.2307/2283550 · Cited by 7,645 · see citing works
Review of personality and social psychology
Davies, M. (1983) · Personality and Individual Differences · doi:10.1016/0191-8869(83)90072-7 · Cited by 3,393 · see citing works
Wicker, A. W. (1969) · Journal of Social Issues · doi:10.1111/j.1540-4560.1969.tb00619.x · Cited by 2,152 · see citing works
The American Journal of Sociology
F., C. B. (1939) · American Journal of Psychiatry · doi:10.1176/ajp.96.1.252 · Cited by 1,914 · see citing works
Questions and answers in attitude surveys: Experiments on question form, wording, and context
(1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90054-w · Cited by 1,718 · see citing works
Smith, H. W., & Triandis, H. C. (1972) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2063502 · Cited by 1,393 · see citing works
Gusfield, J. R., & Apter, D. E. (1966) · American Sociological Review · doi:10.2307/2091287 · Cited by 1,279 · see citing works
General Social Surveys: 1972 - 1994; cumulative codebook
Davis, J. A., & Smith, T. (1994) · Cited by 842 · see citing works
Haslegrave, C. M. (1988) · Applied Ergonomics · doi:10.1016/0003-6870(88)90184-6 · Cited by 816 · see citing works
The Optimal Number of Response Alternatives for a Scale: A Review
Cox, E. P. (1980) · Journal of Marketing Research · doi:10.2307/3150495 · Cited by 812 · see citing works
Mass Political Attitudes and the Survey Response
Achen, C. H. (1975) · American Political Science Review · doi:10.2307/1955282 · Cited by 744 · see citing works
Aging and susceptibility to attitude change.
Krosnick, J. A., & Alwin, D. F. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.3.416 · Cited by 723 · see citing works
Self-citationWilcox, J. B., Rossi, P. H., Wright, J. D., & Anderson, A. B. (1985) · Journal of Marketing Research · doi:10.2307/3151558 · Cited by 708 · see citing works
The Quantitative Analysis of Social Problems.
Lujan, H. D., & Tufte, E. R. (1971) · Midwest Journal of Political Science · doi:10.2307/2110128 · Cited by 661 · see citing works
Separating Reliability and Stability in Test-Retest Correlation
Heise, D. R. (1969) · American Sociological Review · doi:10.2307/2092790 · Cited by 593 · see citing works
Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity
Matell, M. S., & Jacoby, J. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100307 · Cited by 574 · see citing works
Effect of the number of scale points on reliability: A Monte Carlo approach.
Lissitz, R. W., & Green, S. B. (1975) · Journal of Applied Psychology · doi:10.1037/h0076268 · Cited by 488 · see citing works
Annual Meeting of The American Sociological Association
Hashem, M. (1995) · American Journal of Islam and Society · doi:10.35632/ajis.v12i1.2400 · Cited by 425 · see citing works
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Andrews, F. M. (1984) · Public Opinion Quarterly · doi:10.1086/268840 · Cited by 419 · see citing works
Simon, H. A. (1977) · Boston studies in the philosophy of science · doi:10.1007/978-94-010-9521-1 · Cited by 418 · see citing works
Plus ça change…: The New CPS Election Study Panel
Converse, P. E., & Markus, G. B. (1979) · American Political Science Review · doi:10.2307/1954729 · Cited by 402 · see citing works
Matell, M. S., & Jacoby, J. (1972) · Journal of Applied Psychology · doi:10.1037/h0033601 · Cited by 354 · see citing works
Multiple Classification Analysis
Retherford, R. D., & Choe, M. K. (1993) · doi:10.1002/9781118033135.ch3 · Cited by 329 · see citing works
Political Attitudes during an Election Year: A Report on the 1980 NES Panel Study
Markus, G. B. (1982) · American Political Science Review · doi:10.1017/s0003055400188392 · Cited by 278 · see citing works
ESTIMATION AND TESTING OF SIMPLEX MODELS
Jöreskog, K. G. (1970) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1970.tb00439.x · Cited by 274 · see citing works
Research Methods in Social Relations
Boyd, H. W., Jahoda, M., Deutsch, M., & Cook, S. W. (1954) · Journal of Marketing · doi:10.2307/1246908 · Cited by 266 · see citing works
The Effect of the Question on Survey Responses: A Review
Kalton, G., & Schuman, H. (1982) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981421 · Cited by 259 · see citing works
Rating Scales and Information Recovery. How Many Scales and Response Categories to Use?
Green, P. E., & Rao, V. R. (1970) · Journal of Marketing · doi:10.1177/002224297003400307 · Cited by 259 · see citing works
The Estimation of Measurement Error in Panel Data
Wiley, D. E., & Wiley, J. A. (1970) · American Sociological Review · doi:10.2307/2093858 · Cited by 257 · see citing works
(2010) · Sociological Methodology · doi:10.1111/(issn)1467-9531 · Cited by 256 · see citing works
The Estimation of Measurement Error in Panel Data *
Wiley, D. E., Wiley, J. A., & Blalock, H. M. (2017) · Routledge eBooks · doi:10.4324/9781315081670-9 · Cited by 251 · see citing works
Survey Methods in Social Investigation.
Harvey, A., Moser, C. A., & Kalton, G. (1972) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2986691 · Cited by 228 · see citing works
Number of Scale Points and the Reliability of Scales
Komorita, S. S., & Graham, W. K. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500404 · Cited by 196 · see citing works
On the loss of reliability in ratings due to coarseness of the scale
Symonds, P. M. (1924) · Journal of Experimental Psychology · doi:10.1037/h0074469 · Cited by 194 · see citing works
The Structure of Attitude Systems in the General Public: Comparisons of a Structural Equation Model
Judd, C. M., & Milburn, M. A. (1980) · American Sociological Review · doi:10.2307/2095012 · Cited by 190 · see citing works
Measurement in the Social Sciences
(1974) · doi:10.1007/978-1-349-02473-5 · Cited by 190 · see citing works
Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings
Finn, R. H. (1972) · Educational and Psychological Measurement · doi:10.1177/001316447203200203 · Cited by 164 · see citing works
A Monte Carlo study of factors affecting three indices of composite scale reliability.
Jenkins, G. D., & Taber, T. D. (1977) · Journal of Applied Psychology · doi:10.1037/0021-9010.62.4.392 · Cited by 160 · see citing works
Attitude Content, Intensity, and the Neutral Point on a Likert Scale
Komorita, S. S. (1963) · The Journal of Social Psychology · doi:10.1080/00224545.1963.9919489 · Cited by 158 · see citing works
Methodological Issues in Aging Research
Bergeman, C. S., & Boker, S. M. (2015) · Psychology Press eBooks · doi:10.4324/9781315820989 · Cited by 147 · see citing works
Political Involvement and Attitude Structure in the General Public
Judd, C. M., Krosnick, J. A., & Milburn, M. A. (1981) · American Sociological Review · doi:10.2307/2094947 · Cited by 141 · see citing works
Self-citationSocial indicators of well-being: Americans' perceptions of life quality
Gottlieb, A. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90013-0 · Cited by 123 · see citing works
Rating scales, discriminability, and information transmission.
Garner, W. R. (1960) · Psychological Review · doi:10.1037/h0043047 · Cited by 116 · see citing works
Surveying Subjective Phenomena
Sudman, S., Turner, C. F., & Martin, E. (1986) · Journal of Marketing Research · doi:10.2307/3151668 · Cited by 97 · see citing works
Bendig, A. W. (1953) · Journal of Applied Psychology · doi:10.1037/h0057911 · Cited by 91 · see citing works
Comment: Rejoinder To Judd And Milburn
Converse, P. E. (1980) · American Sociological Review · doi:10.2307/2095013 · Cited by 89 · see citing works
Attitudes toward old people in an older sample.
Kogan, N. (1961) · Journal of Abnormal & Social Psychology · doi:10.1037/h0048356 · Cited by 84 · see citing works
Effects of Filter Questions in Public Opinion Surveys
Bishop, G. F., Oldendick, R. W., & Tuchfarber, A. J. (1983) · Public Opinion Quarterly · doi:10.1086/268810 · Cited by 80 · see citing works
Comment: The Status of Nonattitudes
Converse, P. E. (1974) · American Political Science Review · doi:10.1017/s0003055400117447 · Cited by 74 · see citing works
Interviewing Older Adults: the Accuracy of Factual Information
Rodgers, W. L., & Herzog, A. R. (1987) · Journal of Gerontology · doi:10.1093/geronj/42.4.387 · Cited by 73 · see citing works
Problems in the estimation and interpretation of the reliability of survey data
Alwin, D. F. (1989) · Quality & Quantity · doi:10.1007/bf00172447 · Cited by 71 · see citing works
Self-citationOptimal refinement of the rating scale.
Champney, H., & Marshall, H. (1939) · Journal of Applied Psychology · doi:10.1037/h0054522 · Cited by 71 · see citing works
The Quality of Survey Data as Related to Age of Respondent
Andrews, F. M., & Herzog, A. R. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478284 · Cited by 70 · see citing works
Width of the latitude of acceptance as a determinant of attitude change.
Eagly, A. H., & Telaak, K. A. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0033161 · Cited by 70 · see citing works
Making Inferences from Attitude-Behavior Correlations
Alwin, D. F. (1973) · Sociometry · doi:10.2307/2786570 · Cited by 62 · see citing works
Self-citationA Study of the Likert Technique of Attitude Scale Construction
Ferguson, L. W. (1941) · The Journal of Social Psychology · doi:10.1080/00224545.1941.9714060 · Cited by 61 · see citing works
"Don't Know": Item Ambiguity or Respondent Uncertainty?
Coombs, C. H., & Coombs, L. C. (1976) · Public Opinion Quarterly · doi:10.1086/268336 · Cited by 57 · see citing works
Are Three-Point Scales Always Good Enough?
Lehmann, D. R., & Hulbert, J. M. (1972) · Journal of Marketing Research · doi:10.2307/3149313 · Cited by 55 · see citing works
Attitudes, Conflict, and Social Change
(1972) · Elsevier eBooks · doi:10.1016/c2013-0-10972-5 · Cited by 51 · see citing works
Comparative reliability of numerically anchored versus job-task anchored rating scales.
Peters, D. L., & McCormick, E. J. (1966) · Journal of Applied Psychology · doi:10.1037/h0022935 · Cited by 50 · see citing works
Measurement, psychophysics, and neural information processing
Krantz, D. H. (1974) · W.H. Freeman eBooks · Cited by 45 · see citing works
Attitude accessibility following a self-perception process.
Fázio, R. H., Herr, P. M., & Olney, T. J. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.47.2.277 · Cited by 44 · see citing works
Variation in response functions : a source of measurement error in attitude research
Saris, W. E. (1988) · Cited by 44 · see citing works
Comment on "The Estimation of Measurement Error in Panel Data"
Werts, C. E., Jöreskog, K. G., & Linn, R. L. (1971) · American Sociological Review · doi:10.2307/2093511 · Cited by 41 · see citing works
Bean, L. H., & Cantril, H. (1944) · Journal of the American Statistical Association · doi:10.2307/2280646 · Cited by 38 · see citing works
Survey Errors and Survey Costs.
Paterson, L., & Groves, R. M. (1992) · Biometrics · doi:10.2307/2532368 · Cited by 35 · see citing works
Murphy, G., & Likert, R. (1938) · Harper & Bros. eBooks · Cited by 33 · see citing works
Transmitted information and the length of rating scales.
Bendig, A. W. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055679 · Cited by 22 · see citing works
Effects of variations in rating scale format on judgment.
Madden, J. M., & Bourdon, R. D. (1964) · Journal of Applied Psychology · doi:10.1037/h0047779 · Cited by 17 · see citing works
American National Elections Studies Data Sourcebook, 1952-1978
Miller, W. E., Miller, A. H., & Schneider, E. J. (1981) · American Political Science Review · doi:10.2307/1961093 · Cited by 16 · see citing works
Bohrnstedt, G. W., Mohler, P. P., & Müller, W. (1987) · Sociological Methods & Research · doi:10.1177/0049124187015003001 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128 · see citing works
“This number of response options was selected after extensive discussion based on prior work [36] and analyses of available large data sets, in which five response options produced data sets with ample responses in each option for IRT analysis; provided good discrimination in item characteristic curves without producin…”
Diani, M., & McAdam, D. (2003) · doi:10.1093/0199251789.001.0001 · Cited by 1,456 · see citing works
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 813 · see citing works
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 625 · see citing works
Choosing the Number of Categories in Agree–Disagree Scales
Revilla, M., Saris, W. E., & Krosnick, J. A. (2013) · Sociological Methods & Research · doi:10.1177/0049124113509605 · Cited by 560 · see citing works
Self-citationDesigning Rating Scales for Effective Measurement in Surveys
Krosnick, J. A., & Fabrigar, L. R. (1997) · Wiley series in probability and statistics · doi:10.1002/9781118490013.ch6 · Cited by 540 · see citing works
Self-citationSocial Trust and Attitudes Toward Democracy
Zmerli, S., & Newton, K. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn054 · Cited by 504 · see citing works
Feeling Thermometers Versus 7-Point Scales
Alwin, D. F. (1997) · Sociological Methods & Research · doi:10.1177/0049124197025003003 · Cited by 358 · see citing works
Self-citationCollective Preferences in Democratic Politics
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042 · Cited by 340 · see citing works
Developing an Instrument to Measure Customer Service Quality in Branch Banking
Avkiran, N. K. (1994) · International Journal of Bank Marketing · doi:10.1108/02652329410063223 · Cited by 343 · see citing works
Cross‐Talk in Movements: Reconceiving the Culture‐Network Link
Mische, A. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0011 · Cited by 315 · see citing works
Social Networks Matter. But How
Passy, F. (2002) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0002 · Cited by 233 · see citing works
Collective preferences in democratic politics: opinion surveys and the will of the people
(2004) · Choice Reviews Online · doi:10.5860/choice.42-1221 · Cited by 271 · see citing works
Who takes Risks When and Why: Determinants of Changes in Investor Risk Taking*
Weber, M., Weber, E. U., & Nosić, A. (2012) · European Finance Review · doi:10.1093/rof/rfs024 · Cited by 273 · see citing works
Is the Left-Right Scale a Valid Measure of Ideology?
Bauer, P. C., Barberá, P., Ackermann, K., & Venetz, A. (2016) · Political Behavior · doi:10.1007/s11109-016-9368-2 · Cited by 272 · see citing works
Lambert, L. S., & Newman, D. A. (2022) · Organizational Research Methods · doi:10.1177/10944281221115374 · Cited by 301 · see citing works
Borgers, N., Hox, J., & Sikkel, D. (2004) · Quality & Quantity · doi:10.1023/b:ququ.0000013236.29205.a6 · Cited by 285 · see citing works
A classification of response scale characteristics that affect data quality: a literature review
DeCastellarnau, A. (2017) · Quality & Quantity · doi:10.1007/s11135-017-0533-4 · Cited by 261 · see citing works
BEYOND STRUCTURAL ANALYSIS: TOWARD A MORE DYNAMIC UNDERSTANDING OF SOCIAL MOVEMENTS
Mcadam, D. (2002) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0012 · Cited by 221 · see citing works
Saris, W. E., Revilla, M., Krosnick, J. A., & Shaeffer, E. M. (2009) · Survey research methods · doi:10.18148/srm/2010.v4i1.2682 · Cited by 256 · see citing works
Self-citationMeasuring Left-Right Political Orientation: The Choice of Response Format
Kroh, M. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm009 · Cited by 250 · see citing works
Sturgis, P., Roberts, C., & Smith, P. (2012) · Sociological Methods & Research · doi:10.1177/0049124112452527 · Cited by 245 · see citing works
Diani, M. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0001 · Cited by 253 · see citing works
Effects of sustainable supply chain integration on green innovation and firm performance
Junaid, M., Zhang, Q., & Syed, M. W. (2021) · Sustainable Production and Consumption · doi:10.1016/j.spc.2021.11.031 · Cited by 259 · see citing works
‘Leaders’ Or Brokers? Positions and Influence in Social Movement Networks
Diani, M. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0005 · Cited by 237 · see citing works
Bertsou, E., & Caramani, D. (2020) · American Journal of Political Science · doi:10.1111/ajps.12554 · Cited by 224 · see citing works
Assessing Quality of Life in Adult Cancer Survivors (QLACS)
Avis, N. E., Smith, K. W., McGraw, S., Smith, R. G., Petronis, V. M., & Carver, C. S. (2005) · Quality of Life Research · doi:10.1007/s11136-004-2147-2 · Cited by 223 · see citing works
Conspicuous consumption orientation: Conceptualisation, scale development and validation
Chaudhuri, H. R., Mazumdar, S., & Ghoshal, A. (2011) · Journal of Consumer Behaviour · doi:10.1002/cb.364 · Cited by 212 · see citing works
The impact of midpoint responses and reverse coding on survey data
Weems, G. H., & Onwuegbuzie, A. J. (2001) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069033 · Cited by 196 · see citing works
Networks and Social Movements: A Research Programme
Diani, M. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0013 · Cited by 195 · see citing works
Coefficient alpha: a useful indicator of reliability?
Shevlin, M. E., Miles, J. N. V., Davies, M. N. O., & Walker, S. (2000) · Personality and Individual Differences · doi:10.1016/s0191-8869(99)00093-8 · Cited by 171 · see citing works
Hierarchical Regression Models for Interviewer and Respondent Effects
Hox, J. J. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003002 · Cited by 166 · see citing works
The Patient Experiences Questionnaire: development, validity and reliability
Pettersen, K. I. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh074 · Cited by 160 · see citing works
Development and Validation of a Quantitative Measure of Intensive Parenting Attitudes
Liss, M., Schiffrin, H. H., Mackintosh, V. H., Miles‐McLean, H., & Erchull, M. J. (2012) · Journal of Child and Family Studies · doi:10.1007/s10826-012-9616-y · Cited by 157 · see citing works
Passy, F. (2001) · Mobilization An International Quarterly · doi:10.17813/maiq.6.2.v6u4wg67x87w943h · Cited by 157 · see citing works
The Validity and Reliability of Survey Questions
Scherpenzeel, A. C., & Saris, W. E. (1997) · Sociological Methods & Research · doi:10.1177/0049124197025003004 · Cited by 156 · see citing works
Coelho, P. S., & Esteves, S. P. (2007) · International Journal of Market Research · doi:10.1177/147078530704900305 · Cited by 150 · see citing works
Direct experience and attitude change towards bears and wolves
Eriksson, M., Sandström, C., & Ericsson, G. (2015) · Wildlife Biology · doi:10.2981/wlb.00062 · Cited by 144 · see citing works
Pal, A., Herath, T. C., Dé, R., & Rao, H. R. (2021) · Research Policy · doi:10.1016/j.respol.2021.104228 · Cited by 159 · see citing works
Networks, Diffusion, and Cycles of Collective Action
Oliver, P., & Myers, D. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0008 · Cited by 118 · see citing works
Mazefsky, C. A., Day, T. N., Siegel, M. S., White, S. W., Yu, L., & Pilkonis, P. A. (2016) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-016-2907-1 · Cited by 123 · see citing works
Bizer, G. Y., & Krosnick, J. A. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.4.566 · Cited by 120 · see citing works
Self-citationPastor Paulo vs. Doctor Carlos: Professional Titles as Voting Heuristics in Brazil
Boas, T. C. (2014) · Journal of Politics in Latin America · doi:10.1177/1866802x1400600202 · Cited by 117 · see citing works
Why Do Networks Matter? Rationalist and Structuralist Interpretations
Gould, R. V. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0010 · Cited by 116 · see citing works
The Impact of Age and Education on Response Order Effects in Attitude Measurement
Knäuper, B. (1999) · Public Opinion Quarterly · doi:10.1086/297724 · Cited by 118 · see citing works
Developing a Scale to Measure Students’ Attitudes toward Chemistry Lessons
Cheung, D. (2008) · International Journal of Science Education · doi:10.1080/09500690802189799 · Cited by 111 · see citing works
Consumers and animal welfare. A comparison between European Union countries
Toma, L., Stott, A. W., Revoredo‐Giha, C., & Kupiec‐Teahan, B. (2011) · Appetite · doi:10.1016/j.appet.2011.11.015 · Cited by 111 · see citing works
The Best Way to Measure Explicit Racial Attitudes Is to Ask About Them
Axt, J. R. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617728995 · Cited by 109 · see citing works
Ansell, C. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0006 · Cited by 109 · see citing works
Lundmark, S., Gilljam, M., & Dahlberg, S. (2015) · Public Opinion Quarterly · doi:10.1093/poq/nfv042 · Cited by 108 · see citing works
Tsanos, C. S., Zografos, K. G., & Harrison, A. (2014) · The International Journal of Logistics Management · doi:10.1108/ijlm-02-2012-0005 · Cited by 110 · see citing works
Borgers, N. (2003) · International Journal for Quality in Health Care · doi:10.1093/ijpor/15.1.83 · Cited by 106 · see citing works
Mining social networks for personalized email prioritization
Yoo, S., Yang, Y., Lin, F., & Moon, I. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557124 · Cited by 106 · see citing works
Revilla, M., & Ochoa, C. (2014) · Social Science Computer Review · doi:10.1177/0894439314531214 · Cited by 101 · see citing works
Sociodemographic factors and mail survey response
Green, K. E. (1996) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(199602)13:2 · Cited by 98 · see citing works
Chipchase, L. S., Buttrum, P. J., Dunwoodie, R., Hill, A. E., Mandrusiak, A., & Moran, M. (2012) · BMC Medical Education · doi:10.1186/1472-6920-12-112 · Cited by 97 · see citing works
An integrated scale for measuring an organizational learning system
Jyothibabu, C., Farooq, A., & Pradhan, B. B. (2010) · The Learning Organization · doi:10.1108/09696471011043081 · Cited by 89 · see citing works
Webster, C. (1996) · Journal of Marketing Research · doi:10.1177/002224379603300106 · Cited by 86 · see citing works
Political Trust and Sophistication: Taking Measurement Seriously
Turper, S., & Aarts, K. (2015) · Social Indicators Research · doi:10.1007/s11205-015-1182-4 · Cited by 85 · see citing works
Measuring Media Diet in a High-Choice Environment - Testing the List-Frequency Technique
Andersen, K. V., de Vreese, C. H., & Albæk, E. (2016) · Communication Methods and Measures · doi:10.1080/19312458.2016.1150973 · Cited by 81 · see citing works
Variations in Response Style Behavior by Response Scale Format in Attitude Research
Kieruj, N. D., & Moors, G. (2010) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edq001 · Cited by 72 · see citing works
Designing a Strategy for Reducing “No Opinion” Responses in Web-Based Surveys
Derouvray, C., & Couper, M. P. (2002) · Social Science Computer Review · doi:10.1177/089443930202000101 · Cited by 70 · see citing works
Heleski, C., Mertig, A. G., & Zanella, A. J. (2005) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.2005.226.1538 · Cited by 70 · see citing works
Perrin, E. M., Vann, J. C. J., Lazorick, S., Ammerman, A. S., Teplin, S., Flower, K. B., Wegner, S. E., & Benjamin, J. T. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.07.025 · Cited by 67 · see citing works
Lünich, M. (2022) · Springer eBooks · doi:10.1007/978-3-658-36368-0 · Cited by 68 · see citing works
Neighborhood norms and substance use among teens
Musick, K., Seltzer, J. A., & Schwartz, C. R. (2007) · Social Science Research · doi:10.1016/j.ssresearch.2007.02.003 · Cited by 67 · see citing works
Advances in the Science of Asking Questions
Schaeffer, N. C., & Dykema, J. (2020) · Annual Review of Sociology · doi:10.1146/annurev-soc-121919-054544 · Cited by 60 · see citing works
Number of Response Categories and Reliability in Attitude Measurement†
Alwin, D. F., Baumgartner, E. M., & Beattie, B. (2017) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smx025 · Cited by 58 · see citing works
Self-citationCorrection for Measurement Errors in Survey Research: Necessary and Possible
Saris, W. E., & Revilla, M. (2015) · Social Indicators Research · doi:10.1007/s11205-015-1002-x · Cited by 58 · see citing works
Marchand, R., Koh, S. C. L., & Morris, J. C. (2015) · Energy Policy · doi:10.1016/j.enpol.2015.04.035 · Cited by 56 · see citing works
Saris, W. E., van Wijk, T., & Scherpenzeel, A. C. (1998) · Social Indicators Research · doi:10.1023/a:1006993730546 · Cited by 54 · see citing works
How Do Respondents Attend to Verbal Labels in Rating Scales?
Menold, N., Kaczmirek, L., Lenzner, T., & Neusar, A. (2013) · Field Methods · doi:10.1177/1525822x13508270 · Cited by 54 · see citing works
Networks in Opposition: Linking Organizations through Activists in the Polish People's Republic
Osa, M. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0004 · Cited by 54 · see citing works
Effect of response scale on assessment of emotional intelligence competencies
Batista‐Foguet, J. M., Saris, W. E., Boyatzis, R. E., Guillén, L., & Serlavós, R. (2009) · Personality and Individual Differences · doi:10.1016/j.paid.2008.12.011 · Cited by 53 · see citing works
Understanding Satisfaction with Schools: The Role of Expectations
Jacobsen, R., Snyder, J. W., & Saultz, A. (2014) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muu026 · Cited by 52 · see citing works
Concerning Trends in Likert Scale Usage in Human-robot Interaction: Towards Improving Best Practices
Schrum, M., Ghuy, M., Hedlund-Botti, E., Natarajan, M., Johnson, M., & Gombolay, M. (2022) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3572784 · Cited by 51 · see citing works
Sex differences in jealousy: Misinterpretation of nonsignificant results as refuting the theory
Edlund, J. E., & Sagarin, B. J. (2009) · Personal Relationships · doi:10.1111/j.1475-6811.2009.01210.x · Cited by 50 · see citing works
Movement in Context: Thick Networks and Japanese Environmental Protest
Broadbent, J. P. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0009 · Cited by 49 · see citing works
The Problem with Online Data Collection: Predicting Invalid Responding in Undergraduate Samples
Al-Salom, P., & Miller, C. J. (2017) · Current Psychology · doi:10.1007/s12144-017-9674-9 · Cited by 48 · see citing works
Proenvironmental attitudes predict proenvironmental consumer behaviors over time
Bleidorn, W., Lenhausen, M. R., & Hopwood, C. J. (2021) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2021.101627 · Cited by 49 · see citing works
The Role of School Libraries in Reducing Learning Disadvantages in Migrant Children
Kleijnen, E., Huysmans, F., & Elbers, E. (2015) · SAGE Open · doi:10.1177/2158244015580369 · Cited by 47 · see citing works
Panagakou, S. G., Theodoridou, M. N., Papaevangelou, V., Papastergiou, P., Syrogiannopoulos, G. A., Goutziana, G. P., & Hadjichristodoulou, C. S. (2009) · BMC Infectious Diseases · doi:10.1186/1471-2334-9-52 · Cited by 47 · see citing works
Contentious Connections in Great Britain, 1828–34
Tilly, C., & Wood, L. J. (2003) · Oxford University Press eBooks · doi:10.1093/0199251789.003.0007 · Cited by 47 · see citing works
Pérez, A. M., Rodríguez‐Arias, D., Delgado, J., Morgan, M., Frunză, M., Randhawa, G., de Wijdeven, J. R.-V., Schiks, E., Wöhlke, S., & Schicktanz, S. (2018) · Transplantation Reviews · doi:10.1016/j.trre.2018.09.001 · Cited by 48 · see citing works
An Electorate Adrift?: Public Opinion and the Quality of Democracy in Mexico
McCann, J. A., & Lawson, C. H. (2003) · Latin American Research Review · doi:10.1353/lar.2003.0039 · Cited by 46 · see citing works
Response Heaping in Interviewer-Administered Surveys: Is It Really a Form of Satisficing?
Holbrook, A. L., Anand, S., Johnson, T. P., Cho, Y. I., Shavitt, S., Chávez, N. R., & Weiner, S. J. (2014) · Public Opinion Quarterly · doi:10.1093/poq/nfu017 · Cited by 42 · see citing works
The effect of discrete vs. continuous-valued ratings on reputation and ranking systems
Medo, M., & Wakeling, J. R. (2010) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/91/48004 · Cited by 37 · see citing works
Pinkus, E., Moore, S. A., Taplin, R., & Pearce, J. (2016) · Journal of Outdoor Recreation and Tourism · doi:10.1016/j.jort.2016.08.002 · Cited by 39 · see citing works
Remus, A., Smith, V. A., & Wuytack, F. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01197-3 · Cited by 38 · see citing works
Positive First or Negative First?
Krebs, D., & Hoffmeyer-zlotnik, J. H. P. (2010) · Methodology · doi:10.1027/1614-2241/a000013 · Cited by 36 · see citing works
Comparing Extreme Response Styles between Agree-Disagree and Item-Specific Scales
Liu, M., Lee, S., & Conrad, F. G. (2015) · Public Opinion Quarterly · doi:10.1093/poq/nfv034 · Cited by 36 · see citing works
Measurement of Latent Variables With Different Rating Scales
Menold, N., & Tausch, A. (2015) · Sociological Methods & Research · doi:10.1177/0049124115583913 · Cited by 36 · see citing works
Predicting sentencing for low-level crimes: Comparing models of human judgment.
von Helversen, B., & Rieskamp, J. (2009) · Journal of Experimental Psychology Applied · doi:10.1037/a0018024 · Cited by 36 · see citing works
Order Effects in Batteries of Questions
Siminski, P. (2006) · Quality & Quantity · doi:10.1007/s11135-006-9054-2 · Cited by 36 · see citing works
Benner, A. D., Wang, Y., Chen, S., & Boyle, A. E. (2022) · Developmental Review · doi:10.1016/j.dr.2022.101025 · Cited by 35 · see citing works
Impact of the Financial Crisis on Bank Run Risk - Danger of the Days After
Goedde‐Menke, M., Langer, T., & Pfingsten, A. (2012) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2013.11.028 · Cited by 35 · see citing works
Andrew, M., Eggerling-Boeck, J., Sandefur, G. D., & Smith, B. (2006) · Advances in Life Course Research · doi:10.1016/s1040-2608(06)11009-6 · Cited by 34 · see citing works
Peng, X., Li, Y., Wang, P., Mo, L., & Chen, Q. (2015) · Social Neuroscience · doi:10.1080/17470919.2014.999162 · Cited by 34 · see citing works
Children’s Reports of Parents’ Education Level: Does it Matter Whom You Ask and What You Ask About?
Kreuter, F., Eckman, S., Maaz, K., & Watermann, R. (2010) · Survey research methods · doi:10.18148/srm/2010.v4i3.4283 · Cited by 33 · see citing works
Applications of the Rasch model to evaluation of survey data quality
Green, K. E. (1996) · New Directions for Evaluation · doi:10.1002/ev.1036 · Cited by 33 · see citing works
- Authors
- ALWIN, D. F., & KROSNICK, J. A.
- Affiliations
- University of Michigan (US)
- The Ohio State University (US)
- ORCID
- KROSNICK, JON A.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1991-08
- Volume
- 20
- Issue
- 1
- Pages
- 139-181
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2137597548
- Cited by
- 403
- References
- 74
- Citations by year
- 2026: 10 · 2025: 13 · 2024: 17 · 2023: 18 · 2022: 16 · 2021: 31 · 2020: 15 · 2019: 19 · 2018: 16 · 2017: 15 · 2016: 12 · 2015: 31 · 2014: 16 · 2013: 13 · 2012: 17
- FWCI
- 7.65
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Sociological Methods & Research (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- survey reliability, attitude measurement, question characteristics, response options, respondent characteristics, age effects, educational attainment, survey error, General Social Survey
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
