The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Fast times and easy questions: the effects of age, experience and question complexity on web survey response times
Open accessAbstract
This paper examines response times (RT) to survey questions. Cognitive psychologists have long relied on response times to study cognitive processes but response time data have only recently received attention from survey researchers. To date, most of the studies on response times in surveys have treated response times either as a predictor or as a proxy measure for some other variable (e.g. attitude accessibility) of greater interest. As a result, response times have not been the main focus of the research. Focusing on the nature and determinants of response times, this paper examines variables that affect how long it takes respondents to answer questions in web surveys. Using the survey response model proposed by Tourangeau, Rips, and Rasinski (2000), we include both item‐level characteristics and respondent‐level characteristics thought to affect response times in a two‐level cross‐classified model. Much of the time spent on processing the questions involves reading and interpreting them. The results from the cross‐classified models indicate that response times are affected by question characteristics such as the total number of clauses and the number of words per clause that probably reflect reading times. In addition, response times are also affected by the number and type of answer categories, and the location of the question within the questionnaire, as well as respondent characteristics such as age, education and experience with the Internet and with completing web surveys. Aside from their fixed effects on response times, respondent‐level characteristics (such as age) are shown to vary randomly over questions and effects of question‐level characteristics (such as types of questions and response scales) vary randomly over respondents. Copyright © 2007 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Self-citationA capacity theory of comprehension: individual differences in working memory
Just, M. A., & Carpenter, P. A. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.122 · Cited by 4,153
Gill, J. (2005) · Encyclopedia of Social Measurement · doi:10.1016/b0-12-369398-5/00166-3 · Cited by 3,114
On the automatic activation of attitudes.
Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.50.2.229 · Cited by 2,584
The language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,123
Couper, M. P. (2000) · Public Opinion Quarterly · doi:10.1086/318641 · Cited by 2,078
Multiple Processes by which Attitudes Guide Behavior: The Mode Model as an Integrative Framework
Fazio, R. H. (1990) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60318-4 · Cited by 2,002
Stevens' Handbook of Experimental Psychology
(2002) · Wiley eBooks · doi:10.1002/0471214426 · Cited by 1,632
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Theoretical Perspectives on Cognitive Aging
Salthouse, T. A. (2016) · Psychology Press eBooks · doi:10.4324/9781315785363 · Cited by 940
AMERICAN ASSOCIATION FOR PUBLIC OPINION RESEARCH
STAR, S. A. (1980) · Public Opinion Quarterly · doi:10.1093/poq/44.3.420 · Cited by 814
Thinking about Answers: The Application of Cognitive Process to Survey Methodology
Aalbaum, G., Sudman, S., Bradburn, N. M., & Schwarz, N. (1996) · Journal of Marketing Research · doi:10.2307/3152133 · Cited by 783
Stewart, D. W., Schwarz, N., & Sudman, S. (1996) · Journal of Marketing Research · doi:10.2307/3152152 · Cited by 691
The Quantitative Analysis of Social Problems.
Lujan, H. D., & Tufte, E. R. (1971) · Midwest Journal of Political Science · doi:10.2307/2110128 · Cited by 659
(1995) · Bayesian Data Analysis · doi:10.1201/9780429258411-25 · Cited by 553
Theoretical perspectives on cognitive aging
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3013 · Cited by 550
An Experimental Comparison of Web and Telephone Surveys
Fricker, S. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi027 · Cited by 445
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 400
Self-citationQuestions About Questions: Inquiries into the Cognitive Bases of Surveys.
Herting, J. R., & Tanur, J. M. (1993) · Journal of the American Statistical Association · doi:10.2307/2291301 · Cited by 384
Cognition, Aging and Self-Reports
(1998) · Psychology Press eBooks · doi:10.4324/9780203345115 · Cited by 254
Thinking, Judging, and Communicating: A Process Account of Context Effects in Attitude Surveys
Strack, F., & Martin, L. L. (1987) · Recent Research in Psychology · doi:10.1007/978-1-4612-4798-2_7 · Cited by 223
New technologies for the direct and indirect assessment of attitudes.
Dovidio, J. F., & Fázio, R. H. (1992) · Cited by 184
Response Latency Versus Certainty as Indexes of the Strength of Voting Intentions in a Cati Survey
Bassili, J. N. (1993) · Public Opinion Quarterly · doi:10.1086/269354 · Cited by 183
Response-Time Measurement in Survey Research A Method for Cati and a New Look at Nonattitudes
Bassili, J. N., & Fletcher, J. F. (1991) · Public Opinion Quarterly · doi:10.1086/269265 · Cited by 162
Analysis of Response Time Distributions
Zandt, T. V. (2002) · Wiley eBooks · doi:10.1002/0471214426.pas0412 · Cited by 151
Response Latency as a Signal to Question Problems in Survey Research
Bassili, J. N., & Scott, B. S. (1996) · Public Opinion Quarterly · doi:10.1086/297760 · Cited by 137
Over de snelheid van psychische Processen
Donders, F. C. (1868) · Max Planck Digital Library · Cited by 124
Explaining Response Latencies and Changing Answers Using Client-Side Paradata from a Web Survey
Heerwegh, D. (2003) · Social Science Computer Review · doi:10.1177/0894439303253985 · Cited by 119
Attitude structure and belief accessibility
Tourangeau, R., Rasinski, K. A., & D’Andrade, R. G. (1991) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(91)90010-4 · Cited by 97
Self-citationResponse Latency Methodology for Survey Research: Measurement and Modeling Strategies
Mulligan, K., Grant, J. T., Mockabee, S. T., & Monson, J. Q. (2003) · Political Analysis · doi:10.1093/pan/mpg004 · Cited by 73
Response Latency and (Para)Linguistic Expressions as Indicators of Response Error
Draisma, S., & Dijkstra, W. (2004) · Wiley eBooks · doi:10.1002/0471654728.ch7 · Cited by 64
Editor's Introduction: Reflections on Response Latency Measurement in Telephone Surveys
Bassili, J. N. (2000) · Political Psychology · doi:10.1111/0162-895x.00174 · Cited by 18
Cited by
Contemporary Guidance for Stated Preference Studies
Johnston, R. J., Boyle, K. J., Adamowicz, W. (., Bennett, J., Brouwer, R., Cameron, T. A., Hanemann, W. M., Hanley, N., Ryan, M., Scarpa, R., et al. (2017) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/691697 · Cited by 1,430
Self-citationEffects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey
Galesic, M., & Bosnjak, M. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp031 · Cited by 1,297
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 463
Completion Time and Response Order Effects in Web Surveys
Malhotra, N. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn050 · Cited by 332
Engagement and retention: measuring breadth and depth of participant use of an online intervention
Couper, M. P., Alexander, G. L., Zhang, N., Little, R. J., Maddy, N., Nowak, M. A., McClure, J. B., Calvi, J. J., Rolnick, S. J., Stopponi, M. A., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1430 · Cited by 244
Metadata
- Authors
- Yan, T., & Tourangeau, R.
- Venue
- Applied Cognitive Psychology
- Publisher
- Wiley
- Published
- 2007-02-12
- Volume
- 22
- Issue
- 1
- Pages
- 51-68
- ISSN
- 0888-4080 (ISSN-L)
- 1099-0720
- OpenAlex
- W2171415274
- Cited by
- 286
- References
- 35
- FWCI
- 21.45
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.