Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
In this article, we present data from a three-mode survey comparison study carried out in 2010. National surveys were fielded at the same time over the Internet (using an opt-in Internet panel), by telephone with live interviews (using a national Random Digit Dialing (RDD) sample of landlines and cell phones), and by mail (using a national sample of residential addresses). Each survey utilized a nearly identical questionnaire soliciting information across a range of political and social indicators, many of which can be validated with government data. Comparing the findings from the modes using a Total Survey Error approach, we demonstrate that a carefully executed opt-in Internet panel produces estimates that are as accurate as a telephone survey and that the two modes differ little in their estimates of other political indicators and their correlates.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“YouGov uses a model-based sampling approach to produce matched, weighted samples that generalize extremely well to the US adult population”
From Rape or Homicide: Which Is Worse? (2024) · cites this paper as Ansolabehere & Schaffner, 2014
Citations
Cites
What Americans Know about Politics and Why It Matters
Brooks, C., Carpini, M. X. D., & Keeter, S. (1997) · Contemporary Sociology · doi:10.2307/2655098 · Cited by 4,437
Nonresponse rates and nonresponse bias in household surveys
Groves, R. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl033 · Cited by 2,420
What Americans know about politics and why it matters
(1996) · Choice Reviews Online · doi:10.5860/choice.34-0582 · Cited by 2,050
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Chang, L., & Krosnick, J. A. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp075 · Cited by 955
Changes in Telephone Survey Nonresponse over the Past Quarter Century
Curtin, R., Presser, S., & Singer, E. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi002 · Cited by 925
Yeager, D. S., Krosnick, J. A., Chang, L., Javitz, H. S., Levendusky, M. S., Simpser, A., & Wang, R. (2011) · Public Opinion Quarterly · doi:10.1093/poq/nfr020 · Cited by 758
Connections Between Internet Use and Political Efficacy, Knowledge, and Participation
Kenski, K., & Stroud, N. J. (2006) · Journal of Broadcasting & Electronic Media · doi:10.1207/s15506878jobem5002_1 · Cited by 751
Total Survey Error: Past, Present, and Future
Groves, R. M., & Lyberg, L. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq065 · Cited by 594
Total Survey Error: Design, Implementation, and Evaluation
Biemer, P. P. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq058 · Cited by 450
Malhotra, N., & Krosnick, J. A. (2007) · Political Analysis · doi:10.1093/pan/mpm003 · Cited by 268
Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study
Sanders, D., Clarke, H. D., Stewart, M. C., & Whiteley, P. (2007) · Political Analysis · doi:10.1093/pan/mpl010 · Cited by 259
Comparing Oral Interviewing with Self-Administered Computerized QuestionnairesAn Experiment
Chang, L., & Krosnick, J. A. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfp090 · Cited by 218
Blumberg, S. J., Luke, J. V., Ganesh, N., Davern, M. E., Boudreaux, M. H., & Soderberg, K. (2011) · PubMed · Cited by 153
Blumberg, S. J., Luke, J. V., Davidson, G. B., et al. (2009) · PubMed · Cited by 113
Alternative Modes for Health Surveillance Surveys
Link, M., & Mokdad, A. H. (2005) · Epidemiology · doi:10.1097/01.ede.0000172138.67080.7f · Cited by 111
Blumberg, S. J. (2021) · doi:10.15620/cdc:100855 · Cited by 110
Mail Questionnaires in Survey Research: A Review of Response Inducement Techniques
Duncan, W. J. (1979) · Journal of Management · doi:10.1177/014920637900500103 · Cited by 99
Refining the Total Survey Error Perspective
Smith, T. (2011) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edq052 · Cited by 84
Biffignandi, S., & Bethlehem, J. G. (2021) · Wiley eBooks · doi:10.1002/9781119371717.ch4 · Cited by 56
Atkeson, L. R., Adams, A. N., Bryant, L., Zilberman, L., & Saunders, K. L. (2010) · Political Behavior · doi:10.1007/s11109-010-9121-1 · Cited by 50
Josh Pasek, B., & Krosnick, J. A. (2010) · Cited by 23
Surveying Political Activists: The Effectiveness of a Mixed Mode Survey Design
Atkeson, L. R., & Tafoya, L. M. (2008) · Journal of Elections Public Opinion and Parties · doi:10.1080/17457280802305185 · Cited by 10
Research works printed but not linked: 3
- Rivers, 2009, Second thoughts about Internet surveys
- Chatt Cindy , Michael Dennis J. , Li Rick , and Pulliam Paul . 2003. Data collection mode effects controlling for sample origins in a panel survey: Telephone versus Internet. Paper presented at the Annual Meeting of the Midwest Chapter of the American Association for Public Opinion Research, Chicago.
- Groves, 2009, Survey Methodology
Cited by
Conspiracy Theories and the Paranoid Style(s) of Mass Opinion
Oliver, J. E., & Wood, T. J. (2014) · American Journal of Political Science · doi:10.1111/ajps.12084 · Cited by 877
Cornesse, C., Blom, A. G., Dutwin, D., Krosnick, J. A., De Leeuw, E. D., Legleye, S., Pasek, J., Pennay, D., Phillips, B., Sakshaug, J. W., et al. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz041 · Cited by 418
Extreme weather events and climate change concern
Konisky, D. M., Hughes, L., & Kaylor, C. H. (2016) · Climatic Change · doi:10.1007/s10584-015-1555-3 · Cited by 367
Mass support for global climate agreements depends on institutional design
Bechtel, M. M., & Scheve, K. F. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1306374110 · Cited by 350
Ansolabehere, S., & Rivers, D. (2013) · Annual Review of Political Science · doi:10.1146/annurev-polisci-022811-160625 · Cited by 257
Self-citation
Metadata
- Authors
- Ansolabehere, S., & Schaffner, B. F.
- Affiliations
- Harvard University (US)
- University of Massachusetts Amherst (US)
- Corresponding author
- Schaffner, Brian F.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2014
- Volume
- 22
- Issue
- 3
- Pages
- 285-303
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2092517937
- Semantic Scholar
- 87b83b77d780751adf895e5bb941f30107fc981b
- Cited by
- 573
- References
- 23
- Citations by year
- 2026: 25 · 2025: 34 · 2024: 40 · 2023: 40 · 2022: 84 · 2021: 52 · 2020: 48 · 2019: 59 · 2018: 54 · 2017: 39 · 2016: 38 · 2015: 25 · 2014: 23
- FWCI
- 135.17
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Political Analysis (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Keywords
- survey mode, online surveys, telephone surveys, mail surveys, total survey error, measurement error, survey accuracy, political indicators, social indicators, random digit dialing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.