The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Design Effects in the Transition to Web-Based Surveys
Abstract
Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers "out in the cold." This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“it has generated realistic prevalence estimates of mental disorders when used in public health services [32,45].”
From Mental disorders in foster children: a study of prevalence, comorbidity and risk factors (2013) · cites this paper as [45]
Citations
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
Self-citationMail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070232 · Cited by 3,238
Nielsen, J. (1999) · University of Maribor digital library (University of Maribor) · Cited by 1,620
To mix or not to mix data collection modes in surveys.
de Leeuw, E. D. (2005) · Journal of Official Statistics · Cited by 808
Web Survey Design and Administration
Couper, M. P., Traugott, M. W., & Lamias, M. J. (2001) · Public Opinion Quarterly · doi:10.1086/322199 · Cited by 785
Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation
Schwarz, N. (2014) · Medical Entomology and Zoology · Cited by 537
Survey Measurement and Process Quality
Ziegel, E. R., Lyberg, L. E., Biemer, P. P., Collins, M., de Leeuw, E. D., Dippo, C. S., Schwartz, N., & Trewin, D. (1998) · Technometrics · doi:10.2307/1271416 · Cited by 427
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 404
Data Quality in Mail, Telephone and Face to Face Surveys.
Leeuw, D., & de Leeuw, E. D. (1992) · Cited by 393
Cited by
Sorted by citations
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,535
Web-based Questionnaires: The Future in Epidemiology?
van Gelder, M. M. H. J., Bretveld, R. W., & Roeleveld, N. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq291 · Cited by 581
Saleh, A., & Bista, K. (2017) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v13i29.487 · Cited by 493
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 472
Advantages and limitations of web-based surveys: evidence from a child mental health survey
Heiervang, E., & Goodman, R. (2011) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-009-0171-9 · Cited by 263
Metadata
- Authors
- Dillman, D. A., & Smyth, J. D.
- Affiliations
- Washington State University (US)
- Corresponding author
- Dillman, Don A.
- ORCID
- Smyth, Jolene D.
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2007-05
- Volume
- 32
- Issue
- 5
- Pages
- S90-S96
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W2042687462
- Cited by
- 194
- References
- 29
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 9 · 2023: 10 · 2022: 11 · 2021: 12 · 2020: 12 · 2019: 12 · 2018: 6 · 2017: 8 · 2016: 4 · 2015: 16 · 2014: 10 · 2013: 10 · 2012: 16
- FWCI
- 30.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Lincoln (University of Nebraska) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- online surveys, measurement error, survey mode effects, question format, visual design, web survey design
- MeSH terms
- Data Collection, Medical Informatics, United States, User-Computer Interface, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review