The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Design Effects in the Transition to Web-Based Surveys
Abstract
Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers "out in the cold." This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“it has generated realistic prevalence estimates of mental disorders when used in public health services [32,45].”
From Mental disorders in foster children: a study of prevalence, comorbidity and risk factors (2013) · cites this paper as [45]
Citations
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
Self-citationMail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070232 · Cited by 3,238
Nielsen, J. (1999) · University of Maribor digital library (University of Maribor) · Cited by 1,620
To mix or not to mix data collection modes in surveys.
de Leeuw, E. D. (2005) · Journal of Official Statistics · Cited by 808
Web Survey Design and Administration
Couper, M. P., Traugott, M. W., & Lamias, M. J. (2001) · Public Opinion Quarterly · doi:10.1086/322199 · Cited by 785
Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation
Schwarz, N. (2014) · Medical Entomology and Zoology · Cited by 537
Survey Measurement and Process Quality
Ziegel, E. R., Lyberg, L. E., Biemer, P. P., Collins, M., de Leeuw, E. D., Dippo, C. S., Schwartz, N., & Trewin, D. (1998) · Technometrics · doi:10.2307/1271416 · Cited by 427
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 404
Data Quality in Mail, Telephone and Face to Face Surveys.
Leeuw, D., & de Leeuw, E. D. (1992) · Cited by 393
Cited by
Sorted by citations
Items 101–194 of 194
Survey of practice preferences in deep brain stimulation surgery in the United States
Howell, S. G., Tabibian, B. E., Mooney, J. H., Erickson, N. J., Walker, H. C., Guthrie, B. L., & Bentley, J. N. (2021) · Interdisciplinary Neurosurgery · doi:10.1016/j.inat.2021.101463 · Cited by 6
Keesler, J. M. (2015) · Intellectual and developmental disabilities · doi:10.1352/1934-9556-53.1.42 · Cited by 6
Nahm, E., Orwig, D., Resnick, B. M., Magaziner, J. S., Bellantoni, M. F., & Sterling, R. S. (2011) · Ageing International · doi:10.1007/s12126-011-9128-x · Cited by 6
Towe, S. L., & Stephens, R. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.02.628 · Cited by 6
Sevak, R. J., Nguyen, A. B., Randhawa, S., & O’Dell, K. M. (2022) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2022.09.006 · Cited by 6
Extreme response style bias in burn survivors
Ni, P., Marino, M., Dore, E. C., Sonis, L. A., Ryan, C. M., Schneider, J. C., Jette, A. M., & Kazis, L. E. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215898 · Cited by 5
“She’ll be right, mate!”: do Australians take their health for granted?
Harris, P., Salehi, A., Kendall, E. A., Whitty, J. A., Wilson, A. J., & Scuffham, P. (2020) · Journal of Primary Health Care · doi:10.1071/hc20025 · Cited by 5
Mooney, J. H., Laskay, N. M. B., Salehani, A. A., Shannon, C. N., & Rozzelle, C. J. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2022.12.084 · Cited by 5
Fakhfakh, M., Blanchette, V., Plourde, K. V., Gadio, S., Elf, M., Jones, C. A., Meijering, L., Giguere, A. M. C., & Légaré, F. (2022) · JMIR Aging · doi:10.2196/43106 · Cited by 5
Catania, G., Bagnasco, A., Signori, A., Pilastri, P., Bottino, M., Cervetti, C., Zanini, M. P., Aleo, G., & Sasso, L. (2017) · Pilot and Feasibility Studies · doi:10.1186/s40814-017-0196-x · Cited by 5
A Web-based survey on students' conceptions of ‘accident’
Blank, D., Neto, G. H., Grando, E., Siqueira, P. Z., Lunkes, R. P., Pietrobeli, J. L. F., Marzola, N. R., & Goldani, M. Z. (2009) · Informatics for Health and Social Care · doi:10.3109/17538150903358057 · Cited by 6
Are Internet Surveys an Alternative to Face-to Face Interviews in Contingent Valuation?Preprint
Lindhjem, H., & Ståle Navrud, A. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1295521 · Cited by 4
Edeoghon, D., & Mishra, D. B. (2026) · Supply Chain Forum an International Journal · doi:10.1080/16258312.2026.2621653 · Cited by 4
Rigo, C., Grazioli, M., Caravella, G., Ursino, F., Zerla, P. A., Magon, A., Dellafiore, F., & Caruso, R. (2021) · The Journal of Vascular Access · doi:10.1177/11297298211026447 · Cited by 3
High impact of a start-up journal: Surprisingly so?
Reips, U., & Matzat, U. (2008) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-19678 · Cited by 3
Delirium in Acute Stroke: A Survey of Screening and Diagnostic Practice in Scotland
Carin-Levy, G., Nicol, K., van Wijck, F., & Mead, G. E. (2013) · ISRN Stroke · doi:10.1155/2013/620186 · Cited by 3
Tillier, C. N. (2015) · International Journal of Cancer and Clinical Research · doi:10.23937/2378-3419/2/2/1015 · Cited by 3
Avera Twin Register Growing Through Online Consenting and Survey Collection
Kittelsrud, J. M., Ehli, E. A., Petersen, V., Jung, T., Beck, J. J., Kallsen, N. A., Huizenga, P. E., Holm, B., & Davies, G. E. (2019) · Twin Research and Human Genetics · doi:10.1017/thg.2019.73 · Cited by 3
Mabardy, R. A. (2013) · Cited by 3
Online Employee Surveys and Online Feedback
Batinic, B., & Kovacs, C. (2017) · Wiley eBooks · doi:10.1002/9781119256151.ch16 · Cited by 3
Kastner, M., Makarski, J., Mossman, K., Harris, K., Hayden, L., Giraldo, M., Sharma, D., Asalya, M., Jussaume, L., Eisen, D., et al. (2020) · Research Square · doi:10.21203/rs.3.rs-63468/v1 · Cited by 3
Piscitello, J., Heyman, R. E., Slep, A. M. S., & Hogan, J. N. (2025) · Military Medicine · doi:10.1093/milmed/usaf182 · Cited by 2
Ernandez, J. J., Gu, C., & Kathrins, M. N. (2022) · Andrologia · doi:10.1111/and.14474 · Cited by 2
Social Media Influence on Personal Security among the Youth in Nairobi City County, Kenya
Soita, S., & Njoroge, H. (2023) · East African Journal of Information Technology · doi:10.37284/eajit.6.1.1112 · Cited by 2
Flye, M. E., Sponarski, C. C., & Zydlewski, J. (2024) · Marine Policy · doi:10.1016/j.marpol.2024.106424 · Cited by 2
Teacher leadership behaviors and proactive influence tactics in North Carolina public schools
Dohlen, V., & Beth, H. (2012) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) · Cited by 2
The Impact of Pictures on Best-Worst Scaling in Web Surveys
Bărbulescu, M., & Cernat, A. (2012) · International Review of Social Research · doi:10.1515/irsr-2012-0028 · Cited by 2
Peeters, M., Iturrospe, E., Jans, D. M., van Nuijs, A. L. N., & Loof, H. D. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08596-w · Cited by 2
Goolsby, C. A., Schuler, K. L., Tilley, L. C., Zebrowski, A. M., Dacuyan‐Faucher, N., Kim, C., & Redlener, M. (2022) · Disaster Medicine and Public Health Preparedness · doi:10.1017/dmp.2022.246 · Cited by 3
Walia, H., Miller, R., Tumin, D., Tobias, J. D., & Sebastian, R. (2018) · Drug Healthcare and Patient Safety · doi:10.2147/dhps.s160500 · Cited by 2
Ladd, D. A. (2009) · Journal of the Association for Information Systems · Cited by 3
Conducting Survey Research Using MTurk
Chambers, S., & Nimon, K. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8362-2.ch022 · Cited by 2
Conducting Survey Research Using MTurk
Chambers, S., & Nimon, K. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8182-6.ch033 · Cited by 2
Oncology Nurses' Cultural Competence, Knowledge, and Attitudes Toward Cancer Pain
Alnems, A. (2012) · doi:10.22371/07.2012.001 · Cited by 2
Schumm, W. R., Scoglio, C., Schumm, P. R. B., Theodore, V. P., & Roy, R. N. (2025) · Marriage & Family Review · doi:10.1080/01494929.2025.2577673 · Cited by 1
Lorenzo, R., Pizzi, C., & Paolotti, D. (2014) · Cited by 1
Venable, M. A. (2007) · Digital Commons - University of South Florida (University of South Florida) · Cited by 1
Shane McIvera, A. (2017) · International Journal of Complementary & Alternative Medicine · doi:10.15406/ijcam.2017.08.00283 · Cited by 1
Emergence of AI enabled smart buildings in India: a road towards sustainable performance
Gupta, A., & Tandon, U. (2023) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-07-2023-0236 · Cited by 1
Turegeldinova, A., Amralinova, B., Fodor, M., Rakhmetullina, S., Konurbayeva, Z., & Kiizbayeva, Z. (2024) · Frontiers in Communication · doi:10.3389/fcomm.2024.1507039 · Cited by 8
Bolling, M. (2022) · Digital Archive @ GSU · doi:10.57709/4689158 · Cited by 1
Moore, R., & Bering, P. (2017) · Open Journal of Stomatology · doi:10.4236/ojst.2017.712050 · Cited by 1
Thornton, M. (2017) · UNM’s Digital Repository (University of New Mexico) · Cited by 1
Richiardi, L., Pizzi, C., & Paolotti, D. (2013) · Springer eBooks · doi:10.1007/978-0-387-09834-0_59 · Cited by 1
Whitman, Z. (2014) · UC Research Repository (University of Canterbury) · doi:10.26021/8624 · Cited by 1
Oceans and Human Health: Harmful Algal Blooms and Acute Health Symptoms Among Surfers and Lifeguards
O'Halloran, C. L. (2011) · eScholarship (California Digital Library) · Cited by 1
Previously Reported Data Usage in NASS Field OfficesPreprint
Gottschall, C., & Gottschall, C. (2009) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.234377 · Cited by 1
Kurup, P. D. (2012) · OakTrust (Texas A&M University Libraries) · Cited by 1
Understanding the Role of Social Media in Enhancing Participatory Services in Public Libraries
Zou, H. (2019) · Queensland University of Technology · doi:10.5204/thesis.eprints.134413 · Cited by 1
Santos, H. C., Mestechkin, R. M., Vogt-Yerem, R. L., Rosica, D., Heck, P. R., Heydari, P., Brown, M. I., Rosenbaum, G. M., Shermohammed, M., Meyer, M. N., et al. (2023) · doi:10.31234/osf.io/ga6b2 · Cited by 2
From Patient Reported Outcome Measures to individualized prostate cancer care
Tillier, C. (2024) · doi:10.5463/thesis.760 · Cited by 1
Institutional and Patient Level Predictors of Multi-Drug Resistant Healthcare-Associated Infections
Pogorzelska‐Maziarz, M. (2011) · doi:10.7916/d84t6rbd
Gustafson, B. (2015) · HARVEST (University of Saskatchewan)
Hoe lezen en waarderen aios huisartsgeneeskunde Huisarts en Wetenschap?
Jongebreur, K. (2008) · Huisarts en Wetenschap · doi:10.1007/bf03086782
Arboleda, F. E. C., & Jacobo-Bastreri, O. (2014) · Cirugía Plástica Ibero-Latinoamericana · doi:10.4321/s0376-78922014000400010
Alkherayf, F. A. (2012) · uO Research (University of Ottawa) · doi:10.20381/ruor-6254
Lundquist, B. L. (2015) · University Library - University of Saskatchewan (University of Saskatchewan)
How Family Physicians in Saskatchewan Make Lung Cancer Screening Decisions
Jamil, N. (2015) · Scholarship@Western (Western University)
Investigating the Decision-Making Processes That Contribute to Impaired Driving
Duckworth, M. P., Renqvist, J. G., & Dahir, V. B. (2015)
Atkins, C. A. (2014) · OakTrust (Texas A&M University Libraries)
Barriers to English housing energy efficiency: stakeholders' perspectives
Thakore, R., Goulding, J. S., & Toogood, M. (2015) · International Journal of Markets and Business Systems · doi:10.1504/ijmabs.2015.074214
Correlates of Family-School Partnerships in Special Education
Burke, M. M. (2012)
Benchmarking the Kansas 4-H Judging System
Taylor, A. M., & Blackwell, C. (2009) · Journal of Youth Development · doi:10.5195/jyd.2009.245
Controlled Protein Hydrolysis with Immobilized Alkaline Endo-Protease
Odaneth, A. A. (2017) · Journal of Applied Biotechnology & Bioengineering · doi:10.15406/jabb.2017.02.00028
Sociocognitive Relevance of Information Literacy: The Impact on Student Academic Work
Kaufmann, K. F. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.123999
Correlates of subjective hepatitis C knowledge among clinical staff in US drug treatment programs
Lian, Z., Li, C., & Frimpong, J. A. (2019) · Journal of Public Health · doi:10.1007/s10389-019-01032-0
Clinical Management and Measurement of Upper Limb Disability in Neck Pain Patients
Alreni, A. S. E. (2018) · Sheffield Hallam University · doi:10.7190/shu-thesis-00140
Efectos de respuesta en cuestionarios con preguntas de actitud
Igúzquiza, V. D. D. R. (2020) · Papers Revista de Sociologia · doi:10.5565/rev/papers.2605
Smalley, H. K., Emerson, S. C., & Lesser, V. M. (2021) · doi:10.1093/oso/9780198859987.003.0013
Marchant, A. L. (2020) · Cronfa (Swansea University) · doi:10.23889/suthesis.56821
A Primer for Conducting Survey Research Using MTurk
Chambers, S., Nimon, K., & Anthony-McMann, P. E. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8362-2.ch038
Effect of Strategic Management on Organization Productivity from a Work from Home PerspectivePreprint
Gachanja, C., & Kirima, L. K. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4159000
Westby, M. D., Lalande, J.-F., Koehn, C. L., & Johal, N. (2023) · Physiotherapy Canada · doi:10.3138/ptc-2022-0083 · Cited by 2
O'Connor, A., Curran, M., White, J., & Meekel, S. (2023) · EPiC series in built environment · doi:10.29007/vq82
Jumah, K., Alden, A., Mohamed, S. A., & Ahmad, M. (2023) · International Journal for Quality Assurance · doi:10.34028/6/2/261
Sepucha, K., Callans, K. M., Leavitt, L., Chang, Y., Vo, H., Brigger, M. T., Broughton, S., Cahill, J., Chinnadurai, S., Germann, J., et al. (2024) · Trials · doi:10.1186/s13063-024-08522-x
Decision making in web survey participation of undergraduate students
Fan, W. (2013) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/15qt-fdbq
Texas High School Coaches’ Perceptions of Sport Psychology Services
Ferner, K. A. (2025) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2443378
The Impact of Knowledge Management Processes on Employee Performance at Zarqa University
Ahmad, A. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa2025/8/1/282
A culture of quality between tradition and modernity
Dardas, A. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa2025/8/1-287
Isbeetan, T. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa2025/8/1-289
Alrafayia, O. A., & Rashaideh, N. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa2025/8/1-283
The Impact of Knowledge Management Processes on Employee Performance at Zarqa University
Ahmad, A. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa/8/1/282
A culture of quality between tradition and modernity
Dardas, A. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa/8/1/287
Isbeetan, T. (2025) · International Journal for Quality Assurance · doi:10.34028/ijqa/8/1/289
Kastner, M., Makarski, J., Hayden, L., Lai, Y., Chan, J., Treister, V., Harris, K., Munce, S., Holroyd-Leduc, J., Graham, I. D., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12276935
Attitudes Towards Medical Research Participation Among Those With Down Syndrome and Their Caregivers
Koenig, K. A., Bekris, L. M., Sajatovic, M., & Leverenz, J. B. (2025) · Journal of Policy and Practice in Intellectual Disabilities · doi:10.1111/jppi.70035
Mahoney, L. B., Lightdale, J. R., Rubinstein, E., Carman, N., Kim, J., Altaf, M. A., Bhardwaj, V., Bolton, S. M., CaJacob, N., Chiou, E., et al. (2026) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1002/jpn3.70323
Teimourzadeh, A. (2018) · theses.fr (ABES) · doi:10.70675/0919fcc7z504cz4b96z83b9z65a33dc9ef78
Havi, M., Mirjat, S. A., Mirjat, S. A., & Ahmed, J. (2026) · The Asian Bulletin of Big Data Management · doi:10.62019/8mejmg23
Crespo, V. G., Grande, A. A., & Guede, J. R. S. (2026) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-12-2025-1227
Metadata
- Authors
- Dillman, D. A., & Smyth, J. D.
- Affiliations
- Washington State University (US)
- Corresponding author
- Dillman, Don A.
- ORCID
- Smyth, Jolene D.
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2007-05
- Volume
- 32
- Issue
- 5
- Pages
- S90-S96
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W2042687462
- Cited by
- 194
- References
- 29
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 9 · 2023: 10 · 2022: 11 · 2021: 12 · 2020: 12 · 2019: 12 · 2018: 6 · 2017: 8 · 2016: 4 · 2015: 16 · 2014: 10 · 2013: 10 · 2012: 16
- FWCI
- 30.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Lincoln (University of Nebraska) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- online surveys, measurement error, survey mode effects, question format, visual design, web survey design
- MeSH terms
- Data Collection, Medical Informatics, United States, User-Computer Interface, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review